2024-04-18T04:28:16.107 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-18T04:28:16.107 DEBUG:teuthology.run:Teuthology command: teuthology --name teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi --verbose --owner scheduled_teuthology@teuthology --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/ffsb}} --archive /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661522 -- /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661522/orig.config.yaml 2024-04-18T04:28:16.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T04:28:16.252 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661522 branch: reef description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/ffsb}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7661522' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: reef ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: false mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: false mds_sleep_rank_change: 5000000.0 mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 filestore flush min: 0 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - Replacing daemon mds - SLOW_OPS - slow request sha1: 56a91dd158be807f143cc918a11685fc9ee164ae ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: 56a91dd158be807f143cc918a11685fc9ee164ae kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef sha1: 646b8c7d293d8ec31a40c69f7b3237b19c1be24d owner: scheduled_teuthology@teuthology priority: 930 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 5203 sha1: 56a91dd158be807f143cc918a11685fc9ee164ae sleep_before_teardown: 0 subset: 88/512 suite: fs suite_branch: reef suite_path: /home/teuthworker/src/git.ceph.com_ceph_646b8c7d293d8ec31a40c69f7b3237b19c1be24d/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 646b8c7d293d8ec31a40c69f7b3237b19c1be24d syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi120.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHANrs/xll16DEgmxjynlkdARTOaFmeRfeFhHVfwT++ABVzjk3IEbQX/EF1eynzepQqAjIJ+7wXEVeez1lYX8UY= smithi132.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA+I8upALm3bviZVBX1sO1bIoTpNe0J/l7IJXwELLFA4H9YSVNOClwO8zFYqHHY0vbXVWd/ghnU9t1UN9cZzJkg= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - mds_thrash: null - workunit: clients: all: - suites/ffsb.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-17_22:24:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-18T04:28:16.252 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_646b8c7d293d8ec31a40c69f7b3237b19c1be24d/qa; will attempt to use it 2024-04-18T04:28:16.253 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_646b8c7d293d8ec31a40c69f7b3237b19c1be24d/qa/tasks 2024-04-18T04:28:16.253 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-18T04:28:16.255 INFO:teuthology.task.internal:Checking packages... 2024-04-18T04:28:16.279 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '56a91dd158be807f143cc918a11685fc9ee164ae' 2024-04-18T04:28:16.279 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-18T04:28:16.279 INFO:teuthology.packaging:ref: None 2024-04-18T04:28:16.279 INFO:teuthology.packaging:tag: None 2024-04-18T04:28:16.279 INFO:teuthology.packaging:branch: reef 2024-04-18T04:28:16.279 INFO:teuthology.packaging:sha1: 56a91dd158be807f143cc918a11685fc9ee164ae 2024-04-18T04:28:16.279 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=reef 2024-04-18T04:28:16.628 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1237-g646b8c7d-1jammy 2024-04-18T04:28:16.629 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-18T04:28:16.638 INFO:teuthology.task.internal:no buildpackages task found 2024-04-18T04:28:16.638 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-18T04:28:16.659 INFO:teuthology.task.internal:Saving configuration 2024-04-18T04:28:16.678 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-18T04:28:16.686 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-18T04:28:16.711 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi120.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661522', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-18 04:22:37.758039', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIECxqz6Fnx12Hlv9tMAWdwBzPlLE1CqeJMGuGojXe4BI'} 2024-04-18T04:28:16.736 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661522', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-18 04:22:37.759676', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFQXxHSclPEM9eo2rwsohm2DJ5c/PaHkDQMuH4wTZyL2'} 2024-04-18T04:28:16.737 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-18T04:28:16.748 INFO:teuthology.task.internal:roles: ubuntu@smithi120.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-18T04:28:16.748 INFO:teuthology.task.internal:roles: ubuntu@smithi132.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-18T04:28:16.748 INFO:teuthology.run_tasks:Running task console_log... 2024-04-18T04:28:16.827 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f42cfc17ee0>, signals=[15]) 2024-04-18T04:28:16.828 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-18T04:28:16.835 INFO:teuthology.task.internal:Opening connections... 2024-04-18T04:28:16.836 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi120.front.sepia.ceph.com 2024-04-18T04:28:16.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:28:16.922 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi132.front.sepia.ceph.com 2024-04-18T04:28:16.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:28:17.001 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-18T04:28:17.009 DEBUG:teuthology.orchestra.run.smithi120:> uname -m 2024-04-18T04:28:17.014 INFO:teuthology.orchestra.run.smithi120.stdout:x86_64 2024-04-18T04:28:17.014 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2024-04-18T04:28:17.060 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-18T04:28:17.060 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="Ubuntu" 2024-04-18T04:28:17.060 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="22.04" 2024-04-18T04:28:17.061 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-18T04:28:17.061 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_CODENAME=jammy 2024-04-18T04:28:17.061 INFO:teuthology.orchestra.run.smithi120.stdout:ID=ubuntu 2024-04-18T04:28:17.061 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE=debian 2024-04-18T04:28:17.061 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-18T04:28:17.061 INFO:teuthology.orchestra.run.smithi120.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-18T04:28:17.061 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-18T04:28:17.061 INFO:teuthology.orchestra.run.smithi120.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-18T04:28:17.061 INFO:teuthology.orchestra.run.smithi120.stdout:UBUNTU_CODENAME=jammy 2024-04-18T04:28:17.062 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2024-04-18T04:28:17.089 DEBUG:teuthology.orchestra.run.smithi132:> uname -m 2024-04-18T04:28:17.094 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2024-04-18T04:28:17.095 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2024-04-18T04:28:17.142 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-18T04:28:17.142 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="Ubuntu" 2024-04-18T04:28:17.142 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="22.04" 2024-04-18T04:28:17.142 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-18T04:28:17.143 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_CODENAME=jammy 2024-04-18T04:28:17.143 INFO:teuthology.orchestra.run.smithi132.stdout:ID=ubuntu 2024-04-18T04:28:17.143 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE=debian 2024-04-18T04:28:17.143 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-18T04:28:17.143 INFO:teuthology.orchestra.run.smithi132.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-18T04:28:17.143 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-18T04:28:17.143 INFO:teuthology.orchestra.run.smithi132.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-18T04:28:17.143 INFO:teuthology.orchestra.run.smithi132.stdout:UBUNTU_CODENAME=jammy 2024-04-18T04:28:17.143 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2024-04-18T04:28:17.163 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-18T04:28:17.173 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-18T04:28:17.181 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-18T04:28:17.182 DEBUG:teuthology.orchestra.run.smithi120:> test '!' -e /home/ubuntu/cephtest 2024-04-18T04:28:17.184 DEBUG:teuthology.orchestra.run.smithi132:> test '!' -e /home/ubuntu/cephtest 2024-04-18T04:28:17.189 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-18T04:28:17.196 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-18T04:28:17.197 DEBUG:teuthology.orchestra.run.smithi120:> test -z $(ls -A /var/lib/ceph) 2024-04-18T04:28:17.230 DEBUG:teuthology.orchestra.run.smithi132:> test -z $(ls -A /var/lib/ceph) 2024-04-18T04:28:17.239 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-18T04:28:17.297 INFO:teuthology.run_tasks:Running task kernel... 2024-04-18T04:28:17.314 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-04-18T04:28:17.314 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-04-18T04:28:17.314 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-04-18T04:28:17.314 DEBUG:teuthology.orchestra.run.smithi120:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-18T04:28:17.319 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T04:28:17.320 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-04-18T04:28:17.568 DEBUG:teuthology.task.kernel:sha1 for client.0 is 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-18T04:28:17.569 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8"... 2024-04-18T04:28:17.569 DEBUG:teuthology.orchestra.run.smithi120:> uname -r 2024-04-18T04:28:17.575 INFO:teuthology.orchestra.run.smithi120.stdout:5.15.0-56-generic 2024-04-18T04:28:17.575 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-18T04:28:17.575 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-18T04:28:17.576 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-04-18T04:28:17.576 DEBUG:teuthology.orchestra.run.smithi120:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-04-18T04:28:17.633 INFO:teuthology.orchestra.run.smithi120.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-04-18T04:28:17.773 INFO:teuthology.orchestra.run.smithi120.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-04-18T04:28:17.773 INFO:teuthology.orchestra.run.smithi120.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-04-18T04:28:17.773 INFO:teuthology.orchestra.run.smithi120.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-04-18T04:28:17.773 INFO:teuthology.orchestra.run.smithi120.stderr:hint: 2024-04-18T04:28:17.773 INFO:teuthology.orchestra.run.smithi120.stderr:hint: git config --global init.defaultBranch 2024-04-18T04:28:17.773 INFO:teuthology.orchestra.run.smithi120.stderr:hint: 2024-04-18T04:28:17.773 INFO:teuthology.orchestra.run.smithi120.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-04-18T04:28:17.773 INFO:teuthology.orchestra.run.smithi120.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-04-18T04:28:17.774 INFO:teuthology.orchestra.run.smithi120.stderr:hint: 2024-04-18T04:28:17.774 INFO:teuthology.orchestra.run.smithi120.stderr:hint: git branch -m 2024-04-18T04:28:17.774 INFO:teuthology.orchestra.run.smithi120.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-04-18T04:28:17.776 DEBUG:teuthology.orchestra.run.smithi120:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-04-18T04:28:17.850 DEBUG:teuthology.orchestra.run.smithi120:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-04-18T04:28:17.909 DEBUG:teuthology.orchestra.run.smithi120:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-04-18T04:30:28.132 INFO:teuthology.orchestra.run.smithi120.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-04-18T04:30:28.132 INFO:teuthology.orchestra.run.smithi120.stderr: * [new branch] main -> origin/main 2024-04-18T04:30:28.159 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20190312 -> 20190312 2024-04-18T04:30:28.159 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20190416 -> 20190416 2024-04-18T04:30:28.160 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20190514 -> 20190514 2024-04-18T04:30:28.160 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20190618 -> 20190618 2024-04-18T04:30:28.160 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20190717 -> 20190717 2024-04-18T04:30:28.160 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20190815 -> 20190815 2024-04-18T04:30:28.160 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20190923 -> 20190923 2024-04-18T04:30:28.160 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20191022 -> 20191022 2024-04-18T04:30:28.160 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20191215 -> 20191215 2024-04-18T04:30:28.163 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20200122 -> 20200122 2024-04-18T04:30:28.163 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20200316 -> 20200316 2024-04-18T04:30:28.163 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20200421 -> 20200421 2024-04-18T04:30:28.163 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20200519 -> 20200519 2024-04-18T04:30:28.163 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20200619 -> 20200619 2024-04-18T04:30:28.163 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20200721 -> 20200721 2024-04-18T04:30:28.163 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20200817 -> 20200817 2024-04-18T04:30:28.163 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20200918 -> 20200918 2024-04-18T04:30:28.163 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20201022 -> 20201022 2024-04-18T04:30:28.163 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20201118 -> 20201118 2024-04-18T04:30:28.164 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20201218 -> 20201218 2024-04-18T04:30:28.164 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20210208 -> 20210208 2024-04-18T04:30:28.164 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20210315 -> 20210315 2024-04-18T04:30:28.164 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20210511 -> 20210511 2024-04-18T04:30:28.164 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20210716 -> 20210716 2024-04-18T04:30:28.164 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20210818 -> 20210818 2024-04-18T04:30:28.164 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20210919 -> 20210919 2024-04-18T04:30:28.164 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20211027 -> 20211027 2024-04-18T04:30:28.164 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20211216 -> 20211216 2024-04-18T04:30:28.164 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20220209 -> 20220209 2024-04-18T04:30:28.164 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20220310 -> 20220310 2024-04-18T04:30:28.164 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20220411 -> 20220411 2024-04-18T04:30:28.164 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20220509 -> 20220509 2024-04-18T04:30:28.164 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20220610 -> 20220610 2024-04-18T04:30:28.165 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20220708 -> 20220708 2024-04-18T04:30:28.167 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20220815 -> 20220815 2024-04-18T04:30:28.167 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20220913 -> 20220913 2024-04-18T04:30:28.167 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20221012 -> 20221012 2024-04-18T04:30:28.168 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20221109 -> 20221109 2024-04-18T04:30:28.168 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20221214 -> 20221214 2024-04-18T04:30:28.168 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20230117 -> 20230117 2024-04-18T04:30:28.168 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20230210 -> 20230210 2024-04-18T04:30:28.168 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20230310 -> 20230310 2024-04-18T04:30:28.168 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20230404 -> 20230404 2024-04-18T04:30:28.168 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20230515 -> 20230515 2024-04-18T04:30:28.168 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20230625 -> 20230625 2024-04-18T04:30:28.168 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20230804 -> 20230804 2024-04-18T04:30:28.168 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20230919 -> 20230919 2024-04-18T04:30:28.168 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20231030 -> 20231030 2024-04-18T04:30:28.168 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20231111 -> 20231111 2024-04-18T04:30:28.168 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20231211 -> 20231211 2024-04-18T04:30:28.168 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20240115 -> 20240115 2024-04-18T04:30:28.169 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20240220 -> 20240220 2024-04-18T04:30:28.169 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20240312 -> 20240312 2024-04-18T04:30:28.169 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20240410 -> 20240410 2024-04-18T04:30:32.349 INFO:teuthology.orchestra.run.smithi120.stderr:Updating files: 50% (1823/3609) Updating files: 51% (1841/3609) Updating files: 52% (1877/3609) Updating files: 53% (1913/3609) Updating files: 54% (1949/3609) Updating files: 55% (1985/3609) Updating files: 56% (2022/3609) Updating files: 57% (2058/3609) Updating files: 58% (2094/3609) Updating files: 59% (2130/3609) Updating files: 60% (2166/3609) Updating files: 61% (2202/3609) Updating files: 62% (2238/3609) Updating files: 63% (2274/3609) Updating files: 63% (2308/3609) Updating files: 64% (2310/3609) Updating files: 65% (2346/3609) Updating files: 66% (2382/3609) Updating files: 67% (2419/3609) Updating files: 68% (2455/3609) Updating files: 69% (2491/3609) Updating files: 70% (2527/3609) Updating files: 71% (2563/3609) Updating files: 72% (2599/3609) Updating files: 73% (2635/3609) Updating files: 74% (2671/3609) Updating files: 75% (2707/3609) Updating files: 76% (2743/3609) Updating files: 77% (2779/3609) Updating files: 77% (2796/3609) Updating files: 78% (2816/3609) Updating files: 79% (2852/3609) Updating files: 80% (2888/3609) Updating files: 81% (2924/3609) Updating files: 82% (2960/3609) Updating files: 83% (2996/3609) Updating files: 84% (3032/3609) Updating files: 85% (3068/3609) Updating files: 86% (3104/3609) Updating files: 87% (3140/3609) Updating files: 88% (3176/3609) Updating files: 89% (3213/3609) Updating files: 90% (3249/3609) Updating files: 91% (3285/3609) Updating files: 91% (3316/3609) Updating files: 92% (3321/3609) Updating files: 93% (3357/3609) Updating files: 94% (3393/3609) Updating files: 95% (3429/3609) Updating files: 96% (3465/3609) Updating files: 97% (3501/3609) Updating files: 98% (3537/3609) Updating files: 99% (3573/3609) Updating files: 100% (3609/3609) Updating files: 100% (3609/3609), done. 2024-04-18T04:30:32.354 INFO:teuthology.orchestra.run.smithi120.stdout:HEAD is now at e6786998 Merge branch 'mt7922' into 'main' 2024-04-18T04:30:32.375 INFO:teuthology.task.kernel:Downloading kernel 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 on client.0... 2024-04-18T04:30:32.375 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-18T04:30:32.518 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g3f60ed14f7c1/ 2024-04-18T04:30:32.519 DEBUG:teuthology.orchestra.run.smithi120:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-rc3-g3f60ed14f7c1_6.9.0-rc3-g3f60ed14f7c1-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://1.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g3f60ed14f7c1/ --input-file=- 2024-04-18T04:30:32.521 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi120.front.sepia.ceph.com to complete... 2024-04-18T04:30:35.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18 04:30:35 URL:https://1.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g3f60ed14f7c1/linux-image-6.9.0-rc3-g3f60ed14f7c1_6.9.0-rc3-g3f60ed14f7c1-1_amd64.deb [44839714/44839714] -> "/tmp/linux-image.deb" [1] 2024-04-18T04:30:35.128 INFO:teuthology.orchestra.run.smithi120.stderr:FINISHED --2024-04-18 04:30:35-- 2024-04-18T04:30:35.128 INFO:teuthology.orchestra.run.smithi120.stderr:Total wall clock time: 2.6s 2024-04-18T04:30:35.128 INFO:teuthology.orchestra.run.smithi120.stderr:Downloaded: 1 files, 43M in 2.4s (18.1 MB/s) 2024-04-18T04:30:35.132 INFO:teuthology.task.kernel:Installing kernel 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 on client.0... 2024-04-18T04:30:35.132 DEBUG:teuthology.orchestra.run.smithi120:> sudo dpkg -i /tmp/linux-image.deb 2024-04-18T04:30:35.406 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package linux-image-6.9.0-rc3-g3f60ed14f7c1. 2024-04-18T04:30:37.424 INFO:teuthology.orchestra.run.smithi120.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-04-18T04:30:37.428 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-04-18T04:30:37.698 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking linux-image-6.9.0-rc3-g3f60ed14f7c1 (6.9.0-rc3-g3f60ed14f7c1-1) ... 2024-04-18T04:30:41.463 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up linux-image-6.9.0-rc3-g3f60ed14f7c1 (6.9.0-rc3-g3f60ed14f7c1-1) ... 2024-04-18T04:30:41.604 INFO:teuthology.orchestra.run.smithi120.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-rc3-g3f60ed14f7c1 2024-04-18T04:31:04.381 INFO:teuthology.orchestra.run.smithi120.stderr:Sourcing file `/etc/default/grub' 2024-04-18T04:31:04.397 INFO:teuthology.orchestra.run.smithi120.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-18T04:31:04.418 INFO:teuthology.orchestra.run.smithi120.stderr:Generating grub configuration file ... 2024-04-18T04:31:04.733 INFO:teuthology.orchestra.run.smithi120.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g3f60ed14f7c1 2024-04-18T04:31:04.748 INFO:teuthology.orchestra.run.smithi120.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g3f60ed14f7c1 2024-04-18T04:31:05.021 INFO:teuthology.orchestra.run.smithi120.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-18T04:31:05.031 INFO:teuthology.orchestra.run.smithi120.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-18T04:31:05.091 INFO:teuthology.orchestra.run.smithi120.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-18T04:31:05.097 INFO:teuthology.orchestra.run.smithi120.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-18T04:31:05.282 INFO:teuthology.orchestra.run.smithi120.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-18T04:31:05.282 INFO:teuthology.orchestra.run.smithi120.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-18T04:31:05.282 INFO:teuthology.orchestra.run.smithi120.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-18T04:31:05.330 INFO:teuthology.orchestra.run.smithi120.stderr:done 2024-04-18T04:31:05.539 DEBUG:teuthology.orchestra.run.smithi120:> dpkg-deb -c /tmp/linux-image.deb 2024-04-18T04:31:05.546 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./ 2024-04-18T04:31:05.546 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./boot/ 2024-04-18T04:31:05.547 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7002012 2024-04-11 18:50 ./boot/System.map-6.9.0-rc3-g3f60ed14f7c1 2024-04-18T04:31:05.564 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 172073 2024-04-11 18:50 ./boot/config-6.9.0-rc3-g3f60ed14f7c1 2024-04-18T04:31:05.564 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13120512 2024-04-11 18:50 ./boot/vmlinuz-6.9.0-rc3-g3f60ed14f7c1 2024-04-18T04:31:05.583 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./etc/ 2024-04-18T04:31:05.583 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./etc/kernel/ 2024-04-18T04:31:05.583 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./etc/kernel/postinst.d/ 2024-04-18T04:31:05.584 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./etc/kernel/postrm.d/ 2024-04-18T04:31:05.584 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./etc/kernel/preinst.d/ 2024-04-18T04:31:05.584 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./etc/kernel/prerm.d/ 2024-04-18T04:31:05.584 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/ 2024-04-18T04:31:05.584 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/ 2024-04-18T04:31:05.584 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/ 2024-04-18T04:31:05.584 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/ 2024-04-18T04:31:05.584 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/ 2024-04-18T04:31:05.584 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/ 2024-04-18T04:31:05.584 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/ 2024-04-18T04:31:05.584 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 507569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/aesni-intel.ko 2024-04-18T04:31:05.587 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-18T04:31:05.587 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 34313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-18T04:31:05.587 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 35009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-18T04:31:05.588 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 97953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-18T04:31:05.588 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 109905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-18T04:31:05.588 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 155249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-18T04:31:05.588 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-18T04:31:05.588 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-18T04:31:05.588 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 87009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-18T04:31:05.588 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-18T04:31:05.588 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 50305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-18T04:31:05.588 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 50377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-18T04:31:05.588 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 54513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-18T04:31:05.588 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 44657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-18T04:31:05.588 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 48049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-18T04:31:05.588 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 62873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-18T04:31:05.589 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 53569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-18T04:31:05.589 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 34761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-18T04:31:05.589 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-18T04:31:05.589 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/ 2024-04-18T04:31:05.589 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu/ 2024-04-18T04:31:05.589 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu/mce/ 2024-04-18T04:31:05.589 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 49081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-18T04:31:05.589 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpuid.ko 2024-04-18T04:31:05.589 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/msr.ko 2024-04-18T04:31:05.589 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/ 2024-04-18T04:31:05.589 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 444425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-18T04:31:05.589 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 1035881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-18T04:31:05.590 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 2849609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm.ko 2024-04-18T04:31:05.605 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/ 2024-04-18T04:31:05.605 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 65025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/af_alg.ko 2024-04-18T04:31:05.605 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 27961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/algif_hash.ko 2024-04-18T04:31:05.605 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/algif_skcipher.ko 2024-04-18T04:31:05.605 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/ansi_cprng.ko 2024-04-18T04:31:05.605 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/anubis.ko 2024-04-18T04:31:05.605 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/arc4.ko 2024-04-18T04:31:05.606 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/asymmetric_keys/ 2024-04-18T04:31:05.606 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-04-18T04:31:05.606 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/ 2024-04-18T04:31:05.606 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_memcpy.ko 2024-04-18T04:31:05.606 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_pq.ko 2024-04-18T04:31:05.606 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-18T04:31:05.606 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_tx.ko 2024-04-18T04:31:05.606 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_xor.ko 2024-04-18T04:31:05.606 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/raid6test.ko 2024-04-18T04:31:05.606 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/authenc.ko 2024-04-18T04:31:05.606 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 27953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/authencesn.ko 2024-04-18T04:31:05.606 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blake2b_generic.ko 2024-04-18T04:31:05.606 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blowfish_common.ko 2024-04-18T04:31:05.606 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blowfish_generic.ko 2024-04-18T04:31:05.607 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 40889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/camellia_generic.ko 2024-04-18T04:31:05.607 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast5_generic.ko 2024-04-18T04:31:05.607 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast6_generic.ko 2024-04-18T04:31:05.607 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast_common.ko 2024-04-18T04:31:05.607 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 43281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/ccm.ko 2024-04-18T04:31:05.607 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cmac.ko 2024-04-18T04:31:05.607 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crc32_generic.ko 2024-04-18T04:31:05.607 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 59129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cryptd.ko 2024-04-18T04:31:05.607 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 48113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crypto_engine.ko 2024-04-18T04:31:05.607 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 32169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crypto_simd.ko 2024-04-18T04:31:05.607 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 30881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crypto_user.ko 2024-04-18T04:31:05.607 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cts.ko 2024-04-18T04:31:05.607 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/des_generic.ko 2024-04-18T04:31:05.607 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/dh_generic.ko 2024-04-18T04:31:05.608 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/echainiv.ko 2024-04-18T04:31:05.608 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 30689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/essiv.ko 2024-04-18T04:31:05.608 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/fcrypt.ko 2024-04-18T04:31:05.608 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/khazad.ko 2024-04-18T04:31:05.608 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/lrw.ko 2024-04-18T04:31:05.608 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/lz4.ko 2024-04-18T04:31:05.608 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/lz4hc.ko 2024-04-18T04:31:05.608 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/md4.ko 2024-04-18T04:31:05.608 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/michael_mic.ko 2024-04-18T04:31:05.608 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/pcbc.ko 2024-04-18T04:31:05.608 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/pcrypt.ko 2024-04-18T04:31:05.608 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/rmd160.ko 2024-04-18T04:31:05.608 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 30673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/seed.ko 2024-04-18T04:31:05.608 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/serpent_generic.ko 2024-04-18T04:31:05.608 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 169065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/tcrypt.ko 2024-04-18T04:31:05.609 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/tea.ko 2024-04-18T04:31:05.609 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/twofish_common.ko 2024-04-18T04:31:05.609 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/twofish_generic.ko 2024-04-18T04:31:05.609 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/vmac.ko 2024-04-18T04:31:05.609 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 38209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/wp512.ko 2024-04-18T04:31:05.609 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xcbc.ko 2024-04-18T04:31:05.609 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 30345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xor.ko 2024-04-18T04:31:05.609 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xts.ko 2024-04-18T04:31:05.609 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xxhash_generic.ko 2024-04-18T04:31:05.610 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ 2024-04-18T04:31:05.610 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/ 2024-04-18T04:31:05.610 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/acpi_extlog.ko 2024-04-18T04:31:05.610 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 31921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-18T04:31:05.610 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 32281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/acpi_pad.ko 2024-04-18T04:31:05.610 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/apei/ 2024-04-18T04:31:05.610 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 44705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/apei/einj.ko 2024-04-18T04:31:05.610 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/ec_sys.ko 2024-04-18T04:31:05.610 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/platform_profile.ko 2024-04-18T04:31:05.610 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/sbs.ko 2024-04-18T04:31:05.610 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/sbshc.ko 2024-04-18T04:31:05.610 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 119033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/video.ko 2024-04-18T04:31:05.610 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/ 2024-04-18T04:31:05.611 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/acard-ahci.ko 2024-04-18T04:31:05.611 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 96825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/ahci.ko 2024-04-18T04:31:05.611 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/ahci_platform.ko 2024-04-18T04:31:05.611 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 107737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/libahci.ko 2024-04-18T04:31:05.611 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 42001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/libahci_platform.ko 2024-04-18T04:31:05.611 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_acpi.ko 2024-04-18T04:31:05.611 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 35705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ali.ko 2024-04-18T04:31:05.611 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 38329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_amd.ko 2024-04-18T04:31:05.611 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_artop.ko 2024-04-18T04:31:05.611 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_atiixp.ko 2024-04-18T04:31:05.611 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_atp867x.ko 2024-04-18T04:31:05.611 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cmd640.ko 2024-04-18T04:31:05.611 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cmd64x.ko 2024-04-18T04:31:05.612 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cypress.ko 2024-04-18T04:31:05.612 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_efar.ko 2024-04-18T04:31:05.612 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt366.ko 2024-04-18T04:31:05.612 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 38913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt37x.ko 2024-04-18T04:31:05.612 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-18T04:31:05.612 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-18T04:31:05.612 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_it8213.ko 2024-04-18T04:31:05.612 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 41289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_it821x.ko 2024-04-18T04:31:05.612 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_jmicron.ko 2024-04-18T04:31:05.612 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 60257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_legacy.ko 2024-04-18T04:31:05.612 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_marvell.ko 2024-04-18T04:31:05.612 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_mpiix.ko 2024-04-18T04:31:05.612 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_netcell.ko 2024-04-18T04:31:05.613 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ninja32.ko 2024-04-18T04:31:05.613 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ns87410.ko 2024-04-18T04:31:05.613 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ns87415.ko 2024-04-18T04:31:05.613 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_oldpiix.ko 2024-04-18T04:31:05.613 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_opti.ko 2024-04-18T04:31:05.613 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_optidma.ko 2024-04-18T04:31:05.613 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 35145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pcmcia.ko 2024-04-18T04:31:05.613 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 43009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-18T04:31:05.613 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-18T04:31:05.613 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_piccolo.ko 2024-04-18T04:31:05.613 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_radisys.ko 2024-04-18T04:31:05.613 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_rdc.ko 2024-04-18T04:31:05.613 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_rz1000.ko 2024-04-18T04:31:05.613 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sch.ko 2024-04-18T04:31:05.614 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_serverworks.ko 2024-04-18T04:31:05.614 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 27305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sil680.ko 2024-04-18T04:31:05.614 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sl82c105.ko 2024-04-18T04:31:05.614 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_triflex.ko 2024-04-18T04:31:05.614 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 35025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_via.ko 2024-04-18T04:31:05.614 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pdc_adma.ko 2024-04-18T04:31:05.614 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 34889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_inic162x.ko 2024-04-18T04:31:05.614 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 102121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_mv.ko 2024-04-18T04:31:05.614 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 85409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_nv.ko 2024-04-18T04:31:05.614 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 44313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_promise.ko 2024-04-18T04:31:05.614 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_qstor.ko 2024-04-18T04:31:05.614 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 34025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sil.ko 2024-04-18T04:31:05.614 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 45905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sil24.ko 2024-04-18T04:31:05.614 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sis.ko 2024-04-18T04:31:05.615 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_svw.ko 2024-04-18T04:31:05.615 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 53353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sx4.ko 2024-04-18T04:31:05.615 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_uli.ko 2024-04-18T04:31:05.615 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 41049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_via.ko 2024-04-18T04:31:05.615 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_vsc.ko 2024-04-18T04:31:05.615 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/auxdisplay/ 2024-04-18T04:31:05.615 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/auxdisplay/ks0108.ko 2024-04-18T04:31:05.615 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/bcma/ 2024-04-18T04:31:05.615 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 163969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/bcma/bcma.ko 2024-04-18T04:31:05.615 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/ 2024-04-18T04:31:05.615 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/aoe/ 2024-04-18T04:31:05.615 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 140865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/aoe/aoe.ko 2024-04-18T04:31:05.615 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/drbd/ 2024-04-18T04:31:05.615 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 1241657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/drbd/drbd.ko 2024-04-18T04:31:05.616 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 203289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/floppy.ko 2024-04-18T04:31:05.616 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/mtip32xx/ 2024-04-18T04:31:05.616 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 115265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-18T04:31:05.616 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 143433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/nbd.ko 2024-04-18T04:31:05.616 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/null_blk/ 2024-04-18T04:31:05.616 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 126617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/null_blk/null_blk.ko 2024-04-18T04:31:05.616 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 119873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/pktcdvd.ko 2024-04-18T04:31:05.616 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 313217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/rbd.ko 2024-04-18T04:31:05.616 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkback/ 2024-04-18T04:31:05.616 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 117233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-18T04:31:05.684 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/zram/ 2024-04-18T04:31:05.684 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 70385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/zram/zram.ko 2024-04-18T04:31:05.684 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ 2024-04-18T04:31:05.684 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 35377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/applicom.ko 2024-04-18T04:31:05.684 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hangcheck-timer.ko 2024-04-18T04:31:05.684 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/ 2024-04-18T04:31:05.684 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-18T04:31:05.685 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-18T04:31:05.685 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-18T04:31:05.685 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/via-rng.ko 2024-04-18T04:31:05.685 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-18T04:31:05.685 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ 2024-04-18T04:31:05.685 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 37257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-18T04:31:05.685 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 186921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-18T04:31:05.685 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 32521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-18T04:31:05.685 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 179561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-18T04:31:05.685 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 85441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-18T04:31:05.685 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 65313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-18T04:31:05.685 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 43857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/lp.ko 2024-04-18T04:31:05.686 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/mwave/ 2024-04-18T04:31:05.686 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 103409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/mwave/mwave.ko 2024-04-18T04:31:05.686 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 31833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/nvram.ko 2024-04-18T04:31:05.686 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 38977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ppdev.ko 2024-04-18T04:31:05.686 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 59241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tlclk.ko 2024-04-18T04:31:05.686 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/ 2024-04-18T04:31:05.686 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-18T04:31:05.686 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-04-18T04:31:05.686 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-04-18T04:31:05.686 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 39193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-04-18T04:31:05.686 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 34169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-18T04:31:05.686 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-18T04:31:05.686 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-04-18T04:31:05.686 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/xillybus/ 2024-04-18T04:31:05.687 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/xillybus/xillybus_class.ko 2024-04-18T04:31:05.687 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 62545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/xillybus/xillybus_core.ko 2024-04-18T04:31:05.687 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-04-18T04:31:05.687 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/clk/ 2024-04-18T04:31:05.687 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/clk/clk-palmas.ko 2024-04-18T04:31:05.687 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 57289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/clk/clk-si5351.ko 2024-04-18T04:31:05.687 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/clk/clk-twl6040.ko 2024-04-18T04:31:05.687 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/clk/clk-wm831x.ko 2024-04-18T04:31:05.687 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/ 2024-04-18T04:31:05.687 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-18T04:31:05.687 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-18T04:31:05.687 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-18T04:31:05.687 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ 2024-04-18T04:31:05.688 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp/ 2024-04-18T04:31:05.688 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 89257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-18T04:31:05.688 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 333657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp/ccp.ko 2024-04-18T04:31:05.688 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/ 2024-04-18T04:31:05.688 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/ 2024-04-18T04:31:05.688 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_common/ 2024-04-18T04:31:05.688 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 751713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-18T04:31:05.688 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-04-18T04:31:05.688 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-18T04:31:05.688 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/padlock-aes.ko 2024-04-18T04:31:05.688 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/padlock-sha.ko 2024-04-18T04:31:05.688 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/virtio/ 2024-04-18T04:31:05.688 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 90441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-18T04:31:05.688 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dca/ 2024-04-18T04:31:05.689 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 36105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dca/dca.ko 2024-04-18T04:31:05.689 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/ 2024-04-18T04:31:05.689 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/dw/ 2024-04-18T04:31:05.689 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-18T04:31:05.689 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/ioat/ 2024-04-18T04:31:05.689 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 146769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-18T04:31:05.689 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/ 2024-04-18T04:31:05.689 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 96145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/amd64_edac.ko 2024-04-18T04:31:05.689 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 41993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/e752x_edac.ko 2024-04-18T04:31:05.689 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 51105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/edac_mce_amd.ko 2024-04-18T04:31:05.689 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i3000_edac.ko 2024-04-18T04:31:05.689 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i3200_edac.ko 2024-04-18T04:31:05.689 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i5100_edac.ko 2024-04-18T04:31:05.690 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i5400_edac.ko 2024-04-18T04:31:05.690 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i7300_edac.ko 2024-04-18T04:31:05.690 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 64161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i7core_edac.ko 2024-04-18T04:31:05.690 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i82975x_edac.ko 2024-04-18T04:31:05.690 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/ie31200_edac.ko 2024-04-18T04:31:05.690 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 68697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/sb_edac.ko 2024-04-18T04:31:05.690 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/x38_edac.ko 2024-04-18T04:31:05.690 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/ 2024-04-18T04:31:05.690 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-gpio.ko 2024-04-18T04:31:05.690 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 31369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-max14577.ko 2024-04-18T04:31:05.690 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 35601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-max77693.ko 2024-04-18T04:31:05.690 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-max8997.ko 2024-04-18T04:31:05.690 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 30961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-palmas.ko 2024-04-18T04:31:05.690 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 27201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-rt8973a.ko 2024-04-18T04:31:05.691 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 31993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/extcon/extcon-sm5502.ko 2024-04-18T04:31:05.691 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/ 2024-04-18T04:31:05.691 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 42953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/dmi-sysfs.ko 2024-04-18T04:31:05.691 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/efi/ 2024-04-18T04:31:05.691 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/efi/efi-pstore.ko 2024-04-18T04:31:05.691 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-18T04:31:05.691 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/ 2024-04-18T04:31:05.691 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-adp5520.ko 2024-04-18T04:31:05.691 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-amd8111.ko 2024-04-18T04:31:05.691 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-arizona.ko 2024-04-18T04:31:05.691 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-da9052.ko 2024-04-18T04:31:05.691 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-da9055.ko 2024-04-18T04:31:05.691 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-dln2.ko 2024-04-18T04:31:05.692 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 81073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-f7188x.ko 2024-04-18T04:31:05.692 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 40761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-generic.ko 2024-04-18T04:31:05.692 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-ich.ko 2024-04-18T04:31:05.692 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-04-18T04:31:05.692 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-kempld.ko 2024-04-18T04:31:05.692 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-lp3943.ko 2024-04-18T04:31:05.692 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-max7300.ko 2024-04-18T04:31:05.692 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-max730x.ko 2024-04-18T04:31:05.692 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-max732x.ko 2024-04-18T04:31:05.692 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-04-18T04:31:05.692 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 55505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-pca953x.ko 2024-04-18T04:31:05.692 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 31881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-pcf857x.ko 2024-04-18T04:31:05.692 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-rdc321x.ko 2024-04-18T04:31:05.692 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-sch.ko 2024-04-18T04:31:05.692 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-sch311x.ko 2024-04-18T04:31:05.693 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-tps65912.ko 2024-04-18T04:31:05.693 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-twl4030.ko 2024-04-18T04:31:05.693 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-twl6040.ko 2024-04-18T04:31:05.693 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-18T04:31:05.693 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-vx855.ko 2024-04-18T04:31:05.693 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-wm831x.ko 2024-04-18T04:31:05.693 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-wm8350.ko 2024-04-18T04:31:05.693 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-wm8994.ko 2024-04-18T04:31:05.693 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/ 2024-04-18T04:31:05.693 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-a4tech.ko 2024-04-18T04:31:05.693 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 43553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-apple.ko 2024-04-18T04:31:05.693 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-appleir.ko 2024-04-18T04:31:05.693 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-aureal.ko 2024-04-18T04:31:05.693 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-axff.ko 2024-04-18T04:31:05.693 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-belkin.ko 2024-04-18T04:31:05.694 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-cherry.ko 2024-04-18T04:31:05.694 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-chicony.ko 2024-04-18T04:31:05.694 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 74393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-cp2112.ko 2024-04-18T04:31:05.694 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-cypress.ko 2024-04-18T04:31:05.694 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-dr.ko 2024-04-18T04:31:05.694 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-elecom.ko 2024-04-18T04:31:05.694 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-elo.ko 2024-04-18T04:31:05.694 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-emsff.ko 2024-04-18T04:31:05.694 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-ezkey.ko 2024-04-18T04:31:05.694 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gaff.ko 2024-04-18T04:31:05.694 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-generic.ko 2024-04-18T04:31:05.694 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gt683r.ko 2024-04-18T04:31:05.694 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gyration.ko 2024-04-18T04:31:05.695 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-18T04:31:05.695 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-18T04:31:05.695 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtekff.ko 2024-04-18T04:31:05.695 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-hyperv.ko 2024-04-18T04:31:05.695 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-icade.ko 2024-04-18T04:31:05.695 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-kensington.ko 2024-04-18T04:31:05.695 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-keytouch.ko 2024-04-18T04:31:05.695 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-kye.ko 2024-04-18T04:31:05.695 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-lcpower.ko 2024-04-18T04:31:05.695 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-led.ko 2024-04-18T04:31:05.695 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 54217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-lenovo.ko 2024-04-18T04:31:05.695 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 37553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-lg-g15.ko 2024-04-18T04:31:05.695 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 68081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-18T04:31:05.695 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 121369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-18T04:31:05.695 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 97953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-logitech.ko 2024-04-18T04:31:05.696 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 36689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-magicmouse.ko 2024-04-18T04:31:05.696 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-microsoft.ko 2024-04-18T04:31:05.696 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-monterey.ko 2024-04-18T04:31:05.696 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 59001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-multitouch.ko 2024-04-18T04:31:05.696 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 39697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-ntrig.ko 2024-04-18T04:31:05.696 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-ortek.ko 2024-04-18T04:31:05.696 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-penmount.ko 2024-04-18T04:31:05.696 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-petalynx.ko 2024-04-18T04:31:05.696 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 91241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-picolcd.ko 2024-04-18T04:31:05.696 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-pl.ko 2024-04-18T04:31:05.696 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-plantronics.ko 2024-04-18T04:31:05.696 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-primax.ko 2024-04-18T04:31:05.696 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 42889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-rmi.ko 2024-04-18T04:31:05.696 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-18T04:31:05.696 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-common.ko 2024-04-18T04:31:05.697 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 38865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-18T04:31:05.697 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 36305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-18T04:31:05.697 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 38073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-18T04:31:05.697 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-18T04:31:05.697 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 35625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-18T04:31:05.697 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-18T04:31:05.697 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 35425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-18T04:31:05.697 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 35561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-18T04:31:05.697 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-18T04:31:05.697 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat.ko 2024-04-18T04:31:05.697 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-saitek.ko 2024-04-18T04:31:05.697 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 42305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-samsung.ko 2024-04-18T04:31:05.697 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 43609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-18T04:31:05.698 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sjoy.ko 2024-04-18T04:31:05.698 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 62129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sony.ko 2024-04-18T04:31:05.698 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-speedlink.ko 2024-04-18T04:31:05.698 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 30017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-steelseries.ko 2024-04-18T04:31:05.698 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sunplus.ko 2024-04-18T04:31:05.698 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-18T04:31:05.698 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-tivo.ko 2024-04-18T04:31:05.698 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-tmff.ko 2024-04-18T04:31:05.698 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-topseed.ko 2024-04-18T04:31:05.698 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-twinhan.ko 2024-04-18T04:31:05.698 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 81113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-uclogic.ko 2024-04-18T04:31:05.698 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-waltop.ko 2024-04-18T04:31:05.698 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 184745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-wiimote.ko 2024-04-18T04:31:05.698 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-xinmo.ko 2024-04-18T04:31:05.699 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-zpff.ko 2024-04-18T04:31:05.699 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-zydacron.ko 2024-04-18T04:31:05.699 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 319921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid.ko 2024-04-18T04:31:05.699 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 39529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/uhid.ko 2024-04-18T04:31:05.699 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/usbhid/ 2024-04-18T04:31:05.699 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 153633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/usbhid/usbhid.ko 2024-04-18T04:31:05.699 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/usbhid/usbkbd.ko 2024-04-18T04:31:05.699 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/usbhid/usbmouse.ko 2024-04-18T04:31:05.699 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 261945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/wacom.ko 2024-04-18T04:31:05.699 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/ 2024-04-18T04:31:05.699 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 75065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_balloon.ko 2024-04-18T04:31:05.699 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 110681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_utils.ko 2024-04-18T04:31:05.699 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 382033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_vmbus.ko 2024-04-18T04:31:05.700 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ 2024-04-18T04:31:05.700 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 77153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/abituguru.ko 2024-04-18T04:31:05.700 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 67009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/abituguru3.ko 2024-04-18T04:31:05.700 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 42249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-18T04:31:05.700 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ad7414.ko 2024-04-18T04:31:05.700 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ad7418.ko 2024-04-18T04:31:05.700 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adc128d818.ko 2024-04-18T04:31:05.700 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 38097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1025.ko 2024-04-18T04:31:05.700 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 115057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1026.ko 2024-04-18T04:31:05.700 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1029.ko 2024-04-18T04:31:05.700 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 55225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1031.ko 2024-04-18T04:31:05.700 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 31441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm9240.ko 2024-04-18T04:31:05.700 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ads7828.ko 2024-04-18T04:31:05.700 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7410.ko 2024-04-18T04:31:05.701 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7411.ko 2024-04-18T04:31:05.701 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 89025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7462.ko 2024-04-18T04:31:05.701 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 49153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7470.ko 2024-04-18T04:31:05.701 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 81473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7475.ko 2024-04-18T04:31:05.701 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7x10.ko 2024-04-18T04:31:05.701 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 48177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/amc6821.ko 2024-04-18T04:31:05.701 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 68865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/applesmc.ko 2024-04-18T04:31:05.701 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 60193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asb100.ko 2024-04-18T04:31:05.701 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 69009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asc7621.ko 2024-04-18T04:31:05.701 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 47977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-18T04:31:05.701 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/atxp1.ko 2024-04-18T04:31:05.701 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/coretemp.ko 2024-04-18T04:31:05.701 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/da9052-hwmon.ko 2024-04-18T04:31:05.701 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/da9055-hwmon.ko 2024-04-18T04:31:05.702 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 55713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-18T04:31:05.702 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 113201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/dme1737.ko 2024-04-18T04:31:05.702 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ds1621.ko 2024-04-18T04:31:05.702 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ds620.ko 2024-04-18T04:31:05.702 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/emc1403.ko 2024-04-18T04:31:05.702 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 40177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/emc2103.ko 2024-04-18T04:31:05.702 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 34649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/emc6w201.ko 2024-04-18T04:31:05.702 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 78921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f71805f.ko 2024-04-18T04:31:05.702 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 108961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f71882fg.ko 2024-04-18T04:31:05.702 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 50697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f75375s.ko 2024-04-18T04:31:05.702 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/fam15h_power.ko 2024-04-18T04:31:05.702 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 65769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/fschmd.ko 2024-04-18T04:31:05.702 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/g760a.ko 2024-04-18T04:31:05.702 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 30585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/g762.ko 2024-04-18T04:31:05.703 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 59761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/gl518sm.ko 2024-04-18T04:31:05.703 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 56313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/gl520sm.ko 2024-04-18T04:31:05.703 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/hih6130.ko 2024-04-18T04:31:05.703 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-18T04:31:05.703 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/i5500_temp.ko 2024-04-18T04:31:05.703 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 27633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/i5k_amb.ko 2024-04-18T04:31:05.703 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 42585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ibmaem.ko 2024-04-18T04:31:05.703 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ibmpex.ko 2024-04-18T04:31:05.703 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ina209.ko 2024-04-18T04:31:05.703 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ina2xx.ko 2024-04-18T04:31:05.703 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 156465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/it87.ko 2024-04-18T04:31:05.703 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/jc42.ko 2024-04-18T04:31:05.703 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/k10temp.ko 2024-04-18T04:31:05.703 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/k8temp.ko 2024-04-18T04:31:05.704 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lineage-pem.ko 2024-04-18T04:31:05.704 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 57769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm63.ko 2024-04-18T04:31:05.704 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm73.ko 2024-04-18T04:31:05.704 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 44121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm75.ko 2024-04-18T04:31:05.704 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm77.ko 2024-04-18T04:31:05.704 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 41473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm78.ko 2024-04-18T04:31:05.704 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 37049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm80.ko 2024-04-18T04:31:05.704 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm83.ko 2024-04-18T04:31:05.704 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 86497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm85.ko 2024-04-18T04:31:05.704 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 55641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm87.ko 2024-04-18T04:31:05.704 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 42249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm90.ko 2024-04-18T04:31:05.704 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm92.ko 2024-04-18T04:31:05.704 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 131505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm93.ko 2024-04-18T04:31:05.704 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 40225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95234.ko 2024-04-18T04:31:05.705 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95241.ko 2024-04-18T04:31:05.705 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95245.ko 2024-04-18T04:31:05.705 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc2945.ko 2024-04-18T04:31:05.705 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4151.ko 2024-04-18T04:31:05.705 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4215.ko 2024-04-18T04:31:05.705 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4222.ko 2024-04-18T04:31:05.705 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4245.ko 2024-04-18T04:31:05.705 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4260.ko 2024-04-18T04:31:05.705 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4261.ko 2024-04-18T04:31:05.705 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 36769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max16065.ko 2024-04-18T04:31:05.705 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max1619.ko 2024-04-18T04:31:05.705 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max1668.ko 2024-04-18T04:31:05.705 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max197.ko 2024-04-18T04:31:05.706 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 32505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6639.ko 2024-04-18T04:31:05.706 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 27305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6650.ko 2024-04-18T04:31:05.706 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 39729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6697.ko 2024-04-18T04:31:05.706 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/mc13783-adc.ko 2024-04-18T04:31:05.706 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/mcp3021.ko 2024-04-18T04:31:05.706 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-04-18T04:31:05.706 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 56505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6683.ko 2024-04-18T04:31:05.706 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 141353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6775-core.ko 2024-04-18T04:31:05.706 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 72737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6775.ko 2024-04-18T04:31:05.706 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 67841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct7802.ko 2024-04-18T04:31:05.706 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 97777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pc87360.ko 2024-04-18T04:31:05.706 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 61921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pc87427.ko 2024-04-18T04:31:05.706 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pcf8591.ko 2024-04-18T04:31:05.706 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ 2024-04-18T04:31:05.706 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-18T04:31:05.707 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-18T04:31:05.707 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-18T04:31:05.707 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-18T04:31:05.707 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-18T04:31:05.707 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-18T04:31:05.707 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-18T04:31:05.707 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 101233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-18T04:31:05.707 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-18T04:31:05.707 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 36177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-18T04:31:05.707 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-18T04:31:05.707 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-18T04:31:05.707 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/powr1220.ko 2024-04-18T04:31:05.707 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch5627.ko 2024-04-18T04:31:05.707 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 32945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch5636.ko 2024-04-18T04:31:05.707 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 34561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-18T04:31:05.708 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 40849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sht15.ko 2024-04-18T04:31:05.708 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sht21.ko 2024-04-18T04:31:05.708 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/shtc1.ko 2024-04-18T04:31:05.708 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 48713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sis5595.ko 2024-04-18T04:31:05.708 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47b397.ko 2024-04-18T04:31:05.708 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 46473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47m1.ko 2024-04-18T04:31:05.708 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 44313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47m192.ko 2024-04-18T04:31:05.708 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 31417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/thmc50.ko 2024-04-18T04:31:05.708 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp102.ko 2024-04-18T04:31:05.708 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp103.ko 2024-04-18T04:31:05.708 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp401.ko 2024-04-18T04:31:05.708 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp421.ko 2024-04-18T04:31:05.708 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/via-cputemp.ko 2024-04-18T04:31:05.708 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 50217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/via686a.ko 2024-04-18T04:31:05.708 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 59665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/vt1211.ko 2024-04-18T04:31:05.709 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 62737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/vt8231.ko 2024-04-18T04:31:05.709 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 71169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83627ehf.ko 2024-04-18T04:31:05.709 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 96577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83627hf.ko 2024-04-18T04:31:05.709 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 85913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83781d.ko 2024-04-18T04:31:05.709 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 75129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83791d.ko 2024-04-18T04:31:05.709 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 83425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83792d.ko 2024-04-18T04:31:05.709 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 116777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83793.ko 2024-04-18T04:31:05.709 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 134441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83795.ko 2024-04-18T04:31:05.709 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83l785ts.ko 2024-04-18T04:31:05.709 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 43385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83l786ng.ko 2024-04-18T04:31:05.710 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-04-18T04:31:05.710 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-04-18T04:31:05.710 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/ 2024-04-18T04:31:05.710 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos/ 2024-04-18T04:31:05.710 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 27353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-18T04:31:05.710 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-18T04:31:05.710 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/ 2024-04-18T04:31:05.710 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-04-18T04:31:05.710 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 35073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-04-18T04:31:05.710 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 32905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-04-18T04:31:05.710 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-18T04:31:05.710 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 30361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-18T04:31:05.711 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-18T04:31:05.711 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-04-18T04:31:05.711 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-18T04:31:05.711 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-04-18T04:31:05.711 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 64233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-18T04:31:05.711 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-18T04:31:05.711 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-18T04:31:05.711 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-18T04:31:05.711 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-04-18T04:31:05.711 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-04-18T04:31:05.711 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 76969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-18T04:31:05.711 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-18T04:31:05.711 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 52937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-18T04:31:05.711 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-04-18T04:31:05.712 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-18T04:31:05.712 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-18T04:31:05.712 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-04-18T04:31:05.712 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 30049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-18T04:31:05.712 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-18T04:31:05.712 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 57217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-18T04:31:05.712 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-04-18T04:31:05.712 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-18T04:31:05.712 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-18T04:31:05.712 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-04-18T04:31:05.712 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 32585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-04-18T04:31:05.712 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-18T04:31:05.712 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-04-18T04:31:05.712 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-18T04:31:05.713 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-18T04:31:05.713 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-18T04:31:05.713 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-18T04:31:05.713 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 59193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-04-18T04:31:05.713 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 27849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-mux.ko 2024-04-18T04:31:05.713 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-smbus.ko 2024-04-18T04:31:05.713 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-stub.ko 2024-04-18T04:31:05.713 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/muxes/ 2024-04-18T04:31:05.713 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-04-18T04:31:05.713 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-04-18T04:31:05.713 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 36569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-04-18T04:31:05.713 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ 2024-04-18T04:31:05.713 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ 2024-04-18T04:31:05.713 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 329697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-18T04:31:05.714 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 1119913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_core.ko 2024-04-18T04:31:05.714 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 83905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-18T04:31:05.714 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 408433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-18T04:31:05.714 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 120921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-18T04:31:05.714 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 347217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-18T04:31:05.714 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 84945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-18T04:31:05.714 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/ 2024-04-18T04:31:05.714 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/cxgb4/ 2024-04-18T04:31:05.714 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 590929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-18T04:31:05.714 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx4/ 2024-04-18T04:31:05.714 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 514641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-18T04:31:05.714 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx5/ 2024-04-18T04:31:05.714 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 911665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-18T04:31:05.715 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mthca/ 2024-04-18T04:31:05.715 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 375545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-18T04:31:05.715 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/ocrdma/ 2024-04-18T04:31:05.715 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 197121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-04-18T04:31:05.715 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/usnic/ 2024-04-18T04:31:05.715 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 212553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-04-18T04:31:05.715 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/ 2024-04-18T04:31:05.715 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/ipoib/ 2024-04-18T04:31:05.717 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 334401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-18T04:31:05.717 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/iser/ 2024-04-18T04:31:05.718 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 120673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-18T04:31:05.718 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/isert/ 2024-04-18T04:31:05.718 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 132585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-18T04:31:05.718 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srp/ 2024-04-18T04:31:05.718 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 157937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-18T04:31:05.718 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srpt/ 2024-04-18T04:31:05.718 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 156673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-18T04:31:05.718 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/ 2024-04-18T04:31:05.718 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/evbug.ko 2024-04-18T04:31:05.718 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 27609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/ff-memless.ko 2024-04-18T04:31:05.718 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/ 2024-04-18T04:31:05.718 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-18T04:31:05.718 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-18T04:31:05.718 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 50713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/gameport.ko 2024-04-18T04:31:05.719 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 49441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/joydev.ko 2024-04-18T04:31:05.719 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/ 2024-04-18T04:31:05.719 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-04-18T04:31:05.719 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-04-18T04:31:05.719 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 35665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-04-18T04:31:05.719 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-04-18T04:31:05.719 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 45473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-18T04:31:05.719 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-04-18T04:31:05.719 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/lkkbd.ko 2024-04-18T04:31:05.719 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 31857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/lm8323.ko 2024-04-18T04:31:05.719 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/lm8333.ko 2024-04-18T04:31:05.719 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-04-18T04:31:05.719 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-04-18T04:31:05.719 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-04-18T04:31:05.719 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-04-18T04:31:05.720 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/newtonkbd.ko 2024-04-18T04:31:05.720 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-04-18T04:31:05.720 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/qt1070.ko 2024-04-18T04:31:05.720 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/qt2160.ko 2024-04-18T04:31:05.720 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-04-18T04:31:05.720 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/stowaway.ko 2024-04-18T04:31:05.720 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/sunkbd.ko 2024-04-18T04:31:05.720 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-04-18T04:31:05.720 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-04-18T04:31:05.720 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-04-18T04:31:05.720 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/xtkbd.ko 2024-04-18T04:31:05.720 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/matrix-keymap.ko 2024-04-18T04:31:05.720 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/ 2024-04-18T04:31:05.720 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 40617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/appletouch.ko 2024-04-18T04:31:05.721 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 39553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/bcm5974.ko 2024-04-18T04:31:05.721 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 160017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/cyapatp.ko 2024-04-18T04:31:05.721 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 114273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-18T04:31:05.721 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/gpio_mouse.ko 2024-04-18T04:31:05.721 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 428185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/psmouse.ko 2024-04-18T04:31:05.721 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/sermouse.ko 2024-04-18T04:31:05.721 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 27865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-18T04:31:05.721 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 27193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-18T04:31:05.721 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-18T04:31:05.721 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/rmi4/ 2024-04-18T04:31:05.721 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 140969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-18T04:31:05.721 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/ 2024-04-18T04:31:05.721 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/altera_ps2.ko 2024-04-18T04:31:05.721 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/arc_ps2.ko 2024-04-18T04:31:05.722 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/ct82c710.ko 2024-04-18T04:31:05.722 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-18T04:31:05.722 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/parkbd.ko 2024-04-18T04:31:05.722 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/pcips2.ko 2024-04-18T04:31:05.722 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/ps2mult.ko 2024-04-18T04:31:05.722 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/serio_raw.ko 2024-04-18T04:31:05.722 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/serport.ko 2024-04-18T04:31:05.722 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/sparse-keymap.ko 2024-04-18T04:31:05.722 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/ 2024-04-18T04:31:05.722 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-88pm860x.ko 2024-04-18T04:31:05.722 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-adp5520.ko 2024-04-18T04:31:05.722 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 77265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-bd2802.ko 2024-04-18T04:31:05.722 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 31097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-blinkm.ko 2024-04-18T04:31:05.723 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-da903x.ko 2024-04-18T04:31:05.723 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-da9052.ko 2024-04-18T04:31:05.723 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-gpio.ko 2024-04-18T04:31:05.723 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lm3530.ko 2024-04-18T04:31:05.723 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 36705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lm3533.ko 2024-04-18T04:31:05.723 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lm355x.ko 2024-04-18T04:31:05.723 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lm3642.ko 2024-04-18T04:31:05.723 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lp3944.ko 2024-04-18T04:31:05.723 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lp8788.ko 2024-04-18T04:31:05.723 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-max8997.ko 2024-04-18T04:31:05.723 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-mc13783.ko 2024-04-18T04:31:05.723 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-menf21bmc.ko 2024-04-18T04:31:05.723 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-pca9532.ko 2024-04-18T04:31:05.723 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-pca955x.ko 2024-04-18T04:31:05.723 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-pca963x.ko 2024-04-18T04:31:05.724 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 38113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-ss4200.ko 2024-04-18T04:31:05.724 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-tca6507.ko 2024-04-18T04:31:05.724 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-wm831x-status.ko 2024-04-18T04:31:05.724 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-wm8350.ko 2024-04-18T04:31:05.724 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ 2024-04-18T04:31:05.724 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-18T04:31:05.724 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-18T04:31:05.724 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-18T04:31:05.724 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-18T04:31:05.724 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-18T04:31:05.724 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-18T04:31:05.724 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-18T04:31:05.724 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-18T04:31:05.724 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-18T04:31:05.724 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/ 2024-04-18T04:31:05.725 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/bcache/ 2024-04-18T04:31:05.725 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 790753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/bcache/bcache.ko 2024-04-18T04:31:05.725 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 49081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-bio-prison.ko 2024-04-18T04:31:05.725 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 116825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-bufio.ko 2024-04-18T04:31:05.725 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 58281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-cache-smq.ko 2024-04-18T04:31:05.725 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 199041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-cache.ko 2024-04-18T04:31:05.725 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 134945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-crypt.ko 2024-04-18T04:31:05.725 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-delay.ko 2024-04-18T04:31:05.725 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 67497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-era.ko 2024-04-18T04:31:05.725 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-flakey.ko 2024-04-18T04:31:05.725 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 50457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-log-userspace.ko 2024-04-18T04:31:05.725 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 41145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-log.ko 2024-04-18T04:31:05.725 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 60977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-mirror.ko 2024-04-18T04:31:05.726 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 97209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-multipath.ko 2024-04-18T04:31:05.726 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-queue-length.ko 2024-04-18T04:31:05.726 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 85689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-raid.ko 2024-04-18T04:31:05.726 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 44289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-region-hash.ko 2024-04-18T04:31:05.726 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-round-robin.ko 2024-04-18T04:31:05.726 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-service-time.ko 2024-04-18T04:31:05.726 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 139817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-snapshot.ko 2024-04-18T04:31:05.726 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-switch.ko 2024-04-18T04:31:05.726 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 234457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-thin-pool.ko 2024-04-18T04:31:05.726 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 66425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-verity.ko 2024-04-18T04:31:05.726 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-zero.ko 2024-04-18T04:31:05.726 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/persistent-data/ 2024-04-18T04:31:05.726 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 264329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-18T04:31:05.726 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 43137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid0.ko 2024-04-18T04:31:05.727 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 125009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid1.ko 2024-04-18T04:31:05.727 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 157681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid10.ko 2024-04-18T04:31:05.727 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 444665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid456.ko 2024-04-18T04:31:05.727 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/ 2024-04-18T04:31:05.727 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/ 2024-04-18T04:31:05.727 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 214841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptbase.ko 2024-04-18T04:31:05.727 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 77985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptctl.ko 2024-04-18T04:31:05.727 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 54785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptfc.ko 2024-04-18T04:31:05.727 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 44633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptlan.ko 2024-04-18T04:31:05.727 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 150761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptsas.ko 2024-04-18T04:31:05.727 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 97281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptscsih.ko 2024-04-18T04:31:05.727 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 63873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptspi.ko 2024-04-18T04:31:05.727 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/ 2024-04-18T04:31:05.727 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/88pm800.ko 2024-04-18T04:31:05.728 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/88pm805.ko 2024-04-18T04:31:05.728 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/88pm80x.ko 2024-04-18T04:31:05.728 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/arizona-i2c.ko 2024-04-18T04:31:05.728 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 148633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/arizona.ko 2024-04-18T04:31:05.728 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/bcm590xx.ko 2024-04-18T04:31:05.728 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/cros_ec_dev.ko 2024-04-18T04:31:05.728 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 41009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/dln2.ko 2024-04-18T04:31:05.728 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/janz-cmodio.ko 2024-04-18T04:31:05.728 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 59089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/kempld-core.ko 2024-04-18T04:31:05.728 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 31897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lm3533-core.ko 2024-04-18T04:31:05.728 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-04-18T04:31:05.728 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lp3943.ko 2024-04-18T04:31:05.728 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 60497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lpc_ich.ko 2024-04-18T04:31:05.728 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lpc_sch.ko 2024-04-18T04:31:05.728 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/max8907.ko 2024-04-18T04:31:05.729 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 35537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/mc13xxx-core.ko 2024-04-18T04:31:05.729 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-04-18T04:31:05.729 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/menf21bmc.ko 2024-04-18T04:31:05.729 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/pcf50633-adc.ko 2024-04-18T04:31:05.729 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/pcf50633-gpio.ko 2024-04-18T04:31:05.729 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 42297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/pcf50633.ko 2024-04-18T04:31:05.729 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-04-18T04:31:05.729 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/retu-mfd.ko 2024-04-18T04:31:05.729 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 99425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/si476x-core.ko 2024-04-18T04:31:05.729 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 58057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/sm501.ko 2024-04-18T04:31:05.729 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 60681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/tps65010.ko 2024-04-18T04:31:05.729 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/tps6507x.ko 2024-04-18T04:31:05.729 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/viperboard.ko 2024-04-18T04:31:05.729 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/vx855.ko 2024-04-18T04:31:05.729 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/wl1273-core.ko 2024-04-18T04:31:05.730 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 52361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/wm8994.ko 2024-04-18T04:31:05.730 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ 2024-04-18T04:31:05.730 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-04-18T04:31:05.730 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 64265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ad525x_dpot.ko 2024-04-18T04:31:05.730 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/altera-stapl/ 2024-04-18T04:31:05.730 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 57521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-18T04:31:05.730 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/apds9802als.ko 2024-04-18T04:31:05.730 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 47689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/apds990x.ko 2024-04-18T04:31:05.730 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 58633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/bh1770glc.ko 2024-04-18T04:31:05.730 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/c2port/ 2024-04-18T04:31:05.730 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-04-18T04:31:05.730 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 47449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/c2port/core.ko 2024-04-18T04:31:05.730 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/cb710/ 2024-04-18T04:31:05.731 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/cb710/cb710.ko 2024-04-18T04:31:05.731 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ds1682.ko 2024-04-18T04:31:05.731 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/dummy-irq.ko 2024-04-18T04:31:05.731 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/echo/ 2024-04-18T04:31:05.731 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/echo/echo.ko 2024-04-18T04:31:05.731 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/ 2024-04-18T04:31:05.731 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 43041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/at24.ko 2024-04-18T04:31:05.731 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-18T04:31:05.731 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/max6875.ko 2024-04-18T04:31:05.731 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 41185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/enclosure.ko 2024-04-18T04:31:05.731 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/genwqe/ 2024-04-18T04:31:05.731 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 191649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-04-18T04:31:05.731 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/hmc6352.ko 2024-04-18T04:31:05.731 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 37761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/hpilo.ko 2024-04-18T04:31:05.731 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ibmasm/ 2024-04-18T04:31:05.732 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 92345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-04-18T04:31:05.732 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ics932s401.ko 2024-04-18T04:31:05.732 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/isl29003.ko 2024-04-18T04:31:05.732 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/isl29020.ko 2024-04-18T04:31:05.732 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d/ 2024-04-18T04:31:05.732 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 54865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-18T04:31:05.732 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-18T04:31:05.732 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/ 2024-04-18T04:31:05.732 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 154169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei-me.ko 2024-04-18T04:31:05.732 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 69809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei-txe.ko 2024-04-18T04:31:05.732 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 389033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei.ko 2024-04-18T04:31:05.732 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 37961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/phantom.ko 2024-04-18T04:31:05.732 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ti-st/ 2024-04-18T04:31:05.732 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 91145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/ti-st/st_drv.ko 2024-04-18T04:31:05.733 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tifm_7xx1.ko 2024-04-18T04:31:05.733 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 34457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tifm_core.ko 2024-04-18T04:31:05.733 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tsl2550.ko 2024-04-18T04:31:05.733 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 55793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_balloon.ko 2024-04-18T04:31:05.733 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_vmci/ 2024-04-18T04:31:05.733 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 234905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-18T04:31:05.733 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ 2024-04-18T04:31:05.733 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/bonding/ 2024-04-18T04:31:05.733 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 620961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/bonding/bonding.ko 2024-04-18T04:31:05.733 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/ 2024-04-18T04:31:05.733 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/b53/ 2024-04-18T04:31:05.733 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 139817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-18T04:31:05.733 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 49545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-18T04:31:05.733 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-18T04:31:05.733 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6xxx/ 2024-04-18T04:31:05.734 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 587065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-18T04:31:05.734 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dummy.ko 2024-04-18T04:31:05.734 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/eql.ko 2024-04-18T04:31:05.734 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ 2024-04-18T04:31:05.734 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/ 2024-04-18T04:31:05.734 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 53753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-18T04:31:05.734 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 49201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-18T04:31:05.734 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 158649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-18T04:31:05.734 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 85953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-18T04:31:05.734 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/ 2024-04-18T04:31:05.734 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 44161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-18T04:31:05.734 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 73865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-18T04:31:05.734 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-18T04:31:05.734 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 109521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-18T04:31:05.735 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/adaptec/ 2024-04-18T04:31:05.735 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 64705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-18T04:31:05.735 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/agere/ 2024-04-18T04:31:05.735 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 84329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-18T04:31:05.735 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/alteon/ 2024-04-18T04:31:05.735 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 70737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-18T04:31:05.735 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/altera/ 2024-04-18T04:31:05.735 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 52705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-18T04:31:05.735 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/ 2024-04-18T04:31:05.735 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 65857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-18T04:31:05.735 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 56057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-18T04:31:05.735 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 115881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-18T04:31:05.735 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/ 2024-04-18T04:31:05.736 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/alx/ 2024-04-18T04:31:05.736 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 124497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-18T04:31:05.736 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-04-18T04:31:05.736 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 128409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-18T04:31:05.736 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-04-18T04:31:05.736 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 110345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-18T04:31:05.736 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx/ 2024-04-18T04:31:05.736 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 101857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-18T04:31:05.736 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 88953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-18T04:31:05.736 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/ 2024-04-18T04:31:05.736 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 105633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-18T04:31:05.736 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 228985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-18T04:31:05.736 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-04-18T04:31:05.736 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 1733353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-18T04:31:05.736 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 167185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-18T04:31:05.737 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/genet/ 2024-04-18T04:31:05.737 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 161417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-18T04:31:05.737 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 440625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-18T04:31:05.737 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade/ 2024-04-18T04:31:05.737 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade/bna/ 2024-04-18T04:31:05.737 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 432201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-18T04:31:05.737 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/ 2024-04-18T04:31:05.737 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-04-18T04:31:05.737 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 257201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-18T04:31:05.737 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-04-18T04:31:05.737 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 446177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-18T04:31:05.737 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-04-18T04:31:05.737 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 1311433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-18T04:31:05.737 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-04-18T04:31:05.737 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 206689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-18T04:31:05.738 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-04-18T04:31:05.738 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 40161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-18T04:31:05.738 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco/ 2024-04-18T04:31:05.738 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco/enic/ 2024-04-18T04:31:05.738 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 269313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-18T04:31:05.738 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/ 2024-04-18T04:31:05.738 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/ 2024-04-18T04:31:05.738 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 85385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-18T04:31:05.738 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 77457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-18T04:31:05.738 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 169089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-18T04:31:05.738 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 65913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-18T04:31:05.738 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 76209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-18T04:31:05.738 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 38065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-18T04:31:05.738 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink/ 2024-04-18T04:31:05.739 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 75945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-18T04:31:05.739 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 78705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-18T04:31:05.739 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 52313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dnet.ko 2024-04-18T04:31:05.739 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 30409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ec_bhf.ko 2024-04-18T04:31:05.739 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex/ 2024-04-18T04:31:05.739 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex/benet/ 2024-04-18T04:31:05.739 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 356377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-18T04:31:05.739 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 61737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ethoc.ko 2024-04-18T04:31:05.739 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 63185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/fealnx.ko 2024-04-18T04:31:05.739 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/fujitsu/ 2024-04-18T04:31:05.739 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 51513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-04-18T04:31:05.739 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ 2024-04-18T04:31:05.739 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 115569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-18T04:31:05.739 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000/ 2024-04-18T04:31:05.739 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 366217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-18T04:31:05.740 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000e/ 2024-04-18T04:31:05.740 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 755793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-18T04:31:05.740 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/fm10k/ 2024-04-18T04:31:05.740 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 324577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-18T04:31:05.817 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/i40e/ 2024-04-18T04:31:05.818 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 1196297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-18T04:31:05.818 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/iavf/ 2024-04-18T04:31:05.818 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 362593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-18T04:31:05.818 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igb/ 2024-04-18T04:31:05.818 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 671801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-18T04:31:05.818 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igbvf/ 2024-04-18T04:31:05.818 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 121537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-18T04:31:05.818 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-04-18T04:31:05.818 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 966705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-18T04:31:05.818 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-04-18T04:31:05.818 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 193585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-18T04:31:05.818 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 108633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/jme.ko 2024-04-18T04:31:05.818 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/ 2024-04-18T04:31:05.819 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-18T04:31:05.819 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 126881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-18T04:31:05.819 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 150777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-18T04:31:05.819 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/ 2024-04-18T04:31:05.819 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-04-18T04:31:05.819 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 905033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-18T04:31:05.819 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 344145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-18T04:31:05.819 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-04-18T04:31:05.819 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-04-18T04:31:05.819 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 1412417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-18T04:31:05.819 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ 2024-04-18T04:31:05.819 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 65913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-04-18T04:31:05.819 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 54497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-04-18T04:31:05.819 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-04-18T04:31:05.820 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 117353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-18T04:31:05.820 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom/ 2024-04-18T04:31:05.820 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-04-18T04:31:05.820 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 131425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-18T04:31:05.820 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi/ 2024-04-18T04:31:05.820 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 91465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-18T04:31:05.820 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 56689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-18T04:31:05.820 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/neterion/ 2024-04-18T04:31:05.820 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 181081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-18T04:31:05.820 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/nvidia/ 2024-04-18T04:31:05.820 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 171417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-18T04:31:05.820 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines/ 2024-04-18T04:31:05.820 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 58249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-18T04:31:05.820 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 50121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-18T04:31:05.821 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/ 2024-04-18T04:31:05.821 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-04-18T04:31:05.821 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 300817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-18T04:31:05.821 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 105689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-18T04:31:05.821 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-04-18T04:31:05.821 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 885129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-18T04:31:05.821 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rdc/ 2024-04-18T04:31:05.821 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 52305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-18T04:31:05.821 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/ 2024-04-18T04:31:05.821 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 81641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-18T04:31:05.821 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 100689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-18T04:31:05.821 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 34073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-18T04:31:05.821 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 264161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-18T04:31:05.821 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/samsung/ 2024-04-18T04:31:05.821 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-04-18T04:31:05.822 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 142449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-04-18T04:31:05.822 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sfc/ 2024-04-18T04:31:05.822 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 1350385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-18T04:31:05.822 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/silan/ 2024-04-18T04:31:05.822 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 57953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-18T04:31:05.822 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis/ 2024-04-18T04:31:05.822 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 66505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-18T04:31:05.822 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 80065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-18T04:31:05.822 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/ 2024-04-18T04:31:05.822 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 74289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-18T04:31:05.822 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 79457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-18T04:31:05.822 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 100785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-18T04:31:05.822 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 83441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-18T04:31:05.823 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/ 2024-04-18T04:31:05.823 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-04-18T04:31:05.823 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-04-18T04:31:05.823 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 46985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-18T04:31:05.823 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-04-18T04:31:05.823 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 644537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-18T04:31:05.823 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/ 2024-04-18T04:31:05.823 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 128497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-18T04:31:05.823 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 207993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-18T04:31:05.823 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 82633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-18T04:31:05.823 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 91353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-18T04:31:05.823 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/tehuti/ 2024-04-18T04:31:05.823 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 59865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-18T04:31:05.823 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ti/ 2024-04-18T04:31:05.824 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 110729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-18T04:31:05.824 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via/ 2024-04-18T04:31:05.824 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 98689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-18T04:31:05.824 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 102513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-18T04:31:05.824 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet/ 2024-04-18T04:31:05.824 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 61497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-18T04:31:05.824 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 40609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-18T04:31:05.824 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/xircom/ 2024-04-18T04:31:05.824 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 69913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-18T04:31:05.824 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/fddi/ 2024-04-18T04:31:05.824 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 49449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/fddi/defxx.ko 2024-04-18T04:31:05.824 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/fddi/skfp/ 2024-04-18T04:31:05.824 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 275801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/fddi/skfp/skfp.ko 2024-04-18T04:31:05.825 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 91105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/geneve.ko 2024-04-18T04:31:05.825 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/hyperv/ 2024-04-18T04:31:05.825 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 290441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-18T04:31:05.825 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ieee802154/ 2024-04-18T04:31:05.825 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-18T04:31:05.825 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 30001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ifb.ko 2024-04-18T04:31:05.825 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ipvlan/ 2024-04-18T04:31:05.825 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 108329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-18T04:31:05.825 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 78065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/macvlan.ko 2024-04-18T04:31:05.825 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/macvtap.ko 2024-04-18T04:31:05.825 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/ 2024-04-18T04:31:05.825 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-18T04:31:05.825 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-18T04:31:05.825 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-gpio.ko 2024-04-18T04:31:05.826 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-18T04:31:05.826 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio.ko 2024-04-18T04:31:05.826 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mii.ko 2024-04-18T04:31:05.826 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 62681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/netconsole.ko 2024-04-18T04:31:05.826 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/nlmon.ko 2024-04-18T04:31:05.826 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs/ 2024-04-18T04:31:05.826 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-18T04:31:05.826 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 48313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-18T04:31:05.826 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/ 2024-04-18T04:31:05.826 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/amd.ko 2024-04-18T04:31:05.826 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 61985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-18T04:31:05.826 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 52865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-18T04:31:05.826 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm87xx.ko 2024-04-18T04:31:05.827 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 53409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/broadcom.ko 2024-04-18T04:31:05.827 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/cicada.ko 2024-04-18T04:31:05.827 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/davicom.ko 2024-04-18T04:31:05.827 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/et1011c.ko 2024-04-18T04:31:05.827 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 31313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/icplus.ko 2024-04-18T04:31:05.827 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/lxt.ko 2024-04-18T04:31:05.827 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 103377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/marvell.ko 2024-04-18T04:31:05.827 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 96025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/micrel.ko 2024-04-18T04:31:05.827 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/national.ko 2024-04-18T04:31:05.827 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 121105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/phylink.ko 2024-04-18T04:31:05.827 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/qsemi.ko 2024-04-18T04:31:05.827 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 62113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/realtek.ko 2024-04-18T04:31:05.827 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 35513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/smsc.ko 2024-04-18T04:31:05.828 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/ste10Xp.ko 2024-04-18T04:31:05.828 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/vitesse.ko 2024-04-18T04:31:05.828 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/plip/ 2024-04-18T04:31:05.828 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 55353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/plip/plip.ko 2024-04-18T04:31:05.828 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ 2024-04-18T04:31:05.828 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-18T04:31:05.828 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 36273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_async.ko 2024-04-18T04:31:05.828 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-18T04:31:05.828 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-18T04:31:05.828 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 35369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-18T04:31:05.828 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 53233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pppoe.ko 2024-04-18T04:31:05.828 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pppox.ko 2024-04-18T04:31:05.828 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 40081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pptp.ko 2024-04-18T04:31:05.828 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 35937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/sb1000.ko 2024-04-18T04:31:05.829 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip/ 2024-04-18T04:31:05.829 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 52073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip/slip.ko 2024-04-18T04:31:05.829 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 42409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/sungem_phy.ko 2024-04-18T04:31:05.829 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 80161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/tap.ko 2024-04-18T04:31:05.829 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/ 2024-04-18T04:31:05.829 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 137321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team.ko 2024-04-18T04:31:05.829 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-18T04:31:05.829 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-18T04:31:05.829 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 36209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-18T04:31:05.829 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_random.ko 2024-04-18T04:31:05.829 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-18T04:31:05.829 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 108089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/veth.ko 2024-04-18T04:31:05.829 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vmxnet3/ 2024-04-18T04:31:05.829 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 176497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-18T04:31:05.830 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vxlan/ 2024-04-18T04:31:05.830 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 383593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vxlan/vxlan.ko 2024-04-18T04:31:05.830 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netback/ 2024-04-18T04:31:05.830 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 175537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-18T04:31:05.830 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ntb/ 2024-04-18T04:31:05.830 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ntb/ntb.ko 2024-04-18T04:31:05.830 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/ 2024-04-18T04:31:05.830 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host/ 2024-04-18T04:31:05.830 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 335857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host/nvme-core.ko 2024-04-18T04:31:05.830 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 126553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host/nvme.ko 2024-04-18T04:31:05.830 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/ 2024-04-18T04:31:05.830 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 168145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport.ko 2024-04-18T04:31:05.830 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_cs.ko 2024-04-18T04:31:05.831 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 103889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_pc.ko 2024-04-18T04:31:05.831 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 30313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_serial.ko 2024-04-18T04:31:05.831 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/ 2024-04-18T04:31:05.831 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug/ 2024-04-18T04:31:05.831 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-18T04:31:05.831 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-04-18T04:31:05.831 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-04-18T04:31:05.831 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/pci-stub.ko 2024-04-18T04:31:05.831 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 55329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/xen-pcifront.ko 2024-04-18T04:31:05.831 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/ 2024-04-18T04:31:05.831 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 31529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/i82092.ko 2024-04-18T04:31:05.831 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 179961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/pcmcia.ko 2024-04-18T04:31:05.831 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 78161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/pcmcia_core.ko 2024-04-18T04:31:05.831 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 41945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-04-18T04:31:05.831 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 40457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/pd6729.ko 2024-04-18T04:31:05.832 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 133753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-18T04:31:05.832 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/phy/ 2024-04-18T04:31:05.832 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/phy/broadcom/ 2024-04-18T04:31:05.832 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-04-18T04:31:05.832 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/phy/samsung/ 2024-04-18T04:31:05.832 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-04-18T04:31:05.832 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl/ 2024-04-18T04:31:05.832 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl/intel/ 2024-04-18T04:31:05.832 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 78193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-18T04:31:05.832 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/ 2024-04-18T04:31:05.832 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/ 2024-04-18T04:31:05.832 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 61041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-04-18T04:31:05.832 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros_ec.ko 2024-04-18T04:31:05.833 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-04-18T04:31:05.833 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 30217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-04-18T04:31:05.833 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 31801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-04-18T04:31:05.833 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-04-18T04:31:05.833 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-04-18T04:31:05.833 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/ 2024-04-18T04:31:05.833 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 87481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-18T04:31:05.833 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 44105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/acerhdf.ko 2024-04-18T04:31:05.833 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 48257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-18T04:31:05.833 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 73865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-18T04:31:05.833 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-18T04:31:05.833 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 164769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-18T04:31:05.833 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 46185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-18T04:31:05.833 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 62073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-18T04:31:05.833 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-18T04:31:05.834 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 51881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-18T04:31:05.834 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-18T04:31:05.834 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 42761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/hdaps.ko 2024-04-18T04:31:05.834 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/ibm_rtl.ko 2024-04-18T04:31:05.834 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel/ 2024-04-18T04:31:05.834 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-18T04:31:05.834 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-04-18T04:31:05.834 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 54001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel_ips.ko 2024-04-18T04:31:05.834 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-18T04:31:05.834 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-18T04:31:05.834 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 43753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-18T04:31:05.834 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 51897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-18T04:31:05.834 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-18T04:31:05.835 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-18T04:31:05.835 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-18T04:31:05.835 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-18T04:31:05.835 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-18T04:31:05.835 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 61417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/wmi.ko 2024-04-18T04:31:05.835 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/ 2024-04-18T04:31:05.835 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/ 2024-04-18T04:31:05.835 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 36513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/88pm860x_battery.ko 2024-04-18T04:31:05.835 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 40425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/88pm860x_charger.ko 2024-04-18T04:31:05.835 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 68833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/bq2415x_charger.ko 2024-04-18T04:31:05.835 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 73073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/bq24190_charger.ko 2024-04-18T04:31:05.835 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/bq24735-charger.ko 2024-04-18T04:31:05.835 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-04-18T04:31:05.835 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/da9030_battery.ko 2024-04-18T04:31:05.836 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/da9052-battery.ko 2024-04-18T04:31:05.836 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 34489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/ds2760_battery.ko 2024-04-18T04:31:05.836 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/ds2780_battery.ko 2024-04-18T04:31:05.836 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/ds2781_battery.ko 2024-04-18T04:31:05.836 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/ds2782_battery.ko 2024-04-18T04:31:05.836 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/gpio-charger.ko 2024-04-18T04:31:05.836 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/isp1704_charger.ko 2024-04-18T04:31:05.836 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/lp8727_charger.ko 2024-04-18T04:31:05.836 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/max14577_charger.ko 2024-04-18T04:31:05.836 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 37833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/max17042_battery.ko 2024-04-18T04:31:05.836 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/max8903_charger.ko 2024-04-18T04:31:05.836 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 27689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/max8925_power.ko 2024-04-18T04:31:05.836 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/pcf50633-charger.ko 2024-04-18T04:31:05.837 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 44841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/sbs-battery.ko 2024-04-18T04:31:05.837 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 34905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/test_power.ko 2024-04-18T04:31:05.837 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/tps65090-charger.ko 2024-04-18T04:31:05.837 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/wm831x_backup.ko 2024-04-18T04:31:05.837 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/wm831x_power.ko 2024-04-18T04:31:05.837 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 27441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/power/supply/wm8350_power.ko 2024-04-18T04:31:05.837 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap/ 2024-04-18T04:31:05.837 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 73297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-18T04:31:05.837 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-18T04:31:05.837 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/ 2024-04-18T04:31:05.837 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/ 2024-04-18T04:31:05.837 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-18T04:31:05.837 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-18T04:31:05.837 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps_parport.ko 2024-04-18T04:31:05.838 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 49817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/pps_core.ko 2024-04-18T04:31:05.838 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp/ 2024-04-18T04:31:05.838 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 91393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp/ptp.ko 2024-04-18T04:31:05.838 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp/ptp_kvm.ko 2024-04-18T04:31:05.838 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/ 2024-04-18T04:31:05.838 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/ 2024-04-18T04:31:05.838 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/atl/ 2024-04-18T04:31:05.838 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 67513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-18T04:31:05.838 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 47137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/fmpm.ko 2024-04-18T04:31:05.838 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/ 2024-04-18T04:31:05.838 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 27593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-88pm80x.ko 2024-04-18T04:31:05.838 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-88pm860x.ko 2024-04-18T04:31:05.838 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-18T04:31:05.839 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-da9052.ko 2024-04-18T04:31:05.839 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-da9055.ko 2024-04-18T04:31:05.839 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-da9063.ko 2024-04-18T04:31:05.839 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-18T04:31:05.839 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 82225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-18T04:31:05.839 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-18T04:31:05.839 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-18T04:31:05.839 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-18T04:31:05.839 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-18T04:31:05.839 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-18T04:31:05.839 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-18T04:31:05.839 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-18T04:31:05.839 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-em3027.ko 2024-04-18T04:31:05.839 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-18T04:31:05.840 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-18T04:31:05.840 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 44129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-18T04:31:05.840 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-lp8788.ko 2024-04-18T04:31:05.840 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 46913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-18T04:31:05.840 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-18T04:31:05.840 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-18T04:31:05.840 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m48t86.ko 2024-04-18T04:31:05.840 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max6900.ko 2024-04-18T04:31:05.840 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max8907.ko 2024-04-18T04:31:05.840 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max8925.ko 2024-04-18T04:31:05.840 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 31337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max8997.ko 2024-04-18T04:31:05.840 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max8998.ko 2024-04-18T04:31:05.840 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-04-18T04:31:05.840 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-18T04:31:05.840 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-palmas.ko 2024-04-18T04:31:05.841 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 56777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-18T04:31:05.841 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf50633.ko 2024-04-18T04:31:05.841 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 32657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-18T04:31:05.841 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-18T04:31:05.841 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 36065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-18T04:31:05.841 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-18T04:31:05.841 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rc5t583.ko 2024-04-18T04:31:05.841 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-18T04:31:05.841 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 40081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-18T04:31:05.841 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 34529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-18T04:31:05.841 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-18T04:31:05.841 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-18T04:31:05.841 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-s35390a.ko 2024-04-18T04:31:05.842 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-18T04:31:05.842 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-tps6586x.ko 2024-04-18T04:31:05.842 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-tps65910.ko 2024-04-18T04:31:05.842 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-wm831x.ko 2024-04-18T04:31:05.842 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-wm8350.ko 2024-04-18T04:31:05.842 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-x1205.ko 2024-04-18T04:31:05.842 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ 2024-04-18T04:31:05.842 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 90377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-9xxx.ko 2024-04-18T04:31:05.842 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 69593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-sas.ko 2024-04-18T04:31:05.842 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 65945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-xxxx.ko 2024-04-18T04:31:05.842 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 164569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/BusLogic.ko 2024-04-18T04:31:05.842 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 31617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/a100u2w.ko 2024-04-18T04:31:05.842 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aacraid/ 2024-04-18T04:31:05.842 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 340721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-18T04:31:05.843 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 120337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/advansys.ko 2024-04-18T04:31:05.843 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx/ 2024-04-18T04:31:05.843 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 468081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-18T04:31:05.843 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 380673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-18T04:31:05.843 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic94xx/ 2024-04-18T04:31:05.843 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 243705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-04-18T04:31:05.843 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/am53c974.ko 2024-04-18T04:31:05.843 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/arcmsr/ 2024-04-18T04:31:05.843 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 135617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-18T04:31:05.843 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 44289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/atp870u.ko 2024-04-18T04:31:05.843 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/be2iscsi/ 2024-04-18T04:31:05.843 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 304993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-18T04:31:05.843 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bfa/ 2024-04-18T04:31:05.843 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 1527113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bfa/bfa.ko 2024-04-18T04:31:05.844 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2fc/ 2024-04-18T04:31:05.844 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 297801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-18T04:31:05.844 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2i/ 2024-04-18T04:31:05.844 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 144401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-18T04:31:05.844 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 47457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ch.ko 2024-04-18T04:31:05.844 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/csiostor/ 2024-04-18T04:31:05.844 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 390713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-18T04:31:05.844 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/ 2024-04-18T04:31:05.844 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-04-18T04:31:05.844 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 88881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-18T04:31:05.844 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-04-18T04:31:05.844 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 117481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-18T04:31:05.844 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 173017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-18T04:31:05.845 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 91569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/dc395x.ko 2024-04-18T04:31:05.845 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 45401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/dmx3191d.ko 2024-04-18T04:31:05.845 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esas2r/ 2024-04-18T04:31:05.845 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 267577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-18T04:31:05.845 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 78969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esp_scsi.ko 2024-04-18T04:31:05.845 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe/ 2024-04-18T04:31:05.845 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 95329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-18T04:31:05.845 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 194017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-18T04:31:05.845 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fdomain.ko 2024-04-18T04:31:05.845 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fnic/ 2024-04-18T04:31:05.845 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 366529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fnic/fnic.ko 2024-04-18T04:31:05.845 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 251505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hpsa.ko 2024-04-18T04:31:05.845 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 65761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hptiop.ko 2024-04-18T04:31:05.845 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 57097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hv_storvsc.ko 2024-04-18T04:31:05.845 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 44689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/imm.ko 2024-04-18T04:31:05.846 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 55153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/initio.ko 2024-04-18T04:31:05.846 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 327841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ipr.ko 2024-04-18T04:31:05.846 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 129785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ips.ko 2024-04-18T04:31:05.846 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/isci/ 2024-04-18T04:31:05.846 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 397785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/isci/isci.ko 2024-04-18T04:31:05.846 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 32017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-18T04:31:05.846 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 63121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-18T04:31:05.846 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libfc/ 2024-04-18T04:31:05.846 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 386849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libfc/libfc.ko 2024-04-18T04:31:05.846 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 178177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libiscsi.ko 2024-04-18T04:31:05.846 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 64809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-18T04:31:05.846 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libsas/ 2024-04-18T04:31:05.846 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 274009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libsas/libsas.ko 2024-04-18T04:31:05.846 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/lpfc/ 2024-04-18T04:31:05.847 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 2736001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-18T04:31:05.847 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/ 2024-04-18T04:31:05.847 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 88529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-18T04:31:05.847 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 40145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-18T04:31:05.847 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 389177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-18T04:31:05.847 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 104769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid.ko 2024-04-18T04:31:05.847 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mpt3sas/ 2024-04-18T04:31:05.847 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 836945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-18T04:31:05.847 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvsas/ 2024-04-18T04:31:05.847 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 158729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-18T04:31:05.847 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 96537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvumi.ko 2024-04-18T04:31:05.847 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pcmcia/ 2024-04-18T04:31:05.847 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 101625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-04-18T04:31:05.847 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-04-18T04:31:05.848 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-04-18T04:31:05.848 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-04-18T04:31:05.848 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pm8001/ 2024-04-18T04:31:05.848 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 443745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-18T04:31:05.848 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 152033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pmcraid.ko 2024-04-18T04:31:05.848 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 41625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ppa.ko 2024-04-18T04:31:05.848 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 66977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla1280.ko 2024-04-18T04:31:05.848 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx/ 2024-04-18T04:31:05.848 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 2324809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-18T04:31:05.848 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 103601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-18T04:31:05.848 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla4xxx/ 2024-04-18T04:31:05.848 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 697337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-18T04:31:05.848 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qlogicfas408.ko 2024-04-18T04:31:05.848 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/raid_class.ko 2024-04-18T04:31:05.849 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 322865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_debug.ko 2024-04-18T04:31:05.849 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 219857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-18T04:31:05.849 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 357153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-18T04:31:05.849 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 121185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-18T04:31:05.849 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 93481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-18T04:31:05.849 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 55401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-18T04:31:05.849 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ses.ko 2024-04-18T04:31:05.849 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 138121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/st.ko 2024-04-18T04:31:05.849 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 57401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/stex.ko 2024-04-18T04:31:05.849 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/sym53c8xx_2/ 2024-04-18T04:31:05.849 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 205025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-18T04:31:05.849 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 55425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/virtio_scsi.ko 2024-04-18T04:31:05.849 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 59185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-18T04:31:05.849 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 48777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/wd719x.ko 2024-04-18T04:31:05.850 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 59417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/xen-scsifront.ko 2024-04-18T04:31:05.850 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ssb/ 2024-04-18T04:31:05.850 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 174913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ssb/ssb.ko 2024-04-18T04:31:05.850 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/ 2024-04-18T04:31:05.850 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/iscsi/ 2024-04-18T04:31:05.850 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 920169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-18T04:31:05.850 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/loopback/ 2024-04-18T04:31:05.850 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 60321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-18T04:31:05.850 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 48129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_file.ko 2024-04-18T04:31:05.850 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 54233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_iblock.ko 2024-04-18T04:31:05.850 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 1170033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_mod.ko 2024-04-18T04:31:05.850 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 51897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_pscsi.ko 2024-04-18T04:31:05.850 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 149721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_user.ko 2024-04-18T04:31:05.850 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/tcm_fc/ 2024-04-18T04:31:05.851 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 90057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-18T04:31:05.851 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/ 2024-04-18T04:31:05.851 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/ 2024-04-18T04:31:05.851 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/ 2024-04-18T04:31:05.851 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-18T04:31:05.851 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 35209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-18T04:31:05.851 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-18T04:31:05.851 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-18T04:31:05.851 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-18T04:31:05.851 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-18T04:31:05.851 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 36729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-18T04:31:05.851 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-18T04:31:05.851 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-18T04:31:05.851 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-18T04:31:05.852 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-18T04:31:05.852 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-18T04:31:05.852 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 46065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-18T04:31:05.852 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-18T04:31:05.852 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-18T04:31:05.852 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 35913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-04-18T04:31:05.852 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-18T04:31:05.852 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-18T04:31:05.852 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 30577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-18T04:31:05.852 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/ 2024-04-18T04:31:05.852 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/ipwireless/ 2024-04-18T04:31:05.852 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 99313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-18T04:31:05.852 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 69729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/moxa.ko 2024-04-18T04:31:05.852 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 61649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/mxser.ko 2024-04-18T04:31:05.853 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 134401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/n_gsm.ko 2024-04-18T04:31:05.853 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 37905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/n_hdlc.ko 2024-04-18T04:31:05.853 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 78969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/nozomi.ko 2024-04-18T04:31:05.853 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/ 2024-04-18T04:31:05.853 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/8250/ 2024-04-18T04:31:05.853 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 44057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-04-18T04:31:05.853 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 65121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-18T04:31:05.853 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-04-18T04:31:05.853 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/altera_uart.ko 2024-04-18T04:31:05.853 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/arc_uart.ko 2024-04-18T04:31:05.853 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 91665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-04-18T04:31:05.853 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/jsm/ 2024-04-18T04:31:05.853 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 120577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-18T04:31:05.853 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 35161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/rp2.ko 2024-04-18T04:31:05.854 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 65641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/sc16is7xx.ko 2024-04-18T04:31:05.854 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/ 2024-04-18T04:31:05.854 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/core/ 2024-04-18T04:31:05.854 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 693081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-18T04:31:05.854 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/host/ 2024-04-18T04:31:05.854 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 34449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-18T04:31:05.854 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-04-18T04:31:05.854 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/ 2024-04-18T04:31:05.854 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 55617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio.ko 2024-04-18T04:31:05.854 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_aec.ko 2024-04-18T04:31:05.854 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_cif.ko 2024-04-18T04:31:05.854 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_dmem_genirq.ko 2024-04-18T04:31:05.854 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_mf624.ko 2024-04-18T04:31:05.854 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_netx.ko 2024-04-18T04:31:05.855 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_pci_generic.ko 2024-04-18T04:31:05.855 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-04-18T04:31:05.855 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_sercos3.ko 2024-04-18T04:31:05.855 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/ 2024-04-18T04:31:05.855 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/c67x00/ 2024-04-18T04:31:05.855 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 90321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/c67x00/c67x00.ko 2024-04-18T04:31:05.855 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/chipidea/ 2024-04-18T04:31:05.855 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 189209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-04-18T04:31:05.855 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-04-18T04:31:05.855 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-04-18T04:31:05.855 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-04-18T04:31:05.855 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-04-18T04:31:05.855 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/ 2024-04-18T04:31:05.855 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 101545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/cdc-acm.ko 2024-04-18T04:31:05.856 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 63073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-18T04:31:05.856 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 56721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/usblp.ko 2024-04-18T04:31:05.856 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 107417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/usbtmc.ko 2024-04-18T04:31:05.856 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/common/ 2024-04-18T04:31:05.856 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/common/ulpi.ko 2024-04-18T04:31:05.856 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/dwc2/ 2024-04-18T04:31:05.856 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-04-18T04:31:05.856 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/dwc3/ 2024-04-18T04:31:05.856 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-04-18T04:31:05.856 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-04-18T04:31:05.856 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 574593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/dwc3/dwc3.ko 2024-04-18T04:31:05.856 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/ 2024-04-18T04:31:05.856 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/ 2024-04-18T04:31:05.856 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 72249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/u_ether.ko 2024-04-18T04:31:05.857 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 61953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/u_serial.ko 2024-04-18T04:31:05.857 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-04-18T04:31:05.857 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 49737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-04-18T04:31:05.857 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-04-18T04:31:05.857 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 43553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-04-18T04:31:05.857 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 131345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-04-18T04:31:05.857 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 62321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-04-18T04:31:05.857 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 146617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-04-18T04:31:05.857 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 70689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-04-18T04:31:05.857 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-04-18T04:31:05.857 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 37649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-04-18T04:31:05.857 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 70017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-04-18T04:31:05.857 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 101249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-04-18T04:31:05.857 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-04-18T04:31:05.857 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 71257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-04-18T04:31:05.858 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 84937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-04-18T04:31:05.858 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/ 2024-04-18T04:31:05.858 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-04-18T04:31:05.858 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-04-18T04:31:05.858 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-04-18T04:31:05.858 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-04-18T04:31:05.858 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-04-18T04:31:05.858 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-04-18T04:31:05.858 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-04-18T04:31:05.858 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-04-18T04:31:05.858 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 35689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-04-18T04:31:05.858 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-04-18T04:31:05.858 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-04-18T04:31:05.859 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 30345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-04-18T04:31:05.859 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 78073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-04-18T04:31:05.859 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-04-18T04:31:05.859 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 204049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/libcomposite.ko 2024-04-18T04:31:05.859 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/ 2024-04-18T04:31:05.859 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-04-18T04:31:05.859 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/bdc/ 2024-04-18T04:31:05.859 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 182561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-04-18T04:31:05.859 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 45545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-04-18T04:31:05.859 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 66513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-04-18T04:31:05.859 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 85217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-04-18T04:31:05.859 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 69313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-04-18T04:31:05.859 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 90313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/net2272.ko 2024-04-18T04:31:05.859 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 90361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/net2280.ko 2024-04-18T04:31:05.859 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 94841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-04-18T04:31:05.860 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 80521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-04-18T04:31:05.860 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 87465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-04-18T04:31:05.860 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 95441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-04-18T04:31:05.860 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 195969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-04-18T04:31:05.860 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/ 2024-04-18T04:31:05.860 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/bcma-hcd.ko 2024-04-18T04:31:05.860 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 108321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/isp116x-hcd.ko 2024-04-18T04:31:05.860 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 104377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-04-18T04:31:05.860 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 102273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-04-18T04:31:05.860 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 60105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-18T04:31:05.860 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/sl811_cs.ko 2024-04-18T04:31:05.860 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/ssb-hcd.ko 2024-04-18T04:31:05.860 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 32553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-04-18T04:31:05.860 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image/ 2024-04-18T04:31:05.861 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 40409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image/mdc800.ko 2024-04-18T04:31:05.861 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image/microtek.ko 2024-04-18T04:31:05.861 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ 2024-04-18T04:31:05.861 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 47353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/adutux.ko 2024-04-18T04:31:05.861 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/appledisplay.ko 2024-04-18T04:31:05.861 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-04-18T04:31:05.861 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/cytherm.ko 2024-04-18T04:31:05.861 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ehset.ko 2024-04-18T04:31:05.861 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/emi26.ko 2024-04-18T04:31:05.861 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/emi62.ko 2024-04-18T04:31:05.861 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ezusb.ko 2024-04-18T04:31:05.861 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/idmouse.ko 2024-04-18T04:31:05.861 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 42729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/iowarrior.ko 2024-04-18T04:31:05.861 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-18T04:31:05.862 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 42241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ldusb.ko 2024-04-18T04:31:05.862 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 42233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/legousbtower.ko 2024-04-18T04:31:05.862 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/lvstest.ko 2024-04-18T04:31:05.862 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/sisusbvga/ 2024-04-18T04:31:05.862 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 85313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-18T04:31:05.862 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-18T04:31:05.862 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usb3503.ko 2024-04-18T04:31:05.862 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usblcd.ko 2024-04-18T04:31:05.862 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 27809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-18T04:31:05.862 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 84265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usbtest.ko 2024-04-18T04:31:05.862 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 52065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/uss720.ko 2024-04-18T04:31:05.862 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 32345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/yurex.ko 2024-04-18T04:31:05.862 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/mon/ 2024-04-18T04:31:05.862 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 91529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/mon/usbmon.ko 2024-04-18T04:31:05.863 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/musb/ 2024-04-18T04:31:05.863 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 396209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/musb/musb_hdrc.ko 2024-04-18T04:31:05.863 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/ 2024-04-18T04:31:05.863 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/phy-generic.ko 2024-04-18T04:31:05.863 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-04-18T04:31:05.863 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/phy-isp1301.ko 2024-04-18T04:31:05.863 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/phy-tahvo.ko 2024-04-18T04:31:05.863 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ 2024-04-18T04:31:05.863 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/aircable.ko 2024-04-18T04:31:05.863 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 38209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ark3116.ko 2024-04-18T04:31:05.863 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 30681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-18T04:31:05.863 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 44329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ch341.ko 2024-04-18T04:31:05.863 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 79681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cp210x.ko 2024-04-18T04:31:05.863 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 35137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cyberjack.ko 2024-04-18T04:31:05.863 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 66873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-18T04:31:05.864 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 58329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-18T04:31:05.864 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/empeg.ko 2024-04-18T04:31:05.864 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 53009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/f81232.ko 2024-04-18T04:31:05.864 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 188609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-18T04:31:05.864 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 61489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-18T04:31:05.864 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 152305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-18T04:31:05.864 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 142833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/io_ti.ko 2024-04-18T04:31:05.864 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 69217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ipaq.ko 2024-04-18T04:31:05.864 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ipw.ko 2024-04-18T04:31:05.864 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ir-usb.ko 2024-04-18T04:31:05.864 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 66361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-18T04:31:05.864 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 122329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/keyspan.ko 2024-04-18T04:31:05.864 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 41297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-18T04:31:05.864 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-18T04:31:05.865 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 38049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-18T04:31:05.865 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 38041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mct_u232.ko 2024-04-18T04:31:05.865 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/metro-usb.ko 2024-04-18T04:31:05.865 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 79681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mos7720.ko 2024-04-18T04:31:05.865 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 89969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mos7840.ko 2024-04-18T04:31:05.865 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 65073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mxuport.ko 2024-04-18T04:31:05.865 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/navman.ko 2024-04-18T04:31:05.865 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/omninet.ko 2024-04-18T04:31:05.865 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/opticon.ko 2024-04-18T04:31:05.865 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 193857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/option.ko 2024-04-18T04:31:05.865 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 45337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/oti6858.ko 2024-04-18T04:31:05.865 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 61761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/pl2303.ko 2024-04-18T04:31:05.865 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/qcaux.ko 2024-04-18T04:31:05.865 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 39985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/qcserial.ko 2024-04-18T04:31:05.865 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 40529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/quatech2.ko 2024-04-18T04:31:05.866 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/safe_serial.ko 2024-04-18T04:31:05.866 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 59345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/sierra.ko 2024-04-18T04:31:05.866 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-18T04:31:05.866 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 34065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ssu100.ko 2024-04-18T04:31:05.866 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/symbolserial.ko 2024-04-18T04:31:05.866 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 70497 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-18T04:31:05.866 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-18T04:31:05.866 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb_debug.ko 2024-04-18T04:31:05.866 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 39321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-18T04:31:05.866 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 151137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usbserial.ko 2024-04-18T04:31:05.866 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 32505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/visor.ko 2024-04-18T04:31:05.866 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 43577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/whiteheat.ko 2024-04-18T04:31:05.866 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/wishbone-serial.ko 2024-04-18T04:31:05.866 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-18T04:31:05.867 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ 2024-04-18T04:31:05.867 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 64049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/uas.ko 2024-04-18T04:31:05.867 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 30209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-18T04:31:05.867 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-18T04:31:05.867 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-18T04:31:05.867 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 41073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-18T04:31:05.867 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-18T04:31:05.867 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-18T04:31:05.867 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-18T04:31:05.867 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-karma.ko 2024-04-18T04:31:05.867 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-18T04:31:05.867 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-18T04:31:05.867 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-18T04:31:05.867 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-18T04:31:05.867 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 41785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-18T04:31:05.868 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 201193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/usb-storage.ko 2024-04-18T04:31:05.868 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/ 2024-04-18T04:31:05.868 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 76041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-18T04:31:05.868 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 85257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-18T04:31:05.868 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 122321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-18T04:31:05.868 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/ 2024-04-18T04:31:05.868 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci/ 2024-04-18T04:31:05.868 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 206921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-18T04:31:05.868 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-18T04:31:05.868 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 134265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/vfio.ko 2024-04-18T04:31:05.868 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 93673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-18T04:31:05.868 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/ 2024-04-18T04:31:05.868 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 138721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost.ko 2024-04-18T04:31:05.868 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-18T04:31:05.869 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 71281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_net.ko 2024-04-18T04:31:05.869 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 107905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_scsi.ko 2024-04-18T04:31:05.869 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/ 2024-04-18T04:31:05.869 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/ 2024-04-18T04:31:05.869 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-04-18T04:31:05.869 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/aat2870_bl.ko 2024-04-18T04:31:05.869 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/adp5520_bl.ko 2024-04-18T04:31:05.869 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 41169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/adp8860_bl.ko 2024-04-18T04:31:05.869 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 51745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/adp8870_bl.ko 2024-04-18T04:31:05.869 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/apple_bl.ko 2024-04-18T04:31:05.869 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/as3711_bl.ko 2024-04-18T04:31:05.869 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/bd6107.ko 2024-04-18T04:31:05.869 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/da903x_bl.ko 2024-04-18T04:31:05.869 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/da9052_bl.ko 2024-04-18T04:31:05.870 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/gpio_backlight.ko 2024-04-18T04:31:05.870 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/kb3886_bl.ko 2024-04-18T04:31:05.870 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/lcd.ko 2024-04-18T04:31:05.870 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/lm3533_bl.ko 2024-04-18T04:31:05.870 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/lm3639_bl.ko 2024-04-18T04:31:05.870 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/lv5207lp.ko 2024-04-18T04:31:05.870 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/max8925_bl.ko 2024-04-18T04:31:05.870 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/pandora_bl.ko 2024-04-18T04:31:05.870 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-04-18T04:31:05.870 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-18T04:31:05.870 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/wm831x_bl.ko 2024-04-18T04:31:05.870 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/ 2024-04-18T04:31:05.871 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/ 2024-04-18T04:31:05.871 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/ds2482.ko 2024-04-18T04:31:05.871 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 46801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/ds2490.ko 2024-04-18T04:31:05.871 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/matrox_w1.ko 2024-04-18T04:31:05.871 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/w1-gpio.ko 2024-04-18T04:31:05.871 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/ 2024-04-18T04:31:05.871 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-18T04:31:05.871 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 27257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-18T04:31:05.871 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-18T04:31:05.871 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-18T04:31:05.871 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-18T04:31:05.871 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-18T04:31:05.871 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-18T04:31:05.871 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-18T04:31:05.872 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-18T04:31:05.872 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-18T04:31:05.872 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 70369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-18T04:31:05.872 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 129433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/wire.ko 2024-04-18T04:31:05.872 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ 2024-04-18T04:31:05.872 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/acquirewdt.ko 2024-04-18T04:31:05.872 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/advantechwdt.ko 2024-04-18T04:31:05.872 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-18T04:31:05.872 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 27401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-18T04:31:05.872 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/cpu5wdt.ko 2024-04-18T04:31:05.872 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/da9052_wdt.ko 2024-04-18T04:31:05.872 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/da9055_wdt.ko 2024-04-18T04:31:05.872 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/da9063_wdt.ko 2024-04-18T04:31:05.872 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/dw_wdt.ko 2024-04-18T04:31:05.872 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/eurotechwdt.ko 2024-04-18T04:31:05.873 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-18T04:31:05.873 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 32857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/hpwdt.ko 2024-04-18T04:31:05.873 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/i6300esb.ko 2024-04-18T04:31:05.873 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-18T04:31:05.873 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-18T04:31:05.873 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ib700wdt.ko 2024-04-18T04:31:05.873 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ibmasr.ko 2024-04-18T04:31:05.873 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-18T04:31:05.873 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-18T04:31:05.873 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/it87_wdt.ko 2024-04-18T04:31:05.873 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/kempld_wdt.ko 2024-04-18T04:31:05.873 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/machzwd.ko 2024-04-18T04:31:05.873 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/mena21_wdt.ko 2024-04-18T04:31:05.873 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-04-18T04:31:05.873 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/nv_tco.ko 2024-04-18T04:31:05.874 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-04-18T04:31:05.874 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 27721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/pc87413_wdt.ko 2024-04-18T04:31:05.874 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 46953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-18T04:31:05.874 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 37193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-18T04:31:05.874 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/retu_wdt.ko 2024-04-18T04:31:05.874 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-04-18T04:31:05.874 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-04-18T04:31:05.874 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-18T04:31:05.874 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sc1200wdt.ko 2024-04-18T04:31:05.874 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 27489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-18T04:31:05.874 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-04-18T04:31:05.874 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/softdog.ko 2024-04-18T04:31:05.874 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-18T04:31:05.875 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/twl4030_wdt.ko 2024-04-18T04:31:05.875 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/via_wdt.ko 2024-04-18T04:31:05.875 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-18T04:31:05.875 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-18T04:31:05.875 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 32481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-18T04:31:05.875 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/wafer5823wdt.ko 2024-04-18T04:31:05.875 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/wdt_pci.ko 2024-04-18T04:31:05.875 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/wm831x_wdt.ko 2024-04-18T04:31:05.875 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/wm8350_wdt.ko 2024-04-18T04:31:05.875 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/xen_wdt.ko 2024-04-18T04:31:05.875 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/ 2024-04-18T04:31:05.875 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 30049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-evtchn.ko 2024-04-18T04:31:05.875 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 30649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-gntalloc.ko 2024-04-18T04:31:05.875 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 55713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-gntdev.ko 2024-04-18T04:31:05.876 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-pciback/ 2024-04-18T04:31:05.876 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 213913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-18T04:31:05.876 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 47689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-privcmd.ko 2024-04-18T04:31:05.876 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 85713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-scsiback.ko 2024-04-18T04:31:05.876 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xenfs/ 2024-04-18T04:31:05.876 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-18T04:31:05.876 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ 2024-04-18T04:31:05.876 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/9p/ 2024-04-18T04:31:05.876 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 192617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/9p/9p.ko 2024-04-18T04:31:05.876 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/adfs/ 2024-04-18T04:31:05.876 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 78153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/adfs/adfs.ko 2024-04-18T04:31:05.876 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/affs/ 2024-04-18T04:31:05.876 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 197849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/affs/affs.ko 2024-04-18T04:31:05.876 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/afs/ 2024-04-18T04:31:05.877 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 1261113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/afs/kafs.ko 2024-04-18T04:31:05.877 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/autofs/ 2024-04-18T04:31:05.877 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 127377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/autofs/autofs4.ko 2024-04-18T04:31:05.877 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/befs/ 2024-04-18T04:31:05.877 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 80521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/befs/befs.ko 2024-04-18T04:31:05.877 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/bfs/ 2024-04-18T04:31:05.877 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 50473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/bfs/bfs.ko 2024-04-18T04:31:05.877 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 45561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/binfmt_misc.ko 2024-04-18T04:31:05.877 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/btrfs/ 2024-04-18T04:31:05.877 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 4489593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/btrfs/btrfs.ko 2024-04-18T04:31:05.877 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cachefiles/ 2024-04-18T04:31:05.877 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 376857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cachefiles/cachefiles.ko 2024-04-18T04:31:05.877 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ceph/ 2024-04-18T04:31:05.877 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 1586089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ceph/ceph.ko 2024-04-18T04:31:05.878 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/coda/ 2024-04-18T04:31:05.878 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 130073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/coda/coda.ko 2024-04-18T04:31:05.878 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/configfs/ 2024-04-18T04:31:05.878 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 139081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/configfs/configfs.ko 2024-04-18T04:31:05.878 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cramfs/ 2024-04-18T04:31:05.878 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 35665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cramfs/cramfs.ko 2024-04-18T04:31:05.878 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/dlm/ 2024-04-18T04:31:05.878 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 813225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/dlm/dlm.ko 2024-04-18T04:31:05.878 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/efs/ 2024-04-18T04:31:05.878 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 46409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/efs/efs.ko 2024-04-18T04:31:05.878 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/f2fs/ 2024-04-18T04:31:05.878 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 1906817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/f2fs/f2fs.ko 2024-04-18T04:31:05.878 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/ 2024-04-18T04:31:05.878 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 35137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/msdos.ko 2024-04-18T04:31:05.879 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/freevxfs/ 2024-04-18T04:31:05.879 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 52313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/freevxfs/freevxfs.ko 2024-04-18T04:31:05.879 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse/ 2024-04-18T04:31:05.879 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse/cuse.ko 2024-04-18T04:31:05.879 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/gfs2/ 2024-04-18T04:31:05.879 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 1486521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/gfs2/gfs2.ko 2024-04-18T04:31:05.879 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfs/ 2024-04-18T04:31:05.879 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 183305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfs/hfs.ko 2024-04-18T04:31:05.879 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfsplus/ 2024-04-18T04:31:05.879 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 282097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfsplus/hfsplus.ko 2024-04-18T04:31:05.879 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hpfs/ 2024-04-18T04:31:05.879 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 249009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hpfs/hpfs.ko 2024-04-18T04:31:05.879 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/isofs/ 2024-04-18T04:31:05.879 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 93033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/isofs/isofs.ko 2024-04-18T04:31:05.879 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/jfs/ 2024-04-18T04:31:05.880 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 533073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/jfs/jfs.ko 2024-04-18T04:31:05.880 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/lockd/ 2024-04-18T04:31:05.880 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 361369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/lockd/lockd.ko 2024-04-18T04:31:05.880 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/minix/ 2024-04-18T04:31:05.880 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 112609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/minix/minix.ko 2024-04-18T04:31:05.880 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/netfs/ 2024-04-18T04:31:05.880 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 591585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/netfs/netfs.ko 2024-04-18T04:31:05.880 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/ 2024-04-18T04:31:05.880 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/blocklayout/ 2024-04-18T04:31:05.880 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 102561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-18T04:31:05.880 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/filelayout/ 2024-04-18T04:31:05.880 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 74353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-18T04:31:05.880 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/flexfilelayout/ 2024-04-18T04:31:05.880 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 147689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-18T04:31:05.880 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 1320249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfs.ko 2024-04-18T04:31:05.937 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 82105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfsv2.ko 2024-04-18T04:31:05.938 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 151641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfsv3.ko 2024-04-18T04:31:05.938 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 2518505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfsv4.ko 2024-04-18T04:31:05.938 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common/ 2024-04-18T04:31:05.938 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common/grace.ko 2024-04-18T04:31:05.938 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common/nfs_acl.ko 2024-04-18T04:31:05.938 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfsd/ 2024-04-18T04:31:05.938 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 2024049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfsd/nfsd.ko 2024-04-18T04:31:05.938 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nilfs2/ 2024-04-18T04:31:05.938 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 734025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nilfs2/nilfs2.ko 2024-04-18T04:31:05.938 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/ 2024-04-18T04:31:05.938 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-celtic.ko 2024-04-18T04:31:05.939 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-centeuro.ko 2024-04-18T04:31:05.939 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-croatian.ko 2024-04-18T04:31:05.939 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-cyrillic.ko 2024-04-18T04:31:05.939 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-gaelic.ko 2024-04-18T04:31:05.939 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-greek.ko 2024-04-18T04:31:05.939 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-iceland.ko 2024-04-18T04:31:05.939 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-inuit.ko 2024-04-18T04:31:05.939 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-roman.ko 2024-04-18T04:31:05.939 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-romanian.ko 2024-04-18T04:31:05.939 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-turkish.ko 2024-04-18T04:31:05.939 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_ascii.ko 2024-04-18T04:31:05.940 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1250.ko 2024-04-18T04:31:05.940 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1251.ko 2024-04-18T04:31:05.940 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1255.ko 2024-04-18T04:31:05.940 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp737.ko 2024-04-18T04:31:05.940 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp775.ko 2024-04-18T04:31:05.940 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp850.ko 2024-04-18T04:31:05.940 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp852.ko 2024-04-18T04:31:05.940 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp855.ko 2024-04-18T04:31:05.940 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp857.ko 2024-04-18T04:31:05.940 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp860.ko 2024-04-18T04:31:05.940 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp861.ko 2024-04-18T04:31:05.940 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp862.ko 2024-04-18T04:31:05.941 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp863.ko 2024-04-18T04:31:05.941 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp864.ko 2024-04-18T04:31:05.941 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp865.ko 2024-04-18T04:31:05.941 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp866.ko 2024-04-18T04:31:05.941 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp869.ko 2024-04-18T04:31:05.941 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp874.ko 2024-04-18T04:31:05.941 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 95625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp932.ko 2024-04-18T04:31:05.941 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 144209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp936.ko 2024-04-18T04:31:05.941 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 167137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp949.ko 2024-04-18T04:31:05.941 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 119513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp950.ko 2024-04-18T04:31:05.941 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_euc-jp.ko 2024-04-18T04:31:05.941 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-1.ko 2024-04-18T04:31:05.942 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-13.ko 2024-04-18T04:31:05.942 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-14.ko 2024-04-18T04:31:05.942 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-15.ko 2024-04-18T04:31:05.942 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-2.ko 2024-04-18T04:31:05.942 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-3.ko 2024-04-18T04:31:05.942 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-4.ko 2024-04-18T04:31:05.942 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-5.ko 2024-04-18T04:31:05.942 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-6.ko 2024-04-18T04:31:05.942 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-7.ko 2024-04-18T04:31:05.942 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-9.ko 2024-04-18T04:31:05.942 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-r.ko 2024-04-18T04:31:05.942 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-ru.ko 2024-04-18T04:31:05.943 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-u.ko 2024-04-18T04:31:05.943 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-18T04:31:05.943 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_utf8.ko 2024-04-18T04:31:05.943 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ 2024-04-18T04:31:05.943 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/cluster/ 2024-04-18T04:31:05.943 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 302073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-18T04:31:05.943 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlm/ 2024-04-18T04:31:05.943 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 548169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-18T04:31:05.943 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlmfs/ 2024-04-18T04:31:05.943 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 66361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-18T04:31:05.943 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 3245617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2.ko 2024-04-18T04:31:05.943 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-18T04:31:05.944 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 39313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-18T04:31:05.944 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 43073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-18T04:31:05.944 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/omfs/ 2024-04-18T04:31:05.944 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 67489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/omfs/omfs.ko 2024-04-18T04:31:05.944 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/overlayfs/ 2024-04-18T04:31:05.944 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 462873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/overlayfs/overlay.ko 2024-04-18T04:31:05.944 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/pstore/ 2024-04-18T04:31:05.944 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 67977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/pstore/ramoops.ko 2024-04-18T04:31:05.944 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/qnx4/ 2024-04-18T04:31:05.944 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/qnx4/qnx4.ko 2024-04-18T04:31:05.944 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/qnx6/ 2024-04-18T04:31:05.945 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 56097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/qnx6/qnx6.ko 2024-04-18T04:31:05.945 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/quota/ 2024-04-18T04:31:05.945 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 40313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/quota/quota_tree.ko 2024-04-18T04:31:05.945 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/quota/quota_v1.ko 2024-04-18T04:31:05.945 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/quota/quota_v2.ko 2024-04-18T04:31:05.945 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/reiserfs/ 2024-04-18T04:31:05.945 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 684841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/reiserfs/reiserfs.ko 2024-04-18T04:31:05.945 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/romfs/ 2024-04-18T04:31:05.945 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 34673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/romfs/romfs.ko 2024-04-18T04:31:05.945 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/ 2024-04-18T04:31:05.945 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/client/ 2024-04-18T04:31:05.945 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 3319041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/client/cifs.ko 2024-04-18T04:31:05.946 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common/ 2024-04-18T04:31:05.946 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common/cifs_arc4.ko 2024-04-18T04:31:05.946 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common/cifs_md4.ko 2024-04-18T04:31:05.946 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/squashfs/ 2024-04-18T04:31:05.946 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 164185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/squashfs/squashfs.ko 2024-04-18T04:31:05.946 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/sysv/ 2024-04-18T04:31:05.946 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 115977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/sysv/sysv.ko 2024-04-18T04:31:05.946 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/udf/ 2024-04-18T04:31:05.946 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 310017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/udf/udf.ko 2024-04-18T04:31:05.946 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ufs/ 2024-04-18T04:31:05.946 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 198233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ufs/ufs.ko 2024-04-18T04:31:05.947 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/xfs/ 2024-04-18T04:31:05.947 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 5192705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/xfs/xfs.ko 2024-04-18T04:31:05.947 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/ 2024-04-18T04:31:05.947 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/locking/ 2024-04-18T04:31:05.947 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 97625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/locking/locktorture.ko 2024-04-18T04:31:05.947 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/time/ 2024-04-18T04:31:05.947 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/time/test_udelay.ko 2024-04-18T04:31:05.947 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 72665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/torture.ko 2024-04-18T04:31:05.947 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ 2024-04-18T04:31:05.947 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crc-itu-t.ko 2024-04-18T04:31:05.947 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crc7.ko 2024-04-18T04:31:05.947 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crc8.ko 2024-04-18T04:31:05.948 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto/ 2024-04-18T04:31:05.948 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto/libarc4.ko 2024-04-18T04:31:05.948 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 38985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto/libdes.ko 2024-04-18T04:31:05.948 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/interval_tree_test.ko 2024-04-18T04:31:05.948 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/libcrc32c.ko 2024-04-18T04:31:05.948 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lru_cache.ko 2024-04-18T04:31:05.948 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4/ 2024-04-18T04:31:05.948 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 36169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4/lz4_compress.ko 2024-04-18T04:31:05.948 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4/lz4hc_compress.ko 2024-04-18T04:31:05.948 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/math/ 2024-04-18T04:31:05.948 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7281 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/math/cordic.ko 2024-04-18T04:31:05.948 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/memory-notifier-error-inject.ko 2024-04-18T04:31:05.949 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/notifier-error-inject.ko 2024-04-18T04:31:05.949 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/percpu_test.ko 2024-04-18T04:31:05.949 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/pm-notifier-error-inject.ko 2024-04-18T04:31:05.949 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/raid6/ 2024-04-18T04:31:05.949 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 152025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/raid6/raid6_pq.ko 2024-04-18T04:31:05.949 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/rbtree_test.ko 2024-04-18T04:31:05.949 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/reed_solomon/ 2024-04-18T04:31:05.949 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-18T04:31:05.949 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 40969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/test-kstrtox.ko 2024-04-18T04:31:05.949 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 4912441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/test_bpf.ko 2024-04-18T04:31:05.949 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 61169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/test_firmware.ko 2024-04-18T04:31:05.949 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7121 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/test_module.ko 2024-04-18T04:31:05.950 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/test_user_copy.ko 2024-04-18T04:31:05.950 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_bm.ko 2024-04-18T04:31:05.950 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_fsm.ko 2024-04-18T04:31:05.950 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_kmp.ko 2024-04-18T04:31:05.950 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/xz/ 2024-04-18T04:31:05.950 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/xz/xz_dec_test.ko 2024-04-18T04:31:05.950 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/mm/ 2024-04-18T04:31:05.950 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/mm/hwpoison-inject.ko 2024-04-18T04:31:05.950 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ 2024-04-18T04:31:05.950 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/ 2024-04-18T04:31:05.950 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 66969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/6lowpan.ko 2024-04-18T04:31:05.950 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_dest.ko 2024-04-18T04:31:05.951 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_fragment.ko 2024-04-18T04:31:05.951 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_hop.ko 2024-04-18T04:31:05.951 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-18T04:31:05.951 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_mobility.ko 2024-04-18T04:31:05.951 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_routing.ko 2024-04-18T04:31:05.951 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_udp.ko 2024-04-18T04:31:05.951 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/ 2024-04-18T04:31:05.951 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 36729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/garp.ko 2024-04-18T04:31:05.951 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 42297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/mrp.ko 2024-04-18T04:31:05.951 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/p8022.ko 2024-04-18T04:31:05.951 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/psnap.ko 2024-04-18T04:31:05.951 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13537 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/stp.ko 2024-04-18T04:31:05.952 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/8021q/ 2024-04-18T04:31:05.952 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 106793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/8021q/8021q.ko 2024-04-18T04:31:05.952 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/ 2024-04-18T04:31:05.952 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 236793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet.ko 2024-04-18T04:31:05.952 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 44449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_fd.ko 2024-04-18T04:31:05.952 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 32209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_rdma.ko 2024-04-18T04:31:05.952 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 39513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_virtio.ko 2024-04-18T04:31:05.952 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/batman-adv/ 2024-04-18T04:31:05.952 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 879697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/batman-adv/batman-adv.ko 2024-04-18T04:31:05.952 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/ 2024-04-18T04:31:05.952 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 84761 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/br_netfilter.ko 2024-04-18T04:31:05.952 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 1030873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/bridge.ko 2024-04-18T04:31:05.952 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ 2024-04-18T04:31:05.953 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-18T04:31:05.953 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-18T04:31:05.953 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-18T04:31:05.953 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-18T04:31:05.953 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-18T04:31:05.953 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-18T04:31:05.953 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-18T04:31:05.953 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-18T04:31:05.953 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-18T04:31:05.953 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-18T04:31:05.953 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-18T04:31:05.953 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9569 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-18T04:31:05.954 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-18T04:31:05.954 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-18T04:31:05.954 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-18T04:31:05.954 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-18T04:31:05.954 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-18T04:31:05.954 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-18T04:31:05.954 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-18T04:31:05.954 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-18T04:31:05.954 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 70529 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtables.ko 2024-04-18T04:31:05.954 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-18T04:31:05.954 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-18T04:31:05.955 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ceph/ 2024-04-18T04:31:05.955 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 1243505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ceph/libceph.ko 2024-04-18T04:31:05.955 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core/ 2024-04-18T04:31:05.955 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 153801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core/pktgen.ko 2024-04-18T04:31:05.955 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/ 2024-04-18T04:31:05.955 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 244889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp.ko 2024-04-18T04:31:05.955 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_diag.ko 2024-04-18T04:31:05.955 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 71033 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_ipv4.ko 2024-04-18T04:31:05.955 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 74993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_ipv6.ko 2024-04-18T04:31:05.955 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/ 2024-04-18T04:31:05.955 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 507705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/dsa_core.ko 2024-04-18T04:31:05.955 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_brcm.ko 2024-04-18T04:31:05.956 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_dsa.ko 2024-04-18T04:31:05.956 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_none.ko 2024-04-18T04:31:05.956 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_trailer.ko 2024-04-18T04:31:05.956 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/hsr/ 2024-04-18T04:31:05.956 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 128873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/hsr/hsr.ko 2024-04-18T04:31:05.956 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/ 2024-04-18T04:31:05.956 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/6lowpan/ 2024-04-18T04:31:05.956 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 55505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-18T04:31:05.956 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 357425 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/ieee802154.ko 2024-04-18T04:31:05.956 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 59393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-18T04:31:05.956 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ 2024-04-18T04:31:05.957 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ah4.ko 2024-04-18T04:31:05.957 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 46417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/esp4.ko 2024-04-18T04:31:05.957 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 60233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/fou.ko 2024-04-18T04:31:05.957 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/gre.ko 2024-04-18T04:31:05.957 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 65665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/inet_diag.ko 2024-04-18T04:31:05.957 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 75489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_gre.ko 2024-04-18T04:31:05.957 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 77721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_tunnel.ko 2024-04-18T04:31:05.957 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 43705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_vti.ko 2024-04-18T04:31:05.957 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ipcomp.ko 2024-04-18T04:31:05.957 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 34745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ipip.ko 2024-04-18T04:31:05.957 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ 2024-04-18T04:31:05.957 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 45521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-18T04:31:05.957 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-18T04:31:05.958 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-18T04:31:05.958 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 50169 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ip_tables.ko 2024-04-18T04:31:05.958 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-18T04:31:05.958 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-04-18T04:31:05.958 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-18T04:31:05.958 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-18T04:31:05.958 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-18T04:31:05.958 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-04-18T04:31:05.958 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-18T04:31:05.958 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-18T04:31:05.958 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-18T04:31:05.958 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-18T04:31:05.958 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-18T04:31:05.959 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-18T04:31:05.959 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 32473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-18T04:31:05.959 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-18T04:31:05.959 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-18T04:31:05.959 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-04-18T04:31:05.959 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-18T04:31:05.959 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-18T04:31:05.959 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-18T04:31:05.959 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-18T04:31:05.959 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-18T04:31:05.959 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_bic.ko 2024-04-18T04:31:05.959 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_dctcp.ko 2024-04-18T04:31:05.959 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_diag.ko 2024-04-18T04:31:05.960 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_highspeed.ko 2024-04-18T04:31:05.960 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_htcp.ko 2024-04-18T04:31:05.960 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11665 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_hybla.ko 2024-04-18T04:31:05.960 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_illinois.ko 2024-04-18T04:31:05.960 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11737 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_lp.ko 2024-04-18T04:31:05.960 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_scalable.ko 2024-04-18T04:31:05.960 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_vegas.ko 2024-04-18T04:31:05.960 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_veno.ko 2024-04-18T04:31:05.960 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_westwood.ko 2024-04-18T04:31:05.960 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_yeah.ko 2024-04-18T04:31:05.960 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tunnel4.ko 2024-04-18T04:31:05.960 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/udp_diag.ko 2024-04-18T04:31:05.960 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 54441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/udp_tunnel.ko 2024-04-18T04:31:05.961 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-18T04:31:05.961 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ 2024-04-18T04:31:05.961 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 31073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ah6.ko 2024-04-18T04:31:05.961 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 47433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/esp6.ko 2024-04-18T04:31:05.961 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/fou6.ko 2024-04-18T04:31:05.961 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 103177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_gre.ko 2024-04-18T04:31:05.961 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 118881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_tunnel.ko 2024-04-18T04:31:05.961 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-18T04:31:05.961 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 71089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_vti.ko 2024-04-18T04:31:05.961 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ipcomp6.ko 2024-04-18T04:31:05.961 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/mip6.ko 2024-04-18T04:31:05.961 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ 2024-04-18T04:31:05.961 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 50673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-18T04:31:05.962 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-04-18T04:31:05.962 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-18T04:31:05.962 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-18T04:31:05.962 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-18T04:31:05.962 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-18T04:31:05.962 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-18T04:31:05.962 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-18T04:31:05.962 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-18T04:31:05.962 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-18T04:31:05.962 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-18T04:31:05.962 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-18T04:31:05.962 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-18T04:31:05.963 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-18T04:31:05.963 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-18T04:31:05.963 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-18T04:31:05.963 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-18T04:31:05.963 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 46313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-18T04:31:05.963 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-18T04:31:05.963 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-18T04:31:05.963 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-18T04:31:05.963 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-18T04:31:05.963 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-18T04:31:05.963 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-18T04:31:05.963 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-18T04:31:05.964 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 94089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/sit.ko 2024-04-18T04:31:05.964 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 30297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/tunnel6.ko 2024-04-18T04:31:05.964 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-18T04:31:05.964 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/key/ 2024-04-18T04:31:05.964 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 106369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/key/af_key.ko 2024-04-18T04:31:05.964 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/ 2024-04-18T04:31:05.964 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 153217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_core.ko 2024-04-18T04:31:05.964 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-18T04:31:05.964 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 31985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_eth.ko 2024-04-18T04:31:05.964 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 43641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ip.ko 2024-04-18T04:31:05.964 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 44993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ip6.ko 2024-04-18T04:31:05.964 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 42049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_netlink.ko 2024-04-18T04:31:05.964 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 66241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ppp.ko 2024-04-18T04:31:05.965 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/lapb/ 2024-04-18T04:31:05.965 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 63345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/lapb/lapb.ko 2024-04-18T04:31:05.965 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/llc/ 2024-04-18T04:31:05.965 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 27385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/llc/llc.ko 2024-04-18T04:31:05.965 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 332889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/llc/llc2.ko 2024-04-18T04:31:05.965 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mac802154/ 2024-04-18T04:31:05.965 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 388873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mac802154/mac802154.ko 2024-04-18T04:31:05.965 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mpls/ 2024-04-18T04:31:05.965 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mpls/mpls_gso.ko 2024-04-18T04:31:05.965 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ 2024-04-18T04:31:05.965 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ 2024-04-18T04:31:05.965 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 147745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set.ko 2024-04-18T04:31:05.966 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 34473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-18T04:31:05.966 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-18T04:31:05.966 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 32553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-18T04:31:05.966 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 124041 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-18T04:31:05.966 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 124345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-18T04:31:05.966 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 126681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-18T04:31:05.966 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 126473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-18T04:31:05.966 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 137833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-18T04:31:05.966 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 72353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-18T04:31:05.966 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 133681 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-18T04:31:05.966 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 139073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-18T04:31:05.966 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 138265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-18T04:31:05.967 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 136177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-18T04:31:05.967 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 139897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-18T04:31:05.967 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 37129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-18T04:31:05.967 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ 2024-04-18T04:31:05.967 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 534113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-18T04:31:05.967 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-18T04:31:05.967 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-18T04:31:05.967 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-18T04:31:05.967 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20953 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-18T04:31:05.967 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24577 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-18T04:31:05.967 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-18T04:31:05.968 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-18T04:31:05.968 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12649 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-18T04:31:05.968 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-18T04:31:05.968 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-18T04:31:05.968 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15977 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-18T04:31:05.968 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-18T04:31:05.968 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12809 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-18T04:31:05.968 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 55217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conncount.ko 2024-04-18T04:31:05.968 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 496817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack.ko 2024-04-18T04:31:05.968 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-18T04:31:05.968 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-18T04:31:05.968 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 37865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-18T04:31:05.969 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 134377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-18T04:31:05.969 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24513 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-18T04:31:05.969 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-18T04:31:05.969 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 140801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-18T04:31:05.969 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 38305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-18T04:31:05.969 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-18T04:31:05.969 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 79873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-18T04:31:05.969 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-18T04:31:05.969 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-18T04:31:05.969 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-18T04:31:05.969 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 117201 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_flow_table.ko 2024-04-18T04:31:05.970 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-18T04:31:05.970 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 46105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_log_syslog.ko 2024-04-18T04:31:05.970 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 118369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat.ko 2024-04-18T04:31:05.970 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-18T04:31:05.970 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14185 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-18T04:31:05.970 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13345 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_irc.ko 2024-04-18T04:31:05.970 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 34609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_sip.ko 2024-04-18T04:31:05.970 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-18T04:31:05.970 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 53393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-18T04:31:05.970 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 807985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_tables.ko 2024-04-18T04:31:05.970 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 53049 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink.ko 2024-04-18T04:31:05.970 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 36481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-18T04:31:05.971 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 37209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-04-18T04:31:05.971 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 49297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_log.ko 2024-04-18T04:31:05.971 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-18T04:31:05.971 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 65145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-18T04:31:05.971 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_chain_nat.ko 2024-04-18T04:31:05.971 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 41769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_compat.ko 2024-04-18T04:31:05.971 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 50657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_ct.ko 2024-04-18T04:31:05.971 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11081 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-18T04:31:05.971 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_fib.ko 2024-04-18T04:31:05.971 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-18T04:31:05.971 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_hash.ko 2024-04-18T04:31:05.971 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_limit.ko 2024-04-18T04:31:05.972 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17921 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_log.ko 2024-04-18T04:31:05.972 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_masq.ko 2024-04-18T04:31:05.972 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_nat.ko 2024-04-18T04:31:05.972 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16473 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_numgen.ko 2024-04-18T04:31:05.972 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13945 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_osf.ko 2024-04-18T04:31:05.972 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_queue.ko 2024-04-18T04:31:05.972 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_redir.ko 2024-04-18T04:31:05.972 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_reject.ko 2024-04-18T04:31:05.972 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_reject_inet.ko 2024-04-18T04:31:05.972 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15057 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_socket.ko 2024-04-18T04:31:05.972 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24993 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_synproxy.ko 2024-04-18T04:31:05.973 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17641 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_tproxy.ko 2024-04-18T04:31:05.973 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 108393 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/x_tables.ko 2024-04-18T04:31:05.973 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_AUDIT.ko 2024-04-18T04:31:05.973 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-18T04:31:05.973 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-18T04:31:05.973 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-18T04:31:05.973 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CT.ko 2024-04-18T04:31:05.973 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_DSCP.ko 2024-04-18T04:31:05.973 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_HL.ko 2024-04-18T04:31:05.973 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15745 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_HMARK.ko 2024-04-18T04:31:05.973 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 45217 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-18T04:31:05.973 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15937 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_LED.ko 2024-04-18T04:31:05.974 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13017 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_LOG.ko 2024-04-18T04:31:05.974 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-18T04:31:05.974 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NETMAP.ko 2024-04-18T04:31:05.974 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10857 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NFLOG.ko 2024-04-18T04:31:05.974 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15361 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-18T04:31:05.974 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23089 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_RATEEST.ko 2024-04-18T04:31:05.974 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-18T04:31:05.974 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16689 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_SECMARK.ko 2024-04-18T04:31:05.974 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18985 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-18T04:31:05.974 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-18T04:31:05.974 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20697 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TEE.ko 2024-04-18T04:31:05.975 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TPROXY.ko 2024-04-18T04:31:05.975 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TRACE.ko 2024-04-18T04:31:05.975 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15289 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_addrtype.ko 2024-04-18T04:31:05.975 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16633 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_bpf.ko 2024-04-18T04:31:05.975 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cgroup.ko 2024-04-18T04:31:05.975 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cluster.ko 2024-04-18T04:31:05.975 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_comment.ko 2024-04-18T04:31:05.975 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11961 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connbytes.ko 2024-04-18T04:31:05.975 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connlabel.ko 2024-04-18T04:31:05.975 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connlimit.ko 2024-04-18T04:31:05.975 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connmark.ko 2024-04-18T04:31:05.976 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14209 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_conntrack.ko 2024-04-18T04:31:05.976 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cpu.ko 2024-04-18T04:31:05.976 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_dccp.ko 2024-04-18T04:31:05.976 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_devgroup.ko 2024-04-18T04:31:05.976 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10257 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_dscp.ko 2024-04-18T04:31:05.976 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12657 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ecn.ko 2024-04-18T04:31:05.976 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_esp.ko 2024-04-18T04:31:05.976 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 52817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_hashlimit.ko 2024-04-18T04:31:05.976 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_helper.ko 2024-04-18T04:31:05.976 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_hl.ko 2024-04-18T04:31:05.976 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ipcomp.ko 2024-04-18T04:31:05.976 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_iprange.ko 2024-04-18T04:31:05.977 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ipvs.ko 2024-04-18T04:31:05.977 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19193 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_l2tp.ko 2024-04-18T04:31:05.977 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9137 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_length.ko 2024-04-18T04:31:05.977 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11521 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_limit.ko 2024-04-18T04:31:05.977 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_mac.ko 2024-04-18T04:31:05.977 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_mark.ko 2024-04-18T04:31:05.977 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_multiport.ko 2024-04-18T04:31:05.977 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_nat.ko 2024-04-18T04:31:05.977 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_nfacct.ko 2024-04-18T04:31:05.977 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_osf.ko 2024-04-18T04:31:05.977 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11561 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_owner.ko 2024-04-18T04:31:05.977 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_physdev.ko 2024-04-18T04:31:05.978 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_pkttype.ko 2024-04-18T04:31:05.978 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13553 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_policy.ko 2024-04-18T04:31:05.978 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_quota.ko 2024-04-18T04:31:05.978 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11881 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_rateest.ko 2024-04-18T04:31:05.978 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9273 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_realm.ko 2024-04-18T04:31:05.978 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 43465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_recent.ko 2024-04-18T04:31:05.978 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_sctp.ko 2024-04-18T04:31:05.978 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 36489 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_set.ko 2024-04-18T04:31:05.978 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_socket.ko 2024-04-18T04:31:05.978 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10753 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_state.ko 2024-04-18T04:31:05.978 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10849 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_statistic.ko 2024-04-18T04:31:05.978 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_string.ko 2024-04-18T04:31:05.979 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_tcpmss.ko 2024-04-18T04:31:05.979 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18449 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_tcpudp.ko 2024-04-18T04:31:05.979 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12441 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_time.ko 2024-04-18T04:31:05.979 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_u32.ko 2024-04-18T04:31:05.979 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netlink/ 2024-04-18T04:31:05.979 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17233 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netlink/netlink_diag.ko 2024-04-18T04:31:05.979 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/nsh/ 2024-04-18T04:31:05.979 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14073 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/nsh/nsh.ko 2024-04-18T04:31:05.979 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/ 2024-04-18T04:31:05.979 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 488825 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/openvswitch.ko 2024-04-18T04:31:05.979 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12009 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-geneve.ko 2024-04-18T04:31:05.979 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10873 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-gre.ko 2024-04-18T04:31:05.980 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-vxlan.ko 2024-04-18T04:31:05.980 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/packet/ 2024-04-18T04:31:05.980 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15929 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/packet/af_packet_diag.ko 2024-04-18T04:31:05.980 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/phonet/ 2024-04-18T04:31:05.980 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 142025 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/phonet/phonet.ko 2024-04-18T04:31:05.980 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 68817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/phonet/pn_pep.ko 2024-04-18T04:31:05.980 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/ 2024-04-18T04:31:05.980 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 318617 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds.ko 2024-04-18T04:31:05.980 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 202305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds_rdma.ko 2024-04-18T04:31:05.980 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 85105 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds_tcp.ko 2024-04-18T04:31:05.980 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rxrpc/ 2024-04-18T04:31:05.980 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 1027897 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rxrpc/rxrpc.ko 2024-04-18T04:31:05.980 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/ 2024-04-18T04:31:05.981 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 39001 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_csum.ko 2024-04-18T04:31:05.981 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28721 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_gact.ko 2024-04-18T04:31:05.981 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 45409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_mirred.ko 2024-04-18T04:31:05.981 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 27593 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_nat.ko 2024-04-18T04:31:05.981 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 53465 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_pedit.ko 2024-04-18T04:31:05.981 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 38705 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_police.ko 2024-04-18T04:31:05.981 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23969 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_simple.ko 2024-04-18T04:31:05.981 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 43417 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_skbedit.ko 2024-04-18T04:31:05.981 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 45673 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_vlan.ko 2024-04-18T04:31:05.981 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 32129 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_basic.ko 2024-04-18T04:31:05.981 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 41457 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_bpf.ko 2024-04-18T04:31:05.981 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23225 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_cgroup.ko 2024-04-18T04:31:05.982 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 37305 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_flow.ko 2024-04-18T04:31:05.982 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 39601 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_fw.ko 2024-04-18T04:31:05.982 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 49321 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_route.ko 2024-04-18T04:31:05.982 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 79145 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_u32.ko 2024-04-18T04:31:05.982 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8713 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_cmp.ko 2024-04-18T04:31:05.982 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15385 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_ipset.ko 2024-04-18T04:31:05.982 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 48785 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_meta.ko 2024-04-18T04:31:05.982 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9241 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_nbyte.ko 2024-04-18T04:31:05.982 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13369 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_text.ko 2024-04-18T04:31:05.982 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8377 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_u32.ko 2024-04-18T04:31:05.982 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_choke.ko 2024-04-18T04:31:05.982 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25097 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_codel.ko 2024-04-18T04:31:05.983 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 43481 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_drr.ko 2024-04-18T04:31:05.983 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 43153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_fq.ko 2024-04-18T04:31:05.983 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 39177 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_fq_codel.ko 2024-04-18T04:31:05.983 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 42889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_gred.ko 2024-04-18T04:31:05.983 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 62817 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_hfsc.ko 2024-04-18T04:31:05.983 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26585 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_hhf.ko 2024-04-18T04:31:05.983 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 81833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_htb.ko 2024-04-18T04:31:05.983 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33545 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_ingress.ko 2024-04-18T04:31:05.983 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 36625 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_mqprio.ko 2024-04-18T04:31:05.983 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12297 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_mqprio_lib.ko 2024-04-18T04:31:05.983 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33065 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_multiq.ko 2024-04-18T04:31:05.983 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 44793 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_netem.ko 2024-04-18T04:31:05.983 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 32833 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_pie.ko 2024-04-18T04:31:05.984 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13505 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_plug.ko 2024-04-18T04:31:05.984 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 31801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_prio.ko 2024-04-18T04:31:05.984 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 60249 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_qfq.ko 2024-04-18T04:31:05.984 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 40889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_red.ko 2024-04-18T04:31:05.984 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33433 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_sfb.ko 2024-04-18T04:31:05.984 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 38329 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_sfq.ko 2024-04-18T04:31:05.984 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 35777 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_tbf.ko 2024-04-18T04:31:05.984 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 34161 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_teql.ko 2024-04-18T04:31:05.984 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp/ 2024-04-18T04:31:05.984 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 1187313 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp/sctp.ko 2024-04-18T04:31:05.984 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23913 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp/sctp_diag.ko 2024-04-18T04:31:05.984 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/ 2024-04-18T04:31:05.985 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss/ 2024-04-18T04:31:05.985 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 432409 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-18T04:31:05.985 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 70113 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-18T04:31:05.985 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 1940889 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/sunrpc.ko 2024-04-18T04:31:05.985 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/xprtrdma/ 2024-04-18T04:31:05.985 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 890729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-18T04:31:05.985 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc/ 2024-04-18T04:31:05.985 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 1122337 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc/tipc.ko 2024-04-18T04:31:05.985 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12153 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc/tipc_diag.ko 2024-04-18T04:31:05.985 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/unix/ 2024-04-18T04:31:05.985 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18801 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/unix/unix_diag.ko 2024-04-18T04:31:05.985 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/ 2024-04-18T04:31:05.986 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 105609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-18T04:31:05.986 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 90265 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-18T04:31:05.986 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 123769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock.ko 2024-04-18T04:31:05.986 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12905 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-18T04:31:05.986 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20401 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-18T04:31:05.986 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/x25/ 2024-04-18T04:31:05.986 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 165841 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/x25/x25.ko 2024-04-18T04:31:05.986 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm/ 2024-04-18T04:31:05.986 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26729 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm/xfrm_algo.ko 2024-04-18T04:31:05.986 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23353 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-18T04:31:05.986 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 131865 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm/xfrm_user.ko 2024-04-18T04:31:05.986 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 644769 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.alias 2024-04-18T04:31:05.987 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 628542 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.alias.bin 2024-04-18T04:31:05.987 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7706 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin 2024-04-18T04:31:05.987 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23609 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.alias.bin 2024-04-18T04:31:05.987 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9941 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.bin 2024-04-18T04:31:05.987 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 70990 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.modinfo 2024-04-18T04:31:05.987 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 146959 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep 2024-04-18T04:31:05.987 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 232835 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep.bin 2024-04-18T04:31:05.987 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 210 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.devname 2024-04-18T04:31:05.987 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 72602 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.order 2024-04-18T04:31:05.987 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 879 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.softdep 2024-04-18T04:31:05.987 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 258450 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.symbols 2024-04-18T04:31:05.987 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 313019 2024-04-11 18:50 ./lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.symbols.bin 2024-04-18T04:31:05.987 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./usr/ 2024-04-18T04:31:05.988 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./usr/share/ 2024-04-18T04:31:05.988 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./usr/share/doc/ 2024-04-18T04:31:05.988 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2024-04-11 18:50 ./usr/share/doc/linux-image-6.9.0-rc3-g3f60ed14f7c1/ 2024-04-18T04:31:05.988 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 174 2024-04-11 18:50 ./usr/share/doc/linux-image-6.9.0-rc3-g3f60ed14f7c1/changelog.Debian.gz 2024-04-18T04:31:05.988 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 691 2024-04-11 18:50 ./usr/share/doc/linux-image-6.9.0-rc3-g3f60ed14f7c1/copyright 2024-04-18T04:31:05.993 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g3f60ed14f7c1 2024-04-18T04:31:05.993 INFO:teuthology.task.kernel:searching for kernel 6.9.0-rc3-g3f60ed14f7c1 2024-04-18T04:31:05.993 DEBUG:teuthology.orchestra.run.smithi120:> egrep '(submenu|menuentry.*6.9.0-rc3-g3f60ed14f7c1).*{' /boot/grub/grub.cfg 2024-04-18T04:31:06.000 INFO:teuthology.orchestra.run.smithi120.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-18T04:31:06.001 INFO:teuthology.orchestra.run.smithi120.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g3f60ed14f7c1' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g3f60ed14f7c1-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-18T04:31:06.001 INFO:teuthology.orchestra.run.smithi120.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g3f60ed14f7c1 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g3f60ed14f7c1-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-18T04:31:06.001 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-04-18T04:31:06.001 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-rc3-g3f60ed14f7c1 2024-04-18T04:31:06.002 DEBUG:teuthology.orchestra.run.smithi120:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-04-18T04:31:06.044 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi120.front.sepia.ceph.com to complete... 2024-04-18T04:31:06.437 INFO:teuthology.orchestra.run.smithi120.stderr:Sourcing file `/etc/default/grub' 2024-04-18T04:31:06.438 INFO:teuthology.orchestra.run.smithi120.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-18T04:31:06.453 INFO:teuthology.orchestra.run.smithi120.stderr:Generating grub configuration file ... 2024-04-18T04:31:06.660 INFO:teuthology.orchestra.run.smithi120.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g3f60ed14f7c1 2024-04-18T04:31:06.666 INFO:teuthology.orchestra.run.smithi120.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g3f60ed14f7c1 2024-04-18T04:31:06.952 INFO:teuthology.orchestra.run.smithi120.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-18T04:31:06.957 INFO:teuthology.orchestra.run.smithi120.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-18T04:31:07.001 INFO:teuthology.orchestra.run.smithi120.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-18T04:31:07.006 INFO:teuthology.orchestra.run.smithi120.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-18T04:31:07.152 INFO:teuthology.orchestra.run.smithi120.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-18T04:31:07.153 INFO:teuthology.orchestra.run.smithi120.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-18T04:31:07.153 INFO:teuthology.orchestra.run.smithi120.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-18T04:31:07.177 INFO:teuthology.orchestra.run.smithi120.stderr:done 2024-04-18T04:31:38.284 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-04-18T04:31:38.285 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-04-18T04:31:38.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:32:38.289 DEBUG:teuthology.orchestra.remote:timed out 2024-04-18T04:32:47.290 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-04-18T04:32:47.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:32:47.294 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-04-18T04:32:59.295 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-04-18T04:32:59.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:32:59.525 DEBUG:teuthology.orchestra.run.smithi120:> true 2024-04-18T04:33:00.261 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-04-18T04:33:00.262 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-rc3-g3f60ed14f7c1"... 2024-04-18T04:33:00.262 DEBUG:teuthology.orchestra.run.smithi120:> uname -r 2024-04-18T04:33:00.314 INFO:teuthology.orchestra.run.smithi120.stdout:6.9.0-rc3-g3f60ed14f7c1 2024-04-18T04:33:00.314 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g3f60ed14f7c1 vs 6.9.0-rc3-g3f60ed14f7c1 2024-04-18T04:33:00.314 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-18T04:33:00.314 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T04:33:01.315 DEBUG:teuthology.parallel:result is None 2024-04-18T04:33:01.316 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-18T04:33:01.326 INFO:teuthology.task.internal:Creating test directory... 2024-04-18T04:33:01.326 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-18T04:33:01.330 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-18T04:33:01.336 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-18T04:33:01.342 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-18T04:33:01.352 INFO:teuthology.task.internal:Creating archive directory... 2024-04-18T04:33:01.353 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-18T04:33:01.381 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-18T04:33:01.403 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-18T04:33:01.410 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-18T04:33:01.410 DEBUG:teuthology.orchestra.run.smithi132:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-18T04:33:01.444 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T04:33:01.444 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-18T04:33:01.448 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-18T04:33:01.521 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-18T04:33:01.530 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-18T04:33:01.542 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-18T04:33:01.543 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-18T04:33:01.545 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-18T04:33:01.553 INFO:teuthology.task.internal:Configuring sudo... 2024-04-18T04:33:01.553 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-18T04:33:01.556 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-18T04:33:01.600 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-18T04:33:01.610 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-18T04:33:01.610 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-18T04:33:01.621 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-18T04:33:01.648 DEBUG:teuthology.orchestra.run.smithi120:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-18T04:33:01.678 DEBUG:teuthology.orchestra.run.smithi120:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-18T04:33:01.730 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-18T04:33:01.730 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-18T04:33:01.808 DEBUG:teuthology.orchestra.run.smithi132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-18T04:33:01.814 DEBUG:teuthology.orchestra.run.smithi132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-18T04:33:01.861 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-18T04:33:01.861 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-18T04:33:01.928 DEBUG:teuthology.orchestra.run.smithi120:> sudo service rsyslog restart 2024-04-18T04:33:01.932 DEBUG:teuthology.orchestra.run.smithi132:> sudo service rsyslog restart 2024-04-18T04:33:02.044 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-18T04:33:02.052 INFO:teuthology.task.internal:Starting timer... 2024-04-18T04:33:02.052 INFO:teuthology.run_tasks:Running task pcp... 2024-04-18T04:33:02.138 INFO:teuthology.run_tasks:Running task selinux... 2024-04-18T04:33:02.148 DEBUG:teuthology.task.selinux:Excluding smithi120: OS 'ubuntu' does not support SELinux 2024-04-18T04:33:02.148 DEBUG:teuthology.task.selinux:Excluding smithi132: OS 'ubuntu' does not support SELinux 2024-04-18T04:33:02.148 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-18T04:33:02.148 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-18T04:33:02.148 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-18T04:33:02.149 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-18T04:33:02.162 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-18T04:33:02.181 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-18T04:33:02.183 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi120.front.sepia.ceph.com,smithi132.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-18T04:40:34.576 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi120.front.sepia.ceph.com'), Remote(name='ubuntu@smithi132.front.sepia.ceph.com')] 2024-04-18T04:40:34.577 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-04-18T04:40:34.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:40:34.664 DEBUG:teuthology.orchestra.run.smithi120:> true 2024-04-18T04:40:34.801 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-04-18T04:40:34.801 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-04-18T04:40:34.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:40:34.881 DEBUG:teuthology.orchestra.run.smithi132:> true 2024-04-18T04:40:34.986 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-04-18T04:40:34.987 INFO:teuthology.run_tasks:Running task clock... 2024-04-18T04:40:34.998 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-18T04:40:34.999 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-18T04:40:34.999 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-18T04:40:35.003 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-18T04:40:35.003 DEBUG:teuthology.orchestra.run.smithi132:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-18T04:40:35.037 INFO:teuthology.orchestra.run.smithi120.stdout:18 Apr 04:40:35 ntpd[17198]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-18T04:40:35.038 INFO:teuthology.orchestra.run.smithi120.stdout:18 Apr 04:40:35 ntpd[17198]: Command line: ntpd -gq 2024-04-18T04:40:35.038 INFO:teuthology.orchestra.run.smithi120.stdout:18 Apr 04:40:35 ntpd[17198]: ---------------------------------------------------- 2024-04-18T04:40:35.038 INFO:teuthology.orchestra.run.smithi120.stdout:18 Apr 04:40:35 ntpd[17198]: ntp-4 is maintained by Network Time Foundation, 2024-04-18T04:40:35.038 INFO:teuthology.orchestra.run.smithi120.stdout:18 Apr 04:40:35 ntpd[17198]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-18T04:40:35.038 INFO:teuthology.orchestra.run.smithi120.stdout:18 Apr 04:40:35 ntpd[17198]: corporation. Support and training for ntp-4 are 2024-04-18T04:40:35.038 INFO:teuthology.orchestra.run.smithi120.stdout:18 Apr 04:40:35 ntpd[17198]: available at https://www.nwtime.org/support 2024-04-18T04:40:35.038 INFO:teuthology.orchestra.run.smithi120.stdout:18 Apr 04:40:35 ntpd[17198]: ---------------------------------------------------- 2024-04-18T04:40:35.039 INFO:teuthology.orchestra.run.smithi120.stdout:18 Apr 04:40:35 ntpd[17198]: proto: precision = 0.041 usec (-24) 2024-04-18T04:40:35.039 INFO:teuthology.orchestra.run.smithi120.stdout:18 Apr 04:40:35 ntpd[17198]: basedate set to 2022-02-04 2024-04-18T04:40:35.039 INFO:teuthology.orchestra.run.smithi120.stdout:18 Apr 04:40:35 ntpd[17198]: gps base set to 2022-02-06 (week 2196) 2024-04-18T04:40:35.039 INFO:teuthology.orchestra.run.smithi120.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-18T04:40:35.039 INFO:teuthology.orchestra.run.smithi120.stdout:18 Apr 04:40:35 ntpd[17198]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-18T04:40:35.040 INFO:teuthology.orchestra.run.smithi120.stdout:18 Apr 04:40:35 ntpd[17198]: restrict ::: KOD does nothing without LIMITED. 2024-04-18T04:40:35.040 INFO:teuthology.orchestra.run.smithi120.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-18T04:40:35.041 INFO:teuthology.orchestra.run.smithi120.stdout:18 Apr 04:40:35 ntpd[17198]: Listen and drop on 0 v6wildcard [::]:123 2024-04-18T04:40:35.041 INFO:teuthology.orchestra.run.smithi120.stdout:18 Apr 04:40:35 ntpd[17198]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-18T04:40:35.041 INFO:teuthology.orchestra.run.smithi120.stdout:18 Apr 04:40:35 ntpd[17198]: Listen normally on 2 lo 127.0.0.1:123 2024-04-18T04:40:35.041 INFO:teuthology.orchestra.run.smithi120.stdout:18 Apr 04:40:35 ntpd[17198]: Listen normally on 3 enp3s0f1 172.21.15.120:123 2024-04-18T04:40:35.041 INFO:teuthology.orchestra.run.smithi120.stdout:18 Apr 04:40:35 ntpd[17198]: Listen normally on 4 lo [::1]:123 2024-04-18T04:40:35.041 INFO:teuthology.orchestra.run.smithi120.stdout:18 Apr 04:40:35 ntpd[17198]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:478f%5]:123 2024-04-18T04:40:35.041 INFO:teuthology.orchestra.run.smithi120.stdout:18 Apr 04:40:35 ntpd[17198]: Listening on routing socket on fd #22 for interface updates 2024-04-18T04:40:35.055 INFO:teuthology.orchestra.run.smithi132.stdout:18 Apr 04:40:35 ntpd[17614]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-18T04:40:35.055 INFO:teuthology.orchestra.run.smithi132.stdout:18 Apr 04:40:35 ntpd[17614]: Command line: ntpd -gq 2024-04-18T04:40:35.055 INFO:teuthology.orchestra.run.smithi132.stdout:18 Apr 04:40:35 ntpd[17614]: ---------------------------------------------------- 2024-04-18T04:40:35.055 INFO:teuthology.orchestra.run.smithi132.stdout:18 Apr 04:40:35 ntpd[17614]: ntp-4 is maintained by Network Time Foundation, 2024-04-18T04:40:35.055 INFO:teuthology.orchestra.run.smithi132.stdout:18 Apr 04:40:35 ntpd[17614]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-18T04:40:35.055 INFO:teuthology.orchestra.run.smithi132.stdout:18 Apr 04:40:35 ntpd[17614]: corporation. Support and training for ntp-4 are 2024-04-18T04:40:35.055 INFO:teuthology.orchestra.run.smithi132.stdout:18 Apr 04:40:35 ntpd[17614]: available at https://www.nwtime.org/support 2024-04-18T04:40:35.055 INFO:teuthology.orchestra.run.smithi132.stdout:18 Apr 04:40:35 ntpd[17614]: ---------------------------------------------------- 2024-04-18T04:40:35.056 INFO:teuthology.orchestra.run.smithi132.stdout:18 Apr 04:40:35 ntpd[17614]: proto: precision = 0.044 usec (-24) 2024-04-18T04:40:35.056 INFO:teuthology.orchestra.run.smithi132.stdout:18 Apr 04:40:35 ntpd[17614]: basedate set to 2022-02-04 2024-04-18T04:40:35.056 INFO:teuthology.orchestra.run.smithi132.stdout:18 Apr 04:40:35 ntpd[17614]: gps base set to 2022-02-06 (week 2196) 2024-04-18T04:40:35.056 INFO:teuthology.orchestra.run.smithi132.stdout:18 Apr 04:40:35 ntpd[17614]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-18T04:40:35.056 INFO:teuthology.orchestra.run.smithi132.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-18T04:40:35.057 INFO:teuthology.orchestra.run.smithi132.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-18T04:40:35.058 INFO:teuthology.orchestra.run.smithi132.stdout:18 Apr 04:40:35 ntpd[17614]: restrict ::: KOD does nothing without LIMITED. 2024-04-18T04:40:35.058 INFO:teuthology.orchestra.run.smithi132.stdout:18 Apr 04:40:35 ntpd[17614]: Listen and drop on 0 v6wildcard [::]:123 2024-04-18T04:40:35.058 INFO:teuthology.orchestra.run.smithi132.stdout:18 Apr 04:40:35 ntpd[17614]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-18T04:40:35.058 INFO:teuthology.orchestra.run.smithi132.stdout:18 Apr 04:40:35 ntpd[17614]: Listen normally on 2 lo 127.0.0.1:123 2024-04-18T04:40:35.059 INFO:teuthology.orchestra.run.smithi132.stdout:18 Apr 04:40:35 ntpd[17614]: Listen normally on 3 enp3s0f1 172.21.15.132:123 2024-04-18T04:40:35.059 INFO:teuthology.orchestra.run.smithi132.stdout:18 Apr 04:40:35 ntpd[17614]: Listen normally on 4 lo [::1]:123 2024-04-18T04:40:35.059 INFO:teuthology.orchestra.run.smithi132.stdout:18 Apr 04:40:35 ntpd[17614]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:773f%5]:123 2024-04-18T04:40:35.059 INFO:teuthology.orchestra.run.smithi132.stdout:18 Apr 04:40:35 ntpd[17614]: Listening on routing socket on fd #22 for interface updates 2024-04-18T04:40:36.038 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:36 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:40:36.039 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:36 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:40:36.039 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:36 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:40:36.039 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:36 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:40:36.039 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:36 ntpd[17198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T04:40:36.039 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:36 ntpd[17198]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T04:40:36.055 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:36 ntpd[17614]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:40:36.055 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:36 ntpd[17614]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:40:36.055 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:36 ntpd[17614]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:40:36.055 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:36 ntpd[17614]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:40:36.055 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:36 ntpd[17614]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T04:40:36.056 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:36 ntpd[17614]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T04:40:37.055 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:37 ntpd[17614]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:40:37.056 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:37 ntpd[17614]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:40:37.056 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:37 ntpd[17614]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:40:37.056 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:37 ntpd[17614]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:40:37.056 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:37 ntpd[17614]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T04:40:37.056 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:37 ntpd[17614]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T04:40:38.039 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:38 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:40:38.039 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:38 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:40:38.039 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:38 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:40:38.039 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:38 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:40:38.039 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:38 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:40:38.039 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:38 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:40:38.039 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:38 ntpd[17198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T04:40:38.040 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:38 ntpd[17198]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T04:40:38.040 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:38 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:40:38.040 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:38 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:40:38.040 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:38 ntpd[17198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T04:40:38.040 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:38 ntpd[17198]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T04:40:38.055 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:38 ntpd[17614]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:40:38.056 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:38 ntpd[17614]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:40:38.056 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:38 ntpd[17614]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:40:38.056 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:38 ntpd[17614]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:40:38.056 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:38 ntpd[17614]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:40:38.056 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:38 ntpd[17614]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:40:38.056 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:38 ntpd[17614]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T04:40:38.056 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:38 ntpd[17614]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T04:40:39.038 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:39 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:40:39.039 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:39 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:40:39.039 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:39 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:40:39.039 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:39 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:40:39.039 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:39 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:40:39.039 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:39 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:40:39.039 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:39 ntpd[17198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T04:40:39.039 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:39 ntpd[17198]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T04:40:39.056 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:39 ntpd[17614]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:40:39.056 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:39 ntpd[17614]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:40:39.056 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:39 ntpd[17614]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:40:39.056 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:39 ntpd[17614]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:40:39.056 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:39 ntpd[17614]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:40:39.056 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:39 ntpd[17614]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:40:39.056 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:39 ntpd[17614]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T04:40:39.056 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:39 ntpd[17614]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T04:40:39.056 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:39 ntpd[17614]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:40:39.057 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:39 ntpd[17614]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:40:39.057 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:39 ntpd[17614]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T04:40:39.057 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:39 ntpd[17614]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T04:40:40.039 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:40 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:40:40.039 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:40 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:40:40.039 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:40 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:40:40.039 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:40 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:40:40.039 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:40 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:40:40.039 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:40 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:40:40.039 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:40 ntpd[17198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T04:40:40.039 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:40 ntpd[17198]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T04:40:40.039 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:40 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:40:40.039 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:40 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:40:40.040 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:40 ntpd[17198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T04:40:40.040 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:40 ntpd[17198]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T04:40:40.055 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:40 ntpd[17614]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:40:40.056 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:40 ntpd[17614]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:40:40.056 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:40 ntpd[17614]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:40:40.056 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:40 ntpd[17614]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:40:40.056 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:40 ntpd[17614]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T04:40:40.056 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:40 ntpd[17614]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T04:40:41.038 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:41 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:40:41.038 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:41 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:40:41.038 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:41 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:40:41.039 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:41 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:40:41.039 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:41 ntpd[17198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T04:40:41.039 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:41 ntpd[17198]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T04:40:41.056 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:41 ntpd[17614]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:40:41.056 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:41 ntpd[17614]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:40:41.056 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:41 ntpd[17614]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:40:41.056 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:41 ntpd[17614]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:40:41.056 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:41 ntpd[17614]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:40:41.056 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:41 ntpd[17614]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:40:41.056 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:41 ntpd[17614]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T04:40:41.056 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:41 ntpd[17614]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T04:40:41.056 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:41 ntpd[17614]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:40:41.056 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:41 ntpd[17614]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:40:41.057 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:41 ntpd[17614]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T04:40:41.057 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:41 ntpd[17614]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T04:40:42.039 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:42 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:40:42.039 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:42 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:40:42.039 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:42 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:40:42.039 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:42 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:40:42.039 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:42 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:40:42.039 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:42 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:40:42.039 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:42 ntpd[17198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T04:40:42.039 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:42 ntpd[17198]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T04:40:42.040 INFO:teuthology.orchestra.run.smithi120.stdout:18 Apr 04:40:42 ntpd[17198]: ntpd: time slew +0.000629 s 2024-04-18T04:40:42.040 INFO:teuthology.orchestra.run.smithi120.stdout:ntpd: time slew +0.000629s 2024-04-18T04:40:42.040 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:42 ntpd[17198]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-18T04:40:42.040 INFO:teuthology.orchestra.run.smithi120.stderr:18 Apr 04:40:42 ntpd[17198]: can't open /var/log/ntpstats/loopstats.20240418: Permission denied 2024-04-18T04:40:42.055 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:42 ntpd[17614]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:40:42.055 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:42 ntpd[17614]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:40:42.055 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:42 ntpd[17614]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T04:40:42.055 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:42 ntpd[17614]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T04:40:42.056 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:42 ntpd[17614]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T04:40:42.056 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:42 ntpd[17614]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T04:40:42.056 INFO:teuthology.orchestra.run.smithi132.stdout:18 Apr 04:40:42 ntpd[17614]: ntpd: time slew -0.003099 s 2024-04-18T04:40:42.056 INFO:teuthology.orchestra.run.smithi132.stdout:ntpd: time slew -0.003099s 2024-04-18T04:40:42.056 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:42 ntpd[17614]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-18T04:40:42.056 INFO:teuthology.orchestra.run.smithi132.stderr:18 Apr 04:40:42 ntpd[17614]: can't open /var/log/ntpstats/loopstats.20240418: Permission denied 2024-04-18T04:40:42.128 INFO:teuthology.orchestra.run.smithi120.stdout: remote refid st t when poll reach delay offset jitter 2024-04-18T04:40:42.128 INFO:teuthology.orchestra.run.smithi120.stdout:============================================================================== 2024-04-18T04:40:42.128 INFO:teuthology.orchestra.run.smithi120.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T04:40:42.128 INFO:teuthology.orchestra.run.smithi120.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T04:40:42.128 INFO:teuthology.orchestra.run.smithi120.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T04:40:42.128 INFO:teuthology.orchestra.run.smithi120.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T04:40:42.139 INFO:teuthology.orchestra.run.smithi132.stdout: remote refid st t when poll reach delay offset jitter 2024-04-18T04:40:42.139 INFO:teuthology.orchestra.run.smithi132.stdout:============================================================================== 2024-04-18T04:40:42.139 INFO:teuthology.orchestra.run.smithi132.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T04:40:42.140 INFO:teuthology.orchestra.run.smithi132.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T04:40:42.140 INFO:teuthology.orchestra.run.smithi132.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T04:40:42.140 INFO:teuthology.orchestra.run.smithi132.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-18T04:40:42.141 INFO:teuthology.run_tasks:Running task install... 2024-04-18T04:40:42.150 DEBUG:teuthology.task.install:project ceph 2024-04-18T04:40:42.150 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '56a91dd158be807f143cc918a11685fc9ee164ae'}} 2024-04-18T04:40:42.150 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '56a91dd158be807f143cc918a11685fc9ee164ae'} 2024-04-18T04:40:42.150 INFO:teuthology.task.install:Using flavor: default 2024-04-18T04:40:42.156 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-18T04:40:42.156 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-04-18T04:40:42.157 DEBUG:teuthology.orchestra.run.smithi120:> sudo apt-key list | grep Ceph 2024-04-18T04:40:42.157 DEBUG:teuthology.orchestra.run.smithi132:> sudo apt-key list | grep Ceph 2024-04-18T04:40:42.239 INFO:teuthology.orchestra.run.smithi132.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-18T04:40:42.264 INFO:teuthology.orchestra.run.smithi132.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-18T04:40:42.264 INFO:teuthology.orchestra.run.smithi132.stdout:uid [ unknown] Ceph.com (release key) 2024-04-18T04:40:42.265 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-18T04:40:42.265 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-18T04:40:42.265 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=56a91dd158be807f143cc918a11685fc9ee164ae 2024-04-18T04:40:42.271 INFO:teuthology.orchestra.run.smithi120.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-18T04:40:42.433 INFO:teuthology.orchestra.run.smithi120.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-18T04:40:42.434 INFO:teuthology.orchestra.run.smithi120.stdout:uid [ unknown] Ceph.com (release key) 2024-04-18T04:40:42.435 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-18T04:40:42.435 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-18T04:40:42.435 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=56a91dd158be807f143cc918a11685fc9ee164ae 2024-04-18T04:40:42.486 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default/ 2024-04-18T04:40:42.487 INFO:teuthology.task.install.deb:Package version is 18.2.2-1229-g56a91dd1-1jammy 2024-04-18T04:40:42.589 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default/ 2024-04-18T04:40:42.589 INFO:teuthology.task.install.deb:Package version is 18.2.2-1229-g56a91dd1-1jammy 2024-04-18T04:40:42.602 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-18T04:40:42.602 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-18T04:40:42.621 DEBUG:teuthology.orchestra.run.smithi132:> sudo apt-get update 2024-04-18T04:40:42.706 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-18T04:40:42.707 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-18T04:40:42.726 DEBUG:teuthology.orchestra.run.smithi120:> sudo apt-get update 2024-04-18T04:40:42.902 INFO:teuthology.orchestra.run.smithi132.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy InRelease 2024-04-18T04:40:42.917 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T04:40:42.917 INFO:teuthology.orchestra.run.smithi120.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-18T04:40:42.918 INFO:teuthology.orchestra.run.smithi132.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T04:40:42.918 INFO:teuthology.orchestra.run.smithi132.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-18T04:40:42.926 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-18T04:40:42.938 INFO:teuthology.orchestra.run.smithi132.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-18T04:40:42.945 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-18T04:40:42.963 INFO:teuthology.orchestra.run.smithi120.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy InRelease 2024-04-18T04:40:42.977 INFO:teuthology.orchestra.run.smithi132.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-18T04:40:42.984 INFO:teuthology.orchestra.run.smithi120.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-18T04:40:42.993 INFO:teuthology.orchestra.run.smithi132.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-18T04:40:43.006 INFO:teuthology.orchestra.run.smithi120.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-18T04:40:43.017 INFO:teuthology.orchestra.run.smithi132.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2024-04-18T04:40:43.027 INFO:teuthology.orchestra.run.smithi120.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2024-04-18T04:40:43.059 INFO:teuthology.orchestra.run.smithi132.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,417 B] 2024-04-18T04:40:43.059 INFO:teuthology.orchestra.run.smithi120.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,417 B] 2024-04-18T04:40:43.075 INFO:teuthology.orchestra.run.smithi132.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-18T04:40:43.336 INFO:teuthology.orchestra.run.smithi132.stdout:Fetched 139 kB in 1s (262 kB/s) 2024-04-18T04:40:43.507 INFO:teuthology.orchestra.run.smithi120.stdout:Fetched 139 kB in 1s (249 kB/s) 2024-04-18T04:40:44.303 INFO:teuthology.orchestra.run.smithi132.stdout:Reading package lists... 2024-04-18T04:40:44.318 DEBUG:teuthology.orchestra.run.smithi132:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.2-1229-g56a91dd1-1jammy cephadm=18.2.2-1229-g56a91dd1-1jammy ceph-mds=18.2.2-1229-g56a91dd1-1jammy ceph-mgr=18.2.2-1229-g56a91dd1-1jammy ceph-common=18.2.2-1229-g56a91dd1-1jammy ceph-fuse=18.2.2-1229-g56a91dd1-1jammy ceph-test=18.2.2-1229-g56a91dd1-1jammy ceph-volume=18.2.2-1229-g56a91dd1-1jammy radosgw=18.2.2-1229-g56a91dd1-1jammy python3-rados=18.2.2-1229-g56a91dd1-1jammy python3-rgw=18.2.2-1229-g56a91dd1-1jammy python3-cephfs=18.2.2-1229-g56a91dd1-1jammy python3-rbd=18.2.2-1229-g56a91dd1-1jammy libcephfs2=18.2.2-1229-g56a91dd1-1jammy libcephfs-dev=18.2.2-1229-g56a91dd1-1jammy librados2=18.2.2-1229-g56a91dd1-1jammy librbd1=18.2.2-1229-g56a91dd1-1jammy rbd-fuse=18.2.2-1229-g56a91dd1-1jammy python3-cephfs=18.2.2-1229-g56a91dd1-1jammy cephfs-shell=18.2.2-1229-g56a91dd1-1jammy cephfs-top=18.2.2-1229-g56a91dd1-1jammy cephfs-mirror=18.2.2-1229-g56a91dd1-1jammy 2024-04-18T04:40:44.378 INFO:teuthology.orchestra.run.smithi132.stdout:Reading package lists... 2024-04-18T04:40:44.482 INFO:teuthology.orchestra.run.smithi120.stdout:Reading package lists... 2024-04-18T04:40:44.497 DEBUG:teuthology.orchestra.run.smithi120:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.2-1229-g56a91dd1-1jammy cephadm=18.2.2-1229-g56a91dd1-1jammy ceph-mds=18.2.2-1229-g56a91dd1-1jammy ceph-mgr=18.2.2-1229-g56a91dd1-1jammy ceph-common=18.2.2-1229-g56a91dd1-1jammy ceph-fuse=18.2.2-1229-g56a91dd1-1jammy ceph-test=18.2.2-1229-g56a91dd1-1jammy ceph-volume=18.2.2-1229-g56a91dd1-1jammy radosgw=18.2.2-1229-g56a91dd1-1jammy python3-rados=18.2.2-1229-g56a91dd1-1jammy python3-rgw=18.2.2-1229-g56a91dd1-1jammy python3-cephfs=18.2.2-1229-g56a91dd1-1jammy python3-rbd=18.2.2-1229-g56a91dd1-1jammy libcephfs2=18.2.2-1229-g56a91dd1-1jammy libcephfs-dev=18.2.2-1229-g56a91dd1-1jammy librados2=18.2.2-1229-g56a91dd1-1jammy librbd1=18.2.2-1229-g56a91dd1-1jammy rbd-fuse=18.2.2-1229-g56a91dd1-1jammy python3-cephfs=18.2.2-1229-g56a91dd1-1jammy cephfs-shell=18.2.2-1229-g56a91dd1-1jammy cephfs-top=18.2.2-1229-g56a91dd1-1jammy cephfs-mirror=18.2.2-1229-g56a91dd1-1jammy 2024-04-18T04:40:44.570 INFO:teuthology.orchestra.run.smithi120.stdout:Reading package lists... 2024-04-18T04:40:44.574 INFO:teuthology.orchestra.run.smithi132.stdout:Building dependency tree... 2024-04-18T04:40:44.574 INFO:teuthology.orchestra.run.smithi132.stdout:Reading state information... 2024-04-18T04:40:44.744 INFO:teuthology.orchestra.run.smithi120.stdout:Building dependency tree... 2024-04-18T04:40:44.745 INFO:teuthology.orchestra.run.smithi120.stdout:Reading state information... 2024-04-18T04:40:44.768 INFO:teuthology.orchestra.run.smithi132.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T04:40:44.768 INFO:teuthology.orchestra.run.smithi132.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T04:40:44.768 INFO:teuthology.orchestra.run.smithi132.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T04:40:44.769 INFO:teuthology.orchestra.run.smithi132.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T04:40:44.769 INFO:teuthology.orchestra.run.smithi132.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-18T04:40:44.769 INFO:teuthology.orchestra.run.smithi132.stdout: python2.7-minimal 2024-04-18T04:40:44.769 INFO:teuthology.orchestra.run.smithi132.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T04:40:44.770 INFO:teuthology.orchestra.run.smithi132.stdout:The following additional packages will be installed: 2024-04-18T04:40:44.770 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-18T04:40:44.770 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-18T04:40:44.770 INFO:teuthology.orchestra.run.smithi132.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-04-18T04:40:44.770 INFO:teuthology.orchestra.run.smithi132.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-18T04:40:44.771 INFO:teuthology.orchestra.run.smithi132.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-04-18T04:40:44.771 INFO:teuthology.orchestra.run.smithi132.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-18T04:40:44.771 INFO:teuthology.orchestra.run.smithi132.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-18T04:40:44.771 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-18T04:40:44.771 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-18T04:40:44.771 INFO:teuthology.orchestra.run.smithi132.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-18T04:40:44.772 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-18T04:40:44.772 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-18T04:40:44.772 INFO:teuthology.orchestra.run.smithi132.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-18T04:40:44.772 INFO:teuthology.orchestra.run.smithi132.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-18T04:40:44.772 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-18T04:40:44.772 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-18T04:40:44.772 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-18T04:40:44.772 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-18T04:40:44.772 INFO:teuthology.orchestra.run.smithi132.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-18T04:40:44.772 INFO:teuthology.orchestra.run.smithi132.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-18T04:40:44.772 INFO:teuthology.orchestra.run.smithi132.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-18T04:40:44.772 INFO:teuthology.orchestra.run.smithi132.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-18T04:40:44.772 INFO:teuthology.orchestra.run.smithi132.stdout: qttranslations5-l10n socat xmlstarlet 2024-04-18T04:40:44.773 INFO:teuthology.orchestra.run.smithi132.stdout:Suggested packages: 2024-04-18T04:40:44.773 INFO:teuthology.orchestra.run.smithi132.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-04-18T04:40:44.773 INFO:teuthology.orchestra.run.smithi132.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-04-18T04:40:44.773 INFO:teuthology.orchestra.run.smithi132.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-04-18T04:40:44.773 INFO:teuthology.orchestra.run.smithi132.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-04-18T04:40:44.773 INFO:teuthology.orchestra.run.smithi132.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-04-18T04:40:44.773 INFO:teuthology.orchestra.run.smithi132.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-04-18T04:40:44.773 INFO:teuthology.orchestra.run.smithi132.stdout: python3-watchdog 2024-04-18T04:40:44.773 INFO:teuthology.orchestra.run.smithi132.stdout:Recommended packages: 2024-04-18T04:40:44.773 INFO:teuthology.orchestra.run.smithi132.stdout: btrfs-tools 2024-04-18T04:40:44.876 INFO:teuthology.orchestra.run.smithi132.stdout:The following NEW packages will be installed: 2024-04-18T04:40:44.876 INFO:teuthology.orchestra.run.smithi132.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-18T04:40:44.876 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-18T04:40:44.876 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-18T04:40:44.876 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-18T04:40:44.876 INFO:teuthology.orchestra.run.smithi132.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-04-18T04:40:44.876 INFO:teuthology.orchestra.run.smithi132.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-18T04:40:44.876 INFO:teuthology.orchestra.run.smithi132.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-04-18T04:40:44.877 INFO:teuthology.orchestra.run.smithi132.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-04-18T04:40:44.877 INFO:teuthology.orchestra.run.smithi132.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-18T04:40:44.878 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-18T04:40:44.878 INFO:teuthology.orchestra.run.smithi132.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-18T04:40:44.878 INFO:teuthology.orchestra.run.smithi132.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-18T04:40:44.878 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-18T04:40:44.878 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-18T04:40:44.878 INFO:teuthology.orchestra.run.smithi132.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-18T04:40:44.878 INFO:teuthology.orchestra.run.smithi132.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-18T04:40:44.878 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-18T04:40:44.878 INFO:teuthology.orchestra.run.smithi132.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-18T04:40:44.878 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-18T04:40:44.878 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-18T04:40:44.878 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-18T04:40:44.878 INFO:teuthology.orchestra.run.smithi132.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-18T04:40:44.879 INFO:teuthology.orchestra.run.smithi132.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-18T04:40:44.879 INFO:teuthology.orchestra.run.smithi132.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-18T04:40:44.879 INFO:teuthology.orchestra.run.smithi132.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-18T04:40:44.879 INFO:teuthology.orchestra.run.smithi132.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-18T04:40:44.879 INFO:teuthology.orchestra.run.smithi132.stdout: socat xmlstarlet 2024-04-18T04:40:44.920 INFO:teuthology.orchestra.run.smithi120.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T04:40:44.920 INFO:teuthology.orchestra.run.smithi120.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T04:40:44.920 INFO:teuthology.orchestra.run.smithi120.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T04:40:44.920 INFO:teuthology.orchestra.run.smithi120.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T04:40:44.920 INFO:teuthology.orchestra.run.smithi120.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-18T04:40:44.921 INFO:teuthology.orchestra.run.smithi120.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-18T04:40:44.921 INFO:teuthology.orchestra.run.smithi120.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T04:40:44.921 INFO:teuthology.orchestra.run.smithi120.stdout:The following additional packages will be installed: 2024-04-18T04:40:44.921 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-18T04:40:44.921 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-18T04:40:44.921 INFO:teuthology.orchestra.run.smithi120.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-04-18T04:40:44.921 INFO:teuthology.orchestra.run.smithi120.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-18T04:40:44.922 INFO:teuthology.orchestra.run.smithi120.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-04-18T04:40:44.923 INFO:teuthology.orchestra.run.smithi120.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-18T04:40:44.923 INFO:teuthology.orchestra.run.smithi120.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-18T04:40:44.923 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-18T04:40:44.923 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-18T04:40:44.923 INFO:teuthology.orchestra.run.smithi120.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-18T04:40:44.923 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-18T04:40:44.923 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-18T04:40:44.923 INFO:teuthology.orchestra.run.smithi120.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-18T04:40:44.923 INFO:teuthology.orchestra.run.smithi120.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-18T04:40:44.923 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-18T04:40:44.923 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-18T04:40:44.923 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-18T04:40:44.923 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-18T04:40:44.924 INFO:teuthology.orchestra.run.smithi120.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-18T04:40:44.924 INFO:teuthology.orchestra.run.smithi120.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-18T04:40:44.924 INFO:teuthology.orchestra.run.smithi120.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-18T04:40:44.924 INFO:teuthology.orchestra.run.smithi120.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-18T04:40:44.924 INFO:teuthology.orchestra.run.smithi120.stdout: qttranslations5-l10n socat xmlstarlet 2024-04-18T04:40:44.924 INFO:teuthology.orchestra.run.smithi120.stdout:Suggested packages: 2024-04-18T04:40:44.924 INFO:teuthology.orchestra.run.smithi120.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-04-18T04:40:44.924 INFO:teuthology.orchestra.run.smithi120.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-04-18T04:40:44.924 INFO:teuthology.orchestra.run.smithi120.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-04-18T04:40:44.925 INFO:teuthology.orchestra.run.smithi120.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-04-18T04:40:44.925 INFO:teuthology.orchestra.run.smithi120.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-04-18T04:40:44.925 INFO:teuthology.orchestra.run.smithi120.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-04-18T04:40:44.925 INFO:teuthology.orchestra.run.smithi120.stdout: python3-watchdog 2024-04-18T04:40:44.925 INFO:teuthology.orchestra.run.smithi120.stdout:Recommended packages: 2024-04-18T04:40:44.925 INFO:teuthology.orchestra.run.smithi120.stdout: btrfs-tools 2024-04-18T04:40:44.941 INFO:teuthology.orchestra.run.smithi132.stdout:0 upgraded, 115 newly installed, 0 to remove and 305 not upgraded. 2024-04-18T04:40:44.942 INFO:teuthology.orchestra.run.smithi132.stdout:Need to get 163 MB of archives. 2024-04-18T04:40:44.942 INFO:teuthology.orchestra.run.smithi132.stdout:After this operation, 745 MB of additional disk space will be used. 2024-04-18T04:40:44.942 INFO:teuthology.orchestra.run.smithi132.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-18T04:40:44.962 INFO:teuthology.orchestra.run.smithi132.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-18T04:40:44.972 INFO:teuthology.orchestra.run.smithi132.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-18T04:40:45.019 INFO:teuthology.orchestra.run.smithi132.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-04-18T04:40:45.019 INFO:teuthology.orchestra.run.smithi132.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.2-1229-g56a91dd1-1jammy [3,440 kB] 2024-04-18T04:40:45.029 INFO:teuthology.orchestra.run.smithi132.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-18T04:40:45.048 INFO:teuthology.orchestra.run.smithi132.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-18T04:40:45.050 INFO:teuthology.orchestra.run.smithi132.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-18T04:40:45.062 INFO:teuthology.orchestra.run.smithi132.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-18T04:40:45.070 INFO:teuthology.orchestra.run.smithi120.stdout:The following NEW packages will be installed: 2024-04-18T04:40:45.070 INFO:teuthology.orchestra.run.smithi120.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-18T04:40:45.071 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-18T04:40:45.071 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-18T04:40:45.071 INFO:teuthology.orchestra.run.smithi120.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-18T04:40:45.072 INFO:teuthology.orchestra.run.smithi120.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-04-18T04:40:45.072 INFO:teuthology.orchestra.run.smithi120.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-18T04:40:45.072 INFO:teuthology.orchestra.run.smithi120.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-04-18T04:40:45.072 INFO:teuthology.orchestra.run.smithi120.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-04-18T04:40:45.072 INFO:teuthology.orchestra.run.smithi120.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-18T04:40:45.072 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-18T04:40:45.072 INFO:teuthology.orchestra.run.smithi120.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-18T04:40:45.072 INFO:teuthology.orchestra.run.smithi120.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-18T04:40:45.072 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-18T04:40:45.073 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-18T04:40:45.073 INFO:teuthology.orchestra.run.smithi120.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-18T04:40:45.073 INFO:teuthology.orchestra.run.smithi120.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-18T04:40:45.073 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-18T04:40:45.073 INFO:teuthology.orchestra.run.smithi120.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-18T04:40:45.073 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-18T04:40:45.073 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-18T04:40:45.073 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-18T04:40:45.073 INFO:teuthology.orchestra.run.smithi120.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-18T04:40:45.073 INFO:teuthology.orchestra.run.smithi120.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-18T04:40:45.073 INFO:teuthology.orchestra.run.smithi120.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-18T04:40:45.073 INFO:teuthology.orchestra.run.smithi120.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-18T04:40:45.073 INFO:teuthology.orchestra.run.smithi120.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-18T04:40:45.073 INFO:teuthology.orchestra.run.smithi120.stdout: socat xmlstarlet 2024-04-18T04:40:45.111 INFO:teuthology.orchestra.run.smithi132.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-18T04:40:45.115 INFO:teuthology.orchestra.run.smithi132.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-18T04:40:45.127 INFO:teuthology.orchestra.run.smithi132.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-18T04:40:45.131 INFO:teuthology.orchestra.run.smithi132.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-18T04:40:45.131 INFO:teuthology.orchestra.run.smithi132.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-18T04:40:45.139 INFO:teuthology.orchestra.run.smithi132.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-18T04:40:45.140 INFO:teuthology.orchestra.run.smithi132.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-18T04:40:45.141 INFO:teuthology.orchestra.run.smithi132.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-18T04:40:45.142 INFO:teuthology.orchestra.run.smithi132.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-18T04:40:45.142 INFO:teuthology.orchestra.run.smithi132.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-18T04:40:45.145 INFO:teuthology.orchestra.run.smithi120.stdout:0 upgraded, 115 newly installed, 0 to remove and 305 not upgraded. 2024-04-18T04:40:45.145 INFO:teuthology.orchestra.run.smithi120.stdout:Need to get 163 MB of archives. 2024-04-18T04:40:45.145 INFO:teuthology.orchestra.run.smithi120.stdout:After this operation, 745 MB of additional disk space will be used. 2024-04-18T04:40:45.145 INFO:teuthology.orchestra.run.smithi120.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-18T04:40:45.154 INFO:teuthology.orchestra.run.smithi132.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-18T04:40:45.154 INFO:teuthology.orchestra.run.smithi132.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-18T04:40:45.155 INFO:teuthology.orchestra.run.smithi132.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-18T04:40:45.155 INFO:teuthology.orchestra.run.smithi132.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-18T04:40:45.167 INFO:teuthology.orchestra.run.smithi120.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-18T04:40:45.174 INFO:teuthology.orchestra.run.smithi132.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-18T04:40:45.176 INFO:teuthology.orchestra.run.smithi132.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-18T04:40:45.177 INFO:teuthology.orchestra.run.smithi132.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-18T04:40:45.177 INFO:teuthology.orchestra.run.smithi132.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-18T04:40:45.178 INFO:teuthology.orchestra.run.smithi120.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-18T04:40:45.178 INFO:teuthology.orchestra.run.smithi132.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-18T04:40:45.179 INFO:teuthology.orchestra.run.smithi132.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-18T04:40:45.193 INFO:teuthology.orchestra.run.smithi132.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-18T04:40:45.193 INFO:teuthology.orchestra.run.smithi132.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-18T04:40:45.195 INFO:teuthology.orchestra.run.smithi132.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-18T04:40:45.196 INFO:teuthology.orchestra.run.smithi132.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-18T04:40:45.212 INFO:teuthology.orchestra.run.smithi132.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-18T04:40:45.217 INFO:teuthology.orchestra.run.smithi132.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-18T04:40:45.218 INFO:teuthology.orchestra.run.smithi132.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-18T04:40:45.218 INFO:teuthology.orchestra.run.smithi132.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-18T04:40:45.219 INFO:teuthology.orchestra.run.smithi132.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-18T04:40:45.221 INFO:teuthology.orchestra.run.smithi132.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-18T04:40:45.228 INFO:teuthology.orchestra.run.smithi120.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-04-18T04:40:45.232 INFO:teuthology.orchestra.run.smithi132.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-18T04:40:45.233 INFO:teuthology.orchestra.run.smithi132.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-18T04:40:45.234 INFO:teuthology.orchestra.run.smithi132.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-18T04:40:45.235 INFO:teuthology.orchestra.run.smithi132.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-18T04:40:45.238 INFO:teuthology.orchestra.run.smithi120.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-18T04:40:45.251 INFO:teuthology.orchestra.run.smithi132.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-18T04:40:45.252 INFO:teuthology.orchestra.run.smithi132.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-18T04:40:45.254 INFO:teuthology.orchestra.run.smithi132.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-18T04:40:45.271 INFO:teuthology.orchestra.run.smithi120.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-18T04:40:45.279 INFO:teuthology.orchestra.run.smithi120.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-18T04:40:45.287 INFO:teuthology.orchestra.run.smithi120.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-18T04:40:45.309 INFO:teuthology.orchestra.run.smithi132.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-18T04:40:45.310 INFO:teuthology.orchestra.run.smithi132.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-18T04:40:45.311 INFO:teuthology.orchestra.run.smithi132.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-18T04:40:45.312 INFO:teuthology.orchestra.run.smithi132.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-18T04:40:45.312 INFO:teuthology.orchestra.run.smithi132.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-18T04:40:45.313 INFO:teuthology.orchestra.run.smithi132.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-18T04:40:45.314 INFO:teuthology.orchestra.run.smithi132.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-18T04:40:45.314 INFO:teuthology.orchestra.run.smithi132.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-18T04:40:45.316 INFO:teuthology.orchestra.run.smithi132.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-18T04:40:45.320 INFO:teuthology.orchestra.run.smithi120.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.2-1229-g56a91dd1-1jammy [3,440 kB] 2024-04-18T04:40:45.321 INFO:teuthology.orchestra.run.smithi132.stdout:Get:56 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.2-1229-g56a91dd1-1jammy [3,105 kB] 2024-04-18T04:40:45.332 INFO:teuthology.orchestra.run.smithi132.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-18T04:40:45.333 INFO:teuthology.orchestra.run.smithi132.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-18T04:40:45.356 INFO:teuthology.orchestra.run.smithi132.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-18T04:40:45.368 INFO:teuthology.orchestra.run.smithi132.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-18T04:40:45.368 INFO:teuthology.orchestra.run.smithi132.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-18T04:40:45.370 INFO:teuthology.orchestra.run.smithi120.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-18T04:40:45.380 INFO:teuthology.orchestra.run.smithi120.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-18T04:40:45.390 INFO:teuthology.orchestra.run.smithi132.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-18T04:40:45.391 INFO:teuthology.orchestra.run.smithi132.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-18T04:40:45.392 INFO:teuthology.orchestra.run.smithi132.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-18T04:40:45.393 INFO:teuthology.orchestra.run.smithi132.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-18T04:40:45.393 INFO:teuthology.orchestra.run.smithi132.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-18T04:40:45.399 INFO:teuthology.orchestra.run.smithi120.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-18T04:40:45.402 INFO:teuthology.orchestra.run.smithi120.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-18T04:40:45.403 INFO:teuthology.orchestra.run.smithi120.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-18T04:40:45.405 INFO:teuthology.orchestra.run.smithi132.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-18T04:40:45.406 INFO:teuthology.orchestra.run.smithi132.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-18T04:40:45.407 INFO:teuthology.orchestra.run.smithi132.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-18T04:40:45.412 INFO:teuthology.orchestra.run.smithi120.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-18T04:40:45.413 INFO:teuthology.orchestra.run.smithi120.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-18T04:40:45.413 INFO:teuthology.orchestra.run.smithi120.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-18T04:40:45.415 INFO:teuthology.orchestra.run.smithi120.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-18T04:40:45.415 INFO:teuthology.orchestra.run.smithi120.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-18T04:40:45.416 INFO:teuthology.orchestra.run.smithi132.stdout:Get:70 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.2-1229-g56a91dd1-1jammy [680 kB] 2024-04-18T04:40:45.425 INFO:teuthology.orchestra.run.smithi132.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-18T04:40:45.427 INFO:teuthology.orchestra.run.smithi132.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-18T04:40:45.429 INFO:teuthology.orchestra.run.smithi132.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-18T04:40:45.429 INFO:teuthology.orchestra.run.smithi132.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-18T04:40:45.433 INFO:teuthology.orchestra.run.smithi132.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-18T04:40:45.436 INFO:teuthology.orchestra.run.smithi132.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-18T04:40:45.437 INFO:teuthology.orchestra.run.smithi132.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-18T04:40:45.441 INFO:teuthology.orchestra.run.smithi132.stdout:Get:78 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.2-1229-g56a91dd1-1jammy [356 kB] 2024-04-18T04:40:45.442 INFO:teuthology.orchestra.run.smithi120.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-18T04:40:45.443 INFO:teuthology.orchestra.run.smithi120.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-18T04:40:45.443 INFO:teuthology.orchestra.run.smithi120.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-18T04:40:45.443 INFO:teuthology.orchestra.run.smithi120.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-18T04:40:45.446 INFO:teuthology.orchestra.run.smithi132.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-18T04:40:45.450 INFO:teuthology.orchestra.run.smithi132.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-18T04:40:45.450 INFO:teuthology.orchestra.run.smithi132.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-18T04:40:45.452 INFO:teuthology.orchestra.run.smithi132.stdout:Get:82 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.2-1229-g56a91dd1-1jammy [32.8 kB] 2024-04-18T04:40:45.453 INFO:teuthology.orchestra.run.smithi132.stdout:Get:83 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.2-1229-g56a91dd1-1jammy [180 kB] 2024-04-18T04:40:45.459 INFO:teuthology.orchestra.run.smithi132.stdout:Get:84 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.2-1229-g56a91dd1-1jammy [63.7 kB] 2024-04-18T04:40:45.461 INFO:teuthology.orchestra.run.smithi132.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.2-1229-g56a91dd1-1jammy [330 kB] 2024-04-18T04:40:45.463 INFO:teuthology.orchestra.run.smithi120.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-18T04:40:45.466 INFO:teuthology.orchestra.run.smithi120.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-18T04:40:45.466 INFO:teuthology.orchestra.run.smithi120.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-18T04:40:45.467 INFO:teuthology.orchestra.run.smithi120.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-18T04:40:45.467 INFO:teuthology.orchestra.run.smithi120.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-18T04:40:45.469 INFO:teuthology.orchestra.run.smithi120.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-18T04:40:45.469 INFO:teuthology.orchestra.run.smithi132.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-18T04:40:45.472 INFO:teuthology.orchestra.run.smithi132.stdout:Get:87 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.2-1229-g56a91dd1-1jammy [5,891 kB] 2024-04-18T04:40:45.476 INFO:teuthology.orchestra.run.smithi132.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-18T04:40:45.477 INFO:teuthology.orchestra.run.smithi132.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-18T04:40:45.477 INFO:teuthology.orchestra.run.smithi132.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-18T04:40:45.500 INFO:teuthology.orchestra.run.smithi120.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-18T04:40:45.500 INFO:teuthology.orchestra.run.smithi120.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-18T04:40:45.501 INFO:teuthology.orchestra.run.smithi120.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-18T04:40:45.502 INFO:teuthology.orchestra.run.smithi120.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-18T04:40:45.522 INFO:teuthology.orchestra.run.smithi120.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-18T04:40:45.527 INFO:teuthology.orchestra.run.smithi120.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-18T04:40:45.528 INFO:teuthology.orchestra.run.smithi120.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-18T04:40:45.528 INFO:teuthology.orchestra.run.smithi120.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-18T04:40:45.529 INFO:teuthology.orchestra.run.smithi120.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-18T04:40:45.530 INFO:teuthology.orchestra.run.smithi120.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-18T04:40:45.541 INFO:teuthology.orchestra.run.smithi120.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-18T04:40:45.542 INFO:teuthology.orchestra.run.smithi120.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-18T04:40:45.543 INFO:teuthology.orchestra.run.smithi120.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-18T04:40:45.544 INFO:teuthology.orchestra.run.smithi120.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-18T04:40:45.562 INFO:teuthology.orchestra.run.smithi120.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-18T04:40:45.564 INFO:teuthology.orchestra.run.smithi120.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-18T04:40:45.567 INFO:teuthology.orchestra.run.smithi120.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-18T04:40:45.634 INFO:teuthology.orchestra.run.smithi120.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-18T04:40:45.635 INFO:teuthology.orchestra.run.smithi120.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-18T04:40:45.637 INFO:teuthology.orchestra.run.smithi120.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-18T04:40:45.637 INFO:teuthology.orchestra.run.smithi120.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-18T04:40:45.638 INFO:teuthology.orchestra.run.smithi120.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-18T04:40:45.639 INFO:teuthology.orchestra.run.smithi120.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-18T04:40:45.639 INFO:teuthology.orchestra.run.smithi120.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-18T04:40:45.639 INFO:teuthology.orchestra.run.smithi120.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-18T04:40:45.642 INFO:teuthology.orchestra.run.smithi120.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-18T04:40:45.658 INFO:teuthology.orchestra.run.smithi120.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-18T04:40:45.659 INFO:teuthology.orchestra.run.smithi120.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-18T04:40:45.677 INFO:teuthology.orchestra.run.smithi132.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.2-1229-g56a91dd1-1jammy [112 kB] 2024-04-18T04:40:45.680 INFO:teuthology.orchestra.run.smithi132.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.2-1229-g56a91dd1-1jammy [441 kB] 2024-04-18T04:40:45.686 INFO:teuthology.orchestra.run.smithi120.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-18T04:40:45.688 INFO:teuthology.orchestra.run.smithi120.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-18T04:40:45.689 INFO:teuthology.orchestra.run.smithi120.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-18T04:40:45.698 INFO:teuthology.orchestra.run.smithi132.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.2-1229-g56a91dd1-1jammy [21.9 MB] 2024-04-18T04:40:45.708 INFO:teuthology.orchestra.run.smithi120.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-18T04:40:45.708 INFO:teuthology.orchestra.run.smithi120.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-18T04:40:45.711 INFO:teuthology.orchestra.run.smithi120.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-18T04:40:45.712 INFO:teuthology.orchestra.run.smithi120.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-18T04:40:45.712 INFO:teuthology.orchestra.run.smithi120.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-18T04:40:45.718 INFO:teuthology.orchestra.run.smithi120.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-18T04:40:45.718 INFO:teuthology.orchestra.run.smithi120.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-18T04:40:45.737 INFO:teuthology.orchestra.run.smithi120.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-18T04:40:45.742 INFO:teuthology.orchestra.run.smithi120.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-18T04:40:45.744 INFO:teuthology.orchestra.run.smithi120.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-18T04:40:45.746 INFO:teuthology.orchestra.run.smithi120.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-18T04:40:45.746 INFO:teuthology.orchestra.run.smithi120.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-18T04:40:45.750 INFO:teuthology.orchestra.run.smithi120.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-18T04:40:45.753 INFO:teuthology.orchestra.run.smithi120.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-18T04:40:45.753 INFO:teuthology.orchestra.run.smithi120.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-18T04:40:45.768 INFO:teuthology.orchestra.run.smithi120.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-18T04:40:45.771 INFO:teuthology.orchestra.run.smithi120.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-18T04:40:45.788 INFO:teuthology.orchestra.run.smithi120.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-18T04:40:45.790 INFO:teuthology.orchestra.run.smithi120.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-18T04:40:45.797 INFO:teuthology.orchestra.run.smithi120.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-18T04:40:45.798 INFO:teuthology.orchestra.run.smithi120.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-18T04:40:45.798 INFO:teuthology.orchestra.run.smithi120.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-18T04:40:46.549 INFO:teuthology.orchestra.run.smithi132.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.2-1229-g56a91dd1-1jammy [5,002 kB] 2024-04-18T04:40:46.648 INFO:teuthology.orchestra.run.smithi132.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.2-1229-g56a91dd1-1jammy [241 kB] 2024-04-18T04:40:46.654 INFO:teuthology.orchestra.run.smithi132.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.2-1229-g56a91dd1-1jammy [130 kB] 2024-04-18T04:40:46.659 INFO:teuthology.orchestra.run.smithi132.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.2-1229-g56a91dd1-1jammy [1,491 kB] 2024-04-18T04:40:46.714 INFO:teuthology.orchestra.run.smithi132.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.2-1229-g56a91dd1-1jammy [6,079 kB] 2024-04-18T04:40:46.934 INFO:teuthology.orchestra.run.smithi132.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.2-1229-g56a91dd1-1jammy [22.3 MB] 2024-04-18T04:40:47.122 INFO:teuthology.orchestra.run.smithi120.stdout:Get:83 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.2-1229-g56a91dd1-1jammy [3,105 kB] 2024-04-18T04:40:47.827 INFO:teuthology.orchestra.run.smithi132.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.2-1229-g56a91dd1-1jammy [14.1 kB] 2024-04-18T04:40:47.827 INFO:teuthology.orchestra.run.smithi132.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.2-1229-g56a91dd1-1jammy [831 kB] 2024-04-18T04:40:47.843 INFO:teuthology.orchestra.run.smithi132.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.2-1229-g56a91dd1-1jammy [2,154 kB] 2024-04-18T04:40:47.881 INFO:teuthology.orchestra.run.smithi132.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.2-1229-g56a91dd1-1jammy [238 kB] 2024-04-18T04:40:47.885 INFO:teuthology.orchestra.run.smithi132.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.2-1229-g56a91dd1-1jammy [144 kB] 2024-04-18T04:40:47.887 INFO:teuthology.orchestra.run.smithi132.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.2-1229-g56a91dd1-1jammy [2,237 kB] 2024-04-18T04:40:47.926 INFO:teuthology.orchestra.run.smithi132.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.2-1229-g56a91dd1-1jammy [8,625 kB] 2024-04-18T04:40:48.232 INFO:teuthology.orchestra.run.smithi132.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.2-1229-g56a91dd1-1jammy [14.3 kB] 2024-04-18T04:40:48.233 INFO:teuthology.orchestra.run.smithi132.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.2-1229-g56a91dd1-1jammy [42.6 MB] 2024-04-18T04:40:48.423 INFO:teuthology.orchestra.run.smithi120.stdout:Get:84 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.2-1229-g56a91dd1-1jammy [680 kB] 2024-04-18T04:40:48.755 INFO:teuthology.orchestra.run.smithi120.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.2-1229-g56a91dd1-1jammy [356 kB] 2024-04-18T04:40:48.915 INFO:teuthology.orchestra.run.smithi120.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.2-1229-g56a91dd1-1jammy [32.8 kB] 2024-04-18T04:40:48.929 INFO:teuthology.orchestra.run.smithi120.stdout:Get:87 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.2-1229-g56a91dd1-1jammy [180 kB] 2024-04-18T04:40:49.006 INFO:teuthology.orchestra.run.smithi120.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.2-1229-g56a91dd1-1jammy [63.7 kB] 2024-04-18T04:40:49.023 INFO:teuthology.orchestra.run.smithi120.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.2-1229-g56a91dd1-1jammy [330 kB] 2024-04-18T04:40:49.169 INFO:teuthology.orchestra.run.smithi120.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.2-1229-g56a91dd1-1jammy [5,891 kB] 2024-04-18T04:40:49.930 INFO:teuthology.orchestra.run.smithi132.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.2-1229-g56a91dd1-1jammy [121 kB] 2024-04-18T04:40:49.933 INFO:teuthology.orchestra.run.smithi132.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.2.2-1229-g56a91dd1-1jammy [230 kB] 2024-04-18T04:40:49.937 INFO:teuthology.orchestra.run.smithi132.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.2.2-1229-g56a91dd1-1jammy [34.1 kB] 2024-04-18T04:40:49.938 INFO:teuthology.orchestra.run.smithi132.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.2.2-1229-g56a91dd1-1jammy [23.5 kB] 2024-04-18T04:40:49.939 INFO:teuthology.orchestra.run.smithi132.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.2-1229-g56a91dd1-1jammy [38.3 kB] 2024-04-18T04:40:49.940 INFO:teuthology.orchestra.run.smithi132.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.2-1229-g56a91dd1-1jammy [11.6 MB] 2024-04-18T04:40:50.233 INFO:teuthology.orchestra.run.smithi132.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.2-1229-g56a91dd1-1jammy [93.1 kB] 2024-04-18T04:40:50.757 INFO:teuthology.orchestra.run.smithi132.stdout:Fetched 163 MB in 5s (30.4 MB/s) 2024-04-18T04:40:50.823 INFO:teuthology.orchestra.run.smithi120.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.2-1229-g56a91dd1-1jammy [112 kB] 2024-04-18T04:40:50.864 INFO:teuthology.orchestra.run.smithi120.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.2-1229-g56a91dd1-1jammy [441 kB] 2024-04-18T04:40:50.897 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-18T04:40:50.945 INFO:teuthology.orchestra.run.smithi120.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.2-1229-g56a91dd1-1jammy [21.9 MB] 2024-04-18T04:40:50.977 INFO:teuthology.orchestra.run.smithi132.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 130504 files and directories currently installed.) 2024-04-18T04:40:50.982 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-18T04:40:51.028 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-18T04:40:51.323 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-18T04:40:51.343 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-18T04:40:51.381 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-18T04:40:51.659 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-cmd2. 2024-04-18T04:40:51.671 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-18T04:40:51.701 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-18T04:40:51.987 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libfmt8:amd64. 2024-04-18T04:40:51.999 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-04-18T04:40:52.062 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-04-18T04:40:52.399 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-18T04:40:52.419 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-18T04:40:52.458 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-18T04:40:52.811 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-18T04:40:52.831 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-18T04:40:52.869 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-18T04:40:53.164 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-18T04:40:53.184 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-18T04:40:53.214 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-18T04:40:53.651 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-18T04:40:53.671 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T04:40:53.726 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T04:40:54.129 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-18T04:40:54.149 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T04:40:54.187 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T04:40:54.532 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-18T04:40:54.552 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T04:40:54.563 INFO:teuthology.orchestra.run.smithi120.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.2-1229-g56a91dd1-1jammy [5,002 kB] 2024-04-18T04:40:54.590 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T04:40:54.910 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-18T04:40:54.922 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-18T04:40:54.952 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-18T04:40:55.245 INFO:teuthology.orchestra.run.smithi120.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.2-1229-g56a91dd1-1jammy [241 kB] 2024-04-18T04:40:55.255 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package librados2. 2024-04-18T04:40:55.275 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../011-librados2_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:40:55.284 INFO:teuthology.orchestra.run.smithi120.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.2-1229-g56a91dd1-1jammy [130 kB] 2024-04-18T04:40:55.309 INFO:teuthology.orchestra.run.smithi120.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.2-1229-g56a91dd1-1jammy [1,491 kB] 2024-04-18T04:40:55.313 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking librados2 (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:40:55.499 INFO:teuthology.orchestra.run.smithi120.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.2-1229-g56a91dd1-1jammy [6,079 kB] 2024-04-18T04:40:55.783 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package librbd1. 2024-04-18T04:40:55.802 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../012-librbd1_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:40:55.841 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking librbd1 (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:40:56.269 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libcephfs2. 2024-04-18T04:40:56.286 INFO:teuthology.orchestra.run.smithi120.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.2-1229-g56a91dd1-1jammy [22.3 MB] 2024-04-18T04:40:56.290 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../013-libcephfs2_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:40:56.327 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libcephfs2 (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:40:56.614 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-rados. 2024-04-18T04:40:56.634 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../014-python3-rados_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:40:56.672 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-rados (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:40:56.933 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-18T04:40:56.946 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.2.2-1229-g56a91dd1-1jammy_all.deb ... 2024-04-18T04:40:56.983 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-ceph-argparse (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:40:57.210 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-cephfs. 2024-04-18T04:40:57.222 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../016-python3-cephfs_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:40:57.252 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-cephfs (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:40:57.547 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-18T04:40:57.567 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../017-python3-ceph-common_18.2.2-1229-g56a91dd1-1jammy_all.deb ... 2024-04-18T04:40:57.605 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-ceph-common (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:40:57.933 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-prettytable. 2024-04-18T04:40:57.954 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2024-04-18T04:40:57.991 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-18T04:40:58.260 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-rbd. 2024-04-18T04:40:58.272 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../019-python3-rbd_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:40:58.327 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-rbd (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:40:58.639 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-18T04:40:58.660 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-18T04:40:58.689 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-18T04:40:58.706 INFO:teuthology.orchestra.run.smithi120.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.2-1229-g56a91dd1-1jammy [14.1 kB] 2024-04-18T04:40:58.706 INFO:teuthology.orchestra.run.smithi120.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.2-1229-g56a91dd1-1jammy [831 kB] 2024-04-18T04:40:58.777 INFO:teuthology.orchestra.run.smithi120.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.2-1229-g56a91dd1-1jammy [2,154 kB] 2024-04-18T04:40:58.959 INFO:teuthology.orchestra.run.smithi120.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.2-1229-g56a91dd1-1jammy [238 kB] 2024-04-18T04:40:58.967 INFO:teuthology.orchestra.run.smithi120.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.2-1229-g56a91dd1-1jammy [144 kB] 2024-04-18T04:40:58.984 INFO:teuthology.orchestra.run.smithi120.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.2-1229-g56a91dd1-1jammy [2,237 kB] 2024-04-18T04:40:59.008 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package librgw2. 2024-04-18T04:40:59.029 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../021-librgw2_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:40:59.066 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking librgw2 (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:40:59.163 INFO:teuthology.orchestra.run.smithi120.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.2-1229-g56a91dd1-1jammy [8,625 kB] 2024-04-18T04:40:59.569 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-rgw. 2024-04-18T04:40:59.590 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../022-python3-rgw_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:40:59.627 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-rgw (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:40:59.791 INFO:teuthology.orchestra.run.smithi120.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.2-1229-g56a91dd1-1jammy [14.3 kB] 2024-04-18T04:40:59.791 INFO:teuthology.orchestra.run.smithi120.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.2-1229-g56a91dd1-1jammy [42.6 MB] 2024-04-18T04:40:59.964 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-18T04:40:59.985 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-18T04:41:00.022 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-18T04:41:00.275 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libradosstriper1. 2024-04-18T04:41:00.287 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../024-libradosstriper1_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:41:00.325 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libradosstriper1 (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:00.770 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-common. 2024-04-18T04:41:00.791 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../025-ceph-common_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:41:00.828 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-common (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:02.055 INFO:teuthology.orchestra.run.smithi120.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.2-1229-g56a91dd1-1jammy [121 kB] 2024-04-18T04:41:02.056 INFO:teuthology.orchestra.run.smithi120.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.2.2-1229-g56a91dd1-1jammy [230 kB] 2024-04-18T04:41:02.058 INFO:teuthology.orchestra.run.smithi120.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.2.2-1229-g56a91dd1-1jammy [34.1 kB] 2024-04-18T04:41:02.059 INFO:teuthology.orchestra.run.smithi120.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.2.2-1229-g56a91dd1-1jammy [23.5 kB] 2024-04-18T04:41:02.059 INFO:teuthology.orchestra.run.smithi120.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.2-1229-g56a91dd1-1jammy [38.3 kB] 2024-04-18T04:41:02.060 INFO:teuthology.orchestra.run.smithi120.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.2-1229-g56a91dd1-1jammy [11.6 MB] 2024-04-18T04:41:02.485 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-base. 2024-04-18T04:41:02.505 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../026-ceph-base_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:41:02.526 INFO:teuthology.orchestra.run.smithi120.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.2-1229-g56a91dd1-1jammy [93.1 kB] 2024-04-18T04:41:02.552 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-base (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:03.089 INFO:teuthology.orchestra.run.smithi120.stdout:Fetched 163 MB in 17s (9,321 kB/s) 2024-04-18T04:41:03.173 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-18T04:41:03.194 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-18T04:41:03.211 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-18T04:41:03.231 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-18T04:41:03.279 INFO:teuthology.orchestra.run.smithi120.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132922 files and directories currently installed.) 2024-04-18T04:41:03.283 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-18T04:41:03.476 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-18T04:41:03.509 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-cheroot. 2024-04-18T04:41:03.530 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-18T04:41:03.567 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-18T04:41:03.795 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-18T04:41:03.809 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-18T04:41:03.853 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-18T04:41:03.912 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-18T04:41:03.933 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-18T04:41:03.970 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-18T04:41:04.190 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-cmd2. 2024-04-18T04:41:04.203 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-18T04:41:04.240 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-18T04:41:04.247 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-18T04:41:04.261 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-18T04:41:04.298 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-18T04:41:04.567 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libfmt8:amd64. 2024-04-18T04:41:04.581 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-04-18T04:41:04.601 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-18T04:41:04.622 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-18T04:41:04.659 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-18T04:41:04.676 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-04-18T04:41:04.962 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-tempora. 2024-04-18T04:41:04.978 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-18T04:41:04.983 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2024-04-18T04:41:04.994 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-18T04:41:05.021 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-18T04:41:05.028 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-18T04:41:05.299 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-portend. 2024-04-18T04:41:05.320 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2024-04-18T04:41:05.349 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-18T04:41:05.390 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-18T04:41:05.405 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-18T04:41:05.448 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-18T04:41:05.652 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-18T04:41:05.672 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-18T04:41:05.710 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-18T04:41:05.743 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-18T04:41:05.758 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-18T04:41:05.801 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-18T04:41:06.030 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-18T04:41:06.051 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-18T04:41:06.088 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-18T04:41:06.246 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-18T04:41:06.261 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T04:41:06.333 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T04:41:06.434 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-natsort. 2024-04-18T04:41:06.454 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2024-04-18T04:41:06.492 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-18T04:41:06.741 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-18T04:41:06.756 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T04:41:06.799 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T04:41:06.803 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-logutils. 2024-04-18T04:41:06.824 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2024-04-18T04:41:06.862 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-18T04:41:07.119 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-18T04:41:07.134 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-18T04:41:07.165 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-18T04:41:07.177 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T04:41:07.185 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-18T04:41:07.226 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-18T04:41:07.505 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-18T04:41:07.520 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-18T04:41:07.580 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-18T04:41:07.684 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-mako. 2024-04-18T04:41:07.706 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-18T04:41:07.743 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-18T04:41:07.899 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package librados2. 2024-04-18T04:41:07.914 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../011-librados2_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:41:07.957 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking librados2 (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:08.071 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-18T04:41:08.092 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-18T04:41:08.129 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-18T04:41:08.360 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package librbd1. 2024-04-18T04:41:08.375 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../012-librbd1_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:41:08.410 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking librbd1 (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:08.415 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-18T04:41:08.436 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-18T04:41:08.474 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-18T04:41:08.735 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-webob. 2024-04-18T04:41:08.755 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-18T04:41:08.793 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-18T04:41:08.821 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libcephfs2. 2024-04-18T04:41:08.836 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../013-libcephfs2_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:41:08.879 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libcephfs2 (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:09.130 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-waitress. 2024-04-18T04:41:09.150 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-18T04:41:09.156 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-rados. 2024-04-18T04:41:09.171 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../014-python3-rados_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:41:09.182 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-18T04:41:09.215 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-rados (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:09.491 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-tempita. 2024-04-18T04:41:09.512 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-18T04:41:09.549 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-18T04:41:09.568 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-18T04:41:09.583 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.2.2-1229-g56a91dd1-1jammy_all.deb ... 2024-04-18T04:41:09.626 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-ceph-argparse (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:09.852 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-paste. 2024-04-18T04:41:09.853 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-cephfs. 2024-04-18T04:41:09.868 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../016-python3-cephfs_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:41:09.873 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-18T04:41:09.903 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-cephfs (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:09.910 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-18T04:41:10.222 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-18T04:41:10.238 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../017-python3-ceph-common_18.2.2-1229-g56a91dd1-1jammy_all.deb ... 2024-04-18T04:41:10.247 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-18T04:41:10.268 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-18T04:41:10.281 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-ceph-common (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:10.306 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-18T04:41:10.600 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-18T04:41:10.621 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-18T04:41:10.634 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-prettytable. 2024-04-18T04:41:10.649 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2024-04-18T04:41:10.658 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-18T04:41:10.692 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-18T04:41:10.945 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-webtest. 2024-04-18T04:41:10.953 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-rbd. 2024-04-18T04:41:10.965 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2024-04-18T04:41:10.968 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../019-python3-rbd_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:41:10.995 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-18T04:41:11.011 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-rbd (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:11.290 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-pecan. 2024-04-18T04:41:11.310 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-18T04:41:11.348 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-18T04:41:11.355 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-18T04:41:11.370 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-18T04:41:11.406 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-18T04:41:11.675 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package librgw2. 2024-04-18T04:41:11.690 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../021-librgw2_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:41:11.694 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-certifi. 2024-04-18T04:41:11.715 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2024-04-18T04:41:11.725 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking librgw2 (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:11.753 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-18T04:41:12.083 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-idna. 2024-04-18T04:41:12.104 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2024-04-18T04:41:12.149 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-18T04:41:12.188 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-rgw. 2024-04-18T04:41:12.202 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../022-python3-rgw_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:41:12.246 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-rgw (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:12.436 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-urllib3. 2024-04-18T04:41:12.456 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-18T04:41:12.485 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-18T04:41:12.574 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-18T04:41:12.589 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-18T04:41:12.624 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-18T04:41:12.814 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-requests. 2024-04-18T04:41:12.834 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-18T04:41:12.880 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-18T04:41:12.927 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libradosstriper1. 2024-04-18T04:41:12.942 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../024-libradosstriper1_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:41:12.985 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libradosstriper1 (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:13.208 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-18T04:41:13.229 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-18T04:41:13.275 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-18T04:41:13.431 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-common. 2024-04-18T04:41:13.446 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../025-ceph-common_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:41:13.489 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-common (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:13.595 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-18T04:41:13.616 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.2.2-1229-g56a91dd1-1jammy_all.deb ... 2024-04-18T04:41:13.653 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-mgr-modules-core (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:14.058 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-18T04:41:14.079 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:41:14.116 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libsqlite3-mod-ceph (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:14.435 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-openssl. 2024-04-18T04:41:14.456 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2024-04-18T04:41:14.494 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-18T04:41:14.704 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-base. 2024-04-18T04:41:14.718 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../026-ceph-base_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:41:14.771 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-base (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:14.788 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-mgr. 2024-04-18T04:41:14.809 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../058-ceph-mgr_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:41:14.838 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-mgr (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:15.225 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-mon. 2024-04-18T04:41:15.245 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../059-ceph-mon_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:41:15.283 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-mon (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:15.350 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-18T04:41:15.363 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-18T04:41:15.400 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-18T04:41:15.694 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-cheroot. 2024-04-18T04:41:15.708 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-18T04:41:15.761 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-18T04:41:15.895 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-osd. 2024-04-18T04:41:15.916 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../060-ceph-osd_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:41:15.953 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-osd (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:16.073 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-18T04:41:16.091 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-18T04:41:16.165 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-18T04:41:16.468 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-18T04:41:16.484 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-18T04:41:16.526 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-18T04:41:16.846 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-18T04:41:16.860 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-18T04:41:16.904 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-18T04:41:16.998 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph. 2024-04-18T04:41:17.010 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../061-ceph_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:41:17.039 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:17.207 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-tempora. 2024-04-18T04:41:17.221 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2024-04-18T04:41:17.266 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-18T04:41:17.343 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-fuse. 2024-04-18T04:41:17.363 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../062-ceph-fuse_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:41:17.401 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-fuse (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:17.594 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-portend. 2024-04-18T04:41:17.608 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2024-04-18T04:41:17.654 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-18T04:41:18.313 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-mds. 2024-04-18T04:41:18.333 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../063-ceph-mds_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:41:18.547 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-18T04:41:18.561 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-18T04:41:18.747 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-18T04:41:18.796 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-mds (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:19.200 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-18T04:41:19.214 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-18T04:41:19.250 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-18T04:41:19.383 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package cephadm. 2024-04-18T04:41:19.403 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../064-cephadm_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:41:19.449 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking cephadm (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:19.638 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-natsort. 2024-04-18T04:41:19.651 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2024-04-18T04:41:19.696 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-18T04:41:19.819 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-18T04:41:19.839 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-18T04:41:19.885 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-18T04:41:19.991 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-logutils. 2024-04-18T04:41:20.004 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2024-04-18T04:41:20.041 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-18T04:41:20.213 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-18T04:41:20.225 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-18T04:41:20.263 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-18T04:41:20.327 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-18T04:41:20.341 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-18T04:41:20.377 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-18T04:41:20.664 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-mako. 2024-04-18T04:41:20.677 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-18T04:41:20.730 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-18T04:41:21.059 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-18T04:41:21.072 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-18T04:41:21.117 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-18T04:41:21.285 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-babel. 2024-04-18T04:41:21.306 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-18T04:41:21.377 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-18T04:41:21.420 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-18T04:41:21.434 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-18T04:41:21.479 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-18T04:41:21.671 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-jinja2. 2024-04-18T04:41:21.692 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-18T04:41:21.729 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-18T04:41:21.757 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-webob. 2024-04-18T04:41:21.771 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-18T04:41:21.814 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-18T04:41:22.066 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-18T04:41:22.088 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.2.2-1229-g56a91dd1-1jammy_all.deb ... 2024-04-18T04:41:22.124 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-mgr-cephadm (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:22.210 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-waitress. 2024-04-18T04:41:22.223 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-18T04:41:22.270 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-18T04:41:22.428 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-18T04:41:22.440 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-18T04:41:22.478 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-18T04:41:22.621 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-tempita. 2024-04-18T04:41:22.635 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-18T04:41:22.680 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-18T04:41:22.781 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-pluggy. 2024-04-18T04:41:22.802 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-18T04:41:22.839 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-18T04:41:22.966 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-paste. 2024-04-18T04:41:22.980 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-18T04:41:23.024 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-18T04:41:23.159 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-py. 2024-04-18T04:41:23.181 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2024-04-18T04:41:23.217 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-18T04:41:23.369 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-18T04:41:23.383 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-18T04:41:23.428 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-18T04:41:23.545 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-18T04:41:23.567 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-18T04:41:23.612 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-18T04:41:23.739 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-18T04:41:23.753 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-18T04:41:23.814 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-18T04:41:23.898 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-toml. 2024-04-18T04:41:23.919 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2024-04-18T04:41:23.948 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-18T04:41:24.201 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-webtest. 2024-04-18T04:41:24.214 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2024-04-18T04:41:24.250 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-18T04:41:24.268 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-pytest. 2024-04-18T04:41:24.289 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-18T04:41:24.326 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-18T04:41:24.554 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pecan. 2024-04-18T04:41:24.568 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-18T04:41:24.622 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-18T04:41:24.671 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-18T04:41:24.692 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-04-18T04:41:24.729 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-18T04:41:25.000 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-certifi. 2024-04-18T04:41:25.014 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2024-04-18T04:41:25.032 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-routes. 2024-04-18T04:41:25.053 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-18T04:41:25.058 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-18T04:41:25.090 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-18T04:41:25.378 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-idna. 2024-04-18T04:41:25.392 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2024-04-18T04:41:25.436 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-18T04:41:25.436 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-18T04:41:25.457 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.2.2-1229-g56a91dd1-1jammy_all.deb ... 2024-04-18T04:41:25.494 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-mgr-dashboard (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:25.740 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-urllib3. 2024-04-18T04:41:25.754 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-18T04:41:25.798 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-18T04:41:26.135 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-requests. 2024-04-18T04:41:26.150 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-18T04:41:26.218 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-18T04:41:26.521 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-18T04:41:26.531 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-18T04:41:26.571 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-18T04:41:26.783 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-18T04:41:26.804 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-18T04:41:26.849 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-18T04:41:26.883 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-18T04:41:26.892 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.2.2-1229-g56a91dd1-1jammy_all.deb ... 2024-04-18T04:41:26.924 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mgr-modules-core (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:27.263 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-18T04:41:27.272 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:41:27.313 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libsqlite3-mod-ceph (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:27.403 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-joblib. 2024-04-18T04:41:27.424 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-18T04:41:27.461 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-18T04:41:27.616 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-openssl. 2024-04-18T04:41:27.625 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2024-04-18T04:41:27.658 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-18T04:41:27.789 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-18T04:41:27.801 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-18T04:41:27.839 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-18T04:41:27.986 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mgr. 2024-04-18T04:41:27.997 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../058-ceph-mgr_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:41:28.061 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mgr (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:28.434 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-sklearn. 2024-04-18T04:41:28.455 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-18T04:41:28.456 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mon. 2024-04-18T04:41:28.466 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../059-ceph-mon_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:41:28.492 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-18T04:41:28.506 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mon (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:29.060 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-osd. 2024-04-18T04:41:29.069 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../060-ceph-osd_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:41:29.101 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-osd (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:29.286 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-18T04:41:29.308 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.2.2-1229-g56a91dd1-1jammy_all.deb ... 2024-04-18T04:41:29.344 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:29.955 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph. 2024-04-18T04:41:29.965 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../061-ceph_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:41:30.005 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:30.291 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-fuse. 2024-04-18T04:41:30.301 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../062-ceph-fuse_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:41:30.341 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-fuse (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:30.372 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-cachetools. 2024-04-18T04:41:30.393 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-04-18T04:41:30.430 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-18T04:41:30.750 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-18T04:41:30.762 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mds. 2024-04-18T04:41:30.771 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-18T04:41:30.772 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../063-ceph-mds_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:41:30.808 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-18T04:41:30.811 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mds (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:31.153 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-18T04:41:31.174 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-18T04:41:31.211 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-18T04:41:31.215 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package cephadm. 2024-04-18T04:41:31.224 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../064-cephadm_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:41:31.265 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking cephadm (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:31.510 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-18T04:41:31.519 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-18T04:41:31.531 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-rsa. 2024-04-18T04:41:31.552 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-04-18T04:41:31.559 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-18T04:41:31.589 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-18T04:41:31.868 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-google-auth. 2024-04-18T04:41:31.871 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-18T04:41:31.880 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-18T04:41:31.889 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-04-18T04:41:31.913 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-18T04:41:31.926 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-18T04:41:32.221 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-18T04:41:32.242 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-18T04:41:32.279 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-18T04:41:32.590 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-websocket. 2024-04-18T04:41:32.611 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-04-18T04:41:32.648 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-18T04:41:32.926 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-babel. 2024-04-18T04:41:32.935 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-18T04:41:32.968 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-18T04:41:32.976 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-18T04:41:32.990 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-18T04:41:33.027 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-18T04:41:33.263 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-jinja2. 2024-04-18T04:41:33.275 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-18T04:41:33.313 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-18T04:41:33.650 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-18T04:41:33.660 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.2.2-1229-g56a91dd1-1jammy_all.deb ... 2024-04-18T04:41:33.691 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mgr-cephadm (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:33.916 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-18T04:41:33.929 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.2.2-1229-g56a91dd1-1jammy_all.deb ... 2024-04-18T04:41:33.957 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-mgr-k8sevents (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:33.995 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-18T04:41:34.005 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-18T04:41:34.037 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-18T04:41:34.211 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-18T04:41:34.232 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-18T04:41:34.277 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-18T04:41:34.524 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pluggy. 2024-04-18T04:41:34.534 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-18T04:41:34.573 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-18T04:41:34.622 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-18T04:41:34.643 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-18T04:41:34.688 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-18T04:41:34.910 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-py. 2024-04-18T04:41:34.920 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2024-04-18T04:41:34.958 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package jq. 2024-04-18T04:41:34.960 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-18T04:41:34.979 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-18T04:41:35.024 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-18T04:41:35.252 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package socat. 2024-04-18T04:41:35.264 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-18T04:41:35.289 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-18T04:41:35.293 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-18T04:41:35.302 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-18T04:41:35.364 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-18T04:41:35.563 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package xmlstarlet. 2024-04-18T04:41:35.576 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-18T04:41:35.613 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-18T04:41:35.667 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-toml. 2024-04-18T04:41:35.679 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2024-04-18T04:41:35.717 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-18T04:41:35.984 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-test. 2024-04-18T04:41:36.007 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../098-ceph-test_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:41:36.029 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pytest. 2024-04-18T04:41:36.040 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-18T04:41:36.050 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-test (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:36.078 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-18T04:41:36.416 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-18T04:41:36.430 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-04-18T04:41:36.474 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-18T04:41:36.786 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-routes. 2024-04-18T04:41:36.797 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-18T04:41:36.835 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-18T04:41:37.198 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-18T04:41:37.209 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.2.2-1229-g56a91dd1-1jammy_all.deb ... 2024-04-18T04:41:37.248 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mgr-dashboard (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:37.988 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-volume. 2024-04-18T04:41:38.010 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../099-ceph-volume_18.2.2-1229-g56a91dd1-1jammy_all.deb ... 2024-04-18T04:41:38.054 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-volume (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:38.420 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-18T04:41:38.430 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-18T04:41:38.451 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-18T04:41:38.469 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-18T04:41:38.472 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../100-cephfs-mirror_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:41:38.517 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking cephfs-mirror (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:38.837 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-colorama. 2024-04-18T04:41:38.859 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2024-04-18T04:41:38.903 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-18T04:41:38.998 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-joblib. 2024-04-18T04:41:39.009 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-18T04:41:39.048 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-18T04:41:39.165 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package cephfs-shell. 2024-04-18T04:41:39.177 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../102-cephfs-shell_18.2.2-1229-g56a91dd1-1jammy_all.deb ... 2024-04-18T04:41:39.214 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking cephfs-shell (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:39.559 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package cephfs-top. 2024-04-18T04:41:39.573 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../103-cephfs-top_18.2.2-1229-g56a91dd1-1jammy_all.deb ... 2024-04-18T04:41:39.594 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-18T04:41:39.608 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-18T04:41:39.608 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking cephfs-top (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:39.652 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-18T04:41:39.878 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-18T04:41:39.890 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../104-libcephfs-dev_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:41:39.928 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libcephfs-dev (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:39.997 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-sklearn. 2024-04-18T04:41:40.010 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-18T04:41:40.047 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-18T04:41:40.281 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package nvme-cli. 2024-04-18T04:41:40.303 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-18T04:41:40.347 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-18T04:41:40.694 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-18T04:41:40.706 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-18T04:41:40.744 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-18T04:41:40.783 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-18T04:41:40.794 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.2.2-1229-g56a91dd1-1jammy_all.deb ... 2024-04-18T04:41:40.833 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:41.189 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-pastescript. 2024-04-18T04:41:41.210 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-04-18T04:41:41.255 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-18T04:41:41.584 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-psutil. 2024-04-18T04:41:41.605 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-18T04:41:41.650 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-18T04:41:41.803 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-cachetools. 2024-04-18T04:41:41.816 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-04-18T04:41:41.853 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-18T04:41:42.003 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-pygments. 2024-04-18T04:41:42.025 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-18T04:41:42.061 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-18T04:41:42.181 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-18T04:41:42.194 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-18T04:41:42.231 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-18T04:41:42.524 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-18T04:41:42.546 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-18T04:41:42.560 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-18T04:41:42.573 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-18T04:41:42.590 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-18T04:41:42.618 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-18T04:41:42.888 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-rsa. 2024-04-18T04:41:42.901 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-04-18T04:41:42.902 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-simplejson. 2024-04-18T04:41:42.924 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-18T04:41:42.938 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-18T04:41:42.968 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-18T04:41:43.237 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-18T04:41:43.259 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-google-auth. 2024-04-18T04:41:43.259 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-18T04:41:43.272 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-04-18T04:41:43.304 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-18T04:41:43.316 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-18T04:41:43.637 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-18T04:41:43.650 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-18T04:41:43.687 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-18T04:41:44.015 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-websocket. 2024-04-18T04:41:44.028 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-04-18T04:41:44.065 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-18T04:41:44.074 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package radosgw. 2024-04-18T04:41:44.096 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../113-radosgw_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:41:44.141 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking radosgw (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:44.335 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-18T04:41:44.348 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-18T04:41:44.402 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-18T04:41:44.894 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package rbd-fuse. 2024-04-18T04:41:44.906 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../114-rbd-fuse_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:41:44.935 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking rbd-fuse (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:45.108 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-18T04:41:45.122 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.2.2-1229-g56a91dd1-1jammy_all.deb ... 2024-04-18T04:41:45.158 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mgr-k8sevents (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:45.220 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-18T04:41:45.394 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-18T04:41:45.406 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-18T04:41:45.444 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-18T04:41:45.482 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-18T04:41:45.624 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-18T04:41:45.814 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-18T04:41:45.827 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-18T04:41:45.864 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-18T04:41:45.891 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-18T04:41:46.125 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package jq. 2024-04-18T04:41:46.138 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-18T04:41:46.210 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-18T04:41:46.222 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-18T04:41:46.436 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package socat. 2024-04-18T04:41:46.449 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-18T04:41:46.478 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-18T04:41:46.699 INFO:teuthology.orchestra.run.smithi132.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-18T04:41:46.804 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package xmlstarlet. 2024-04-18T04:41:46.817 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-18T04:41:46.865 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-18T04:41:46.994 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up cephadm (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:47.211 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-test. 2024-04-18T04:41:47.223 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../098-ceph-test_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:41:47.253 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-test (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:47.518 INFO:teuthology.orchestra.run.smithi132.stdout:Adding system user cephadm....done 2024-04-18T04:41:47.658 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-18T04:41:47.935 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-18T04:41:48.186 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-18T04:41:48.312 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-18T04:41:48.571 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-18T04:41:48.831 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-18T04:41:48.957 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-volume. 2024-04-18T04:41:48.970 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../099-ceph-volume_18.2.2-1229-g56a91dd1-1jammy_all.deb ... 2024-04-18T04:41:48.973 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-18T04:41:49.007 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-volume (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:49.420 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-18T04:41:49.433 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../100-cephfs-mirror_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:41:49.470 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking cephfs-mirror (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:49.551 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-18T04:41:49.910 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-18T04:41:50.008 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-colorama. 2024-04-18T04:41:50.022 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2024-04-18T04:41:50.058 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-18T04:41:50.161 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-18T04:41:50.320 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package cephfs-shell. 2024-04-18T04:41:50.331 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../102-cephfs-shell_18.2.2-1229-g56a91dd1-1jammy_all.deb ... 2024-04-18T04:41:50.369 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking cephfs-shell (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:50.404 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-18T04:41:50.663 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-18T04:41:50.664 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package cephfs-top. 2024-04-18T04:41:50.676 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../103-cephfs-top_18.2.2-1229-g56a91dd1-1jammy_all.deb ... 2024-04-18T04:41:50.714 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking cephfs-top (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:50.914 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-18T04:41:50.959 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-18T04:41:50.972 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../104-libcephfs-dev_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:41:51.009 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libcephfs-dev (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:51.166 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-18T04:41:51.371 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package nvme-cli. 2024-04-18T04:41:51.383 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-18T04:41:51.400 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-ceph-argparse (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:51.412 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-18T04:41:51.660 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-18T04:41:51.701 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-18T04:41:51.713 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-18T04:41:51.787 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-18T04:41:51.811 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-18T04:41:52.062 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-18T04:41:52.137 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pastescript. 2024-04-18T04:41:52.149 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-04-18T04:41:52.178 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-18T04:41:52.299 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-18T04:41:52.422 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-18T04:41:52.507 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-psutil. 2024-04-18T04:41:52.520 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-18T04:41:52.557 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-18T04:41:52.773 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-18T04:41:52.877 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pygments. 2024-04-18T04:41:52.889 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-18T04:41:52.891 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-18T04:41:52.927 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-18T04:41:53.168 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-18T04:41:53.398 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-18T04:41:53.409 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-18T04:41:53.435 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-18T04:41:53.447 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-18T04:41:53.728 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-18T04:41:53.768 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-simplejson. 2024-04-18T04:41:53.780 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-18T04:41:53.809 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-18T04:41:54.079 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-18T04:41:54.090 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-18T04:41:54.130 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-18T04:41:54.397 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-18T04:41:54.648 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-18T04:41:54.774 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-18T04:41:54.833 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package radosgw. 2024-04-18T04:41:54.844 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../113-radosgw_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:41:54.882 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking radosgw (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:54.891 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-18T04:41:55.201 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-18T04:41:55.594 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-18T04:41:55.594 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package rbd-fuse. 2024-04-18T04:41:55.608 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../114-rbd-fuse_18.2.2-1229-g56a91dd1-1jammy_amd64.deb ... 2024-04-18T04:41:55.644 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking rbd-fuse (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:55.828 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-18T04:41:55.928 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-18T04:41:56.196 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-18T04:41:56.225 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-18T04:41:56.359 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-18T04:41:56.481 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-18T04:41:56.618 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-18T04:41:56.774 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-18T04:41:57.015 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-18T04:41:57.125 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-18T04:41:57.377 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-18T04:41:57.503 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-ceph-common (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:57.641 INFO:teuthology.orchestra.run.smithi120.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-18T04:41:57.685 INFO:teuthology.orchestra.run.smithi120.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-04-18T04:41:57.727 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up cephadm (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:41:57.795 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-idna (3.3-1) ... 2024-04-18T04:41:58.121 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-18T04:41:58.247 INFO:teuthology.orchestra.run.smithi120.stdout:Adding system user cephadm....done 2024-04-18T04:41:58.402 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-18T04:41:58.711 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-18T04:41:58.962 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-18T04:41:59.122 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-18T04:41:59.329 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T04:41:59.381 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-18T04:41:59.464 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-18T04:41:59.641 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-18T04:41:59.776 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-18T04:41:59.875 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-18T04:42:00.024 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-18T04:42:00.086 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-18T04:42:00.150 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-18T04:42:00.454 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-18T04:42:00.468 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-18T04:42:00.706 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-18T04:42:00.736 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-18T04:42:00.974 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-18T04:42:01.012 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T04:42:01.138 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-04-18T04:42:01.258 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-18T04:42:01.264 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-18T04:42:01.526 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-18T04:42:01.565 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-18T04:42:01.803 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-18T04:42:01.808 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-18T04:42:02.059 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-18T04:42:02.062 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-ceph-argparse (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:02.310 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-18T04:42:02.363 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-18T04:42:02.490 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-18T04:42:02.553 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-18T04:42:02.757 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-18T04:42:02.829 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-18T04:42:02.955 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-18T04:42:03.017 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-18T04:42:03.143 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-18T04:42:03.223 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-18T04:42:03.349 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-18T04:42:03.502 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-18T04:42:03.612 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-18T04:42:03.642 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-18T04:42:03.872 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-18T04:42:03.959 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-18T04:42:04.173 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-18T04:42:04.211 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-18T04:42:04.474 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-18T04:42:04.647 INFO:teuthology.orchestra.run.smithi132.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-18T04:42:04.897 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-18T04:42:05.023 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-18T04:42:05.185 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-18T04:42:05.408 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-18T04:42:05.453 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-18T04:42:05.578 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-18T04:42:05.667 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-18T04:42:05.705 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-18T04:42:05.910 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T04:42:06.036 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-18T04:42:06.056 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-18T04:42:06.354 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-18T04:42:06.457 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-18T04:42:06.655 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-18T04:42:06.709 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-18T04:42:06.940 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-18T04:42:07.066 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-18T04:42:07.102 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-18T04:42:07.342 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-18T04:42:07.395 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-18T04:42:07.626 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-18T04:42:07.696 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-18T04:42:07.886 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-18T04:42:08.031 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-18T04:42:08.271 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-18T04:42:08.299 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-18T04:42:08.433 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-ceph-common (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:08.564 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-18T04:42:08.735 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-idna (3.3-1) ... 2024-04-18T04:42:08.958 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-18T04:42:09.083 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up librados2 (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:09.127 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-18T04:42:09.201 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up librgw2 (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:09.404 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libsqlite3-mod-ceph (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:09.530 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libcephfs2 (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:09.656 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libradosstriper1 (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:09.782 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-18T04:42:10.058 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up librbd1 (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:10.184 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-mgr-modules-core (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:10.334 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T04:42:10.336 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-fuse (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:10.550 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-18T04:42:10.550 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-18T04:42:10.744 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-18T04:42:11.011 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-18T04:42:11.079 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libcephfs-dev (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:11.112 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-18T04:42:11.205 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-rados (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:11.222 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-18T04:42:11.331 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up cephfs-top (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:11.448 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-18T04:42:11.548 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-18T04:42:11.800 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-18T04:42:12.109 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T04:42:12.235 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-04-18T04:42:12.361 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-18T04:42:12.661 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-rbd (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:12.671 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-18T04:42:12.787 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up rbd-fuse (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:12.913 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-rgw (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:12.931 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-18T04:42:13.039 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-cephfs (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:13.165 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up cephfs-shell (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:13.199 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-18T04:42:13.291 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-common (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:13.459 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-18T04:42:13.718 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-18T04:42:13.800 INFO:teuthology.orchestra.run.smithi132.stdout:Adding group ceph....done 2024-04-18T04:42:14.019 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-18T04:42:14.137 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-18T04:42:14.186 INFO:teuthology.orchestra.run.smithi132.stdout:Adding system user ceph....done 2024-04-18T04:42:14.354 INFO:teuthology.orchestra.run.smithi132.stdout:Setting system user ceph properties....done 2024-04-18T04:42:14.371 INFO:teuthology.orchestra.run.smithi132.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-18T04:42:14.413 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-18T04:42:14.510 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-18T04:42:14.539 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-18T04:42:14.824 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-18T04:42:14.843 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-18T04:42:15.142 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-18T04:42:15.376 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up cephfs-mirror (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:15.401 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-18T04:42:15.580 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-18T04:42:15.580 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-18T04:42:15.814 INFO:teuthology.orchestra.run.smithi120.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-18T04:42:16.088 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-18T04:42:16.094 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-test (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:16.220 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up radosgw (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:16.230 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-18T04:42:16.624 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-18T04:42:16.702 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-18T04:42:16.702 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-18T04:42:16.900 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-18T04:42:17.160 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-18T04:42:17.197 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-base (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:17.286 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-18T04:42:17.534 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-18T04:42:17.612 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-18T04:42:17.896 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-18T04:42:18.065 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-mds (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:18.181 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-18T04:42:18.290 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-18T04:42:18.293 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-18T04:42:18.293 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-18T04:42:18.550 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-18T04:42:18.800 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-mgr (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:18.868 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-18T04:42:19.016 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-18T04:42:19.016 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-18T04:42:19.144 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-18T04:42:19.511 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-osd (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:19.512 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-18T04:42:19.806 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-18T04:42:19.840 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-18T04:42:19.840 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-18T04:42:20.183 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-18T04:42:20.309 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up librados2 (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:20.435 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up librgw2 (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:20.663 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libsqlite3-mod-ceph (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:20.683 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-mgr-k8sevents (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:20.781 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libcephfs2 (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:20.907 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libradosstriper1 (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:21.025 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-18T04:42:21.107 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-mgr-diskprediction-local (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:21.266 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-mon (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:21.352 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up librbd1 (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:21.454 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mgr-modules-core (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:21.480 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-18T04:42:21.480 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-18T04:42:21.554 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-fuse (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:21.764 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-18T04:42:21.764 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-18T04:42:22.042 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-mgr-cephadm (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:22.214 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:22.336 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-mgr-dashboard (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:22.406 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libcephfs-dev (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:22.487 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-volume (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:22.507 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-rados (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:22.617 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up cephfs-top (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:22.743 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-18T04:42:22.849 INFO:teuthology.orchestra.run.smithi132.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-18T04:42:23.917 INFO:teuthology.orchestra.run.smithi132.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-18T04:42:24.014 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-rbd (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:24.149 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up rbd-fuse (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:24.258 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-rgw (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:24.385 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-cephfs (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:24.395 INFO:teuthology.orchestra.run.smithi132.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-18T04:42:24.398 DEBUG:teuthology.orchestra.run.smithi132:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-18T04:42:24.452 INFO:teuthology.orchestra.run.smithi132.stdout:Reading package lists... 2024-04-18T04:42:24.511 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up cephfs-shell (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:24.637 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-common (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:24.652 INFO:teuthology.orchestra.run.smithi132.stdout:Building dependency tree... 2024-04-18T04:42:24.653 INFO:teuthology.orchestra.run.smithi132.stdout:Reading state information... 2024-04-18T04:42:24.834 INFO:teuthology.orchestra.run.smithi132.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-18T04:42:24.834 INFO:teuthology.orchestra.run.smithi132.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-18T04:42:24.834 INFO:teuthology.orchestra.run.smithi132.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-18T04:42:24.834 INFO:teuthology.orchestra.run.smithi132.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T04:42:24.834 INFO:teuthology.orchestra.run.smithi132.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T04:42:24.834 INFO:teuthology.orchestra.run.smithi132.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T04:42:24.835 INFO:teuthology.orchestra.run.smithi132.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T04:42:24.835 INFO:teuthology.orchestra.run.smithi132.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-18T04:42:24.836 INFO:teuthology.orchestra.run.smithi132.stdout: python2.7-minimal 2024-04-18T04:42:24.836 INFO:teuthology.orchestra.run.smithi132.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T04:42:24.836 INFO:teuthology.orchestra.run.smithi132.stdout:The following additional packages will be installed: 2024-04-18T04:42:24.836 INFO:teuthology.orchestra.run.smithi132.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-18T04:42:24.836 INFO:teuthology.orchestra.run.smithi132.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-18T04:42:24.836 INFO:teuthology.orchestra.run.smithi132.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-18T04:42:24.837 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-18T04:42:24.837 INFO:teuthology.orchestra.run.smithi132.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-18T04:42:24.837 INFO:teuthology.orchestra.run.smithi132.stdout:Suggested packages: 2024-04-18T04:42:24.837 INFO:teuthology.orchestra.run.smithi132.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-18T04:42:24.837 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-18T04:42:24.837 INFO:teuthology.orchestra.run.smithi132.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-18T04:42:24.877 INFO:teuthology.orchestra.run.smithi132.stdout:The following NEW packages will be installed: 2024-04-18T04:42:24.877 INFO:teuthology.orchestra.run.smithi132.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-18T04:42:24.877 INFO:teuthology.orchestra.run.smithi132.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-18T04:42:24.878 INFO:teuthology.orchestra.run.smithi132.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-18T04:42:24.878 INFO:teuthology.orchestra.run.smithi132.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-18T04:42:24.878 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-18T04:42:24.878 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-18T04:42:24.879 INFO:teuthology.orchestra.run.smithi132.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-18T04:42:24.879 INFO:teuthology.orchestra.run.smithi132.stdout:The following packages will be upgraded: 2024-04-18T04:42:24.879 INFO:teuthology.orchestra.run.smithi132.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-18T04:42:25.082 INFO:teuthology.orchestra.run.smithi132.stdout:4 upgraded, 39 newly installed, 0 to remove and 301 not upgraded. 2024-04-18T04:42:25.083 INFO:teuthology.orchestra.run.smithi132.stdout:Need to get 55.7 MB of archives. 2024-04-18T04:42:25.083 INFO:teuthology.orchestra.run.smithi132.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-18T04:42:25.083 INFO:teuthology.orchestra.run.smithi132.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-18T04:42:25.207 INFO:teuthology.orchestra.run.smithi120.stdout:Adding group ceph....done 2024-04-18T04:42:25.625 INFO:teuthology.orchestra.run.smithi120.stdout:Adding system user ceph....done 2024-04-18T04:42:25.711 INFO:teuthology.orchestra.run.smithi132.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-18T04:42:25.732 INFO:teuthology.orchestra.run.smithi132.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-18T04:42:25.794 INFO:teuthology.orchestra.run.smithi120.stdout:Setting system user ceph properties....done 2024-04-18T04:42:25.813 INFO:teuthology.orchestra.run.smithi120.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-18T04:42:25.857 INFO:teuthology.orchestra.run.smithi132.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-18T04:42:25.859 INFO:teuthology.orchestra.run.smithi132.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-18T04:42:25.860 INFO:teuthology.orchestra.run.smithi132.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-18T04:42:25.889 INFO:teuthology.orchestra.run.smithi132.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-18T04:42:25.890 INFO:teuthology.orchestra.run.smithi132.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-18T04:42:25.894 INFO:teuthology.orchestra.run.smithi132.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-18T04:42:25.896 INFO:teuthology.orchestra.run.smithi132.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-18T04:42:25.897 INFO:teuthology.orchestra.run.smithi132.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-18T04:42:25.956 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-18T04:42:26.065 INFO:teuthology.orchestra.run.smithi132.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-18T04:42:26.350 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-18T04:42:26.360 INFO:teuthology.orchestra.run.smithi132.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-18T04:42:26.370 INFO:teuthology.orchestra.run.smithi132.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-18T04:42:26.375 INFO:teuthology.orchestra.run.smithi132.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-18T04:42:26.460 INFO:teuthology.orchestra.run.smithi132.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-18T04:42:27.139 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up cephfs-mirror (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:27.366 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-18T04:42:27.366 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-18T04:42:27.641 INFO:teuthology.orchestra.run.smithi132.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-18T04:42:27.646 INFO:teuthology.orchestra.run.smithi132.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-18T04:42:27.646 INFO:teuthology.orchestra.run.smithi132.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-18T04:42:27.653 INFO:teuthology.orchestra.run.smithi132.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-18T04:42:27.654 INFO:teuthology.orchestra.run.smithi132.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-18T04:42:27.664 INFO:teuthology.orchestra.run.smithi132.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-18T04:42:27.832 INFO:teuthology.orchestra.run.smithi132.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-18T04:42:27.999 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-test (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:28.108 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up radosgw (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:28.470 INFO:teuthology.orchestra.run.smithi132.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-18T04:42:28.471 INFO:teuthology.orchestra.run.smithi132.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-18T04:42:28.638 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-18T04:42:28.639 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-18T04:42:28.656 INFO:teuthology.orchestra.run.smithi132.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-18T04:42:28.657 INFO:teuthology.orchestra.run.smithi132.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-18T04:42:28.697 INFO:teuthology.orchestra.run.smithi132.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-18T04:42:28.771 INFO:teuthology.orchestra.run.smithi132.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-18T04:42:28.778 INFO:teuthology.orchestra.run.smithi132.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-18T04:42:28.779 INFO:teuthology.orchestra.run.smithi132.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-18T04:42:28.780 INFO:teuthology.orchestra.run.smithi132.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-18T04:42:28.781 INFO:teuthology.orchestra.run.smithi132.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-18T04:42:28.971 INFO:teuthology.orchestra.run.smithi132.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-18T04:42:29.269 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-base (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:29.382 INFO:teuthology.orchestra.run.smithi132.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-18T04:42:29.596 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-18T04:42:30.178 INFO:teuthology.orchestra.run.smithi132.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-18T04:42:30.178 INFO:teuthology.orchestra.run.smithi132.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-18T04:42:30.224 INFO:teuthology.orchestra.run.smithi132.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-18T04:42:30.224 INFO:teuthology.orchestra.run.smithi132.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-18T04:42:30.225 INFO:teuthology.orchestra.run.smithi132.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-18T04:42:30.225 INFO:teuthology.orchestra.run.smithi132.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-18T04:42:30.252 INFO:teuthology.orchestra.run.smithi132.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-18T04:42:30.253 INFO:teuthology.orchestra.run.smithi132.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-18T04:42:30.278 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mds (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:30.509 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-18T04:42:30.509 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-18T04:42:30.658 INFO:teuthology.orchestra.run.smithi132.stdout:Preconfiguring packages ... 2024-04-18T04:42:30.808 INFO:teuthology.orchestra.run.smithi132.stdout:Fetched 55.7 MB in 5s (10.4 MB/s) 2024-04-18T04:42:31.293 INFO:teuthology.orchestra.run.smithi132.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137745 files and directories currently installed.) 2024-04-18T04:42:31.298 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-18T04:42:31.442 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-18T04:42:31.528 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mgr (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:31.795 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-18T04:42:31.796 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-18T04:42:32.110 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-18T04:42:32.519 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-osd (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:32.838 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-18T04:42:32.839 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-18T04:42:33.045 INFO:teuthology.orchestra.run.smithi132.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-18T04:42:33.315 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package flex. 2024-04-18T04:42:33.401 INFO:teuthology.orchestra.run.smithi132.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137745 files and directories currently installed.) 2024-04-18T04:42:33.405 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-18T04:42:33.454 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-18T04:42:33.480 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mgr-k8sevents (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:33.580 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mgr-diskprediction-local (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:33.715 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mon (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:33.933 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-18T04:42:33.933 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-18T04:42:34.006 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-18T04:42:34.178 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-18T04:42:34.567 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mgr-cephadm (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:34.600 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-18T04:42:34.735 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:34.844 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mgr-dashboard (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:34.970 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-volume (18.2.2-1229-g56a91dd1-1jammy) ... 2024-04-18T04:42:35.158 INFO:teuthology.orchestra.run.smithi132.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137818 files and directories currently installed.) 2024-04-18T04:42:35.163 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-18T04:42:35.268 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-18T04:42:35.323 INFO:teuthology.orchestra.run.smithi120.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-18T04:42:35.670 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-18T04:42:35.799 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-18T04:42:36.139 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-18T04:42:36.458 INFO:teuthology.orchestra.run.smithi120.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-18T04:42:36.576 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package bison. 2024-04-18T04:42:36.664 INFO:teuthology.orchestra.run.smithi132.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137818 files and directories currently installed.) 2024-04-18T04:42:36.669 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-18T04:42:36.706 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-18T04:42:37.079 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-18T04:42:37.101 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-18T04:42:37.137 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-18T04:42:37.184 INFO:teuthology.orchestra.run.smithi120.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-18T04:42:37.188 DEBUG:teuthology.orchestra.run.smithi120:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-18T04:42:37.262 INFO:teuthology.orchestra.run.smithi120.stdout:Reading package lists... 2024-04-18T04:42:37.435 INFO:teuthology.orchestra.run.smithi120.stdout:Building dependency tree... 2024-04-18T04:42:37.436 INFO:teuthology.orchestra.run.smithi120.stdout:Reading state information... 2024-04-18T04:42:37.473 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package dump. 2024-04-18T04:42:37.495 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-18T04:42:37.540 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking dump (0.4b47-3) ... 2024-04-18T04:42:37.609 INFO:teuthology.orchestra.run.smithi120.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-18T04:42:37.609 INFO:teuthology.orchestra.run.smithi120.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-18T04:42:37.609 INFO:teuthology.orchestra.run.smithi120.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-18T04:42:37.610 INFO:teuthology.orchestra.run.smithi120.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T04:42:37.610 INFO:teuthology.orchestra.run.smithi120.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T04:42:37.610 INFO:teuthology.orchestra.run.smithi120.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T04:42:37.610 INFO:teuthology.orchestra.run.smithi120.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T04:42:37.611 INFO:teuthology.orchestra.run.smithi120.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-18T04:42:37.611 INFO:teuthology.orchestra.run.smithi120.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-18T04:42:37.611 INFO:teuthology.orchestra.run.smithi120.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T04:42:37.611 INFO:teuthology.orchestra.run.smithi120.stdout:The following additional packages will be installed: 2024-04-18T04:42:37.611 INFO:teuthology.orchestra.run.smithi120.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-18T04:42:37.611 INFO:teuthology.orchestra.run.smithi120.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-18T04:42:37.612 INFO:teuthology.orchestra.run.smithi120.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-18T04:42:37.612 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-18T04:42:37.612 INFO:teuthology.orchestra.run.smithi120.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-18T04:42:37.613 INFO:teuthology.orchestra.run.smithi120.stdout:Suggested packages: 2024-04-18T04:42:37.613 INFO:teuthology.orchestra.run.smithi120.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-18T04:42:37.613 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-18T04:42:37.613 INFO:teuthology.orchestra.run.smithi120.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-18T04:42:37.667 INFO:teuthology.orchestra.run.smithi120.stdout:The following NEW packages will be installed: 2024-04-18T04:42:37.667 INFO:teuthology.orchestra.run.smithi120.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-18T04:42:37.668 INFO:teuthology.orchestra.run.smithi120.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-18T04:42:37.668 INFO:teuthology.orchestra.run.smithi120.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-18T04:42:37.668 INFO:teuthology.orchestra.run.smithi120.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-18T04:42:37.668 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-18T04:42:37.668 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-18T04:42:37.668 INFO:teuthology.orchestra.run.smithi120.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-18T04:42:37.669 INFO:teuthology.orchestra.run.smithi120.stdout:The following packages will be upgraded: 2024-04-18T04:42:37.670 INFO:teuthology.orchestra.run.smithi120.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-18T04:42:37.855 INFO:teuthology.orchestra.run.smithi120.stdout:4 upgraded, 39 newly installed, 0 to remove and 301 not upgraded. 2024-04-18T04:42:37.855 INFO:teuthology.orchestra.run.smithi120.stdout:Need to get 55.7 MB of archives. 2024-04-18T04:42:37.855 INFO:teuthology.orchestra.run.smithi120.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-18T04:42:37.855 INFO:teuthology.orchestra.run.smithi120.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-18T04:42:37.902 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package indent. 2024-04-18T04:42:37.915 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-18T04:42:37.952 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-18T04:42:38.189 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-18T04:42:38.200 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-18T04:42:38.229 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-18T04:42:38.498 INFO:teuthology.orchestra.run.smithi120.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-18T04:42:38.514 INFO:teuthology.orchestra.run.smithi120.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-18T04:42:38.542 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-18T04:42:38.563 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-18T04:42:38.608 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-18T04:42:38.640 INFO:teuthology.orchestra.run.smithi120.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-18T04:42:38.641 INFO:teuthology.orchestra.run.smithi120.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-18T04:42:38.642 INFO:teuthology.orchestra.run.smithi120.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-18T04:42:38.671 INFO:teuthology.orchestra.run.smithi120.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-18T04:42:38.671 INFO:teuthology.orchestra.run.smithi120.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-18T04:42:38.675 INFO:teuthology.orchestra.run.smithi120.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-18T04:42:38.677 INFO:teuthology.orchestra.run.smithi120.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-18T04:42:38.678 INFO:teuthology.orchestra.run.smithi120.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-18T04:42:38.844 INFO:teuthology.orchestra.run.smithi120.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-18T04:42:38.878 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-18T04:42:38.900 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-18T04:42:38.945 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-18T04:42:39.138 INFO:teuthology.orchestra.run.smithi120.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-18T04:42:39.147 INFO:teuthology.orchestra.run.smithi120.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-18T04:42:39.152 INFO:teuthology.orchestra.run.smithi120.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-18T04:42:39.236 INFO:teuthology.orchestra.run.smithi120.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-18T04:42:39.248 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-18T04:42:39.270 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-18T04:42:39.306 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-18T04:42:39.525 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-18T04:42:39.547 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-18T04:42:39.592 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-18T04:42:39.886 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libjson-perl. 2024-04-18T04:42:39.900 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-18T04:42:39.937 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-18T04:42:40.201 INFO:teuthology.orchestra.run.smithi120.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-18T04:42:40.229 INFO:teuthology.orchestra.run.smithi120.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-18T04:42:40.229 INFO:teuthology.orchestra.run.smithi120.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-18T04:42:40.232 INFO:teuthology.orchestra.run.smithi120.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-18T04:42:40.233 INFO:teuthology.orchestra.run.smithi120.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-18T04:42:40.237 INFO:teuthology.orchestra.run.smithi120.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-18T04:42:40.239 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-18T04:42:40.262 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-18T04:42:40.306 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-18T04:42:40.403 INFO:teuthology.orchestra.run.smithi120.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-18T04:42:41.008 INFO:teuthology.orchestra.run.smithi120.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-18T04:42:41.009 INFO:teuthology.orchestra.run.smithi120.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-18T04:42:41.189 INFO:teuthology.orchestra.run.smithi120.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-18T04:42:41.189 INFO:teuthology.orchestra.run.smithi120.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-18T04:42:41.228 INFO:teuthology.orchestra.run.smithi120.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-18T04:42:41.287 INFO:teuthology.orchestra.run.smithi120.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-18T04:42:41.292 INFO:teuthology.orchestra.run.smithi120.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-18T04:42:41.293 INFO:teuthology.orchestra.run.smithi120.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-18T04:42:41.294 INFO:teuthology.orchestra.run.smithi120.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-18T04:42:41.294 INFO:teuthology.orchestra.run.smithi120.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-18T04:42:41.501 INFO:teuthology.orchestra.run.smithi120.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-18T04:42:41.925 INFO:teuthology.orchestra.run.smithi120.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-18T04:42:42.135 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-18T04:42:42.157 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-18T04:42:42.210 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-18T04:42:42.471 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-18T04:42:42.483 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-18T04:42:42.521 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-18T04:42:42.674 INFO:teuthology.orchestra.run.smithi120.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-18T04:42:42.674 INFO:teuthology.orchestra.run.smithi120.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-18T04:42:42.674 INFO:teuthology.orchestra.run.smithi120.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-18T04:42:42.674 INFO:teuthology.orchestra.run.smithi120.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-18T04:42:42.674 INFO:teuthology.orchestra.run.smithi120.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-18T04:42:42.675 INFO:teuthology.orchestra.run.smithi120.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-18T04:42:42.708 INFO:teuthology.orchestra.run.smithi120.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-18T04:42:42.708 INFO:teuthology.orchestra.run.smithi120.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-18T04:42:42.841 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-18T04:42:42.862 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-18T04:42:42.907 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-18T04:42:43.086 INFO:teuthology.orchestra.run.smithi120.stdout:Preconfiguring packages ... 2024-04-18T04:42:43.260 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-18T04:42:43.260 INFO:teuthology.orchestra.run.smithi120.stdout:Fetched 55.7 MB in 5s (11.1 MB/s) 2024-04-18T04:42:43.281 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-18T04:42:43.326 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-18T04:42:43.491 INFO:teuthology.orchestra.run.smithi120.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140163 files and directories currently installed.) 2024-04-18T04:42:43.494 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-18T04:42:43.628 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-18T04:42:43.654 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-18T04:42:43.676 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-18T04:42:43.721 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-18T04:42:44.082 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-18T04:42:44.103 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-18T04:42:44.140 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-18T04:42:44.244 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-18T04:42:44.527 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-18T04:42:44.548 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-18T04:42:44.602 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-18T04:42:44.904 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-18T04:42:44.917 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-18T04:42:44.954 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-18T04:42:45.207 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-18T04:42:45.219 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-18T04:42:45.257 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-18T04:42:45.379 INFO:teuthology.orchestra.run.smithi120.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-18T04:42:45.668 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package flex. 2024-04-18T04:42:45.737 INFO:teuthology.orchestra.run.smithi120.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140163 files and directories currently installed.) 2024-04-18T04:42:45.740 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-18T04:42:45.752 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-18T04:42:45.774 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-18T04:42:45.800 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-18T04:42:45.819 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-18T04:42:46.164 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package modemmanager. 2024-04-18T04:42:46.185 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-18T04:42:46.230 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-18T04:42:46.336 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-18T04:42:46.481 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-18T04:42:46.894 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-18T04:42:47.230 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package network-manager. 2024-04-18T04:42:47.252 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-18T04:42:47.338 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-18T04:42:47.417 INFO:teuthology.orchestra.run.smithi120.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140236 files and directories currently installed.) 2024-04-18T04:42:47.421 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-18T04:42:47.547 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-18T04:42:47.953 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-18T04:42:47.980 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ppp. 2024-04-18T04:42:48.001 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-18T04:42:48.189 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-18T04:42:48.299 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-18T04:42:48.469 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-18T04:42:48.659 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package pptp-linux. 2024-04-18T04:42:48.681 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-18T04:42:48.734 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-18T04:42:48.823 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package bison. 2024-04-18T04:42:48.897 INFO:teuthology.orchestra.run.smithi120.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140236 files and directories currently installed.) 2024-04-18T04:42:48.900 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-18T04:42:48.942 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-18T04:42:49.047 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-18T04:42:49.069 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-18T04:42:49.122 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-18T04:42:49.351 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-18T04:42:49.365 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-18T04:42:49.400 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-18T04:42:49.492 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-18T04:42:49.514 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-18T04:42:49.567 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking postgresql-client-common (238) ... 2024-04-18T04:42:49.712 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package dump. 2024-04-18T04:42:49.726 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-18T04:42:49.770 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking dump (0.4b47-3) ... 2024-04-18T04:42:49.937 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-18T04:42:49.959 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-18T04:42:50.012 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-18T04:42:50.082 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package indent. 2024-04-18T04:42:50.096 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-18T04:42:50.140 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-18T04:42:50.427 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-18T04:42:50.441 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-18T04:42:50.501 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-18T04:42:50.567 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package postgresql-common. 2024-04-18T04:42:50.589 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-18T04:42:50.651 INFO:teuthology.orchestra.run.smithi132.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-18T04:42:50.681 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking postgresql-common (238) ... 2024-04-18T04:42:50.805 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-18T04:42:50.822 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-18T04:42:50.863 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-18T04:42:51.141 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package postgresql-14. 2024-04-18T04:42:51.163 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-18T04:42:51.182 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-18T04:42:51.196 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-18T04:42:51.210 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-18T04:42:51.241 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-18T04:42:51.578 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-18T04:42:51.592 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-18T04:42:51.661 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-18T04:42:51.913 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-18T04:42:51.927 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-18T04:42:51.972 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-18T04:42:52.208 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libjson-perl. 2024-04-18T04:42:52.221 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-18T04:42:52.282 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-18T04:42:52.552 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-18T04:42:52.566 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-18T04:42:52.602 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-18T04:42:53.203 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package postgresql. 2024-04-18T04:42:53.226 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-18T04:42:53.269 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking postgresql (14+238) ... 2024-04-18T04:42:53.547 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package postgresql-client. 2024-04-18T04:42:53.569 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-18T04:42:53.613 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking postgresql-client (14+238) ... 2024-04-18T04:42:53.865 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-18T04:42:53.887 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-18T04:42:53.932 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-18T04:42:54.005 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-18T04:42:54.021 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-18T04:42:54.063 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-18T04:42:54.251 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package tcl8.6. 2024-04-18T04:42:54.273 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-18T04:42:54.318 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-18T04:42:54.341 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-18T04:42:54.356 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-18T04:42:54.399 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-18T04:42:54.587 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package tcl. 2024-04-18T04:42:54.609 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-18T04:42:54.659 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-18T04:42:54.710 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-18T04:42:54.725 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-18T04:42:54.793 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-18T04:42:55.024 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package wpasupplicant. 2024-04-18T04:42:55.045 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-18T04:42:55.063 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-18T04:42:55.078 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-18T04:42:55.090 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-18T04:42:55.121 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-18T04:42:55.453 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-18T04:42:55.465 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-18T04:42:55.474 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-18T04:42:55.490 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-18T04:42:55.503 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-18T04:42:55.532 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-18T04:42:55.877 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-18T04:42:55.889 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-18T04:42:55.893 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-18T04:42:55.911 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-18T04:42:55.935 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-18T04:42:55.963 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-18T04:42:56.229 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-18T04:42:56.245 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-18T04:42:56.265 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up postgresql-client-common (238) ... 2024-04-18T04:42:56.279 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-18T04:42:56.478 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-18T04:42:56.557 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-18T04:42:56.572 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-18T04:42:56.613 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-18T04:42:56.632 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-18T04:42:56.739 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-18T04:42:56.857 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-18T04:42:56.859 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-18T04:42:56.874 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-18T04:42:56.917 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-18T04:42:56.974 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-18T04:42:57.100 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-18T04:42:57.480 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-18T04:42:57.495 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-18T04:42:57.538 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-18T04:42:57.642 INFO:teuthology.orchestra.run.smithi132.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-18T04:42:57.740 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-18T04:42:57.916 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package modemmanager. 2024-04-18T04:42:57.931 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-18T04:42:57.974 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-18T04:42:58.124 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-18T04:42:58.124 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-18T04:42:58.614 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package network-manager. 2024-04-18T04:42:58.630 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-18T04:42:58.680 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-18T04:42:58.709 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-18T04:42:58.835 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-18T04:42:58.945 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-18T04:42:59.062 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-18T04:42:59.188 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-18T04:42:59.221 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ppp. 2024-04-18T04:42:59.236 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-18T04:42:59.314 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-18T04:42:59.440 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-18T04:42:59.566 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-18T04:42:59.585 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-18T04:42:59.942 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package pptp-linux. 2024-04-18T04:42:59.956 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-18T04:43:00.000 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-18T04:43:00.288 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-18T04:43:00.303 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-18T04:43:00.317 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-18T04:43:00.370 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-18T04:43:00.414 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up dump (0.4b47-3) ... 2024-04-18T04:43:00.508 INFO:teuthology.orchestra.run.smithi132.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-18T04:43:00.574 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-18T04:43:00.703 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-18T04:43:00.740 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-18T04:43:00.754 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-18T04:43:00.806 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking postgresql-client-common (238) ... 2024-04-18T04:43:00.826 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-18T04:43:00.952 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-18T04:43:01.078 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-18T04:43:01.151 INFO:teuthology.orchestra.run.smithi132.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-18T04:43:01.202 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-18T04:43:01.217 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-18T04:43:01.221 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-18T04:43:01.268 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-18T04:43:01.347 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-18T04:43:01.523 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-18T04:43:01.649 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-18T04:43:01.775 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-18T04:43:01.881 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package postgresql-common. 2024-04-18T04:43:01.896 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-18T04:43:01.943 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up postgresql-client (14+238) ... 2024-04-18T04:43:01.957 INFO:teuthology.orchestra.run.smithi120.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-18T04:43:01.988 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking postgresql-common (238) ... 2024-04-18T04:43:02.069 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-18T04:43:02.421 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package postgresql-14. 2024-04-18T04:43:02.436 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-18T04:43:02.474 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-18T04:43:02.589 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T04:43:02.589 INFO:teuthology.orchestra.run.smithi132.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-18T04:43:02.590 INFO:teuthology.orchestra.run.smithi132.stdout:which means they are currently configured by ifupdown: 2024-04-18T04:43:02.590 INFO:teuthology.orchestra.run.smithi132.stdout:- enp3s0f1 2024-04-18T04:43:02.590 INFO:teuthology.orchestra.run.smithi132.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-18T04:43:02.590 INFO:teuthology.orchestra.run.smithi132.stdout:remove their configuration from /etc/network/interfaces. 2024-04-18T04:43:02.590 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T04:43:02.709 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-18T04:43:03.038 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-18T04:43:03.376 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-18T04:43:03.590 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package postgresql. 2024-04-18T04:43:03.605 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-18T04:43:03.649 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking postgresql (14+238) ... 2024-04-18T04:43:03.875 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package postgresql-client. 2024-04-18T04:43:03.890 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-18T04:43:03.947 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-18T04:43:03.959 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking postgresql-client (14+238) ... 2024-04-18T04:43:04.090 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-18T04:43:04.203 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-18T04:43:04.216 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-18T04:43:04.217 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-18T04:43:04.261 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-18T04:43:04.342 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up postgresql-common (238) ... 2024-04-18T04:43:04.564 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package tcl8.6. 2024-04-18T04:43:04.578 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-18T04:43:04.613 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-18T04:43:04.891 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package tcl. 2024-04-18T04:43:04.906 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-18T04:43:04.953 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-18T04:43:05.274 INFO:teuthology.orchestra.run.smithi132.stdout:Adding user postgres to group ssl-cert 2024-04-18T04:43:05.318 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package wpasupplicant. 2024-04-18T04:43:05.334 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-18T04:43:05.376 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-18T04:43:05.459 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T04:43:05.459 INFO:teuthology.orchestra.run.smithi132.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-18T04:43:05.651 INFO:teuthology.orchestra.run.smithi132.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-18T04:43:05.652 INFO:teuthology.orchestra.run.smithi132.stdout:Removing obsolete dictionary files: 2024-04-18T04:43:05.689 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-18T04:43:05.705 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-18T04:43:05.756 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-18T04:43:06.075 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-18T04:43:06.091 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-18T04:43:06.142 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-18T04:43:06.275 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-18T04:43:06.451 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up postgresql-client-common (238) ... 2024-04-18T04:43:06.631 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-18T04:43:06.710 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-18T04:43:06.749 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-18T04:43:06.875 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-18T04:43:07.034 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-18T04:43:07.035 INFO:teuthology.orchestra.run.smithi132.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-18T04:43:07.055 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-18T04:43:07.104 INFO:teuthology.orchestra.run.smithi132.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-18T04:43:07.105 INFO:teuthology.orchestra.run.smithi132.stdout:This user must also own the server process. 2024-04-18T04:43:07.105 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T04:43:07.105 INFO:teuthology.orchestra.run.smithi132.stdout:The database cluster will be initialized with locale "en_US". 2024-04-18T04:43:07.105 INFO:teuthology.orchestra.run.smithi132.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-18T04:43:07.105 INFO:teuthology.orchestra.run.smithi132.stdout:The default text search configuration will be set to "english". 2024-04-18T04:43:07.105 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T04:43:07.105 INFO:teuthology.orchestra.run.smithi132.stdout:Data page checksums are disabled. 2024-04-18T04:43:07.105 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T04:43:07.105 INFO:teuthology.orchestra.run.smithi132.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-18T04:43:07.105 INFO:teuthology.orchestra.run.smithi132.stdout:creating subdirectories ... ok 2024-04-18T04:43:07.105 INFO:teuthology.orchestra.run.smithi132.stdout:selecting dynamic shared memory implementation ... posix 2024-04-18T04:43:07.117 INFO:teuthology.orchestra.run.smithi132.stdout:selecting default max_connections ... 100 2024-04-18T04:43:07.139 INFO:teuthology.orchestra.run.smithi132.stdout:selecting default shared_buffers ... 128MB 2024-04-18T04:43:07.148 INFO:teuthology.orchestra.run.smithi132.stdout:selecting default time zone ... Etc/UTC 2024-04-18T04:43:07.149 INFO:teuthology.orchestra.run.smithi132.stdout:creating configuration files ... ok 2024-04-18T04:43:07.160 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-18T04:43:07.267 INFO:teuthology.orchestra.run.smithi132.stdout:running bootstrap script ... ok 2024-04-18T04:43:07.295 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-18T04:43:07.963 INFO:teuthology.orchestra.run.smithi132.stdout:performing post-bootstrap initialization ... ok 2024-04-18T04:43:08.250 INFO:teuthology.orchestra.run.smithi120.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-18T04:43:08.342 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-18T04:43:08.702 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-18T04:43:08.702 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-18T04:43:08.722 INFO:teuthology.orchestra.run.smithi132.stdout:syncing data to disk ... ok 2024-04-18T04:43:09.136 INFO:teuthology.orchestra.run.smithi132.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-18T04:43:09.436 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-18T04:43:09.562 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-18T04:43:09.680 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-18T04:43:09.781 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-18T04:43:09.898 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-18T04:43:10.049 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-18T04:43:10.175 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-18T04:43:10.301 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-18T04:43:10.965 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-18T04:43:11.074 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up dump (0.4b47-3) ... 2024-04-18T04:43:11.169 INFO:teuthology.orchestra.run.smithi120.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-18T04:43:11.259 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-18T04:43:11.393 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-18T04:43:11.519 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-18T04:43:11.653 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-18T04:43:11.790 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-18T04:43:11.894 INFO:teuthology.orchestra.run.smithi120.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-18T04:43:11.964 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-18T04:43:12.025 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-18T04:43:12.073 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-18T04:43:12.151 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-18T04:43:12.250 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-18T04:43:12.277 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up postgresql (14+238) ... 2024-04-18T04:43:12.376 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-18T04:43:12.395 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-18T04:43:12.512 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-18T04:43:12.535 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-18T04:43:12.703 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up postgresql-client (14+238) ... 2024-04-18T04:43:12.774 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-18T04:43:12.774 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-18T04:43:12.829 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-18T04:43:13.365 INFO:teuthology.orchestra.run.smithi132.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-18T04:43:13.428 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:43:13.429 INFO:teuthology.orchestra.run.smithi120.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-18T04:43:13.429 INFO:teuthology.orchestra.run.smithi120.stdout:which means they are currently configured by ifupdown: 2024-04-18T04:43:13.429 INFO:teuthology.orchestra.run.smithi120.stdout:- enp3s0f1 2024-04-18T04:43:13.429 INFO:teuthology.orchestra.run.smithi120.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-18T04:43:13.429 INFO:teuthology.orchestra.run.smithi120.stdout:remove their configuration from /etc/network/interfaces. 2024-04-18T04:43:13.429 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:43:13.561 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-18T04:43:13.574 INFO:teuthology.orchestra.run.smithi132.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-18T04:43:13.893 INFO:teuthology.orchestra.run.smithi132.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-18T04:43:13.936 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-18T04:43:14.045 INFO:teuthology.orchestra.run.smithi132.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-18T04:43:14.396 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-18T04:43:15.081 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-18T04:43:15.233 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-18T04:43:15.358 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-18T04:43:15.468 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up postgresql-common (238) ... 2024-04-18T04:43:15.473 INFO:teuthology.orchestra.run.smithi132.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-18T04:43:15.573 INFO:teuthology.orchestra.run.smithi132.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-18T04:43:16.230 INFO:teuthology.orchestra.run.smithi132.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-18T04:43:16.236 DEBUG:teuthology.parallel:result is None 2024-04-18T04:43:16.436 INFO:teuthology.orchestra.run.smithi120.stdout:Adding user postgres to group ssl-cert 2024-04-18T04:43:16.667 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:43:16.667 INFO:teuthology.orchestra.run.smithi120.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-18T04:43:16.930 INFO:teuthology.orchestra.run.smithi120.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-18T04:43:16.930 INFO:teuthology.orchestra.run.smithi120.stdout:Removing obsolete dictionary files: 2024-04-18T04:43:17.638 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-18T04:43:18.093 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-18T04:43:18.423 INFO:teuthology.orchestra.run.smithi120.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-18T04:43:18.442 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-18T04:43:18.494 INFO:teuthology.orchestra.run.smithi120.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-18T04:43:18.494 INFO:teuthology.orchestra.run.smithi120.stdout:This user must also own the server process. 2024-04-18T04:43:18.494 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:43:18.494 INFO:teuthology.orchestra.run.smithi120.stdout:The database cluster will be initialized with locale "en_US". 2024-04-18T04:43:18.494 INFO:teuthology.orchestra.run.smithi120.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-18T04:43:18.494 INFO:teuthology.orchestra.run.smithi120.stdout:The default text search configuration will be set to "english". 2024-04-18T04:43:18.494 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:43:18.495 INFO:teuthology.orchestra.run.smithi120.stdout:Data page checksums are disabled. 2024-04-18T04:43:18.495 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:43:18.495 INFO:teuthology.orchestra.run.smithi120.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-18T04:43:18.495 INFO:teuthology.orchestra.run.smithi120.stdout:creating subdirectories ... ok 2024-04-18T04:43:18.495 INFO:teuthology.orchestra.run.smithi120.stdout:selecting dynamic shared memory implementation ... posix 2024-04-18T04:43:18.518 INFO:teuthology.orchestra.run.smithi120.stdout:selecting default max_connections ... 100 2024-04-18T04:43:18.552 INFO:teuthology.orchestra.run.smithi120.stdout:selecting default shared_buffers ... 128MB 2024-04-18T04:43:18.566 INFO:teuthology.orchestra.run.smithi120.stdout:selecting default time zone ... Etc/UTC 2024-04-18T04:43:18.567 INFO:teuthology.orchestra.run.smithi120.stdout:creating configuration files ... ok 2024-04-18T04:43:18.732 INFO:teuthology.orchestra.run.smithi120.stdout:running bootstrap script ... ok 2024-04-18T04:43:19.350 INFO:teuthology.orchestra.run.smithi120.stdout:performing post-bootstrap initialization ... ok 2024-04-18T04:43:20.015 INFO:teuthology.orchestra.run.smithi120.stdout:syncing data to disk ... ok 2024-04-18T04:43:20.540 INFO:teuthology.orchestra.run.smithi120.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-18T04:43:23.492 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-18T04:43:23.636 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-18T04:43:23.769 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up postgresql (14+238) ... 2024-04-18T04:43:23.894 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-18T04:43:24.004 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-18T04:43:24.249 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-18T04:43:24.249 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-18T04:43:25.014 INFO:teuthology.orchestra.run.smithi120.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-18T04:43:25.207 INFO:teuthology.orchestra.run.smithi120.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-18T04:43:25.551 INFO:teuthology.orchestra.run.smithi120.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-18T04:43:25.702 INFO:teuthology.orchestra.run.smithi120.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-18T04:43:27.113 INFO:teuthology.orchestra.run.smithi120.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-18T04:43:27.213 INFO:teuthology.orchestra.run.smithi120.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-18T04:43:27.888 INFO:teuthology.orchestra.run.smithi120.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-18T04:43:27.894 DEBUG:teuthology.parallel:result is None 2024-04-18T04:43:27.895 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=56a91dd158be807f143cc918a11685fc9ee164ae 2024-04-18T04:43:28.119 DEBUG:teuthology.orchestra.run.smithi120:> dpkg-query -W -f '${Version}' ceph 2024-04-18T04:43:28.141 INFO:teuthology.orchestra.run.smithi120.stdout:18.2.2-1229-g56a91dd1-1jammy 2024-04-18T04:43:28.142 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1229-g56a91dd1-1jammy 2024-04-18T04:43:28.142 INFO:teuthology.task.install:The correct ceph version 18.2.2-1229-g56a91dd1-1jammy is installed. 2024-04-18T04:43:28.144 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=56a91dd158be807f143cc918a11685fc9ee164ae 2024-04-18T04:43:28.283 DEBUG:teuthology.orchestra.run.smithi132:> dpkg-query -W -f '${Version}' ceph 2024-04-18T04:43:28.303 INFO:teuthology.orchestra.run.smithi132.stdout:18.2.2-1229-g56a91dd1-1jammy 2024-04-18T04:43:28.303 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1229-g56a91dd1-1jammy 2024-04-18T04:43:28.303 INFO:teuthology.task.install:The correct ceph version 18.2.2-1229-g56a91dd1-1jammy is installed. 2024-04-18T04:43:28.305 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-18T04:43:28.305 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-18T04:43:28.305 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-18T04:43:28.325 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-18T04:43:28.325 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-18T04:43:28.357 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-18T04:43:28.357 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-18T04:43:28.357 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/daemon-helper 2024-04-18T04:43:28.392 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-18T04:43:28.456 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-18T04:43:28.456 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/daemon-helper 2024-04-18T04:43:28.470 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-18T04:43:28.523 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-18T04:43:28.524 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-18T04:43:28.524 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-18T04:43:28.544 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-18T04:43:28.611 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-18T04:43:28.612 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-18T04:43:28.625 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-18T04:43:28.680 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-18T04:43:28.680 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-18T04:43:28.680 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/stdin-killer 2024-04-18T04:43:28.700 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-18T04:43:28.764 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-18T04:43:28.764 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/stdin-killer 2024-04-18T04:43:28.777 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-18T04:43:28.832 INFO:teuthology.run_tasks:Running task ceph... 2024-04-18T04:43:28.914 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-18T04:43:28.914 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 777 /var/log/ceph 2024-04-18T04:43:28.917 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 777 /var/log/ceph 2024-04-18T04:43:28.932 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-18T04:43:28.933 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-18T04:43:28.980 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-18T04:43:28.998 INFO:tasks.ceph:Creating extra log directories... 2024-04-18T04:43:28.998 DEBUG:teuthology.orchestra.run.smithi120:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-18T04:43:29.044 DEBUG:teuthology.orchestra.run.smithi132:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-18T04:43:29.066 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-18T04:43:29.066 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-18T04:43:29.067 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-18T04:43:29.067 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-18T04:43:29.067 DEBUG:teuthology.orchestra.run.smithi120:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-18T04:43:29.110 DEBUG:teuthology.orchestra.run.smithi120:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-18T04:43:29.198 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-18T04:43:29.198 DEBUG:teuthology.orchestra.run.smithi132:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-18T04:43:29.204 DEBUG:teuthology.orchestra.run.smithi132:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-18T04:43:29.285 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-18T04:43:29.285 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': False, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': False, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'Replacing daemon mds', 'SLOW_OPS', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-18T04:43:29.285 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661522', 'branch': 'reef', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/ffsb}}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7661522', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'reef'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': False, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': False, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'Replacing daemon mds', 'SLOW_OPS', 'slow request'], 'sha1': '56a91dd158be807f143cc918a11685fc9ee164ae'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '56a91dd158be807f143cc918a11685fc9ee164ae'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 930, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 5203, 'sha1': '56a91dd158be807f143cc918a11685fc9ee164ae', 'sleep_before_teardown': 0, 'subset': '88/512', 'suite': 'fs', 'suite_branch': 'reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_646b8c7d293d8ec31a40c69f7b3237b19c1be24d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi120.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHANrs/xll16DEgmxjynlkdARTOaFmeRfeFhHVfwT++ABVzjk3IEbQX/EF1eynzepQqAjIJ+7wXEVeez1lYX8UY=', 'smithi132.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA+I8upALm3bviZVBX1sO1bIoTpNe0J/l7IJXwELLFA4H9YSVNOClwO8zFYqHHY0vbXVWd/ghnU9t1UN9cZzJkg='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '56a91dd158be807f143cc918a11685fc9ee164ae'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': False, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': False, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'Replacing daemon mds', 'SLOW_OPS', 'slow request'], 'sha1': '56a91dd158be807f143cc918a11685fc9ee164ae', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'mds_thrash': None}, {'workunit': {'clients': {'all': ['suites/ffsb.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-17_22:24:03', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-18T04:43:29.286 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-18T04:43:29.289 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-18T04:43:29.329 DEBUG:teuthology.orchestra.run.smithi120:> sudo install -d -m0777 -- /var/run/ceph 2024-04-18T04:43:29.340 DEBUG:teuthology.orchestra.run.smithi132:> sudo install -d -m0777 -- /var/run/ceph 2024-04-18T04:43:29.384 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-18T04:43:29.384 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/scratch_devs of=/dev/stdout 2024-04-18T04:43:29.405 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-18T04:43:29.405 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_1 2024-04-18T04:43:29.458 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-18T04:43:29.458 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T04:43:29.458 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 6h/6d Inode: 891 Links: 1 2024-04-18T04:43:29.458 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T04:43:29.458 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-04-18 04:37:09.343373474 +0000 2024-04-18T04:43:29.458 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-04-18 04:37:09.047376117 +0000 2024-04-18T04:43:29.458 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-04-18 04:37:09.047376117 +0000 2024-04-18T04:43:29.458 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-04-18 04:37:09.047376117 +0000 2024-04-18T04:43:29.459 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-18T04:43:29.518 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-04-18T04:43:29.518 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-04-18T04:43:29.519 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000664419 s, 771 kB/s 2024-04-18T04:43:29.520 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-18T04:43:29.571 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_2 2024-04-18T04:43:29.621 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-18T04:43:29.621 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T04:43:29.621 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 6h/6d Inode: 908 Links: 1 2024-04-18T04:43:29.621 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T04:43:29.621 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-04-18 04:37:09.915368364 +0000 2024-04-18T04:43:29.621 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-04-18 04:37:09.627370938 +0000 2024-04-18T04:43:29.622 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-04-18 04:37:09.627370938 +0000 2024-04-18T04:43:29.622 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-04-18 04:37:09.627370938 +0000 2024-04-18T04:43:29.622 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-18T04:43:29.682 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-04-18T04:43:29.683 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-04-18T04:43:29.683 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000344795 s, 1.5 MB/s 2024-04-18T04:43:29.684 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-18T04:43:29.735 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_3 2024-04-18T04:43:29.785 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-18T04:43:29.785 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T04:43:29.785 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 6h/6d Inode: 928 Links: 1 2024-04-18T04:43:29.785 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T04:43:29.786 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-04-18 04:37:10.503363113 +0000 2024-04-18T04:43:29.786 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-04-18 04:37:10.219365649 +0000 2024-04-18T04:43:29.786 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-04-18 04:37:10.219365649 +0000 2024-04-18T04:43:29.786 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-04-18 04:37:10.219365649 +0000 2024-04-18T04:43:29.786 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-18T04:43:29.846 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-04-18T04:43:29.846 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-04-18T04:43:29.846 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000327046 s, 1.6 MB/s 2024-04-18T04:43:29.848 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-18T04:43:29.899 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_4 2024-04-18T04:43:29.949 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-18T04:43:29.949 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T04:43:29.949 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 6h/6d Inode: 945 Links: 1 2024-04-18T04:43:29.950 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T04:43:29.950 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-04-18 04:37:10.807360398 +0000 2024-04-18T04:43:29.950 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-04-18 04:37:10.803360434 +0000 2024-04-18T04:43:29.950 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-04-18 04:37:10.803360434 +0000 2024-04-18T04:43:29.950 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-04-18 04:37:10.803360434 +0000 2024-04-18T04:43:29.950 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-18T04:43:30.010 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-04-18T04:43:30.010 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-04-18T04:43:30.010 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000366096 s, 1.4 MB/s 2024-04-18T04:43:30.012 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-18T04:43:30.063 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-18T04:43:30.063 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-18T04:43:30.063 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/scratch_devs of=/dev/stdout 2024-04-18T04:43:30.069 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-18T04:43:30.069 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_1 2024-04-18T04:43:30.117 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-18T04:43:30.117 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T04:43:30.117 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 892 Links: 1 2024-04-18T04:43:30.117 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T04:43:30.118 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-04-18 04:36:50.630999663 +0000 2024-04-18T04:43:30.118 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-04-18 04:36:50.395001771 +0000 2024-04-18T04:43:30.118 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-04-18 04:36:50.395001771 +0000 2024-04-18T04:43:30.118 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: - 2024-04-18T04:43:30.118 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-18T04:43:30.172 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-04-18T04:43:30.172 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-04-18T04:43:30.172 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000498111 s, 1.0 MB/s 2024-04-18T04:43:30.173 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-18T04:43:30.222 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_2 2024-04-18T04:43:30.269 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-18T04:43:30.269 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T04:43:30.269 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 912 Links: 1 2024-04-18T04:43:30.269 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T04:43:30.269 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-04-18 04:36:51.122995269 +0000 2024-04-18T04:43:30.269 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-04-18 04:36:50.862997591 +0000 2024-04-18T04:43:30.270 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-04-18 04:36:50.862997591 +0000 2024-04-18T04:43:30.270 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: - 2024-04-18T04:43:30.270 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-18T04:43:30.323 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-04-18T04:43:30.323 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-04-18T04:43:30.323 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000552542 s, 927 kB/s 2024-04-18T04:43:30.324 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-18T04:43:30.374 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_3 2024-04-18T04:43:30.421 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-18T04:43:30.421 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T04:43:30.421 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 929 Links: 1 2024-04-18T04:43:30.421 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T04:43:30.421 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-04-18 04:36:51.610990911 +0000 2024-04-18T04:43:30.421 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-04-18 04:36:51.330993411 +0000 2024-04-18T04:43:30.421 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-04-18 04:36:51.330993411 +0000 2024-04-18T04:43:30.421 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: - 2024-04-18T04:43:30.422 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-18T04:43:30.475 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-04-18T04:43:30.475 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-04-18T04:43:30.475 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000433452 s, 1.2 MB/s 2024-04-18T04:43:30.476 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-18T04:43:30.526 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_4 2024-04-18T04:43:30.572 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-18T04:43:30.573 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T04:43:30.573 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 939 Links: 1 2024-04-18T04:43:30.573 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T04:43:30.573 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-04-18 04:36:52.130986265 +0000 2024-04-18T04:43:30.573 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-04-18 04:36:51.854988730 +0000 2024-04-18T04:43:30.573 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-04-18 04:36:51.854988730 +0000 2024-04-18T04:43:30.573 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: - 2024-04-18T04:43:30.573 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-18T04:43:30.627 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-04-18T04:43:30.627 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-04-18T04:43:30.627 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000485527 s, 1.1 MB/s 2024-04-18T04:43:30.628 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-18T04:43:30.678 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-18T04:43:30.678 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi120.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi132.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-18T04:43:30.678 INFO:tasks.ceph:Generating config... 2024-04-18T04:43:30.680 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-18T04:43:30.680 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-04-18T04:43:30.680 INFO:tasks.ceph:[client] debug client = 20 2024-04-18T04:43:30.680 INFO:tasks.ceph:[client] debug ms = 1 2024-04-18T04:43:30.680 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-18T04:43:30.680 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-18T04:43:30.680 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-18T04:43:30.680 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-18T04:43:30.680 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-18T04:43:30.680 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-18T04:43:30.680 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-04-18T04:43:30.680 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-04-18T04:43:30.680 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-04-18T04:43:30.680 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-04-18T04:43:30.680 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-18T04:43:30.681 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-18T04:43:30.681 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = False 2024-04-18T04:43:30.681 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-18T04:43:30.681 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-18T04:43:30.681 INFO:tasks.ceph:[mds] mds_dir_prefetch = False 2024-04-18T04:43:30.681 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-04-18T04:43:30.681 INFO:tasks.ceph:[mds] mon client directed command retry = 5 2024-04-18T04:43:30.681 INFO:tasks.ceph:[mds] ms inject delay max = 1 2024-04-18T04:43:30.681 INFO:tasks.ceph:[mds] ms inject delay probability = 0.005 2024-04-18T04:43:30.681 INFO:tasks.ceph:[mds] ms inject delay type = client mds osd 2024-04-18T04:43:30.681 INFO:tasks.ceph:[mds] ms inject socket failures = 2500 2024-04-18T04:43:30.681 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-18T04:43:30.681 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-18T04:43:30.681 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-18T04:43:30.681 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-18T04:43:30.682 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-18T04:43:30.682 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-18T04:43:30.682 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-18T04:43:30.682 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-18T04:43:30.682 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-18T04:43:30.682 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-18T04:43:30.682 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-04-18T04:43:30.682 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-18T04:43:30.682 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-18T04:43:30.682 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-18T04:43:30.682 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-18T04:43:30.682 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-18T04:43:30.682 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-18T04:43:30.683 INFO:tasks.ceph:[osd] filestore flush min = 0 2024-04-18T04:43:30.683 INFO:tasks.ceph:[osd] mon client directed command retry = 5 2024-04-18T04:43:30.683 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-18T04:43:30.683 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-18T04:43:30.683 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-18T04:43:30.683 INFO:tasks.ceph:[osd] ms inject delay max = 1 2024-04-18T04:43:30.683 INFO:tasks.ceph:[osd] ms inject delay probability = 0.005 2024-04-18T04:43:30.683 INFO:tasks.ceph:[osd] ms inject delay type = client mds 2024-04-18T04:43:30.683 INFO:tasks.ceph:[osd] ms inject socket failures = 2500 2024-04-18T04:43:30.683 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-18T04:43:30.683 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-18T04:43:30.683 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-18T04:43:30.683 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-18T04:43:30.683 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-18T04:43:30.684 INFO:tasks.ceph:Setting up mon.a... 2024-04-18T04:43:30.684 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-18T04:43:30.728 INFO:teuthology.orchestra.run.smithi120.stdout:creating /etc/ceph/ceph.keyring 2024-04-18T04:43:30.761 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-18T04:43:30.853 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-18T04:43:30.873 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.120'), ('mon.b', '172.21.15.132'), ('mon.c', '[v2:172.21.15.132:3301,v1:172.21.15.132:6790]')] 2024-04-18T04:43:30.873 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.120,172.21.15.132,[v2:172.21.15.132:3301,v1:172.21.15.132:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': False, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': False, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-18T04:43:30.874 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-18T04:43:30.874 DEBUG:teuthology.orchestra.run.smithi120:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-18T04:43:30.921 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.120 --add b 172.21.15.132 --addv c '[v2:172.21.15.132:3301,v1:172.21.15.132:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-18T04:43:31.014 INFO:teuthology.orchestra.run.smithi120.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-18T04:43:31.015 INFO:teuthology.orchestra.run.smithi120.stdout:monmaptool: generated fsid 8e73592f-08e2-4957-a98f-9d044cec4ba5 2024-04-18T04:43:31.015 INFO:teuthology.orchestra.run.smithi120.stdout:setting min_mon_release = pacific 2024-04-18T04:43:31.015 INFO:teuthology.orchestra.run.smithi120.stdout:epoch 0 2024-04-18T04:43:31.015 INFO:teuthology.orchestra.run.smithi120.stdout:fsid 8e73592f-08e2-4957-a98f-9d044cec4ba5 2024-04-18T04:43:31.015 INFO:teuthology.orchestra.run.smithi120.stdout:last_changed 2024-04-18T04:43:31.019204+0000 2024-04-18T04:43:31.015 INFO:teuthology.orchestra.run.smithi120.stdout:created 2024-04-18T04:43:31.019204+0000 2024-04-18T04:43:31.015 INFO:teuthology.orchestra.run.smithi120.stdout:min_mon_release 16 (pacific) 2024-04-18T04:43:31.015 INFO:teuthology.orchestra.run.smithi120.stdout:election_strategy: 1 2024-04-18T04:43:31.015 INFO:teuthology.orchestra.run.smithi120.stdout:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-04-18T04:43:31.015 INFO:teuthology.orchestra.run.smithi120.stdout:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-04-18T04:43:31.015 INFO:teuthology.orchestra.run.smithi120.stdout:2: [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] mon.c 2024-04-18T04:43:31.016 INFO:teuthology.orchestra.run.smithi120.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-18T04:43:31.018 DEBUG:teuthology.orchestra.run.smithi120:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-18T04:43:31.069 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 8e73592f-08e2-4957-a98f-9d044cec4ba5... 2024-04-18T04:43:31.070 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-18T04:43:31.116 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-18T04:43:31.147 INFO:teuthology.orchestra.run.smithi132.stdout:[global] 2024-04-18T04:43:31.147 INFO:teuthology.orchestra.run.smithi132.stdout: chdir = "" 2024-04-18T04:43:31.147 INFO:teuthology.orchestra.run.smithi132.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-18T04:43:31.147 INFO:teuthology.orchestra.run.smithi132.stdout: auth supported = cephx 2024-04-18T04:43:31.147 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T04:43:31.147 INFO:teuthology.orchestra.run.smithi132.stdout: filestore xattr use omap = true 2024-04-18T04:43:31.147 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T04:43:31.147 INFO:teuthology.orchestra.run.smithi132.stdout: mon clock drift allowed = 1.000 2024-04-18T04:43:31.147 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T04:43:31.147 INFO:teuthology.orchestra.run.smithi132.stdout: osd crush chooseleaf type = 0 2024-04-18T04:43:31.148 INFO:teuthology.orchestra.run.smithi132.stdout: auth debug = true 2024-04-18T04:43:31.148 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T04:43:31.148 INFO:teuthology.orchestra.run.smithi132.stdout: ms die on old message = true 2024-04-18T04:43:31.148 INFO:teuthology.orchestra.run.smithi132.stdout: ms die on bug = true 2024-04-18T04:43:31.148 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T04:43:31.148 INFO:teuthology.orchestra.run.smithi132.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-18T04:43:31.148 INFO:teuthology.orchestra.run.smithi132.stdout: mon pg warn max object skew = 0 2024-04-18T04:43:31.148 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T04:43:31.148 INFO:teuthology.orchestra.run.smithi132.stdout: # disable pg_autoscaler by default for new pools 2024-04-18T04:43:31.148 INFO:teuthology.orchestra.run.smithi132.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-18T04:43:31.148 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T04:43:31.148 INFO:teuthology.orchestra.run.smithi132.stdout: osd pool default size = 2 2024-04-18T04:43:31.148 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T04:43:31.148 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd allow primary affinity = true 2024-04-18T04:43:31.149 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd allow pg remap = true 2024-04-18T04:43:31.149 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on legacy crush tunables = false 2024-04-18T04:43:31.149 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on crush straw calc version zero = false 2024-04-18T04:43:31.149 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on no sortbitwise = false 2024-04-18T04:43:31.149 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on osd down out interval zero = false 2024-04-18T04:43:31.149 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on too few osds = false 2024-04-18T04:43:31.149 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-18T04:43:31.149 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-18T04:43:31.149 INFO:teuthology.orchestra.run.smithi132.stdout: mon_allow_pool_size_one = true 2024-04-18T04:43:31.149 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T04:43:31.149 INFO:teuthology.orchestra.run.smithi132.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-18T04:43:31.149 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T04:43:31.149 INFO:teuthology.orchestra.run.smithi132.stdout: osd default data pool replay window = 5 2024-04-18T04:43:31.149 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T04:43:31.149 INFO:teuthology.orchestra.run.smithi132.stdout: mon allow pool delete = true 2024-04-18T04:43:31.150 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T04:43:31.150 INFO:teuthology.orchestra.run.smithi132.stdout: mon cluster log file level = debug 2024-04-18T04:43:31.150 INFO:teuthology.orchestra.run.smithi132.stdout: debug asserts on shutdown = true 2024-04-18T04:43:31.150 INFO:teuthology.orchestra.run.smithi132.stdout: mon health detail to clog = false 2024-04-18T04:43:31.150 INFO:teuthology.orchestra.run.smithi132.stdout: mon host = "172.21.15.120,172.21.15.132,[v2:172.21.15.132:3301,v1:172.21.15.132:6790]" 2024-04-18T04:43:31.151 INFO:teuthology.orchestra.run.smithi132.stdout: ms die on skipped message = False 2024-04-18T04:43:31.151 INFO:teuthology.orchestra.run.smithi132.stdout: fsid = 8e73592f-08e2-4957-a98f-9d044cec4ba5 2024-04-18T04:43:31.151 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T04:43:31.151 INFO:teuthology.orchestra.run.smithi132.stdout:[osd] 2024-04-18T04:43:31.151 INFO:teuthology.orchestra.run.smithi132.stdout: osd journal size = 100 2024-04-18T04:43:31.152 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T04:43:31.152 INFO:teuthology.orchestra.run.smithi132.stdout: osd scrub load threshold = 5.0 2024-04-18T04:43:31.152 INFO:teuthology.orchestra.run.smithi132.stdout: osd scrub max interval = 600 2024-04-18T04:43:31.152 INFO:teuthology.orchestra.run.smithi132.stdout: osd mclock profile = high_recovery_ops 2024-04-18T04:43:31.152 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T04:43:31.152 INFO:teuthology.orchestra.run.smithi132.stdout: osd recover clone overlap = true 2024-04-18T04:43:31.152 INFO:teuthology.orchestra.run.smithi132.stdout: osd recovery max chunk = 1048576 2024-04-18T04:43:31.152 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T04:43:31.152 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug shutdown = true 2024-04-18T04:43:31.152 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug op order = true 2024-04-18T04:43:31.152 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug verify stray on activate = true 2024-04-18T04:43:31.152 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T04:43:31.152 INFO:teuthology.orchestra.run.smithi132.stdout: osd open classes on start = true 2024-04-18T04:43:31.152 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug pg log writeout = true 2024-04-18T04:43:31.153 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T04:43:31.153 INFO:teuthology.orchestra.run.smithi132.stdout: osd deep scrub update digest min age = 30 2024-04-18T04:43:31.153 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T04:43:31.153 INFO:teuthology.orchestra.run.smithi132.stdout: osd map max advance = 10 2024-04-18T04:43:31.153 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T04:43:31.153 INFO:teuthology.orchestra.run.smithi132.stdout: journal zero on create = true 2024-04-18T04:43:31.153 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T04:43:31.153 INFO:teuthology.orchestra.run.smithi132.stdout: filestore ondisk finisher threads = 3 2024-04-18T04:43:31.153 INFO:teuthology.orchestra.run.smithi132.stdout: filestore apply finisher threads = 3 2024-04-18T04:43:31.153 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T04:43:31.153 INFO:teuthology.orchestra.run.smithi132.stdout: bdev debug aio = true 2024-04-18T04:43:31.153 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug misdirected ops = true 2024-04-18T04:43:31.153 INFO:teuthology.orchestra.run.smithi132.stdout: bluestore block size = 96636764160 2024-04-18T04:43:31.153 INFO:teuthology.orchestra.run.smithi132.stdout: bluestore compression mode = aggressive 2024-04-18T04:43:31.153 INFO:teuthology.orchestra.run.smithi132.stdout: bluestore fsck on mount = True 2024-04-18T04:43:31.154 INFO:teuthology.orchestra.run.smithi132.stdout: debug bluefs = 20 2024-04-18T04:43:31.154 INFO:teuthology.orchestra.run.smithi132.stdout: debug bluestore = 20 2024-04-18T04:43:31.154 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2024-04-18T04:43:31.154 INFO:teuthology.orchestra.run.smithi132.stdout: debug osd = 20 2024-04-18T04:43:31.154 INFO:teuthology.orchestra.run.smithi132.stdout: debug rocksdb = 10 2024-04-18T04:43:31.154 INFO:teuthology.orchestra.run.smithi132.stdout: filestore flush min = 0 2024-04-18T04:43:31.154 INFO:teuthology.orchestra.run.smithi132.stdout: mon client directed command retry = 5 2024-04-18T04:43:31.154 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd backfillfull_ratio = 0.85 2024-04-18T04:43:31.154 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd full ratio = 0.9 2024-04-18T04:43:31.154 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd nearfull ratio = 0.8 2024-04-18T04:43:31.154 INFO:teuthology.orchestra.run.smithi132.stdout: ms inject delay max = 1 2024-04-18T04:43:31.154 INFO:teuthology.orchestra.run.smithi132.stdout: ms inject delay probability = 0.005 2024-04-18T04:43:31.154 INFO:teuthology.orchestra.run.smithi132.stdout: ms inject delay type = client mds 2024-04-18T04:43:31.154 INFO:teuthology.orchestra.run.smithi132.stdout: ms inject socket failures = 2500 2024-04-18T04:43:31.154 INFO:teuthology.orchestra.run.smithi132.stdout: osd blocked scrub grace period = 3600 2024-04-18T04:43:31.155 INFO:teuthology.orchestra.run.smithi132.stdout: osd failsafe full ratio = 0.95 2024-04-18T04:43:31.155 INFO:teuthology.orchestra.run.smithi132.stdout: osd max markdown count = 1000 2024-04-18T04:43:31.155 INFO:teuthology.orchestra.run.smithi132.stdout: osd objectstore = bluestore 2024-04-18T04:43:31.155 INFO:teuthology.orchestra.run.smithi132.stdout: osd op complaint time = 180 2024-04-18T04:43:31.155 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T04:43:31.155 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr] 2024-04-18T04:43:31.155 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2024-04-18T04:43:31.155 INFO:teuthology.orchestra.run.smithi132.stdout: debug mgr = 20 2024-04-18T04:43:31.155 INFO:teuthology.orchestra.run.smithi132.stdout: debug mon = 20 2024-04-18T04:43:31.155 INFO:teuthology.orchestra.run.smithi132.stdout: debug auth = 20 2024-04-18T04:43:31.155 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min pgs per osd = 4 2024-04-18T04:43:31.155 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min bytes per osd = 10 2024-04-18T04:43:31.155 INFO:teuthology.orchestra.run.smithi132.stdout: mgr/telemetry/nag = false 2024-04-18T04:43:31.155 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T04:43:31.155 INFO:teuthology.orchestra.run.smithi132.stdout:[mon] 2024-04-18T04:43:31.156 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2024-04-18T04:43:31.156 INFO:teuthology.orchestra.run.smithi132.stdout: debug mon = 20 2024-04-18T04:43:31.156 INFO:teuthology.orchestra.run.smithi132.stdout: debug paxos = 20 2024-04-18T04:43:31.156 INFO:teuthology.orchestra.run.smithi132.stdout: debug auth = 20 2024-04-18T04:43:31.156 INFO:teuthology.orchestra.run.smithi132.stdout: mon data avail warn = 5 2024-04-18T04:43:31.156 INFO:teuthology.orchestra.run.smithi132.stdout: mon mgr mkfs grace = 240 2024-04-18T04:43:31.156 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min pgs per osd = 4 2024-04-18T04:43:31.156 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd reporter subtree level = osd 2024-04-18T04:43:31.156 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd prime pg temp = true 2024-04-18T04:43:31.156 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min bytes per osd = 10 2024-04-18T04:43:31.156 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T04:43:31.156 INFO:teuthology.orchestra.run.smithi132.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-18T04:43:31.156 INFO:teuthology.orchestra.run.smithi132.stdout: auth mon ticket ttl = 660 # 11m 2024-04-18T04:43:31.156 INFO:teuthology.orchestra.run.smithi132.stdout: auth service ticket ttl = 240 # 4m 2024-04-18T04:43:31.156 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T04:43:31.157 INFO:teuthology.orchestra.run.smithi132.stdout: # don't complain about insecure global_id in the test suite 2024-04-18T04:43:31.157 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-18T04:43:31.157 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-18T04:43:31.157 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T04:43:31.157 INFO:teuthology.orchestra.run.smithi132.stdout: # 1m isn't quite enough 2024-04-18T04:43:31.157 INFO:teuthology.orchestra.run.smithi132.stdout: mon_down_mkfs_grace = 2m 2024-04-18T04:43:31.157 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T04:43:31.157 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_filestore_osds = false 2024-04-18T04:43:31.157 INFO:teuthology.orchestra.run.smithi132.stdout: mon op complaint time = 120 2024-04-18T04:43:31.157 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-18T04:43:31.157 INFO:teuthology.orchestra.run.smithi132.stdout:[client] 2024-04-18T04:43:31.157 INFO:teuthology.orchestra.run.smithi132.stdout: rgw cache enabled = true 2024-04-18T04:43:31.157 INFO:teuthology.orchestra.run.smithi132.stdout: rgw enable ops log = true 2024-04-18T04:43:31.157 INFO:teuthology.orchestra.run.smithi132.stdout: rgw enable usage log = true 2024-04-18T04:43:31.157 INFO:teuthology.orchestra.run.smithi132.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-18T04:43:31.158 INFO:teuthology.orchestra.run.smithi132.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-18T04:43:31.158 INFO:teuthology.orchestra.run.smithi132.stdout: client mount timeout = 600 2024-04-18T04:43:31.158 INFO:teuthology.orchestra.run.smithi132.stdout: client_shutdown_timeout = 120 2024-04-18T04:43:31.158 INFO:teuthology.orchestra.run.smithi132.stdout: debug client = 20 2024-04-18T04:43:31.158 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2024-04-18T04:43:31.158 INFO:teuthology.orchestra.run.smithi132.stdout: rados mon op timeout = 900 2024-04-18T04:43:31.158 INFO:teuthology.orchestra.run.smithi132.stdout: rados osd op timeout = 900 2024-04-18T04:43:31.158 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.a] 2024-04-18T04:43:31.158 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.b] 2024-04-18T04:43:31.158 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.c] 2024-04-18T04:43:31.158 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.a] 2024-04-18T04:43:31.158 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.c] 2024-04-18T04:43:31.158 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.e] 2024-04-18T04:43:31.159 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.b] 2024-04-18T04:43:31.159 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.d] 2024-04-18T04:43:31.159 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.f] 2024-04-18T04:43:31.159 INFO:teuthology.orchestra.run.smithi132.stdout:[mds] 2024-04-18T04:43:31.159 INFO:teuthology.orchestra.run.smithi132.stdout: debug mds = 20 2024-04-18T04:43:31.159 INFO:teuthology.orchestra.run.smithi132.stdout: debug mds balancer = 20 2024-04-18T04:43:31.159 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2024-04-18T04:43:31.159 INFO:teuthology.orchestra.run.smithi132.stdout: mds bal fragment size max = 10000 2024-04-18T04:43:31.159 INFO:teuthology.orchestra.run.smithi132.stdout: mds bal merge size = 5 2024-04-18T04:43:31.159 INFO:teuthology.orchestra.run.smithi132.stdout: mds bal split bits = 3 2024-04-18T04:43:31.159 INFO:teuthology.orchestra.run.smithi132.stdout: mds bal split size = 100 2024-04-18T04:43:31.160 INFO:teuthology.orchestra.run.smithi132.stdout: mds debug frag = True 2024-04-18T04:43:31.160 INFO:teuthology.orchestra.run.smithi132.stdout: mds debug scatterstat = True 2024-04-18T04:43:31.160 INFO:teuthology.orchestra.run.smithi132.stdout: mds oft prefetch dirfrags = False 2024-04-18T04:43:31.160 INFO:teuthology.orchestra.run.smithi132.stdout: mds op complaint time = 180 2024-04-18T04:43:31.160 INFO:teuthology.orchestra.run.smithi132.stdout: mds verify scatter = True 2024-04-18T04:43:31.160 INFO:teuthology.orchestra.run.smithi132.stdout: mds_dir_prefetch = False 2024-04-18T04:43:31.160 INFO:teuthology.orchestra.run.smithi132.stdout: mds_sleep_rank_change = 5000000.0 2024-04-18T04:43:31.160 INFO:teuthology.orchestra.run.smithi132.stdout: mon client directed command retry = 5 2024-04-18T04:43:31.160 INFO:teuthology.orchestra.run.smithi132.stdout: ms inject delay max = 1 2024-04-18T04:43:31.160 INFO:teuthology.orchestra.run.smithi132.stdout: ms inject delay probability = 0.005 2024-04-18T04:43:31.160 INFO:teuthology.orchestra.run.smithi132.stdout: ms inject delay type = client mds osd 2024-04-18T04:43:31.160 INFO:teuthology.orchestra.run.smithi132.stdout: ms inject socket failures = 2500 2024-04-18T04:43:31.160 INFO:teuthology.orchestra.run.smithi132.stdout: osd op complaint time = 180 2024-04-18T04:43:31.160 INFO:teuthology.orchestra.run.smithi132.stdout: rados mon op timeout = 900 2024-04-18T04:43:31.160 INFO:teuthology.orchestra.run.smithi132.stdout: rados osd op timeout = 900 2024-04-18T04:43:31.161 INFO:teuthology.orchestra.run.smithi120.stdout:[global] 2024-04-18T04:43:31.161 INFO:teuthology.orchestra.run.smithi120.stdout: chdir = "" 2024-04-18T04:43:31.161 INFO:teuthology.orchestra.run.smithi120.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-18T04:43:31.161 INFO:teuthology.orchestra.run.smithi120.stdout: auth supported = cephx 2024-04-18T04:43:31.161 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:43:31.162 INFO:teuthology.orchestra.run.smithi120.stdout: filestore xattr use omap = true 2024-04-18T04:43:31.162 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:43:31.162 INFO:teuthology.orchestra.run.smithi120.stdout: mon clock drift allowed = 1.000 2024-04-18T04:43:31.162 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:43:31.162 INFO:teuthology.orchestra.run.smithi120.stdout: osd crush chooseleaf type = 0 2024-04-18T04:43:31.162 INFO:teuthology.orchestra.run.smithi120.stdout: auth debug = true 2024-04-18T04:43:31.162 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:43:31.162 INFO:teuthology.orchestra.run.smithi120.stdout: ms die on old message = true 2024-04-18T04:43:31.162 INFO:teuthology.orchestra.run.smithi120.stdout: ms die on bug = true 2024-04-18T04:43:31.162 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:43:31.162 INFO:teuthology.orchestra.run.smithi120.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-18T04:43:31.162 INFO:teuthology.orchestra.run.smithi120.stdout: mon pg warn max object skew = 0 2024-04-18T04:43:31.162 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:43:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: # disable pg_autoscaler by default for new pools 2024-04-18T04:43:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-18T04:43:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:43:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: osd pool default size = 2 2024-04-18T04:43:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:43:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd allow primary affinity = true 2024-04-18T04:43:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd allow pg remap = true 2024-04-18T04:43:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on legacy crush tunables = false 2024-04-18T04:43:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on crush straw calc version zero = false 2024-04-18T04:43:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on no sortbitwise = false 2024-04-18T04:43:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on osd down out interval zero = false 2024-04-18T04:43:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on too few osds = false 2024-04-18T04:43:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-18T04:43:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-18T04:43:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: mon_allow_pool_size_one = true 2024-04-18T04:43:31.164 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:43:31.164 INFO:teuthology.orchestra.run.smithi120.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-18T04:43:31.164 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:43:31.164 INFO:teuthology.orchestra.run.smithi120.stdout: osd default data pool replay window = 5 2024-04-18T04:43:31.164 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:43:31.164 INFO:teuthology.orchestra.run.smithi120.stdout: mon allow pool delete = true 2024-04-18T04:43:31.164 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:43:31.164 INFO:teuthology.orchestra.run.smithi120.stdout: mon cluster log file level = debug 2024-04-18T04:43:31.164 INFO:teuthology.orchestra.run.smithi120.stdout: debug asserts on shutdown = true 2024-04-18T04:43:31.164 INFO:teuthology.orchestra.run.smithi120.stdout: mon health detail to clog = false 2024-04-18T04:43:31.164 INFO:teuthology.orchestra.run.smithi120.stdout: mon host = "172.21.15.120,172.21.15.132,[v2:172.21.15.132:3301,v1:172.21.15.132:6790]" 2024-04-18T04:43:31.164 INFO:teuthology.orchestra.run.smithi120.stdout: ms die on skipped message = False 2024-04-18T04:43:31.164 INFO:teuthology.orchestra.run.smithi120.stdout: fsid = 8e73592f-08e2-4957-a98f-9d044cec4ba5 2024-04-18T04:43:31.164 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:43:31.165 INFO:teuthology.orchestra.run.smithi120.stdout:[osd] 2024-04-18T04:43:31.165 INFO:teuthology.orchestra.run.smithi120.stdout: osd journal size = 100 2024-04-18T04:43:31.165 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:43:31.165 INFO:teuthology.orchestra.run.smithi120.stdout: osd scrub load threshold = 5.0 2024-04-18T04:43:31.165 INFO:teuthology.orchestra.run.smithi120.stdout: osd scrub max interval = 600 2024-04-18T04:43:31.165 INFO:teuthology.orchestra.run.smithi120.stdout: osd mclock profile = high_recovery_ops 2024-04-18T04:43:31.165 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:43:31.165 INFO:teuthology.orchestra.run.smithi120.stdout: osd recover clone overlap = true 2024-04-18T04:43:31.165 INFO:teuthology.orchestra.run.smithi120.stdout: osd recovery max chunk = 1048576 2024-04-18T04:43:31.165 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:43:31.165 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug shutdown = true 2024-04-18T04:43:31.165 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug op order = true 2024-04-18T04:43:31.165 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug verify stray on activate = true 2024-04-18T04:43:31.165 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:43:31.165 INFO:teuthology.orchestra.run.smithi120.stdout: osd open classes on start = true 2024-04-18T04:43:31.166 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug pg log writeout = true 2024-04-18T04:43:31.166 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:43:31.166 INFO:teuthology.orchestra.run.smithi120.stdout: osd deep scrub update digest min age = 30 2024-04-18T04:43:31.166 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:43:31.166 INFO:teuthology.orchestra.run.smithi120.stdout: osd map max advance = 10 2024-04-18T04:43:31.166 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:43:31.166 INFO:teuthology.orchestra.run.smithi120.stdout: journal zero on create = true 2024-04-18T04:43:31.166 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:43:31.166 INFO:teuthology.orchestra.run.smithi120.stdout: filestore ondisk finisher threads = 3 2024-04-18T04:43:31.166 INFO:teuthology.orchestra.run.smithi120.stdout: filestore apply finisher threads = 3 2024-04-18T04:43:31.166 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:43:31.166 INFO:teuthology.orchestra.run.smithi120.stdout: bdev debug aio = true 2024-04-18T04:43:31.166 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug misdirected ops = true 2024-04-18T04:43:31.166 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore block size = 96636764160 2024-04-18T04:43:31.166 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore compression mode = aggressive 2024-04-18T04:43:31.167 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore fsck on mount = True 2024-04-18T04:43:31.167 INFO:teuthology.orchestra.run.smithi120.stdout: debug bluefs = 20 2024-04-18T04:43:31.167 INFO:teuthology.orchestra.run.smithi120.stdout: debug bluestore = 20 2024-04-18T04:43:31.167 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2024-04-18T04:43:31.167 INFO:teuthology.orchestra.run.smithi120.stdout: debug osd = 20 2024-04-18T04:43:31.167 INFO:teuthology.orchestra.run.smithi120.stdout: debug rocksdb = 10 2024-04-18T04:43:31.167 INFO:teuthology.orchestra.run.smithi120.stdout: filestore flush min = 0 2024-04-18T04:43:31.167 INFO:teuthology.orchestra.run.smithi120.stdout: mon client directed command retry = 5 2024-04-18T04:43:31.167 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd backfillfull_ratio = 0.85 2024-04-18T04:43:31.167 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd full ratio = 0.9 2024-04-18T04:43:31.167 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd nearfull ratio = 0.8 2024-04-18T04:43:31.167 INFO:teuthology.orchestra.run.smithi120.stdout: ms inject delay max = 1 2024-04-18T04:43:31.167 INFO:teuthology.orchestra.run.smithi120.stdout: ms inject delay probability = 0.005 2024-04-18T04:43:31.167 INFO:teuthology.orchestra.run.smithi120.stdout: ms inject delay type = client mds 2024-04-18T04:43:31.167 INFO:teuthology.orchestra.run.smithi120.stdout: ms inject socket failures = 2500 2024-04-18T04:43:31.168 INFO:teuthology.orchestra.run.smithi120.stdout: osd blocked scrub grace period = 3600 2024-04-18T04:43:31.168 INFO:teuthology.orchestra.run.smithi120.stdout: osd failsafe full ratio = 0.95 2024-04-18T04:43:31.168 INFO:teuthology.orchestra.run.smithi120.stdout: osd max markdown count = 1000 2024-04-18T04:43:31.168 INFO:teuthology.orchestra.run.smithi120.stdout: osd objectstore = bluestore 2024-04-18T04:43:31.168 INFO:teuthology.orchestra.run.smithi120.stdout: osd op complaint time = 180 2024-04-18T04:43:31.168 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:43:31.168 INFO:teuthology.orchestra.run.smithi120.stdout:[mgr] 2024-04-18T04:43:31.168 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2024-04-18T04:43:31.168 INFO:teuthology.orchestra.run.smithi120.stdout: debug mgr = 20 2024-04-18T04:43:31.168 INFO:teuthology.orchestra.run.smithi120.stdout: debug mon = 20 2024-04-18T04:43:31.168 INFO:teuthology.orchestra.run.smithi120.stdout: debug auth = 20 2024-04-18T04:43:31.168 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min pgs per osd = 4 2024-04-18T04:43:31.168 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min bytes per osd = 10 2024-04-18T04:43:31.168 INFO:teuthology.orchestra.run.smithi120.stdout: mgr/telemetry/nag = false 2024-04-18T04:43:31.168 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:43:31.169 INFO:teuthology.orchestra.run.smithi120.stdout:[mon] 2024-04-18T04:43:31.169 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2024-04-18T04:43:31.169 INFO:teuthology.orchestra.run.smithi120.stdout: debug mon = 20 2024-04-18T04:43:31.169 INFO:teuthology.orchestra.run.smithi120.stdout: debug paxos = 20 2024-04-18T04:43:31.169 INFO:teuthology.orchestra.run.smithi120.stdout: debug auth = 20 2024-04-18T04:43:31.169 INFO:teuthology.orchestra.run.smithi120.stdout: mon data avail warn = 5 2024-04-18T04:43:31.169 INFO:teuthology.orchestra.run.smithi120.stdout: mon mgr mkfs grace = 240 2024-04-18T04:43:31.169 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min pgs per osd = 4 2024-04-18T04:43:31.169 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd reporter subtree level = osd 2024-04-18T04:43:31.169 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd prime pg temp = true 2024-04-18T04:43:31.169 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min bytes per osd = 10 2024-04-18T04:43:31.169 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:43:31.169 INFO:teuthology.orchestra.run.smithi120.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-18T04:43:31.169 INFO:teuthology.orchestra.run.smithi120.stdout: auth mon ticket ttl = 660 # 11m 2024-04-18T04:43:31.169 INFO:teuthology.orchestra.run.smithi120.stdout: auth service ticket ttl = 240 # 4m 2024-04-18T04:43:31.170 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:43:31.170 INFO:teuthology.orchestra.run.smithi120.stdout: # don't complain about insecure global_id in the test suite 2024-04-18T04:43:31.170 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-18T04:43:31.170 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-18T04:43:31.170 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:43:31.170 INFO:teuthology.orchestra.run.smithi120.stdout: # 1m isn't quite enough 2024-04-18T04:43:31.170 INFO:teuthology.orchestra.run.smithi120.stdout: mon_down_mkfs_grace = 2m 2024-04-18T04:43:31.170 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:43:31.170 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_filestore_osds = false 2024-04-18T04:43:31.170 INFO:teuthology.orchestra.run.smithi120.stdout: mon op complaint time = 120 2024-04-18T04:43:31.170 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:43:31.170 INFO:teuthology.orchestra.run.smithi120.stdout:[client] 2024-04-18T04:43:31.170 INFO:teuthology.orchestra.run.smithi120.stdout: rgw cache enabled = true 2024-04-18T04:43:31.170 INFO:teuthology.orchestra.run.smithi120.stdout: rgw enable ops log = true 2024-04-18T04:43:31.171 INFO:teuthology.orchestra.run.smithi120.stdout: rgw enable usage log = true 2024-04-18T04:43:31.171 INFO:teuthology.orchestra.run.smithi120.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-18T04:43:31.171 INFO:teuthology.orchestra.run.smithi120.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-18T04:43:31.171 INFO:teuthology.orchestra.run.smithi120.stdout: client mount timeout = 600 2024-04-18T04:43:31.171 INFO:teuthology.orchestra.run.smithi120.stdout: client_shutdown_timeout = 120 2024-04-18T04:43:31.171 INFO:teuthology.orchestra.run.smithi120.stdout: debug client = 20 2024-04-18T04:43:31.171 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2024-04-18T04:43:31.171 INFO:teuthology.orchestra.run.smithi120.stdout: rados mon op timeout = 900 2024-04-18T04:43:31.171 INFO:teuthology.orchestra.run.smithi120.stdout: rados osd op timeout = 900 2024-04-18T04:43:31.171 INFO:teuthology.orchestra.run.smithi120.stdout:[mon.a] 2024-04-18T04:43:31.171 INFO:teuthology.orchestra.run.smithi120.stdout:[mon.b] 2024-04-18T04:43:31.171 INFO:teuthology.orchestra.run.smithi120.stdout:[mon.c] 2024-04-18T04:43:31.171 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.a] 2024-04-18T04:43:31.171 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.c] 2024-04-18T04:43:31.172 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.e] 2024-04-18T04:43:31.172 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.b] 2024-04-18T04:43:31.172 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.d] 2024-04-18T04:43:31.172 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.f] 2024-04-18T04:43:31.172 INFO:teuthology.orchestra.run.smithi120.stdout:[mds] 2024-04-18T04:43:31.172 INFO:teuthology.orchestra.run.smithi120.stdout: debug mds = 20 2024-04-18T04:43:31.172 INFO:teuthology.orchestra.run.smithi120.stdout: debug mds balancer = 20 2024-04-18T04:43:31.172 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2024-04-18T04:43:31.172 INFO:teuthology.orchestra.run.smithi120.stdout: mds bal fragment size max = 10000 2024-04-18T04:43:31.172 INFO:teuthology.orchestra.run.smithi120.stdout: mds bal merge size = 5 2024-04-18T04:43:31.172 INFO:teuthology.orchestra.run.smithi120.stdout: mds bal split bits = 3 2024-04-18T04:43:31.172 INFO:teuthology.orchestra.run.smithi120.stdout: mds bal split size = 100 2024-04-18T04:43:31.172 INFO:teuthology.orchestra.run.smithi120.stdout: mds debug frag = True 2024-04-18T04:43:31.172 INFO:teuthology.orchestra.run.smithi120.stdout: mds debug scatterstat = True 2024-04-18T04:43:31.173 INFO:teuthology.orchestra.run.smithi120.stdout: mds oft prefetch dirfrags = False 2024-04-18T04:43:31.173 INFO:teuthology.orchestra.run.smithi120.stdout: mds op complaint time = 180 2024-04-18T04:43:31.173 INFO:teuthology.orchestra.run.smithi120.stdout: mds verify scatter = True 2024-04-18T04:43:31.173 INFO:teuthology.orchestra.run.smithi120.stdout: mds_dir_prefetch = False 2024-04-18T04:43:31.173 INFO:teuthology.orchestra.run.smithi120.stdout: mds_sleep_rank_change = 5000000.0 2024-04-18T04:43:31.173 INFO:teuthology.orchestra.run.smithi120.stdout: mon client directed command retry = 5 2024-04-18T04:43:31.173 INFO:teuthology.orchestra.run.smithi120.stdout: ms inject delay max = 1 2024-04-18T04:43:31.173 INFO:teuthology.orchestra.run.smithi120.stdout: ms inject delay probability = 0.005 2024-04-18T04:43:31.173 INFO:teuthology.orchestra.run.smithi120.stdout: ms inject delay type = client mds osd 2024-04-18T04:43:31.173 INFO:teuthology.orchestra.run.smithi120.stdout: ms inject socket failures = 2500 2024-04-18T04:43:31.173 INFO:teuthology.orchestra.run.smithi120.stdout: osd op complaint time = 180 2024-04-18T04:43:31.173 INFO:teuthology.orchestra.run.smithi120.stdout: rados mon op timeout = 900 2024-04-18T04:43:31.173 INFO:teuthology.orchestra.run.smithi120.stdout: rados osd op timeout = 900 2024-04-18T04:43:31.175 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-18T04:43:31.175 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-18T04:43:31.276 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-18T04:43:31.276 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-18T04:43:31.277 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-18T04:43:31.285 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-18T04:43:31.285 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-18T04:43:31.337 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi120.front.sepia.ceph.com 2024-04-18T04:43:31.337 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-18T04:43:31.337 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-18T04:43:31.337 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-18T04:43:31.408 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-18T04:43:31.408 DEBUG:teuthology.orchestra.run.smithi120:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-18T04:43:31.457 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi132.front.sepia.ceph.com 2024-04-18T04:43:31.457 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-18T04:43:31.457 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-18T04:43:31.457 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-18T04:43:31.482 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-18T04:43:31.482 DEBUG:teuthology.orchestra.run.smithi132:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-18T04:43:31.529 INFO:tasks.ceph:Setting up mon nodes... 2024-04-18T04:43:31.529 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-18T04:43:31.529 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-18T04:43:31.583 INFO:teuthology.orchestra.run.smithi120.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-18T04:43:31.588 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-18T04:43:31.630 INFO:teuthology.orchestra.run.smithi132.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-18T04:43:31.644 INFO:tasks.ceph:Setting up mds nodes... 2024-04-18T04:43:31.645 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-18T04:43:31.699 INFO:teuthology.orchestra.run.smithi120.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-18T04:43:31.703 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-18T04:43:31.722 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-18T04:43:31.817 INFO:teuthology.orchestra.run.smithi120.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-18T04:43:31.822 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-18T04:43:31.841 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-04-18T04:43:31.939 INFO:teuthology.orchestra.run.smithi120.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-04-18T04:43:31.943 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-04-18T04:43:31.963 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-18T04:43:32.007 INFO:teuthology.orchestra.run.smithi132.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-18T04:43:32.009 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-18T04:43:32.064 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-18T04:43:32.146 INFO:teuthology.orchestra.run.smithi132.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-18T04:43:32.149 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-18T04:43:32.205 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-04-18T04:43:32.288 INFO:teuthology.orchestra.run.smithi132.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-04-18T04:43:32.291 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-04-18T04:43:32.345 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-18T04:43:32.345 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-18T04:43:32.386 INFO:teuthology.orchestra.run.smithi120.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-18T04:43:32.402 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-18T04:43:32.402 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi120.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi132.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-18T04:43:32.402 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-18T04:43:32.463 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-18T04:43:32.464 INFO:tasks.ceph:role: osd.0 2024-04-18T04:43:32.464 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi120.front.sepia.ceph.com 2024-04-18T04:43:32.464 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-18T04:43:32.531 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T04:43:32.531 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T04:43:32.531 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T04:43:32.531 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-18T04:43:32.531 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T04:43:32.531 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2024-04-18T04:43:32.532 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T04:43:32.532 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T04:43:32.532 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T04:43:32.532 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T04:43:32.925 INFO:teuthology.orchestra.run.smithi120.stdout:Discarding blocks...Done. 2024-04-18T04:43:32.928 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2024-04-18T04:43:32.928 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-18T04:43:33.027 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-18T04:43:33.043 INFO:teuthology.orchestra.run.smithi120.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T04:43:33.044 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T04:43:33.044 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-18T04:43:33.108 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-18T04:43:33.108 INFO:tasks.ceph:role: osd.1 2024-04-18T04:43:33.108 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi120.front.sepia.ceph.com 2024-04-18T04:43:33.108 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-18T04:43:33.179 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T04:43:33.180 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T04:43:33.180 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T04:43:33.180 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-18T04:43:33.180 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T04:43:33.180 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2024-04-18T04:43:33.180 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T04:43:33.180 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T04:43:33.180 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T04:43:33.180 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T04:43:33.584 INFO:teuthology.orchestra.run.smithi120.stdout:Discarding blocks...Done. 2024-04-18T04:43:33.587 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2024-04-18T04:43:33.587 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-18T04:43:33.703 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-18T04:43:33.721 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T04:43:33.722 INFO:teuthology.orchestra.run.smithi120.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T04:43:33.722 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-18T04:43:33.788 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-18T04:43:33.788 INFO:tasks.ceph:role: osd.2 2024-04-18T04:43:33.788 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi120.front.sepia.ceph.com 2024-04-18T04:43:33.788 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-18T04:43:33.860 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T04:43:33.860 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T04:43:33.860 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T04:43:33.860 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-18T04:43:33.860 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T04:43:33.860 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2024-04-18T04:43:33.860 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T04:43:33.860 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T04:43:33.860 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T04:43:33.860 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T04:43:34.273 INFO:teuthology.orchestra.run.smithi120.stdout:Discarding blocks...Done. 2024-04-18T04:43:34.276 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2024-04-18T04:43:34.276 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-18T04:43:34.391 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-18T04:43:34.408 INFO:teuthology.orchestra.run.smithi120.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T04:43:34.408 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T04:43:34.409 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-18T04:43:34.473 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-18T04:43:34.473 INFO:tasks.ceph:role: osd.3 2024-04-18T04:43:34.473 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi120.front.sepia.ceph.com 2024-04-18T04:43:34.473 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-18T04:43:34.540 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T04:43:34.540 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T04:43:34.540 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T04:43:34.540 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-18T04:43:34.540 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T04:43:34.540 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2024-04-18T04:43:34.540 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T04:43:34.540 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T04:43:34.540 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T04:43:34.541 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T04:43:34.907 INFO:teuthology.orchestra.run.smithi120.stdout:Discarding blocks...Done. 2024-04-18T04:43:34.910 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2024-04-18T04:43:34.910 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-18T04:43:34.985 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-18T04:43:35.041 INFO:teuthology.orchestra.run.smithi120.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T04:43:35.042 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T04:43:35.043 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T04:43:35.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:43:35.164+0000 7f30f57ad7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-18T04:43:35.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:43:35.168+0000 7f30f57ad7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-18T04:43:35.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:43:35.168+0000 7f30f57ad7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-18T04:43:35.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:43:35.168+0000 7f30f57ad7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-18T04:43:35.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:43:35.168+0000 7f30f57ad7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-18T04:43:35.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:43:35.176+0000 7f30f57ad7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-18T04:43:38.218 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-18T04:43:38.239 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T04:43:38.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:43:38.336+0000 7f323bc677c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-18T04:43:38.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:43:38.336+0000 7f323bc677c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-18T04:43:38.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:43:38.336+0000 7f323bc677c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-18T04:43:38.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:43:38.336+0000 7f323bc677c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-18T04:43:38.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:43:38.336+0000 7f323bc677c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-18T04:43:38.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:43:38.340+0000 7f323bc677c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-18T04:43:41.368 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-18T04:43:41.390 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T04:43:41.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:43:41.488+0000 7ff58399d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-18T04:43:41.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:43:41.488+0000 7ff58399d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-18T04:43:41.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:43:41.488+0000 7ff58399d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-18T04:43:41.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:43:41.488+0000 7ff58399d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-18T04:43:41.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:43:41.488+0000 7ff58399d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-18T04:43:41.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:43:41.488+0000 7ff58399d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-18T04:43:44.519 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-18T04:43:44.540 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T04:43:44.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:43:44.636+0000 7ff85b7fb7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-18T04:43:44.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:43:44.636+0000 7ff85b7fb7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-18T04:43:44.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:43:44.636+0000 7ff85b7fb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-18T04:43:44.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:43:44.636+0000 7ff85b7fb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-18T04:43:44.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:43:44.636+0000 7ff85b7fb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-18T04:43:44.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:43:44.636+0000 7ff85b7fb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-18T04:43:47.687 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-18T04:43:47.708 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-18T04:43:47.723 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-18T04:43:47.723 INFO:tasks.ceph:role: osd.4 2024-04-18T04:43:47.723 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi132.front.sepia.ceph.com 2024-04-18T04:43:47.724 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-18T04:43:47.788 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T04:43:47.788 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T04:43:47.788 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T04:43:47.788 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-18T04:43:47.788 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T04:43:47.788 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2024-04-18T04:43:47.788 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T04:43:47.789 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T04:43:47.789 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T04:43:47.789 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T04:43:48.243 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2024-04-18T04:43:48.245 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2024-04-18T04:43:48.246 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-18T04:43:48.354 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-18T04:43:48.363 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T04:43:48.363 INFO:teuthology.orchestra.run.smithi132.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T04:43:48.364 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-18T04:43:48.418 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-18T04:43:48.418 INFO:tasks.ceph:role: osd.5 2024-04-18T04:43:48.418 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi132.front.sepia.ceph.com 2024-04-18T04:43:48.418 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-18T04:43:48.479 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T04:43:48.479 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T04:43:48.480 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T04:43:48.480 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-18T04:43:48.480 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T04:43:48.480 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2024-04-18T04:43:48.480 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T04:43:48.480 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T04:43:48.480 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T04:43:48.480 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T04:43:48.952 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2024-04-18T04:43:48.955 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2024-04-18T04:43:48.955 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-18T04:43:49.093 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-18T04:43:49.104 INFO:teuthology.orchestra.run.smithi132.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T04:43:49.105 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T04:43:49.106 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-18T04:43:49.159 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-18T04:43:49.159 INFO:tasks.ceph:role: osd.6 2024-04-18T04:43:49.159 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi132.front.sepia.ceph.com 2024-04-18T04:43:49.159 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-18T04:43:49.220 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T04:43:49.220 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T04:43:49.221 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T04:43:49.221 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-18T04:43:49.221 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T04:43:49.221 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2024-04-18T04:43:49.221 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T04:43:49.221 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T04:43:49.221 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T04:43:49.222 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T04:43:49.700 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2024-04-18T04:43:49.706 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2024-04-18T04:43:49.706 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-18T04:43:49.852 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-18T04:43:49.864 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T04:43:49.865 INFO:teuthology.orchestra.run.smithi132.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T04:43:49.865 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-18T04:43:49.920 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-18T04:43:49.920 INFO:tasks.ceph:role: osd.7 2024-04-18T04:43:49.920 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi132.front.sepia.ceph.com 2024-04-18T04:43:49.921 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-18T04:43:49.983 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T04:43:49.983 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T04:43:49.983 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T04:43:49.983 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-18T04:43:49.983 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T04:43:49.983 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2024-04-18T04:43:49.983 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T04:43:49.983 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T04:43:49.983 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T04:43:49.984 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T04:43:50.403 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2024-04-18T04:43:50.405 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2024-04-18T04:43:50.405 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-18T04:43:50.499 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-18T04:43:50.510 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T04:43:50.510 INFO:teuthology.orchestra.run.smithi132.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T04:43:50.510 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T04:43:50.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:43:50.622+0000 7fce675c57c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-18T04:43:50.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:43:50.626+0000 7fce675c57c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-18T04:43:50.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:43:50.626+0000 7fce675c57c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-18T04:43:50.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:43:50.626+0000 7fce675c57c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-18T04:43:50.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:43:50.626+0000 7fce675c57c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-18T04:43:50.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:43:50.626+0000 7fce675c57c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-18T04:43:53.596 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-18T04:43:53.609 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T04:43:53.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:43:53.694+0000 7ff455fe37c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-18T04:43:53.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:43:53.694+0000 7ff455fe37c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-18T04:43:53.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:43:53.694+0000 7ff455fe37c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-18T04:43:53.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:43:53.694+0000 7ff455fe37c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-18T04:43:53.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:43:53.694+0000 7ff455fe37c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-18T04:43:53.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:43:53.694+0000 7ff455fe37c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-18T04:43:56.660 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-18T04:43:56.717 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T04:43:56.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:43:56.798+0000 7f51b85ff7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-18T04:43:56.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:43:56.802+0000 7f51b85ff7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-18T04:43:56.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:43:56.802+0000 7f51b85ff7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-18T04:43:56.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:43:56.802+0000 7f51b85ff7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-18T04:43:56.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:43:56.802+0000 7f51b85ff7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-18T04:43:56.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:43:56.802+0000 7f51b85ff7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-18T04:43:59.287 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:43:59.291 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:43:59.774 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-18T04:43:59.788 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T04:43:59.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:43:59.870+0000 7f07083267c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-18T04:43:59.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:43:59.870+0000 7f07083267c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-18T04:43:59.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:43:59.870+0000 7f07083267c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-18T04:43:59.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:43:59.870+0000 7f07083267c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-18T04:43:59.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:43:59.870+0000 7f07083267c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-18T04:43:59.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:43:59.870+0000 7f07083267c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-18T04:44:02.832 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-18T04:44:02.889 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-18T04:44:02.889 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-18T04:44:02.889 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-18T04:44:02.912 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-18T04:44:02.912 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-18T04:44:02.973 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-18T04:44:02.973 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-18T04:44:03.037 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-18T04:44:03.038 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-04-18T04:44:03.101 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-18T04:44:03.101 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-18T04:44:03.165 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-18T04:44:03.166 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-18T04:44:03.230 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-18T04:44:03.230 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-18T04:44:03.294 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-18T04:44:03.294 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-18T04:44:03.357 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-18T04:44:03.357 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-18T04:44:03.371 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-18T04:44:03.371 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-18T04:44:03.428 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-18T04:44:03.429 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-18T04:44:03.484 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-18T04:44:03.484 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-04-18T04:44:03.540 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-18T04:44:03.540 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-18T04:44:03.596 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-18T04:44:03.596 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-18T04:44:03.652 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-18T04:44:03.652 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-18T04:44:03.708 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-18T04:44:03.708 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-18T04:44:03.764 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-18T04:44:03.764 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-18T04:44:03.773 INFO:tasks.ceph:Adding keys to all mons... 2024-04-18T04:44:03.773 DEBUG:teuthology.orchestra.run.smithi120:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-18T04:44:03.816 DEBUG:teuthology.orchestra.run.smithi132:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-18T04:44:03.827 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr.y] 2024-04-18T04:44:03.827 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQDzpCBmieQIIxAAEW824X/Td8HwJUJ6vozS/A== 2024-04-18T04:44:03.827 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.a] 2024-04-18T04:44:03.827 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQDzpCBmSB3vKRAAXamspR6SAyePRzZyUz0UdQ== 2024-04-18T04:44:03.827 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.c] 2024-04-18T04:44:03.827 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQDzpCBmx/cDMRAAj4ruVH0/HA9XBhbgrTGF1g== 2024-04-18T04:44:03.827 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.e] 2024-04-18T04:44:03.827 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQDzpCBmCMRAOBAAbjVgheY2gt4Bpv/NdT7d0w== 2024-04-18T04:44:03.827 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.0] 2024-04-18T04:44:03.827 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQD3pCBmjLUXChAAiQr9Pu3F9xvDD2gawzyPaQ== 2024-04-18T04:44:03.827 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.1] 2024-04-18T04:44:03.828 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQD6pCBm7mVCFBAAkJVXpQjIm/uk3EDtRJNh7g== 2024-04-18T04:44:03.828 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.2] 2024-04-18T04:44:03.828 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQD9pCBmlHFGHRAAnDpH3d11/ElloXjn4Po4hg== 2024-04-18T04:44:03.828 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.3] 2024-04-18T04:44:03.828 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAApSBmpVERJhAAiCWCRgu+1YjUZlWNXBQWRQ== 2024-04-18T04:44:03.828 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr.x] 2024-04-18T04:44:03.828 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQDzpCBm48PkJRAAjSrRrfHcbz28S+nT9l/J6Q== 2024-04-18T04:44:03.828 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.b] 2024-04-18T04:44:03.828 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQD0pCBmOa28ABAASkK/uorTirmF61Ua0qfqjQ== 2024-04-18T04:44:03.828 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.d] 2024-04-18T04:44:03.828 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQD0pCBmadMNCRAAgqCpXTtrxDJKcmjBRtfotQ== 2024-04-18T04:44:03.828 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.f] 2024-04-18T04:44:03.828 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQD0pCBmFLB5ERAAjZnXUJe5FAw9iFXcb35uDg== 2024-04-18T04:44:03.828 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.4] 2024-04-18T04:44:03.828 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAGpSBm3lpcJRAABBd3kC/xERxhv62aM7iKDw== 2024-04-18T04:44:03.829 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.5] 2024-04-18T04:44:03.829 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAJpSBm5LC1KRAAYj4hC9iVBBCbjIysHgkGCg== 2024-04-18T04:44:03.829 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.6] 2024-04-18T04:44:03.829 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAMpSBmqx4BMBAATWWachdEid7NN9g6oHcoPQ== 2024-04-18T04:44:03.829 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.7] 2024-04-18T04:44:03.829 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAPpSBmp3klNBAAlv6oQhTBEo9xeE6bbyYdMw== 2024-04-18T04:44:03.829 INFO:teuthology.orchestra.run.smithi132.stdout:[client.0] 2024-04-18T04:44:03.829 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQD0pCBmagBLFxAAJ8oU/E7Pb8WHE/4zF1gziQ== 2024-04-18T04:44:03.831 INFO:teuthology.orchestra.run.smithi120.stdout:[mgr.y] 2024-04-18T04:44:03.831 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQDzpCBmieQIIxAAEW824X/Td8HwJUJ6vozS/A== 2024-04-18T04:44:03.831 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.a] 2024-04-18T04:44:03.831 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQDzpCBmSB3vKRAAXamspR6SAyePRzZyUz0UdQ== 2024-04-18T04:44:03.831 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.c] 2024-04-18T04:44:03.831 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQDzpCBmx/cDMRAAj4ruVH0/HA9XBhbgrTGF1g== 2024-04-18T04:44:03.831 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.e] 2024-04-18T04:44:03.831 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQDzpCBmCMRAOBAAbjVgheY2gt4Bpv/NdT7d0w== 2024-04-18T04:44:03.831 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.0] 2024-04-18T04:44:03.831 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQD3pCBmjLUXChAAiQr9Pu3F9xvDD2gawzyPaQ== 2024-04-18T04:44:03.831 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.1] 2024-04-18T04:44:03.832 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQD6pCBm7mVCFBAAkJVXpQjIm/uk3EDtRJNh7g== 2024-04-18T04:44:03.832 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.2] 2024-04-18T04:44:03.832 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQD9pCBmlHFGHRAAnDpH3d11/ElloXjn4Po4hg== 2024-04-18T04:44:03.832 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.3] 2024-04-18T04:44:03.832 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQAApSBmpVERJhAAiCWCRgu+1YjUZlWNXBQWRQ== 2024-04-18T04:44:03.832 INFO:teuthology.orchestra.run.smithi120.stdout:[mgr.x] 2024-04-18T04:44:03.832 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQDzpCBm48PkJRAAjSrRrfHcbz28S+nT9l/J6Q== 2024-04-18T04:44:03.832 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.b] 2024-04-18T04:44:03.832 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQD0pCBmOa28ABAASkK/uorTirmF61Ua0qfqjQ== 2024-04-18T04:44:03.832 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.d] 2024-04-18T04:44:03.832 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQD0pCBmadMNCRAAgqCpXTtrxDJKcmjBRtfotQ== 2024-04-18T04:44:03.832 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.f] 2024-04-18T04:44:03.832 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQD0pCBmFLB5ERAAjZnXUJe5FAw9iFXcb35uDg== 2024-04-18T04:44:03.832 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.4] 2024-04-18T04:44:03.832 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQAGpSBm3lpcJRAABBd3kC/xERxhv62aM7iKDw== 2024-04-18T04:44:03.833 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.5] 2024-04-18T04:44:03.833 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQAJpSBm5LC1KRAAYj4hC9iVBBCbjIysHgkGCg== 2024-04-18T04:44:03.833 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.6] 2024-04-18T04:44:03.833 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQAMpSBmqx4BMBAATWWachdEid7NN9g6oHcoPQ== 2024-04-18T04:44:03.833 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.7] 2024-04-18T04:44:03.833 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQAPpSBmp3klNBAAlv6oQhTBEo9xeE6bbyYdMw== 2024-04-18T04:44:03.833 INFO:teuthology.orchestra.run.smithi120.stdout:[client.0] 2024-04-18T04:44:03.833 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQD0pCBmagBLFxAAJ8oU/E7Pb8WHE/4zF1gziQ== 2024-04-18T04:44:03.834 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-18T04:44:03.882 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-18T04:44:03.935 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-18T04:44:03.938 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-18T04:44:04.015 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-18T04:44:04.018 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-18T04:44:04.099 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-18T04:44:04.102 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-18T04:44:04.183 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T04:44:04.186 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T04:44:04.263 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T04:44:04.267 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T04:44:04.349 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T04:44:04.352 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T04:44:04.402 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T04:44:04.405 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T04:44:04.475 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-18T04:44:04.479 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-18T04:44:04.554 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-18T04:44:04.558 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-18T04:44:04.643 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-18T04:44:04.646 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-18T04:44:04.731 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-18T04:44:04.734 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-18T04:44:04.824 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T04:44:04.827 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T04:44:04.911 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T04:44:04.914 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T04:44:04.993 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T04:44:04.996 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T04:44:05.075 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T04:44:05.078 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T04:44:05.156 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-18T04:44:05.159 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-18T04:44:05.248 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-18T04:44:05.249 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-18T04:44:05.268 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-18T04:44:05.373 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-18T04:44:05.392 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-18T04:44:05.406 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-18T04:44:05.502 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-18T04:44:05.514 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-18T04:44:05.566 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-18T04:44:05.659 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-18T04:44:05.670 DEBUG:teuthology.orchestra.run.smithi120:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-18T04:44:05.673 DEBUG:teuthology.orchestra.run.smithi132:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-18T04:44:05.716 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-18T04:44:05.716 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-18T04:44:05.716 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-18T04:44:05.724 INFO:tasks.ceph.mon.a:Started 2024-04-18T04:44:05.724 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-18T04:44:05.724 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-18T04:44:05.761 INFO:tasks.ceph.mon.b:Started 2024-04-18T04:44:05.761 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-18T04:44:05.761 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-18T04:44:05.763 INFO:tasks.ceph.mon.c:Started 2024-04-18T04:44:05.763 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-18T04:44:05.764 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-18T04:44:05.764 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-18T04:44:05.767 INFO:tasks.ceph.mgr.y:Started 2024-04-18T04:44:05.767 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-18T04:44:05.767 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-18T04:44:05.769 INFO:tasks.ceph.mgr.x:Started 2024-04-18T04:44:05.769 INFO:tasks.ceph:Setting crush tunables to default 2024-04-18T04:44:05.769 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd crush tunables default 2024-04-18T04:44:05.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:05.907+0000 7f6c8a000640 1 Processor -- start 2024-04-18T04:44:05.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:05.907+0000 7f6c8a000640 1 -- start start 2024-04-18T04:44:05.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:05.907+0000 7f6c8a000640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6c841535a0 0x7f6c84069ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:05.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:05.907+0000 7f6c8a000640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c8415a460 con 0x7f6c84153980 2024-04-18T04:44:05.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:05.907+0000 7f6c8a000640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c841598e0 con 0x7f6c8406d490 2024-04-18T04:44:05.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:05.907+0000 7f6c8a000640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c84159bc0 con 0x7f6c841535a0 2024-04-18T04:44:05.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:05.907+0000 7f6c83e00640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f6c84153980 0x7f6c8406cd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:51198/0 (socket says 172.21.15.120:51198) 2024-04-18T04:44:05.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:05.907+0000 7f6c83e00640 1 -- 172.21.15.120:0/3422925360 learned_addr learned my addr 172.21.15.120:0/3422925360 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:44:05.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:05.907+0000 7f6c88c00640 1 --2- 172.21.15.120:0/3422925360 >> v2:172.21.15.132:3300/0 conn(0x7f6c841535a0 0x7f6c84069ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:05.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:05.911+0000 7f6c88c00640 1 -- 172.21.15.120:0/3422925360 >> v2:172.21.15.132:3300/0 conn(0x7f6c841535a0 msgr2=0x7f6c84069ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T04:44:05.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:05.911+0000 7f6c88c00640 1 -- 172.21.15.120:0/3422925360 >> v2:172.21.15.132:3300/0 conn(0x7f6c841535a0 msgr2=0x7f6c84069ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:44:05.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:05.911+0000 7f6c88c00640 1 --2- 172.21.15.120:0/3422925360 >> v2:172.21.15.132:3300/0 conn(0x7f6c841535a0 0x7f6c84069ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:44:05.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:05.911+0000 7f6c88c00640 1 --2- 172.21.15.120:0/3422925360 >> v2:172.21.15.132:3300/0 conn(0x7f6c841535a0 0x7f6c84069ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:44:06.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.115+0000 7f6c88c00640 1 --2- 172.21.15.120:0/3422925360 >> v2:172.21.15.132:3300/0 conn(0x7f6c841535a0 0x7f6c84069ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:06.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.115+0000 7f6c88c00640 1 -- 172.21.15.120:0/3422925360 >> v2:172.21.15.132:3300/0 conn(0x7f6c841535a0 msgr2=0x7f6c84069ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T04:44:06.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.115+0000 7f6c88c00640 1 -- 172.21.15.120:0/3422925360 >> v2:172.21.15.132:3300/0 conn(0x7f6c841535a0 msgr2=0x7f6c84069ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:44:06.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.115+0000 7f6c88c00640 1 --2- 172.21.15.120:0/3422925360 >> v2:172.21.15.132:3300/0 conn(0x7f6c841535a0 0x7f6c84069ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:44:06.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.115+0000 7f6c88c00640 1 --2- 172.21.15.120:0/3422925360 >> v2:172.21.15.132:3300/0 conn(0x7f6c841535a0 0x7f6c84069ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-18T04:44:06.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.159+0000 7f6c83400640 1 -- 172.21.15.120:0/3422925360 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4256283779 0 0) 0x7f6c8415a460 con 0x7f6c84153980 2024-04-18T04:44:06.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.159+0000 7f6c83400640 1 -- 172.21.15.120:0/3422925360 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c6c003530 con 0x7f6c84153980 2024-04-18T04:44:06.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.159+0000 7f6c83400640 1 -- 172.21.15.120:0/3422925360 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1564992937 0 0) 0x7f6c6c003530 con 0x7f6c84153980 2024-04-18T04:44:06.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.159+0000 7f6c83400640 1 -- 172.21.15.120:0/3422925360 >> v2:172.21.15.132:3300/0 conn(0x7f6c841535a0 msgr2=0x7f6c84069ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:44:06.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.159+0000 7f6c83400640 1 --2- 172.21.15.120:0/3422925360 >> v2:172.21.15.132:3300/0 conn(0x7f6c841535a0 0x7f6c84069ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:06.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.159+0000 7f6c83400640 1 -- 172.21.15.120:0/3422925360 >> v1:172.21.15.132:6789/0 conn(0x7f6c8406d490 legacy=0x7f6c84163e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:06.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.159+0000 7f6c83400640 1 -- 172.21.15.120:0/3422925360 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c84159ea0 con 0x7f6c84153980 2024-04-18T04:44:06.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.159+0000 7f6c83400640 1 -- 172.21.15.120:0/3422925360 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7f6c70001680 con 0x7f6c84153980 2024-04-18T04:44:06.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.159+0000 7f6c83400640 1 -- 172.21.15.120:0/3422925360 >> v1:172.21.15.120:6789/0 conn(0x7f6c84153980 legacy=0x7f6c8406cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:06.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.159+0000 7f6c83400640 1 --2- 172.21.15.120:0/3422925360 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c6c0039d0 0x7f6c6c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:06.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.159+0000 7f6c83400640 1 --2- 172.21.15.120:0/3422925360 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c6c0047d0 0x7f6c6c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:06.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.159+0000 7f6c83400640 1 --2- 172.21.15.120:0/3422925360 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c6c0052b0 0x7f6c6c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:06.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.159+0000 7f6c83400640 1 -- 172.21.15.120:0/3422925360 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c84159bc0 con 0x7f6c6c0052b0 2024-04-18T04:44:06.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.159+0000 7f6c83400640 1 -- 172.21.15.120:0/3422925360 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6c00c1d0 con 0x7f6c6c0039d0 2024-04-18T04:44:06.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.159+0000 7f6c83400640 1 -- 172.21.15.120:0/3422925360 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6c00c390 con 0x7f6c6c0047d0 2024-04-18T04:44:06.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.159+0000 7f6c88c00640 1 --2- 172.21.15.120:0/3422925360 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c6c0039d0 0x7f6c6c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:06.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.159+0000 7f6c89600640 1 --2- 172.21.15.120:0/3422925360 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c6c0052b0 0x7f6c6c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:06.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.159+0000 7f6c83e00640 1 --2- 172.21.15.120:0/3422925360 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c6c0047d0 0x7f6c6c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:06.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.159+0000 7f6c89600640 1 -- 172.21.15.120:0/3422925360 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c6c0047d0 msgr2=0x7f6c6c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:06.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.159+0000 7f6c89600640 1 --2- 172.21.15.120:0/3422925360 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c6c0047d0 0x7f6c6c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:06.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.159+0000 7f6c89600640 1 -- 172.21.15.120:0/3422925360 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c6c0039d0 msgr2=0x7f6c6c003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:06.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.159+0000 7f6c89600640 1 --2- 172.21.15.120:0/3422925360 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c6c0039d0 0x7f6c6c003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:06.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.159+0000 7f6c89600640 1 -- 172.21.15.120:0/3422925360 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c6c003530 con 0x7f6c6c0052b0 2024-04-18T04:44:06.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.163+0000 7f6c89600640 1 -- 172.21.15.120:0/3422925360 reap_dead start 2024-04-18T04:44:06.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.163+0000 7f6c89600640 1 --2- 172.21.15.120:0/3422925360 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c6c0052b0 0x7f6c6c00b990 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c001e40 tx=0x7f6c7c01c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a4d129daacea8b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:06.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.163+0000 7f6c83400640 1 -- 172.21.15.120:0/3422925360 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c003b80 con 0x7f6c6c0052b0 2024-04-18T04:44:06.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.163+0000 7f6c83400640 1 -- 172.21.15.120:0/3422925360 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7c003ce0 con 0x7f6c6c0052b0 2024-04-18T04:44:06.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.163+0000 7f6c83400640 1 -- 172.21.15.120:0/3422925360 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c005310 con 0x7f6c6c0052b0 2024-04-18T04:44:06.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.167+0000 7f6c8a000640 1 -- 172.21.15.120:0/3422925360 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c6c0052b0 msgr2=0x7f6c6c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:06.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.167+0000 7f6c8a000640 1 --2- 172.21.15.120:0/3422925360 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c6c0052b0 0x7f6c6c00b990 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c001e40 tx=0x7f6c7c01c700 comp rx=0 tx=0).stop 2024-04-18T04:44:06.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.167+0000 7f6c8a000640 1 -- 172.21.15.120:0/3422925360 shutdown_connections 2024-04-18T04:44:06.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.167+0000 7f6c8a000640 1 --2- 172.21.15.120:0/3422925360 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c6c0052b0 0x7f6c6c00b990 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:06.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.167+0000 7f6c8a000640 1 -- 172.21.15.120:0/3422925360 >> 172.21.15.120:0/3422925360 conn(0x7f6c8406e210 msgr2=0x7f6c8406e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:06.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.167+0000 7f6c8a000640 1 -- 172.21.15.120:0/3422925360 shutdown_connections 2024-04-18T04:44:06.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.167+0000 7f6c8a000640 1 -- 172.21.15.120:0/3422925360 wait complete. 2024-04-18T04:44:06.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.167+0000 7f6c8a000640 1 Processor -- start 2024-04-18T04:44:06.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.167+0000 7f6c8a000640 1 -- start start 2024-04-18T04:44:06.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.167+0000 7f6c8a000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c6c0052b0 0x7f6c841efd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:06.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.167+0000 7f6c8a000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c841f0240 0x7f6c8415c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:06.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.167+0000 7f6c8a000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c84072290 0x7f6c8415c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:06.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.167+0000 7f6c8a000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8415ba50 con 0x7f6c841f0240 2024-04-18T04:44:06.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.167+0000 7f6c8a000640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8414fac0 con 0x7f6c84072290 2024-04-18T04:44:06.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.167+0000 7f6c8a000640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8414f2b0 con 0x7f6c6c0052b0 2024-04-18T04:44:06.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.171+0000 7f6c83e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c841f0240 0x7f6c8415c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:06.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.171+0000 7f6c89600640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c84072290 0x7f6c8415c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:06.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.171+0000 7f6c83e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c841f0240 0x7f6c8415c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58360/0 (socket says 172.21.15.120:58360) 2024-04-18T04:44:06.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.171+0000 7f6c83e00640 1 -- 172.21.15.120:0/2546666800 learned_addr learned my addr 172.21.15.120:0/2546666800 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:06.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.171+0000 7f6c88c00640 1 --2- 172.21.15.120:0/2546666800 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c6c0052b0 0x7f6c841efd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:06.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.171+0000 7f6c83e00640 1 -- 172.21.15.120:0/2546666800 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c6c0052b0 msgr2=0x7f6c841efd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:06.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.171+0000 7f6c83e00640 1 --2- 172.21.15.120:0/2546666800 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c6c0052b0 0x7f6c841efd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:06.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.171+0000 7f6c83e00640 1 -- 172.21.15.120:0/2546666800 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c84072290 msgr2=0x7f6c8415c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:06.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.171+0000 7f6c83e00640 1 --2- 172.21.15.120:0/2546666800 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c84072290 0x7f6c8415c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:06.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.171+0000 7f6c83e00640 1 -- 172.21.15.120:0/2546666800 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8415a680 con 0x7f6c841f0240 2024-04-18T04:44:06.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.171+0000 7f6c83e00640 1 --2- 172.21.15.120:0/2546666800 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c841f0240 0x7f6c8415c320 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6c70004880 tx=0x7f6c70011d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:06.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.171+0000 7f6c80c00640 1 -- 172.21.15.120:0/2546666800 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7000fb60 con 0x7f6c841f0240 2024-04-18T04:44:06.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.171+0000 7f6c80c00640 1 -- 172.21.15.120:0/2546666800 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7000fd00 con 0x7f6c841f0240 2024-04-18T04:44:06.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.171+0000 7f6c80c00640 1 -- 172.21.15.120:0/2546666800 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c70015650 con 0x7f6c841f0240 2024-04-18T04:44:06.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.171+0000 7f6c8a000640 1 -- 172.21.15.120:0/2546666800 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c84157720 con 0x7f6c841f0240 2024-04-18T04:44:06.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.171+0000 7f6c8a000640 1 -- 172.21.15.120:0/2546666800 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c8414f500 con 0x7f6c841f0240 2024-04-18T04:44:06.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.171+0000 7f6c80c00640 1 -- 172.21.15.120:0/2546666800 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f6c700157b0 con 0x7f6c841f0240 2024-04-18T04:44:06.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.171+0000 7f6c80c00640 1 -- 172.21.15.120:0/2546666800 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6c7001f710 con 0x7f6c841f0240 2024-04-18T04:44:06.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.171+0000 7f6c8a000640 1 -- 172.21.15.120:0/2546666800 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c84067070 con 0x7f6c841f0240 2024-04-18T04:44:06.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.175+0000 7f6c80c00640 1 -- 172.21.15.120:0/2546666800 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f6c70010040 con 0x7f6c841f0240 2024-04-18T04:44:06.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.239+0000 7f6c8a000640 1 -- 172.21.15.120:0/2546666800 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f6c841524c0 con 0x7f6c841f0240 2024-04-18T04:44:06.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.243+0000 7f6c80c00640 1 -- 172.21.15.120:0/2546666800 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f6c70015c40 con 0x7f6c841f0240 2024-04-18T04:44:06.243 INFO:teuthology.orchestra.run.smithi120.stderr:adjusted tunables profile to default 2024-04-18T04:44:06.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.243+0000 7f6c8a000640 1 -- 172.21.15.120:0/2546666800 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c841f0240 msgr2=0x7f6c8415c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:06.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.243+0000 7f6c8a000640 1 --2- 172.21.15.120:0/2546666800 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c841f0240 0x7f6c8415c320 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6c70004880 tx=0x7f6c70011d30 comp rx=0 tx=0).stop 2024-04-18T04:44:06.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.243+0000 7f6c8a000640 1 -- 172.21.15.120:0/2546666800 shutdown_connections 2024-04-18T04:44:06.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.243+0000 7f6c8a000640 1 --2- 172.21.15.120:0/2546666800 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c84072290 0x7f6c8415c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:06.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.243+0000 7f6c8a000640 1 --2- 172.21.15.120:0/2546666800 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c841f0240 0x7f6c8415c320 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:06.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.243+0000 7f6c8a000640 1 --2- 172.21.15.120:0/2546666800 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c6c0052b0 0x7f6c841efd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:06.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.243+0000 7f6c8a000640 1 -- 172.21.15.120:0/2546666800 >> 172.21.15.120:0/2546666800 conn(0x7f6c8406e210 msgr2=0x7f6c841502f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:06.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.243+0000 7f6c8a000640 1 -- 172.21.15.120:0/2546666800 shutdown_connections 2024-04-18T04:44:06.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:06.243+0000 7f6c8a000640 1 -- 172.21.15.120:0/2546666800 wait complete. 2024-04-18T04:44:06.262 INFO:tasks.ceph:check_enable_crimson: False 2024-04-18T04:44:06.262 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-18T04:44:06.263 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-18T04:44:06.263 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-18T04:44:06.282 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-18T04:44:06.282 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-18T04:44:06.348 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-18T04:44:06.348 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-18T04:44:06.397 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-18T04:44:06.401+0000 7f3f4e3ae180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-18T04:44:06.401 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-04-18T04:44:06.403+0000 7f9bfaa80180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-18T04:44:06.409 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-18T04:44:06.409 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-18T04:44:06.468 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-18T04:44:06.468 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-18T04:44:06.482 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-18T04:44:06.482 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-18T04:44:06.536 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-18T04:44:06.536 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-18T04:44:06.591 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-18T04:44:06.591 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-18T04:44:06.643 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new a80903bd-d9be-4fb9-af99-6125cb26bd2d 0 2024-04-18T04:44:06.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.809+0000 7f144c87e640 1 Processor -- start 2024-04-18T04:44:06.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.809+0000 7f144c87e640 1 -- start start 2024-04-18T04:44:06.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.809+0000 7f144c87e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f14480cc430 0x7f14480c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:06.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.809+0000 7f144c87e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14480c7670 0x7f14481501e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:06.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.809+0000 7f144c87e640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1448071760 con 0x7f14480cc810 2024-04-18T04:44:06.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.813+0000 7f144c87e640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1448070aa0 con 0x7f14480cc430 2024-04-18T04:44:06.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.813+0000 7f144c87e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1448070d80 con 0x7f14480c7670 2024-04-18T04:44:06.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.813+0000 7f1446d9d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14480c7670 0x7f14481501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:06.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.813+0000 7f1446d9d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14480c7670 0x7f14481501e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.132:52946/0 (socket says 172.21.15.132:52946) 2024-04-18T04:44:06.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.813+0000 7f1446d9d640 1 -- 172.21.15.132:0/3666360700 learned_addr learned my addr 172.21.15.132:0/3666360700 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-18T04:44:06.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.813+0000 7f1446d9d640 1 -- 172.21.15.132:0/3666360700 >> v2:172.21.15.120:3300/0 conn(0x7f14480cc430 msgr2=0x7f14480c68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:06.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.813+0000 7f1446d9d640 1 --2- 172.21.15.132:0/3666360700 >> v2:172.21.15.120:3300/0 conn(0x7f14480cc430 0x7f14480c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:06.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.813+0000 7f1446d9d640 1 -- 172.21.15.132:0/3666360700 >> v1:172.21.15.120:6789/0 conn(0x7f14480cc810 legacy=0x7f1448072130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:06.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.813+0000 7f1446d9d640 1 -- 172.21.15.132:0/3666360700 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14480719b0 con 0x7f14480c7670 2024-04-18T04:44:06.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.813+0000 7f1446d9d640 1 --2- 172.21.15.132:0/3666360700 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14480c7670 0x7f14481501e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1440009870 tx=0x7f144001ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e18bbd2134304807 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:06.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.813+0000 7f1445d9b640 1 -- 172.21.15.132:0/3666360700 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14400a89d0 con 0x7f14480c7670 2024-04-18T04:44:06.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.813+0000 7f1445d9b640 1 -- 172.21.15.132:0/3666360700 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14400a8b30 con 0x7f14480c7670 2024-04-18T04:44:06.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.813+0000 7f1445d9b640 1 -- 172.21.15.132:0/3666360700 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14400b0440 con 0x7f14480c7670 2024-04-18T04:44:06.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.813+0000 7f144c87e640 1 -- 172.21.15.132:0/3666360700 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14480c7670 msgr2=0x7f14481501e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:06.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.813+0000 7f144c87e640 1 --2- 172.21.15.132:0/3666360700 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14480c7670 0x7f14481501e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1440009870 tx=0x7f144001ed10 comp rx=0 tx=0).stop 2024-04-18T04:44:06.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.813+0000 7f144c87e640 1 -- 172.21.15.132:0/3666360700 shutdown_connections 2024-04-18T04:44:06.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.813+0000 7f144c87e640 1 --2- 172.21.15.132:0/3666360700 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14480c7670 0x7f14481501e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:06.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.813+0000 7f144c87e640 1 --2- 172.21.15.132:0/3666360700 >> v2:172.21.15.120:3300/0 conn(0x7f14480cc430 0x7f14480c68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:06.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.813+0000 7f144c87e640 1 -- 172.21.15.132:0/3666360700 >> 172.21.15.132:0/3666360700 conn(0x7f144806b1a0 msgr2=0x7f144806b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:06.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.813+0000 7f144c87e640 1 -- 172.21.15.132:0/3666360700 shutdown_connections 2024-04-18T04:44:06.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.813+0000 7f144c87e640 1 -- 172.21.15.132:0/3666360700 wait complete. 2024-04-18T04:44:06.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.817+0000 7f144c87e640 1 Processor -- start 2024-04-18T04:44:06.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.817+0000 7f144c87e640 1 -- start start 2024-04-18T04:44:06.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.817+0000 7f144c87e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14480c7670 0x7f144814a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:06.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.817+0000 7f144c87e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14480cc430 0x7f14480c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:06.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.817+0000 7f144c87e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14480cc810 0x7f1448148190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:06.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.817+0000 7f144c87e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144814bcb0 con 0x7f14480c7670 2024-04-18T04:44:06.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.817+0000 7f144c87e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144806a640 con 0x7f14480cc430 2024-04-18T04:44:06.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.817+0000 7f144c87e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14480cb6e0 con 0x7f14480cc810 2024-04-18T04:44:06.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.817+0000 7f1446d9d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14480cc810 0x7f1448148190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:06.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.817+0000 7f1446d9d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14480cc810 0x7f1448148190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.132:52952/0 (socket says 172.21.15.132:52952) 2024-04-18T04:44:06.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.817+0000 7f1446d9d640 1 -- 172.21.15.132:0/2065589321 learned_addr learned my addr 172.21.15.132:0/2065589321 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-18T04:44:06.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.817+0000 7f143dd9b640 1 --2- 172.21.15.132:0/2065589321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14480cc430 0x7f14480c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:06.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.817+0000 7f144659c640 1 --2- 172.21.15.132:0/2065589321 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14480c7670 0x7f144814a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:06.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.817+0000 7f1446d9d640 1 -- 172.21.15.132:0/2065589321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14480cc430 msgr2=0x7f14480c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:06.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.817+0000 7f1446d9d640 1 --2- 172.21.15.132:0/2065589321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14480cc430 0x7f14480c9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:06.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.817+0000 7f1446d9d640 1 -- 172.21.15.132:0/2065589321 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14480c7670 msgr2=0x7f144814a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:06.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.817+0000 7f1446d9d640 1 --2- 172.21.15.132:0/2065589321 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14480c7670 0x7f144814a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:06.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.817+0000 7f1446d9d640 1 -- 172.21.15.132:0/2065589321 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14400094d0 con 0x7f14480cc810 2024-04-18T04:44:06.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.817+0000 7f144659c640 1 --2- 172.21.15.132:0/2065589321 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14480c7670 0x7f144814a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:44:06.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.817+0000 7f1446d9d640 1 --2- 172.21.15.132:0/2065589321 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14480cc810 0x7f1448148190 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f144001d3c0 tx=0x7f144001bab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:06.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.817+0000 7f143f7fe640 1 -- 172.21.15.132:0/2065589321 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14400b0da0 con 0x7f14480cc810 2024-04-18T04:44:06.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.817+0000 7f143f7fe640 1 -- 172.21.15.132:0/2065589321 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14400bb470 con 0x7f14480cc810 2024-04-18T04:44:06.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.817+0000 7f144c87e640 1 -- 172.21.15.132:0/2065589321 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14480c19d0 con 0x7f14480cc810 2024-04-18T04:44:06.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.817+0000 7f143f7fe640 1 -- 172.21.15.132:0/2065589321 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14400bb7e0 con 0x7f14480cc810 2024-04-18T04:44:06.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.817+0000 7f144c87e640 1 -- 172.21.15.132:0/2065589321 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f144806a900 con 0x7f14480cc810 2024-04-18T04:44:06.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.821+0000 7f143f7fe640 1 -- 172.21.15.132:0/2065589321 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f14400b7070 con 0x7f14480cc810 2024-04-18T04:44:06.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.821+0000 7f143f7fe640 1 -- 172.21.15.132:0/2065589321 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f14400c59b0 con 0x7f14480cc810 2024-04-18T04:44:06.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.821+0000 7f144c87e640 1 -- 172.21.15.132:0/2065589321 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14480729d0 con 0x7f14480cc810 2024-04-18T04:44:06.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.829+0000 7f143f7fe640 1 -- 172.21.15.132:0/2065589321 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f14400b5070 con 0x7f14480cc810 2024-04-18T04:44:06.894 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-18T04:44:06.897+0000 7f3f4e3ae180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-18T04:44:06.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.897+0000 7f144c87e640 1 -- 172.21.15.132:0/2065589321 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a80903bd-d9be-4fb9-af99-6125cb26bd2d", "id": 0} v 0) v1 -- 0x7f14480729d0 con 0x7f14480cc810 2024-04-18T04:44:06.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.905+0000 7f143f7fe640 1 -- 172.21.15.132:0/2065589321 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a80903bd-d9be-4fb9-af99-6125cb26bd2d", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f14400c5460 con 0x7f14480cc810 2024-04-18T04:44:06.901 INFO:teuthology.orchestra.run.smithi132.stdout:0 2024-04-18T04:44:06.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.905+0000 7f144c87e640 1 -- 172.21.15.132:0/2065589321 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14480cc810 msgr2=0x7f1448148190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:06.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.905+0000 7f144c87e640 1 --2- 172.21.15.132:0/2065589321 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14480cc810 0x7f1448148190 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f144001d3c0 tx=0x7f144001bab0 comp rx=0 tx=0).stop 2024-04-18T04:44:06.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.905+0000 7f144c87e640 1 -- 172.21.15.132:0/2065589321 shutdown_connections 2024-04-18T04:44:06.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.905+0000 7f144c87e640 1 --2- 172.21.15.132:0/2065589321 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14480cc810 0x7f1448148190 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:06.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.905+0000 7f144c87e640 1 --2- 172.21.15.132:0/2065589321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14480cc430 0x7f14480c9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:06.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.905+0000 7f144c87e640 1 --2- 172.21.15.132:0/2065589321 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14480c7670 0x7f144814a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:06.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.905+0000 7f144c87e640 1 -- 172.21.15.132:0/2065589321 >> 172.21.15.132:0/2065589321 conn(0x7f144806b1a0 msgr2=0x7f14480c7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:06.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.905+0000 7f144c87e640 1 -- 172.21.15.132:0/2065589321 shutdown_connections 2024-04-18T04:44:06.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:06.905+0000 7f144c87e640 1 -- 172.21.15.132:0/2065589321 wait complete. 2024-04-18T04:44:06.904 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-04-18T04:44:06.903+0000 7f9bfaa80180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-18T04:44:06.919 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 8f5f004b-6870-4c78-8d50-9622e631ec25 1 2024-04-18T04:44:07.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.037+0000 7fe21de9b640 1 Processor -- start 2024-04-18T04:44:07.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.037+0000 7fe21de9b640 1 -- start start 2024-04-18T04:44:07.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.037+0000 7fe21de9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe2180c68d0 0x7fe2181501e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:07.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.037+0000 7fe21de9b640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe218071760 con 0x7fe2180cc810 2024-04-18T04:44:07.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.037+0000 7fe21de9b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2180c6ce0 con 0x7fe2180cc430 2024-04-18T04:44:07.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.037+0000 7fe21de9b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe218070aa0 con 0x7fe2180c68d0 2024-04-18T04:44:07.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.037+0000 7fe217fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe2180c68d0 0x7fe2181501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:07.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.041+0000 7fe217fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe2180c68d0 0x7fe2181501e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:46236/0 (socket says 172.21.15.132:46236) 2024-04-18T04:44:07.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.041+0000 7fe217fff640 1 -- 172.21.15.132:0/1853250694 learned_addr learned my addr 172.21.15.132:0/1853250694 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-18T04:44:07.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.041+0000 7fe217fff640 1 -- 172.21.15.132:0/1853250694 >> v1:172.21.15.132:6789/0 conn(0x7fe2180cc430 legacy=0x7fe218072130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:07.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.041+0000 7fe217fff640 1 -- 172.21.15.132:0/1853250694 >> v1:172.21.15.120:6789/0 conn(0x7fe2180cc810 legacy=0x7fe2180c7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:07.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.041+0000 7fe217fff640 1 -- 172.21.15.132:0/1853250694 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe218070d80 con 0x7fe2180c68d0 2024-04-18T04:44:07.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.041+0000 7fe217fff640 1 --2- 172.21.15.132:0/1853250694 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2180c68d0 0x7fe2181501e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe21000d150 tx=0x7fe2100213e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16b07d9adf4af8bb server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:07.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.041+0000 7fe2167fc640 1 -- 172.21.15.132:0/1853250694 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21000b2d0 con 0x7fe2180c68d0 2024-04-18T04:44:07.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.041+0000 7fe2167fc640 1 -- 172.21.15.132:0/1853250694 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2100ad050 con 0x7fe2180c68d0 2024-04-18T04:44:07.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.041+0000 7fe2167fc640 1 -- 172.21.15.132:0/1853250694 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe210009820 con 0x7fe2180c68d0 2024-04-18T04:44:07.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.041+0000 7fe21de9b640 1 -- 172.21.15.132:0/1853250694 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2180c68d0 msgr2=0x7fe2181501e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:07.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.041+0000 7fe21de9b640 1 --2- 172.21.15.132:0/1853250694 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2180c68d0 0x7fe2181501e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe21000d150 tx=0x7fe2100213e0 comp rx=0 tx=0).stop 2024-04-18T04:44:07.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.041+0000 7fe21de9b640 1 -- 172.21.15.132:0/1853250694 shutdown_connections 2024-04-18T04:44:07.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.041+0000 7fe21de9b640 1 --2- 172.21.15.132:0/1853250694 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2180c68d0 0x7fe2181501e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:07.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.041+0000 7fe21de9b640 1 -- 172.21.15.132:0/1853250694 >> 172.21.15.132:0/1853250694 conn(0x7fe21806b1a0 msgr2=0x7fe21806b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:07.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.041+0000 7fe21de9b640 1 -- 172.21.15.132:0/1853250694 shutdown_connections 2024-04-18T04:44:07.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.041+0000 7fe21de9b640 1 -- 172.21.15.132:0/1853250694 wait complete. 2024-04-18T04:44:07.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.045+0000 7fe21de9b640 1 Processor -- start 2024-04-18T04:44:07.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.045+0000 7fe21de9b640 1 -- start start 2024-04-18T04:44:07.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.045+0000 7fe21de9b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe2180c68d0 0x7fe21814b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:07.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.045+0000 7fe21de9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2180cc430 0x7fe21814e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:07.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.045+0000 7fe21de9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2180cc810 0x7fe21814e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:07.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.045+0000 7fe21de9b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21814dba0 con 0x7fe2180cc810 2024-04-18T04:44:07.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.045+0000 7fe21de9b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21814ad70 con 0x7fe2180cc430 2024-04-18T04:44:07.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.045+0000 7fe21de9b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2180cb460 con 0x7fe2180c68d0 2024-04-18T04:44:07.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.045+0000 7fe2177fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe2180c68d0 0x7fe21814b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:07.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.045+0000 7fe216ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2180cc430 0x7fe21814e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:07.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.045+0000 7fe2177fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe2180c68d0 0x7fe21814b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.132:52954/0 (socket says 172.21.15.132:52954) 2024-04-18T04:44:07.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.045+0000 7fe2177fe640 1 -- 172.21.15.132:0/4182419895 learned_addr learned my addr 172.21.15.132:0/4182419895 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-18T04:44:07.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.045+0000 7fe216ffd640 1 -- 172.21.15.132:0/4182419895 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe2180c68d0 msgr2=0x7fe21814b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:07.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.045+0000 7fe216ffd640 1 --2- 172.21.15.132:0/4182419895 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe2180c68d0 0x7fe21814b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:07.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.045+0000 7fe216ffd640 1 -- 172.21.15.132:0/4182419895 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2180cc810 msgr2=0x7fe21814e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:07.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.045+0000 7fe216ffd640 1 --2- 172.21.15.132:0/4182419895 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2180cc810 0x7fe21814e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:07.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.045+0000 7fe216ffd640 1 -- 172.21.15.132:0/4182419895 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe21000bd40 con 0x7fe2180cc430 2024-04-18T04:44:07.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.045+0000 7fe216ffd640 1 --2- 172.21.15.132:0/4182419895 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2180cc430 0x7fe21814e030 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe20800b410 tx=0x7fe20800b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:07.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.045+0000 7fe20ffff640 1 -- 172.21.15.132:0/4182419895 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe208004020 con 0x7fe2180cc430 2024-04-18T04:44:07.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.045+0000 7fe20ffff640 1 -- 172.21.15.132:0/4182419895 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe208004180 con 0x7fe2180cc430 2024-04-18T04:44:07.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.045+0000 7fe20ffff640 1 -- 172.21.15.132:0/4182419895 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe208011630 con 0x7fe2180cc430 2024-04-18T04:44:07.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.049+0000 7fe21de9b640 1 -- 172.21.15.132:0/4182419895 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe218141370 con 0x7fe2180cc430 2024-04-18T04:44:07.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.049+0000 7fe21de9b640 1 -- 172.21.15.132:0/4182419895 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe218140db0 con 0x7fe2180cc430 2024-04-18T04:44:07.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.049+0000 7fe20ffff640 1 -- 172.21.15.132:0/4182419895 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fe208011a90 con 0x7fe2180cc430 2024-04-18T04:44:07.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.049+0000 7fe20ffff640 1 -- 172.21.15.132:0/4182419895 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fe208003dd0 con 0x7fe2180cc430 2024-04-18T04:44:07.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.049+0000 7fe21de9b640 1 -- 172.21.15.132:0/4182419895 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe21814dd50 con 0x7fe2180cc430 2024-04-18T04:44:07.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.049+0000 7fe20ffff640 1 -- 172.21.15.132:0/4182419895 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fe21814dd50 con 0x7fe2180cc430 2024-04-18T04:44:07.076 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-18T04:44:07.081+0000 7f3f4e3ae180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-18T04:44:07.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.121+0000 7fe21de9b640 1 -- 172.21.15.132:0/4182419895 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8f5f004b-6870-4c78-8d50-9622e631ec25", "id": 1} v 0) v1 -- 0x7fe2180729d0 con 0x7fe2180cc430 2024-04-18T04:44:07.122 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-04-18T04:44:07.119+0000 7f9bfaa80180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-18T04:44:07.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.129+0000 7fe20ffff640 1 -- 172.21.15.132:0/4182419895 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8f5f004b-6870-4c78-8d50-9622e631ec25", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe208015030 con 0x7fe2180cc430 2024-04-18T04:44:07.125 INFO:teuthology.orchestra.run.smithi132.stdout:1 2024-04-18T04:44:07.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.129+0000 7fe21de9b640 1 -- 172.21.15.132:0/4182419895 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2180cc430 msgr2=0x7fe21814e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:07.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.129+0000 7fe21de9b640 1 --2- 172.21.15.132:0/4182419895 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2180cc430 0x7fe21814e030 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe20800b410 tx=0x7fe20800b8d0 comp rx=0 tx=0).stop 2024-04-18T04:44:07.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.129+0000 7fe21de9b640 1 -- 172.21.15.132:0/4182419895 shutdown_connections 2024-04-18T04:44:07.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.129+0000 7fe21de9b640 1 --2- 172.21.15.132:0/4182419895 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2180cc810 0x7fe21814e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:07.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.129+0000 7fe21de9b640 1 --2- 172.21.15.132:0/4182419895 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2180cc430 0x7fe21814e030 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:07.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.129+0000 7fe21de9b640 1 --2- 172.21.15.132:0/4182419895 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe2180c68d0 0x7fe21814b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:07.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.129+0000 7fe21de9b640 1 -- 172.21.15.132:0/4182419895 >> 172.21.15.132:0/4182419895 conn(0x7fe21806b1a0 msgr2=0x7fe2180c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:07.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.129+0000 7fe21de9b640 1 -- 172.21.15.132:0/4182419895 shutdown_connections 2024-04-18T04:44:07.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.129+0000 7fe21de9b640 1 -- 172.21.15.132:0/4182419895 wait complete. 2024-04-18T04:44:07.144 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 6e228a2b-6103-4301-a8b5-ee81dbb1f920 2 2024-04-18T04:44:07.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.261+0000 7f744603a640 1 Processor -- start 2024-04-18T04:44:07.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.261+0000 7f744603a640 1 -- start start 2024-04-18T04:44:07.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.261+0000 7f744603a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f744006e670 0x7f74400cd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:07.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.261+0000 7f744603a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74400cd8c0 0x7f7440158d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:07.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.261+0000 7f744603a640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7440158900 con 0x7f7440151740 2024-04-18T04:44:07.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.261+0000 7f744603a640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7440151b20 con 0x7f744006e670 2024-04-18T04:44:07.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.261+0000 7f744603a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74400c1fe0 con 0x7f74400cd8c0 2024-04-18T04:44:07.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.261+0000 7f743ffff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74400cd8c0 0x7f7440158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:07.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.261+0000 7f743ffff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74400cd8c0 0x7f7440158d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.132:52964/0 (socket says 172.21.15.132:52964) 2024-04-18T04:44:07.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.261+0000 7f743ffff640 1 -- 172.21.15.132:0/3176251341 learned_addr learned my addr 172.21.15.132:0/3176251341 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-18T04:44:07.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.265+0000 7f743ffff640 1 -- 172.21.15.132:0/3176251341 >> v2:172.21.15.120:3300/0 conn(0x7f744006e670 msgr2=0x7f74400cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:07.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.265+0000 7f743effd640 1 --2- 172.21.15.132:0/3176251341 >> v2:172.21.15.120:3300/0 conn(0x7f744006e670 0x7f74400cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:07.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.265+0000 7f743ffff640 1 --2- 172.21.15.132:0/3176251341 >> v2:172.21.15.120:3300/0 conn(0x7f744006e670 0x7f74400cd380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:07.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.265+0000 7f743ffff640 1 -- 172.21.15.132:0/3176251341 >> v1:172.21.15.120:6789/0 conn(0x7f7440151740 legacy=0x7f7440157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:07.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.265+0000 7f743ffff640 1 -- 172.21.15.132:0/3176251341 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74400c2280 con 0x7f74400cd8c0 2024-04-18T04:44:07.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.265+0000 7f743effd640 1 --2- 172.21.15.132:0/3176251341 >> v2:172.21.15.120:3300/0 conn(0x7f744006e670 0x7f74400cd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:44:07.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.265+0000 7f743ffff640 1 --2- 172.21.15.132:0/3176251341 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74400cd8c0 0x7f7440158d90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7438009e50 tx=0x7f743801ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecf370e4912754bd server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:07.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.265+0000 7f743e7fc640 1 -- 172.21.15.132:0/3176251341 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74380a5700 con 0x7f74400cd8c0 2024-04-18T04:44:07.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.265+0000 7f743e7fc640 1 -- 172.21.15.132:0/3176251341 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74380a5860 con 0x7f74400cd8c0 2024-04-18T04:44:07.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.265+0000 7f743e7fc640 1 -- 172.21.15.132:0/3176251341 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74380a5bf0 con 0x7f74400cd8c0 2024-04-18T04:44:07.264 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.265+0000 7f744603a640 1 -- 172.21.15.132:0/3176251341 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74400cd8c0 msgr2=0x7f7440158d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:07.264 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.265+0000 7f744603a640 1 --2- 172.21.15.132:0/3176251341 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74400cd8c0 0x7f7440158d90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7438009e50 tx=0x7f743801ca30 comp rx=0 tx=0).stop 2024-04-18T04:44:07.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.265+0000 7f744603a640 1 -- 172.21.15.132:0/3176251341 shutdown_connections 2024-04-18T04:44:07.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.265+0000 7f744603a640 1 --2- 172.21.15.132:0/3176251341 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74400cd8c0 0x7f7440158d90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:07.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.265+0000 7f744603a640 1 --2- 172.21.15.132:0/3176251341 >> v2:172.21.15.120:3300/0 conn(0x7f744006e670 0x7f74400cd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:07.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.265+0000 7f744603a640 1 -- 172.21.15.132:0/3176251341 >> 172.21.15.132:0/3176251341 conn(0x7f7440065d90 msgr2=0x7f74400661a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:07.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.265+0000 7f744603a640 1 -- 172.21.15.132:0/3176251341 shutdown_connections 2024-04-18T04:44:07.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.265+0000 7f744603a640 1 -- 172.21.15.132:0/3176251341 wait complete. 2024-04-18T04:44:07.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.269+0000 7f744603a640 1 Processor -- start 2024-04-18T04:44:07.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.269+0000 7f744603a640 1 -- start start 2024-04-18T04:44:07.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.269+0000 7f744603a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f744006e670 0x7f744014a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:07.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.269+0000 7f744603a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74400cd8c0 0x7f7440144e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:07.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.269+0000 7f744603a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7440151740 0x7f7440141970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:07.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.269+0000 7f744603a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7440144a00 con 0x7f74400cd8c0 2024-04-18T04:44:07.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.269+0000 7f744603a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7440148410 con 0x7f7440151740 2024-04-18T04:44:07.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.269+0000 7f744603a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74401446b0 con 0x7f744006e670 2024-04-18T04:44:07.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.269+0000 7f743f7fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f744006e670 0x7f744014a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:07.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.269+0000 7f743ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7440151740 0x7f7440141970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:07.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.269+0000 7f743f7fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f744006e670 0x7f744014a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.132:52966/0 (socket says 172.21.15.132:52966) 2024-04-18T04:44:07.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.269+0000 7f743f7fe640 1 -- 172.21.15.132:0/160340653 learned_addr learned my addr 172.21.15.132:0/160340653 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-18T04:44:07.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.269+0000 7f743effd640 1 --2- 172.21.15.132:0/160340653 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74400cd8c0 0x7f7440144e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:07.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.269+0000 7f743f7fe640 1 -- 172.21.15.132:0/160340653 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7440151740 msgr2=0x7f7440141970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:07.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.269+0000 7f743f7fe640 1 --2- 172.21.15.132:0/160340653 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7440151740 0x7f7440141970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:07.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.269+0000 7f743f7fe640 1 -- 172.21.15.132:0/160340653 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74400cd8c0 msgr2=0x7f7440144e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:07.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.269+0000 7f743f7fe640 1 --2- 172.21.15.132:0/160340653 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74400cd8c0 0x7f7440144e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:07.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.269+0000 7f743f7fe640 1 -- 172.21.15.132:0/160340653 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7438009b30 con 0x7f744006e670 2024-04-18T04:44:07.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.269+0000 7f743ffff640 1 --2- 172.21.15.132:0/160340653 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7440151740 0x7f7440141970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:44:07.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.269+0000 7f743f7fe640 1 --2- 172.21.15.132:0/160340653 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f744006e670 0x7f744014a280 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f743000c530 tx=0x7f743000c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:07.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.269+0000 7f7427fff640 1 -- 172.21.15.132:0/160340653 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7430005220 con 0x7f744006e670 2024-04-18T04:44:07.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.269+0000 7f7427fff640 1 -- 172.21.15.132:0/160340653 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7430005380 con 0x7f744006e670 2024-04-18T04:44:07.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.269+0000 7f744603a640 1 -- 172.21.15.132:0/160340653 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7440158580 con 0x7f744006e670 2024-04-18T04:44:07.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.269+0000 7f7427fff640 1 -- 172.21.15.132:0/160340653 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7430007270 con 0x7f744006e670 2024-04-18T04:44:07.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.269+0000 7f744603a640 1 -- 172.21.15.132:0/160340653 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7440148660 con 0x7f744006e670 2024-04-18T04:44:07.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.269+0000 7f7427fff640 1 -- 172.21.15.132:0/160340653 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f74300067e0 con 0x7f744006e670 2024-04-18T04:44:07.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.269+0000 7f7427fff640 1 -- 172.21.15.132:0/160340653 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f7430012d20 con 0x7f744006e670 2024-04-18T04:44:07.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.269+0000 7f744603a640 1 -- 172.21.15.132:0/160340653 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74400729d0 con 0x7f744006e670 2024-04-18T04:44:07.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.273+0000 7f7427fff640 1 -- 172.21.15.132:0/160340653 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f7430016020 con 0x7f744006e670 2024-04-18T04:44:07.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.341+0000 7f744603a640 1 -- 172.21.15.132:0/160340653 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6e228a2b-6103-4301-a8b5-ee81dbb1f920", "id": 2} v 0) v1 -- 0x7f74400ccb60 con 0x7f744006e670 2024-04-18T04:44:07.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.349+0000 7f7427fff640 1 -- 172.21.15.132:0/160340653 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6e228a2b-6103-4301-a8b5-ee81dbb1f920", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f743002a0b0 con 0x7f744006e670 2024-04-18T04:44:07.347 INFO:teuthology.orchestra.run.smithi132.stdout:2 2024-04-18T04:44:07.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.349+0000 7f744603a640 1 -- 172.21.15.132:0/160340653 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f744006e670 msgr2=0x7f744014a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:07.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.349+0000 7f744603a640 1 --2- 172.21.15.132:0/160340653 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f744006e670 0x7f744014a280 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f743000c530 tx=0x7f743000c9f0 comp rx=0 tx=0).stop 2024-04-18T04:44:07.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.349+0000 7f744603a640 1 -- 172.21.15.132:0/160340653 shutdown_connections 2024-04-18T04:44:07.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.349+0000 7f744603a640 1 --2- 172.21.15.132:0/160340653 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7440151740 0x7f7440141970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:07.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.349+0000 7f744603a640 1 --2- 172.21.15.132:0/160340653 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74400cd8c0 0x7f7440144e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:07.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.349+0000 7f744603a640 1 --2- 172.21.15.132:0/160340653 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f744006e670 0x7f744014a280 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:07.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.349+0000 7f744603a640 1 -- 172.21.15.132:0/160340653 >> 172.21.15.132:0/160340653 conn(0x7f7440065d90 msgr2=0x7f7440066170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:07.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.349+0000 7f744603a640 1 -- 172.21.15.132:0/160340653 shutdown_connections 2024-04-18T04:44:07.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.349+0000 7f744603a640 1 -- 172.21.15.132:0/160340653 wait complete. 2024-04-18T04:44:07.364 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 7a5cabd7-d898-4e32-a03c-25b46e790134 3 2024-04-18T04:44:07.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.485+0000 7fa9b9dd6640 1 Processor -- start 2024-04-18T04:44:07.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.485+0000 7fa9b9dd6640 1 -- start start 2024-04-18T04:44:07.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.485+0000 7fa9b9dd6640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa9b40cc810 0x7fa9b40c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:07.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.485+0000 7fa9b9dd6640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9b4071760 con 0x7fa9b40c7670 2024-04-18T04:44:07.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.485+0000 7fa9b9dd6640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9b4070aa0 con 0x7fa9b40cc430 2024-04-18T04:44:07.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.485+0000 7fa9b9dd6640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9b4070d80 con 0x7fa9b40cc810 2024-04-18T04:44:07.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.485+0000 7fa9b37fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fa9b40cc430 0x7fa9b4072130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:53618/0 (socket says 172.21.15.132:53618) 2024-04-18T04:44:07.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.485+0000 7fa9b37fe640 1 -- 172.21.15.132:0/1593700915 learned_addr learned my addr 172.21.15.132:0/1593700915 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-18T04:44:07.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.485+0000 7fa9abfff640 1 --2- 172.21.15.132:0/1593700915 >> v2:172.21.15.120:3300/0 conn(0x7fa9b40cc810 0x7fa9b40c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:07.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.485+0000 7fa9b2ffd640 1 -- 172.21.15.132:0/1593700915 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4106098993 0 0) 0x7fa9b4070aa0 con 0x7fa9b40cc430 2024-04-18T04:44:07.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.485+0000 7fa9b2ffd640 1 -- 172.21.15.132:0/1593700915 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9a0003530 con 0x7fa9b40cc430 2024-04-18T04:44:07.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.485+0000 7fa9b2ffd640 1 -- 172.21.15.132:0/1593700915 <== mon.1 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1067488549 0 0) 0x7fa9a0003530 con 0x7fa9b40cc430 2024-04-18T04:44:07.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.485+0000 7fa9b2ffd640 1 -- 172.21.15.132:0/1593700915 >> v2:172.21.15.120:3300/0 conn(0x7fa9b40cc810 msgr2=0x7fa9b40c68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:07.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.485+0000 7fa9b2ffd640 1 --2- 172.21.15.132:0/1593700915 >> v2:172.21.15.120:3300/0 conn(0x7fa9b40cc810 0x7fa9b40c68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:07.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.485+0000 7fa9b2ffd640 1 -- 172.21.15.132:0/1593700915 >> v1:172.21.15.120:6789/0 conn(0x7fa9b40c7670 legacy=0x7fa9b41501e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:07.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.485+0000 7fa9b2ffd640 1 -- 172.21.15.132:0/1593700915 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b40719b0 con 0x7fa9b40cc430 2024-04-18T04:44:07.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.485+0000 7fa9b2ffd640 1 -- 172.21.15.132:0/1593700915 <== mon.1 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7fa9a4001680 con 0x7fa9b40cc430 2024-04-18T04:44:07.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.485+0000 7fa9b2ffd640 1 -- 172.21.15.132:0/1593700915 >> v1:172.21.15.132:6789/0 conn(0x7fa9b40cc430 legacy=0x7fa9b4072130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:07.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.485+0000 7fa9b2ffd640 1 --2- 172.21.15.132:0/1593700915 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9a0003980 0x7fa9a0003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:07.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.485+0000 7fa9b2ffd640 1 --2- 172.21.15.132:0/1593700915 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa9a0004380 0x7fa9a0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:07.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.485+0000 7fa9b2ffd640 1 --2- 172.21.15.132:0/1593700915 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9a0005050 0x7fa9a000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:07.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.485+0000 7fa9b2ffd640 1 -- 172.21.15.132:0/1593700915 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b4070d80 con 0x7fa9a0005050 2024-04-18T04:44:07.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.485+0000 7fa9b2ffd640 1 -- 172.21.15.132:0/1593700915 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a000e110 con 0x7fa9a0003980 2024-04-18T04:44:07.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.485+0000 7fa9b2ffd640 1 -- 172.21.15.132:0/1593700915 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a000e2d0 con 0x7fa9a0004380 2024-04-18T04:44:07.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.485+0000 7fa9b37fe640 1 --2- 172.21.15.132:0/1593700915 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9a0003980 0x7fa9a0003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:07.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.485+0000 7fa9abfff640 1 --2- 172.21.15.132:0/1593700915 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa9a0004380 0x7fa9a0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:07.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.485+0000 7fa9b3fff640 1 --2- 172.21.15.132:0/1593700915 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9a0005050 0x7fa9a000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:07.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.485+0000 7fa9b37fe640 1 -- 172.21.15.132:0/1593700915 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa9a0004380 msgr2=0x7fa9a0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:07.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.485+0000 7fa9b37fe640 1 --2- 172.21.15.132:0/1593700915 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa9a0004380 0x7fa9a0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:07.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.485+0000 7fa9b37fe640 1 -- 172.21.15.132:0/1593700915 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9a0005050 msgr2=0x7fa9a000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:07.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.485+0000 7fa9b37fe640 1 --2- 172.21.15.132:0/1593700915 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9a0005050 0x7fa9a000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:07.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.485+0000 7fa9b37fe640 1 -- 172.21.15.132:0/1593700915 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a0003530 con 0x7fa9a0003980 2024-04-18T04:44:07.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.485+0000 7fa9b3fff640 1 -- 172.21.15.132:0/1593700915 reap_dead start 2024-04-18T04:44:07.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.489+0000 7fa9b37fe640 1 --2- 172.21.15.132:0/1593700915 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9a0003980 0x7fa9a0003d60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa9a400c210 tx=0x7fa9a401cc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71622d67039e9152 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:07.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.489+0000 7fa9b2ffd640 1 -- 172.21.15.132:0/1593700915 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a40a5b80 con 0x7fa9a0003980 2024-04-18T04:44:07.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.489+0000 7fa9b2ffd640 1 -- 172.21.15.132:0/1593700915 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9a40a5d00 con 0x7fa9a0003980 2024-04-18T04:44:07.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.489+0000 7fa9b2ffd640 1 -- 172.21.15.132:0/1593700915 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a4005b20 con 0x7fa9a0003980 2024-04-18T04:44:07.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.489+0000 7fa9b9dd6640 1 -- 172.21.15.132:0/1593700915 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9a0003980 msgr2=0x7fa9a0003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:07.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.489+0000 7fa9b9dd6640 1 --2- 172.21.15.132:0/1593700915 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9a0003980 0x7fa9a0003d60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa9a400c210 tx=0x7fa9a401cc80 comp rx=0 tx=0).stop 2024-04-18T04:44:07.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.489+0000 7fa9b9dd6640 1 -- 172.21.15.132:0/1593700915 shutdown_connections 2024-04-18T04:44:07.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.489+0000 7fa9b9dd6640 1 --2- 172.21.15.132:0/1593700915 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9a0003980 0x7fa9a0003d60 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:07.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.489+0000 7fa9b9dd6640 1 -- 172.21.15.132:0/1593700915 >> 172.21.15.132:0/1593700915 conn(0x7fa9b406b1a0 msgr2=0x7fa9b406b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:07.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.489+0000 7fa9b9dd6640 1 -- 172.21.15.132:0/1593700915 shutdown_connections 2024-04-18T04:44:07.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.489+0000 7fa9b9dd6640 1 -- 172.21.15.132:0/1593700915 wait complete. 2024-04-18T04:44:07.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.489+0000 7fa9b9dd6640 1 Processor -- start 2024-04-18T04:44:07.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.489+0000 7fa9b9dd6640 1 -- start start 2024-04-18T04:44:07.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.493+0000 7fa9b9dd6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9a0003980 0x7fa9b414d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:07.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.493+0000 7fa9b9dd6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9b41442a0 0x7fa9b414c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:07.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.493+0000 7fa9b9dd6640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa9b414e8b0 0x7fa9b414ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:07.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.493+0000 7fa9b9dd6640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b4144700 con 0x7fa9a0003980 2024-04-18T04:44:07.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.493+0000 7fa9b9dd6640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b4141640 con 0x7fa9b41442a0 2024-04-18T04:44:07.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.493+0000 7fa9b9dd6640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b414c890 con 0x7fa9b414e8b0 2024-04-18T04:44:07.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.493+0000 7fa9abfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9b41442a0 0x7fa9b414c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:07.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.493+0000 7fa9b3fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa9b414e8b0 0x7fa9b414ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:07.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.493+0000 7fa9abfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9b41442a0 0x7fa9b414c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:46278/0 (socket says 172.21.15.132:46278) 2024-04-18T04:44:07.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.493+0000 7fa9b3fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa9b414e8b0 0x7fa9b414ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.132:52986/0 (socket says 172.21.15.132:52986) 2024-04-18T04:44:07.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.493+0000 7fa9abfff640 1 -- 172.21.15.132:0/1680663134 learned_addr learned my addr 172.21.15.132:0/1680663134 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-18T04:44:07.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.493+0000 7fa9b37fe640 1 --2- 172.21.15.132:0/1680663134 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9a0003980 0x7fa9b414d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:07.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.493+0000 7fa9abfff640 1 -- 172.21.15.132:0/1680663134 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa9b414e8b0 msgr2=0x7fa9b414ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:07.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.493+0000 7fa9abfff640 1 --2- 172.21.15.132:0/1680663134 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa9b414e8b0 0x7fa9b414ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:07.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.493+0000 7fa9abfff640 1 -- 172.21.15.132:0/1680663134 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9a0003980 msgr2=0x7fa9b414d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:07.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.493+0000 7fa9abfff640 1 --2- 172.21.15.132:0/1680663134 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9a0003980 0x7fa9b414d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:07.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.493+0000 7fa9abfff640 1 -- 172.21.15.132:0/1680663134 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b40c19d0 con 0x7fa9b41442a0 2024-04-18T04:44:07.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.493+0000 7fa9b3fff640 1 --2- 172.21.15.132:0/1680663134 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa9b414e8b0 0x7fa9b414ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:44:07.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.493+0000 7fa9abfff640 1 --2- 172.21.15.132:0/1680663134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9b41442a0 0x7fa9b414c350 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa99c011aa0 tx=0x7fa99c011f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:07.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.493+0000 7fa9b0ff9640 1 -- 172.21.15.132:0/1680663134 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99c00fb80 con 0x7fa9b41442a0 2024-04-18T04:44:07.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.493+0000 7fa9b0ff9640 1 -- 172.21.15.132:0/1680663134 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa99c00fce0 con 0x7fa9b41442a0 2024-04-18T04:44:07.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.493+0000 7fa9b9dd6640 1 -- 172.21.15.132:0/1680663134 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9b414fc80 con 0x7fa9b41442a0 2024-04-18T04:44:07.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.493+0000 7fa9b0ff9640 1 -- 172.21.15.132:0/1680663134 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99c014660 con 0x7fa9b41442a0 2024-04-18T04:44:07.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.493+0000 7fa9b9dd6640 1 -- 172.21.15.132:0/1680663134 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9b41eea20 con 0x7fa9b41442a0 2024-04-18T04:44:07.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.493+0000 7fa9b0ff9640 1 -- 172.21.15.132:0/1680663134 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fa99c014ac0 con 0x7fa9b41442a0 2024-04-18T04:44:07.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.493+0000 7fa9b0ff9640 1 -- 172.21.15.132:0/1680663134 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fa99c01dc50 con 0x7fa9b41442a0 2024-04-18T04:44:07.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.493+0000 7fa9b9dd6640 1 -- 172.21.15.132:0/1680663134 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9b41eec10 con 0x7fa9b41442a0 2024-04-18T04:44:07.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.497+0000 7fa9b0ff9640 1 -- 172.21.15.132:0/1680663134 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fa99c022020 con 0x7fa9b41442a0 2024-04-18T04:44:07.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.561+0000 7fa9b9dd6640 1 -- 172.21.15.132:0/1680663134 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7a5cabd7-d898-4e32-a03c-25b46e790134", "id": 3} v 0) v1 -- 0x7fa9b40729d0 con 0x7fa9b41442a0 2024-04-18T04:44:07.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.569+0000 7fa9b0ff9640 1 -- 172.21.15.132:0/1680663134 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7a5cabd7-d898-4e32-a03c-25b46e790134", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa99c01d7c0 con 0x7fa9b41442a0 2024-04-18T04:44:07.567 INFO:teuthology.orchestra.run.smithi132.stdout:3 2024-04-18T04:44:07.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.569+0000 7fa9b9dd6640 1 -- 172.21.15.132:0/1680663134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9b41442a0 msgr2=0x7fa9b414c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:07.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.569+0000 7fa9b9dd6640 1 --2- 172.21.15.132:0/1680663134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9b41442a0 0x7fa9b414c350 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa99c011aa0 tx=0x7fa99c011f60 comp rx=0 tx=0).stop 2024-04-18T04:44:07.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.569+0000 7fa9b9dd6640 1 -- 172.21.15.132:0/1680663134 shutdown_connections 2024-04-18T04:44:07.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.569+0000 7fa9b9dd6640 1 --2- 172.21.15.132:0/1680663134 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa9b414e8b0 0x7fa9b414ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:07.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.569+0000 7fa9b9dd6640 1 --2- 172.21.15.132:0/1680663134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9b41442a0 0x7fa9b414c350 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:07.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.569+0000 7fa9b9dd6640 1 --2- 172.21.15.132:0/1680663134 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9a0003980 0x7fa9b414d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:07.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.569+0000 7fa9b9dd6640 1 -- 172.21.15.132:0/1680663134 >> 172.21.15.132:0/1680663134 conn(0x7fa9b406b1a0 msgr2=0x7fa9b414ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:07.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.573+0000 7fa9b9dd6640 1 -- 172.21.15.132:0/1680663134 shutdown_connections 2024-04-18T04:44:07.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.573+0000 7fa9b9dd6640 1 -- 172.21.15.132:0/1680663134 wait complete. 2024-04-18T04:44:07.584 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 8e9f530f-6bab-4b23-a1a3-a71362fefcc0 4 2024-04-18T04:44:07.660 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-18T04:44:07.661+0000 7f3f4e3ae180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-18T04:44:07.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.701+0000 7fe8b67c0640 1 Processor -- start 2024-04-18T04:44:07.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.701+0000 7fe8b67c0640 1 -- start start 2024-04-18T04:44:07.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.701+0000 7fe8b67c0640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8b0151740 0x7fe8b0157e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:07.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.701+0000 7fe8b67c0640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe8b006e670 0x7fe8b00cd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:07.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.701+0000 7fe8b67c0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe8b00cd8c0 0x7fe8b0158d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:07.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.701+0000 7fe8b67c0640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8b0158900 con 0x7fe8b006e670 2024-04-18T04:44:07.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.701+0000 7fe8b67c0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8b01583d0 con 0x7fe8b00cd8c0 2024-04-18T04:44:07.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.701+0000 7fe8b67c0640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b0151b20 con 0x7fe8b0151740 2024-04-18T04:44:07.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.701+0000 7fe8b4d5d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe8b00cd8c0 0x7fe8b0158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:07.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.701+0000 7fe8affff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8b0151740 0x7fe8b0157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:07.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.701+0000 7fe8b4d5d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe8b00cd8c0 0x7fe8b0158d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:46286/0 (socket says 172.21.15.132:46286) 2024-04-18T04:44:07.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.701+0000 7fe8b4d5d640 1 -- 172.21.15.132:0/2855226950 learned_addr learned my addr 172.21.15.132:0/2855226950 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-18T04:44:07.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.705+0000 7fe8af7fe640 1 --2- 172.21.15.132:0/2855226950 >> v2:172.21.15.120:3300/0 conn(0x7fe8b006e670 0x7fe8b00cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:07.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.705+0000 7fe8b4d5d640 1 -- 172.21.15.132:0/2855226950 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8b0151740 msgr2=0x7fe8b0157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:07.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.705+0000 7fe8b4d5d640 1 --2- 172.21.15.132:0/2855226950 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8b0151740 0x7fe8b0157e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:07.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.705+0000 7fe8b4d5d640 1 -- 172.21.15.132:0/2855226950 >> v2:172.21.15.120:3300/0 conn(0x7fe8b006e670 msgr2=0x7fe8b00cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:07.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.705+0000 7fe8b4d5d640 1 --2- 172.21.15.132:0/2855226950 >> v2:172.21.15.120:3300/0 conn(0x7fe8b006e670 0x7fe8b00cd380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:07.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.705+0000 7fe8b4d5d640 1 -- 172.21.15.132:0/2855226950 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b00c1fe0 con 0x7fe8b00cd8c0 2024-04-18T04:44:07.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.705+0000 7fe8affff640 1 --2- 172.21.15.132:0/2855226950 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8b0151740 0x7fe8b0157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:44:07.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.705+0000 7fe8b4d5d640 1 --2- 172.21.15.132:0/2855226950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8b00cd8c0 0x7fe8b0158d90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe8b00ccf30 tx=0x7fe8a801f1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19bd6682dc3506ec server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:07.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.705+0000 7fe8aeffd640 1 -- 172.21.15.132:0/2855226950 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a80af400 con 0x7fe8b00cd8c0 2024-04-18T04:44:07.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.705+0000 7fe8aeffd640 1 -- 172.21.15.132:0/2855226950 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a80ab050 con 0x7fe8b00cd8c0 2024-04-18T04:44:07.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.705+0000 7fe8aeffd640 1 -- 172.21.15.132:0/2855226950 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a80af780 con 0x7fe8b00cd8c0 2024-04-18T04:44:07.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.705+0000 7fe8b67c0640 1 -- 172.21.15.132:0/2855226950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8b00cd8c0 msgr2=0x7fe8b0158d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:07.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.705+0000 7fe8b67c0640 1 --2- 172.21.15.132:0/2855226950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8b00cd8c0 0x7fe8b0158d90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe8b00ccf30 tx=0x7fe8a801f1e0 comp rx=0 tx=0).stop 2024-04-18T04:44:07.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.705+0000 7fe8b67c0640 1 -- 172.21.15.132:0/2855226950 shutdown_connections 2024-04-18T04:44:07.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.705+0000 7fe8b67c0640 1 --2- 172.21.15.132:0/2855226950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8b00cd8c0 0x7fe8b0158d90 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:07.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.705+0000 7fe8b67c0640 1 --2- 172.21.15.132:0/2855226950 >> v2:172.21.15.120:3300/0 conn(0x7fe8b006e670 0x7fe8b00cd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:07.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.705+0000 7fe8b67c0640 1 --2- 172.21.15.132:0/2855226950 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8b0151740 0x7fe8b0157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:07.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.705+0000 7fe8b67c0640 1 -- 172.21.15.132:0/2855226950 >> 172.21.15.132:0/2855226950 conn(0x7fe8b0065d90 msgr2=0x7fe8b00661a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:07.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.705+0000 7fe8b67c0640 1 -- 172.21.15.132:0/2855226950 shutdown_connections 2024-04-18T04:44:07.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.705+0000 7fe8b67c0640 1 -- 172.21.15.132:0/2855226950 wait complete. 2024-04-18T04:44:07.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.709+0000 7fe8b67c0640 1 Processor -- start 2024-04-18T04:44:07.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.709+0000 7fe8b67c0640 1 -- start start 2024-04-18T04:44:07.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.709+0000 7fe8b67c0640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8b006e670 0x7fe8b01eef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:07.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.709+0000 7fe8b67c0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8b00cd8c0 0x7fe8b0158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:07.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.709+0000 7fe8b67c0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8b0151740 0x7fe8b00c6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:07.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.709+0000 7fe8b67c0640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b0157310 con 0x7fe8b00cd8c0 2024-04-18T04:44:07.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.709+0000 7fe8b67c0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b014c3e0 con 0x7fe8b0151740 2024-04-18T04:44:07.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.709+0000 7fe8b67c0640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b01ef5f0 con 0x7fe8b006e670 2024-04-18T04:44:07.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.709+0000 7fe8affff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8b006e670 0x7fe8b01eef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:07.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.709+0000 7fe8b4d5d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8b0151740 0x7fe8b00c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:07.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.709+0000 7fe8affff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8b006e670 0x7fe8b01eef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.132:53004/0 (socket says 172.21.15.132:53004) 2024-04-18T04:44:07.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.709+0000 7fe8affff640 1 -- 172.21.15.132:0/2063860848 learned_addr learned my addr 172.21.15.132:0/2063860848 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-18T04:44:07.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.709+0000 7fe8af7fe640 1 --2- 172.21.15.132:0/2063860848 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8b00cd8c0 0x7fe8b0158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:07.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.709+0000 7fe8affff640 1 -- 172.21.15.132:0/2063860848 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8b0151740 msgr2=0x7fe8b00c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:07.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.709+0000 7fe8affff640 1 --2- 172.21.15.132:0/2063860848 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8b0151740 0x7fe8b00c6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:07.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.709+0000 7fe8affff640 1 -- 172.21.15.132:0/2063860848 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8b00cd8c0 msgr2=0x7fe8b0158ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:07.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.709+0000 7fe8affff640 1 --2- 172.21.15.132:0/2063860848 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8b00cd8c0 0x7fe8b0158ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:07.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.709+0000 7fe8affff640 1 -- 172.21.15.132:0/2063860848 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a0009420 con 0x7fe8b006e670 2024-04-18T04:44:07.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.709+0000 7fe8af7fe640 1 --2- 172.21.15.132:0/2063860848 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8b00cd8c0 0x7fe8b0158ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:44:07.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.709+0000 7fe8b4d5d640 1 --2- 172.21.15.132:0/2063860848 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8b0151740 0x7fe8b00c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:44:07.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.709+0000 7fe8affff640 1 --2- 172.21.15.132:0/2063860848 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8b006e670 0x7fe8b01eef60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe8a000e980 tx=0x7fe8a000ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:07.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.709+0000 7fe8acff9640 1 -- 172.21.15.132:0/2063860848 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a000ca00 con 0x7fe8b006e670 2024-04-18T04:44:07.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.709+0000 7fe8acff9640 1 -- 172.21.15.132:0/2063860848 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a000cb60 con 0x7fe8b006e670 2024-04-18T04:44:07.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.709+0000 7fe8b67c0640 1 -- 172.21.15.132:0/2063860848 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a8009b30 con 0x7fe8b006e670 2024-04-18T04:44:07.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.709+0000 7fe8acff9640 1 -- 172.21.15.132:0/2063860848 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a0013470 con 0x7fe8b006e670 2024-04-18T04:44:07.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.709+0000 7fe8b67c0640 1 -- 172.21.15.132:0/2063860848 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8b01ef8b0 con 0x7fe8b006e670 2024-04-18T04:44:07.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.709+0000 7fe8acff9640 1 -- 172.21.15.132:0/2063860848 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fe8a00138d0 con 0x7fe8b006e670 2024-04-18T04:44:07.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.709+0000 7fe8acff9640 1 -- 172.21.15.132:0/2063860848 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fe8a001cdc0 con 0x7fe8b006e670 2024-04-18T04:44:07.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.709+0000 7fe8b67c0640 1 -- 172.21.15.132:0/2063860848 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8b014eb50 con 0x7fe8b006e670 2024-04-18T04:44:07.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.713+0000 7fe8acff9640 1 -- 172.21.15.132:0/2063860848 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fe8a0021060 con 0x7fe8b006e670 2024-04-18T04:44:07.716 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-18T04:44:07.717+0000 7f3f4e3ae180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-18T04:44:07.735 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-04-18T04:44:07.735+0000 7f9bfaa80180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-18T04:44:07.768 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-18T04:44:07.773+0000 7f3f4e3ae180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-18T04:44:07.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.781+0000 7fe8b67c0640 1 -- 172.21.15.132:0/2063860848 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8e9f530f-6bab-4b23-a1a3-a71362fefcc0", "id": 4} v 0) v1 -- 0x7fe8b00729d0 con 0x7fe8b006e670 2024-04-18T04:44:07.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.785+0000 7fe8acff9640 1 -- 172.21.15.132:0/2063860848 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8e9f530f-6bab-4b23-a1a3-a71362fefcc0", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe8a002a020 con 0x7fe8b006e670 2024-04-18T04:44:07.782 INFO:teuthology.orchestra.run.smithi132.stdout:4 2024-04-18T04:44:07.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.785+0000 7fe8b67c0640 1 -- 172.21.15.132:0/2063860848 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8b006e670 msgr2=0x7fe8b01eef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:07.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.785+0000 7fe8b67c0640 1 --2- 172.21.15.132:0/2063860848 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8b006e670 0x7fe8b01eef60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe8a000e980 tx=0x7fe8a000ee40 comp rx=0 tx=0).stop 2024-04-18T04:44:07.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.785+0000 7fe8b67c0640 1 -- 172.21.15.132:0/2063860848 shutdown_connections 2024-04-18T04:44:07.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.785+0000 7fe8b67c0640 1 --2- 172.21.15.132:0/2063860848 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8b0151740 0x7fe8b00c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:07.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.785+0000 7fe8b67c0640 1 --2- 172.21.15.132:0/2063860848 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8b00cd8c0 0x7fe8b0158ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:07.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.785+0000 7fe8b67c0640 1 --2- 172.21.15.132:0/2063860848 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8b006e670 0x7fe8b01eef60 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:07.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.785+0000 7fe8b67c0640 1 -- 172.21.15.132:0/2063860848 >> 172.21.15.132:0/2063860848 conn(0x7fe8b0065d90 msgr2=0x7fe8b0159c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:07.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.785+0000 7fe8b67c0640 1 -- 172.21.15.132:0/2063860848 shutdown_connections 2024-04-18T04:44:07.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.785+0000 7fe8b67c0640 1 -- 172.21.15.132:0/2063860848 wait complete. 2024-04-18T04:44:07.798 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 2243fabe-cc81-40cf-91bc-f106fe275a01 5 2024-04-18T04:44:07.799 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-04-18T04:44:07.799+0000 7f9bfaa80180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-18T04:44:07.849 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-18T04:44:07.853+0000 7f3f4e3ae180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-18T04:44:07.859 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-04-18T04:44:07.859+0000 7f9bfaa80180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-18T04:44:07.902 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-18T04:44:07.905+0000 7f3f4e3ae180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-18T04:44:07.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.913+0000 7f1c898fc640 1 Processor -- start 2024-04-18T04:44:07.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.913+0000 7f1c898fc640 1 -- start start 2024-04-18T04:44:07.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.913+0000 7f1c898fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1c8406d090 0x7f1c8415aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:07.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.913+0000 7f1c898fc640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c8406d4b0 0x7f1c8406aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:07.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.913+0000 7f1c898fc640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c84157e20 con 0x7f1c84151930 2024-04-18T04:44:07.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.913+0000 7f1c898fc640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c840c85c0 con 0x7f1c8406d090 2024-04-18T04:44:07.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.913+0000 7f1c898fc640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c840c71d0 con 0x7f1c8406d4b0 2024-04-18T04:44:07.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.913+0000 7f1c837fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c8406d4b0 0x7f1c8406aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:07.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.913+0000 7f1c827fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1c8406d090 0x7f1c8415aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:07.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.913+0000 7f1c837fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c8406d4b0 0x7f1c8406aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.132:53012/0 (socket says 172.21.15.132:53012) 2024-04-18T04:44:07.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.913+0000 7f1c837fe640 1 -- 172.21.15.132:0/2255594502 learned_addr learned my addr 172.21.15.132:0/2255594502 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-18T04:44:07.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.913+0000 7f1c82ffd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f1c84151930 0x7f1c840c6940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:53630/0 (socket says 172.21.15.132:53630) 2024-04-18T04:44:07.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.913+0000 7f1c837fe640 1 -- 172.21.15.132:0/2255594502 >> v2:172.21.15.132:3300/0 conn(0x7f1c8406d090 msgr2=0x7f1c8415aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:07.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.913+0000 7f1c837fe640 1 --2- 172.21.15.132:0/2255594502 >> v2:172.21.15.132:3300/0 conn(0x7f1c8406d090 0x7f1c8415aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:07.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.913+0000 7f1c837fe640 1 -- 172.21.15.132:0/2255594502 >> v1:172.21.15.132:6789/0 conn(0x7f1c84151930 legacy=0x7f1c840c6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:07.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.913+0000 7f1c837fe640 1 -- 172.21.15.132:0/2255594502 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c840c7490 con 0x7f1c8406d4b0 2024-04-18T04:44:07.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.913+0000 7f1c81ffb640 1 -- 172.21.15.132:0/2255594502 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4266174084 0 0) 0x7f1c84157e20 con 0x7f1c84151930 2024-04-18T04:44:07.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.913+0000 7f1c827fc640 1 --2- 172.21.15.132:0/2255594502 >> v2:172.21.15.132:3300/0 conn(0x7f1c8406d090 0x7f1c8415aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:44:07.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.917+0000 7f1c837fe640 1 --2- 172.21.15.132:0/2255594502 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c8406d4b0 0x7f1c8406aed0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c009e50 tx=0x7f1c7c01ca00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e72464ed702e7462 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:07.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.917+0000 7f1c81ffb640 1 -- 172.21.15.132:0/2255594502 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c0a57e0 con 0x7f1c8406d4b0 2024-04-18T04:44:07.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.917+0000 7f1c81ffb640 1 -- 172.21.15.132:0/2255594502 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c7c0a5940 con 0x7f1c8406d4b0 2024-04-18T04:44:07.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.917+0000 7f1c81ffb640 1 -- 172.21.15.132:0/2255594502 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c0a5cd0 con 0x7f1c8406d4b0 2024-04-18T04:44:07.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.917+0000 7f1c898fc640 1 -- 172.21.15.132:0/2255594502 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c8406d4b0 msgr2=0x7f1c8406aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:07.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.917+0000 7f1c898fc640 1 --2- 172.21.15.132:0/2255594502 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c8406d4b0 0x7f1c8406aed0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c009e50 tx=0x7f1c7c01ca00 comp rx=0 tx=0).stop 2024-04-18T04:44:07.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.917+0000 7f1c898fc640 1 -- 172.21.15.132:0/2255594502 shutdown_connections 2024-04-18T04:44:07.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.917+0000 7f1c898fc640 1 --2- 172.21.15.132:0/2255594502 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c8406d4b0 0x7f1c8406aed0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:07.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.917+0000 7f1c898fc640 1 --2- 172.21.15.132:0/2255594502 >> v2:172.21.15.132:3300/0 conn(0x7f1c8406d090 0x7f1c8415aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:07.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.917+0000 7f1c898fc640 1 -- 172.21.15.132:0/2255594502 >> 172.21.15.132:0/2255594502 conn(0x7f1c8406c4a0 msgr2=0x7f1c8406c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:07.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.917+0000 7f1c898fc640 1 -- 172.21.15.132:0/2255594502 shutdown_connections 2024-04-18T04:44:07.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.917+0000 7f1c898fc640 1 -- 172.21.15.132:0/2255594502 wait complete. 2024-04-18T04:44:07.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.921+0000 7f1c898fc640 1 Processor -- start 2024-04-18T04:44:07.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.921+0000 7f1c898fc640 1 -- start start 2024-04-18T04:44:07.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.921+0000 7f1c898fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c8406d090 0x7f1c84159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:07.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.921+0000 7f1c898fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c8406d4b0 0x7f1c841f2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:07.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.921+0000 7f1c898fc640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c84151930 0x7f1c84142e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:07.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.921+0000 7f1c898fc640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c840c5bf0 con 0x7f1c8406d4b0 2024-04-18T04:44:07.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.921+0000 7f1c898fc640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c840c5760 con 0x7f1c8406d090 2024-04-18T04:44:07.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.921+0000 7f1c898fc640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c841f39b0 con 0x7f1c84151930 2024-04-18T04:44:07.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.921+0000 7f1c82ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c8406d090 0x7f1c84159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:07.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.921+0000 7f1c82ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c8406d090 0x7f1c84159f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:46300/0 (socket says 172.21.15.132:46300) 2024-04-18T04:44:07.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.921+0000 7f1c82ffd640 1 -- 172.21.15.132:0/3193486704 learned_addr learned my addr 172.21.15.132:0/3193486704 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-18T04:44:07.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.921+0000 7f1c837fe640 1 --2- 172.21.15.132:0/3193486704 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c84151930 0x7f1c84142e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:07.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.921+0000 7f1c82ffd640 1 -- 172.21.15.132:0/3193486704 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c84151930 msgr2=0x7f1c84142e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:07.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.921+0000 7f1c82ffd640 1 --2- 172.21.15.132:0/3193486704 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c84151930 0x7f1c84142e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:07.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.921+0000 7f1c82ffd640 1 -- 172.21.15.132:0/3193486704 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c8406d4b0 msgr2=0x7f1c841f2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:07.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.921+0000 7f1c82ffd640 1 --2- 172.21.15.132:0/3193486704 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c8406d4b0 0x7f1c841f2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:07.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.921+0000 7f1c82ffd640 1 -- 172.21.15.132:0/3193486704 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c74009420 con 0x7f1c8406d090 2024-04-18T04:44:07.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.921+0000 7f1c82ffd640 1 --2- 172.21.15.132:0/3193486704 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c8406d090 0x7f1c84159f30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1c7800c480 tx=0x7f1c7800c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:07.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.921+0000 7f1c6bfff640 1 -- 172.21.15.132:0/3193486704 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c780074e0 con 0x7f1c8406d090 2024-04-18T04:44:07.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.921+0000 7f1c6bfff640 1 -- 172.21.15.132:0/3193486704 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c78007660 con 0x7f1c8406d090 2024-04-18T04:44:07.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.921+0000 7f1c898fc640 1 -- 172.21.15.132:0/3193486704 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c7c009b30 con 0x7f1c8406d090 2024-04-18T04:44:07.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.921+0000 7f1c6bfff640 1 -- 172.21.15.132:0/3193486704 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c78004a30 con 0x7f1c8406d090 2024-04-18T04:44:07.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.921+0000 7f1c898fc640 1 -- 172.21.15.132:0/3193486704 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c84158430 con 0x7f1c8406d090 2024-04-18T04:44:07.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.921+0000 7f1c6bfff640 1 -- 172.21.15.132:0/3193486704 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f1c7801d440 con 0x7f1c8406d090 2024-04-18T04:44:07.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.921+0000 7f1c6bfff640 1 -- 172.21.15.132:0/3193486704 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f1c78012980 con 0x7f1c8406d090 2024-04-18T04:44:07.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.921+0000 7f1c898fc640 1 -- 172.21.15.132:0/3193486704 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c84073c00 con 0x7f1c8406d090 2024-04-18T04:44:07.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:07.925+0000 7f1c6bfff640 1 -- 172.21.15.132:0/3193486704 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f1c78018070 con 0x7f1c8406d090 2024-04-18T04:44:07.947 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-04-18T04:44:07.947+0000 7f9bfaa80180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-18T04:44:07.995 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-18T04:44:07.997+0000 7f3f4e3ae180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-18T04:44:07.998 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.001+0000 7f1c898fc640 1 -- 172.21.15.132:0/3193486704 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2243fabe-cc81-40cf-91bc-f106fe275a01", "id": 5} v 0) v1 -- 0x7f1c84158290 con 0x7f1c8406d090 2024-04-18T04:44:08.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.005+0000 7f1c6bfff640 1 -- 172.21.15.132:0/3193486704 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2243fabe-cc81-40cf-91bc-f106fe275a01", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1c84158290 con 0x7f1c8406d090 2024-04-18T04:44:08.003 INFO:teuthology.orchestra.run.smithi132.stdout:5 2024-04-18T04:44:08.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.009+0000 7f1c898fc640 1 -- 172.21.15.132:0/3193486704 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c8406d090 msgr2=0x7f1c84159f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:08.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.009+0000 7f1c898fc640 1 --2- 172.21.15.132:0/3193486704 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c8406d090 0x7f1c84159f30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1c7800c480 tx=0x7f1c7800c940 comp rx=0 tx=0).stop 2024-04-18T04:44:08.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.009+0000 7f1c898fc640 1 -- 172.21.15.132:0/3193486704 shutdown_connections 2024-04-18T04:44:08.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.009+0000 7f1c898fc640 1 --2- 172.21.15.132:0/3193486704 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c84151930 0x7f1c84142e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:08.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.009+0000 7f1c898fc640 1 --2- 172.21.15.132:0/3193486704 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c8406d4b0 0x7f1c841f2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:08.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.009+0000 7f1c898fc640 1 --2- 172.21.15.132:0/3193486704 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c8406d090 0x7f1c84159f30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:08.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.009+0000 7f1c898fc640 1 -- 172.21.15.132:0/3193486704 >> 172.21.15.132:0/3193486704 conn(0x7f1c8406c4a0 msgr2=0x7f1c84071ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:08.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.009+0000 7f1c898fc640 1 -- 172.21.15.132:0/3193486704 shutdown_connections 2024-04-18T04:44:08.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.009+0000 7f1c898fc640 1 -- 172.21.15.132:0/3193486704 wait complete. 2024-04-18T04:44:08.008 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-04-18T04:44:08.007+0000 7f9bfaa80180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-18T04:44:08.020 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new c093a5ed-25c8-41a7-a20d-606a1a1661e9 6 2024-04-18T04:44:08.051 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-18T04:44:08.053+0000 7f3f4e3ae180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-18T04:44:08.096 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-04-18T04:44:08.095+0000 7f9bfaa80180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-18T04:44:08.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.141+0000 7f3579127640 1 Processor -- start 2024-04-18T04:44:08.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.141+0000 7f3579127640 1 -- start start 2024-04-18T04:44:08.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.145+0000 7f3579127640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3574151740 0x7f3574157e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:08.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.145+0000 7f3579127640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3574158d90 0x7f35741591a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:08.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.145+0000 7f3579127640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3574158900 con 0x7f357406e670 2024-04-18T04:44:08.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.145+0000 7f3579127640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35741583d0 con 0x7f3574151740 2024-04-18T04:44:08.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.145+0000 7f3579127640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3574151b20 con 0x7f3574158d90 2024-04-18T04:44:08.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.145+0000 7f357359e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3574158d90 0x7f35741591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:08.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.145+0000 7f357359e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3574158d90 0x7f35741591a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:46308/0 (socket says 172.21.15.132:46308) 2024-04-18T04:44:08.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.145+0000 7f357259c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f357406e670 0x7f35740cd380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:53638/0 (socket says 172.21.15.132:53638) 2024-04-18T04:44:08.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.145+0000 7f357359e640 1 -- 172.21.15.132:0/2517630708 learned_addr learned my addr 172.21.15.132:0/2517630708 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-18T04:44:08.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.145+0000 7f3572d9d640 1 --2- 172.21.15.132:0/2517630708 >> v2:172.21.15.120:3300/0 conn(0x7f3574151740 0x7f3574157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:08.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.145+0000 7f357359e640 1 -- 172.21.15.132:0/2517630708 >> v2:172.21.15.120:3300/0 conn(0x7f3574151740 msgr2=0x7f3574157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:08.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.145+0000 7f357359e640 1 --2- 172.21.15.132:0/2517630708 >> v2:172.21.15.120:3300/0 conn(0x7f3574151740 0x7f3574157e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:08.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.145+0000 7f357359e640 1 -- 172.21.15.132:0/2517630708 >> v1:172.21.15.132:6789/0 conn(0x7f357406e670 legacy=0x7f35740cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:08.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.145+0000 7f3571d9b640 1 -- 172.21.15.132:0/2517630708 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3142332780 0 0) 0x7f3574158900 con 0x7f357406e670 2024-04-18T04:44:08.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.145+0000 7f357359e640 1 -- 172.21.15.132:0/2517630708 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35740c1fe0 con 0x7f3574158d90 2024-04-18T04:44:08.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.145+0000 7f357359e640 1 --2- 172.21.15.132:0/2517630708 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3574158d90 0x7f35741591a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f357415a940 tx=0x7f356c01c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a58326f9f4deefe server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:08.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.145+0000 7f3571d9b640 1 -- 172.21.15.132:0/2517630708 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c0a5690 con 0x7f3574158d90 2024-04-18T04:44:08.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.145+0000 7f3571d9b640 1 -- 172.21.15.132:0/2517630708 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356c0a57f0 con 0x7f3574158d90 2024-04-18T04:44:08.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.145+0000 7f3571d9b640 1 -- 172.21.15.132:0/2517630708 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c0a5b80 con 0x7f3574158d90 2024-04-18T04:44:08.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.145+0000 7f3579127640 1 -- 172.21.15.132:0/2517630708 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3574158d90 msgr2=0x7f35741591a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:08.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.145+0000 7f3579127640 1 --2- 172.21.15.132:0/2517630708 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3574158d90 0x7f35741591a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f357415a940 tx=0x7f356c01c9f0 comp rx=0 tx=0).stop 2024-04-18T04:44:08.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.145+0000 7f3579127640 1 -- 172.21.15.132:0/2517630708 shutdown_connections 2024-04-18T04:44:08.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.145+0000 7f3579127640 1 --2- 172.21.15.132:0/2517630708 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3574158d90 0x7f35741591a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:08.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.145+0000 7f3579127640 1 --2- 172.21.15.132:0/2517630708 >> v2:172.21.15.120:3300/0 conn(0x7f3574151740 0x7f3574157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:08.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.145+0000 7f3579127640 1 -- 172.21.15.132:0/2517630708 >> 172.21.15.132:0/2517630708 conn(0x7f3574065d90 msgr2=0x7f35740661a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:08.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.145+0000 7f3579127640 1 -- 172.21.15.132:0/2517630708 shutdown_connections 2024-04-18T04:44:08.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.145+0000 7f3579127640 1 -- 172.21.15.132:0/2517630708 wait complete. 2024-04-18T04:44:08.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.149+0000 7f3579127640 1 Processor -- start 2024-04-18T04:44:08.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.149+0000 7f3579127640 1 -- start start 2024-04-18T04:44:08.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.149+0000 7f3579127640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f357406e670 0x7f35741f5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:08.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.149+0000 7f3579127640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3574151740 0x7f357414d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:08.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.149+0000 7f3579127640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3574158d90 0x7f3574155f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:08.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.149+0000 7f3579127640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35740c6240 con 0x7f3574151740 2024-04-18T04:44:08.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.149+0000 7f3579127640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35741f5b80 con 0x7f357406e670 2024-04-18T04:44:08.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.149+0000 7f3579127640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35741f2100 con 0x7f3574158d90 2024-04-18T04:44:08.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.149+0000 7f357359e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3574158d90 0x7f3574155f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:08.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.149+0000 7f3572d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f357406e670 0x7f35741f5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:08.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.149+0000 7f357359e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3574158d90 0x7f3574155f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.132:53030/0 (socket says 172.21.15.132:53030) 2024-04-18T04:44:08.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.149+0000 7f357359e640 1 -- 172.21.15.132:0/2666330821 learned_addr learned my addr 172.21.15.132:0/2666330821 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-18T04:44:08.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.149+0000 7f357259c640 1 --2- 172.21.15.132:0/2666330821 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3574151740 0x7f357414d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:08.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.149+0000 7f357359e640 1 -- 172.21.15.132:0/2666330821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f357406e670 msgr2=0x7f35741f5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:08.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.149+0000 7f357359e640 1 --2- 172.21.15.132:0/2666330821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f357406e670 0x7f35741f5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:08.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.149+0000 7f357359e640 1 -- 172.21.15.132:0/2666330821 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3574151740 msgr2=0x7f357414d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:08.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.149+0000 7f357359e640 1 --2- 172.21.15.132:0/2666330821 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3574151740 0x7f357414d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:08.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.149+0000 7f357359e640 1 -- 172.21.15.132:0/2666330821 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f356c009b30 con 0x7f3574158d90 2024-04-18T04:44:08.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.149+0000 7f3572d9d640 1 --2- 172.21.15.132:0/2666330821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f357406e670 0x7f35741f5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:44:08.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.149+0000 7f357359e640 1 --2- 172.21.15.132:0/2666330821 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3574158d90 0x7f3574155f70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f356c0af040 tx=0x7f356c019790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:08.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.149+0000 7f355b7fe640 1 -- 172.21.15.132:0/2666330821 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c0b8670 con 0x7f3574158d90 2024-04-18T04:44:08.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.149+0000 7f355b7fe640 1 -- 172.21.15.132:0/2666330821 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356c0b87f0 con 0x7f3574158d90 2024-04-18T04:44:08.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.149+0000 7f355b7fe640 1 -- 172.21.15.132:0/2666330821 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c0b8ba0 con 0x7f3574158d90 2024-04-18T04:44:08.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.149+0000 7f3579127640 1 -- 172.21.15.132:0/2666330821 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35741f17d0 con 0x7f3574158d90 2024-04-18T04:44:08.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.149+0000 7f3579127640 1 -- 172.21.15.132:0/2666330821 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35741f1d90 con 0x7f3574158d90 2024-04-18T04:44:08.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.149+0000 7f355b7fe640 1 -- 172.21.15.132:0/2666330821 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f356c0c3460 con 0x7f3574158d90 2024-04-18T04:44:08.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.149+0000 7f355b7fe640 1 -- 172.21.15.132:0/2666330821 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f356c0b6a30 con 0x7f3574158d90 2024-04-18T04:44:08.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.149+0000 7f3579127640 1 -- 172.21.15.132:0/2666330821 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35740729d0 con 0x7f3574158d90 2024-04-18T04:44:08.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.153+0000 7f355b7fe640 1 -- 172.21.15.132:0/2666330821 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f356c0b6d10 con 0x7f3574158d90 2024-04-18T04:44:08.157 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-04-18T04:44:08.155+0000 7f9bfaa80180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-18T04:44:08.209 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-18T04:44:08.213+0000 7f3f4e3ae180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-18T04:44:08.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.221+0000 7f3579127640 1 -- 172.21.15.132:0/2666330821 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c093a5ed-25c8-41a7-a20d-606a1a1661e9", "id": 6} v 0) v1 -- 0x7f3574154e30 con 0x7f3574158d90 2024-04-18T04:44:08.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.225+0000 7f355b7fe640 1 -- 172.21.15.132:0/2666330821 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c093a5ed-25c8-41a7-a20d-606a1a1661e9", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f356c0b6440 con 0x7f3574158d90 2024-04-18T04:44:08.224 INFO:teuthology.orchestra.run.smithi132.stdout:6 2024-04-18T04:44:08.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.229+0000 7f3579127640 1 -- 172.21.15.132:0/2666330821 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3574158d90 msgr2=0x7f3574155f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:08.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.229+0000 7f3579127640 1 --2- 172.21.15.132:0/2666330821 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3574158d90 0x7f3574155f70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f356c0af040 tx=0x7f356c019790 comp rx=0 tx=0).stop 2024-04-18T04:44:08.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.229+0000 7f3579127640 1 -- 172.21.15.132:0/2666330821 shutdown_connections 2024-04-18T04:44:08.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.229+0000 7f3579127640 1 --2- 172.21.15.132:0/2666330821 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3574158d90 0x7f3574155f70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:08.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.229+0000 7f3579127640 1 --2- 172.21.15.132:0/2666330821 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3574151740 0x7f357414d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:08.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.229+0000 7f3579127640 1 --2- 172.21.15.132:0/2666330821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f357406e670 0x7f35741f5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:08.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.229+0000 7f3579127640 1 -- 172.21.15.132:0/2666330821 >> 172.21.15.132:0/2666330821 conn(0x7f3574065d90 msgr2=0x7f3574150390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:08.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.229+0000 7f3579127640 1 -- 172.21.15.132:0/2666330821 shutdown_connections 2024-04-18T04:44:08.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.229+0000 7f3579127640 1 -- 172.21.15.132:0/2666330821 wait complete. 2024-04-18T04:44:08.241 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new c37426b7-1080-4434-9f3e-a3afbbdc0fac 7 2024-04-18T04:44:08.271 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-18T04:44:08.273+0000 7f3f4e3ae180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-18T04:44:08.324 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-04-18T04:44:08.323+0000 7f9bfaa80180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-18T04:44:08.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.389+0000 7fae2c585640 1 Processor -- start 2024-04-18T04:44:08.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.389+0000 7fae2c585640 1 -- start start 2024-04-18T04:44:08.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.389+0000 7fae2c585640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fae2406fff0 0x7fae24072080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:08.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.389+0000 7fae2c585640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fae240c3ec0 0x7fae241502c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:08.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.389+0000 7fae2c585640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae24071bf0 con 0x7fae24159d70 2024-04-18T04:44:08.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.389+0000 7fae2c585640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae24066300 con 0x7fae2406fff0 2024-04-18T04:44:08.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.389+0000 7fae2c585640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae240cc200 con 0x7fae240c3ec0 2024-04-18T04:44:08.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.389+0000 7fae29b20640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fae2406fff0 0x7fae24072080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:08.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.389+0000 7fae2ab22640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fae240c3ec0 0x7fae241502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:08.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.389+0000 7fae29b20640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fae2406fff0 0x7fae24072080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:46320/0 (socket says 172.21.15.132:46320) 2024-04-18T04:44:08.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.389+0000 7fae29b20640 1 -- 172.21.15.132:0/4250928224 learned_addr learned my addr 172.21.15.132:0/4250928224 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-18T04:44:08.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.389+0000 7fae2ab22640 1 --2- 172.21.15.132:0/4250928224 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fae240c3ec0 0x7fae241502c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.132:53044/0 (socket says 172.21.15.132:53044) 2024-04-18T04:44:08.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.393+0000 7fae29b20640 1 -- 172.21.15.132:0/4250928224 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fae240c3ec0 msgr2=0x7fae241502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:08.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.393+0000 7fae29b20640 1 --2- 172.21.15.132:0/4250928224 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fae240c3ec0 0x7fae241502c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:08.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.393+0000 7fae29b20640 1 -- 172.21.15.132:0/4250928224 >> v1:172.21.15.132:6789/0 conn(0x7fae24159d70 legacy=0x7fae2415a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:08.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.393+0000 7fae29b20640 1 -- 172.21.15.132:0/4250928224 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae240c42f0 con 0x7fae2406fff0 2024-04-18T04:44:08.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.393+0000 7fae29b20640 1 --2- 172.21.15.132:0/4250928224 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae2406fff0 0x7fae24072080 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fae1400bb10 tx=0x7fae14021420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a2a2f5a866e5255 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:08.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.393+0000 7fae2931f640 1 -- 172.21.15.132:0/4250928224 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae140b1600 con 0x7fae2406fff0 2024-04-18T04:44:08.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.393+0000 7fae2931f640 1 -- 172.21.15.132:0/4250928224 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae140ad050 con 0x7fae2406fff0 2024-04-18T04:44:08.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.393+0000 7fae2931f640 1 -- 172.21.15.132:0/4250928224 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae140b1980 con 0x7fae2406fff0 2024-04-18T04:44:08.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.393+0000 7fae2c585640 1 -- 172.21.15.132:0/4250928224 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae2406fff0 msgr2=0x7fae24072080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:08.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.393+0000 7fae2c585640 1 --2- 172.21.15.132:0/4250928224 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae2406fff0 0x7fae24072080 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fae1400bb10 tx=0x7fae14021420 comp rx=0 tx=0).stop 2024-04-18T04:44:08.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.393+0000 7fae2c585640 1 -- 172.21.15.132:0/4250928224 shutdown_connections 2024-04-18T04:44:08.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.393+0000 7fae2c585640 1 --2- 172.21.15.132:0/4250928224 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fae240c3ec0 0x7fae241502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:08.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.393+0000 7fae2c585640 1 --2- 172.21.15.132:0/4250928224 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae2406fff0 0x7fae24072080 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:08.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.393+0000 7fae2c585640 1 -- 172.21.15.132:0/4250928224 >> 172.21.15.132:0/4250928224 conn(0x7fae240cb390 msgr2=0x7fae240cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:08.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.393+0000 7fae2c585640 1 -- 172.21.15.132:0/4250928224 shutdown_connections 2024-04-18T04:44:08.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.393+0000 7fae2c585640 1 -- 172.21.15.132:0/4250928224 wait complete. 2024-04-18T04:44:08.393 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-04-18T04:44:08.391+0000 7f9bfaa80180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-18T04:44:08.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.397+0000 7fae2c585640 1 Processor -- start 2024-04-18T04:44:08.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.397+0000 7fae2c585640 1 -- start start 2024-04-18T04:44:08.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.397+0000 7fae2c585640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fae2406fff0 0x7fae24143770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:08.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.397+0000 7fae2c585640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae240c3ec0 0x7fae2414f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:08.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.397+0000 7fae2c585640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae24159d70 0x7fae241eae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:08.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.397+0000 7fae2c585640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae241586a0 con 0x7fae24159d70 2024-04-18T04:44:08.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.397+0000 7fae2c585640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae241ee160 con 0x7fae240c3ec0 2024-04-18T04:44:08.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.397+0000 7fae2c585640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae241ee3e0 con 0x7fae2406fff0 2024-04-18T04:44:08.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.397+0000 7fae29b20640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae240c3ec0 0x7fae2414f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:08.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.397+0000 7fae2a321640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fae2406fff0 0x7fae24143770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:08.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.397+0000 7fae29b20640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae240c3ec0 0x7fae2414f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:46326/0 (socket says 172.21.15.132:46326) 2024-04-18T04:44:08.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.397+0000 7fae29b20640 1 -- 172.21.15.132:0/2794003121 learned_addr learned my addr 172.21.15.132:0/2794003121 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-18T04:44:08.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.397+0000 7fae2a321640 1 -- 172.21.15.132:0/2794003121 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae240c3ec0 msgr2=0x7fae2414f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:08.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.397+0000 7fae2a321640 1 --2- 172.21.15.132:0/2794003121 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae240c3ec0 0x7fae2414f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:08.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.397+0000 7fae2a321640 1 -- 172.21.15.132:0/2794003121 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae24159d70 msgr2=0x7fae241eae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:08.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.397+0000 7fae2a321640 1 --2- 172.21.15.132:0/2794003121 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae24159d70 0x7fae241eae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:08.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.397+0000 7fae2a321640 1 -- 172.21.15.132:0/2794003121 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae1400b770 con 0x7fae2406fff0 2024-04-18T04:44:08.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.397+0000 7fae29b20640 1 --2- 172.21.15.132:0/2794003121 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae240c3ec0 0x7fae2414f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:44:08.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.397+0000 7fae2a321640 1 --2- 172.21.15.132:0/2794003121 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fae2406fff0 0x7fae24143770 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fae1c00c6b0 tx=0x7fae1c00cb70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:08.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.397+0000 7fae1affd640 1 -- 172.21.15.132:0/2794003121 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1c003b80 con 0x7fae2406fff0 2024-04-18T04:44:08.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.397+0000 7fae1affd640 1 -- 172.21.15.132:0/2794003121 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae1c003ce0 con 0x7fae2406fff0 2024-04-18T04:44:08.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.397+0000 7fae2c585640 1 -- 172.21.15.132:0/2794003121 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae240cb0c0 con 0x7fae2406fff0 2024-04-18T04:44:08.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.397+0000 7fae1affd640 1 -- 172.21.15.132:0/2794003121 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1c005310 con 0x7fae2406fff0 2024-04-18T04:44:08.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.397+0000 7fae2c585640 1 -- 172.21.15.132:0/2794003121 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae241ee980 con 0x7fae2406fff0 2024-04-18T04:44:08.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.397+0000 7fae1affd640 1 -- 172.21.15.132:0/2794003121 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fae1c00a640 con 0x7fae2406fff0 2024-04-18T04:44:08.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.397+0000 7fae1affd640 1 -- 172.21.15.132:0/2794003121 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fae1c012a80 con 0x7fae2406fff0 2024-04-18T04:44:08.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.397+0000 7fae2c585640 1 -- 172.21.15.132:0/2794003121 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae240729d0 con 0x7fae2406fff0 2024-04-18T04:44:08.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.401+0000 7fae1affd640 1 -- 172.21.15.132:0/2794003121 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fae1c012cd0 con 0x7fae2406fff0 2024-04-18T04:44:08.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.469+0000 7fae2c585640 1 -- 172.21.15.132:0/2794003121 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c37426b7-1080-4434-9f3e-a3afbbdc0fac", "id": 7} v 0) v1 -- 0x7fae2415a830 con 0x7fae2406fff0 2024-04-18T04:44:08.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.473+0000 7fae1affd640 1 -- 172.21.15.132:0/2794003121 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c37426b7-1080-4434-9f3e-a3afbbdc0fac", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fae1c00aad0 con 0x7fae2406fff0 2024-04-18T04:44:08.472 INFO:teuthology.orchestra.run.smithi132.stdout:7 2024-04-18T04:44:08.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.477+0000 7fae2c585640 1 -- 172.21.15.132:0/2794003121 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fae2406fff0 msgr2=0x7fae24143770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:08.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.477+0000 7fae2c585640 1 --2- 172.21.15.132:0/2794003121 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fae2406fff0 0x7fae24143770 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fae1c00c6b0 tx=0x7fae1c00cb70 comp rx=0 tx=0).stop 2024-04-18T04:44:08.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.477+0000 7fae2c585640 1 -- 172.21.15.132:0/2794003121 shutdown_connections 2024-04-18T04:44:08.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.477+0000 7fae2c585640 1 --2- 172.21.15.132:0/2794003121 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae24159d70 0x7fae241eae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:08.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.477+0000 7fae2c585640 1 --2- 172.21.15.132:0/2794003121 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae240c3ec0 0x7fae2414f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:08.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.477+0000 7fae2c585640 1 --2- 172.21.15.132:0/2794003121 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fae2406fff0 0x7fae24143770 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:08.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.477+0000 7fae2c585640 1 -- 172.21.15.132:0/2794003121 >> 172.21.15.132:0/2794003121 conn(0x7fae240cb390 msgr2=0x7fae240c6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:08.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.477+0000 7fae2c585640 1 -- 172.21.15.132:0/2794003121 shutdown_connections 2024-04-18T04:44:08.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-18T04:44:08.477+0000 7fae2c585640 1 -- 172.21.15.132:0/2794003121 wait complete. 2024-04-18T04:44:08.488 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-18T04:44:08.488 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-18T04:44:08.491 INFO:tasks.ceph.osd.0:Started 2024-04-18T04:44:08.492 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-18T04:44:08.492 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-18T04:44:08.495 INFO:tasks.ceph.osd.1:Started 2024-04-18T04:44:08.495 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-18T04:44:08.495 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-18T04:44:08.498 INFO:tasks.ceph.osd.2:Started 2024-04-18T04:44:08.498 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-18T04:44:08.498 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-18T04:44:08.502 INFO:tasks.ceph.osd.3:Started 2024-04-18T04:44:08.502 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-18T04:44:08.502 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-18T04:44:08.504 INFO:tasks.ceph.osd.4:Started 2024-04-18T04:44:08.504 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-18T04:44:08.504 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-18T04:44:08.506 INFO:tasks.ceph.osd.5:Started 2024-04-18T04:44:08.506 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-18T04:44:08.506 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-18T04:44:08.508 INFO:tasks.ceph.osd.6:Started 2024-04-18T04:44:08.508 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-18T04:44:08.508 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-18T04:44:08.510 INFO:tasks.ceph.osd.7:Started 2024-04-18T04:44:08.511 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T04:44:08.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.663+0000 7f1425400640 1 Processor -- start 2024-04-18T04:44:08.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.663+0000 7f1425400640 1 -- start start 2024-04-18T04:44:08.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.663+0000 7f1425400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f14201515e0 0x7f14201573c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:08.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.663+0000 7f1425400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f14200ca280 0x7f142006fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:08.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.663+0000 7f1425400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14200ca690 0x7f14200ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:08.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.663+0000 7f1425400640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14200c3120 con 0x7f14201515e0 2024-04-18T04:44:08.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.663+0000 7f1425400640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1420157a50 con 0x7f14200ca280 2024-04-18T04:44:08.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.663+0000 7f1425400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1420157d10 con 0x7f14200ca690 2024-04-18T04:44:08.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.663+0000 7f141e800640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f14201515e0 0x7f14201573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:08.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.663+0000 7f141e800640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f14201515e0 0x7f14201573c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58392/0 (socket says 172.21.15.120:58392) 2024-04-18T04:44:08.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.663+0000 7f141e800640 1 -- 172.21.15.120:0/2643349521 learned_addr learned my addr 172.21.15.120:0/2643349521 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:08.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.663+0000 7f141f200640 1 --2- 172.21.15.120:0/2643349521 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14200ca690 0x7f14200ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:08.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.663+0000 7f141de00640 1 --2- 172.21.15.120:0/2643349521 >> v2:172.21.15.132:3300/0 conn(0x7f14200ca280 0x7f142006fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:08.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.663+0000 7f141e800640 1 -- 172.21.15.120:0/2643349521 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14200ca690 msgr2=0x7f14200ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:08.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.663+0000 7f141e800640 1 --2- 172.21.15.120:0/2643349521 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14200ca690 0x7f14200ccee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:08.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.663+0000 7f141e800640 1 -- 172.21.15.120:0/2643349521 >> v2:172.21.15.132:3300/0 conn(0x7f14200ca280 msgr2=0x7f142006fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:08.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.663+0000 7f141e800640 1 --2- 172.21.15.120:0/2643349521 >> v2:172.21.15.132:3300/0 conn(0x7f14200ca280 0x7f142006fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:08.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.663+0000 7f141e800640 1 -- 172.21.15.120:0/2643349521 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1420157ff0 con 0x7f14201515e0 2024-04-18T04:44:08.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.667+0000 7f141e800640 1 --2- 172.21.15.120:0/2643349521 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14201515e0 0x7f14201573c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f142006e5f0 tx=0x7f141001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3390157ba2a52063 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:08.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.667+0000 7f141d400640 1 -- 172.21.15.120:0/2643349521 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14100a89d0 con 0x7f14201515e0 2024-04-18T04:44:08.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.667+0000 7f141d400640 1 -- 172.21.15.120:0/2643349521 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14100a8b30 con 0x7f14201515e0 2024-04-18T04:44:08.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.667+0000 7f141d400640 1 -- 172.21.15.120:0/2643349521 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14100b0440 con 0x7f14201515e0 2024-04-18T04:44:08.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.667+0000 7f1425400640 1 -- 172.21.15.120:0/2643349521 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14201515e0 msgr2=0x7f14201573c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:08.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.667+0000 7f1425400640 1 --2- 172.21.15.120:0/2643349521 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14201515e0 0x7f14201573c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f142006e5f0 tx=0x7f141001ed10 comp rx=0 tx=0).stop 2024-04-18T04:44:08.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.667+0000 7f1425400640 1 -- 172.21.15.120:0/2643349521 shutdown_connections 2024-04-18T04:44:08.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.667+0000 7f1425400640 1 --2- 172.21.15.120:0/2643349521 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14200ca690 0x7f14200ccee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:08.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.667+0000 7f1425400640 1 --2- 172.21.15.120:0/2643349521 >> v2:172.21.15.132:3300/0 conn(0x7f14200ca280 0x7f142006fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:08.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.667+0000 7f1425400640 1 --2- 172.21.15.120:0/2643349521 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14201515e0 0x7f14201573c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:08.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.667+0000 7f1425400640 1 -- 172.21.15.120:0/2643349521 >> 172.21.15.120:0/2643349521 conn(0x7f142006e0f0 msgr2=0x7f1420071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:08.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.667+0000 7f1425400640 1 -- 172.21.15.120:0/2643349521 shutdown_connections 2024-04-18T04:44:08.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.667+0000 7f1425400640 1 -- 172.21.15.120:0/2643349521 wait complete. 2024-04-18T04:44:08.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.667+0000 7f1425400640 1 Processor -- start 2024-04-18T04:44:08.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.667+0000 7f1425400640 1 -- start start 2024-04-18T04:44:08.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.671+0000 7f1425400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14200ca280 0x7f14201ed1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:08.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.671+0000 7f1425400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14200ca690 0x7f142014d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:08.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.671+0000 7f1425400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14201515e0 0x7f142014f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:08.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.671+0000 7f1425400640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14201ed730 con 0x7f14200ca280 2024-04-18T04:44:08.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.671+0000 7f1425400640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142014ee50 con 0x7f14201515e0 2024-04-18T04:44:08.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.671+0000 7f1425400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f142014f200 con 0x7f14200ca690 2024-04-18T04:44:08.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.671+0000 7f141e800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14200ca280 0x7f14201ed1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:08.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.671+0000 7f141de00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14200ca690 0x7f142014d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:08.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.671+0000 7f141de00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14200ca690 0x7f142014d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:34230/0 (socket says 172.21.15.120:34230) 2024-04-18T04:44:08.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.671+0000 7f141e800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14200ca280 0x7f14201ed1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58404/0 (socket says 172.21.15.120:58404) 2024-04-18T04:44:08.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.671+0000 7f141de00640 1 -- 172.21.15.120:0/477763120 learned_addr learned my addr 172.21.15.120:0/477763120 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:08.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.671+0000 7f141f200640 1 --2- 172.21.15.120:0/477763120 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14201515e0 0x7f142014f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:08.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.671+0000 7f141de00640 1 -- 172.21.15.120:0/477763120 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14201515e0 msgr2=0x7f142014f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:08.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.671+0000 7f141de00640 1 --2- 172.21.15.120:0/477763120 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14201515e0 0x7f142014f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:08.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.671+0000 7f141de00640 1 -- 172.21.15.120:0/477763120 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14200ca280 msgr2=0x7f14201ed1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:08.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.671+0000 7f141de00640 1 --2- 172.21.15.120:0/477763120 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14200ca280 0x7f14201ed1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:08.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.671+0000 7f141de00640 1 -- 172.21.15.120:0/477763120 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14100094d0 con 0x7f14200ca690 2024-04-18T04:44:08.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.671+0000 7f141e800640 1 --2- 172.21.15.120:0/477763120 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14200ca280 0x7f14201ed1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:44:08.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.671+0000 7f141de00640 1 --2- 172.21.15.120:0/477763120 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14200ca690 0x7f142014d5a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f140c00e8e0 tx=0x7f140c00eda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:08.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.671+0000 7f1416a00640 1 -- 172.21.15.120:0/477763120 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c00ca00 con 0x7f14200ca690 2024-04-18T04:44:08.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.671+0000 7f1416a00640 1 -- 172.21.15.120:0/477763120 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140c00cb60 con 0x7f14200ca690 2024-04-18T04:44:08.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.671+0000 7f1416a00640 1 -- 172.21.15.120:0/477763120 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c013470 con 0x7f14200ca690 2024-04-18T04:44:08.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.671+0000 7f1425400640 1 -- 172.21.15.120:0/477763120 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1420154810 con 0x7f14200ca690 2024-04-18T04:44:08.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.671+0000 7f1425400640 1 -- 172.21.15.120:0/477763120 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14201524e0 con 0x7f14200ca690 2024-04-18T04:44:08.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.671+0000 7f1416a00640 1 -- 172.21.15.120:0/477763120 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f140c005ca0 con 0x7f14200ca690 2024-04-18T04:44:08.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.671+0000 7f1416a00640 1 -- 172.21.15.120:0/477763120 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f140c006840 con 0x7f14200ca690 2024-04-18T04:44:08.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.671+0000 7f1425400640 1 -- 172.21.15.120:0/477763120 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1420072a70 con 0x7f14200ca690 2024-04-18T04:44:08.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.675+0000 7f1416a00640 1 -- 172.21.15.120:0/477763120 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f140c021060 con 0x7f14200ca690 2024-04-18T04:44:08.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.731+0000 7f1425400640 1 -- 172.21.15.120:0/477763120 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14200c3550 con 0x7f14200ca690 2024-04-18T04:44:08.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.731+0000 7f1416a00640 1 -- 172.21.15.120:0/477763120 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f140c029020 con 0x7f14200ca690 2024-04-18T04:44:08.733 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:44:08.734 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":10,"fsid":"8e73592f-08e2-4957-a98f-9d044cec4ba5","created":"2024-04-18T04:44:06.139983+0000","modified":"2024-04-18T04:44:08.470250+0000","last_up_change":"0.000000","last_in_change":"2024-04-18T04:44:08.470250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a80903bd-d9be-4fb9-af99-6125cb26bd2d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8f5f004b-6870-4c78-8d50-9622e631ec25","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6e228a2b-6103-4301-a8b5-ee81dbb1f920","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7a5cabd7-d898-4e32-a03c-25b46e790134","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8e9f530f-6bab-4b23-a1a3-a71362fefcc0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2243fabe-cc81-40cf-91bc-f106fe275a01","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c093a5ed-25c8-41a7-a20d-606a1a1661e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c37426b7-1080-4434-9f3e-a3afbbdc0fac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T04:44:08.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.735+0000 7f1425400640 1 -- 172.21.15.120:0/477763120 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14200ca690 msgr2=0x7f142014d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:08.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.735+0000 7f1425400640 1 --2- 172.21.15.120:0/477763120 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14200ca690 0x7f142014d5a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f140c00e8e0 tx=0x7f140c00eda0 comp rx=0 tx=0).stop 2024-04-18T04:44:08.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.735+0000 7f1425400640 1 -- 172.21.15.120:0/477763120 shutdown_connections 2024-04-18T04:44:08.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.735+0000 7f1425400640 1 --2- 172.21.15.120:0/477763120 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14201515e0 0x7f142014f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:08.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.735+0000 7f1425400640 1 --2- 172.21.15.120:0/477763120 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14200ca690 0x7f142014d5a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:08.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.735+0000 7f1425400640 1 --2- 172.21.15.120:0/477763120 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14200ca280 0x7f14201ed1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:08.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.735+0000 7f1425400640 1 -- 172.21.15.120:0/477763120 >> 172.21.15.120:0/477763120 conn(0x7f142006e0f0 msgr2=0x7f14200c4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:08.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.735+0000 7f1425400640 1 -- 172.21.15.120:0/477763120 shutdown_connections 2024-04-18T04:44:08.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:08.735+0000 7f1425400640 1 -- 172.21.15.120:0/477763120 wait complete. 2024-04-18T04:44:08.767 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-18T04:44:08.767 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-18T04:44:08.889 INFO:tasks.ceph.mgr.x.smithi132.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-18T04:44:08.889 INFO:tasks.ceph.mgr.x.smithi132.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-18T04:44:08.889 INFO:tasks.ceph.mgr.x.smithi132.stderr: from numpy import show_config as show_numpy_config 2024-04-18T04:44:08.898 INFO:tasks.ceph.osd.6.smithi132.stderr:2024-04-18T04:44:08.901+0000 7fb6f6fbd7c0 -1 Falling back to public interface 2024-04-18T04:44:08.918 INFO:tasks.ceph.osd.5.smithi132.stderr:2024-04-18T04:44:08.921+0000 7fc8f916e7c0 -1 Falling back to public interface 2024-04-18T04:44:08.930 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-18T04:44:08.933+0000 7f3f4e3ae180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-18T04:44:08.937 INFO:tasks.ceph.osd.7.smithi132.stderr:2024-04-18T04:44:08.941+0000 7fdbfc5b67c0 -1 Falling back to public interface 2024-04-18T04:44:09.080 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-18T04:44:09.081+0000 7f3f4e3ae180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-18T04:44:09.102 INFO:tasks.ceph.osd.4.smithi132.stderr:2024-04-18T04:44:09.105+0000 7fe5852d67c0 -1 Falling back to public interface 2024-04-18T04:44:09.108 INFO:tasks.ceph.mgr.y.smithi120.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-18T04:44:09.108 INFO:tasks.ceph.mgr.y.smithi120.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-18T04:44:09.108 INFO:tasks.ceph.mgr.y.smithi120.stderr: from numpy import show_config as show_numpy_config 2024-04-18T04:44:09.131 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-18T04:44:09.131+0000 7f3189f887c0 -1 Falling back to public interface 2024-04-18T04:44:09.175 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-04-18T04:44:09.175+0000 7f0a93b347c0 -1 Falling back to public interface 2024-04-18T04:44:09.176 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-04-18T04:44:09.175+0000 7f9bfaa80180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-18T04:44:09.178 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-04-18T04:44:09.179+0000 7f488582b7c0 -1 Falling back to public interface 2024-04-18T04:44:09.183 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-04-18T04:44:09.183+0000 7f085b9317c0 -1 Falling back to public interface 2024-04-18T04:44:09.250 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-18T04:44:09.253+0000 7f3f4e3ae180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-18T04:44:09.319 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-18T04:44:09.321+0000 7f3f4e3ae180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-18T04:44:09.325 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-04-18T04:44:09.323+0000 7f9bfaa80180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-18T04:44:09.463 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-18T04:44:09.465+0000 7f3f4e3ae180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-18T04:44:09.509 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-04-18T04:44:09.507+0000 7f9bfaa80180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-18T04:44:09.571 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-18T04:44:09.582 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-04-18T04:44:09.583+0000 7f9bfaa80180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-18T04:44:09.698 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.699+0000 7ff0f5400640 1 Processor -- start 2024-04-18T04:44:09.698 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.699+0000 7ff0f5400640 1 -- start start 2024-04-18T04:44:09.700 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.699+0000 7ff0f5400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0f0150670 0x7ff0f0070900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:09.701 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.699+0000 7ff0f5400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff0f006d060 0x7ff0f00c7290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:09.701 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.699+0000 7ff0f5400640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0f00720c0 con 0x7ff0f00c77d0 2024-04-18T04:44:09.701 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.699+0000 7ff0f5400640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0f00c81c0 con 0x7ff0f006d060 2024-04-18T04:44:09.701 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.699+0000 7ff0f5400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f00725f0 con 0x7ff0f0150670 2024-04-18T04:44:09.701 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.699+0000 7ff0ef200640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7ff0f00c77d0 0x7ff0f0159b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:51234/0 (socket says 172.21.15.120:51234) 2024-04-18T04:44:09.701 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.699+0000 7ff0ef200640 1 -- 172.21.15.120:0/2576817316 learned_addr learned my addr 172.21.15.120:0/2576817316 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:44:09.701 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.699+0000 7ff0ee800640 1 --2- 172.21.15.120:0/2576817316 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0f0150670 0x7ff0f0070900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:09.701 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.699+0000 7ff0ede00640 1 --2- 172.21.15.120:0/2576817316 >> v2:172.21.15.132:3300/0 conn(0x7ff0f006d060 0x7ff0f00c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:09.702 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.699+0000 7ff0ed400640 1 -- 172.21.15.120:0/2576817316 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3674187897 0 0) 0x7ff0f00720c0 con 0x7ff0f00c77d0 2024-04-18T04:44:09.702 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.699+0000 7ff0ed400640 1 -- 172.21.15.120:0/2576817316 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0d4005740 con 0x7ff0f00c77d0 2024-04-18T04:44:09.702 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.699+0000 7ff0ee800640 1 -- 172.21.15.120:0/2576817316 >> v2:172.21.15.132:3300/0 conn(0x7ff0f006d060 msgr2=0x7ff0f00c7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:09.702 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.699+0000 7ff0ee800640 1 --2- 172.21.15.120:0/2576817316 >> v2:172.21.15.132:3300/0 conn(0x7ff0f006d060 0x7ff0f00c7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:09.702 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.699+0000 7ff0ed400640 1 -- 172.21.15.120:0/2576817316 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1694893594 0 0) 0x7ff0d4005740 con 0x7ff0f00c77d0 2024-04-18T04:44:09.702 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.699+0000 7ff0ee800640 1 -- 172.21.15.120:0/2576817316 >> v1:172.21.15.120:6789/0 conn(0x7ff0f00c77d0 legacy=0x7ff0f0159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:09.702 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.699+0000 7ff0ee800640 1 -- 172.21.15.120:0/2576817316 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f0071e70 con 0x7ff0f0150670 2024-04-18T04:44:09.702 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.699+0000 7ff0ede00640 1 --2- 172.21.15.120:0/2576817316 >> v2:172.21.15.132:3300/0 conn(0x7ff0f006d060 0x7ff0f00c7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:44:09.704 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.703+0000 7ff0ee800640 1 --2- 172.21.15.120:0/2576817316 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0f0150670 0x7ff0f0070900 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff0e00097c0 tx=0x7ff0e001c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=944f9f9e9db4a2fd server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:09.704 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.703+0000 7ff0ed400640 1 -- 172.21.15.120:0/2576817316 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e8001a00 con 0x7ff0f0150670 2024-04-18T04:44:09.704 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.703+0000 7ff0ed400640 1 -- 172.21.15.120:0/2576817316 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e00a7050 con 0x7ff0f0150670 2024-04-18T04:44:09.705 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.703+0000 7ff0ed400640 1 -- 172.21.15.120:0/2576817316 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e00ab600 con 0x7ff0f0150670 2024-04-18T04:44:09.706 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.703+0000 7ff0f5400640 1 -- 172.21.15.120:0/2576817316 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0f0150670 msgr2=0x7ff0f0070900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:09.706 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.703+0000 7ff0f5400640 1 --2- 172.21.15.120:0/2576817316 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0f0150670 0x7ff0f0070900 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff0e00097c0 tx=0x7ff0e001c3c0 comp rx=0 tx=0).stop 2024-04-18T04:44:09.706 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.703+0000 7ff0f5400640 1 -- 172.21.15.120:0/2576817316 shutdown_connections 2024-04-18T04:44:09.706 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.703+0000 7ff0f5400640 1 --2- 172.21.15.120:0/2576817316 >> v2:172.21.15.132:3300/0 conn(0x7ff0f006d060 0x7ff0f00c7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:09.706 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.703+0000 7ff0f5400640 1 --2- 172.21.15.120:0/2576817316 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0f0150670 0x7ff0f0070900 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:09.706 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.703+0000 7ff0f5400640 1 -- 172.21.15.120:0/2576817316 >> 172.21.15.120:0/2576817316 conn(0x7ff0f00cbed0 msgr2=0x7ff0f00cc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:09.706 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.703+0000 7ff0f5400640 1 -- 172.21.15.120:0/2576817316 shutdown_connections 2024-04-18T04:44:09.706 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.703+0000 7ff0f5400640 1 -- 172.21.15.120:0/2576817316 wait complete. 2024-04-18T04:44:09.707 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.707+0000 7ff0f5400640 1 Processor -- start 2024-04-18T04:44:09.707 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.707+0000 7ff0f5400640 1 -- start start 2024-04-18T04:44:09.711 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.707+0000 7ff0f5400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0f006d060 0x7ff0f01f5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:09.711 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.707+0000 7ff0f5400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0f00c77d0 0x7ff0f01461a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:09.711 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.707+0000 7ff0f5400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0f0150670 0x7ff0f0149b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:09.711 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.707+0000 7ff0f5400640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f0146d30 con 0x7ff0f0150670 2024-04-18T04:44:09.711 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.707+0000 7ff0f5400640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f01575d0 con 0x7ff0f006d060 2024-04-18T04:44:09.711 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.707+0000 7ff0f5400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f01578b0 con 0x7ff0f00c77d0 2024-04-18T04:44:09.711 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.707+0000 7ff0ef200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0f0150670 0x7ff0f0149b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:09.711 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.707+0000 7ff0ef200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0f0150670 0x7ff0f0149b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58420/0 (socket says 172.21.15.120:58420) 2024-04-18T04:44:09.711 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.707+0000 7ff0ef200640 1 -- 172.21.15.120:0/2215752191 learned_addr learned my addr 172.21.15.120:0/2215752191 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:09.711 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.707+0000 7ff0ee800640 1 --2- 172.21.15.120:0/2215752191 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0f006d060 0x7ff0f01f5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:09.711 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.707+0000 7ff0ede00640 1 --2- 172.21.15.120:0/2215752191 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0f00c77d0 0x7ff0f01461a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:09.712 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.707+0000 7ff0ef200640 1 -- 172.21.15.120:0/2215752191 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0f00c77d0 msgr2=0x7ff0f01461a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:09.712 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.707+0000 7ff0ef200640 1 --2- 172.21.15.120:0/2215752191 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0f00c77d0 0x7ff0f01461a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:09.712 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.707+0000 7ff0ef200640 1 -- 172.21.15.120:0/2215752191 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0f006d060 msgr2=0x7ff0f01f5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:09.712 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.707+0000 7ff0ef200640 1 --2- 172.21.15.120:0/2215752191 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0f006d060 0x7ff0f01f5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:09.712 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.707+0000 7ff0ef200640 1 -- 172.21.15.120:0/2215752191 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0dc009420 con 0x7ff0f0150670 2024-04-18T04:44:09.712 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.707+0000 7ff0ede00640 1 --2- 172.21.15.120:0/2215752191 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0f00c77d0 0x7ff0f01461a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:44:09.712 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.707+0000 7ff0ef200640 1 --2- 172.21.15.120:0/2215752191 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0f0150670 0x7ff0f0149b80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff0e800cc90 tx=0x7ff0e800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:09.712 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.707+0000 7ff0e6a00640 1 -- 172.21.15.120:0/2215752191 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e800cea0 con 0x7ff0f0150670 2024-04-18T04:44:09.712 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.707+0000 7ff0e6a00640 1 -- 172.21.15.120:0/2215752191 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e8012400 con 0x7ff0f0150670 2024-04-18T04:44:09.712 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.707+0000 7ff0e6a00640 1 -- 172.21.15.120:0/2215752191 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e80127b0 con 0x7ff0f0150670 2024-04-18T04:44:09.712 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.707+0000 7ff0f5400640 1 -- 172.21.15.120:0/2215752191 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e0009420 con 0x7ff0f0150670 2024-04-18T04:44:09.712 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.707+0000 7ff0f5400640 1 -- 172.21.15.120:0/2215752191 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0f01f56a0 con 0x7ff0f0150670 2024-04-18T04:44:09.712 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.707+0000 7ff0e6a00640 1 -- 172.21.15.120:0/2215752191 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7ff0e8012c10 con 0x7ff0f0150670 2024-04-18T04:44:09.712 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.711+0000 7ff0e6a00640 1 -- 172.21.15.120:0/2215752191 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7ff0e8007740 con 0x7ff0f0150670 2024-04-18T04:44:09.713 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.711+0000 7ff0f5400640 1 -- 172.21.15.120:0/2215752191 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0f0072880 con 0x7ff0f0150670 2024-04-18T04:44:09.713 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.711+0000 7ff0e6a00640 1 -- 172.21.15.120:0/2215752191 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7ff0e8017070 con 0x7ff0f0150670 2024-04-18T04:44:09.739 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-04-18T04:44:09.739+0000 7f9bfaa80180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-18T04:44:09.771 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.771+0000 7ff0f5400640 1 -- 172.21.15.120:0/2215752191 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0f015ef10 con 0x7ff0f0150670 2024-04-18T04:44:09.772 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.771+0000 7ff0e6a00640 1 -- 172.21.15.120:0/2215752191 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7ff0e8007900 con 0x7ff0f0150670 2024-04-18T04:44:09.772 INFO:teuthology.misc.health.smithi120.stdout: 2024-04-18T04:44:09.772 INFO:teuthology.misc.health.smithi120.stdout:{"epoch":10,"fsid":"8e73592f-08e2-4957-a98f-9d044cec4ba5","created":"2024-04-18T04:44:06.139983+0000","modified":"2024-04-18T04:44:08.470250+0000","last_up_change":"0.000000","last_in_change":"2024-04-18T04:44:08.470250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a80903bd-d9be-4fb9-af99-6125cb26bd2d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8f5f004b-6870-4c78-8d50-9622e631ec25","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6e228a2b-6103-4301-a8b5-ee81dbb1f920","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7a5cabd7-d898-4e32-a03c-25b46e790134","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8e9f530f-6bab-4b23-a1a3-a71362fefcc0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2243fabe-cc81-40cf-91bc-f106fe275a01","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c093a5ed-25c8-41a7-a20d-606a1a1661e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c37426b7-1080-4434-9f3e-a3afbbdc0fac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T04:44:09.773 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.771+0000 7ff0f5400640 1 -- 172.21.15.120:0/2215752191 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0f0150670 msgr2=0x7ff0f0149b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:09.773 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.771+0000 7ff0f5400640 1 --2- 172.21.15.120:0/2215752191 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0f0150670 0x7ff0f0149b80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff0e800cc90 tx=0x7ff0e800a430 comp rx=0 tx=0).stop 2024-04-18T04:44:09.774 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.771+0000 7ff0f5400640 1 -- 172.21.15.120:0/2215752191 shutdown_connections 2024-04-18T04:44:09.774 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.771+0000 7ff0f5400640 1 --2- 172.21.15.120:0/2215752191 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0f0150670 0x7ff0f0149b80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:09.774 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.771+0000 7ff0f5400640 1 --2- 172.21.15.120:0/2215752191 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0f00c77d0 0x7ff0f01461a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:09.774 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.771+0000 7ff0f5400640 1 --2- 172.21.15.120:0/2215752191 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0f006d060 0x7ff0f01f5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:09.774 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.771+0000 7ff0f5400640 1 -- 172.21.15.120:0/2215752191 >> 172.21.15.120:0/2215752191 conn(0x7ff0f00cbed0 msgr2=0x7ff0f006e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:09.774 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.771+0000 7ff0f5400640 1 -- 172.21.15.120:0/2215752191 shutdown_connections 2024-04-18T04:44:09.774 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:09.771+0000 7ff0f5400640 1 -- 172.21.15.120:0/2215752191 wait complete. 2024-04-18T04:44:09.789 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-18T04:44:10.075 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-18T04:44:10.077+0000 7f3f4e3ae180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-18T04:44:10.150 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-18T04:44:10.153+0000 7f3f4e3ae180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-18T04:44:10.330 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-18T04:44:10.333+0000 7f3f4e3ae180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-18T04:44:10.402 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-18T04:44:10.405+0000 7f3f4e3ae180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-18T04:44:10.426 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-04-18T04:44:10.427+0000 7f9bfaa80180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-18T04:44:10.513 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-04-18T04:44:10.511+0000 7f9bfaa80180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-18T04:44:10.690 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-18T04:44:10.693+0000 7f3f4e3ae180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-18T04:44:10.713 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-04-18T04:44:10.711+0000 7f9bfaa80180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-18T04:44:10.752 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-18T04:44:10.753+0000 7f3f4e3ae180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-18T04:44:10.800 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-04-18T04:44:10.799+0000 7f9bfaa80180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-18T04:44:11.130 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-04-18T04:44:11.131+0000 7f9bfaa80180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-18T04:44:11.201 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-04-18T04:44:11.199+0000 7f9bfaa80180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-18T04:44:11.789 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-18T04:44:11.792+0000 7f3ef5962640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-18T04:44:11.794 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-18T04:44:11.796+0000 7f3ef5962640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-18T04:44:12.695 INFO:tasks.ceph.osd.5.smithi132.stderr:2024-04-18T04:44:12.696+0000 7fc8f916e7c0 -1 osd.5 0 log_to_monitors true 2024-04-18T04:44:12.800 INFO:tasks.ceph.osd.6.smithi132.stderr:2024-04-18T04:44:12.800+0000 7fb6f6fbd7c0 -1 osd.6 0 log_to_monitors true 2024-04-18T04:44:12.836 INFO:tasks.ceph.osd.7.smithi132.stderr:2024-04-18T04:44:12.836+0000 7fdbfc5b67c0 -1 osd.7 0 log_to_monitors true 2024-04-18T04:44:12.946 INFO:tasks.ceph.osd.4.smithi132.stderr:2024-04-18T04:44:12.948+0000 7fe5852d67c0 -1 osd.4 0 log_to_monitors true 2024-04-18T04:44:13.014 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-18T04:44:13.015+0000 7f3189f887c0 -1 osd.0 0 log_to_monitors true 2024-04-18T04:44:13.181 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-04-18T04:44:13.179+0000 7f0a93b347c0 -1 osd.3 0 log_to_monitors true 2024-04-18T04:44:13.255 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-04-18T04:44:13.255+0000 7f085b9317c0 -1 osd.1 0 log_to_monitors true 2024-04-18T04:44:13.278 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-04-18T04:44:13.275+0000 7f488582b7c0 -1 osd.2 0 log_to_monitors true 2024-04-18T04:44:14.955 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-18T04:44:14.954+0000 7f3184e00640 -1 osd.0 0 waiting for initial osdmap 2024-04-18T04:44:14.983 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-18T04:44:14.982+0000 7f317ae00640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T04:44:15.326 INFO:tasks.ceph.osd.7.smithi132.stderr:2024-04-18T04:44:15.328+0000 7fdbf855b640 -1 osd.7 0 waiting for initial osdmap 2024-04-18T04:44:15.328 INFO:tasks.ceph.osd.5.smithi132.stderr:2024-04-18T04:44:15.328+0000 7fc8f592a640 -1 osd.5 0 waiting for initial osdmap 2024-04-18T04:44:15.341 INFO:tasks.ceph.osd.4.smithi132.stderr:2024-04-18T04:44:15.344+0000 7fe581a92640 -1 osd.4 0 waiting for initial osdmap 2024-04-18T04:44:15.353 INFO:tasks.ceph.osd.5.smithi132.stderr:2024-04-18T04:44:15.356+0000 7fc8ecf46640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T04:44:15.361 INFO:tasks.ceph.osd.7.smithi132.stderr:2024-04-18T04:44:15.364+0000 7fdbf038e640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T04:44:15.370 INFO:tasks.ceph.osd.4.smithi132.stderr:2024-04-18T04:44:15.372+0000 7fe5790ae640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T04:44:15.373 INFO:tasks.ceph.osd.6.smithi132.stderr:2024-04-18T04:44:15.376+0000 7fb6f3779640 -1 osd.6 0 waiting for initial osdmap 2024-04-18T04:44:15.413 INFO:tasks.ceph.osd.6.smithi132.stderr:2024-04-18T04:44:15.412+0000 7fb6ead95640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T04:44:16.377 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-04-18T04:44:16.374+0000 7f4880600640 -1 osd.2 0 waiting for initial osdmap 2024-04-18T04:44:16.395 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-04-18T04:44:16.394+0000 7f0856800640 -1 osd.1 0 waiting for initial osdmap 2024-04-18T04:44:16.404 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-04-18T04:44:16.402+0000 7f0a8ea00640 -1 osd.3 0 waiting for initial osdmap 2024-04-18T04:44:16.419 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-04-18T04:44:16.418+0000 7f4875c00640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T04:44:16.427 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-04-18T04:44:16.426+0000 7f0a84a00640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T04:44:16.427 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-04-18T04:44:16.426+0000 7f084c800640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T04:44:16.595 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-18T04:44:16.721 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.718+0000 7f386ce00640 1 Processor -- start 2024-04-18T04:44:16.721 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.718+0000 7f386ce00640 1 -- start start 2024-04-18T04:44:16.721 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.718+0000 7f386ce00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f386814e070 0x7f3868070520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:16.722 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.718+0000 7f386ce00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3868071f90 con 0x7f386806db40 2024-04-18T04:44:16.722 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.718+0000 7f386ce00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3868072250 con 0x7f3868157ee0 2024-04-18T04:44:16.722 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.718+0000 7f386ce00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f386806f860 con 0x7f386814e070 2024-04-18T04:44:16.723 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.722+0000 7f3865e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f386814e070 0x7f3868070520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:16.723 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.722+0000 7f385d400640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f386806db40 0x7f38680cad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:46952/0 (socket says 172.21.15.120:46952) 2024-04-18T04:44:16.723 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.722+0000 7f385d400640 1 -- 172.21.15.120:0/2818349899 learned_addr learned my addr 172.21.15.120:0/2818349899 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:44:16.723 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.722+0000 7f3865e00640 1 -- 172.21.15.120:0/2818349899 >> v1:172.21.15.132:6789/0 conn(0x7f3868157ee0 legacy=0x7f3868161e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:16.723 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.722+0000 7f3865e00640 1 -- 172.21.15.120:0/2818349899 >> v1:172.21.15.120:6789/0 conn(0x7f386806db40 legacy=0x7f38680cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:16.723 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.722+0000 7f3865e00640 1 -- 172.21.15.120:0/2818349899 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f386806fa40 con 0x7f386814e070 2024-04-18T04:44:16.723 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.722+0000 7f3865400640 1 -- 172.21.15.120:0/2818349899 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1627503363 0 0) 0x7f3868071f90 con 0x7f386806db40 2024-04-18T04:44:16.725 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.722+0000 7f3865e00640 1 --2- 172.21.15.120:0/2818349899 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f386814e070 0x7f3868070520 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f38580097c0 tx=0x7f385801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4463104475f70e0c server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:16.725 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.722+0000 7f3865400640 1 -- 172.21.15.120:0/2818349899 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38580a8990 con 0x7f386814e070 2024-04-18T04:44:16.726 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.722+0000 7f3865400640 1 -- 172.21.15.120:0/2818349899 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38580a8af0 con 0x7f386814e070 2024-04-18T04:44:16.726 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.722+0000 7f3865400640 1 -- 172.21.15.120:0/2818349899 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38580a8e80 con 0x7f386814e070 2024-04-18T04:44:16.726 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.726+0000 7f386ce00640 1 -- 172.21.15.120:0/2818349899 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f386814e070 msgr2=0x7f3868070520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:16.726 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.726+0000 7f386ce00640 1 --2- 172.21.15.120:0/2818349899 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f386814e070 0x7f3868070520 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f38580097c0 tx=0x7f385801ec90 comp rx=0 tx=0).stop 2024-04-18T04:44:16.727 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.726+0000 7f386ce00640 1 -- 172.21.15.120:0/2818349899 shutdown_connections 2024-04-18T04:44:16.727 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.726+0000 7f386ce00640 1 --2- 172.21.15.120:0/2818349899 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f386814e070 0x7f3868070520 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:16.727 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.726+0000 7f386ce00640 1 -- 172.21.15.120:0/2818349899 >> 172.21.15.120:0/2818349899 conn(0x7f386806b450 msgr2=0x7f386806b860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:16.727 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.726+0000 7f386ce00640 1 -- 172.21.15.120:0/2818349899 shutdown_connections 2024-04-18T04:44:16.727 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.726+0000 7f386ce00640 1 -- 172.21.15.120:0/2818349899 wait complete. 2024-04-18T04:44:16.728 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.726+0000 7f386ce00640 1 Processor -- start 2024-04-18T04:44:16.728 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.726+0000 7f386ce00640 1 -- start start 2024-04-18T04:44:16.730 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.726+0000 7f386ce00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f386806db40 0x7f3868146d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:16.730 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.726+0000 7f386ce00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f386814e070 0x7f38681eee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:16.730 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.726+0000 7f386ce00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3868157ee0 0x7f38681ef370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:16.730 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.726+0000 7f386ce00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38681f2f50 con 0x7f3868157ee0 2024-04-18T04:44:16.730 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.726+0000 7f386ce00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38681f23a0 con 0x7f386806db40 2024-04-18T04:44:16.730 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.726+0000 7f386ce00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3868155460 con 0x7f386814e070 2024-04-18T04:44:16.730 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.726+0000 7f3866800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3868157ee0 0x7f38681ef370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:16.731 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.726+0000 7f3866800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3868157ee0 0x7f38681ef370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57770/0 (socket says 172.21.15.120:57770) 2024-04-18T04:44:16.731 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.726+0000 7f3866800640 1 -- 172.21.15.120:0/2058583025 learned_addr learned my addr 172.21.15.120:0/2058583025 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:16.731 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.726+0000 7f385d400640 1 --2- 172.21.15.120:0/2058583025 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f386814e070 0x7f38681eee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:16.731 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.726+0000 7f3865e00640 1 --2- 172.21.15.120:0/2058583025 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f386806db40 0x7f3868146d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:16.731 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.726+0000 7f3866800640 1 -- 172.21.15.120:0/2058583025 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f386814e070 msgr2=0x7f38681eee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:16.731 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.726+0000 7f3866800640 1 --2- 172.21.15.120:0/2058583025 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f386814e070 0x7f38681eee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:16.731 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.726+0000 7f3866800640 1 -- 172.21.15.120:0/2058583025 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f386806db40 msgr2=0x7f3868146d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:16.731 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.726+0000 7f3866800640 1 --2- 172.21.15.120:0/2058583025 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f386806db40 0x7f3868146d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:16.731 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.726+0000 7f3866800640 1 -- 172.21.15.120:0/2058583025 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3858009420 con 0x7f3868157ee0 2024-04-18T04:44:16.731 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.726+0000 7f3866800640 1 --2- 172.21.15.120:0/2058583025 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3868157ee0 0x7f38681ef370 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f386000c730 tx=0x7f386000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:16.731 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.730+0000 7f385ea00640 1 -- 172.21.15.120:0/2058583025 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3860003b80 con 0x7f3868157ee0 2024-04-18T04:44:16.731 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.730+0000 7f385ea00640 1 -- 172.21.15.120:0/2058583025 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3860003ce0 con 0x7f3868157ee0 2024-04-18T04:44:16.731 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.730+0000 7f385ea00640 1 -- 172.21.15.120:0/2058583025 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3860005310 con 0x7f3868157ee0 2024-04-18T04:44:16.731 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.730+0000 7f386ce00640 1 -- 172.21.15.120:0/2058583025 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38680c05b0 con 0x7f3868157ee0 2024-04-18T04:44:16.731 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.730+0000 7f386ce00640 1 -- 172.21.15.120:0/2058583025 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38681f2890 con 0x7f3868157ee0 2024-04-18T04:44:16.732 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.730+0000 7f386ce00640 1 -- 172.21.15.120:0/2058583025 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3868072660 con 0x7f3868157ee0 2024-04-18T04:44:16.732 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.730+0000 7f385ea00640 1 -- 172.21.15.120:0/2058583025 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 4) v1 ==== 86036+0+0 (secure 0 0 0) 0x7f3860005680 con 0x7f3868157ee0 2024-04-18T04:44:16.732 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.730+0000 7f385ea00640 1 --2- 172.21.15.120:0/2058583025 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3844066630 0x7f3844068af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:16.733 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.730+0000 7f385ea00640 1 -- 172.21.15.120:0/2058583025 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3631+0+0 (secure 0 0 0) 0x7f38600837c0 con 0x7f3868157ee0 2024-04-18T04:44:16.733 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.730+0000 7f3865e00640 1 --2- 172.21.15.120:0/2058583025 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3844066630 0x7f3844068af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:16.734 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.734+0000 7f3865e00640 1 --2- 172.21.15.120:0/2058583025 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3844066630 0x7f3844068af0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f38580b2000 tx=0x7f38580aa070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:16.738 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.734+0000 7f385ea00640 1 -- 172.21.15.120:0/2058583025 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f3860051300 con 0x7f3868157ee0 2024-04-18T04:44:16.894 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.894+0000 7f386ce00640 1 -- 172.21.15.120:0/2058583025 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38681f3090 con 0x7f3868157ee0 2024-04-18T04:44:16.895 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.894+0000 7f385ea00640 1 -- 172.21.15.120:0/2058583025 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+9233 (secure 0 0 0) 0x7f38681f3090 con 0x7f3868157ee0 2024-04-18T04:44:16.895 INFO:teuthology.misc.health.smithi120.stdout: 2024-04-18T04:44:16.895 INFO:teuthology.misc.health.smithi120.stdout:{"epoch":14,"fsid":"8e73592f-08e2-4957-a98f-9d044cec4ba5","created":"2024-04-18T04:44:06.139983+0000","modified":"2024-04-18T04:44:16.349062+0000","last_up_change":"2024-04-18T04:44:16.349062+0000","last_in_change":"2024-04-18T04:44:08.470250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a80903bd-d9be-4fb9-af99-6125cb26bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":27468},{"type":"v1","addr":"172.21.15.120:6801","nonce":27468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":27468},{"type":"v1","addr":"172.21.15.120:6803","nonce":27468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":27468},{"type":"v1","addr":"172.21.15.120:6807","nonce":27468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":27468},{"type":"v1","addr":"172.21.15.120:6805","nonce":27468}]},"public_addr":"172.21.15.120:6801/27468","cluster_addr":"172.21.15.120:6803/27468","heartbeat_back_addr":"172.21.15.120:6807/27468","heartbeat_front_addr":"172.21.15.120:6805/27468","state":["exists","up"]},{"osd":1,"uuid":"8f5f004b-6870-4c78-8d50-9622e631ec25","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6e228a2b-6103-4301-a8b5-ee81dbb1f920","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7a5cabd7-d898-4e32-a03c-25b46e790134","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8e9f530f-6bab-4b23-a1a3-a71362fefcc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":28102},{"type":"v1","addr":"172.21.15.132:6825","nonce":28102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":28102},{"type":"v1","addr":"172.21.15.132:6827","nonce":28102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":28102},{"type":"v1","addr":"172.21.15.132:6831","nonce":28102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":28102},{"type":"v1","addr":"172.21.15.132:6829","nonce":28102}]},"public_addr":"172.21.15.132:6825/28102","cluster_addr":"172.21.15.132:6827/28102","heartbeat_back_addr":"172.21.15.132:6831/28102","heartbeat_front_addr":"172.21.15.132:6829/28102","state":["exists","up"]},{"osd":5,"uuid":"2243fabe-cc81-40cf-91bc-f106fe275a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":28104},{"type":"v1","addr":"172.21.15.132:6809","nonce":28104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":28104},{"type":"v1","addr":"172.21.15.132:6811","nonce":28104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":28104},{"type":"v1","addr":"172.21.15.132:6815","nonce":28104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":28104},{"type":"v1","addr":"172.21.15.132:6813","nonce":28104}]},"public_addr":"172.21.15.132:6809/28104","cluster_addr":"172.21.15.132:6811/28104","heartbeat_back_addr":"172.21.15.132:6815/28104","heartbeat_front_addr":"172.21.15.132:6813/28104","state":["exists","up"]},{"osd":6,"uuid":"c093a5ed-25c8-41a7-a20d-606a1a1661e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":28103},{"type":"v1","addr":"172.21.15.132:6801","nonce":28103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":28103},{"type":"v1","addr":"172.21.15.132:6803","nonce":28103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":28103},{"type":"v1","addr":"172.21.15.132:6807","nonce":28103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":28103},{"type":"v1","addr":"172.21.15.132:6805","nonce":28103}]},"public_addr":"172.21.15.132:6801/28103","cluster_addr":"172.21.15.132:6803/28103","heartbeat_back_addr":"172.21.15.132:6807/28103","heartbeat_front_addr":"172.21.15.132:6805/28103","state":["exists","up"]},{"osd":7,"uuid":"c37426b7-1080-4434-9f3e-a3afbbdc0fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":28129},{"type":"v1","addr":"172.21.15.132:6817","nonce":28129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":28129},{"type":"v1","addr":"172.21.15.132:6819","nonce":28129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":28129},{"type":"v1","addr":"172.21.15.132:6823","nonce":28129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":28129},{"type":"v1","addr":"172.21.15.132:6821","nonce":28129}]},"public_addr":"172.21.15.132:6817/28129","cluster_addr":"172.21.15.132:6819/28129","heartbeat_back_addr":"172.21.15.132:6823/28129","heartbeat_front_addr":"172.21.15.132:6821/28129","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.053825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T04:44:16.897 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.894+0000 7f386ce00640 1 -- 172.21.15.120:0/2058583025 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3844066630 msgr2=0x7f3844068af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:16.897 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.894+0000 7f386ce00640 1 --2- 172.21.15.120:0/2058583025 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3844066630 0x7f3844068af0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f38580b2000 tx=0x7f38580aa070 comp rx=0 tx=0).stop 2024-04-18T04:44:16.897 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.894+0000 7f386ce00640 1 -- 172.21.15.120:0/2058583025 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3868157ee0 msgr2=0x7f38681ef370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:16.897 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.894+0000 7f386ce00640 1 --2- 172.21.15.120:0/2058583025 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3868157ee0 0x7f38681ef370 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f386000c730 tx=0x7f386000cbf0 comp rx=0 tx=0).stop 2024-04-18T04:44:16.897 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.894+0000 7f386ce00640 1 -- 172.21.15.120:0/2058583025 shutdown_connections 2024-04-18T04:44:16.897 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.894+0000 7f386ce00640 1 --2- 172.21.15.120:0/2058583025 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3844066630 0x7f3844068af0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:16.898 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.894+0000 7f386ce00640 1 --2- 172.21.15.120:0/2058583025 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3868157ee0 0x7f38681ef370 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:16.898 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.894+0000 7f386ce00640 1 --2- 172.21.15.120:0/2058583025 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f386814e070 0x7f38681eee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:16.898 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.894+0000 7f386ce00640 1 --2- 172.21.15.120:0/2058583025 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f386806db40 0x7f3868146d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:16.898 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.894+0000 7f386ce00640 1 -- 172.21.15.120:0/2058583025 >> 172.21.15.120:0/2058583025 conn(0x7f386806b450 msgr2=0x7f386814bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:16.898 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.894+0000 7f386ce00640 1 -- 172.21.15.120:0/2058583025 shutdown_connections 2024-04-18T04:44:16.898 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:16.894+0000 7f386ce00640 1 -- 172.21.15.120:0/2058583025 wait complete. 2024-04-18T04:44:16.914 DEBUG:teuthology.misc:5 of 8 OSDs are up 2024-04-18T04:44:23.721 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-18T04:44:23.857 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.858+0000 7f81d5200640 1 Processor -- start 2024-04-18T04:44:23.857 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.858+0000 7f81d5200640 1 -- start start 2024-04-18T04:44:23.858 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.858+0000 7f81d5200640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f81d006db40 0x7f81d0070520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:23.858 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.858+0000 7f81d5200640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f81d0157ee0 0x7f81d01589a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:23.858 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.858+0000 7f81d5200640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81d0158ee0 con 0x7f81d014e070 2024-04-18T04:44:23.858 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.858+0000 7f81d5200640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81d006f860 con 0x7f81d006db40 2024-04-18T04:44:23.858 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.858+0000 7f81d5200640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81d014e450 con 0x7f81d0157ee0 2024-04-18T04:44:23.859 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.858+0000 7f81cd400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f81d006db40 0x7f81d0070520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:23.859 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.862+0000 7f81cde00640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f81d014e070 0x7f81d00cad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:49842/0 (socket says 172.21.15.120:49842) 2024-04-18T04:44:23.859 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.862+0000 7f81cde00640 1 -- 172.21.15.120:0/1408069359 learned_addr learned my addr 172.21.15.120:0/1408069359 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:44:23.859 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.862+0000 7f81ce800640 1 --2- 172.21.15.120:0/1408069359 >> v2:172.21.15.132:3300/0 conn(0x7f81d0157ee0 0x7f81d01589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:23.859 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.862+0000 7f81cd400640 1 -- 172.21.15.120:0/1408069359 >> v2:172.21.15.132:3300/0 conn(0x7f81d0157ee0 msgr2=0x7f81d01589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:23.859 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.862+0000 7f81cd400640 1 --2- 172.21.15.120:0/1408069359 >> v2:172.21.15.132:3300/0 conn(0x7f81d0157ee0 0x7f81d01589a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:23.860 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.862+0000 7f81cd400640 1 -- 172.21.15.120:0/1408069359 >> v1:172.21.15.120:6789/0 conn(0x7f81d014e070 legacy=0x7f81d00cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:23.860 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.862+0000 7f81cd400640 1 -- 172.21.15.120:0/1408069359 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d0071f90 con 0x7f81d006db40 2024-04-18T04:44:23.860 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.862+0000 7f81cca00640 1 -- 172.21.15.120:0/1408069359 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3271856508 0 0) 0x7f81d0158ee0 con 0x7f81d014e070 2024-04-18T04:44:23.861 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.862+0000 7f81cd400640 1 --2- 172.21.15.120:0/1408069359 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81d006db40 0x7f81d0070520 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f81d00cbe60 tx=0x7f81bc01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0c4a8d01b3ef4d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:23.862 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.862+0000 7f81cca00640 1 -- 172.21.15.120:0/1408069359 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81bc0a8970 con 0x7f81d006db40 2024-04-18T04:44:23.862 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.862+0000 7f81cca00640 1 -- 172.21.15.120:0/1408069359 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81bc0a8ad0 con 0x7f81d006db40 2024-04-18T04:44:23.862 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.862+0000 7f81cca00640 1 -- 172.21.15.120:0/1408069359 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81bc0a8e60 con 0x7f81d006db40 2024-04-18T04:44:23.862 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.866+0000 7f81d5200640 1 -- 172.21.15.120:0/1408069359 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81d006db40 msgr2=0x7f81d0070520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:23.863 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.866+0000 7f81d5200640 1 --2- 172.21.15.120:0/1408069359 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81d006db40 0x7f81d0070520 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f81d00cbe60 tx=0x7f81bc01ec70 comp rx=0 tx=0).stop 2024-04-18T04:44:23.863 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.866+0000 7f81d5200640 1 -- 172.21.15.120:0/1408069359 shutdown_connections 2024-04-18T04:44:23.863 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.866+0000 7f81d5200640 1 --2- 172.21.15.120:0/1408069359 >> v2:172.21.15.132:3300/0 conn(0x7f81d0157ee0 0x7f81d01589a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:23.863 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.866+0000 7f81d5200640 1 --2- 172.21.15.120:0/1408069359 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81d006db40 0x7f81d0070520 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:23.863 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.866+0000 7f81d5200640 1 -- 172.21.15.120:0/1408069359 >> 172.21.15.120:0/1408069359 conn(0x7f81d006b450 msgr2=0x7f81d006b860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:23.863 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.866+0000 7f81d5200640 1 -- 172.21.15.120:0/1408069359 shutdown_connections 2024-04-18T04:44:23.863 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.866+0000 7f81d5200640 1 -- 172.21.15.120:0/1408069359 wait complete. 2024-04-18T04:44:23.864 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.866+0000 7f81d5200640 1 Processor -- start 2024-04-18T04:44:23.864 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.866+0000 7f81d5200640 1 -- start start 2024-04-18T04:44:23.867 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.866+0000 7f81d5200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81d006db40 0x7f81d0145710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:23.868 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.866+0000 7f81d5200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81d014e070 0x7f81d0145c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:23.868 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.866+0000 7f81d5200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81d0157ee0 0x7f81d00c0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:23.868 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.866+0000 7f81d5200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d00c29f0 con 0x7f81d014e070 2024-04-18T04:44:23.868 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.866+0000 7f81d5200640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d0155f40 con 0x7f81d006db40 2024-04-18T04:44:23.868 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.866+0000 7f81d5200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81d01567e0 con 0x7f81d0157ee0 2024-04-18T04:44:23.868 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.866+0000 7f81cd400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81d014e070 0x7f81d0145c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:23.868 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.866+0000 7f81cd400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81d014e070 0x7f81d0145c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46552/0 (socket says 172.21.15.120:46552) 2024-04-18T04:44:23.868 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.866+0000 7f81cd400640 1 -- 172.21.15.120:0/2890661343 learned_addr learned my addr 172.21.15.120:0/2890661343 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:23.868 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.866+0000 7f81ce800640 1 --2- 172.21.15.120:0/2890661343 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81d0157ee0 0x7f81d00c0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:23.868 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.866+0000 7f81cde00640 1 --2- 172.21.15.120:0/2890661343 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81d006db40 0x7f81d0145710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:23.868 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.866+0000 7f81cd400640 1 -- 172.21.15.120:0/2890661343 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81d0157ee0 msgr2=0x7f81d00c0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:23.869 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.866+0000 7f81cd400640 1 --2- 172.21.15.120:0/2890661343 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81d0157ee0 0x7f81d00c0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:23.869 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.866+0000 7f81cd400640 1 -- 172.21.15.120:0/2890661343 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81d006db40 msgr2=0x7f81d0145710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:23.869 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.866+0000 7f81cd400640 1 --2- 172.21.15.120:0/2890661343 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81d006db40 0x7f81d0145710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:23.869 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.866+0000 7f81cd400640 1 -- 172.21.15.120:0/2890661343 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81bc009420 con 0x7f81d014e070 2024-04-18T04:44:23.869 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.866+0000 7f81cde00640 1 --2- 172.21.15.120:0/2890661343 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81d006db40 0x7f81d0145710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:44:23.869 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.866+0000 7f81cd400640 1 --2- 172.21.15.120:0/2890661343 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81d014e070 0x7f81d0145c50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f81bc0b3040 tx=0x7f81bc01ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:23.869 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.870+0000 7f81c6000640 1 -- 172.21.15.120:0/2890661343 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81bc0b0dd0 con 0x7f81d014e070 2024-04-18T04:44:23.869 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.870+0000 7f81c6000640 1 -- 172.21.15.120:0/2890661343 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81bc0b9430 con 0x7f81d014e070 2024-04-18T04:44:23.869 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.870+0000 7f81c6000640 1 -- 172.21.15.120:0/2890661343 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81bc0b97e0 con 0x7f81d014e070 2024-04-18T04:44:23.870 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.870+0000 7f81d5200640 1 -- 172.21.15.120:0/2890661343 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81d00c0030 con 0x7f81d014e070 2024-04-18T04:44:23.870 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.870+0000 7f81d5200640 1 -- 172.21.15.120:0/2890661343 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81d0156190 con 0x7f81d014e070 2024-04-18T04:44:23.870 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.870+0000 7f81d5200640 1 -- 172.21.15.120:0/2890661343 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81d0072660 con 0x7f81d014e070 2024-04-18T04:44:23.871 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.870+0000 7f81c6000640 1 -- 172.21.15.120:0/2890661343 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f81bc0b7040 con 0x7f81d014e070 2024-04-18T04:44:23.871 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.870+0000 7f81c6000640 1 --2- 172.21.15.120:0/2890661343 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f81b0066690 0x7f81b0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:23.871 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.870+0000 7f81c6000640 1 -- 172.21.15.120:0/2890661343 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f81bc121aa0 con 0x7f81d014e070 2024-04-18T04:44:23.871 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.870+0000 7f81cde00640 1 --2- 172.21.15.120:0/2890661343 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f81b0066690 0x7f81b0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:23.871 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.874+0000 7f81cde00640 1 --2- 172.21.15.120:0/2890661343 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f81b0066690 0x7f81b0068b50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f81c0007fd0 tx=0x7f81c0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:23.874 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:23.874+0000 7f81c6000640 1 -- 172.21.15.120:0/2890661343 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f81bc0ef0c0 con 0x7f81d014e070 2024-04-18T04:44:24.028 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:24.030+0000 7f81d5200640 1 -- 172.21.15.120:0/2890661343 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81d0072880 con 0x7f81d014e070 2024-04-18T04:44:24.029 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:24.030+0000 7f81c6000640 1 -- 172.21.15.120:0/2890661343 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12430 (secure 0 0 0) 0x7f81bc0b5090 con 0x7f81d014e070 2024-04-18T04:44:24.029 INFO:teuthology.misc.health.smithi120.stdout: 2024-04-18T04:44:24.029 INFO:teuthology.misc.health.smithi120.stdout:{"epoch":17,"fsid":"8e73592f-08e2-4957-a98f-9d044cec4ba5","created":"2024-04-18T04:44:06.139983+0000","modified":"2024-04-18T04:44:19.430995+0000","last_up_change":"2024-04-18T04:44:17.410146+0000","last_in_change":"2024-04-18T04:44:08.470250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T04:44:16.864728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a80903bd-d9be-4fb9-af99-6125cb26bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":27468},{"type":"v1","addr":"172.21.15.120:6801","nonce":27468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":27468},{"type":"v1","addr":"172.21.15.120:6803","nonce":27468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":27468},{"type":"v1","addr":"172.21.15.120:6807","nonce":27468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":27468},{"type":"v1","addr":"172.21.15.120:6805","nonce":27468}]},"public_addr":"172.21.15.120:6801/27468","cluster_addr":"172.21.15.120:6803/27468","heartbeat_back_addr":"172.21.15.120:6807/27468","heartbeat_front_addr":"172.21.15.120:6805/27468","state":["exists","up"]},{"osd":1,"uuid":"8f5f004b-6870-4c78-8d50-9622e631ec25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":27470},{"type":"v1","addr":"172.21.15.120:6823","nonce":27470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":27470},{"type":"v1","addr":"172.21.15.120:6827","nonce":27470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":27470},{"type":"v1","addr":"172.21.15.120:6831","nonce":27470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":27470},{"type":"v1","addr":"172.21.15.120:6829","nonce":27470}]},"public_addr":"172.21.15.120:6823/27470","cluster_addr":"172.21.15.120:6827/27470","heartbeat_back_addr":"172.21.15.120:6831/27470","heartbeat_front_addr":"172.21.15.120:6829/27470","state":["exists","up"]},{"osd":2,"uuid":"6e228a2b-6103-4301-a8b5-ee81dbb1f920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":27471},{"type":"v1","addr":"172.21.15.120:6817","nonce":27471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":27471},{"type":"v1","addr":"172.21.15.120:6819","nonce":27471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":27471},{"type":"v1","addr":"172.21.15.120:6826","nonce":27471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":27471},{"type":"v1","addr":"172.21.15.120:6822","nonce":27471}]},"public_addr":"172.21.15.120:6817/27471","cluster_addr":"172.21.15.120:6819/27471","heartbeat_back_addr":"172.21.15.120:6826/27471","heartbeat_front_addr":"172.21.15.120:6822/27471","state":["exists","up"]},{"osd":3,"uuid":"7a5cabd7-d898-4e32-a03c-25b46e790134","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":27469},{"type":"v1","addr":"172.21.15.120:6809","nonce":27469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":27469},{"type":"v1","addr":"172.21.15.120:6811","nonce":27469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":27469},{"type":"v1","addr":"172.21.15.120:6815","nonce":27469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":27469},{"type":"v1","addr":"172.21.15.120:6813","nonce":27469}]},"public_addr":"172.21.15.120:6809/27469","cluster_addr":"172.21.15.120:6811/27469","heartbeat_back_addr":"172.21.15.120:6815/27469","heartbeat_front_addr":"172.21.15.120:6813/27469","state":["exists","up"]},{"osd":4,"uuid":"8e9f530f-6bab-4b23-a1a3-a71362fefcc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":28102},{"type":"v1","addr":"172.21.15.132:6825","nonce":28102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":28102},{"type":"v1","addr":"172.21.15.132:6827","nonce":28102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":28102},{"type":"v1","addr":"172.21.15.132:6831","nonce":28102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":28102},{"type":"v1","addr":"172.21.15.132:6829","nonce":28102}]},"public_addr":"172.21.15.132:6825/28102","cluster_addr":"172.21.15.132:6827/28102","heartbeat_back_addr":"172.21.15.132:6831/28102","heartbeat_front_addr":"172.21.15.132:6829/28102","state":["exists","up"]},{"osd":5,"uuid":"2243fabe-cc81-40cf-91bc-f106fe275a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":28104},{"type":"v1","addr":"172.21.15.132:6809","nonce":28104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":28104},{"type":"v1","addr":"172.21.15.132:6811","nonce":28104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":28104},{"type":"v1","addr":"172.21.15.132:6815","nonce":28104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":28104},{"type":"v1","addr":"172.21.15.132:6813","nonce":28104}]},"public_addr":"172.21.15.132:6809/28104","cluster_addr":"172.21.15.132:6811/28104","heartbeat_back_addr":"172.21.15.132:6815/28104","heartbeat_front_addr":"172.21.15.132:6813/28104","state":["exists","up"]},{"osd":6,"uuid":"c093a5ed-25c8-41a7-a20d-606a1a1661e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":28103},{"type":"v1","addr":"172.21.15.132:6801","nonce":28103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":28103},{"type":"v1","addr":"172.21.15.132:6803","nonce":28103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":28103},{"type":"v1","addr":"172.21.15.132:6807","nonce":28103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":28103},{"type":"v1","addr":"172.21.15.132:6805","nonce":28103}]},"public_addr":"172.21.15.132:6801/28103","cluster_addr":"172.21.15.132:6803/28103","heartbeat_back_addr":"172.21.15.132:6807/28103","heartbeat_front_addr":"172.21.15.132:6805/28103","state":["exists","up"]},{"osd":7,"uuid":"c37426b7-1080-4434-9f3e-a3afbbdc0fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":28129},{"type":"v1","addr":"172.21.15.132:6817","nonce":28129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":28129},{"type":"v1","addr":"172.21.15.132:6819","nonce":28129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":28129},{"type":"v1","addr":"172.21.15.132:6823","nonce":28129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":28129},{"type":"v1","addr":"172.21.15.132:6821","nonce":28129}]},"public_addr":"172.21.15.132:6817/28129","cluster_addr":"172.21.15.132:6819/28129","heartbeat_back_addr":"172.21.15.132:6823/28129","heartbeat_front_addr":"172.21.15.132:6821/28129","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.053825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.289753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.274645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.146361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.943883+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.701955+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.851076+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.800782+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T04:44:24.031 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:24.030+0000 7f81d5200640 1 -- 172.21.15.120:0/2890661343 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f81b0066690 msgr2=0x7f81b0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:24.031 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:24.030+0000 7f81d5200640 1 --2- 172.21.15.120:0/2890661343 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f81b0066690 0x7f81b0068b50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f81c0007fd0 tx=0x7f81c0009040 comp rx=0 tx=0).stop 2024-04-18T04:44:24.032 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:24.030+0000 7f81d5200640 1 -- 172.21.15.120:0/2890661343 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81d014e070 msgr2=0x7f81d0145c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:24.032 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:24.030+0000 7f81d5200640 1 --2- 172.21.15.120:0/2890661343 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81d014e070 0x7f81d0145c50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f81bc0b3040 tx=0x7f81bc01ba10 comp rx=0 tx=0).stop 2024-04-18T04:44:24.032 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:24.034+0000 7f81d5200640 1 -- 172.21.15.120:0/2890661343 shutdown_connections 2024-04-18T04:44:24.032 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:24.034+0000 7f81d5200640 1 --2- 172.21.15.120:0/2890661343 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f81b0066690 0x7f81b0068b50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:24.032 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:24.034+0000 7f81d5200640 1 --2- 172.21.15.120:0/2890661343 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81d0157ee0 0x7f81d00c0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:24.032 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:24.034+0000 7f81d5200640 1 --2- 172.21.15.120:0/2890661343 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81d014e070 0x7f81d0145c50 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:24.033 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:24.034+0000 7f81d5200640 1 --2- 172.21.15.120:0/2890661343 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81d006db40 0x7f81d0145710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:24.033 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:24.034+0000 7f81d5200640 1 -- 172.21.15.120:0/2890661343 >> 172.21.15.120:0/2890661343 conn(0x7f81d006b450 msgr2=0x7f81d0073370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:24.033 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:24.034+0000 7f81d5200640 1 -- 172.21.15.120:0/2890661343 shutdown_connections 2024-04-18T04:44:24.033 INFO:teuthology.misc.health.smithi120.stderr:2024-04-18T04:44:24.034+0000 7f81d5200640 1 -- 172.21.15.120:0/2890661343 wait complete. 2024-04-18T04:44:24.048 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-18T04:44:24.048 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-18T04:44:24.048 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-18T04:44:24.048 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-18T04:44:24.052 INFO:tasks.ceph.mds.a:Started 2024-04-18T04:44:24.052 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-18T04:44:24.052 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-18T04:44:24.055 INFO:tasks.ceph.mds.c:Started 2024-04-18T04:44:24.056 INFO:tasks.ceph.mds.e:Restarting daemon 2024-04-18T04:44:24.056 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-04-18T04:44:24.059 INFO:tasks.ceph.mds.e:Started 2024-04-18T04:44:24.059 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-18T04:44:24.059 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-18T04:44:24.063 INFO:tasks.ceph.mds.b:Started 2024-04-18T04:44:24.063 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-18T04:44:24.063 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-18T04:44:24.066 INFO:tasks.ceph.mds.d:Started 2024-04-18T04:44:24.066 INFO:tasks.ceph.mds.f:Restarting daemon 2024-04-18T04:44:24.067 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-04-18T04:44:24.069 INFO:tasks.ceph.mds.f:Started 2024-04-18T04:44:24.070 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-18T04:44:24.070 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T04:44:24.142 INFO:tasks.ceph.mds.b.smithi132.stdout:starting mds.b at 2024-04-18T04:44:24.150 INFO:tasks.ceph.mds.d.smithi132.stdout:starting mds.d at 2024-04-18T04:44:24.151 INFO:tasks.ceph.mds.f.smithi132.stdout:starting mds.f at 2024-04-18T04:44:24.160 INFO:tasks.ceph.mds.c.smithi120.stdout:starting mds.c at 2024-04-18T04:44:24.175 INFO:tasks.ceph.mds.a.smithi120.stdout:starting mds.a at 2024-04-18T04:44:24.176 INFO:tasks.ceph.mds.e.smithi120.stdout:starting mds.e at 2024-04-18T04:44:24.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.222+0000 7f1271400640 1 Processor -- start 2024-04-18T04:44:24.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.222+0000 7f1271400640 1 -- start start 2024-04-18T04:44:24.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.222+0000 7f1271400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f126c0c7480 0x7f126c0c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:24.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.222+0000 7f1271400640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f126c06f9b0 con 0x7f126c150340 2024-04-18T04:44:24.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.222+0000 7f1271400640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f126c156b40 con 0x7f126c0bfe70 2024-04-18T04:44:24.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.222+0000 7f1271400640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f126c0c0520 con 0x7f126c0c7480 2024-04-18T04:44:24.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.222+0000 7f126a800640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f126c150340 0x7f126c156430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:49860/0 (socket says 172.21.15.120:49860) 2024-04-18T04:44:24.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.222+0000 7f126a800640 1 -- 172.21.15.120:0/690795322 learned_addr learned my addr 172.21.15.120:0/690795322 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:44:24.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.222+0000 7f1269e00640 1 --2- 172.21.15.120:0/690795322 >> v2:172.21.15.132:3300/0 conn(0x7f126c0c7480 0x7f126c0c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:24.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.222+0000 7f1269e00640 1 -- 172.21.15.120:0/690795322 >> v1:172.21.15.132:6789/0 conn(0x7f126c0bfe70 legacy=0x7f126c160db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:24.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.222+0000 7f1269e00640 1 -- 172.21.15.120:0/690795322 >> v1:172.21.15.120:6789/0 conn(0x7f126c150340 legacy=0x7f126c156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:24.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.222+0000 7f1269400640 1 -- 172.21.15.120:0/690795322 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2125984700 0 0) 0x7f126c06f9b0 con 0x7f126c150340 2024-04-18T04:44:24.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.222+0000 7f1269e00640 1 -- 172.21.15.120:0/690795322 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f126c0c0800 con 0x7f126c0c7480 2024-04-18T04:44:24.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.226+0000 7f1269e00640 1 --2- 172.21.15.120:0/690795322 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f126c0c7480 0x7f126c0c68d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f12580097c0 tx=0x7f1258020ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=321478d073be5470 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:24.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.226+0000 7f1269400640 1 -- 172.21.15.120:0/690795322 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12580aaba0 con 0x7f126c0c7480 2024-04-18T04:44:24.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.226+0000 7f1269400640 1 -- 172.21.15.120:0/690795322 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12580aad00 con 0x7f126c0c7480 2024-04-18T04:44:24.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.226+0000 7f1269400640 1 -- 172.21.15.120:0/690795322 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12580b2660 con 0x7f126c0c7480 2024-04-18T04:44:24.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.226+0000 7f1271400640 1 -- 172.21.15.120:0/690795322 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f126c0c7480 msgr2=0x7f126c0c68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:24.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.226+0000 7f1271400640 1 --2- 172.21.15.120:0/690795322 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f126c0c7480 0x7f126c0c68d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f12580097c0 tx=0x7f1258020ea0 comp rx=0 tx=0).stop 2024-04-18T04:44:24.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.226+0000 7f1271400640 1 -- 172.21.15.120:0/690795322 shutdown_connections 2024-04-18T04:44:24.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.226+0000 7f1271400640 1 --2- 172.21.15.120:0/690795322 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f126c0c7480 0x7f126c0c68d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:24.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.226+0000 7f1271400640 1 -- 172.21.15.120:0/690795322 >> 172.21.15.120:0/690795322 conn(0x7f126c0c78c0 msgr2=0x7f126c0c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:24.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.226+0000 7f1271400640 1 -- 172.21.15.120:0/690795322 shutdown_connections 2024-04-18T04:44:24.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.226+0000 7f1271400640 1 -- 172.21.15.120:0/690795322 wait complete. 2024-04-18T04:44:24.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.230+0000 7f1271400640 1 Processor -- start 2024-04-18T04:44:24.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.230+0000 7f1271400640 1 -- start start 2024-04-18T04:44:24.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.230+0000 7f1271400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f126c0bfe70 0x7f126c155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:24.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.230+0000 7f1271400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f126c0c7480 0x7f126c149670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:24.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.230+0000 7f1271400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f126c150340 0x7f126c149bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:24.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.230+0000 7f1271400640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126c158b40 con 0x7f126c150340 2024-04-18T04:44:24.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.230+0000 7f1271400640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126c155720 con 0x7f126c0bfe70 2024-04-18T04:44:24.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.230+0000 7f1271400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f126c155140 con 0x7f126c0c7480 2024-04-18T04:44:24.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.230+0000 7f126b200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f126c150340 0x7f126c149bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:24.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.230+0000 7f126b200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f126c150340 0x7f126c149bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46620/0 (socket says 172.21.15.120:46620) 2024-04-18T04:44:24.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.230+0000 7f126b200640 1 -- 172.21.15.120:0/2780086171 learned_addr learned my addr 172.21.15.120:0/2780086171 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:24.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.230+0000 7f126a800640 1 --2- 172.21.15.120:0/2780086171 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f126c0bfe70 0x7f126c155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:24.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.230+0000 7f1269e00640 1 --2- 172.21.15.120:0/2780086171 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f126c0c7480 0x7f126c149670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:24.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.230+0000 7f126b200640 1 -- 172.21.15.120:0/2780086171 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f126c0c7480 msgr2=0x7f126c149670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:24.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.230+0000 7f126b200640 1 --2- 172.21.15.120:0/2780086171 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f126c0c7480 0x7f126c149670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:24.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.230+0000 7f126b200640 1 -- 172.21.15.120:0/2780086171 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f126c0bfe70 msgr2=0x7f126c155bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:24.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.230+0000 7f126b200640 1 --2- 172.21.15.120:0/2780086171 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f126c0bfe70 0x7f126c155bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:24.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.230+0000 7f126b200640 1 -- 172.21.15.120:0/2780086171 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1258009420 con 0x7f126c150340 2024-04-18T04:44:24.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.230+0000 7f126b200640 1 --2- 172.21.15.120:0/2780086171 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f126c150340 0x7f126c149bb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f126400c720 tx=0x7f126400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:24.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.230+0000 7f1262a00640 1 -- 172.21.15.120:0/2780086171 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1264003b80 con 0x7f126c150340 2024-04-18T04:44:24.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.230+0000 7f1262a00640 1 -- 172.21.15.120:0/2780086171 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1264003ce0 con 0x7f126c150340 2024-04-18T04:44:24.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.230+0000 7f1271400640 1 -- 172.21.15.120:0/2780086171 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f126c159c60 con 0x7f126c150340 2024-04-18T04:44:24.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.230+0000 7f1262a00640 1 -- 172.21.15.120:0/2780086171 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126400aa90 con 0x7f126c150340 2024-04-18T04:44:24.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.230+0000 7f1271400640 1 -- 172.21.15.120:0/2780086171 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f126c1553b0 con 0x7f126c150340 2024-04-18T04:44:24.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.230+0000 7f1271400640 1 -- 172.21.15.120:0/2780086171 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f126c0726d0 con 0x7f126c150340 2024-04-18T04:44:24.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.234+0000 7f1262a00640 1 -- 172.21.15.120:0/2780086171 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f126400abf0 con 0x7f126c150340 2024-04-18T04:44:24.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.234+0000 7f1262a00640 1 --2- 172.21.15.120:0/2780086171 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f124c066690 0x7f124c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:24.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.234+0000 7f1262a00640 1 -- 172.21.15.120:0/2780086171 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1264083b90 con 0x7f126c150340 2024-04-18T04:44:24.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.234+0000 7f126a800640 1 --2- 172.21.15.120:0/2780086171 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f124c066690 0x7f124c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:24.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.234+0000 7f126a800640 1 --2- 172.21.15.120:0/2780086171 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f124c066690 0x7f124c068b50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f125c000f70 tx=0x7f125c007240 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:24.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.238+0000 7f1262a00640 1 -- 172.21.15.120:0/2780086171 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f12640511d0 con 0x7f126c150340 2024-04-18T04:44:24.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.390+0000 7f1271400640 1 -- 172.21.15.120:0/2780086171 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f126c072a70 con 0x7f126c150340 2024-04-18T04:44:24.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.394+0000 7f1262a00640 1 -- 172.21.15.120:0/2780086171 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12430 (secure 0 0 0) 0x7f12640547f0 con 0x7f126c150340 2024-04-18T04:44:24.391 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:44:24.391 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":17,"fsid":"8e73592f-08e2-4957-a98f-9d044cec4ba5","created":"2024-04-18T04:44:06.139983+0000","modified":"2024-04-18T04:44:19.430995+0000","last_up_change":"2024-04-18T04:44:17.410146+0000","last_in_change":"2024-04-18T04:44:08.470250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T04:44:16.864728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a80903bd-d9be-4fb9-af99-6125cb26bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":27468},{"type":"v1","addr":"172.21.15.120:6801","nonce":27468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":27468},{"type":"v1","addr":"172.21.15.120:6803","nonce":27468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":27468},{"type":"v1","addr":"172.21.15.120:6807","nonce":27468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":27468},{"type":"v1","addr":"172.21.15.120:6805","nonce":27468}]},"public_addr":"172.21.15.120:6801/27468","cluster_addr":"172.21.15.120:6803/27468","heartbeat_back_addr":"172.21.15.120:6807/27468","heartbeat_front_addr":"172.21.15.120:6805/27468","state":["exists","up"]},{"osd":1,"uuid":"8f5f004b-6870-4c78-8d50-9622e631ec25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":27470},{"type":"v1","addr":"172.21.15.120:6823","nonce":27470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":27470},{"type":"v1","addr":"172.21.15.120:6827","nonce":27470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":27470},{"type":"v1","addr":"172.21.15.120:6831","nonce":27470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":27470},{"type":"v1","addr":"172.21.15.120:6829","nonce":27470}]},"public_addr":"172.21.15.120:6823/27470","cluster_addr":"172.21.15.120:6827/27470","heartbeat_back_addr":"172.21.15.120:6831/27470","heartbeat_front_addr":"172.21.15.120:6829/27470","state":["exists","up"]},{"osd":2,"uuid":"6e228a2b-6103-4301-a8b5-ee81dbb1f920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":27471},{"type":"v1","addr":"172.21.15.120:6817","nonce":27471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":27471},{"type":"v1","addr":"172.21.15.120:6819","nonce":27471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":27471},{"type":"v1","addr":"172.21.15.120:6826","nonce":27471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":27471},{"type":"v1","addr":"172.21.15.120:6822","nonce":27471}]},"public_addr":"172.21.15.120:6817/27471","cluster_addr":"172.21.15.120:6819/27471","heartbeat_back_addr":"172.21.15.120:6826/27471","heartbeat_front_addr":"172.21.15.120:6822/27471","state":["exists","up"]},{"osd":3,"uuid":"7a5cabd7-d898-4e32-a03c-25b46e790134","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":27469},{"type":"v1","addr":"172.21.15.120:6809","nonce":27469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":27469},{"type":"v1","addr":"172.21.15.120:6811","nonce":27469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":27469},{"type":"v1","addr":"172.21.15.120:6815","nonce":27469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":27469},{"type":"v1","addr":"172.21.15.120:6813","nonce":27469}]},"public_addr":"172.21.15.120:6809/27469","cluster_addr":"172.21.15.120:6811/27469","heartbeat_back_addr":"172.21.15.120:6815/27469","heartbeat_front_addr":"172.21.15.120:6813/27469","state":["exists","up"]},{"osd":4,"uuid":"8e9f530f-6bab-4b23-a1a3-a71362fefcc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":28102},{"type":"v1","addr":"172.21.15.132:6825","nonce":28102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":28102},{"type":"v1","addr":"172.21.15.132:6827","nonce":28102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":28102},{"type":"v1","addr":"172.21.15.132:6831","nonce":28102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":28102},{"type":"v1","addr":"172.21.15.132:6829","nonce":28102}]},"public_addr":"172.21.15.132:6825/28102","cluster_addr":"172.21.15.132:6827/28102","heartbeat_back_addr":"172.21.15.132:6831/28102","heartbeat_front_addr":"172.21.15.132:6829/28102","state":["exists","up"]},{"osd":5,"uuid":"2243fabe-cc81-40cf-91bc-f106fe275a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":28104},{"type":"v1","addr":"172.21.15.132:6809","nonce":28104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":28104},{"type":"v1","addr":"172.21.15.132:6811","nonce":28104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":28104},{"type":"v1","addr":"172.21.15.132:6815","nonce":28104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":28104},{"type":"v1","addr":"172.21.15.132:6813","nonce":28104}]},"public_addr":"172.21.15.132:6809/28104","cluster_addr":"172.21.15.132:6811/28104","heartbeat_back_addr":"172.21.15.132:6815/28104","heartbeat_front_addr":"172.21.15.132:6813/28104","state":["exists","up"]},{"osd":6,"uuid":"c093a5ed-25c8-41a7-a20d-606a1a1661e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":28103},{"type":"v1","addr":"172.21.15.132:6801","nonce":28103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":28103},{"type":"v1","addr":"172.21.15.132:6803","nonce":28103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":28103},{"type":"v1","addr":"172.21.15.132:6807","nonce":28103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":28103},{"type":"v1","addr":"172.21.15.132:6805","nonce":28103}]},"public_addr":"172.21.15.132:6801/28103","cluster_addr":"172.21.15.132:6803/28103","heartbeat_back_addr":"172.21.15.132:6807/28103","heartbeat_front_addr":"172.21.15.132:6805/28103","state":["exists","up"]},{"osd":7,"uuid":"c37426b7-1080-4434-9f3e-a3afbbdc0fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":28129},{"type":"v1","addr":"172.21.15.132:6817","nonce":28129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":28129},{"type":"v1","addr":"172.21.15.132:6819","nonce":28129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":28129},{"type":"v1","addr":"172.21.15.132:6823","nonce":28129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":28129},{"type":"v1","addr":"172.21.15.132:6821","nonce":28129}]},"public_addr":"172.21.15.132:6817/28129","cluster_addr":"172.21.15.132:6819/28129","heartbeat_back_addr":"172.21.15.132:6823/28129","heartbeat_front_addr":"172.21.15.132:6821/28129","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.053825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.289753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.274645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.146361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.943883+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.701955+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.851076+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.800782+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T04:44:24.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.394+0000 7f1271400640 1 -- 172.21.15.120:0/2780086171 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f124c066690 msgr2=0x7f124c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:24.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.394+0000 7f1271400640 1 --2- 172.21.15.120:0/2780086171 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f124c066690 0x7f124c068b50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f125c000f70 tx=0x7f125c007240 comp rx=0 tx=0).stop 2024-04-18T04:44:24.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.394+0000 7f1271400640 1 -- 172.21.15.120:0/2780086171 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f126c150340 msgr2=0x7f126c149bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:24.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.394+0000 7f1271400640 1 --2- 172.21.15.120:0/2780086171 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f126c150340 0x7f126c149bb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f126400c720 tx=0x7f126400cbe0 comp rx=0 tx=0).stop 2024-04-18T04:44:24.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.394+0000 7f1271400640 1 -- 172.21.15.120:0/2780086171 shutdown_connections 2024-04-18T04:44:24.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.394+0000 7f1271400640 1 --2- 172.21.15.120:0/2780086171 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f124c066690 0x7f124c068b50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:24.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.394+0000 7f1271400640 1 --2- 172.21.15.120:0/2780086171 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f126c150340 0x7f126c149bb0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:24.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.394+0000 7f1271400640 1 --2- 172.21.15.120:0/2780086171 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f126c0c7480 0x7f126c149670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:24.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.394+0000 7f1271400640 1 --2- 172.21.15.120:0/2780086171 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f126c0bfe70 0x7f126c155bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:24.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.394+0000 7f1271400640 1 -- 172.21.15.120:0/2780086171 >> 172.21.15.120:0/2780086171 conn(0x7f126c0c78c0 msgr2=0x7f126c06b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:24.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.394+0000 7f1271400640 1 -- 172.21.15.120:0/2780086171 shutdown_connections 2024-04-18T04:44:24.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.394+0000 7f1271400640 1 -- 172.21.15.120:0/2780086171 wait complete. 2024-04-18T04:44:24.412 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T04:44:16.864728+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-18T04:44:24.412 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T04:44:24.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.554+0000 7ff294800640 1 Processor -- start 2024-04-18T04:44:24.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.554+0000 7ff294800640 1 -- start start 2024-04-18T04:44:24.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.554+0000 7ff294800640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff28c158150 0x7ff28c0c73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:24.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.554+0000 7ff294800640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff28c072640 con 0x7ff28c0caff0 2024-04-18T04:44:24.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.554+0000 7ff294800640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff28c072360 con 0x7ff28c151730 2024-04-18T04:44:24.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.554+0000 7ff294800640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff28c071120 con 0x7ff28c158150 2024-04-18T04:44:24.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.554+0000 7ff292800640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7ff28c0caff0 0x7ff28c161eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:49866/0 (socket says 172.21.15.120:49866) 2024-04-18T04:44:24.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.554+0000 7ff292800640 1 -- 172.21.15.120:0/3529039193 learned_addr learned my addr 172.21.15.120:0/3529039193 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:44:24.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.554+0000 7ff291400640 1 --2- 172.21.15.120:0/3529039193 >> v2:172.21.15.132:3300/0 conn(0x7ff28c158150 0x7ff28c0c73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:24.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.554+0000 7ff290a00640 1 -- 172.21.15.120:0/3529039193 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2769120360 0 0) 0x7ff28c072640 con 0x7ff28c0caff0 2024-04-18T04:44:24.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.554+0000 7ff290a00640 1 -- 172.21.15.120:0/3529039193 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff274003530 con 0x7ff28c0caff0 2024-04-18T04:44:24.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.554+0000 7ff291400640 1 -- 172.21.15.120:0/3529039193 >> v1:172.21.15.132:6789/0 conn(0x7ff28c151730 legacy=0x7ff28c06dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:24.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.554+0000 7ff291400640 1 -- 172.21.15.120:0/3529039193 >> v1:172.21.15.120:6789/0 conn(0x7ff28c0caff0 legacy=0x7ff28c161eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:24.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.554+0000 7ff290a00640 1 -- 172.21.15.120:0/3529039193 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1737726173 0 0) 0x7ff274003530 con 0x7ff28c0caff0 2024-04-18T04:44:24.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.554+0000 7ff291400640 1 -- 172.21.15.120:0/3529039193 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff28c06f9d0 con 0x7ff28c158150 2024-04-18T04:44:24.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.558+0000 7ff291400640 1 --2- 172.21.15.120:0/3529039193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff28c158150 0x7ff28c0c73d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff27c0097c0 tx=0x7ff27c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=789af2c727080820 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:24.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.558+0000 7ff290a00640 1 -- 172.21.15.120:0/3529039193 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff288001a00 con 0x7ff28c158150 2024-04-18T04:44:24.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.558+0000 7ff290a00640 1 -- 172.21.15.120:0/3529039193 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27c0a7050 con 0x7ff28c158150 2024-04-18T04:44:24.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.558+0000 7ff290a00640 1 -- 172.21.15.120:0/3529039193 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27c0ab620 con 0x7ff28c158150 2024-04-18T04:44:24.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.558+0000 7ff294800640 1 -- 172.21.15.120:0/3529039193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff28c158150 msgr2=0x7ff28c0c73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:24.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.558+0000 7ff294800640 1 --2- 172.21.15.120:0/3529039193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff28c158150 0x7ff28c0c73d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff27c0097c0 tx=0x7ff27c01c3c0 comp rx=0 tx=0).stop 2024-04-18T04:44:24.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.558+0000 7ff294800640 1 -- 172.21.15.120:0/3529039193 shutdown_connections 2024-04-18T04:44:24.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.558+0000 7ff294800640 1 --2- 172.21.15.120:0/3529039193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff28c158150 0x7ff28c0c73d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:24.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.558+0000 7ff294800640 1 -- 172.21.15.120:0/3529039193 >> 172.21.15.120:0/3529039193 conn(0x7ff28c06b780 msgr2=0x7ff28c06bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:24.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.558+0000 7ff294800640 1 -- 172.21.15.120:0/3529039193 shutdown_connections 2024-04-18T04:44:24.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.558+0000 7ff294800640 1 -- 172.21.15.120:0/3529039193 wait complete. 2024-04-18T04:44:24.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.562+0000 7ff294800640 1 Processor -- start 2024-04-18T04:44:24.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.562+0000 7ff294800640 1 -- start start 2024-04-18T04:44:24.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.562+0000 7ff294800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff28c0caff0 0x7ff28c0c3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:24.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.562+0000 7ff294800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff28c151730 0x7ff28c0c6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:24.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.562+0000 7ff294800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff28c158150 0x7ff28c1f3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:24.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.562+0000 7ff294800640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c0c2810 con 0x7ff28c0caff0 2024-04-18T04:44:24.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.562+0000 7ff294800640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c0c2530 con 0x7ff28c151730 2024-04-18T04:44:24.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.562+0000 7ff294800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c150a70 con 0x7ff28c158150 2024-04-18T04:44:24.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.562+0000 7ff291e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff28c0caff0 0x7ff28c0c3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:24.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.562+0000 7ff291e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff28c0caff0 0x7ff28c0c3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46626/0 (socket says 172.21.15.120:46626) 2024-04-18T04:44:24.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.562+0000 7ff291e00640 1 -- 172.21.15.120:0/1982286443 learned_addr learned my addr 172.21.15.120:0/1982286443 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:24.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.562+0000 7ff291400640 1 --2- 172.21.15.120:0/1982286443 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff28c151730 0x7ff28c0c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:24.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.562+0000 7ff292800640 1 --2- 172.21.15.120:0/1982286443 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff28c158150 0x7ff28c1f3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:24.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.562+0000 7ff291e00640 1 -- 172.21.15.120:0/1982286443 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff28c158150 msgr2=0x7ff28c1f3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:24.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.562+0000 7ff291e00640 1 --2- 172.21.15.120:0/1982286443 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff28c158150 0x7ff28c1f3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:24.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.562+0000 7ff291e00640 1 -- 172.21.15.120:0/1982286443 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff28c151730 msgr2=0x7ff28c0c6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:24.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.562+0000 7ff291e00640 1 --2- 172.21.15.120:0/1982286443 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff28c151730 0x7ff28c0c6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:24.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.562+0000 7ff291e00640 1 -- 172.21.15.120:0/1982286443 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff27c009420 con 0x7ff28c0caff0 2024-04-18T04:44:24.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.562+0000 7ff292800640 1 --2- 172.21.15.120:0/1982286443 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff28c158150 0x7ff28c1f3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:44:24.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.562+0000 7ff291e00640 1 --2- 172.21.15.120:0/1982286443 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff28c0caff0 0x7ff28c0c3c50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff28000c500 tx=0x7ff28000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:24.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.562+0000 7ff286000640 1 -- 172.21.15.120:0/1982286443 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff280005220 con 0x7ff28c0caff0 2024-04-18T04:44:24.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.562+0000 7ff286000640 1 -- 172.21.15.120:0/1982286443 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff280005380 con 0x7ff28c0caff0 2024-04-18T04:44:24.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.562+0000 7ff294800640 1 -- 172.21.15.120:0/1982286443 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff28c150d50 con 0x7ff28c0caff0 2024-04-18T04:44:24.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.562+0000 7ff286000640 1 -- 172.21.15.120:0/1982286443 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff280007270 con 0x7ff28c0caff0 2024-04-18T04:44:24.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.562+0000 7ff294800640 1 -- 172.21.15.120:0/1982286443 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff28c151030 con 0x7ff28c0caff0 2024-04-18T04:44:24.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.566+0000 7ff294800640 1 -- 172.21.15.120:0/1982286443 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff28c0729d0 con 0x7ff28c0caff0 2024-04-18T04:44:24.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.566+0000 7ff286000640 1 -- 172.21.15.120:0/1982286443 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff2800073d0 con 0x7ff28c0caff0 2024-04-18T04:44:24.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.566+0000 7ff286000640 1 --2- 172.21.15.120:0/1982286443 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff270066690 0x7ff270068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:24.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.566+0000 7ff286000640 1 -- 172.21.15.120:0/1982286443 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff280083730 con 0x7ff28c0caff0 2024-04-18T04:44:24.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.566+0000 7ff291400640 1 --2- 172.21.15.120:0/1982286443 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff270066690 0x7ff270068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:24.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.566+0000 7ff291400640 1 --2- 172.21.15.120:0/1982286443 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff270066690 0x7ff270068b50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff27c0ad000 tx=0x7ff27c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:24.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.570+0000 7ff286000640 1 -- 172.21.15.120:0/1982286443 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7ff280050d60 con 0x7ff28c0caff0 2024-04-18T04:44:24.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.726+0000 7ff294800640 1 -- 172.21.15.120:0/1982286443 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff28c06d760 con 0x7ff28c0caff0 2024-04-18T04:44:24.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.726+0000 7ff286000640 1 -- 172.21.15.120:0/1982286443 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff280054380 con 0x7ff28c0caff0 2024-04-18T04:44:24.724 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2024-04-18T04:44:24.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.726+0000 7ff294800640 1 -- 172.21.15.120:0/1982286443 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff270066690 msgr2=0x7ff270068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:24.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.726+0000 7ff294800640 1 --2- 172.21.15.120:0/1982286443 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff270066690 0x7ff270068b50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff27c0ad000 tx=0x7ff27c008040 comp rx=0 tx=0).stop 2024-04-18T04:44:24.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.726+0000 7ff294800640 1 -- 172.21.15.120:0/1982286443 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff28c0caff0 msgr2=0x7ff28c0c3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:24.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.726+0000 7ff294800640 1 --2- 172.21.15.120:0/1982286443 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff28c0caff0 0x7ff28c0c3c50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff28000c500 tx=0x7ff28000c9c0 comp rx=0 tx=0).stop 2024-04-18T04:44:24.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.726+0000 7ff294800640 1 -- 172.21.15.120:0/1982286443 shutdown_connections 2024-04-18T04:44:24.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.726+0000 7ff294800640 1 --2- 172.21.15.120:0/1982286443 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff270066690 0x7ff270068b50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:24.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.726+0000 7ff294800640 1 --2- 172.21.15.120:0/1982286443 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff28c158150 0x7ff28c1f3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:24.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.726+0000 7ff294800640 1 --2- 172.21.15.120:0/1982286443 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff28c151730 0x7ff28c0c6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:24.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.726+0000 7ff294800640 1 --2- 172.21.15.120:0/1982286443 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff28c0caff0 0x7ff28c0c3c50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:24.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.726+0000 7ff294800640 1 -- 172.21.15.120:0/1982286443 >> 172.21.15.120:0/1982286443 conn(0x7ff28c06b780 msgr2=0x7ff28c0ca200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:24.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.726+0000 7ff294800640 1 -- 172.21.15.120:0/1982286443 shutdown_connections 2024-04-18T04:44:24.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.726+0000 7ff294800640 1 -- 172.21.15.120:0/1982286443 wait complete. 2024-04-18T04:44:24.744 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:44:24.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.878+0000 7fc116e00640 1 Processor -- start 2024-04-18T04:44:24.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.878+0000 7fc116e00640 1 -- start start 2024-04-18T04:44:24.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.882+0000 7fc116e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc110153830 0x7fc11006fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:24.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.882+0000 7fc116e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc1100c8850 0x7fc1100ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:24.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.882+0000 7fc116e00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1100703b0 con 0x7fc1100cd420 2024-04-18T04:44:24.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.882+0000 7fc116e00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1100c4200 con 0x7fc1100c8850 2024-04-18T04:44:24.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.882+0000 7fc116e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1100c9520 con 0x7fc110153830 2024-04-18T04:44:24.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.882+0000 7fc107400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc1100c8850 0x7fc1100ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:24.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.882+0000 7fc107400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc1100c8850 0x7fc1100ccee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46640/0 (socket says 172.21.15.120:46640) 2024-04-18T04:44:24.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.882+0000 7fc107400640 1 -- 172.21.15.120:0/177467296 learned_addr learned my addr 172.21.15.120:0/177467296 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:24.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.882+0000 7fc10fe00640 1 --2- 172.21.15.120:0/177467296 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc110153830 0x7fc11006fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:24.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.882+0000 7fc107400640 1 -- 172.21.15.120:0/177467296 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc110153830 msgr2=0x7fc11006fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:24.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.882+0000 7fc107400640 1 --2- 172.21.15.120:0/177467296 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc110153830 0x7fc11006fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:24.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.882+0000 7fc107400640 1 -- 172.21.15.120:0/177467296 >> v1:172.21.15.132:6789/0 conn(0x7fc1100cd420 legacy=0x7fc11015d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:24.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.882+0000 7fc107400640 1 -- 172.21.15.120:0/177467296 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11015cc00 con 0x7fc1100c8850 2024-04-18T04:44:24.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.886+0000 7fc107400640 1 --2- 172.21.15.120:0/177467296 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1100c8850 0x7fc1100ccee0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8009870 tx=0x7fc0f801ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82bc6330b138cf2a server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:24.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.886+0000 7fc10f400640 1 -- 172.21.15.120:0/177467296 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f80a8a50 con 0x7fc1100c8850 2024-04-18T04:44:24.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.886+0000 7fc10f400640 1 -- 172.21.15.120:0/177467296 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f80a8bb0 con 0x7fc1100c8850 2024-04-18T04:44:24.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.886+0000 7fc10f400640 1 -- 172.21.15.120:0/177467296 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f80b0440 con 0x7fc1100c8850 2024-04-18T04:44:24.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.886+0000 7fc116e00640 1 -- 172.21.15.120:0/177467296 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1100c8850 msgr2=0x7fc1100ccee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:24.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.886+0000 7fc116e00640 1 --2- 172.21.15.120:0/177467296 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1100c8850 0x7fc1100ccee0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8009870 tx=0x7fc0f801ed50 comp rx=0 tx=0).stop 2024-04-18T04:44:24.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.886+0000 7fc116e00640 1 -- 172.21.15.120:0/177467296 shutdown_connections 2024-04-18T04:44:24.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.886+0000 7fc116e00640 1 --2- 172.21.15.120:0/177467296 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1100c8850 0x7fc1100ccee0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:24.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.886+0000 7fc116e00640 1 --2- 172.21.15.120:0/177467296 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc110153830 0x7fc11006fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:24.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.886+0000 7fc116e00640 1 -- 172.21.15.120:0/177467296 >> 172.21.15.120:0/177467296 conn(0x7fc11006e0f0 msgr2=0x7fc110071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:24.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.886+0000 7fc116e00640 1 -- 172.21.15.120:0/177467296 shutdown_connections 2024-04-18T04:44:24.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.886+0000 7fc116e00640 1 -- 172.21.15.120:0/177467296 wait complete. 2024-04-18T04:44:24.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.886+0000 7fc116e00640 1 Processor -- start 2024-04-18T04:44:24.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.886+0000 7fc116e00640 1 -- start start 2024-04-18T04:44:24.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.890+0000 7fc116e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1100c8850 0x7fc1101ef2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:24.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.890+0000 7fc116e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1100cd420 0x7fc11006b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:24.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.890+0000 7fc116e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc110153830 0x7fc1100c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:24.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.890+0000 7fc116e00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1101ef830 con 0x7fc110153830 2024-04-18T04:44:24.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.890+0000 7fc116e00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1100c70c0 con 0x7fc1100c8850 2024-04-18T04:44:24.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.890+0000 7fc116e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1100c5440 con 0x7fc1100cd420 2024-04-18T04:44:24.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.890+0000 7fc114e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc110153830 0x7fc1100c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:24.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.890+0000 7fc114e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc110153830 0x7fc1100c67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46648/0 (socket says 172.21.15.120:46648) 2024-04-18T04:44:24.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.890+0000 7fc114e00640 1 -- 172.21.15.120:0/2914331859 learned_addr learned my addr 172.21.15.120:0/2914331859 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:24.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.890+0000 7fc10fe00640 1 --2- 172.21.15.120:0/2914331859 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1100c8850 0x7fc1101ef2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:24.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.890+0000 7fc107400640 1 --2- 172.21.15.120:0/2914331859 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1100cd420 0x7fc11006b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:24.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.890+0000 7fc114e00640 1 -- 172.21.15.120:0/2914331859 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1100cd420 msgr2=0x7fc11006b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:24.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.890+0000 7fc114e00640 1 --2- 172.21.15.120:0/2914331859 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1100cd420 0x7fc11006b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:24.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.890+0000 7fc114e00640 1 -- 172.21.15.120:0/2914331859 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1100c8850 msgr2=0x7fc1101ef2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:24.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.890+0000 7fc114e00640 1 --2- 172.21.15.120:0/2914331859 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1100c8850 0x7fc1101ef2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:24.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.890+0000 7fc114e00640 1 -- 172.21.15.120:0/2914331859 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f80094d0 con 0x7fc110153830 2024-04-18T04:44:24.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.890+0000 7fc107400640 1 --2- 172.21.15.120:0/2914331859 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1100cd420 0x7fc11006b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:44:24.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.890+0000 7fc114e00640 1 --2- 172.21.15.120:0/2914331859 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc110153830 0x7fc1100c67e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc10800c430 tx=0x7fc10800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:24.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.890+0000 7fc10cc00640 1 -- 172.21.15.120:0/2914331859 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc108005220 con 0x7fc110153830 2024-04-18T04:44:24.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.890+0000 7fc10cc00640 1 -- 172.21.15.120:0/2914331859 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc108005380 con 0x7fc110153830 2024-04-18T04:44:24.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.890+0000 7fc116e00640 1 -- 172.21.15.120:0/2914331859 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1100c5720 con 0x7fc110153830 2024-04-18T04:44:24.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.890+0000 7fc10cc00640 1 -- 172.21.15.120:0/2914331859 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc108007270 con 0x7fc110153830 2024-04-18T04:44:24.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.890+0000 7fc116e00640 1 -- 172.21.15.120:0/2914331859 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1100c5ce0 con 0x7fc110153830 2024-04-18T04:44:24.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.890+0000 7fc116e00640 1 -- 172.21.15.120:0/2914331859 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc110072a70 con 0x7fc110153830 2024-04-18T04:44:24.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.890+0000 7fc10cc00640 1 -- 172.21.15.120:0/2914331859 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc1080073d0 con 0x7fc110153830 2024-04-18T04:44:24.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.894+0000 7fc10cc00640 1 --2- 172.21.15.120:0/2914331859 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc0ec066690 0x7fc0ec068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:24.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.894+0000 7fc10cc00640 1 -- 172.21.15.120:0/2914331859 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc1080834a0 con 0x7fc110153830 2024-04-18T04:44:24.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.894+0000 7fc10fe00640 1 --2- 172.21.15.120:0/2914331859 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc0ec066690 0x7fc0ec068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:24.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.894+0000 7fc10fe00640 1 --2- 172.21.15.120:0/2914331859 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc0ec066690 0x7fc0ec068b50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc100003ab0 tx=0x7fc100009830 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:24.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:24.898+0000 7fc10cc00640 1 -- 172.21.15.120:0/2914331859 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fc108050a30 con 0x7fc110153830 2024-04-18T04:44:25.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:25.082+0000 7fc116e00640 1 -- 172.21.15.120:0/2914331859 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1100737b0 con 0x7fc110153830 2024-04-18T04:44:25.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:25.082+0000 7fc10cc00640 1 -- 172.21.15.120:0/2914331859 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1259 (secure 0 0 0) 0x7fc108054050 con 0x7fc110153830 2024-04-18T04:44:25.082 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:44:25.082 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-04-18T04:44:25.083 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 2 2024-04-18T04:44:25.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:25.086+0000 7fc116e00640 1 -- 172.21.15.120:0/2914331859 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc0ec066690 msgr2=0x7fc0ec068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:25.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:25.086+0000 7fc116e00640 1 --2- 172.21.15.120:0/2914331859 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc0ec066690 0x7fc0ec068b50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc100003ab0 tx=0x7fc100009830 comp rx=0 tx=0).stop 2024-04-18T04:44:25.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:25.086+0000 7fc116e00640 1 -- 172.21.15.120:0/2914331859 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc110153830 msgr2=0x7fc1100c67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:25.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:25.086+0000 7fc116e00640 1 --2- 172.21.15.120:0/2914331859 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc110153830 0x7fc1100c67e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc10800c430 tx=0x7fc10800c8f0 comp rx=0 tx=0).stop 2024-04-18T04:44:25.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:25.086+0000 7fc116e00640 1 -- 172.21.15.120:0/2914331859 shutdown_connections 2024-04-18T04:44:25.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:25.086+0000 7fc116e00640 1 --2- 172.21.15.120:0/2914331859 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc0ec066690 0x7fc0ec068b50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:25.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:25.086+0000 7fc116e00640 1 --2- 172.21.15.120:0/2914331859 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc110153830 0x7fc1100c67e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:25.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:25.086+0000 7fc116e00640 1 --2- 172.21.15.120:0/2914331859 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1100cd420 0x7fc11006b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:25.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:25.086+0000 7fc116e00640 1 --2- 172.21.15.120:0/2914331859 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1100c8850 0x7fc1101ef2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:25.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:25.086+0000 7fc116e00640 1 -- 172.21.15.120:0/2914331859 >> 172.21.15.120:0/2914331859 conn(0x7fc11006e0f0 msgr2=0x7fc11015b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:25.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:25.086+0000 7fc116e00640 1 -- 172.21.15.120:0/2914331859 shutdown_connections 2024-04-18T04:44:25.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:25.086+0000 7fc116e00640 1 -- 172.21.15.120:0/2914331859 wait complete. 2024-04-18T04:44:27.103 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:44:27.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.254+0000 7ffb74400640 1 Processor -- start 2024-04-18T04:44:27.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.254+0000 7ffb74400640 1 -- start start 2024-04-18T04:44:27.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.254+0000 7ffb74400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb6c06b8c0 0x7ffb6c0c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:27.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.254+0000 7ffb74400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ffb6c06bca0 0x7ffb6c06c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:27.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.254+0000 7ffb74400640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb6c1576f0 con 0x7ffb6c151440 2024-04-18T04:44:27.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.254+0000 7ffb74400640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb6c158610 con 0x7ffb6c06bca0 2024-04-18T04:44:27.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.254+0000 7ffb74400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6c0c7740 con 0x7ffb6c06b8c0 2024-04-18T04:44:27.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.254+0000 7ffb71a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb6c06b8c0 0x7ffb6c0c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:27.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.254+0000 7ffb71000640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ffb6c06bca0 0x7ffb6c06c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:27.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.254+0000 7ffb71a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb6c06b8c0 0x7ffb6c0c7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:39560/0 (socket says 172.21.15.120:39560) 2024-04-18T04:44:27.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.254+0000 7ffb71a00640 1 -- 172.21.15.120:0/35910187 learned_addr learned my addr 172.21.15.120:0/35910187 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:27.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.254+0000 7ffb71000640 1 -- 172.21.15.120:0/35910187 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb6c06b8c0 msgr2=0x7ffb6c0c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:27.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.254+0000 7ffb71000640 1 --2- 172.21.15.120:0/35910187 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb6c06b8c0 0x7ffb6c0c7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:27.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.254+0000 7ffb71000640 1 -- 172.21.15.120:0/35910187 >> v1:172.21.15.132:6789/0 conn(0x7ffb6c151440 legacy=0x7ffb6c070750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:27.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.254+0000 7ffb71000640 1 -- 172.21.15.120:0/35910187 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb6c157990 con 0x7ffb6c06bca0 2024-04-18T04:44:27.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.254+0000 7ffb71a00640 1 --2- 172.21.15.120:0/35910187 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb6c06b8c0 0x7ffb6c0c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:44:27.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.258+0000 7ffb71000640 1 --2- 172.21.15.120:0/35910187 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb6c06bca0 0x7ffb6c06c0c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ffb580097f0 tx=0x7ffb5801ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5aca5115c62731a server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:27.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.258+0000 7ffb6be00640 1 -- 172.21.15.120:0/35910187 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb580a8990 con 0x7ffb6c06bca0 2024-04-18T04:44:27.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.258+0000 7ffb6be00640 1 -- 172.21.15.120:0/35910187 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb580a8af0 con 0x7ffb6c06bca0 2024-04-18T04:44:27.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.258+0000 7ffb6be00640 1 -- 172.21.15.120:0/35910187 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb580a8e80 con 0x7ffb6c06bca0 2024-04-18T04:44:27.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.258+0000 7ffb74400640 1 -- 172.21.15.120:0/35910187 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb6c06bca0 msgr2=0x7ffb6c06c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:27.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.258+0000 7ffb74400640 1 --2- 172.21.15.120:0/35910187 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb6c06bca0 0x7ffb6c06c0c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ffb580097f0 tx=0x7ffb5801ec90 comp rx=0 tx=0).stop 2024-04-18T04:44:27.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.258+0000 7ffb74400640 1 -- 172.21.15.120:0/35910187 shutdown_connections 2024-04-18T04:44:27.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.258+0000 7ffb74400640 1 --2- 172.21.15.120:0/35910187 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb6c06bca0 0x7ffb6c06c0c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:27.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.258+0000 7ffb74400640 1 --2- 172.21.15.120:0/35910187 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb6c06b8c0 0x7ffb6c0c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:27.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.258+0000 7ffb74400640 1 -- 172.21.15.120:0/35910187 >> 172.21.15.120:0/35910187 conn(0x7ffb6c0c78c0 msgr2=0x7ffb6c0c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:27.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.258+0000 7ffb74400640 1 -- 172.21.15.120:0/35910187 shutdown_connections 2024-04-18T04:44:27.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.258+0000 7ffb74400640 1 -- 172.21.15.120:0/35910187 wait complete. 2024-04-18T04:44:27.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.262+0000 7ffb74400640 1 Processor -- start 2024-04-18T04:44:27.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.262+0000 7ffb74400640 1 -- start start 2024-04-18T04:44:27.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.262+0000 7ffb74400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb6c06b8c0 0x7ffb6c1f2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:27.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.262+0000 7ffb74400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb6c06bca0 0x7ffb6c0c5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:27.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.262+0000 7ffb74400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb6c151440 0x7ffb6c1eeac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:27.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.262+0000 7ffb74400640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6c1f2090 con 0x7ffb6c06b8c0 2024-04-18T04:44:27.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.262+0000 7ffb74400640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6c1f2650 con 0x7ffb6c151440 2024-04-18T04:44:27.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.262+0000 7ffb74400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6c1f2fb0 con 0x7ffb6c06bca0 2024-04-18T04:44:27.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.262+0000 7ffb71a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb6c06b8c0 0x7ffb6c1f2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:27.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.262+0000 7ffb71a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb6c06b8c0 0x7ffb6c1f2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46652/0 (socket says 172.21.15.120:46652) 2024-04-18T04:44:27.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.262+0000 7ffb71a00640 1 -- 172.21.15.120:0/123286871 learned_addr learned my addr 172.21.15.120:0/123286871 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:27.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.262+0000 7ffb71000640 1 --2- 172.21.15.120:0/123286871 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb6c06bca0 0x7ffb6c0c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:27.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.262+0000 7ffb72400640 1 --2- 172.21.15.120:0/123286871 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb6c151440 0x7ffb6c1eeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:27.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.262+0000 7ffb71a00640 1 -- 172.21.15.120:0/123286871 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb6c06bca0 msgr2=0x7ffb6c0c5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:27.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.262+0000 7ffb71a00640 1 --2- 172.21.15.120:0/123286871 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb6c06bca0 0x7ffb6c0c5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:27.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.262+0000 7ffb71a00640 1 -- 172.21.15.120:0/123286871 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb6c151440 msgr2=0x7ffb6c1eeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:27.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.262+0000 7ffb71a00640 1 --2- 172.21.15.120:0/123286871 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb6c151440 0x7ffb6c1eeac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:27.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.262+0000 7ffb71a00640 1 -- 172.21.15.120:0/123286871 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb64009b30 con 0x7ffb6c06b8c0 2024-04-18T04:44:27.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.262+0000 7ffb71a00640 1 --2- 172.21.15.120:0/123286871 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb6c06b8c0 0x7ffb6c1f2a70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ffb6400efc0 tx=0x7ffb6400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:27.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.262+0000 7ffb69600640 1 -- 172.21.15.120:0/123286871 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6400ce60 con 0x7ffb6c06b8c0 2024-04-18T04:44:27.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.262+0000 7ffb69600640 1 -- 172.21.15.120:0/123286871 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6400f040 con 0x7ffb6c06b8c0 2024-04-18T04:44:27.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.262+0000 7ffb69600640 1 -- 172.21.15.120:0/123286871 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb64014680 con 0x7ffb6c06b8c0 2024-04-18T04:44:27.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.262+0000 7ffb74400640 1 -- 172.21.15.120:0/123286871 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb58009420 con 0x7ffb6c06b8c0 2024-04-18T04:44:27.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.262+0000 7ffb74400640 1 -- 172.21.15.120:0/123286871 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb6c0c19c0 con 0x7ffb6c06b8c0 2024-04-18T04:44:27.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.266+0000 7ffb74400640 1 -- 172.21.15.120:0/123286871 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb6c072a70 con 0x7ffb6c06b8c0 2024-04-18T04:44:27.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.266+0000 7ffb69600640 1 -- 172.21.15.120:0/123286871 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ffb640147e0 con 0x7ffb6c06b8c0 2024-04-18T04:44:27.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.266+0000 7ffb69600640 1 --2- 172.21.15.120:0/123286871 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ffb4c0666c0 0x7ffb4c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:27.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.266+0000 7ffb69600640 1 -- 172.21.15.120:0/123286871 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ffb64084760 con 0x7ffb6c06b8c0 2024-04-18T04:44:27.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.266+0000 7ffb71000640 1 --2- 172.21.15.120:0/123286871 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ffb4c0666c0 0x7ffb4c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:27.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.270+0000 7ffb71000640 1 --2- 172.21.15.120:0/123286871 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ffb4c0666c0 0x7ffb4c068b80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ffb580b2000 tx=0x7ffb580aa070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:27.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.270+0000 7ffb69600640 1 -- 172.21.15.120:0/123286871 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7ffb64051d80 con 0x7ffb6c06b8c0 2024-04-18T04:44:27.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.454+0000 7ffb74400640 1 -- 172.21.15.120:0/123286871 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb6c155000 con 0x7ffb6c06b8c0 2024-04-18T04:44:27.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.454+0000 7ffb69600640 1 -- 172.21.15.120:0/123286871 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+5048 (secure 0 0 0) 0x7ffb640553a0 con 0x7ffb6c06b8c0 2024-04-18T04:44:27.454 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:44:27.455 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/1552155328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1552155328},{"type":"v1","addr":"172.21.15.132:6835","nonce":1552155328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6833/2564667113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2564667113},{"type":"v1","addr":"172.21.15.120:6833","nonce":2564667113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-04-18T04:44:27.455 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 3 2024-04-18T04:44:27.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.458+0000 7ffb74400640 1 -- 172.21.15.120:0/123286871 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ffb4c0666c0 msgr2=0x7ffb4c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:27.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.458+0000 7ffb74400640 1 --2- 172.21.15.120:0/123286871 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ffb4c0666c0 0x7ffb4c068b80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ffb580b2000 tx=0x7ffb580aa070 comp rx=0 tx=0).stop 2024-04-18T04:44:27.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.458+0000 7ffb74400640 1 -- 172.21.15.120:0/123286871 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb6c06b8c0 msgr2=0x7ffb6c1f2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:27.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.458+0000 7ffb74400640 1 --2- 172.21.15.120:0/123286871 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb6c06b8c0 0x7ffb6c1f2a70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ffb6400efc0 tx=0x7ffb6400c490 comp rx=0 tx=0).stop 2024-04-18T04:44:27.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.458+0000 7ffb74400640 1 -- 172.21.15.120:0/123286871 shutdown_connections 2024-04-18T04:44:27.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.458+0000 7ffb74400640 1 --2- 172.21.15.120:0/123286871 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ffb4c0666c0 0x7ffb4c068b80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:27.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.458+0000 7ffb74400640 1 --2- 172.21.15.120:0/123286871 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb6c151440 0x7ffb6c1eeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:27.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.458+0000 7ffb74400640 1 --2- 172.21.15.120:0/123286871 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb6c06bca0 0x7ffb6c0c5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:27.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.458+0000 7ffb74400640 1 --2- 172.21.15.120:0/123286871 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb6c06b8c0 0x7ffb6c1f2a70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:27.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.458+0000 7ffb74400640 1 -- 172.21.15.120:0/123286871 >> 172.21.15.120:0/123286871 conn(0x7ffb6c0c78c0 msgr2=0x7ffb6c0c4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:27.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.458+0000 7ffb74400640 1 -- 172.21.15.120:0/123286871 shutdown_connections 2024-04-18T04:44:27.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.458+0000 7ffb74400640 1 -- 172.21.15.120:0/123286871 wait complete. 2024-04-18T04:44:27.475 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T04:44:27.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.614+0000 7f6465c00640 1 Processor -- start 2024-04-18T04:44:27.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.614+0000 7f6465c00640 1 -- start start 2024-04-18T04:44:27.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.614+0000 7f6465c00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f64600c7ef0 0x7f64600717c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:27.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.614+0000 7f6465c00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64600c9580 con 0x7f6460153630 2024-04-18T04:44:27.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.614+0000 7f6465c00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64601595b0 con 0x7f6460071d00 2024-04-18T04:44:27.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.614+0000 7f6465c00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64600ca560 con 0x7f64600c7ef0 2024-04-18T04:44:27.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.614+0000 7f645f400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f64600c7ef0 0x7f64600717c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:27.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.614+0000 7f645fe00640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f6460153630 0x7f64600c9e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:49872/0 (socket says 172.21.15.120:49872) 2024-04-18T04:44:27.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.614+0000 7f645fe00640 1 -- 172.21.15.120:0/3041023288 learned_addr learned my addr 172.21.15.120:0/3041023288 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:44:27.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.614+0000 7f645f400640 1 -- 172.21.15.120:0/3041023288 >> v1:172.21.15.132:6789/0 conn(0x7f6460071d00 legacy=0x7f646006b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:27.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.614+0000 7f645f400640 1 -- 172.21.15.120:0/3041023288 >> v1:172.21.15.120:6789/0 conn(0x7f6460153630 legacy=0x7f64600c9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:27.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.614+0000 7f645ea00640 1 -- 172.21.15.120:0/3041023288 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3667446456 0 0) 0x7f64600c9580 con 0x7f6460153630 2024-04-18T04:44:27.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.614+0000 7f645f400640 1 -- 172.21.15.120:0/3041023288 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6460159850 con 0x7f64600c7ef0 2024-04-18T04:44:27.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.618+0000 7f645f400640 1 --2- 172.21.15.120:0/3041023288 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64600c7ef0 0x7f64600717c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f644c0097c0 tx=0x7f644c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c32a00d0689204cd server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:27.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.618+0000 7f645ea00640 1 -- 172.21.15.120:0/3041023288 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c0ab600 con 0x7f64600c7ef0 2024-04-18T04:44:27.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.618+0000 7f645ea00640 1 -- 172.21.15.120:0/3041023288 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f644c0a7050 con 0x7f64600c7ef0 2024-04-18T04:44:27.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.618+0000 7f645ea00640 1 -- 172.21.15.120:0/3041023288 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c0ab980 con 0x7f64600c7ef0 2024-04-18T04:44:27.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.618+0000 7f6465c00640 1 -- 172.21.15.120:0/3041023288 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64600c7ef0 msgr2=0x7f64600717c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:27.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.618+0000 7f6465c00640 1 --2- 172.21.15.120:0/3041023288 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64600c7ef0 0x7f64600717c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f644c0097c0 tx=0x7f644c01c4a0 comp rx=0 tx=0).stop 2024-04-18T04:44:27.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.618+0000 7f6465c00640 1 -- 172.21.15.120:0/3041023288 shutdown_connections 2024-04-18T04:44:27.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.618+0000 7f6465c00640 1 --2- 172.21.15.120:0/3041023288 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64600c7ef0 0x7f64600717c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:27.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.618+0000 7f6465c00640 1 -- 172.21.15.120:0/3041023288 >> 172.21.15.120:0/3041023288 conn(0x7f646006da10 msgr2=0x7f646006f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:27.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.618+0000 7f6465c00640 1 -- 172.21.15.120:0/3041023288 shutdown_connections 2024-04-18T04:44:27.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.618+0000 7f6465c00640 1 -- 172.21.15.120:0/3041023288 wait complete. 2024-04-18T04:44:27.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.618+0000 7f6465c00640 1 Processor -- start 2024-04-18T04:44:27.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.618+0000 7f6465c00640 1 -- start start 2024-04-18T04:44:27.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.622+0000 7f6465c00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6460071d00 0x7f646014f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:27.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.622+0000 7f6465c00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f64600c7ef0 0x7f6460144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:27.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.622+0000 7f6465c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6460153630 0x7f646015d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:27.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.622+0000 7f6465c00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646015b820 con 0x7f6460153630 2024-04-18T04:44:27.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.622+0000 7f6465c00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646015ac50 con 0x7f6460071d00 2024-04-18T04:44:27.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.622+0000 7f6465c00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f646015af30 con 0x7f64600c7ef0 2024-04-18T04:44:27.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.622+0000 7f6465200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6460153630 0x7f646015d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:27.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.622+0000 7f6465200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6460153630 0x7f646015d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46674/0 (socket says 172.21.15.120:46674) 2024-04-18T04:44:27.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.622+0000 7f6465200640 1 -- 172.21.15.120:0/2142672201 learned_addr learned my addr 172.21.15.120:0/2142672201 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:27.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.622+0000 7f645f400640 1 --2- 172.21.15.120:0/2142672201 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f64600c7ef0 0x7f6460144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:27.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.622+0000 7f645fe00640 1 --2- 172.21.15.120:0/2142672201 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6460071d00 0x7f646014f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:27.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.622+0000 7f6465200640 1 -- 172.21.15.120:0/2142672201 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f64600c7ef0 msgr2=0x7f6460144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:27.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.622+0000 7f6465200640 1 --2- 172.21.15.120:0/2142672201 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f64600c7ef0 0x7f6460144ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:27.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.622+0000 7f6465200640 1 -- 172.21.15.120:0/2142672201 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6460071d00 msgr2=0x7f646014f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:27.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.622+0000 7f6465200640 1 --2- 172.21.15.120:0/2142672201 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6460071d00 0x7f646014f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:27.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.622+0000 7f6465200640 1 -- 172.21.15.120:0/2142672201 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f644c009420 con 0x7f6460153630 2024-04-18T04:44:27.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.622+0000 7f645f400640 1 --2- 172.21.15.120:0/2142672201 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f64600c7ef0 0x7f6460144ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:44:27.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.622+0000 7f645fe00640 1 --2- 172.21.15.120:0/2142672201 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6460071d00 0x7f646014f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:44:27.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.622+0000 7f6465200640 1 --2- 172.21.15.120:0/2142672201 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6460153630 0x7f646015d020 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f645800c770 tx=0x7f645800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:27.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.622+0000 7f6457e00640 1 -- 172.21.15.120:0/2142672201 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6458003b80 con 0x7f6460153630 2024-04-18T04:44:27.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.622+0000 7f6457e00640 1 -- 172.21.15.120:0/2142672201 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6458003ce0 con 0x7f6460153630 2024-04-18T04:44:27.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.622+0000 7f6465c00640 1 -- 172.21.15.120:0/2142672201 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f646015cb00 con 0x7f6460153630 2024-04-18T04:44:27.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.622+0000 7f6457e00640 1 -- 172.21.15.120:0/2142672201 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645800aa90 con 0x7f6460153630 2024-04-18T04:44:27.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.622+0000 7f6465c00640 1 -- 172.21.15.120:0/2142672201 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64601474f0 con 0x7f6460153630 2024-04-18T04:44:27.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.622+0000 7f6465c00640 1 -- 172.21.15.120:0/2142672201 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f646015cd40 con 0x7f6460153630 2024-04-18T04:44:27.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.622+0000 7f6457e00640 1 -- 172.21.15.120:0/2142672201 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f645800abf0 con 0x7f6460153630 2024-04-18T04:44:27.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.626+0000 7f6457e00640 1 --2- 172.21.15.120:0/2142672201 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f64400666c0 0x7f6440068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:27.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.626+0000 7f6457e00640 1 -- 172.21.15.120:0/2142672201 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6458083d50 con 0x7f6460153630 2024-04-18T04:44:27.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.626+0000 7f645fe00640 1 --2- 172.21.15.120:0/2142672201 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f64400666c0 0x7f6440068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:27.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.626+0000 7f645fe00640 1 --2- 172.21.15.120:0/2142672201 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f64400666c0 0x7f6440068b80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6450000f70 tx=0x7f6450007dd0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:27.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.630+0000 7f6457e00640 1 -- 172.21.15.120:0/2142672201 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f646015cd40 con 0x7f6460153630 2024-04-18T04:44:27.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.782+0000 7f6465c00640 1 -- 172.21.15.120:0/2142672201 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f646015ccf0 con 0x7f6460153630 2024-04-18T04:44:27.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.782+0000 7f6457e00640 1 -- 172.21.15.120:0/2142672201 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12430 (secure 0 0 0) 0x7f6458051370 con 0x7f6460153630 2024-04-18T04:44:27.782 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:44:27.782 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":17,"fsid":"8e73592f-08e2-4957-a98f-9d044cec4ba5","created":"2024-04-18T04:44:06.139983+0000","modified":"2024-04-18T04:44:19.430995+0000","last_up_change":"2024-04-18T04:44:17.410146+0000","last_in_change":"2024-04-18T04:44:08.470250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T04:44:16.864728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a80903bd-d9be-4fb9-af99-6125cb26bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":27468},{"type":"v1","addr":"172.21.15.120:6801","nonce":27468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":27468},{"type":"v1","addr":"172.21.15.120:6803","nonce":27468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":27468},{"type":"v1","addr":"172.21.15.120:6807","nonce":27468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":27468},{"type":"v1","addr":"172.21.15.120:6805","nonce":27468}]},"public_addr":"172.21.15.120:6801/27468","cluster_addr":"172.21.15.120:6803/27468","heartbeat_back_addr":"172.21.15.120:6807/27468","heartbeat_front_addr":"172.21.15.120:6805/27468","state":["exists","up"]},{"osd":1,"uuid":"8f5f004b-6870-4c78-8d50-9622e631ec25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":27470},{"type":"v1","addr":"172.21.15.120:6823","nonce":27470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":27470},{"type":"v1","addr":"172.21.15.120:6827","nonce":27470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":27470},{"type":"v1","addr":"172.21.15.120:6831","nonce":27470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":27470},{"type":"v1","addr":"172.21.15.120:6829","nonce":27470}]},"public_addr":"172.21.15.120:6823/27470","cluster_addr":"172.21.15.120:6827/27470","heartbeat_back_addr":"172.21.15.120:6831/27470","heartbeat_front_addr":"172.21.15.120:6829/27470","state":["exists","up"]},{"osd":2,"uuid":"6e228a2b-6103-4301-a8b5-ee81dbb1f920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":27471},{"type":"v1","addr":"172.21.15.120:6817","nonce":27471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":27471},{"type":"v1","addr":"172.21.15.120:6819","nonce":27471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":27471},{"type":"v1","addr":"172.21.15.120:6826","nonce":27471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":27471},{"type":"v1","addr":"172.21.15.120:6822","nonce":27471}]},"public_addr":"172.21.15.120:6817/27471","cluster_addr":"172.21.15.120:6819/27471","heartbeat_back_addr":"172.21.15.120:6826/27471","heartbeat_front_addr":"172.21.15.120:6822/27471","state":["exists","up"]},{"osd":3,"uuid":"7a5cabd7-d898-4e32-a03c-25b46e790134","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":27469},{"type":"v1","addr":"172.21.15.120:6809","nonce":27469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":27469},{"type":"v1","addr":"172.21.15.120:6811","nonce":27469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":27469},{"type":"v1","addr":"172.21.15.120:6815","nonce":27469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":27469},{"type":"v1","addr":"172.21.15.120:6813","nonce":27469}]},"public_addr":"172.21.15.120:6809/27469","cluster_addr":"172.21.15.120:6811/27469","heartbeat_back_addr":"172.21.15.120:6815/27469","heartbeat_front_addr":"172.21.15.120:6813/27469","state":["exists","up"]},{"osd":4,"uuid":"8e9f530f-6bab-4b23-a1a3-a71362fefcc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":28102},{"type":"v1","addr":"172.21.15.132:6825","nonce":28102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":28102},{"type":"v1","addr":"172.21.15.132:6827","nonce":28102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":28102},{"type":"v1","addr":"172.21.15.132:6831","nonce":28102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":28102},{"type":"v1","addr":"172.21.15.132:6829","nonce":28102}]},"public_addr":"172.21.15.132:6825/28102","cluster_addr":"172.21.15.132:6827/28102","heartbeat_back_addr":"172.21.15.132:6831/28102","heartbeat_front_addr":"172.21.15.132:6829/28102","state":["exists","up"]},{"osd":5,"uuid":"2243fabe-cc81-40cf-91bc-f106fe275a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":28104},{"type":"v1","addr":"172.21.15.132:6809","nonce":28104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":28104},{"type":"v1","addr":"172.21.15.132:6811","nonce":28104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":28104},{"type":"v1","addr":"172.21.15.132:6815","nonce":28104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":28104},{"type":"v1","addr":"172.21.15.132:6813","nonce":28104}]},"public_addr":"172.21.15.132:6809/28104","cluster_addr":"172.21.15.132:6811/28104","heartbeat_back_addr":"172.21.15.132:6815/28104","heartbeat_front_addr":"172.21.15.132:6813/28104","state":["exists","up"]},{"osd":6,"uuid":"c093a5ed-25c8-41a7-a20d-606a1a1661e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":28103},{"type":"v1","addr":"172.21.15.132:6801","nonce":28103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":28103},{"type":"v1","addr":"172.21.15.132:6803","nonce":28103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":28103},{"type":"v1","addr":"172.21.15.132:6807","nonce":28103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":28103},{"type":"v1","addr":"172.21.15.132:6805","nonce":28103}]},"public_addr":"172.21.15.132:6801/28103","cluster_addr":"172.21.15.132:6803/28103","heartbeat_back_addr":"172.21.15.132:6807/28103","heartbeat_front_addr":"172.21.15.132:6805/28103","state":["exists","up"]},{"osd":7,"uuid":"c37426b7-1080-4434-9f3e-a3afbbdc0fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":28129},{"type":"v1","addr":"172.21.15.132:6817","nonce":28129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":28129},{"type":"v1","addr":"172.21.15.132:6819","nonce":28129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":28129},{"type":"v1","addr":"172.21.15.132:6823","nonce":28129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":28129},{"type":"v1","addr":"172.21.15.132:6821","nonce":28129}]},"public_addr":"172.21.15.132:6817/28129","cluster_addr":"172.21.15.132:6819/28129","heartbeat_back_addr":"172.21.15.132:6823/28129","heartbeat_front_addr":"172.21.15.132:6821/28129","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.053825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.289753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.274645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.146361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.943883+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.701955+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.851076+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.800782+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T04:44:27.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.786+0000 7f6465c00640 1 -- 172.21.15.120:0/2142672201 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f64400666c0 msgr2=0x7f6440068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:27.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.786+0000 7f6465c00640 1 --2- 172.21.15.120:0/2142672201 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f64400666c0 0x7f6440068b80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6450000f70 tx=0x7f6450007dd0 comp rx=0 tx=0).stop 2024-04-18T04:44:27.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.786+0000 7f6465c00640 1 -- 172.21.15.120:0/2142672201 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6460153630 msgr2=0x7f646015d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:27.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.786+0000 7f6465c00640 1 --2- 172.21.15.120:0/2142672201 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6460153630 0x7f646015d020 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f645800c770 tx=0x7f645800cc30 comp rx=0 tx=0).stop 2024-04-18T04:44:27.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.786+0000 7f6465c00640 1 -- 172.21.15.120:0/2142672201 shutdown_connections 2024-04-18T04:44:27.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.786+0000 7f6465c00640 1 --2- 172.21.15.120:0/2142672201 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f64400666c0 0x7f6440068b80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:27.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.786+0000 7f6465c00640 1 --2- 172.21.15.120:0/2142672201 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6460153630 0x7f646015d020 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:27.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.786+0000 7f6465c00640 1 --2- 172.21.15.120:0/2142672201 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f64600c7ef0 0x7f6460144ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:27.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.786+0000 7f6465c00640 1 --2- 172.21.15.120:0/2142672201 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6460071d00 0x7f646014f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:27.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.786+0000 7f6465c00640 1 -- 172.21.15.120:0/2142672201 >> 172.21.15.120:0/2142672201 conn(0x7f646006da10 msgr2=0x7f646006c180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:27.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.786+0000 7f6465c00640 1 -- 172.21.15.120:0/2142672201 shutdown_connections 2024-04-18T04:44:27.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.786+0000 7f6465c00640 1 -- 172.21.15.120:0/2142672201 wait complete. 2024-04-18T04:44:27.803 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T04:44:16.864728+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-18T04:44:27.804 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T04:44:27.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.942+0000 7fd905200640 1 Processor -- start 2024-04-18T04:44:27.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.942+0000 7fd905200640 1 -- start start 2024-04-18T04:44:27.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.946+0000 7fd905200640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd900150820 0x7fd9000c0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:27.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.946+0000 7fd905200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd900159d90 0x7fd90015a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:27.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.946+0000 7fd905200640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd900071a60 con 0x7fd9000c09d0 2024-04-18T04:44:27.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.946+0000 7fd905200640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd900150c00 con 0x7fd900150820 2024-04-18T04:44:27.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.946+0000 7fd905200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd900157430 con 0x7fd900159d90 2024-04-18T04:44:27.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.946+0000 7fd8fde00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd900150820 0x7fd9000c0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:27.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.946+0000 7fd8fe800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd900159d90 0x7fd90015a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:27.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.946+0000 7fd8fde00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd900150820 0x7fd9000c0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:54768/0 (socket says 172.21.15.120:54768) 2024-04-18T04:44:27.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.946+0000 7fd8fe800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd900159d90 0x7fd90015a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:39594/0 (socket says 172.21.15.120:39594) 2024-04-18T04:44:27.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.946+0000 7fd8fde00640 1 -- 172.21.15.120:0/3847485286 learned_addr learned my addr 172.21.15.120:0/3847485286 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:27.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.946+0000 7fd8fde00640 1 -- 172.21.15.120:0/3847485286 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd900159d90 msgr2=0x7fd90015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:27.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.946+0000 7fd8fde00640 1 --2- 172.21.15.120:0/3847485286 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd900159d90 0x7fd90015a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:27.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.946+0000 7fd8fde00640 1 -- 172.21.15.120:0/3847485286 >> v1:172.21.15.132:6789/0 conn(0x7fd9000c09d0 legacy=0x7fd9000caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:27.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.946+0000 7fd8fde00640 1 -- 172.21.15.120:0/3847485286 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd90015a720 con 0x7fd900150820 2024-04-18T04:44:27.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.950+0000 7fd8fde00640 1 --2- 172.21.15.120:0/3847485286 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd900150820 0x7fd9000c0490 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd8f000d150 tx=0x7fd8f001ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12697476c914e3f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:27.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.950+0000 7fd8fd400640 1 -- 172.21.15.120:0/3847485286 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f000b2d0 con 0x7fd900150820 2024-04-18T04:44:27.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.950+0000 7fd8fd400640 1 -- 172.21.15.120:0/3847485286 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f000b430 con 0x7fd900150820 2024-04-18T04:44:27.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.950+0000 7fd8fd400640 1 -- 172.21.15.120:0/3847485286 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f00a7b00 con 0x7fd900150820 2024-04-18T04:44:27.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.950+0000 7fd905200640 1 -- 172.21.15.120:0/3847485286 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd900150820 msgr2=0x7fd9000c0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:27.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.950+0000 7fd905200640 1 --2- 172.21.15.120:0/3847485286 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd900150820 0x7fd9000c0490 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd8f000d150 tx=0x7fd8f001ec00 comp rx=0 tx=0).stop 2024-04-18T04:44:27.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.950+0000 7fd905200640 1 -- 172.21.15.120:0/3847485286 shutdown_connections 2024-04-18T04:44:27.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.950+0000 7fd905200640 1 --2- 172.21.15.120:0/3847485286 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd900159d90 0x7fd90015a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:27.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.950+0000 7fd905200640 1 --2- 172.21.15.120:0/3847485286 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd900150820 0x7fd9000c0490 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:27.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.950+0000 7fd905200640 1 -- 172.21.15.120:0/3847485286 >> 172.21.15.120:0/3847485286 conn(0x7fd90006b780 msgr2=0x7fd90006bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:27.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.950+0000 7fd905200640 1 -- 172.21.15.120:0/3847485286 shutdown_connections 2024-04-18T04:44:27.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.950+0000 7fd905200640 1 -- 172.21.15.120:0/3847485286 wait complete. 2024-04-18T04:44:27.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.950+0000 7fd905200640 1 Processor -- start 2024-04-18T04:44:27.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.950+0000 7fd905200640 1 -- start start 2024-04-18T04:44:27.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.954+0000 7fd905200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd9000c09d0 0x7fd9001f5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:27.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.954+0000 7fd905200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd900150820 0x7fd9000ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:27.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.954+0000 7fd905200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd900159d90 0x7fd900158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:27.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.954+0000 7fd905200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd900159590 con 0x7fd900150820 2024-04-18T04:44:27.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.954+0000 7fd905200640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd900158040 con 0x7fd900159d90 2024-04-18T04:44:27.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.954+0000 7fd905200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd900157a10 con 0x7fd9000c09d0 2024-04-18T04:44:27.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.954+0000 7fd8f5400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd900150820 0x7fd9000ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:27.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.954+0000 7fd8f5400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd900150820 0x7fd9000ca0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46684/0 (socket says 172.21.15.120:46684) 2024-04-18T04:44:27.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.954+0000 7fd8f5400640 1 -- 172.21.15.120:0/3987922280 learned_addr learned my addr 172.21.15.120:0/3987922280 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:27.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.954+0000 7fd8fde00640 1 --2- 172.21.15.120:0/3987922280 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd9000c09d0 0x7fd9001f5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:27.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.954+0000 7fd8fe800640 1 --2- 172.21.15.120:0/3987922280 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd900159d90 0x7fd900158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:27.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.954+0000 7fd8f5400640 1 -- 172.21.15.120:0/3987922280 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd9000c09d0 msgr2=0x7fd9001f5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:27.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.954+0000 7fd8f5400640 1 --2- 172.21.15.120:0/3987922280 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd9000c09d0 0x7fd9001f5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:27.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.954+0000 7fd8f5400640 1 -- 172.21.15.120:0/3987922280 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd900159d90 msgr2=0x7fd900158460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:27.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.954+0000 7fd8f5400640 1 --2- 172.21.15.120:0/3987922280 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd900159d90 0x7fd900158460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:27.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.954+0000 7fd8f5400640 1 -- 172.21.15.120:0/3987922280 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f000bd40 con 0x7fd900150820 2024-04-18T04:44:27.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.954+0000 7fd8fe800640 1 --2- 172.21.15.120:0/3987922280 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd900159d90 0x7fd900158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:44:27.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.954+0000 7fd8f5400640 1 --2- 172.21.15.120:0/3987922280 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd900150820 0x7fd9000ca0a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd8e800c3c0 tx=0x7fd8e800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:27.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.954+0000 7fd8f6a00640 1 -- 172.21.15.120:0/3987922280 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e80052d0 con 0x7fd900150820 2024-04-18T04:44:27.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.954+0000 7fd8f6a00640 1 -- 172.21.15.120:0/3987922280 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e8005430 con 0x7fd900150820 2024-04-18T04:44:27.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.954+0000 7fd8f6a00640 1 -- 172.21.15.120:0/3987922280 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e8003840 con 0x7fd900150820 2024-04-18T04:44:27.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.954+0000 7fd905200640 1 -- 172.21.15.120:0/3987922280 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9001f6260 con 0x7fd900150820 2024-04-18T04:44:27.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.954+0000 7fd905200640 1 -- 172.21.15.120:0/3987922280 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9001f67d0 con 0x7fd900150820 2024-04-18T04:44:27.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.954+0000 7fd905200640 1 -- 172.21.15.120:0/3987922280 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9000729d0 con 0x7fd900150820 2024-04-18T04:44:27.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.954+0000 7fd8f6a00640 1 -- 172.21.15.120:0/3987922280 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd8e80039a0 con 0x7fd900150820 2024-04-18T04:44:27.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.958+0000 7fd8f6a00640 1 --2- 172.21.15.120:0/3987922280 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd8dc066690 0x7fd8dc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:27.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.958+0000 7fd8f6a00640 1 -- 172.21.15.120:0/3987922280 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd8e8083360 con 0x7fd900150820 2024-04-18T04:44:27.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.958+0000 7fd8fde00640 1 --2- 172.21.15.120:0/3987922280 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd8dc066690 0x7fd8dc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:27.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.958+0000 7fd8fde00640 1 --2- 172.21.15.120:0/3987922280 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd8dc066690 0x7fd8dc068b50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd8f00b0000 tx=0x7fd8f00a9070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:27.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:27.962+0000 7fd8f6a00640 1 -- 172.21.15.120:0/3987922280 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fd8e8050a30 con 0x7fd900150820 2024-04-18T04:44:28.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.114+0000 7fd905200640 1 -- 172.21.15.120:0/3987922280 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd9000c1590 con 0x7fd900150820 2024-04-18T04:44:28.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.114+0000 7fd8f6a00640 1 -- 172.21.15.120:0/3987922280 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd8e8054050 con 0x7fd900150820 2024-04-18T04:44:28.113 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2024-04-18T04:44:28.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.118+0000 7fd905200640 1 -- 172.21.15.120:0/3987922280 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd8dc066690 msgr2=0x7fd8dc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:28.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.118+0000 7fd905200640 1 --2- 172.21.15.120:0/3987922280 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd8dc066690 0x7fd8dc068b50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd8f00b0000 tx=0x7fd8f00a9070 comp rx=0 tx=0).stop 2024-04-18T04:44:28.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.118+0000 7fd905200640 1 -- 172.21.15.120:0/3987922280 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd900150820 msgr2=0x7fd9000ca0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:28.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.118+0000 7fd905200640 1 --2- 172.21.15.120:0/3987922280 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd900150820 0x7fd9000ca0a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd8e800c3c0 tx=0x7fd8e800c880 comp rx=0 tx=0).stop 2024-04-18T04:44:28.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.118+0000 7fd905200640 1 -- 172.21.15.120:0/3987922280 shutdown_connections 2024-04-18T04:44:28.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.118+0000 7fd905200640 1 --2- 172.21.15.120:0/3987922280 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd8dc066690 0x7fd8dc068b50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:28.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.118+0000 7fd905200640 1 --2- 172.21.15.120:0/3987922280 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd900159d90 0x7fd900158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:28.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.118+0000 7fd905200640 1 --2- 172.21.15.120:0/3987922280 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd900150820 0x7fd9000ca0a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:28.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.118+0000 7fd905200640 1 --2- 172.21.15.120:0/3987922280 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd9000c09d0 0x7fd9001f5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:28.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.118+0000 7fd905200640 1 -- 172.21.15.120:0/3987922280 >> 172.21.15.120:0/3987922280 conn(0x7fd90006b780 msgr2=0x7fd90006bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:28.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.118+0000 7fd905200640 1 -- 172.21.15.120:0/3987922280 shutdown_connections 2024-04-18T04:44:28.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.118+0000 7fd905200640 1 -- 172.21.15.120:0/3987922280 wait complete. 2024-04-18T04:44:28.133 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-18T04:44:28.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.274+0000 7fca4a400640 1 Processor -- start 2024-04-18T04:44:28.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.274+0000 7fca4a400640 1 -- start start 2024-04-18T04:44:28.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.274+0000 7fca4a400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fca441573c0 0x7fca4406fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:28.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.274+0000 7fca4a400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fca440ccee0 0x7fca440cd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:28.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.274+0000 7fca4a400640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca441577d0 con 0x7fca441515e0 2024-04-18T04:44:28.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.274+0000 7fca4a400640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca440c3120 con 0x7fca441573c0 2024-04-18T04:44:28.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.274+0000 7fca4a400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca440ca990 con 0x7fca440ccee0 2024-04-18T04:44:28.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.274+0000 7fca42a00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fca441573c0 0x7fca4406fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:28.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.274+0000 7fca42a00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fca441573c0 0x7fca4406fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46692/0 (socket says 172.21.15.120:46692) 2024-04-18T04:44:28.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.274+0000 7fca42a00640 1 -- 172.21.15.120:0/88718300 learned_addr learned my addr 172.21.15.120:0/88718300 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:28.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.274+0000 7fca43e00640 1 --2- 172.21.15.120:0/88718300 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fca440ccee0 0x7fca440cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:28.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.274+0000 7fca42a00640 1 -- 172.21.15.120:0/88718300 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fca440ccee0 msgr2=0x7fca440cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:28.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.274+0000 7fca42a00640 1 --2- 172.21.15.120:0/88718300 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fca440ccee0 0x7fca440cd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:28.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.274+0000 7fca42a00640 1 -- 172.21.15.120:0/88718300 >> v1:172.21.15.132:6789/0 conn(0x7fca441515e0 legacy=0x7fca440ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:28.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.274+0000 7fca42a00640 1 -- 172.21.15.120:0/88718300 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca44157a50 con 0x7fca441573c0 2024-04-18T04:44:28.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.278+0000 7fca42a00640 1 --2- 172.21.15.120:0/88718300 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca441573c0 0x7fca4406fd00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fca30009870 tx=0x7fca3001ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e81f13af80123f77 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:28.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.278+0000 7fca42000640 1 -- 172.21.15.120:0/88718300 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca300a8a50 con 0x7fca441573c0 2024-04-18T04:44:28.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.278+0000 7fca42000640 1 -- 172.21.15.120:0/88718300 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca300a8bb0 con 0x7fca441573c0 2024-04-18T04:44:28.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.278+0000 7fca42000640 1 -- 172.21.15.120:0/88718300 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca300b0440 con 0x7fca441573c0 2024-04-18T04:44:28.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.278+0000 7fca4a400640 1 -- 172.21.15.120:0/88718300 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca441573c0 msgr2=0x7fca4406fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:28.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.278+0000 7fca4a400640 1 --2- 172.21.15.120:0/88718300 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca441573c0 0x7fca4406fd00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fca30009870 tx=0x7fca3001ed50 comp rx=0 tx=0).stop 2024-04-18T04:44:28.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.278+0000 7fca4a400640 1 -- 172.21.15.120:0/88718300 shutdown_connections 2024-04-18T04:44:28.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.278+0000 7fca4a400640 1 --2- 172.21.15.120:0/88718300 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fca440ccee0 0x7fca440cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:28.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.278+0000 7fca4a400640 1 --2- 172.21.15.120:0/88718300 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca441573c0 0x7fca4406fd00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:28.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.278+0000 7fca4a400640 1 -- 172.21.15.120:0/88718300 >> 172.21.15.120:0/88718300 conn(0x7fca4406e0f0 msgr2=0x7fca44071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:28.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.278+0000 7fca4a400640 1 -- 172.21.15.120:0/88718300 shutdown_connections 2024-04-18T04:44:28.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.278+0000 7fca4a400640 1 -- 172.21.15.120:0/88718300 wait complete. 2024-04-18T04:44:28.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.278+0000 7fca4a400640 1 Processor -- start 2024-04-18T04:44:28.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.278+0000 7fca4a400640 1 -- start start 2024-04-18T04:44:28.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.282+0000 7fca4a400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fca440ccee0 0x7fca4415a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:28.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.282+0000 7fca4a400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca441515e0 0x7fca440cbda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:28.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.282+0000 7fca4a400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca441573c0 0x7fca440cc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:28.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.282+0000 7fca4a400640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca44158d60 con 0x7fca441573c0 2024-04-18T04:44:28.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.282+0000 7fca4a400640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4414eea0 con 0x7fca441515e0 2024-04-18T04:44:28.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.282+0000 7fca4a400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca4414e890 con 0x7fca440ccee0 2024-04-18T04:44:28.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.282+0000 7fca43e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca441573c0 0x7fca440cc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:28.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.282+0000 7fca43e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca441573c0 0x7fca440cc2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46708/0 (socket says 172.21.15.120:46708) 2024-04-18T04:44:28.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.282+0000 7fca43e00640 1 -- 172.21.15.120:0/1837489490 learned_addr learned my addr 172.21.15.120:0/1837489490 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:28.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.282+0000 7fca42a00640 1 --2- 172.21.15.120:0/1837489490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca441515e0 0x7fca440cbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:28.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.282+0000 7fca43400640 1 --2- 172.21.15.120:0/1837489490 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fca440ccee0 0x7fca4415a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:28.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.282+0000 7fca43e00640 1 -- 172.21.15.120:0/1837489490 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fca440ccee0 msgr2=0x7fca4415a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:28.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.282+0000 7fca43e00640 1 --2- 172.21.15.120:0/1837489490 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fca440ccee0 0x7fca4415a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:28.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.282+0000 7fca43e00640 1 -- 172.21.15.120:0/1837489490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca441515e0 msgr2=0x7fca440cbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:28.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.282+0000 7fca43e00640 1 --2- 172.21.15.120:0/1837489490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca441515e0 0x7fca440cbda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:28.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.282+0000 7fca43e00640 1 -- 172.21.15.120:0/1837489490 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca300094d0 con 0x7fca441573c0 2024-04-18T04:44:28.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.282+0000 7fca42a00640 1 --2- 172.21.15.120:0/1837489490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca441515e0 0x7fca440cbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:44:28.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.282+0000 7fca43e00640 1 --2- 172.21.15.120:0/1837489490 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca441573c0 0x7fca440cc2e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fca3c007e40 tx=0x7fca3c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:28.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.282+0000 7fca3b400640 1 -- 172.21.15.120:0/1837489490 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c014620 con 0x7fca441573c0 2024-04-18T04:44:28.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.282+0000 7fca3b400640 1 -- 172.21.15.120:0/1837489490 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3c0147a0 con 0x7fca441573c0 2024-04-18T04:44:28.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.282+0000 7fca3b400640 1 -- 172.21.15.120:0/1837489490 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c014b50 con 0x7fca441573c0 2024-04-18T04:44:28.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.282+0000 7fca4a400640 1 -- 172.21.15.120:0/1837489490 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca4406ce20 con 0x7fca441573c0 2024-04-18T04:44:28.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.282+0000 7fca4a400640 1 -- 172.21.15.120:0/1837489490 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca4414eb30 con 0x7fca441573c0 2024-04-18T04:44:28.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.282+0000 7fca4a400640 1 -- 172.21.15.120:0/1837489490 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca4406afd0 con 0x7fca441573c0 2024-04-18T04:44:28.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.282+0000 7fca3b400640 1 -- 172.21.15.120:0/1837489490 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fca3c014cb0 con 0x7fca441573c0 2024-04-18T04:44:28.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.286+0000 7fca3b400640 1 --2- 172.21.15.120:0/1837489490 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fca24066690 0x7fca24068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:28.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.286+0000 7fca3b400640 1 -- 172.21.15.120:0/1837489490 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fca3c084900 con 0x7fca441573c0 2024-04-18T04:44:28.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.286+0000 7fca43400640 1 --2- 172.21.15.120:0/1837489490 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fca24066690 0x7fca24068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:28.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.286+0000 7fca43400640 1 --2- 172.21.15.120:0/1837489490 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fca24066690 0x7fca24068b50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fca34000f70 tx=0x7fca34009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:28.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.290+0000 7fca3b400640 1 -- 172.21.15.120:0/1837489490 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fca4406afd0 con 0x7fca441573c0 2024-04-18T04:44:28.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.446+0000 7fca4a400640 1 -- 172.21.15.120:0/1837489490 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fca4406afd0 con 0x7fca441573c0 2024-04-18T04:44:28.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.446+0000 7fca3b400640 1 -- 172.21.15.120:0/1837489490 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7fca4406afd0 con 0x7fca441573c0 2024-04-18T04:44:28.445 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:44:28.445 INFO:teuthology.orchestra.run.smithi120.stdout:[ 2024-04-18T04:44:28.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-18T04:44:28.445 INFO:teuthology.orchestra.run.smithi120.stdout: "poolnum": 1, 2024-04-18T04:44:28.445 INFO:teuthology.orchestra.run.smithi120.stdout: "poolname": ".mgr" 2024-04-18T04:44:28.445 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-18T04:44:28.445 INFO:teuthology.orchestra.run.smithi120.stdout:] 2024-04-18T04:44:28.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.446+0000 7fca4a400640 1 -- 172.21.15.120:0/1837489490 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fca24066690 msgr2=0x7fca24068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:28.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.446+0000 7fca4a400640 1 --2- 172.21.15.120:0/1837489490 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fca24066690 0x7fca24068b50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fca34000f70 tx=0x7fca34009040 comp rx=0 tx=0).stop 2024-04-18T04:44:28.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.446+0000 7fca4a400640 1 -- 172.21.15.120:0/1837489490 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca441573c0 msgr2=0x7fca440cc2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:28.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.446+0000 7fca4a400640 1 --2- 172.21.15.120:0/1837489490 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca441573c0 0x7fca440cc2e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fca3c007e40 tx=0x7fca3c00e4b0 comp rx=0 tx=0).stop 2024-04-18T04:44:28.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.450+0000 7fca4a400640 1 -- 172.21.15.120:0/1837489490 shutdown_connections 2024-04-18T04:44:28.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.450+0000 7fca4a400640 1 --2- 172.21.15.120:0/1837489490 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fca24066690 0x7fca24068b50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:28.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.450+0000 7fca4a400640 1 --2- 172.21.15.120:0/1837489490 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca441573c0 0x7fca440cc2e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:28.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.450+0000 7fca4a400640 1 --2- 172.21.15.120:0/1837489490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca441515e0 0x7fca440cbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:28.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.450+0000 7fca4a400640 1 --2- 172.21.15.120:0/1837489490 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fca440ccee0 0x7fca4415a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:28.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.450+0000 7fca4a400640 1 -- 172.21.15.120:0/1837489490 >> 172.21.15.120:0/1837489490 conn(0x7fca4406e0f0 msgr2=0x7fca440c7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:28.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.450+0000 7fca4a400640 1 -- 172.21.15.120:0/1837489490 shutdown_connections 2024-04-18T04:44:28.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.450+0000 7fca4a400640 1 -- 172.21.15.120:0/1837489490 wait complete. 2024-04-18T04:44:28.466 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-18T04:44:28.466 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-18T04:44:28.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.610+0000 7f3e03200640 1 Processor -- start 2024-04-18T04:44:28.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.610+0000 7f3e03200640 1 -- start start 2024-04-18T04:44:28.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.610+0000 7f3e03200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3e04151470 0x7f3e0406f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:28.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.610+0000 7f3e03200640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3e040c1e90 0x7f3e040c2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:28.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.610+0000 7f3e03200640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e040c8650 con 0x7f3e040c9380 2024-04-18T04:44:28.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.610+0000 7f3e03200640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e040c3750 con 0x7f3e040c1e90 2024-04-18T04:44:28.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.610+0000 7f3e03200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e040c8ef0 con 0x7f3e04151470 2024-04-18T04:44:28.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.610+0000 7f3dfbe00640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f3e040c9380 0x7f3e04157200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:49880/0 (socket says 172.21.15.120:49880) 2024-04-18T04:44:28.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.610+0000 7f3dfbe00640 1 -- 172.21.15.120:0/3625378448 learned_addr learned my addr 172.21.15.120:0/3625378448 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:44:28.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.610+0000 7f3e01e00640 1 --2- 172.21.15.120:0/3625378448 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3e04151470 0x7f3e0406f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:28.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.610+0000 7f3e02800640 1 --2- 172.21.15.120:0/3625378448 >> v2:172.21.15.132:3300/0 conn(0x7f3e040c1e90 0x7f3e040c2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:28.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.610+0000 7f3e01400640 1 -- 172.21.15.120:0/3625378448 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3791471187 0 0) 0x7f3e040c8650 con 0x7f3e040c9380 2024-04-18T04:44:28.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.610+0000 7f3e01400640 1 -- 172.21.15.120:0/3625378448 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3de8003530 con 0x7f3e040c9380 2024-04-18T04:44:28.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.610+0000 7f3e01400640 1 -- 172.21.15.120:0/3625378448 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 465419955 0 0) 0x7f3de8003530 con 0x7f3e040c9380 2024-04-18T04:44:28.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.610+0000 7f3e01400640 1 -- 172.21.15.120:0/3625378448 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3e04151470 msgr2=0x7f3e0406f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:28.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.610+0000 7f3e01400640 1 --2- 172.21.15.120:0/3625378448 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3e04151470 0x7f3e0406f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:28.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.610+0000 7f3e01400640 1 -- 172.21.15.120:0/3625378448 >> v2:172.21.15.132:3300/0 conn(0x7f3e040c1e90 msgr2=0x7f3e040c2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:28.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.610+0000 7f3e01400640 1 --2- 172.21.15.120:0/3625378448 >> v2:172.21.15.132:3300/0 conn(0x7f3e040c1e90 0x7f3e040c2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:28.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.610+0000 7f3e01400640 1 -- 172.21.15.120:0/3625378448 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e040c97c0 con 0x7f3e040c9380 2024-04-18T04:44:28.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.610+0000 7f3e01400640 1 -- 172.21.15.120:0/3625378448 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7f3dec001680 con 0x7f3e040c9380 2024-04-18T04:44:28.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.610+0000 7f3e01400640 1 -- 172.21.15.120:0/3625378448 >> v1:172.21.15.120:6789/0 conn(0x7f3e040c9380 legacy=0x7f3e04157200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:28.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.610+0000 7f3e01400640 1 --2- 172.21.15.120:0/3625378448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3de8003980 0x7f3de8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:28.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.610+0000 7f3e01400640 1 --2- 172.21.15.120:0/3625378448 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3de80047d0 0x7f3de8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:28.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.610+0000 7f3e01400640 1 --2- 172.21.15.120:0/3625378448 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3e04151470 0x7f3de8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:28.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.610+0000 7f3e01400640 1 -- 172.21.15.120:0/3625378448 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e040c3750 con 0x7f3de80047d0 2024-04-18T04:44:28.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.610+0000 7f3e01400640 1 -- 172.21.15.120:0/3625378448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e040c8ef0 con 0x7f3de8003980 2024-04-18T04:44:28.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.610+0000 7f3e01400640 1 -- 172.21.15.120:0/3625378448 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de800b990 con 0x7f3e04151470 2024-04-18T04:44:28.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.610+0000 7f3dfbe00640 1 --2- 172.21.15.120:0/3625378448 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3de80047d0 0x7f3de8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:28.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.610+0000 7f3e02800640 1 --2- 172.21.15.120:0/3625378448 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3e04151470 0x7f3de8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:28.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.610+0000 7f3e01e00640 1 --2- 172.21.15.120:0/3625378448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3de8003980 0x7f3de8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:28.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.610+0000 7f3dfbe00640 1 -- 172.21.15.120:0/3625378448 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3e04151470 msgr2=0x7f3de8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:28.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.610+0000 7f3dfbe00640 1 --2- 172.21.15.120:0/3625378448 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3e04151470 0x7f3de8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:28.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.610+0000 7f3dfbe00640 1 -- 172.21.15.120:0/3625378448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3de8003980 msgr2=0x7f3de8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:28.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.610+0000 7f3dfbe00640 1 --2- 172.21.15.120:0/3625378448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3de8003980 0x7f3de8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:28.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.610+0000 7f3dfbe00640 1 -- 172.21.15.120:0/3625378448 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de8003530 con 0x7f3de80047d0 2024-04-18T04:44:28.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.610+0000 7f3e01e00640 1 --2- 172.21.15.120:0/3625378448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3de8003980 0x7f3de8003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:44:28.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.614+0000 7f3dfbe00640 1 --2- 172.21.15.120:0/3625378448 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3de80047d0 0x7f3de8004c50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3dec00c1c0 tx=0x7f3dec01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=533bc1b823688329 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:28.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.614+0000 7f3e01400640 1 -- 172.21.15.120:0/3625378448 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dec0058e0 con 0x7f3de80047d0 2024-04-18T04:44:28.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.614+0000 7f3e01400640 1 -- 172.21.15.120:0/3625378448 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dec005a60 con 0x7f3de80047d0 2024-04-18T04:44:28.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.614+0000 7f3e01400640 1 -- 172.21.15.120:0/3625378448 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dec005e10 con 0x7f3de80047d0 2024-04-18T04:44:28.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.614+0000 7f3e03200640 1 -- 172.21.15.120:0/3625378448 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3de80047d0 msgr2=0x7f3de8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:28.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.614+0000 7f3e03200640 1 --2- 172.21.15.120:0/3625378448 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3de80047d0 0x7f3de8004c50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3dec00c1c0 tx=0x7f3dec01cc60 comp rx=0 tx=0).stop 2024-04-18T04:44:28.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.614+0000 7f3e02800640 1 -- 172.21.15.120:0/3625378448 reap_dead start 2024-04-18T04:44:28.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.614+0000 7f3e03200640 1 -- 172.21.15.120:0/3625378448 shutdown_connections 2024-04-18T04:44:28.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.614+0000 7f3e03200640 1 -- 172.21.15.120:0/3625378448 >> 172.21.15.120:0/3625378448 conn(0x7f3e040cce70 msgr2=0x7f3e040cd280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:28.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.614+0000 7f3e03200640 1 -- 172.21.15.120:0/3625378448 shutdown_connections 2024-04-18T04:44:28.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.614+0000 7f3e03200640 1 -- 172.21.15.120:0/3625378448 wait complete. 2024-04-18T04:44:28.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.618+0000 7f3e03200640 1 Processor -- start 2024-04-18T04:44:28.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.618+0000 7f3e03200640 1 -- start start 2024-04-18T04:44:28.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.618+0000 7f3e03200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3de80047d0 0x7f3e0415af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:28.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.618+0000 7f3e03200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e0414d770 0x7f3e041583c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:28.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.618+0000 7f3e03200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3e0406c660 0x7f3e0406cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:28.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.618+0000 7f3e03200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0415b440 con 0x7f3de80047d0 2024-04-18T04:44:28.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.618+0000 7f3e03200640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0406d020 con 0x7f3e0414d770 2024-04-18T04:44:28.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.618+0000 7f3e03200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0406c1d0 con 0x7f3e0406c660 2024-04-18T04:44:28.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.618+0000 7f3e01e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3de80047d0 0x7f3e0415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:28.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.618+0000 7f3e01e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3de80047d0 0x7f3e0415af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46720/0 (socket says 172.21.15.120:46720) 2024-04-18T04:44:28.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.618+0000 7f3e01e00640 1 -- 172.21.15.120:0/2127581340 learned_addr learned my addr 172.21.15.120:0/2127581340 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:28.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.618+0000 7f3dfbe00640 1 --2- 172.21.15.120:0/2127581340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e0414d770 0x7f3e041583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:28.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.618+0000 7f3e02800640 1 --2- 172.21.15.120:0/2127581340 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3e0406c660 0x7f3e0406cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:28.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.618+0000 7f3e01e00640 1 -- 172.21.15.120:0/2127581340 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3e0406c660 msgr2=0x7f3e0406cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:28.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.618+0000 7f3e01e00640 1 --2- 172.21.15.120:0/2127581340 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3e0406c660 0x7f3e0406cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:28.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.618+0000 7f3e01e00640 1 -- 172.21.15.120:0/2127581340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e0414d770 msgr2=0x7f3e041583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:28.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.618+0000 7f3e01e00640 1 --2- 172.21.15.120:0/2127581340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e0414d770 0x7f3e041583c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:28.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.618+0000 7f3e01e00640 1 -- 172.21.15.120:0/2127581340 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e0415b640 con 0x7f3de80047d0 2024-04-18T04:44:28.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.618+0000 7f3dfbe00640 1 --2- 172.21.15.120:0/2127581340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e0414d770 0x7f3e041583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:44:28.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.618+0000 7f3e01e00640 1 --2- 172.21.15.120:0/2127581340 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3de80047d0 0x7f3e0415af00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3df4009fd0 tx=0x7f3df4011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:28.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.618+0000 7f3dfa000640 1 -- 172.21.15.120:0/2127581340 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df4004220 con 0x7f3de80047d0 2024-04-18T04:44:28.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.618+0000 7f3dfa000640 1 -- 172.21.15.120:0/2127581340 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df4004380 con 0x7f3de80047d0 2024-04-18T04:44:28.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.618+0000 7f3dfa000640 1 -- 172.21.15.120:0/2127581340 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df4015890 con 0x7f3de80047d0 2024-04-18T04:44:28.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.618+0000 7f3e03200640 1 -- 172.21.15.120:0/2127581340 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e0406b5c0 con 0x7f3de80047d0 2024-04-18T04:44:28.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.618+0000 7f3e03200640 1 -- 172.21.15.120:0/2127581340 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e0406bb80 con 0x7f3de80047d0 2024-04-18T04:44:28.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.618+0000 7f3e03200640 1 -- 172.21.15.120:0/2127581340 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e04072960 con 0x7f3de80047d0 2024-04-18T04:44:28.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.622+0000 7f3dfa000640 1 -- 172.21.15.120:0/2127581340 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3df40159f0 con 0x7f3de80047d0 2024-04-18T04:44:28.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.622+0000 7f3dfa000640 1 --2- 172.21.15.120:0/2127581340 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3de0066690 0x7f3de0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:28.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.622+0000 7f3dfa000640 1 -- 172.21.15.120:0/2127581340 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3df4084290 con 0x7f3de80047d0 2024-04-18T04:44:28.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.622+0000 7f3dfbe00640 1 --2- 172.21.15.120:0/2127581340 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3de0066690 0x7f3de0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:28.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.622+0000 7f3dfbe00640 1 --2- 172.21.15.120:0/2127581340 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3de0066690 0x7f3de0068b50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3dec0aa000 tx=0x7f3e040c4200 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:28.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.626+0000 7f3dfa000640 1 -- 172.21.15.120:0/2127581340 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f3df4051930 con 0x7f3de80047d0 2024-04-18T04:44:28.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.778+0000 7f3e03200640 1 -- 172.21.15.120:0/2127581340 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f3e0406ddb0 con 0x7f3de80047d0 2024-04-18T04:44:28.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.850+0000 7f3dfa000640 1 -- 172.21.15.120:0/2127581340 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3df4054f50 con 0x7f3de80047d0 2024-04-18T04:44:28.848 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_metadata' created 2024-04-18T04:44:28.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.854+0000 7f3e03200640 1 -- 172.21.15.120:0/2127581340 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3de0066690 msgr2=0x7f3de0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:28.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.854+0000 7f3e03200640 1 --2- 172.21.15.120:0/2127581340 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3de0066690 0x7f3de0068b50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3dec0aa000 tx=0x7f3e040c4200 comp rx=0 tx=0).stop 2024-04-18T04:44:28.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.854+0000 7f3e03200640 1 -- 172.21.15.120:0/2127581340 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3de80047d0 msgr2=0x7f3e0415af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:28.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.854+0000 7f3e03200640 1 --2- 172.21.15.120:0/2127581340 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3de80047d0 0x7f3e0415af00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3df4009fd0 tx=0x7f3df4011a60 comp rx=0 tx=0).stop 2024-04-18T04:44:28.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.854+0000 7f3e03200640 1 -- 172.21.15.120:0/2127581340 shutdown_connections 2024-04-18T04:44:28.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.854+0000 7f3e03200640 1 --2- 172.21.15.120:0/2127581340 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3de0066690 0x7f3de0068b50 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:28.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.854+0000 7f3e03200640 1 --2- 172.21.15.120:0/2127581340 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3e0406c660 0x7f3e0406cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:28.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.854+0000 7f3e03200640 1 --2- 172.21.15.120:0/2127581340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e0414d770 0x7f3e041583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:28.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.854+0000 7f3e03200640 1 --2- 172.21.15.120:0/2127581340 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3de80047d0 0x7f3e0415af00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:28.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.854+0000 7f3e03200640 1 -- 172.21.15.120:0/2127581340 >> 172.21.15.120:0/2127581340 conn(0x7f3e040cce70 msgr2=0x7f3e0414ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:28.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.854+0000 7f3e03200640 1 -- 172.21.15.120:0/2127581340 shutdown_connections 2024-04-18T04:44:28.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:28.854+0000 7f3e03200640 1 -- 172.21.15.120:0/2127581340 wait complete. 2024-04-18T04:44:28.875 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-18T04:44:29.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.022+0000 7f155fc00640 1 Processor -- start 2024-04-18T04:44:29.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.022+0000 7f155fc00640 1 -- start start 2024-04-18T04:44:29.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.022+0000 7f155fc00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f155806afd0 0x7f155806b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:29.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.022+0000 7f155fc00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1558159c60 0x7f1558163e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:29.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.022+0000 7f155fc00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f155806df90 con 0x7f15580c3f30 2024-04-18T04:44:29.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.022+0000 7f155fc00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f155806b8f0 con 0x7f1558159c60 2024-04-18T04:44:29.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.022+0000 7f155fc00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f155806eef0 con 0x7f155806afd0 2024-04-18T04:44:29.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.022+0000 7f155d200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f155806afd0 0x7f155806b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:29.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.022+0000 7f155dc00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1558159c60 0x7f1558163e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:29.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.022+0000 7f154fe00640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f15580c3f30 0x7f1558159550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:45162/0 (socket says 172.21.15.120:45162) 2024-04-18T04:44:29.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.022+0000 7f154fe00640 1 -- 172.21.15.120:0/3125228844 learned_addr learned my addr 172.21.15.120:0/3125228844 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:44:29.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.022+0000 7f155d200640 1 -- 172.21.15.120:0/3125228844 >> v2:172.21.15.132:3300/0 conn(0x7f1558159c60 msgr2=0x7f1558163e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:29.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.022+0000 7f155d200640 1 --2- 172.21.15.120:0/3125228844 >> v2:172.21.15.132:3300/0 conn(0x7f1558159c60 0x7f1558163e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:29.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.022+0000 7f155d200640 1 -- 172.21.15.120:0/3125228844 >> v1:172.21.15.132:6789/0 conn(0x7f15580c3f30 legacy=0x7f1558159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:29.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.022+0000 7f155d200640 1 -- 172.21.15.120:0/3125228844 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155806e1c0 con 0x7f155806afd0 2024-04-18T04:44:29.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.022+0000 7f155dc00640 1 --2- 172.21.15.120:0/3125228844 >> v2:172.21.15.132:3300/0 conn(0x7f1558159c60 0x7f1558163e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:44:29.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.026+0000 7f155d200640 1 --2- 172.21.15.120:0/3125228844 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f155806afd0 0x7f155806b3b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f15480097f0 tx=0x7f154801ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acc5c31a240371ed server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:29.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.026+0000 7f1557e00640 1 -- 172.21.15.120:0/3125228844 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15480a8990 con 0x7f155806afd0 2024-04-18T04:44:29.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.026+0000 7f1557e00640 1 -- 172.21.15.120:0/3125228844 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15480a8af0 con 0x7f155806afd0 2024-04-18T04:44:29.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.026+0000 7f1557e00640 1 -- 172.21.15.120:0/3125228844 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15480a8e80 con 0x7f155806afd0 2024-04-18T04:44:29.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.026+0000 7f155fc00640 1 -- 172.21.15.120:0/3125228844 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f155806afd0 msgr2=0x7f155806b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:29.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.026+0000 7f155fc00640 1 --2- 172.21.15.120:0/3125228844 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f155806afd0 0x7f155806b3b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f15480097f0 tx=0x7f154801ec90 comp rx=0 tx=0).stop 2024-04-18T04:44:29.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.026+0000 7f155fc00640 1 -- 172.21.15.120:0/3125228844 shutdown_connections 2024-04-18T04:44:29.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.026+0000 7f155fc00640 1 --2- 172.21.15.120:0/3125228844 >> v2:172.21.15.132:3300/0 conn(0x7f1558159c60 0x7f1558163e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:29.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.026+0000 7f155fc00640 1 --2- 172.21.15.120:0/3125228844 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f155806afd0 0x7f155806b3b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:29.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.026+0000 7f155fc00640 1 -- 172.21.15.120:0/3125228844 >> 172.21.15.120:0/3125228844 conn(0x7f1558072190 msgr2=0x7f1558065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:29.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.026+0000 7f155fc00640 1 -- 172.21.15.120:0/3125228844 shutdown_connections 2024-04-18T04:44:29.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.026+0000 7f155fc00640 1 -- 172.21.15.120:0/3125228844 wait complete. 2024-04-18T04:44:29.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.030+0000 7f155fc00640 1 Processor -- start 2024-04-18T04:44:29.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.030+0000 7f155fc00640 1 -- start start 2024-04-18T04:44:29.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.030+0000 7f155fc00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f155806afd0 0x7f15581581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:29.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.030+0000 7f155fc00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f15580c3f30 0x7f1558151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:29.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.030+0000 7f155fc00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15581e63a0 0x7f15581f28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:29.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.030+0000 7f155fc00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15581577e0 con 0x7f155806afd0 2024-04-18T04:44:29.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.030+0000 7f155fc00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1558151a90 con 0x7f15581e63a0 2024-04-18T04:44:29.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.030+0000 7f155fc00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15581f23d0 con 0x7f15580c3f30 2024-04-18T04:44:29.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.030+0000 7f155d200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f155806afd0 0x7f15581581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:29.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.030+0000 7f155d200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f155806afd0 0x7f15581581d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46734/0 (socket says 172.21.15.120:46734) 2024-04-18T04:44:29.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.030+0000 7f155d200640 1 -- 172.21.15.120:0/675585437 learned_addr learned my addr 172.21.15.120:0/675585437 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:29.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.030+0000 7f155dc00640 1 --2- 172.21.15.120:0/675585437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15581e63a0 0x7f15581f28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:29.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.030+0000 7f154fe00640 1 --2- 172.21.15.120:0/675585437 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f15580c3f30 0x7f1558151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:29.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.030+0000 7f155d200640 1 -- 172.21.15.120:0/675585437 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f15580c3f30 msgr2=0x7f1558151550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:29.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.030+0000 7f155d200640 1 --2- 172.21.15.120:0/675585437 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f15580c3f30 0x7f1558151550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:29.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.030+0000 7f155d200640 1 -- 172.21.15.120:0/675585437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15581e63a0 msgr2=0x7f15581f28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:29.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.030+0000 7f155d200640 1 --2- 172.21.15.120:0/675585437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15581e63a0 0x7f15581f28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:29.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.030+0000 7f155d200640 1 -- 172.21.15.120:0/675585437 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1550009a70 con 0x7f155806afd0 2024-04-18T04:44:29.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.030+0000 7f155d200640 1 --2- 172.21.15.120:0/675585437 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f155806afd0 0x7f15581581d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f154801d340 tx=0x7f154801ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:29.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.030+0000 7f1555600640 1 -- 172.21.15.120:0/675585437 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15480b0dd0 con 0x7f155806afd0 2024-04-18T04:44:29.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.030+0000 7f1555600640 1 -- 172.21.15.120:0/675585437 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1548006e20 con 0x7f155806afd0 2024-04-18T04:44:29.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.030+0000 7f155fc00640 1 -- 172.21.15.120:0/675585437 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1548009420 con 0x7f155806afd0 2024-04-18T04:44:29.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.030+0000 7f1555600640 1 -- 172.21.15.120:0/675585437 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15480b9670 con 0x7f155806afd0 2024-04-18T04:44:29.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.030+0000 7f155fc00640 1 -- 172.21.15.120:0/675585437 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1558150780 con 0x7f155806afd0 2024-04-18T04:44:29.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.034+0000 7f155fc00640 1 -- 172.21.15.120:0/675585437 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15581f2590 con 0x7f155806afd0 2024-04-18T04:44:29.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.034+0000 7f1555600640 1 -- 172.21.15.120:0/675585437 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f15480b7040 con 0x7f155806afd0 2024-04-18T04:44:29.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.034+0000 7f1555600640 1 --2- 172.21.15.120:0/675585437 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f15340666c0 0x7f1534068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:29.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.034+0000 7f1555600640 1 -- 172.21.15.120:0/675585437 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f15481223c0 con 0x7f155806afd0 2024-04-18T04:44:29.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.034+0000 7f154fe00640 1 --2- 172.21.15.120:0/675585437 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f15340666c0 0x7f1534068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:29.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.038+0000 7f154fe00640 1 --2- 172.21.15.120:0/675585437 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f15340666c0 0x7f1534068b80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f155814bc00 tx=0x7f1540009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:29.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.038+0000 7f1555600640 1 -- 172.21.15.120:0/675585437 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f15480ef8f0 con 0x7f155806afd0 2024-04-18T04:44:29.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.202+0000 7f155fc00640 1 -- 172.21.15.120:0/675585437 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f15580729d0 con 0x7f155806afd0 2024-04-18T04:44:29.359 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:44:29.363 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:44:29.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.858+0000 7f1555600640 1 -- 172.21.15.120:0/675585437 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) v1 ==== 171+0+0 (secure 0 0 0) 0x7f15480f2f10 con 0x7f155806afd0 2024-04-18T04:44:29.857 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_data' created 2024-04-18T04:44:29.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.862+0000 7f155fc00640 1 -- 172.21.15.120:0/675585437 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f15340666c0 msgr2=0x7f1534068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:29.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.862+0000 7f155fc00640 1 --2- 172.21.15.120:0/675585437 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f15340666c0 0x7f1534068b80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f155814bc00 tx=0x7f1540009040 comp rx=0 tx=0).stop 2024-04-18T04:44:29.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.862+0000 7f155fc00640 1 -- 172.21.15.120:0/675585437 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f155806afd0 msgr2=0x7f15581581d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:29.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.862+0000 7f155fc00640 1 --2- 172.21.15.120:0/675585437 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f155806afd0 0x7f15581581d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f154801d340 tx=0x7f154801ba30 comp rx=0 tx=0).stop 2024-04-18T04:44:29.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.866+0000 7f155fc00640 1 -- 172.21.15.120:0/675585437 shutdown_connections 2024-04-18T04:44:29.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.866+0000 7f155fc00640 1 --2- 172.21.15.120:0/675585437 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f15340666c0 0x7f1534068b80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:29.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.866+0000 7f155fc00640 1 --2- 172.21.15.120:0/675585437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15581e63a0 0x7f15581f28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:29.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.866+0000 7f155fc00640 1 --2- 172.21.15.120:0/675585437 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f15580c3f30 0x7f1558151550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:29.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.866+0000 7f155fc00640 1 --2- 172.21.15.120:0/675585437 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f155806afd0 0x7f15581581d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:29.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.866+0000 7f155fc00640 1 -- 172.21.15.120:0/675585437 >> 172.21.15.120:0/675585437 conn(0x7f1558072190 msgr2=0x7f1558152920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:29.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.866+0000 7f155fc00640 1 -- 172.21.15.120:0/675585437 shutdown_connections 2024-04-18T04:44:29.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:29.866+0000 7f155fc00640 1 -- 172.21.15.120:0/675585437 wait complete. 2024-04-18T04:44:29.902 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-18T04:44:30.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.042+0000 7fbc1be00640 1 Processor -- start 2024-04-18T04:44:30.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.042+0000 7fbc1be00640 1 -- start start 2024-04-18T04:44:30.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.046+0000 7fbc1be00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbc1c06e050 0x7fbc1c157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:30.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.046+0000 7fbc1be00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fbc1c06d1e0 0x7fbc1c0c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:30.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.046+0000 7fbc1be00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc1c06de30 con 0x7fbc1c1516a0 2024-04-18T04:44:30.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.046+0000 7fbc1be00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc1c06d650 con 0x7fbc1c06d1e0 2024-04-18T04:44:30.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.046+0000 7fbc1be00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc1c157a50 con 0x7fbc1c06e050 2024-04-18T04:44:30.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.046+0000 7fbc1b400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fbc1c06d1e0 0x7fbc1c0c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:30.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.046+0000 7fbc1aa00640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fbc1c1516a0 0x7fbc1c0c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:49888/0 (socket says 172.21.15.120:49888) 2024-04-18T04:44:30.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.046+0000 7fbc1aa00640 1 -- 172.21.15.120:0/3983241071 learned_addr learned my addr 172.21.15.120:0/3983241071 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:44:30.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.046+0000 7fbc1a000640 1 --2- 172.21.15.120:0/3983241071 >> v2:172.21.15.132:3300/0 conn(0x7fbc1c06e050 0x7fbc1c157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:30.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.046+0000 7fbc1b400640 1 -- 172.21.15.120:0/3983241071 >> v2:172.21.15.132:3300/0 conn(0x7fbc1c06e050 msgr2=0x7fbc1c157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:30.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.046+0000 7fbc1b400640 1 --2- 172.21.15.120:0/3983241071 >> v2:172.21.15.132:3300/0 conn(0x7fbc1c06e050 0x7fbc1c157ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:30.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.046+0000 7fbc1b400640 1 -- 172.21.15.120:0/3983241071 >> v1:172.21.15.120:6789/0 conn(0x7fbc1c1516a0 legacy=0x7fbc1c0c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:30.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.046+0000 7fbc1b400640 1 -- 172.21.15.120:0/3983241071 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc1c06d870 con 0x7fbc1c06d1e0 2024-04-18T04:44:30.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.046+0000 7fbc19600640 1 -- 172.21.15.120:0/3983241071 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4107755339 0 0) 0x7fbc1c06de30 con 0x7fbc1c1516a0 2024-04-18T04:44:30.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.046+0000 7fbc1b400640 1 --2- 172.21.15.120:0/3983241071 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc1c06d1e0 0x7fbc1c0c86d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c0686e0 tx=0x7fbc1401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=950375f1d85d5259 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:30.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.050+0000 7fbc19600640 1 -- 172.21.15.120:0/3983241071 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc140ab680 con 0x7fbc1c06d1e0 2024-04-18T04:44:30.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.050+0000 7fbc19600640 1 -- 172.21.15.120:0/3983241071 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc140ab7e0 con 0x7fbc1c06d1e0 2024-04-18T04:44:30.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.050+0000 7fbc19600640 1 -- 172.21.15.120:0/3983241071 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc140abb70 con 0x7fbc1c06d1e0 2024-04-18T04:44:30.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.050+0000 7fbc1be00640 1 -- 172.21.15.120:0/3983241071 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc1c06d1e0 msgr2=0x7fbc1c0c86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:30.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.050+0000 7fbc1be00640 1 --2- 172.21.15.120:0/3983241071 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc1c06d1e0 0x7fbc1c0c86d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c0686e0 tx=0x7fbc1401c480 comp rx=0 tx=0).stop 2024-04-18T04:44:30.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.050+0000 7fbc1be00640 1 -- 172.21.15.120:0/3983241071 shutdown_connections 2024-04-18T04:44:30.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.050+0000 7fbc1be00640 1 --2- 172.21.15.120:0/3983241071 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc1c06d1e0 0x7fbc1c0c86d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:30.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.050+0000 7fbc1be00640 1 --2- 172.21.15.120:0/3983241071 >> v2:172.21.15.132:3300/0 conn(0x7fbc1c06e050 0x7fbc1c157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:30.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.050+0000 7fbc1be00640 1 -- 172.21.15.120:0/3983241071 >> 172.21.15.120:0/3983241071 conn(0x7fbc1c0ccde0 msgr2=0x7fbc1c0cd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:30.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.050+0000 7fbc1be00640 1 -- 172.21.15.120:0/3983241071 shutdown_connections 2024-04-18T04:44:30.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.050+0000 7fbc1be00640 1 -- 172.21.15.120:0/3983241071 wait complete. 2024-04-18T04:44:30.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.050+0000 7fbc1be00640 1 Processor -- start 2024-04-18T04:44:30.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.050+0000 7fbc1be00640 1 -- start start 2024-04-18T04:44:30.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.050+0000 7fbc1be00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbc1c06d1e0 0x7fbc1c14c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:30.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.050+0000 7fbc1be00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc1c06e050 0x7fbc1c156360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:30.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.050+0000 7fbc1be00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc1c1516a0 0x7fbc1c1f4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:30.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.050+0000 7fbc1be00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc1c1543e0 con 0x7fbc1c1516a0 2024-04-18T04:44:30.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.050+0000 7fbc1be00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc1c1f5e30 con 0x7fbc1c06e050 2024-04-18T04:44:30.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.050+0000 7fbc1be00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc1c14c3b0 con 0x7fbc1c06d1e0 2024-04-18T04:44:30.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.050+0000 7fbc1b400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc1c1516a0 0x7fbc1c1f4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:30.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.050+0000 7fbc1b400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc1c1516a0 0x7fbc1c1f4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46752/0 (socket says 172.21.15.120:46752) 2024-04-18T04:44:30.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.050+0000 7fbc1b400640 1 -- 172.21.15.120:0/764510387 learned_addr learned my addr 172.21.15.120:0/764510387 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:30.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.050+0000 7fbc1a000640 1 --2- 172.21.15.120:0/764510387 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc1c06e050 0x7fbc1c156360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:30.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.050+0000 7fbc1aa00640 1 --2- 172.21.15.120:0/764510387 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbc1c06d1e0 0x7fbc1c14c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:30.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.054+0000 7fbc1b400640 1 -- 172.21.15.120:0/764510387 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbc1c06d1e0 msgr2=0x7fbc1c14c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:30.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.054+0000 7fbc1b400640 1 --2- 172.21.15.120:0/764510387 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbc1c06d1e0 0x7fbc1c14c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:30.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.054+0000 7fbc1b400640 1 -- 172.21.15.120:0/764510387 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc1c06e050 msgr2=0x7fbc1c156360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:30.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.054+0000 7fbc1b400640 1 --2- 172.21.15.120:0/764510387 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc1c06e050 0x7fbc1c156360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:30.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.054+0000 7fbc1b400640 1 -- 172.21.15.120:0/764510387 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc14009420 con 0x7fbc1c1516a0 2024-04-18T04:44:30.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.054+0000 7fbc1b400640 1 --2- 172.21.15.120:0/764510387 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc1c1516a0 0x7fbc1c1f4900 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbc140ad040 tx=0x7fbc1401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:30.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.054+0000 7fbc12a00640 1 -- 172.21.15.120:0/764510387 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc140bf610 con 0x7fbc1c1516a0 2024-04-18T04:44:30.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.054+0000 7fbc12a00640 1 -- 172.21.15.120:0/764510387 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc140bf770 con 0x7fbc1c1516a0 2024-04-18T04:44:30.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.054+0000 7fbc12a00640 1 -- 172.21.15.120:0/764510387 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc140bfb20 con 0x7fbc1c1516a0 2024-04-18T04:44:30.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.054+0000 7fbc1be00640 1 -- 172.21.15.120:0/764510387 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc1c1f6340 con 0x7fbc1c1516a0 2024-04-18T04:44:30.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.054+0000 7fbc1be00640 1 -- 172.21.15.120:0/764510387 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc1c14ba80 con 0x7fbc1c1516a0 2024-04-18T04:44:30.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.054+0000 7fbc1be00640 1 -- 172.21.15.120:0/764510387 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc1c14c560 con 0x7fbc1c1516a0 2024-04-18T04:44:30.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.054+0000 7fbc12a00640 1 -- 172.21.15.120:0/764510387 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbc140bfc80 con 0x7fbc1c1516a0 2024-04-18T04:44:30.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.054+0000 7fbc12a00640 1 --2- 172.21.15.120:0/764510387 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fbbfc066690 0x7fbbfc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:30.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.054+0000 7fbc12a00640 1 -- 172.21.15.120:0/764510387 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fbc1411ec70 con 0x7fbc1c1516a0 2024-04-18T04:44:30.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.054+0000 7fbc1aa00640 1 --2- 172.21.15.120:0/764510387 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fbbfc066690 0x7fbbfc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:30.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.058+0000 7fbc1aa00640 1 --2- 172.21.15.120:0/764510387 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fbbfc066690 0x7fbbfc068b50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c0012f0 tx=0x7fbc0c001690 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:30.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.058+0000 7fbc12a00640 1 -- 172.21.15.120:0/764510387 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fbc140ec050 con 0x7fbc1c1516a0 2024-04-18T04:44:30.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.250+0000 7fbc1be00640 1 -- 172.21.15.120:0/764510387 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fbc1c0728f0 con 0x7fbc1c1516a0 2024-04-18T04:44:30.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.254+0000 7fbc12a00640 1 -- 172.21.15.120:0/764510387 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fbc140ef670 con 0x7fbc1c1516a0 2024-04-18T04:44:30.258 INFO:teuthology.orchestra.run.smithi120.stderr:new fs with metadata pool 2 and data pool 3 2024-04-18T04:44:30.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.258+0000 7fbc1be00640 1 -- 172.21.15.120:0/764510387 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fbbfc066690 msgr2=0x7fbbfc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:30.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.258+0000 7fbc1be00640 1 --2- 172.21.15.120:0/764510387 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fbbfc066690 0x7fbbfc068b50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c0012f0 tx=0x7fbc0c001690 comp rx=0 tx=0).stop 2024-04-18T04:44:30.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.258+0000 7fbc1be00640 1 -- 172.21.15.120:0/764510387 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc1c1516a0 msgr2=0x7fbc1c1f4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:30.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.258+0000 7fbc1be00640 1 --2- 172.21.15.120:0/764510387 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc1c1516a0 0x7fbc1c1f4900 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbc140ad040 tx=0x7fbc1401acc0 comp rx=0 tx=0).stop 2024-04-18T04:44:30.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.258+0000 7fbc1be00640 1 -- 172.21.15.120:0/764510387 shutdown_connections 2024-04-18T04:44:30.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.258+0000 7fbc1be00640 1 --2- 172.21.15.120:0/764510387 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fbbfc066690 0x7fbbfc068b50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:30.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.258+0000 7fbc1be00640 1 --2- 172.21.15.120:0/764510387 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc1c1516a0 0x7fbc1c1f4900 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:30.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.258+0000 7fbc1be00640 1 --2- 172.21.15.120:0/764510387 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc1c06e050 0x7fbc1c156360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:30.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.258+0000 7fbc1be00640 1 --2- 172.21.15.120:0/764510387 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbc1c06d1e0 0x7fbc1c14c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:30.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.258+0000 7fbc1be00640 1 -- 172.21.15.120:0/764510387 >> 172.21.15.120:0/764510387 conn(0x7fbc1c0ccde0 msgr2=0x7fbc1c0c7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:30.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.258+0000 7fbc1be00640 1 -- 172.21.15.120:0/764510387 shutdown_connections 2024-04-18T04:44:30.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.258+0000 7fbc1be00640 1 -- 172.21.15.120:0/764510387 wait complete. 2024-04-18T04:44:30.290 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-18T04:44:30.291 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-18T04:44:30.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.434+0000 7efd79200640 1 Processor -- start 2024-04-18T04:44:30.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.438+0000 7efd79200640 1 -- start start 2024-04-18T04:44:30.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.438+0000 7efd79200640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7efd74150240 0x7efd7406f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:30.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.438+0000 7efd79200640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7efd74159f00 0x7efd7406afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:30.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.438+0000 7efd79200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efd7406b510 0x7efd7406e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:30.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.438+0000 7efd79200640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd7406c890 con 0x7efd74159f00 2024-04-18T04:44:30.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.438+0000 7efd79200640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd7406dcd0 con 0x7efd74150240 2024-04-18T04:44:30.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.438+0000 7efd79200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd74150620 con 0x7efd7406b510 2024-04-18T04:44:30.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.438+0000 7efd6aa00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7efd74159f00 0x7efd7406afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:30.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.438+0000 7efd6aa00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7efd74159f00 0x7efd7406afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46758/0 (socket says 172.21.15.120:46758) 2024-04-18T04:44:30.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.438+0000 7efd6aa00640 1 -- 172.21.15.120:0/2480932678 learned_addr learned my addr 172.21.15.120:0/2480932678 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:30.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.438+0000 7efd73e00640 1 --2- 172.21.15.120:0/2480932678 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efd7406b510 0x7efd7406e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:30.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.438+0000 7efd73400640 1 --2- 172.21.15.120:0/2480932678 >> v2:172.21.15.132:3300/0 conn(0x7efd74150240 0x7efd7406f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:30.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.438+0000 7efd6aa00640 1 -- 172.21.15.120:0/2480932678 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efd7406b510 msgr2=0x7efd7406e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:30.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.438+0000 7efd6aa00640 1 --2- 172.21.15.120:0/2480932678 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efd7406b510 0x7efd7406e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:30.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.438+0000 7efd6aa00640 1 -- 172.21.15.120:0/2480932678 >> v2:172.21.15.132:3300/0 conn(0x7efd74150240 msgr2=0x7efd7406f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:30.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.438+0000 7efd6aa00640 1 --2- 172.21.15.120:0/2480932678 >> v2:172.21.15.132:3300/0 conn(0x7efd74150240 0x7efd7406f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:30.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.438+0000 7efd6aa00640 1 -- 172.21.15.120:0/2480932678 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd7406f830 con 0x7efd74159f00 2024-04-18T04:44:30.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.442+0000 7efd6aa00640 1 --2- 172.21.15.120:0/2480932678 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd74159f00 0x7efd7406afd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efd74067bc0 tx=0x7efd5c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb3c4a119957be84 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:30.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.442+0000 7efd72a00640 1 -- 172.21.15.120:0/2480932678 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c0a89d0 con 0x7efd74159f00 2024-04-18T04:44:30.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.442+0000 7efd72a00640 1 -- 172.21.15.120:0/2480932678 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5c0a8b30 con 0x7efd74159f00 2024-04-18T04:44:30.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.442+0000 7efd72a00640 1 -- 172.21.15.120:0/2480932678 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c0b0440 con 0x7efd74159f00 2024-04-18T04:44:30.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.442+0000 7efd79200640 1 -- 172.21.15.120:0/2480932678 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd74159f00 msgr2=0x7efd7406afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:30.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.442+0000 7efd79200640 1 --2- 172.21.15.120:0/2480932678 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd74159f00 0x7efd7406afd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efd74067bc0 tx=0x7efd5c01ed10 comp rx=0 tx=0).stop 2024-04-18T04:44:30.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.442+0000 7efd79200640 1 -- 172.21.15.120:0/2480932678 shutdown_connections 2024-04-18T04:44:30.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.442+0000 7efd79200640 1 --2- 172.21.15.120:0/2480932678 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efd7406b510 0x7efd7406e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:30.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.442+0000 7efd79200640 1 --2- 172.21.15.120:0/2480932678 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd74159f00 0x7efd7406afd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:30.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.442+0000 7efd79200640 1 --2- 172.21.15.120:0/2480932678 >> v2:172.21.15.132:3300/0 conn(0x7efd74150240 0x7efd7406f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:30.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.442+0000 7efd79200640 1 -- 172.21.15.120:0/2480932678 >> 172.21.15.120:0/2480932678 conn(0x7efd740cce70 msgr2=0x7efd740cd280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:30.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.442+0000 7efd79200640 1 -- 172.21.15.120:0/2480932678 shutdown_connections 2024-04-18T04:44:30.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.442+0000 7efd79200640 1 -- 172.21.15.120:0/2480932678 wait complete. 2024-04-18T04:44:30.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.442+0000 7efd79200640 1 Processor -- start 2024-04-18T04:44:30.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.442+0000 7efd79200640 1 -- start start 2024-04-18T04:44:30.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.446+0000 7efd79200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd7406b510 0x7efd741f26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:30.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.446+0000 7efd79200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd74150240 0x7efd741f2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:30.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.446+0000 7efd79200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efd74159f00 0x7efd7415bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:30.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.446+0000 7efd79200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7415bb80 con 0x7efd7406b510 2024-04-18T04:44:30.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.446+0000 7efd79200640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7415b550 con 0x7efd74150240 2024-04-18T04:44:30.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.446+0000 7efd79200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd74067270 con 0x7efd74159f00 2024-04-18T04:44:30.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.446+0000 7efd73400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd7406b510 0x7efd741f26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:30.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.446+0000 7efd73400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd7406b510 0x7efd741f26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46762/0 (socket says 172.21.15.120:46762) 2024-04-18T04:44:30.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.446+0000 7efd73400640 1 -- 172.21.15.120:0/2561342584 learned_addr learned my addr 172.21.15.120:0/2561342584 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:30.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.446+0000 7efd6aa00640 1 --2- 172.21.15.120:0/2561342584 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd74150240 0x7efd741f2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:30.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.446+0000 7efd73e00640 1 --2- 172.21.15.120:0/2561342584 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efd74159f00 0x7efd7415bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:30.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.446+0000 7efd73400640 1 -- 172.21.15.120:0/2561342584 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efd74159f00 msgr2=0x7efd7415bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:30.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.446+0000 7efd73400640 1 --2- 172.21.15.120:0/2561342584 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efd74159f00 0x7efd7415bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:30.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.446+0000 7efd73400640 1 -- 172.21.15.120:0/2561342584 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd74150240 msgr2=0x7efd741f2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:30.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.446+0000 7efd73400640 1 --2- 172.21.15.120:0/2561342584 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd74150240 0x7efd741f2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:30.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.446+0000 7efd73400640 1 -- 172.21.15.120:0/2561342584 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5c0094d0 con 0x7efd7406b510 2024-04-18T04:44:30.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.446+0000 7efd6aa00640 1 --2- 172.21.15.120:0/2561342584 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd74150240 0x7efd741f2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:44:30.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.446+0000 7efd73e00640 1 --2- 172.21.15.120:0/2561342584 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efd74159f00 0x7efd7415bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:44:30.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.446+0000 7efd73400640 1 --2- 172.21.15.120:0/2561342584 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd7406b510 0x7efd741f26d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efd64007f20 tx=0x7efd6400e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:30.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.446+0000 7efd6be00640 1 -- 172.21.15.120:0/2561342584 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd64014620 con 0x7efd7406b510 2024-04-18T04:44:30.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.446+0000 7efd6be00640 1 -- 172.21.15.120:0/2561342584 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd64014780 con 0x7efd7406b510 2024-04-18T04:44:30.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.446+0000 7efd79200640 1 -- 172.21.15.120:0/2561342584 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd741f32d0 con 0x7efd7406b510 2024-04-18T04:44:30.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.446+0000 7efd6be00640 1 -- 172.21.15.120:0/2561342584 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd64014b30 con 0x7efd7406b510 2024-04-18T04:44:30.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.446+0000 7efd79200640 1 -- 172.21.15.120:0/2561342584 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd7415b0e0 con 0x7efd7406b510 2024-04-18T04:44:30.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.446+0000 7efd79200640 1 -- 172.21.15.120:0/2561342584 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd74072960 con 0x7efd7406b510 2024-04-18T04:44:30.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.446+0000 7efd6be00640 1 -- 172.21.15.120:0/2561342584 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efd64014c90 con 0x7efd7406b510 2024-04-18T04:44:30.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.450+0000 7efd6be00640 1 --2- 172.21.15.120:0/2561342584 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7efd50066690 0x7efd50068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:30.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.450+0000 7efd6be00640 1 -- 172.21.15.120:0/2561342584 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efd64084b60 con 0x7efd7406b510 2024-04-18T04:44:30.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.450+0000 7efd6aa00640 1 --2- 172.21.15.120:0/2561342584 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7efd50066690 0x7efd50068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:30.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.450+0000 7efd6aa00640 1 --2- 172.21.15.120:0/2561342584 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7efd50066690 0x7efd50068b50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efd5c0b2000 tx=0x7efd5c0aa070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:30.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.450+0000 7efd6be00640 1 -- 172.21.15.120:0/2561342584 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7efd64051ec0 con 0x7efd7406b510 2024-04-18T04:44:30.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:30.614+0000 7efd79200640 1 -- 172.21.15.120:0/2561342584 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7efd7415b3c0 con 0x7efd7406b510 2024-04-18T04:44:31.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.266+0000 7efd6be00640 1 -- 172.21.15.120:0/2561342584 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) v1 ==== 157+0+0 (secure 0 0 0) 0x7efd640554e0 con 0x7efd7406b510 2024-04-18T04:44:31.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.266+0000 7efd79200640 1 -- 172.21.15.120:0/2561342584 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7efd50066690 msgr2=0x7efd50068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:31.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.266+0000 7efd79200640 1 --2- 172.21.15.120:0/2561342584 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7efd50066690 0x7efd50068b50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efd5c0b2000 tx=0x7efd5c0aa070 comp rx=0 tx=0).stop 2024-04-18T04:44:31.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.266+0000 7efd79200640 1 -- 172.21.15.120:0/2561342584 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd7406b510 msgr2=0x7efd741f26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:31.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.266+0000 7efd79200640 1 --2- 172.21.15.120:0/2561342584 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd7406b510 0x7efd741f26d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efd64007f20 tx=0x7efd6400e570 comp rx=0 tx=0).stop 2024-04-18T04:44:31.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.266+0000 7efd79200640 1 -- 172.21.15.120:0/2561342584 shutdown_connections 2024-04-18T04:44:31.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.266+0000 7efd79200640 1 --2- 172.21.15.120:0/2561342584 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7efd50066690 0x7efd50068b50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:31.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.266+0000 7efd79200640 1 --2- 172.21.15.120:0/2561342584 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efd74159f00 0x7efd7415bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:31.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.266+0000 7efd79200640 1 --2- 172.21.15.120:0/2561342584 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd74150240 0x7efd741f2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:31.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.266+0000 7efd79200640 1 --2- 172.21.15.120:0/2561342584 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd7406b510 0x7efd741f26d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:31.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.266+0000 7efd79200640 1 -- 172.21.15.120:0/2561342584 >> 172.21.15.120:0/2561342584 conn(0x7efd740cce70 msgr2=0x7efd740cc460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:31.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.266+0000 7efd79200640 1 -- 172.21.15.120:0/2561342584 shutdown_connections 2024-04-18T04:44:31.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.266+0000 7efd79200640 1 -- 172.21.15.120:0/2561342584 wait complete. 2024-04-18T04:44:31.285 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-18T04:44:31.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.434+0000 7fdf0ae00640 1 Processor -- start 2024-04-18T04:44:31.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.434+0000 7fdf0ae00640 1 -- start start 2024-04-18T04:44:31.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.434+0000 7fdf0ae00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdf040cb710 0x7fdf04065bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:31.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.434+0000 7fdf0ae00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf04066270 con 0x7fdf040cbaf0 2024-04-18T04:44:31.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.434+0000 7fdf0ae00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf0406b7d0 con 0x7fdf040c7f10 2024-04-18T04:44:31.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.434+0000 7fdf0ae00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf041596e0 con 0x7fdf040cb710 2024-04-18T04:44:31.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.434+0000 7fdf03400640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fdf040cbaf0 0x7fdf04070140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:38378/0 (socket says 172.21.15.120:38378) 2024-04-18T04:44:31.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.434+0000 7fdf03400640 1 -- 172.21.15.120:0/3736498805 learned_addr learned my addr 172.21.15.120:0/3736498805 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:44:31.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.434+0000 7fdf03e00640 1 --2- 172.21.15.120:0/3736498805 >> v2:172.21.15.132:3300/0 conn(0x7fdf040cb710 0x7fdf04065bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:31.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.434+0000 7fdf02a00640 1 -- 172.21.15.120:0/3736498805 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 298890506 0 0) 0x7fdf04066270 con 0x7fdf040cbaf0 2024-04-18T04:44:31.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.434+0000 7fdf02a00640 1 -- 172.21.15.120:0/3736498805 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdee8003530 con 0x7fdf040cbaf0 2024-04-18T04:44:31.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.434+0000 7fdf02a00640 1 -- 172.21.15.120:0/3736498805 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1858665730 0 0) 0x7fdee8003530 con 0x7fdf040cbaf0 2024-04-18T04:44:31.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.434+0000 7fdf02a00640 1 -- 172.21.15.120:0/3736498805 >> v2:172.21.15.132:3300/0 conn(0x7fdf040cb710 msgr2=0x7fdf04065bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:31.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.434+0000 7fdf02a00640 1 --2- 172.21.15.120:0/3736498805 >> v2:172.21.15.132:3300/0 conn(0x7fdf040cb710 0x7fdf04065bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:31.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.434+0000 7fdf02a00640 1 -- 172.21.15.120:0/3736498805 >> v1:172.21.15.132:6789/0 conn(0x7fdf040c7f10 legacy=0x7fdf040c83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:31.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.434+0000 7fdf02a00640 1 -- 172.21.15.120:0/3736498805 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf041599c0 con 0x7fdf040cbaf0 2024-04-18T04:44:31.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.434+0000 7fdf02a00640 1 -- 172.21.15.120:0/3736498805 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7fdef0001680 con 0x7fdf040cbaf0 2024-04-18T04:44:31.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.434+0000 7fdf02a00640 1 -- 172.21.15.120:0/3736498805 >> v1:172.21.15.120:6789/0 conn(0x7fdf040cbaf0 legacy=0x7fdf04070140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:31.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.434+0000 7fdf02a00640 1 --2- 172.21.15.120:0/3736498805 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdee8003980 0x7fdee8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:31.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.434+0000 7fdf02a00640 1 --2- 172.21.15.120:0/3736498805 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdee80047d0 0x7fdee8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:31.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.434+0000 7fdf02a00640 1 --2- 172.21.15.120:0/3736498805 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee8005190 0x7fdee800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:31.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.434+0000 7fdf02a00640 1 -- 172.21.15.120:0/3736498805 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf041596e0 con 0x7fdee80047d0 2024-04-18T04:44:31.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.434+0000 7fdf02a00640 1 -- 172.21.15.120:0/3736498805 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee800c040 con 0x7fdee8005190 2024-04-18T04:44:31.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.434+0000 7fdf02a00640 1 -- 172.21.15.120:0/3736498805 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee800c200 con 0x7fdee8003980 2024-04-18T04:44:31.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.434+0000 7fdf03400640 1 --2- 172.21.15.120:0/3736498805 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdee80047d0 0x7fdee8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:31.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.434+0000 7fdf08e00640 1 --2- 172.21.15.120:0/3736498805 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee8005190 0x7fdee800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:31.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.434+0000 7fdf03e00640 1 --2- 172.21.15.120:0/3736498805 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdee8003980 0x7fdee8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:31.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.434+0000 7fdf03400640 1 -- 172.21.15.120:0/3736498805 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdee8003980 msgr2=0x7fdee8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:31.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.434+0000 7fdf03400640 1 --2- 172.21.15.120:0/3736498805 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdee8003980 0x7fdee8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:31.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.434+0000 7fdf03400640 1 -- 172.21.15.120:0/3736498805 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee8005190 msgr2=0x7fdee800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:31.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.434+0000 7fdf03400640 1 --2- 172.21.15.120:0/3736498805 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee8005190 0x7fdee800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:31.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.434+0000 7fdf03400640 1 -- 172.21.15.120:0/3736498805 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee8003530 con 0x7fdee80047d0 2024-04-18T04:44:31.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.434+0000 7fdf08e00640 1 --2- 172.21.15.120:0/3736498805 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee8005190 0x7fdee800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:44:31.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.434+0000 7fdf08e00640 1 -- 172.21.15.120:0/3736498805 reap_dead start 2024-04-18T04:44:31.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.438+0000 7fdf03400640 1 --2- 172.21.15.120:0/3736498805 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdee80047d0 0x7fdee8004c50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdef000c1c0 tx=0x7fdef001cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71531a0348570c00 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:31.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.438+0000 7fdf02a00640 1 -- 172.21.15.120:0/3736498805 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef00a5b40 con 0x7fdee80047d0 2024-04-18T04:44:31.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.438+0000 7fdf02a00640 1 -- 172.21.15.120:0/3736498805 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef00a5ca0 con 0x7fdee80047d0 2024-04-18T04:44:31.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.438+0000 7fdf02a00640 1 -- 172.21.15.120:0/3736498805 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef0005b20 con 0x7fdee80047d0 2024-04-18T04:44:31.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.438+0000 7fdf0ae00640 1 -- 172.21.15.120:0/3736498805 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdee80047d0 msgr2=0x7fdee8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:31.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.438+0000 7fdf0ae00640 1 --2- 172.21.15.120:0/3736498805 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdee80047d0 0x7fdee8004c50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdef000c1c0 tx=0x7fdef001cc40 comp rx=0 tx=0).stop 2024-04-18T04:44:31.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.438+0000 7fdf0ae00640 1 -- 172.21.15.120:0/3736498805 shutdown_connections 2024-04-18T04:44:31.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.438+0000 7fdf0ae00640 1 --2- 172.21.15.120:0/3736498805 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdee80047d0 0x7fdee8004c50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:31.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.438+0000 7fdf0ae00640 1 -- 172.21.15.120:0/3736498805 >> 172.21.15.120:0/3736498805 conn(0x7fdf0406be50 msgr2=0x7fdf0406c260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:31.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.438+0000 7fdf0ae00640 1 -- 172.21.15.120:0/3736498805 shutdown_connections 2024-04-18T04:44:31.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.438+0000 7fdf0ae00640 1 -- 172.21.15.120:0/3736498805 wait complete. 2024-04-18T04:44:31.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.442+0000 7fdf0ae00640 1 Processor -- start 2024-04-18T04:44:31.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.442+0000 7fdf0ae00640 1 -- start start 2024-04-18T04:44:31.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.442+0000 7fdf0ae00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdee80047d0 0x7fdf04155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:31.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.442+0000 7fdf0ae00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf04155bf0 0x7fdf0414df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:31.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.442+0000 7fdf0ae00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf041491f0 0x7fdf04149670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:31.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.442+0000 7fdf0ae00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0414dad0 con 0x7fdf041491f0 2024-04-18T04:44:31.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.442+0000 7fdf0ae00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf041557c0 con 0x7fdf04155bf0 2024-04-18T04:44:31.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.442+0000 7fdf0ae00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf04158110 con 0x7fdee80047d0 2024-04-18T04:44:31.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.442+0000 7fdf08e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf041491f0 0x7fdf04149670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:31.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.442+0000 7fdf08e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf041491f0 0x7fdf04149670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53346/0 (socket says 172.21.15.120:53346) 2024-04-18T04:44:31.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.442+0000 7fdf08e00640 1 -- 172.21.15.120:0/834381271 learned_addr learned my addr 172.21.15.120:0/834381271 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:31.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.442+0000 7fdf03e00640 1 --2- 172.21.15.120:0/834381271 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdee80047d0 0x7fdf04155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:31.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.442+0000 7fdf03400640 1 --2- 172.21.15.120:0/834381271 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf04155bf0 0x7fdf0414df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:31.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.442+0000 7fdf08e00640 1 -- 172.21.15.120:0/834381271 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdee80047d0 msgr2=0x7fdf04155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:31.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.442+0000 7fdf08e00640 1 --2- 172.21.15.120:0/834381271 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdee80047d0 0x7fdf04155280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:31.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.442+0000 7fdf08e00640 1 -- 172.21.15.120:0/834381271 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf04155bf0 msgr2=0x7fdf0414df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:31.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.442+0000 7fdf08e00640 1 --2- 172.21.15.120:0/834381271 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf04155bf0 0x7fdf0414df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:31.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.442+0000 7fdf08e00640 1 -- 172.21.15.120:0/834381271 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf04153fd0 con 0x7fdf041491f0 2024-04-18T04:44:31.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.442+0000 7fdf08e00640 1 --2- 172.21.15.120:0/834381271 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf041491f0 0x7fdf04149670 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdf040c2fe0 tx=0x7fdefc00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:31.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.442+0000 7fdefbe00640 1 -- 172.21.15.120:0/834381271 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc00eed0 con 0x7fdf041491f0 2024-04-18T04:44:31.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.442+0000 7fdefbe00640 1 -- 172.21.15.120:0/834381271 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdefc003980 con 0x7fdf041491f0 2024-04-18T04:44:31.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.442+0000 7fdefbe00640 1 -- 172.21.15.120:0/834381271 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc003d10 con 0x7fdf041491f0 2024-04-18T04:44:31.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.442+0000 7fdf0ae00640 1 -- 172.21.15.120:0/834381271 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf041542b0 con 0x7fdf041491f0 2024-04-18T04:44:31.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.442+0000 7fdf0ae00640 1 -- 172.21.15.120:0/834381271 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf0414e460 con 0x7fdf041491f0 2024-04-18T04:44:31.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.442+0000 7fdf0ae00640 1 -- 172.21.15.120:0/834381271 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf040729d0 con 0x7fdf041491f0 2024-04-18T04:44:31.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.446+0000 7fdefbe00640 1 -- 172.21.15.120:0/834381271 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdefc0050d0 con 0x7fdf041491f0 2024-04-18T04:44:31.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.446+0000 7fdefbe00640 1 --2- 172.21.15.120:0/834381271 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fdee4066690 0x7fdee4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:31.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.446+0000 7fdefbe00640 1 -- 172.21.15.120:0/834381271 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fdefc083fb0 con 0x7fdf041491f0 2024-04-18T04:44:31.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.446+0000 7fdf03e00640 1 --2- 172.21.15.120:0/834381271 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fdee4066690 0x7fdee4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:31.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.446+0000 7fdf03e00640 1 --2- 172.21.15.120:0/834381271 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fdee4066690 0x7fdee4068b50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdef4009ab0 tx=0x7fdef4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:31.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.450+0000 7fdefbe00640 1 -- 172.21.15.120:0/834381271 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fdefc051230 con 0x7fdf041491f0 2024-04-18T04:44:31.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:31.606+0000 7fdf0ae00640 1 -- 172.21.15.120:0/834381271 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fdf040c5c40 con 0x7fdf041491f0 2024-04-18T04:44:33.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.274+0000 7fdefbe00640 1 -- 172.21.15.120:0/834381271 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) v1 ==== 228+0+0 (secure 0 0 0) 0x7fdefc054850 con 0x7fdf041491f0 2024-04-18T04:44:33.275 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_data_ec' created 2024-04-18T04:44:33.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.278+0000 7fdf0ae00640 1 -- 172.21.15.120:0/834381271 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fdee4066690 msgr2=0x7fdee4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:33.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.278+0000 7fdf0ae00640 1 --2- 172.21.15.120:0/834381271 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fdee4066690 0x7fdee4068b50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdef4009ab0 tx=0x7fdef4008040 comp rx=0 tx=0).stop 2024-04-18T04:44:33.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.278+0000 7fdf0ae00640 1 -- 172.21.15.120:0/834381271 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf041491f0 msgr2=0x7fdf04149670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:33.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.278+0000 7fdf0ae00640 1 --2- 172.21.15.120:0/834381271 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf041491f0 0x7fdf04149670 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdf040c2fe0 tx=0x7fdefc00eb90 comp rx=0 tx=0).stop 2024-04-18T04:44:33.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.282+0000 7fdf0ae00640 1 -- 172.21.15.120:0/834381271 shutdown_connections 2024-04-18T04:44:33.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.282+0000 7fdf0ae00640 1 --2- 172.21.15.120:0/834381271 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fdee4066690 0x7fdee4068b50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:33.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.282+0000 7fdf0ae00640 1 --2- 172.21.15.120:0/834381271 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf041491f0 0x7fdf04149670 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:33.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.282+0000 7fdf0ae00640 1 --2- 172.21.15.120:0/834381271 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf04155bf0 0x7fdf0414df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:33.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.282+0000 7fdf0ae00640 1 --2- 172.21.15.120:0/834381271 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdee80047d0 0x7fdf04155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:33.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.282+0000 7fdf0ae00640 1 -- 172.21.15.120:0/834381271 >> 172.21.15.120:0/834381271 conn(0x7fdf0406be50 msgr2=0x7fdf04152920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:33.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.282+0000 7fdf0ae00640 1 -- 172.21.15.120:0/834381271 shutdown_connections 2024-04-18T04:44:33.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.282+0000 7fdf0ae00640 1 -- 172.21.15.120:0/834381271 wait complete. 2024-04-18T04:44:33.309 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-18T04:44:33.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.454+0000 7ff4f2400640 1 Processor -- start 2024-04-18T04:44:33.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.454+0000 7ff4f2400640 1 -- start start 2024-04-18T04:44:33.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.454+0000 7ff4f2400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff4ec06a500 0x7ff4ec1564b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:33.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.454+0000 7ff4f2400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4ec06aba0 0x7ff4ec150260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:33.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.454+0000 7ff4f2400640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4ec0709d0 con 0x7ff4ec06a120 2024-04-18T04:44:33.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.454+0000 7ff4f2400640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4ec156dd0 con 0x7ff4ec06a500 2024-04-18T04:44:33.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.454+0000 7ff4f2400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec1570b0 con 0x7ff4ec06aba0 2024-04-18T04:44:33.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.454+0000 7ff4eb400640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7ff4ec06a120 0x7ff4ec071470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:38390/0 (socket says 172.21.15.120:38390) 2024-04-18T04:44:33.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.454+0000 7ff4eb400640 1 -- 172.21.15.120:0/1492360318 learned_addr learned my addr 172.21.15.120:0/1492360318 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:44:33.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.454+0000 7ff4e2a00640 1 --2- 172.21.15.120:0/1492360318 >> v2:172.21.15.132:3300/0 conn(0x7ff4ec06a500 0x7ff4ec1564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:33.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.454+0000 7ff4ebe00640 1 --2- 172.21.15.120:0/1492360318 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4ec06aba0 0x7ff4ec150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:33.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.454+0000 7ff4eaa00640 1 -- 172.21.15.120:0/1492360318 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 859259304 0 0) 0x7ff4ec0709d0 con 0x7ff4ec06a120 2024-04-18T04:44:33.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.454+0000 7ff4eaa00640 1 -- 172.21.15.120:0/1492360318 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4d0003530 con 0x7ff4ec06a120 2024-04-18T04:44:33.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.454+0000 7ff4eaa00640 1 -- 172.21.15.120:0/1492360318 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 10842463 0 0) 0x7ff4d0003530 con 0x7ff4ec06a120 2024-04-18T04:44:33.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.454+0000 7ff4eaa00640 1 -- 172.21.15.120:0/1492360318 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4ec06aba0 msgr2=0x7ff4ec150260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:33.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.454+0000 7ff4eaa00640 1 --2- 172.21.15.120:0/1492360318 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4ec06aba0 0x7ff4ec150260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:33.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.454+0000 7ff4eaa00640 1 -- 172.21.15.120:0/1492360318 >> v2:172.21.15.132:3300/0 conn(0x7ff4ec06a500 msgr2=0x7ff4ec1564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:33.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.454+0000 7ff4eaa00640 1 --2- 172.21.15.120:0/1492360318 >> v2:172.21.15.132:3300/0 conn(0x7ff4ec06a500 0x7ff4ec1564b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:33.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.454+0000 7ff4eaa00640 1 -- 172.21.15.120:0/1492360318 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ec070c70 con 0x7ff4ec06a120 2024-04-18T04:44:33.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.454+0000 7ff4eaa00640 1 -- 172.21.15.120:0/1492360318 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7ff4dc001680 con 0x7ff4ec06a120 2024-04-18T04:44:33.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.454+0000 7ff4e2a00640 1 --2- 172.21.15.120:0/1492360318 >> v2:172.21.15.132:3300/0 conn(0x7ff4ec06a500 0x7ff4ec1564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:44:33.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.454+0000 7ff4eaa00640 1 -- 172.21.15.120:0/1492360318 >> v1:172.21.15.120:6789/0 conn(0x7ff4ec06a120 legacy=0x7ff4ec071470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:33.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.454+0000 7ff4eaa00640 1 --2- 172.21.15.120:0/1492360318 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4d0003980 0x7ff4d0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:33.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.454+0000 7ff4eaa00640 1 --2- 172.21.15.120:0/1492360318 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4d00047d0 0x7ff4d0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:33.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.454+0000 7ff4eaa00640 1 --2- 172.21.15.120:0/1492360318 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4ec06aba0 0x7ff4d0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:33.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.454+0000 7ff4eaa00640 1 -- 172.21.15.120:0/1492360318 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec156dd0 con 0x7ff4d0003980 2024-04-18T04:44:33.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.454+0000 7ff4eaa00640 1 -- 172.21.15.120:0/1492360318 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec1570b0 con 0x7ff4d00047d0 2024-04-18T04:44:33.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.454+0000 7ff4eaa00640 1 -- 172.21.15.120:0/1492360318 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d000b990 con 0x7ff4ec06aba0 2024-04-18T04:44:33.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.454+0000 7ff4eb400640 1 --2- 172.21.15.120:0/1492360318 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4d0003980 0x7ff4d0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:33.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.454+0000 7ff4e2a00640 1 --2- 172.21.15.120:0/1492360318 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4d00047d0 0x7ff4d0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:33.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.454+0000 7ff4ebe00640 1 --2- 172.21.15.120:0/1492360318 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4ec06aba0 0x7ff4d0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:33.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.454+0000 7ff4eb400640 1 -- 172.21.15.120:0/1492360318 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4ec06aba0 msgr2=0x7ff4d0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:33.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.454+0000 7ff4eb400640 1 --2- 172.21.15.120:0/1492360318 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4ec06aba0 0x7ff4d0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:33.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.454+0000 7ff4eb400640 1 -- 172.21.15.120:0/1492360318 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4d00047d0 msgr2=0x7ff4d0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:33.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.454+0000 7ff4eb400640 1 --2- 172.21.15.120:0/1492360318 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4d00047d0 0x7ff4d0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:33.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.454+0000 7ff4eb400640 1 -- 172.21.15.120:0/1492360318 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d0003530 con 0x7ff4d0003980 2024-04-18T04:44:33.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.454+0000 7ff4ebe00640 1 --2- 172.21.15.120:0/1492360318 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4ec06aba0 0x7ff4d0005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:44:33.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.458+0000 7ff4eb400640 1 --2- 172.21.15.120:0/1492360318 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4d0003980 0x7ff4d0003da0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc00c210 tx=0x7ff4dc01f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5339846afd6463e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:33.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.458+0000 7ff4eaa00640 1 -- 172.21.15.120:0/1492360318 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc0a8d00 con 0x7ff4d0003980 2024-04-18T04:44:33.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.458+0000 7ff4eaa00640 1 -- 172.21.15.120:0/1492360318 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4dc0a8e60 con 0x7ff4d0003980 2024-04-18T04:44:33.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.458+0000 7ff4eaa00640 1 -- 172.21.15.120:0/1492360318 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc005ae0 con 0x7ff4d0003980 2024-04-18T04:44:33.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.458+0000 7ff4f2400640 1 -- 172.21.15.120:0/1492360318 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4d0003980 msgr2=0x7ff4d0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:33.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.458+0000 7ff4f2400640 1 --2- 172.21.15.120:0/1492360318 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4d0003980 0x7ff4d0003da0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc00c210 tx=0x7ff4dc01f3d0 comp rx=0 tx=0).stop 2024-04-18T04:44:33.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.458+0000 7ff4ebe00640 1 -- 172.21.15.120:0/1492360318 reap_dead start 2024-04-18T04:44:33.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.458+0000 7ff4f2400640 1 -- 172.21.15.120:0/1492360318 shutdown_connections 2024-04-18T04:44:33.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.458+0000 7ff4f2400640 1 -- 172.21.15.120:0/1492360318 >> 172.21.15.120:0/1492360318 conn(0x7ff4ec0c79c0 msgr2=0x7ff4ec0c7da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:33.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.458+0000 7ff4f2400640 1 -- 172.21.15.120:0/1492360318 shutdown_connections 2024-04-18T04:44:33.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.458+0000 7ff4f2400640 1 -- 172.21.15.120:0/1492360318 wait complete. 2024-04-18T04:44:33.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.462+0000 7ff4f2400640 1 Processor -- start 2024-04-18T04:44:33.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.462+0000 7ff4f2400640 1 -- start start 2024-04-18T04:44:33.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.462+0000 7ff4f2400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4d0003980 0x7ff4ec0c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:33.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.462+0000 7ff4f2400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4ec0c1b90 0x7ff4ec1ecac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:33.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.462+0000 7ff4f2400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4ec154a70 0x7ff4ec0bfda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:33.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.462+0000 7ff4f2400640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec150f30 con 0x7ff4d0003980 2024-04-18T04:44:33.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.462+0000 7ff4f2400640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec1f0030 con 0x7ff4ec154a70 2024-04-18T04:44:33.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.462+0000 7ff4f2400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec1f08d0 con 0x7ff4ec0c1b90 2024-04-18T04:44:33.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.462+0000 7ff4eb400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4d0003980 0x7ff4ec0c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:33.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.462+0000 7ff4eb400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4d0003980 0x7ff4ec0c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53350/0 (socket says 172.21.15.120:53350) 2024-04-18T04:44:33.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.462+0000 7ff4eb400640 1 -- 172.21.15.120:0/1388683786 learned_addr learned my addr 172.21.15.120:0/1388683786 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:33.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.462+0000 7ff4e2a00640 1 --2- 172.21.15.120:0/1388683786 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4ec0c1b90 0x7ff4ec1ecac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:33.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.462+0000 7ff4ebe00640 1 --2- 172.21.15.120:0/1388683786 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4ec154a70 0x7ff4ec0bfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:33.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.462+0000 7ff4eb400640 1 -- 172.21.15.120:0/1388683786 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4ec0c1b90 msgr2=0x7ff4ec1ecac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:33.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.462+0000 7ff4eb400640 1 --2- 172.21.15.120:0/1388683786 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4ec0c1b90 0x7ff4ec1ecac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:33.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.462+0000 7ff4eb400640 1 -- 172.21.15.120:0/1388683786 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4ec154a70 msgr2=0x7ff4ec0bfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:33.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.462+0000 7ff4eb400640 1 --2- 172.21.15.120:0/1388683786 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4ec154a70 0x7ff4ec0bfda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:33.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.462+0000 7ff4eb400640 1 -- 172.21.15.120:0/1388683786 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ec0ca5c0 con 0x7ff4d0003980 2024-04-18T04:44:33.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.462+0000 7ff4eb400640 1 --2- 172.21.15.120:0/1388683786 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4d0003980 0x7ff4ec0c94c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc00c210 tx=0x7ff4d0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:33.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.462+0000 7ff4e3e00640 1 -- 172.21.15.120:0/1388683786 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc0049f0 con 0x7ff4d0003980 2024-04-18T04:44:33.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.462+0000 7ff4e3e00640 1 -- 172.21.15.120:0/1388683786 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4dc0b6070 con 0x7ff4d0003980 2024-04-18T04:44:33.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.462+0000 7ff4e3e00640 1 -- 172.21.15.120:0/1388683786 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc004d70 con 0x7ff4d0003980 2024-04-18T04:44:33.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.462+0000 7ff4f2400640 1 -- 172.21.15.120:0/1388683786 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4ec151160 con 0x7ff4d0003980 2024-04-18T04:44:33.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.462+0000 7ff4f2400640 1 -- 172.21.15.120:0/1388683786 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4ec1f0560 con 0x7ff4d0003980 2024-04-18T04:44:33.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.466+0000 7ff4e0c00640 1 -- 172.21.15.120:0/1388683786 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4ec074020 con 0x7ff4d0003980 2024-04-18T04:44:33.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.466+0000 7ff4e3e00640 1 -- 172.21.15.120:0/1388683786 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff4dc0070d0 con 0x7ff4d0003980 2024-04-18T04:44:33.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.466+0000 7ff4e3e00640 1 --2- 172.21.15.120:0/1388683786 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff4c80666c0 0x7ff4c8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:33.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.466+0000 7ff4e3e00640 1 -- 172.21.15.120:0/1388683786 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7ff4dc0b8070 con 0x7ff4d0003980 2024-04-18T04:44:33.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.466+0000 7ff4e2a00640 1 --2- 172.21.15.120:0/1388683786 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff4c80666c0 0x7ff4c8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:33.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.466+0000 7ff4e2a00640 1 --2- 172.21.15.120:0/1388683786 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff4c80666c0 0x7ff4c8068b80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec0c1040 tx=0x7ff4d4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:33.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.470+0000 7ff4e3e00640 1 -- 172.21.15.120:0/1388683786 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7ff4dc0ee4c0 con 0x7ff4d0003980 2024-04-18T04:44:33.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:33.622+0000 7ff4e0c00640 1 -- 172.21.15.120:0/1388683786 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7ff4ec067070 con 0x7ff4d0003980 2024-04-18T04:44:34.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.282+0000 7ff4e3e00640 1 -- 172.21.15.120:0/1388683786 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff4dc0f1ae0 con 0x7ff4d0003980 2024-04-18T04:44:34.282 INFO:teuthology.orchestra.run.smithi120.stderr:set pool 4 allow_ec_overwrites to true 2024-04-18T04:44:34.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.290+0000 7ff4e0c00640 1 -- 172.21.15.120:0/1388683786 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff4c80666c0 msgr2=0x7ff4c8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:34.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.290+0000 7ff4e0c00640 1 --2- 172.21.15.120:0/1388683786 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff4c80666c0 0x7ff4c8068b80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec0c1040 tx=0x7ff4d4008040 comp rx=0 tx=0).stop 2024-04-18T04:44:34.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.290+0000 7ff4e0c00640 1 -- 172.21.15.120:0/1388683786 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4d0003980 msgr2=0x7ff4ec0c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:34.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.290+0000 7ff4e0c00640 1 --2- 172.21.15.120:0/1388683786 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4d0003980 0x7ff4ec0c94c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc00c210 tx=0x7ff4d0005800 comp rx=0 tx=0).stop 2024-04-18T04:44:34.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.294+0000 7ff4e0c00640 1 -- 172.21.15.120:0/1388683786 shutdown_connections 2024-04-18T04:44:34.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.294+0000 7ff4e0c00640 1 --2- 172.21.15.120:0/1388683786 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff4c80666c0 0x7ff4c8068b80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:34.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.294+0000 7ff4e0c00640 1 --2- 172.21.15.120:0/1388683786 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4ec154a70 0x7ff4ec0bfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:34.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.294+0000 7ff4e0c00640 1 --2- 172.21.15.120:0/1388683786 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4ec0c1b90 0x7ff4ec1ecac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:34.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.294+0000 7ff4e0c00640 1 --2- 172.21.15.120:0/1388683786 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4d0003980 0x7ff4ec0c94c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:34.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.294+0000 7ff4e0c00640 1 -- 172.21.15.120:0/1388683786 >> 172.21.15.120:0/1388683786 conn(0x7ff4ec0c79c0 msgr2=0x7ff4ec0c5af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:34.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.294+0000 7ff4e0c00640 1 -- 172.21.15.120:0/1388683786 shutdown_connections 2024-04-18T04:44:34.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.298+0000 7ff4e0c00640 1 -- 172.21.15.120:0/1388683786 wait complete. 2024-04-18T04:44:34.327 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-18T04:44:34.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.469+0000 7f3c76000640 1 Processor -- start 2024-04-18T04:44:34.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.469+0000 7f3c76000640 1 -- start start 2024-04-18T04:44:34.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.473+0000 7f3c76000640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3c70158150 0x7f3c700c73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:34.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.473+0000 7f3c76000640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3c700caff0 0x7f3c700cb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:34.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.473+0000 7f3c76000640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c70072640 con 0x7f3c70151730 2024-04-18T04:44:34.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.473+0000 7f3c76000640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c70071120 con 0x7f3c700caff0 2024-04-18T04:44:34.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.473+0000 7f3c76000640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c700cb940 con 0x7f3c70158150 2024-04-18T04:44:34.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.473+0000 7f3c6fe00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3c700caff0 0x7f3c700cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:34.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.473+0000 7f3c6fe00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3c700caff0 0x7f3c700cb400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53358/0 (socket says 172.21.15.120:53358) 2024-04-18T04:44:34.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.473+0000 7f3c6fe00640 1 -- 172.21.15.120:0/272926473 learned_addr learned my addr 172.21.15.120:0/272926473 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:34.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.473+0000 7f3c6ea00640 1 --2- 172.21.15.120:0/272926473 >> v2:172.21.15.132:3300/0 conn(0x7f3c70158150 0x7f3c700c73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:34.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.473+0000 7f3c6fe00640 1 -- 172.21.15.120:0/272926473 >> v2:172.21.15.132:3300/0 conn(0x7f3c70158150 msgr2=0x7f3c700c73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:34.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.473+0000 7f3c6fe00640 1 --2- 172.21.15.120:0/272926473 >> v2:172.21.15.132:3300/0 conn(0x7f3c70158150 0x7f3c700c73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:34.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.473+0000 7f3c6fe00640 1 -- 172.21.15.120:0/272926473 >> v1:172.21.15.132:6789/0 conn(0x7f3c70151730 legacy=0x7f3c7006dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:34.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.473+0000 7f3c6fe00640 1 -- 172.21.15.120:0/272926473 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c70072360 con 0x7f3c700caff0 2024-04-18T04:44:34.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.473+0000 7f3c6fe00640 1 --2- 172.21.15.120:0/272926473 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c700caff0 0x7f3c700cb400 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3c700c8c50 tx=0x7f3c6801c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ecd707007ee8075 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:34.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.473+0000 7f3c6e000640 1 -- 172.21.15.120:0/272926473 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c680a5760 con 0x7f3c700caff0 2024-04-18T04:44:34.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.473+0000 7f3c6e000640 1 -- 172.21.15.120:0/272926473 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c680a58c0 con 0x7f3c700caff0 2024-04-18T04:44:34.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.473+0000 7f3c6e000640 1 -- 172.21.15.120:0/272926473 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c680a5c50 con 0x7f3c700caff0 2024-04-18T04:44:34.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.477+0000 7f3c76000640 1 -- 172.21.15.120:0/272926473 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c700caff0 msgr2=0x7f3c700cb400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:34.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.477+0000 7f3c76000640 1 --2- 172.21.15.120:0/272926473 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c700caff0 0x7f3c700cb400 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3c700c8c50 tx=0x7f3c6801c9b0 comp rx=0 tx=0).stop 2024-04-18T04:44:34.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.477+0000 7f3c76000640 1 -- 172.21.15.120:0/272926473 shutdown_connections 2024-04-18T04:44:34.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.477+0000 7f3c76000640 1 --2- 172.21.15.120:0/272926473 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c700caff0 0x7f3c700cb400 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:34.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.477+0000 7f3c76000640 1 --2- 172.21.15.120:0/272926473 >> v2:172.21.15.132:3300/0 conn(0x7f3c70158150 0x7f3c700c73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:34.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.477+0000 7f3c76000640 1 -- 172.21.15.120:0/272926473 >> 172.21.15.120:0/272926473 conn(0x7f3c7006b780 msgr2=0x7f3c7006bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:34.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.477+0000 7f3c76000640 1 -- 172.21.15.120:0/272926473 shutdown_connections 2024-04-18T04:44:34.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.477+0000 7f3c76000640 1 -- 172.21.15.120:0/272926473 wait complete. 2024-04-18T04:44:34.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.477+0000 7f3c76000640 1 Processor -- start 2024-04-18T04:44:34.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.477+0000 7f3c76000640 1 -- start start 2024-04-18T04:44:34.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.477+0000 7f3c76000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3c700caff0 0x7f3c701f2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:34.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.477+0000 7f3c76000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c70151730 0x7f3c7014c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:34.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.477+0000 7f3c76000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c70158150 0x7f3c7014af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:34.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.477+0000 7f3c76000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c701f1f00 con 0x7f3c70158150 2024-04-18T04:44:34.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.477+0000 7f3c76000640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c701f18f0 con 0x7f3c70151730 2024-04-18T04:44:34.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.477+0000 7f3c76000640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7014ddb0 con 0x7f3c700caff0 2024-04-18T04:44:34.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.477+0000 7f3c6fe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c70158150 0x7f3c7014af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:34.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.477+0000 7f3c6fe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c70158150 0x7f3c7014af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53360/0 (socket says 172.21.15.120:53360) 2024-04-18T04:44:34.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.477+0000 7f3c6fe00640 1 -- 172.21.15.120:0/2266687022 learned_addr learned my addr 172.21.15.120:0/2266687022 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:34.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.477+0000 7f3c6f400640 1 --2- 172.21.15.120:0/2266687022 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3c700caff0 0x7f3c701f2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:34.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.477+0000 7f3c6ea00640 1 --2- 172.21.15.120:0/2266687022 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c70151730 0x7f3c7014c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:34.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.477+0000 7f3c6fe00640 1 -- 172.21.15.120:0/2266687022 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3c700caff0 msgr2=0x7f3c701f2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:34.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.477+0000 7f3c6fe00640 1 --2- 172.21.15.120:0/2266687022 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3c700caff0 0x7f3c701f2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:34.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.477+0000 7f3c6fe00640 1 -- 172.21.15.120:0/2266687022 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c70151730 msgr2=0x7f3c7014c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:34.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.477+0000 7f3c6fe00640 1 --2- 172.21.15.120:0/2266687022 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c70151730 0x7f3c7014c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:34.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.477+0000 7f3c6fe00640 1 -- 172.21.15.120:0/2266687022 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c68009b30 con 0x7f3c70158150 2024-04-18T04:44:34.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.477+0000 7f3c6ea00640 1 --2- 172.21.15.120:0/2266687022 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c70151730 0x7f3c7014c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:44:34.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.477+0000 7f3c6fe00640 1 --2- 172.21.15.120:0/2266687022 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c70158150 0x7f3c7014af50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3c680af040 tx=0x7f3c68019750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:34.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.481+0000 7f3c67400640 1 -- 172.21.15.120:0/2266687022 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c680b8670 con 0x7f3c70158150 2024-04-18T04:44:34.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.481+0000 7f3c67400640 1 -- 172.21.15.120:0/2266687022 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c680b87d0 con 0x7f3c70158150 2024-04-18T04:44:34.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.481+0000 7f3c76000640 1 -- 172.21.15.120:0/2266687022 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c7014e7c0 con 0x7f3c70158150 2024-04-18T04:44:34.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.481+0000 7f3c67400640 1 -- 172.21.15.120:0/2266687022 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c680b8b80 con 0x7f3c70158150 2024-04-18T04:44:34.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.481+0000 7f3c76000640 1 -- 172.21.15.120:0/2266687022 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c701f1b90 con 0x7f3c70158150 2024-04-18T04:44:34.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.481+0000 7f3c76000640 1 -- 172.21.15.120:0/2266687022 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c701f2070 con 0x7f3c70158150 2024-04-18T04:44:34.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.481+0000 7f3c67400640 1 -- 172.21.15.120:0/2266687022 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3c680b8ce0 con 0x7f3c70158150 2024-04-18T04:44:34.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.481+0000 7f3c67400640 1 --2- 172.21.15.120:0/2266687022 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3c500666c0 0x7f3c50068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:34.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.481+0000 7f3c67400640 1 -- 172.21.15.120:0/2266687022 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f3c6811f5f0 con 0x7f3c70158150 2024-04-18T04:44:34.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.481+0000 7f3c6f400640 1 --2- 172.21.15.120:0/2266687022 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3c500666c0 0x7f3c50068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:34.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.485+0000 7f3c6f400640 1 --2- 172.21.15.120:0/2266687022 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3c500666c0 0x7f3c50068b80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3c60004e30 tx=0x7f3c60009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:34.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.485+0000 7f3c67400640 1 -- 172.21.15.120:0/2266687022 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f3c680ec710 con 0x7f3c70158150 2024-04-18T04:44:34.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.673+0000 7f3c76000640 1 -- 172.21.15.120:0/2266687022 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f3c701f2040 con 0x7f3c70158150 2024-04-18T04:44:34.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.677+0000 7f3c67400640 1 -- 172.21.15.120:0/2266687022 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v5) v1 ==== 137+0+0 (secure 0 0 0) 0x7f3c680efd30 con 0x7f3c70158150 2024-04-18T04:44:34.677 INFO:teuthology.orchestra.run.smithi120.stderr:added data pool 4 to fsmap 2024-04-18T04:44:34.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.681+0000 7f3c76000640 1 -- 172.21.15.120:0/2266687022 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3c500666c0 msgr2=0x7f3c50068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:34.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.681+0000 7f3c76000640 1 --2- 172.21.15.120:0/2266687022 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3c500666c0 0x7f3c50068b80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3c60004e30 tx=0x7f3c60009040 comp rx=0 tx=0).stop 2024-04-18T04:44:34.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.681+0000 7f3c76000640 1 -- 172.21.15.120:0/2266687022 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c70158150 msgr2=0x7f3c7014af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:34.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.681+0000 7f3c76000640 1 --2- 172.21.15.120:0/2266687022 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c70158150 0x7f3c7014af50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3c680af040 tx=0x7f3c68019750 comp rx=0 tx=0).stop 2024-04-18T04:44:34.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.681+0000 7f3c76000640 1 -- 172.21.15.120:0/2266687022 shutdown_connections 2024-04-18T04:44:34.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.681+0000 7f3c76000640 1 --2- 172.21.15.120:0/2266687022 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3c500666c0 0x7f3c50068b80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:34.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.681+0000 7f3c76000640 1 --2- 172.21.15.120:0/2266687022 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c70158150 0x7f3c7014af50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:34.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.681+0000 7f3c76000640 1 --2- 172.21.15.120:0/2266687022 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c70151730 0x7f3c7014c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:34.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.681+0000 7f3c76000640 1 --2- 172.21.15.120:0/2266687022 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3c700caff0 0x7f3c701f2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:34.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.681+0000 7f3c76000640 1 -- 172.21.15.120:0/2266687022 >> 172.21.15.120:0/2266687022 conn(0x7f3c7006b780 msgr2=0x7f3c7006bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:34.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.681+0000 7f3c76000640 1 -- 172.21.15.120:0/2266687022 shutdown_connections 2024-04-18T04:44:34.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.681+0000 7f3c76000640 1 -- 172.21.15.120:0/2266687022 wait complete. 2024-04-18T04:44:34.698 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:44:34.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.833+0000 7f0a49c00640 1 Processor -- start 2024-04-18T04:44:34.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.837+0000 7f0a49c00640 1 -- start start 2024-04-18T04:44:34.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.837+0000 7f0a49c00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0a441537f0 0x7f0a440c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:34.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.837+0000 7f0a49c00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0a4415d5e0 0x7f0a440c7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:34.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.837+0000 7f0a49c00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a44153bd0 con 0x7f0a44065fc0 2024-04-18T04:44:34.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.837+0000 7f0a49c00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a4415ca80 con 0x7f0a4415d5e0 2024-04-18T04:44:34.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.837+0000 7f0a49c00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a44159490 con 0x7f0a441537f0 2024-04-18T04:44:34.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.837+0000 7f0a43e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0a441537f0 0x7f0a440c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:34.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.837+0000 7f0a49200640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0a4415d5e0 0x7f0a440c7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:34.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.837+0000 7f0a43e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0a441537f0 0x7f0a440c6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:53382/0 (socket says 172.21.15.120:53382) 2024-04-18T04:44:34.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.837+0000 7f0a43e00640 1 -- 172.21.15.120:0/1896111833 learned_addr learned my addr 172.21.15.120:0/1896111833 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:34.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.837+0000 7f0a3be00640 1 --1- 172.21.15.120:0/1896111833 >> v1:172.21.15.132:6789/0 conn(0x7f0a44065fc0 0x7f0a4415ced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:53858/0 (socket says 172.21.15.120:53858) 2024-04-18T04:44:34.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.837+0000 7f0a49200640 1 -- 172.21.15.120:0/1896111833 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0a441537f0 msgr2=0x7f0a440c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:34.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.837+0000 7f0a49200640 1 --2- 172.21.15.120:0/1896111833 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0a441537f0 0x7f0a440c6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:34.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.837+0000 7f0a49200640 1 -- 172.21.15.120:0/1896111833 >> v1:172.21.15.132:6789/0 conn(0x7f0a44065fc0 legacy=0x7f0a4415ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:34.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.837+0000 7f0a49200640 1 -- 172.21.15.120:0/1896111833 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a44159730 con 0x7f0a4415d5e0 2024-04-18T04:44:34.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.841+0000 7f0a49200640 1 --2- 172.21.15.120:0/1896111833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a4415d5e0 0x7f0a440c7020 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c009d90 tx=0x7f0a3c01f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4a7df6fdfe050ff server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:34.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.841+0000 7f0a43400640 1 -- 172.21.15.120:0/1896111833 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c0af600 con 0x7f0a4415d5e0 2024-04-18T04:44:34.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.841+0000 7f0a43400640 1 -- 172.21.15.120:0/1896111833 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3c0ab050 con 0x7f0a4415d5e0 2024-04-18T04:44:34.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.841+0000 7f0a43400640 1 -- 172.21.15.120:0/1896111833 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c0af980 con 0x7f0a4415d5e0 2024-04-18T04:44:34.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.841+0000 7f0a49c00640 1 -- 172.21.15.120:0/1896111833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a4415d5e0 msgr2=0x7f0a440c7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:34.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.841+0000 7f0a49c00640 1 --2- 172.21.15.120:0/1896111833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a4415d5e0 0x7f0a440c7020 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c009d90 tx=0x7f0a3c01f150 comp rx=0 tx=0).stop 2024-04-18T04:44:34.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.841+0000 7f0a49c00640 1 -- 172.21.15.120:0/1896111833 shutdown_connections 2024-04-18T04:44:34.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.841+0000 7f0a49c00640 1 --2- 172.21.15.120:0/1896111833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a4415d5e0 0x7f0a440c7020 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:34.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.841+0000 7f0a49c00640 1 --2- 172.21.15.120:0/1896111833 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0a441537f0 0x7f0a440c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:34.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.841+0000 7f0a49c00640 1 -- 172.21.15.120:0/1896111833 >> 172.21.15.120:0/1896111833 conn(0x7f0a4406c620 msgr2=0x7f0a440cb2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:34.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.841+0000 7f0a49c00640 1 -- 172.21.15.120:0/1896111833 shutdown_connections 2024-04-18T04:44:34.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.841+0000 7f0a49c00640 1 -- 172.21.15.120:0/1896111833 wait complete. 2024-04-18T04:44:34.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.841+0000 7f0a49c00640 1 Processor -- start 2024-04-18T04:44:34.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.845+0000 7f0a49c00640 1 -- start start 2024-04-18T04:44:34.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.845+0000 7f0a49c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0a44065fc0 0x7f0a4415bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:34.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.845+0000 7f0a49c00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a441537f0 0x7f0a441eec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:34.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.845+0000 7f0a49c00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0a4415d5e0 0x7f0a441ef180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:34.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.845+0000 7f0a49c00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4414e190 con 0x7f0a44065fc0 2024-04-18T04:44:34.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.845+0000 7f0a49c00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a440c39d0 con 0x7f0a441537f0 2024-04-18T04:44:34.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.845+0000 7f0a49c00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a440c36f0 con 0x7f0a4415d5e0 2024-04-18T04:44:34.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.845+0000 7f0a43e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0a44065fc0 0x7f0a4415bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:34.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.845+0000 7f0a43e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0a44065fc0 0x7f0a4415bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53362/0 (socket says 172.21.15.120:53362) 2024-04-18T04:44:34.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.845+0000 7f0a43e00640 1 -- 172.21.15.120:0/2009458033 learned_addr learned my addr 172.21.15.120:0/2009458033 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:34.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.845+0000 7f0a3be00640 1 --2- 172.21.15.120:0/2009458033 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a441537f0 0x7f0a441eec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:34.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.845+0000 7f0a49200640 1 --2- 172.21.15.120:0/2009458033 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0a4415d5e0 0x7f0a441ef180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:34.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.845+0000 7f0a43e00640 1 -- 172.21.15.120:0/2009458033 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0a4415d5e0 msgr2=0x7f0a441ef180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:34.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.845+0000 7f0a43e00640 1 --2- 172.21.15.120:0/2009458033 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0a4415d5e0 0x7f0a441ef180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:34.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.845+0000 7f0a43e00640 1 -- 172.21.15.120:0/2009458033 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a441537f0 msgr2=0x7f0a441eec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:34.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.845+0000 7f0a43e00640 1 --2- 172.21.15.120:0/2009458033 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a441537f0 0x7f0a441eec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:34.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.845+0000 7f0a43e00640 1 -- 172.21.15.120:0/2009458033 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a3c009a70 con 0x7f0a44065fc0 2024-04-18T04:44:34.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.845+0000 7f0a43e00640 1 --2- 172.21.15.120:0/2009458033 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0a44065fc0 0x7f0a4415bc40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0a3400e8c0 tx=0x7f0a3400ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:34.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.845+0000 7f0a40c00640 1 -- 172.21.15.120:0/2009458033 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a34009620 con 0x7f0a44065fc0 2024-04-18T04:44:34.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.845+0000 7f0a40c00640 1 -- 172.21.15.120:0/2009458033 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3400c940 con 0x7f0a44065fc0 2024-04-18T04:44:34.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.845+0000 7f0a40c00640 1 -- 172.21.15.120:0/2009458033 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3400ccf0 con 0x7f0a44065fc0 2024-04-18T04:44:34.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.845+0000 7f0a49c00640 1 -- 172.21.15.120:0/2009458033 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a44150af0 con 0x7f0a44065fc0 2024-04-18T04:44:34.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.845+0000 7f0a49c00640 1 -- 172.21.15.120:0/2009458033 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a441510b0 con 0x7f0a44065fc0 2024-04-18T04:44:34.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.845+0000 7f0a49c00640 1 -- 172.21.15.120:0/2009458033 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a44067070 con 0x7f0a44065fc0 2024-04-18T04:44:34.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.849+0000 7f0a40c00640 1 -- 172.21.15.120:0/2009458033 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0a34013470 con 0x7f0a44065fc0 2024-04-18T04:44:34.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.849+0000 7f0a40c00640 1 --2- 172.21.15.120:0/2009458033 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0a20066690 0x7f0a20068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:34.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.849+0000 7f0a40c00640 1 -- 172.21.15.120:0/2009458033 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0a34084640 con 0x7f0a44065fc0 2024-04-18T04:44:34.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.849+0000 7f0a3be00640 1 --2- 172.21.15.120:0/2009458033 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0a20066690 0x7f0a20068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:34.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.849+0000 7f0a3be00640 1 --2- 172.21.15.120:0/2009458033 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0a20066690 0x7f0a20068b50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0a441525b0 tx=0x7f0a2c007cb0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:34.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:34.853+0000 7f0a40c00640 1 -- 172.21.15.120:0/2009458033 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f0a34051620 con 0x7f0a44065fc0 2024-04-18T04:44:35.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.037+0000 7f0a49c00640 1 -- 172.21.15.120:0/2009458033 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a440c6370 con 0x7f0a44065fc0 2024-04-18T04:44:35.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.037+0000 7f0a40c00640 1 -- 172.21.15.120:0/2009458033 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+6256 (secure 0 0 0) 0x7f0a34054c40 con 0x7f0a44065fc0 2024-04-18T04:44:35.037 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:44:35.037 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/1552155328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1552155328},{"type":"v1","addr":"172.21.15.132:6835","nonce":1552155328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6833/2564667113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2564667113},{"type":"v1","addr":"172.21.15.120:6833","nonce":2564667113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:44:34.676482+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:creating","state_seq":1,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:44:35.037 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 5 2024-04-18T04:44:35.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.037+0000 7f0a49c00640 1 -- 172.21.15.120:0/2009458033 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0a20066690 msgr2=0x7f0a20068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:35.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.037+0000 7f0a49c00640 1 --2- 172.21.15.120:0/2009458033 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0a20066690 0x7f0a20068b50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0a441525b0 tx=0x7f0a2c007cb0 comp rx=0 tx=0).stop 2024-04-18T04:44:35.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.037+0000 7f0a49c00640 1 -- 172.21.15.120:0/2009458033 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0a44065fc0 msgr2=0x7f0a4415bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:35.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.037+0000 7f0a49c00640 1 --2- 172.21.15.120:0/2009458033 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0a44065fc0 0x7f0a4415bc40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0a3400e8c0 tx=0x7f0a3400ed80 comp rx=0 tx=0).stop 2024-04-18T04:44:35.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.037+0000 7f0a49c00640 1 -- 172.21.15.120:0/2009458033 shutdown_connections 2024-04-18T04:44:35.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.037+0000 7f0a49c00640 1 --2- 172.21.15.120:0/2009458033 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0a20066690 0x7f0a20068b50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:35.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.037+0000 7f0a49c00640 1 --2- 172.21.15.120:0/2009458033 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0a4415d5e0 0x7f0a441ef180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:35.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.037+0000 7f0a49c00640 1 --2- 172.21.15.120:0/2009458033 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a441537f0 0x7f0a441eec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:35.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.037+0000 7f0a49c00640 1 --2- 172.21.15.120:0/2009458033 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0a44065fc0 0x7f0a4415bc40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:35.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.037+0000 7f0a49c00640 1 -- 172.21.15.120:0/2009458033 >> 172.21.15.120:0/2009458033 conn(0x7f0a4406c620 msgr2=0x7f0a44151c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:35.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.041+0000 7f0a49c00640 1 -- 172.21.15.120:0/2009458033 shutdown_connections 2024-04-18T04:44:35.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.041+0000 7f0a49c00640 1 -- 172.21.15.120:0/2009458033 wait complete. 2024-04-18T04:44:35.059 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T04:44:35.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.197+0000 7f1c78000640 1 Processor -- start 2024-04-18T04:44:35.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.197+0000 7f1c78000640 1 -- start start 2024-04-18T04:44:35.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.197+0000 7f1c78000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c701573c0 0x7f1c7006fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:35.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.197+0000 7f1c78000640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c701577f0 con 0x7f1c701515e0 2024-04-18T04:44:35.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.197+0000 7f1c78000640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c70157a50 con 0x7f1c700ccee0 2024-04-18T04:44:35.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.197+0000 7f1c78000640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c700c3120 con 0x7f1c701573c0 2024-04-18T04:44:35.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.197+0000 7f1c74c00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c701573c0 0x7f1c7006fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:35.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.197+0000 7f1c75600640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f1c701515e0 0x7f1c700ca280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:38398/0 (socket says 172.21.15.120:38398) 2024-04-18T04:44:35.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.197+0000 7f1c75600640 1 -- 172.21.15.120:0/2645173001 learned_addr learned my addr 172.21.15.120:0/2645173001 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:44:35.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.197+0000 7f1c74c00640 1 -- 172.21.15.120:0/2645173001 >> v1:172.21.15.132:6789/0 conn(0x7f1c700ccee0 legacy=0x7f1c70161d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:35.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.197+0000 7f1c74c00640 1 -- 172.21.15.120:0/2645173001 >> v1:172.21.15.120:6789/0 conn(0x7f1c701515e0 legacy=0x7f1c700ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:35.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.197+0000 7f1c74c00640 1 -- 172.21.15.120:0/2645173001 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c70157d10 con 0x7f1c701573c0 2024-04-18T04:44:35.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.201+0000 7f1c74c00640 1 --2- 172.21.15.120:0/2645173001 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c701573c0 0x7f1c7006fd00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c0097f0 tx=0x7f1c5c01ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6471c309bfb1ec85 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:35.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.201+0000 7f1c6fe00640 1 -- 172.21.15.120:0/2645173001 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c0a89d0 con 0x7f1c701573c0 2024-04-18T04:44:35.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.201+0000 7f1c6fe00640 1 -- 172.21.15.120:0/2645173001 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5c0a8b30 con 0x7f1c701573c0 2024-04-18T04:44:35.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.201+0000 7f1c6fe00640 1 -- 172.21.15.120:0/2645173001 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c0b0440 con 0x7f1c701573c0 2024-04-18T04:44:35.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.205+0000 7f1c78000640 1 -- 172.21.15.120:0/2645173001 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c701573c0 msgr2=0x7f1c7006fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:35.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.205+0000 7f1c78000640 1 --2- 172.21.15.120:0/2645173001 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c701573c0 0x7f1c7006fd00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c0097f0 tx=0x7f1c5c01ecd0 comp rx=0 tx=0).stop 2024-04-18T04:44:35.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.205+0000 7f1c78000640 1 -- 172.21.15.120:0/2645173001 shutdown_connections 2024-04-18T04:44:35.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.205+0000 7f1c78000640 1 --2- 172.21.15.120:0/2645173001 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c701573c0 0x7f1c7006fd00 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:35.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.205+0000 7f1c78000640 1 -- 172.21.15.120:0/2645173001 >> 172.21.15.120:0/2645173001 conn(0x7f1c7006e0f0 msgr2=0x7f1c70071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:35.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.205+0000 7f1c78000640 1 -- 172.21.15.120:0/2645173001 shutdown_connections 2024-04-18T04:44:35.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.205+0000 7f1c78000640 1 -- 172.21.15.120:0/2645173001 wait complete. 2024-04-18T04:44:35.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.205+0000 7f1c78000640 1 Processor -- start 2024-04-18T04:44:35.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.205+0000 7f1c78000640 1 -- start start 2024-04-18T04:44:35.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.205+0000 7f1c78000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c700ccee0 0x7f1c7014c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:35.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.205+0000 7f1c78000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c701515e0 0x7f1c7006cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:35.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.205+0000 7f1c78000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c701573c0 0x7f1c700c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:35.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.205+0000 7f1c78000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7014cb40 con 0x7f1c701573c0 2024-04-18T04:44:35.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.205+0000 7f1c78000640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7014b800 con 0x7f1c701515e0 2024-04-18T04:44:35.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.205+0000 7f1c78000640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7006cff0 con 0x7f1c700ccee0 2024-04-18T04:44:35.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.205+0000 7f1c76000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c701573c0 0x7f1c700c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:35.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.205+0000 7f1c76000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c701573c0 0x7f1c700c48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53370/0 (socket says 172.21.15.120:53370) 2024-04-18T04:44:35.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.205+0000 7f1c76000640 1 -- 172.21.15.120:0/747599449 learned_addr learned my addr 172.21.15.120:0/747599449 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:35.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.205+0000 7f1c74c00640 1 --2- 172.21.15.120:0/747599449 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c701515e0 0x7f1c7006cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:35.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.205+0000 7f1c75600640 1 --2- 172.21.15.120:0/747599449 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c700ccee0 0x7f1c7014c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:35.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.209+0000 7f1c76000640 1 -- 172.21.15.120:0/747599449 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c700ccee0 msgr2=0x7f1c7014c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:35.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.209+0000 7f1c76000640 1 --2- 172.21.15.120:0/747599449 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c700ccee0 0x7f1c7014c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:35.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.209+0000 7f1c76000640 1 -- 172.21.15.120:0/747599449 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c701515e0 msgr2=0x7f1c7006cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:35.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.209+0000 7f1c76000640 1 --2- 172.21.15.120:0/747599449 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c701515e0 0x7f1c7006cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:35.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.209+0000 7f1c76000640 1 -- 172.21.15.120:0/747599449 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c5c009420 con 0x7f1c701573c0 2024-04-18T04:44:35.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.209+0000 7f1c75600640 1 --2- 172.21.15.120:0/747599449 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c700ccee0 0x7f1c7014c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:44:35.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.209+0000 7f1c76000640 1 --2- 172.21.15.120:0/747599449 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c701573c0 0x7f1c700c48c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1c6800c770 tx=0x7f1c6800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:35.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.209+0000 7f1c6d600640 1 -- 172.21.15.120:0/747599449 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c68003b80 con 0x7f1c701573c0 2024-04-18T04:44:35.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.209+0000 7f1c6d600640 1 -- 172.21.15.120:0/747599449 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c68003ce0 con 0x7f1c701573c0 2024-04-18T04:44:35.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.209+0000 7f1c78000640 1 -- 172.21.15.120:0/747599449 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c7014af60 con 0x7f1c701573c0 2024-04-18T04:44:35.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.209+0000 7f1c6d600640 1 -- 172.21.15.120:0/747599449 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6800aa90 con 0x7f1c701573c0 2024-04-18T04:44:35.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.209+0000 7f1c78000640 1 -- 172.21.15.120:0/747599449 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c7014b520 con 0x7f1c701573c0 2024-04-18T04:44:35.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.209+0000 7f1c78000640 1 -- 172.21.15.120:0/747599449 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c70072a70 con 0x7f1c701573c0 2024-04-18T04:44:35.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.209+0000 7f1c6d600640 1 -- 172.21.15.120:0/747599449 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1c6800abf0 con 0x7f1c701573c0 2024-04-18T04:44:35.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.209+0000 7f1c6d600640 1 --2- 172.21.15.120:0/747599449 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1c50066690 0x7f1c50068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:35.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.209+0000 7f1c6d600640 1 -- 172.21.15.120:0/747599449 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1c680843e0 con 0x7f1c701573c0 2024-04-18T04:44:35.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.209+0000 7f1c75600640 1 --2- 172.21.15.120:0/747599449 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1c50066690 0x7f1c50068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:35.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.213+0000 7f1c75600640 1 --2- 172.21.15.120:0/747599449 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1c50066690 0x7f1c50068b50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1c64000f70 tx=0x7f1c64009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:35.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.213+0000 7f1c6d600640 1 -- 172.21.15.120:0/747599449 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f1c68051330 con 0x7f1c701573c0 2024-04-18T04:44:35.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.381+0000 7f1c78000640 1 -- 172.21.15.120:0/747599449 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c700c6140 con 0x7f1c701573c0 2024-04-18T04:44:35.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.381+0000 7f1c6d600640 1 -- 172.21.15.120:0/747599449 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f1c68054950 con 0x7f1c701573c0 2024-04-18T04:44:35.381 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:44:35.381 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":25,"fsid":"8e73592f-08e2-4957-a98f-9d044cec4ba5","created":"2024-04-18T04:44:06.139983+0000","modified":"2024-04-18T04:44:34.676253+0000","last_up_change":"2024-04-18T04:44:17.410146+0000","last_in_change":"2024-04-18T04:44:08.470250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T04:44:16.864728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T04:44:28.825773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T04:44:29.245857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-18T04:44:32.314302+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a80903bd-d9be-4fb9-af99-6125cb26bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":27468},{"type":"v1","addr":"172.21.15.120:6801","nonce":27468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":27468},{"type":"v1","addr":"172.21.15.120:6803","nonce":27468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":27468},{"type":"v1","addr":"172.21.15.120:6807","nonce":27468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":27468},{"type":"v1","addr":"172.21.15.120:6805","nonce":27468}]},"public_addr":"172.21.15.120:6801/27468","cluster_addr":"172.21.15.120:6803/27468","heartbeat_back_addr":"172.21.15.120:6807/27468","heartbeat_front_addr":"172.21.15.120:6805/27468","state":["exists","up"]},{"osd":1,"uuid":"8f5f004b-6870-4c78-8d50-9622e631ec25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":27470},{"type":"v1","addr":"172.21.15.120:6823","nonce":27470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":27470},{"type":"v1","addr":"172.21.15.120:6827","nonce":27470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":27470},{"type":"v1","addr":"172.21.15.120:6831","nonce":27470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":27470},{"type":"v1","addr":"172.21.15.120:6829","nonce":27470}]},"public_addr":"172.21.15.120:6823/27470","cluster_addr":"172.21.15.120:6827/27470","heartbeat_back_addr":"172.21.15.120:6831/27470","heartbeat_front_addr":"172.21.15.120:6829/27470","state":["exists","up"]},{"osd":2,"uuid":"6e228a2b-6103-4301-a8b5-ee81dbb1f920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":27471},{"type":"v1","addr":"172.21.15.120:6817","nonce":27471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":27471},{"type":"v1","addr":"172.21.15.120:6819","nonce":27471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":27471},{"type":"v1","addr":"172.21.15.120:6826","nonce":27471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":27471},{"type":"v1","addr":"172.21.15.120:6822","nonce":27471}]},"public_addr":"172.21.15.120:6817/27471","cluster_addr":"172.21.15.120:6819/27471","heartbeat_back_addr":"172.21.15.120:6826/27471","heartbeat_front_addr":"172.21.15.120:6822/27471","state":["exists","up"]},{"osd":3,"uuid":"7a5cabd7-d898-4e32-a03c-25b46e790134","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":27469},{"type":"v1","addr":"172.21.15.120:6809","nonce":27469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":27469},{"type":"v1","addr":"172.21.15.120:6811","nonce":27469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":27469},{"type":"v1","addr":"172.21.15.120:6815","nonce":27469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":27469},{"type":"v1","addr":"172.21.15.120:6813","nonce":27469}]},"public_addr":"172.21.15.120:6809/27469","cluster_addr":"172.21.15.120:6811/27469","heartbeat_back_addr":"172.21.15.120:6815/27469","heartbeat_front_addr":"172.21.15.120:6813/27469","state":["exists","up"]},{"osd":4,"uuid":"8e9f530f-6bab-4b23-a1a3-a71362fefcc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":28102},{"type":"v1","addr":"172.21.15.132:6825","nonce":28102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":28102},{"type":"v1","addr":"172.21.15.132:6827","nonce":28102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":28102},{"type":"v1","addr":"172.21.15.132:6831","nonce":28102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":28102},{"type":"v1","addr":"172.21.15.132:6829","nonce":28102}]},"public_addr":"172.21.15.132:6825/28102","cluster_addr":"172.21.15.132:6827/28102","heartbeat_back_addr":"172.21.15.132:6831/28102","heartbeat_front_addr":"172.21.15.132:6829/28102","state":["exists","up"]},{"osd":5,"uuid":"2243fabe-cc81-40cf-91bc-f106fe275a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":28104},{"type":"v1","addr":"172.21.15.132:6809","nonce":28104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":28104},{"type":"v1","addr":"172.21.15.132:6811","nonce":28104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":28104},{"type":"v1","addr":"172.21.15.132:6815","nonce":28104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":28104},{"type":"v1","addr":"172.21.15.132:6813","nonce":28104}]},"public_addr":"172.21.15.132:6809/28104","cluster_addr":"172.21.15.132:6811/28104","heartbeat_back_addr":"172.21.15.132:6815/28104","heartbeat_front_addr":"172.21.15.132:6813/28104","state":["exists","up"]},{"osd":6,"uuid":"c093a5ed-25c8-41a7-a20d-606a1a1661e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":28103},{"type":"v1","addr":"172.21.15.132:6801","nonce":28103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":28103},{"type":"v1","addr":"172.21.15.132:6803","nonce":28103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":28103},{"type":"v1","addr":"172.21.15.132:6807","nonce":28103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":28103},{"type":"v1","addr":"172.21.15.132:6805","nonce":28103}]},"public_addr":"172.21.15.132:6801/28103","cluster_addr":"172.21.15.132:6803/28103","heartbeat_back_addr":"172.21.15.132:6807/28103","heartbeat_front_addr":"172.21.15.132:6805/28103","state":["exists","up"]},{"osd":7,"uuid":"c37426b7-1080-4434-9f3e-a3afbbdc0fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":28129},{"type":"v1","addr":"172.21.15.132:6817","nonce":28129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":28129},{"type":"v1","addr":"172.21.15.132:6819","nonce":28129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":28129},{"type":"v1","addr":"172.21.15.132:6823","nonce":28129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":28129},{"type":"v1","addr":"172.21.15.132:6821","nonce":28129}]},"public_addr":"172.21.15.132:6817/28129","cluster_addr":"172.21.15.132:6819/28129","heartbeat_back_addr":"172.21.15.132:6823/28129","heartbeat_front_addr":"172.21.15.132:6821/28129","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.053825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.289753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.274645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.146361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.943883+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.701955+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.851076+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.800782+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T04:44:35.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.381+0000 7f1c78000640 1 -- 172.21.15.120:0/747599449 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1c50066690 msgr2=0x7f1c50068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:35.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.381+0000 7f1c78000640 1 --2- 172.21.15.120:0/747599449 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1c50066690 0x7f1c50068b50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1c64000f70 tx=0x7f1c64009040 comp rx=0 tx=0).stop 2024-04-18T04:44:35.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.381+0000 7f1c78000640 1 -- 172.21.15.120:0/747599449 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c701573c0 msgr2=0x7f1c700c48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:35.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.381+0000 7f1c78000640 1 --2- 172.21.15.120:0/747599449 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c701573c0 0x7f1c700c48c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1c6800c770 tx=0x7f1c6800cc30 comp rx=0 tx=0).stop 2024-04-18T04:44:35.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.381+0000 7f1c78000640 1 -- 172.21.15.120:0/747599449 shutdown_connections 2024-04-18T04:44:35.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.381+0000 7f1c78000640 1 --2- 172.21.15.120:0/747599449 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1c50066690 0x7f1c50068b50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:35.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.381+0000 7f1c78000640 1 --2- 172.21.15.120:0/747599449 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c701573c0 0x7f1c700c48c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:35.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.381+0000 7f1c78000640 1 --2- 172.21.15.120:0/747599449 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c701515e0 0x7f1c7006cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:35.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.381+0000 7f1c78000640 1 --2- 172.21.15.120:0/747599449 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c700ccee0 0x7f1c7014c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:35.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.381+0000 7f1c78000640 1 -- 172.21.15.120:0/747599449 >> 172.21.15.120:0/747599449 conn(0x7f1c7006e0f0 msgr2=0x7f1c7006fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:35.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.381+0000 7f1c78000640 1 -- 172.21.15.120:0/747599449 shutdown_connections 2024-04-18T04:44:35.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.381+0000 7f1c78000640 1 -- 172.21.15.120:0/747599449 wait complete. 2024-04-18T04:44:35.402 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T04:44:35.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.537+0000 7f64e0000640 1 Processor -- start 2024-04-18T04:44:35.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.537+0000 7f64e0000640 1 -- start start 2024-04-18T04:44:35.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.537+0000 7f64e0000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f64d80c7480 0x7f64d80c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:35.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.537+0000 7f64e0000640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f64d80bfe70 0x7f64d80c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:35.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.537+0000 7f64e0000640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64d806f9b0 con 0x7f64d8150340 2024-04-18T04:44:35.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.537+0000 7f64e0000640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64d8156b40 con 0x7f64d80bfe70 2024-04-18T04:44:35.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.537+0000 7f64e0000640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d80c0520 con 0x7f64d80c7480 2024-04-18T04:44:35.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.541+0000 7f64dcc00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f64d80c7480 0x7f64d80c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:35.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.541+0000 7f64dcc00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f64d80c7480 0x7f64d80c68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:53406/0 (socket says 172.21.15.120:53406) 2024-04-18T04:44:35.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.541+0000 7f64dcc00640 1 -- 172.21.15.120:0/728535041 learned_addr learned my addr 172.21.15.120:0/728535041 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:35.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.541+0000 7f64de000640 1 --2- 172.21.15.120:0/728535041 >> v2:172.21.15.132:3300/0 conn(0x7f64d80bfe70 0x7f64d80c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:35.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.541+0000 7f64dcc00640 1 -- 172.21.15.120:0/728535041 >> v2:172.21.15.132:3300/0 conn(0x7f64d80bfe70 msgr2=0x7f64d80c6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:35.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.541+0000 7f64dcc00640 1 --2- 172.21.15.120:0/728535041 >> v2:172.21.15.132:3300/0 conn(0x7f64d80bfe70 0x7f64d80c6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:35.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.541+0000 7f64dcc00640 1 -- 172.21.15.120:0/728535041 >> v1:172.21.15.132:6789/0 conn(0x7f64d8150340 legacy=0x7f64d8156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:35.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.541+0000 7f64dcc00640 1 -- 172.21.15.120:0/728535041 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d80c0800 con 0x7f64d80c7480 2024-04-18T04:44:35.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.541+0000 7f64dcc00640 1 --2- 172.21.15.120:0/728535041 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f64d80c7480 0x7f64d80c68d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f64c4009870 tx=0x7f64c401ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b951791a4289217 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:35.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.545+0000 7f64d7e00640 1 -- 172.21.15.120:0/728535041 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c40a8a50 con 0x7f64d80c7480 2024-04-18T04:44:35.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.545+0000 7f64d7e00640 1 -- 172.21.15.120:0/728535041 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c40a8bb0 con 0x7f64d80c7480 2024-04-18T04:44:35.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.545+0000 7f64d7e00640 1 -- 172.21.15.120:0/728535041 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c40b0440 con 0x7f64d80c7480 2024-04-18T04:44:35.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.545+0000 7f64e0000640 1 -- 172.21.15.120:0/728535041 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f64d80c7480 msgr2=0x7f64d80c68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:35.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.545+0000 7f64e0000640 1 --2- 172.21.15.120:0/728535041 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f64d80c7480 0x7f64d80c68d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f64c4009870 tx=0x7f64c401ed50 comp rx=0 tx=0).stop 2024-04-18T04:44:35.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.545+0000 7f64e0000640 1 -- 172.21.15.120:0/728535041 shutdown_connections 2024-04-18T04:44:35.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.545+0000 7f64e0000640 1 --2- 172.21.15.120:0/728535041 >> v2:172.21.15.132:3300/0 conn(0x7f64d80bfe70 0x7f64d80c6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:35.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.545+0000 7f64e0000640 1 --2- 172.21.15.120:0/728535041 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f64d80c7480 0x7f64d80c68d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:35.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.545+0000 7f64e0000640 1 -- 172.21.15.120:0/728535041 >> 172.21.15.120:0/728535041 conn(0x7f64d80c78c0 msgr2=0x7f64d80c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:35.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.545+0000 7f64e0000640 1 -- 172.21.15.120:0/728535041 shutdown_connections 2024-04-18T04:44:35.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.545+0000 7f64e0000640 1 -- 172.21.15.120:0/728535041 wait complete. 2024-04-18T04:44:35.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.545+0000 7f64e0000640 1 Processor -- start 2024-04-18T04:44:35.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.545+0000 7f64e0000640 1 -- start start 2024-04-18T04:44:35.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.545+0000 7f64e0000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f64d80bfe70 0x7f64d814a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:35.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.545+0000 7f64e0000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64d80c7480 0x7f64d8155d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:35.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.545+0000 7f64e0000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f64d8150340 0x7f64d814b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:35.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.545+0000 7f64e0000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d81562d0 con 0x7f64d80c7480 2024-04-18T04:44:35.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.545+0000 7f64e0000640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d81463d0 con 0x7f64d80bfe70 2024-04-18T04:44:35.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.545+0000 7f64e0000640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d80c9700 con 0x7f64d8150340 2024-04-18T04:44:35.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.545+0000 7f64dcc00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64d80c7480 0x7f64d8155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:35.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.545+0000 7f64dcc00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64d80c7480 0x7f64d8155d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53376/0 (socket says 172.21.15.120:53376) 2024-04-18T04:44:35.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.545+0000 7f64dcc00640 1 -- 172.21.15.120:0/206028484 learned_addr learned my addr 172.21.15.120:0/206028484 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:35.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.545+0000 7f64de000640 1 --2- 172.21.15.120:0/206028484 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f64d8150340 0x7f64d814b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:35.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.545+0000 7f64dd600640 1 --2- 172.21.15.120:0/206028484 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f64d80bfe70 0x7f64d814a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:35.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.549+0000 7f64dcc00640 1 -- 172.21.15.120:0/206028484 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f64d8150340 msgr2=0x7f64d814b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:35.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.549+0000 7f64dcc00640 1 --2- 172.21.15.120:0/206028484 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f64d8150340 0x7f64d814b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:35.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.549+0000 7f64dcc00640 1 -- 172.21.15.120:0/206028484 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f64d80bfe70 msgr2=0x7f64d814a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:35.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.549+0000 7f64dcc00640 1 --2- 172.21.15.120:0/206028484 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f64d80bfe70 0x7f64d814a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:35.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.549+0000 7f64dcc00640 1 -- 172.21.15.120:0/206028484 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c40094d0 con 0x7f64d80c7480 2024-04-18T04:44:35.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.549+0000 7f64dcc00640 1 --2- 172.21.15.120:0/206028484 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64d80c7480 0x7f64d8155d90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f64c4000c10 tx=0x7f64c401baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:35.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.549+0000 7f64d5600640 1 -- 172.21.15.120:0/206028484 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c40bf070 con 0x7f64d80c7480 2024-04-18T04:44:35.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.549+0000 7f64d5600640 1 -- 172.21.15.120:0/206028484 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c40b1be0 con 0x7f64d80c7480 2024-04-18T04:44:35.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.549+0000 7f64e0000640 1 -- 172.21.15.120:0/206028484 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64d8155660 con 0x7f64d80c7480 2024-04-18T04:44:35.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.549+0000 7f64d5600640 1 -- 172.21.15.120:0/206028484 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c40b9410 con 0x7f64d80c7480 2024-04-18T04:44:35.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.549+0000 7f64e0000640 1 -- 172.21.15.120:0/206028484 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64d80c9f60 con 0x7f64d80c7480 2024-04-18T04:44:35.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.549+0000 7f64e0000640 1 -- 172.21.15.120:0/206028484 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64d80726d0 con 0x7f64d80c7480 2024-04-18T04:44:35.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.549+0000 7f64d5600640 1 -- 172.21.15.120:0/206028484 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f64c40b7040 con 0x7f64d80c7480 2024-04-18T04:44:35.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.549+0000 7f64d5600640 1 --2- 172.21.15.120:0/206028484 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f64b8066690 0x7f64b8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:35.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.549+0000 7f64d5600640 1 -- 172.21.15.120:0/206028484 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f64c41217a0 con 0x7f64d80c7480 2024-04-18T04:44:35.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.549+0000 7f64dd600640 1 --2- 172.21.15.120:0/206028484 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f64b8066690 0x7f64b8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:35.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.553+0000 7f64dd600640 1 --2- 172.21.15.120:0/206028484 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f64b8066690 0x7f64b8068b50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f64cc001770 tx=0x7f64cc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:35.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.553+0000 7f64d5600640 1 -- 172.21.15.120:0/206028484 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f64c40ee8c0 con 0x7f64d80c7480 2024-04-18T04:44:35.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.709+0000 7f64e0000640 1 -- 172.21.15.120:0/206028484 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64d80c98c0 con 0x7f64d80c7480 2024-04-18T04:44:35.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.713+0000 7f64d5600640 1 -- 172.21.15.120:0/206028484 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f64d80c98c0 con 0x7f64d80c7480 2024-04-18T04:44:35.712 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:44:35.712 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":25,"fsid":"8e73592f-08e2-4957-a98f-9d044cec4ba5","created":"2024-04-18T04:44:06.139983+0000","modified":"2024-04-18T04:44:34.676253+0000","last_up_change":"2024-04-18T04:44:17.410146+0000","last_in_change":"2024-04-18T04:44:08.470250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T04:44:16.864728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T04:44:28.825773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T04:44:29.245857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-18T04:44:32.314302+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a80903bd-d9be-4fb9-af99-6125cb26bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":27468},{"type":"v1","addr":"172.21.15.120:6801","nonce":27468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":27468},{"type":"v1","addr":"172.21.15.120:6803","nonce":27468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":27468},{"type":"v1","addr":"172.21.15.120:6807","nonce":27468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":27468},{"type":"v1","addr":"172.21.15.120:6805","nonce":27468}]},"public_addr":"172.21.15.120:6801/27468","cluster_addr":"172.21.15.120:6803/27468","heartbeat_back_addr":"172.21.15.120:6807/27468","heartbeat_front_addr":"172.21.15.120:6805/27468","state":["exists","up"]},{"osd":1,"uuid":"8f5f004b-6870-4c78-8d50-9622e631ec25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":27470},{"type":"v1","addr":"172.21.15.120:6823","nonce":27470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":27470},{"type":"v1","addr":"172.21.15.120:6827","nonce":27470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":27470},{"type":"v1","addr":"172.21.15.120:6831","nonce":27470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":27470},{"type":"v1","addr":"172.21.15.120:6829","nonce":27470}]},"public_addr":"172.21.15.120:6823/27470","cluster_addr":"172.21.15.120:6827/27470","heartbeat_back_addr":"172.21.15.120:6831/27470","heartbeat_front_addr":"172.21.15.120:6829/27470","state":["exists","up"]},{"osd":2,"uuid":"6e228a2b-6103-4301-a8b5-ee81dbb1f920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":27471},{"type":"v1","addr":"172.21.15.120:6817","nonce":27471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":27471},{"type":"v1","addr":"172.21.15.120:6819","nonce":27471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":27471},{"type":"v1","addr":"172.21.15.120:6826","nonce":27471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":27471},{"type":"v1","addr":"172.21.15.120:6822","nonce":27471}]},"public_addr":"172.21.15.120:6817/27471","cluster_addr":"172.21.15.120:6819/27471","heartbeat_back_addr":"172.21.15.120:6826/27471","heartbeat_front_addr":"172.21.15.120:6822/27471","state":["exists","up"]},{"osd":3,"uuid":"7a5cabd7-d898-4e32-a03c-25b46e790134","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":27469},{"type":"v1","addr":"172.21.15.120:6809","nonce":27469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":27469},{"type":"v1","addr":"172.21.15.120:6811","nonce":27469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":27469},{"type":"v1","addr":"172.21.15.120:6815","nonce":27469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":27469},{"type":"v1","addr":"172.21.15.120:6813","nonce":27469}]},"public_addr":"172.21.15.120:6809/27469","cluster_addr":"172.21.15.120:6811/27469","heartbeat_back_addr":"172.21.15.120:6815/27469","heartbeat_front_addr":"172.21.15.120:6813/27469","state":["exists","up"]},{"osd":4,"uuid":"8e9f530f-6bab-4b23-a1a3-a71362fefcc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":28102},{"type":"v1","addr":"172.21.15.132:6825","nonce":28102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":28102},{"type":"v1","addr":"172.21.15.132:6827","nonce":28102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":28102},{"type":"v1","addr":"172.21.15.132:6831","nonce":28102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":28102},{"type":"v1","addr":"172.21.15.132:6829","nonce":28102}]},"public_addr":"172.21.15.132:6825/28102","cluster_addr":"172.21.15.132:6827/28102","heartbeat_back_addr":"172.21.15.132:6831/28102","heartbeat_front_addr":"172.21.15.132:6829/28102","state":["exists","up"]},{"osd":5,"uuid":"2243fabe-cc81-40cf-91bc-f106fe275a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":28104},{"type":"v1","addr":"172.21.15.132:6809","nonce":28104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":28104},{"type":"v1","addr":"172.21.15.132:6811","nonce":28104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":28104},{"type":"v1","addr":"172.21.15.132:6815","nonce":28104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":28104},{"type":"v1","addr":"172.21.15.132:6813","nonce":28104}]},"public_addr":"172.21.15.132:6809/28104","cluster_addr":"172.21.15.132:6811/28104","heartbeat_back_addr":"172.21.15.132:6815/28104","heartbeat_front_addr":"172.21.15.132:6813/28104","state":["exists","up"]},{"osd":6,"uuid":"c093a5ed-25c8-41a7-a20d-606a1a1661e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":28103},{"type":"v1","addr":"172.21.15.132:6801","nonce":28103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":28103},{"type":"v1","addr":"172.21.15.132:6803","nonce":28103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":28103},{"type":"v1","addr":"172.21.15.132:6807","nonce":28103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":28103},{"type":"v1","addr":"172.21.15.132:6805","nonce":28103}]},"public_addr":"172.21.15.132:6801/28103","cluster_addr":"172.21.15.132:6803/28103","heartbeat_back_addr":"172.21.15.132:6807/28103","heartbeat_front_addr":"172.21.15.132:6805/28103","state":["exists","up"]},{"osd":7,"uuid":"c37426b7-1080-4434-9f3e-a3afbbdc0fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":28129},{"type":"v1","addr":"172.21.15.132:6817","nonce":28129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":28129},{"type":"v1","addr":"172.21.15.132:6819","nonce":28129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":28129},{"type":"v1","addr":"172.21.15.132:6823","nonce":28129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":28129},{"type":"v1","addr":"172.21.15.132:6821","nonce":28129}]},"public_addr":"172.21.15.132:6817/28129","cluster_addr":"172.21.15.132:6819/28129","heartbeat_back_addr":"172.21.15.132:6823/28129","heartbeat_front_addr":"172.21.15.132:6821/28129","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.053825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.289753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.274645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.146361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.943883+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.701955+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.851076+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.800782+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T04:44:35.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.713+0000 7f64e0000640 1 -- 172.21.15.120:0/206028484 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f64b8066690 msgr2=0x7f64b8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:35.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.713+0000 7f64e0000640 1 --2- 172.21.15.120:0/206028484 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f64b8066690 0x7f64b8068b50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f64cc001770 tx=0x7f64cc009040 comp rx=0 tx=0).stop 2024-04-18T04:44:35.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.713+0000 7f64e0000640 1 -- 172.21.15.120:0/206028484 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64d80c7480 msgr2=0x7f64d8155d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:35.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.713+0000 7f64e0000640 1 --2- 172.21.15.120:0/206028484 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64d80c7480 0x7f64d8155d90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f64c4000c10 tx=0x7f64c401baf0 comp rx=0 tx=0).stop 2024-04-18T04:44:35.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.713+0000 7f64e0000640 1 -- 172.21.15.120:0/206028484 shutdown_connections 2024-04-18T04:44:35.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.713+0000 7f64e0000640 1 --2- 172.21.15.120:0/206028484 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f64b8066690 0x7f64b8068b50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:35.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.713+0000 7f64e0000640 1 --2- 172.21.15.120:0/206028484 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f64d8150340 0x7f64d814b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:35.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.713+0000 7f64e0000640 1 --2- 172.21.15.120:0/206028484 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64d80c7480 0x7f64d8155d90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:35.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.713+0000 7f64e0000640 1 --2- 172.21.15.120:0/206028484 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f64d80bfe70 0x7f64d814a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:35.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.713+0000 7f64e0000640 1 -- 172.21.15.120:0/206028484 >> 172.21.15.120:0/206028484 conn(0x7f64d80c78c0 msgr2=0x7f64d81e3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:35.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.713+0000 7f64e0000640 1 -- 172.21.15.120:0/206028484 shutdown_connections 2024-04-18T04:44:35.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.713+0000 7f64e0000640 1 -- 172.21.15.120:0/206028484 wait complete. 2024-04-18T04:44:35.751 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:44:35.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.885+0000 7fa7cbc00640 1 Processor -- start 2024-04-18T04:44:35.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.885+0000 7fa7cbc00640 1 -- start start 2024-04-18T04:44:35.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.885+0000 7fa7cbc00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa7c4153820 0x7fa7c41595c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:35.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.885+0000 7fa7cbc00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa7c406e7d0 0x7fa7c40c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:35.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.885+0000 7fa7cbc00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7c40701f0 con 0x7fa7c40c8790 2024-04-18T04:44:35.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.885+0000 7fa7cbc00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7c4071b10 con 0x7fa7c406e7d0 2024-04-18T04:44:35.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.885+0000 7fa7cbc00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7c4159c00 con 0x7fa7c4153820 2024-04-18T04:44:35.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.885+0000 7fa7c3e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa7c406e7d0 0x7fa7c40c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:35.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.885+0000 7fa7c9c00640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fa7c40c8790 0x7fa7c40cb590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:38412/0 (socket says 172.21.15.120:38412) 2024-04-18T04:44:35.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.885+0000 7fa7c9c00640 1 -- 172.21.15.120:0/3144451624 learned_addr learned my addr 172.21.15.120:0/3144451624 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:44:35.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.889+0000 7fa7c9200640 1 --2- 172.21.15.120:0/3144451624 >> v2:172.21.15.132:3300/0 conn(0x7fa7c4153820 0x7fa7c41595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:35.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.889+0000 7fa7c3e00640 1 -- 172.21.15.120:0/3144451624 >> v2:172.21.15.132:3300/0 conn(0x7fa7c4153820 msgr2=0x7fa7c41595c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:35.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.889+0000 7fa7c3e00640 1 --2- 172.21.15.120:0/3144451624 >> v2:172.21.15.132:3300/0 conn(0x7fa7c4153820 0x7fa7c41595c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:35.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.889+0000 7fa7c3e00640 1 -- 172.21.15.120:0/3144451624 >> v1:172.21.15.120:6789/0 conn(0x7fa7c40c8790 legacy=0x7fa7c40cb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:35.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.889+0000 7fa7c3e00640 1 -- 172.21.15.120:0/3144451624 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c4159ee0 con 0x7fa7c406e7d0 2024-04-18T04:44:35.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.889+0000 7fa7c3400640 1 -- 172.21.15.120:0/3144451624 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1244389391 0 0) 0x7fa7c40701f0 con 0x7fa7c40c8790 2024-04-18T04:44:35.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.889+0000 7fa7c3e00640 1 --2- 172.21.15.120:0/3144451624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7c406e7d0 0x7fa7c40c78b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa7c40c7f40 tx=0x7fa7b001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a01e5901d06c09b server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:35.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.889+0000 7fa7c3400640 1 -- 172.21.15.120:0/3144451624 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b00a8970 con 0x7fa7c406e7d0 2024-04-18T04:44:35.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.889+0000 7fa7c3400640 1 -- 172.21.15.120:0/3144451624 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b00a8ad0 con 0x7fa7c406e7d0 2024-04-18T04:44:35.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.889+0000 7fa7c3400640 1 -- 172.21.15.120:0/3144451624 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b00a8e60 con 0x7fa7c406e7d0 2024-04-18T04:44:35.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.889+0000 7fa7cbc00640 1 -- 172.21.15.120:0/3144451624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7c406e7d0 msgr2=0x7fa7c40c78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:35.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.889+0000 7fa7cbc00640 1 --2- 172.21.15.120:0/3144451624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7c406e7d0 0x7fa7c40c78b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa7c40c7f40 tx=0x7fa7b001ec70 comp rx=0 tx=0).stop 2024-04-18T04:44:35.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.893+0000 7fa7cbc00640 1 -- 172.21.15.120:0/3144451624 shutdown_connections 2024-04-18T04:44:35.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.893+0000 7fa7cbc00640 1 --2- 172.21.15.120:0/3144451624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7c406e7d0 0x7fa7c40c78b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:35.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.893+0000 7fa7cbc00640 1 --2- 172.21.15.120:0/3144451624 >> v2:172.21.15.132:3300/0 conn(0x7fa7c4153820 0x7fa7c41595c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:35.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.893+0000 7fa7cbc00640 1 -- 172.21.15.120:0/3144451624 >> 172.21.15.120:0/3144451624 conn(0x7fa7c4066450 msgr2=0x7fa7c406dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:35.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.893+0000 7fa7cbc00640 1 -- 172.21.15.120:0/3144451624 shutdown_connections 2024-04-18T04:44:35.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.893+0000 7fa7cbc00640 1 -- 172.21.15.120:0/3144451624 wait complete. 2024-04-18T04:44:35.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.893+0000 7fa7cbc00640 1 Processor -- start 2024-04-18T04:44:35.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.893+0000 7fa7cbc00640 1 -- start start 2024-04-18T04:44:35.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.893+0000 7fa7cbc00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa7c406e7d0 0x7fa7c41f25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:35.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.893+0000 7fa7cbc00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7c40c8790 0x7fa7c41efa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:35.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.893+0000 7fa7cbc00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7c4153820 0x7fa7c40c4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:35.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.893+0000 7fa7cbc00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c41ef080 con 0x7fa7c40c8790 2024-04-18T04:44:35.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.893+0000 7fa7cbc00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c41f3540 con 0x7fa7c4153820 2024-04-18T04:44:35.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.893+0000 7fa7cbc00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c415a7f0 con 0x7fa7c406e7d0 2024-04-18T04:44:35.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.893+0000 7fa7c3e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7c40c8790 0x7fa7c41efa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:35.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.893+0000 7fa7c3e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7c40c8790 0x7fa7c41efa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53382/0 (socket says 172.21.15.120:53382) 2024-04-18T04:44:35.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.893+0000 7fa7c3e00640 1 -- 172.21.15.120:0/2603608122 learned_addr learned my addr 172.21.15.120:0/2603608122 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:35.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.893+0000 7fa7c9200640 1 --2- 172.21.15.120:0/2603608122 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa7c406e7d0 0x7fa7c41f25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:35.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.893+0000 7fa7c9c00640 1 --2- 172.21.15.120:0/2603608122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7c4153820 0x7fa7c40c4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:35.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.893+0000 7fa7c3e00640 1 -- 172.21.15.120:0/2603608122 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa7c406e7d0 msgr2=0x7fa7c41f25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:35.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.893+0000 7fa7c3e00640 1 --2- 172.21.15.120:0/2603608122 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa7c406e7d0 0x7fa7c41f25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:35.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.893+0000 7fa7c3e00640 1 -- 172.21.15.120:0/2603608122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7c4153820 msgr2=0x7fa7c40c4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:35.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.893+0000 7fa7c3e00640 1 --2- 172.21.15.120:0/2603608122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7c4153820 0x7fa7c40c4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:35.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.893+0000 7fa7c3e00640 1 -- 172.21.15.120:0/2603608122 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b0009420 con 0x7fa7c40c8790 2024-04-18T04:44:35.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.893+0000 7fa7c9200640 1 --2- 172.21.15.120:0/2603608122 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa7c406e7d0 0x7fa7c41f25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:44:35.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.893+0000 7fa7c3e00640 1 --2- 172.21.15.120:0/2603608122 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7c40c8790 0x7fa7c41efa90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa7b00b3040 tx=0x7fa7b001ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:35.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.893+0000 7fa7c0c00640 1 -- 172.21.15.120:0/2603608122 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b00b9630 con 0x7fa7c40c8790 2024-04-18T04:44:35.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.893+0000 7fa7c0c00640 1 -- 172.21.15.120:0/2603608122 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b00b97b0 con 0x7fa7c40c8790 2024-04-18T04:44:35.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.897+0000 7fa7c0c00640 1 -- 172.21.15.120:0/2603608122 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b00b9b60 con 0x7fa7c40c8790 2024-04-18T04:44:35.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.897+0000 7fa7cbc00640 1 -- 172.21.15.120:0/2603608122 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7c41effd0 con 0x7fa7c40c8790 2024-04-18T04:44:35.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.897+0000 7fa7cbc00640 1 -- 172.21.15.120:0/2603608122 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7c41f2f80 con 0x7fa7c40c8790 2024-04-18T04:44:35.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.897+0000 7fa7cbc00640 1 -- 172.21.15.120:0/2603608122 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7c406e340 con 0x7fa7c40c8790 2024-04-18T04:44:35.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.897+0000 7fa7c0c00640 1 -- 172.21.15.120:0/2603608122 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa7b00b7040 con 0x7fa7c40c8790 2024-04-18T04:44:35.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.897+0000 7fa7c0c00640 1 --2- 172.21.15.120:0/2603608122 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fa7a4066690 0x7fa7a4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:35.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.897+0000 7fa7c0c00640 1 -- 172.21.15.120:0/2603608122 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa7b0122630 con 0x7fa7c40c8790 2024-04-18T04:44:35.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.897+0000 7fa7c9200640 1 --2- 172.21.15.120:0/2603608122 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fa7a4066690 0x7fa7a4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:35.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.901+0000 7fa7c9200640 1 --2- 172.21.15.120:0/2603608122 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fa7a4066690 0x7fa7a4068b50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa7b800b9f0 tx=0x7fa7b8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:35.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:35.901+0000 7fa7c0c00640 1 -- 172.21.15.120:0/2603608122 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fa7b00ef6a0 con 0x7fa7c40c8790 2024-04-18T04:44:36.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.089+0000 7fa7cbc00640 1 -- 172.21.15.120:0/2603608122 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7c4072a70 con 0x7fa7c40c8790 2024-04-18T04:44:36.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.089+0000 7fa7c0c00640 1 -- 172.21.15.120:0/2603608122 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+6254 (secure 0 0 0) 0x7fa7b00b5090 con 0x7fa7c40c8790 2024-04-18T04:44:36.088 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:44:36.088 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/1552155328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1552155328},{"type":"v1","addr":"172.21.15.132:6835","nonce":1552155328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6833/2564667113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2564667113},{"type":"v1","addr":"172.21.15.120:6833","nonce":2564667113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:44:35.678432+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-18T04:44:36.088 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 7 2024-04-18T04:44:36.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.089+0000 7fa7cbc00640 1 -- 172.21.15.120:0/2603608122 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fa7a4066690 msgr2=0x7fa7a4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:36.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.089+0000 7fa7cbc00640 1 --2- 172.21.15.120:0/2603608122 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fa7a4066690 0x7fa7a4068b50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa7b800b9f0 tx=0x7fa7b8008040 comp rx=0 tx=0).stop 2024-04-18T04:44:36.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.089+0000 7fa7cbc00640 1 -- 172.21.15.120:0/2603608122 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7c40c8790 msgr2=0x7fa7c41efa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:36.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.089+0000 7fa7cbc00640 1 --2- 172.21.15.120:0/2603608122 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7c40c8790 0x7fa7c41efa90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa7b00b3040 tx=0x7fa7b001ba10 comp rx=0 tx=0).stop 2024-04-18T04:44:36.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.089+0000 7fa7cbc00640 1 -- 172.21.15.120:0/2603608122 shutdown_connections 2024-04-18T04:44:36.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.089+0000 7fa7cbc00640 1 --2- 172.21.15.120:0/2603608122 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fa7a4066690 0x7fa7a4068b50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:36.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.089+0000 7fa7cbc00640 1 --2- 172.21.15.120:0/2603608122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7c4153820 0x7fa7c40c4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:36.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.089+0000 7fa7cbc00640 1 --2- 172.21.15.120:0/2603608122 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7c40c8790 0x7fa7c41efa90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:36.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.089+0000 7fa7cbc00640 1 --2- 172.21.15.120:0/2603608122 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa7c406e7d0 0x7fa7c41f25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:36.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.089+0000 7fa7cbc00640 1 -- 172.21.15.120:0/2603608122 >> 172.21.15.120:0/2603608122 conn(0x7fa7c4066450 msgr2=0x7fa7c40cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:36.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.089+0000 7fa7cbc00640 1 -- 172.21.15.120:0/2603608122 shutdown_connections 2024-04-18T04:44:36.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.089+0000 7fa7cbc00640 1 -- 172.21.15.120:0/2603608122 wait complete. 2024-04-18T04:44:36.108 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T04:44:36.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.245+0000 7fc926200640 1 Processor -- start 2024-04-18T04:44:36.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.245+0000 7fc926200640 1 -- start start 2024-04-18T04:44:36.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.245+0000 7fc926200640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc92006b8c0 0x7fc9200c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:36.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.249+0000 7fc926200640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc92006c560 con 0x7fc92006bca0 2024-04-18T04:44:36.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.249+0000 7fc926200640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9201576f0 con 0x7fc92006c0f0 2024-04-18T04:44:36.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.249+0000 7fc926200640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc920158610 con 0x7fc92006b8c0 2024-04-18T04:44:36.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.249+0000 7fc916a00640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fc92006bca0 0x7fc920151440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:38420/0 (socket says 172.21.15.120:38420) 2024-04-18T04:44:36.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.249+0000 7fc916a00640 1 -- 172.21.15.120:0/3658488116 learned_addr learned my addr 172.21.15.120:0/3658488116 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:44:36.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.249+0000 7fc91f400640 1 --2- 172.21.15.120:0/3658488116 >> v2:172.21.15.132:3300/0 conn(0x7fc92006b8c0 0x7fc9200c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:36.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.249+0000 7fc91ea00640 1 -- 172.21.15.120:0/3658488116 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2463994968 0 0) 0x7fc92006c560 con 0x7fc92006bca0 2024-04-18T04:44:36.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.249+0000 7fc91ea00640 1 -- 172.21.15.120:0/3658488116 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc904003530 con 0x7fc92006bca0 2024-04-18T04:44:36.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.249+0000 7fc91ea00640 1 -- 172.21.15.120:0/3658488116 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 416723344 0 0) 0x7fc904003530 con 0x7fc92006bca0 2024-04-18T04:44:36.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.249+0000 7fc91ea00640 1 -- 172.21.15.120:0/3658488116 >> v2:172.21.15.132:3300/0 conn(0x7fc92006b8c0 msgr2=0x7fc9200c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:36.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.249+0000 7fc91ea00640 1 --2- 172.21.15.120:0/3658488116 >> v2:172.21.15.132:3300/0 conn(0x7fc92006b8c0 0x7fc9200c7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:36.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.249+0000 7fc91ea00640 1 -- 172.21.15.120:0/3658488116 >> v1:172.21.15.132:6789/0 conn(0x7fc92006c0f0 legacy=0x7fc920070750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:36.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.249+0000 7fc91ea00640 1 -- 172.21.15.120:0/3658488116 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc920157990 con 0x7fc92006bca0 2024-04-18T04:44:36.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.249+0000 7fc91ea00640 1 -- 172.21.15.120:0/3658488116 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7fc908001680 con 0x7fc92006bca0 2024-04-18T04:44:36.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.249+0000 7fc91f400640 1 --2- 172.21.15.120:0/3658488116 >> v2:172.21.15.132:3300/0 conn(0x7fc92006b8c0 0x7fc9200c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:44:36.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.249+0000 7fc91ea00640 1 -- 172.21.15.120:0/3658488116 >> v1:172.21.15.120:6789/0 conn(0x7fc92006bca0 legacy=0x7fc920151440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:36.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.249+0000 7fc91ea00640 1 --2- 172.21.15.120:0/3658488116 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc904003980 0x7fc904003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:36.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.249+0000 7fc91ea00640 1 --2- 172.21.15.120:0/3658488116 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc9040047d0 0x7fc904004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:36.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.249+0000 7fc91ea00640 1 --2- 172.21.15.120:0/3658488116 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc904005190 0x7fc90400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:36.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.249+0000 7fc91ea00640 1 -- 172.21.15.120:0/3658488116 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc920158610 con 0x7fc904005190 2024-04-18T04:44:36.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.249+0000 7fc91ea00640 1 -- 172.21.15.120:0/3658488116 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc90400c040 con 0x7fc9040047d0 2024-04-18T04:44:36.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.249+0000 7fc91ea00640 1 -- 172.21.15.120:0/3658488116 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc90400c200 con 0x7fc904003980 2024-04-18T04:44:36.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.249+0000 7fc91fe00640 1 --2- 172.21.15.120:0/3658488116 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc904005190 0x7fc90400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:36.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.249+0000 7fc91f400640 1 --2- 172.21.15.120:0/3658488116 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc904003980 0x7fc904003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:36.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.249+0000 7fc916a00640 1 --2- 172.21.15.120:0/3658488116 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc9040047d0 0x7fc904004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:36.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.249+0000 7fc91fe00640 1 -- 172.21.15.120:0/3658488116 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc904003980 msgr2=0x7fc904003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:36.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.249+0000 7fc91fe00640 1 --2- 172.21.15.120:0/3658488116 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc904003980 0x7fc904003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:36.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.249+0000 7fc91fe00640 1 -- 172.21.15.120:0/3658488116 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc9040047d0 msgr2=0x7fc904004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:36.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.249+0000 7fc91fe00640 1 --2- 172.21.15.120:0/3658488116 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc9040047d0 0x7fc904004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:36.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.249+0000 7fc91fe00640 1 -- 172.21.15.120:0/3658488116 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc904003530 con 0x7fc904005190 2024-04-18T04:44:36.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.253+0000 7fc91fe00640 1 -- 172.21.15.120:0/3658488116 reap_dead start 2024-04-18T04:44:36.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.253+0000 7fc91fe00640 1 --2- 172.21.15.120:0/3658488116 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc904005190 0x7fc90400b990 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc918001e70 tx=0x7fc91801c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d37be30d0702b22d server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:36.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.253+0000 7fc91ea00640 1 -- 172.21.15.120:0/3658488116 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc918003b80 con 0x7fc904005190 2024-04-18T04:44:36.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.253+0000 7fc91ea00640 1 -- 172.21.15.120:0/3658488116 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc918003d00 con 0x7fc904005190 2024-04-18T04:44:36.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.253+0000 7fc91ea00640 1 -- 172.21.15.120:0/3658488116 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc918005260 con 0x7fc904005190 2024-04-18T04:44:36.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.253+0000 7fc926200640 1 -- 172.21.15.120:0/3658488116 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc904005190 msgr2=0x7fc90400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:36.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.253+0000 7fc926200640 1 --2- 172.21.15.120:0/3658488116 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc904005190 0x7fc90400b990 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc918001e70 tx=0x7fc91801c780 comp rx=0 tx=0).stop 2024-04-18T04:44:36.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.253+0000 7fc926200640 1 -- 172.21.15.120:0/3658488116 shutdown_connections 2024-04-18T04:44:36.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.253+0000 7fc926200640 1 --2- 172.21.15.120:0/3658488116 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc904005190 0x7fc90400b990 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:36.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.253+0000 7fc926200640 1 -- 172.21.15.120:0/3658488116 >> 172.21.15.120:0/3658488116 conn(0x7fc9200c78c0 msgr2=0x7fc9200c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:36.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.253+0000 7fc926200640 1 -- 172.21.15.120:0/3658488116 shutdown_connections 2024-04-18T04:44:36.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.253+0000 7fc926200640 1 -- 172.21.15.120:0/3658488116 wait complete. 2024-04-18T04:44:36.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.253+0000 7fc926200640 1 Processor -- start 2024-04-18T04:44:36.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.253+0000 7fc926200640 1 -- start start 2024-04-18T04:44:36.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.257+0000 7fc926200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc904005190 0x7fc9201591b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:36.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.257+0000 7fc926200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc920149650 0x7fc920149ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:36.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.257+0000 7fc926200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc9201ecd50 0x7fc9201ed1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:36.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.257+0000 7fc926200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92014a010 con 0x7fc904005190 2024-04-18T04:44:36.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.257+0000 7fc926200640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92014c8e0 con 0x7fc920149650 2024-04-18T04:44:36.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.257+0000 7fc926200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9201ed710 con 0x7fc9201ecd50 2024-04-18T04:44:36.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.257+0000 7fc91f400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc904005190 0x7fc9201591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:36.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.257+0000 7fc91f400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc904005190 0x7fc9201591b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53396/0 (socket says 172.21.15.120:53396) 2024-04-18T04:44:36.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.257+0000 7fc91f400640 1 -- 172.21.15.120:0/269873094 learned_addr learned my addr 172.21.15.120:0/269873094 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:36.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.257+0000 7fc916a00640 1 --2- 172.21.15.120:0/269873094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc920149650 0x7fc920149ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:36.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.257+0000 7fc91fe00640 1 --2- 172.21.15.120:0/269873094 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc9201ecd50 0x7fc9201ed1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:36.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.257+0000 7fc91f400640 1 -- 172.21.15.120:0/269873094 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc9201ecd50 msgr2=0x7fc9201ed1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:36.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.257+0000 7fc91f400640 1 --2- 172.21.15.120:0/269873094 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc9201ecd50 0x7fc9201ed1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:36.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.257+0000 7fc91f400640 1 -- 172.21.15.120:0/269873094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc920149650 msgr2=0x7fc920149ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:36.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.257+0000 7fc91f400640 1 --2- 172.21.15.120:0/269873094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc920149650 0x7fc920149ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:36.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.257+0000 7fc91f400640 1 -- 172.21.15.120:0/269873094 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9201ec850 con 0x7fc904005190 2024-04-18T04:44:36.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.257+0000 7fc916a00640 1 --2- 172.21.15.120:0/269873094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc920149650 0x7fc920149ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:44:36.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.257+0000 7fc91f400640 1 --2- 172.21.15.120:0/269873094 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc904005190 0x7fc9201591b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc910011a60 tx=0x7fc910011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:36.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.257+0000 7fc917e00640 1 -- 172.21.15.120:0/269873094 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91000fc70 con 0x7fc904005190 2024-04-18T04:44:36.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.257+0000 7fc917e00640 1 -- 172.21.15.120:0/269873094 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc91000fdd0 con 0x7fc904005190 2024-04-18T04:44:36.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.257+0000 7fc917e00640 1 -- 172.21.15.120:0/269873094 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc910004240 con 0x7fc904005190 2024-04-18T04:44:36.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.257+0000 7fc926200640 1 -- 172.21.15.120:0/269873094 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc92014cb50 con 0x7fc904005190 2024-04-18T04:44:36.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.257+0000 7fc926200640 1 -- 172.21.15.120:0/269873094 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc92014d110 con 0x7fc904005190 2024-04-18T04:44:36.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.257+0000 7fc926200640 1 -- 172.21.15.120:0/269873094 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc920072a70 con 0x7fc904005190 2024-04-18T04:44:36.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.257+0000 7fc917e00640 1 -- 172.21.15.120:0/269873094 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc9100043a0 con 0x7fc904005190 2024-04-18T04:44:36.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.261+0000 7fc917e00640 1 --2- 172.21.15.120:0/269873094 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc8fc0666c0 0x7fc8fc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:36.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.261+0000 7fc917e00640 1 -- 172.21.15.120:0/269873094 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc910084ac0 con 0x7fc904005190 2024-04-18T04:44:36.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.261+0000 7fc916a00640 1 --2- 172.21.15.120:0/269873094 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc8fc0666c0 0x7fc8fc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:36.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.261+0000 7fc916a00640 1 --2- 172.21.15.120:0/269873094 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc8fc0666c0 0x7fc8fc068b80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc9200c4a10 tx=0x7fc908009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:36.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.265+0000 7fc917e00640 1 -- 172.21.15.120:0/269873094 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fc910051b30 con 0x7fc904005190 2024-04-18T04:44:36.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.421+0000 7fc926200640 1 -- 172.21.15.120:0/269873094 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc92014d790 con 0x7fc904005190 2024-04-18T04:44:36.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.421+0000 7fc917e00640 1 -- 172.21.15.120:0/269873094 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7fc910022020 con 0x7fc904005190 2024-04-18T04:44:36.421 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:44:36.421 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":25,"fsid":"8e73592f-08e2-4957-a98f-9d044cec4ba5","created":"2024-04-18T04:44:06.139983+0000","modified":"2024-04-18T04:44:34.676253+0000","last_up_change":"2024-04-18T04:44:17.410146+0000","last_in_change":"2024-04-18T04:44:08.470250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T04:44:16.864728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T04:44:28.825773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T04:44:29.245857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-18T04:44:32.314302+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a80903bd-d9be-4fb9-af99-6125cb26bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":27468},{"type":"v1","addr":"172.21.15.120:6801","nonce":27468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":27468},{"type":"v1","addr":"172.21.15.120:6803","nonce":27468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":27468},{"type":"v1","addr":"172.21.15.120:6807","nonce":27468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":27468},{"type":"v1","addr":"172.21.15.120:6805","nonce":27468}]},"public_addr":"172.21.15.120:6801/27468","cluster_addr":"172.21.15.120:6803/27468","heartbeat_back_addr":"172.21.15.120:6807/27468","heartbeat_front_addr":"172.21.15.120:6805/27468","state":["exists","up"]},{"osd":1,"uuid":"8f5f004b-6870-4c78-8d50-9622e631ec25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":27470},{"type":"v1","addr":"172.21.15.120:6823","nonce":27470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":27470},{"type":"v1","addr":"172.21.15.120:6827","nonce":27470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":27470},{"type":"v1","addr":"172.21.15.120:6831","nonce":27470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":27470},{"type":"v1","addr":"172.21.15.120:6829","nonce":27470}]},"public_addr":"172.21.15.120:6823/27470","cluster_addr":"172.21.15.120:6827/27470","heartbeat_back_addr":"172.21.15.120:6831/27470","heartbeat_front_addr":"172.21.15.120:6829/27470","state":["exists","up"]},{"osd":2,"uuid":"6e228a2b-6103-4301-a8b5-ee81dbb1f920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":27471},{"type":"v1","addr":"172.21.15.120:6817","nonce":27471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":27471},{"type":"v1","addr":"172.21.15.120:6819","nonce":27471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":27471},{"type":"v1","addr":"172.21.15.120:6826","nonce":27471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":27471},{"type":"v1","addr":"172.21.15.120:6822","nonce":27471}]},"public_addr":"172.21.15.120:6817/27471","cluster_addr":"172.21.15.120:6819/27471","heartbeat_back_addr":"172.21.15.120:6826/27471","heartbeat_front_addr":"172.21.15.120:6822/27471","state":["exists","up"]},{"osd":3,"uuid":"7a5cabd7-d898-4e32-a03c-25b46e790134","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":27469},{"type":"v1","addr":"172.21.15.120:6809","nonce":27469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":27469},{"type":"v1","addr":"172.21.15.120:6811","nonce":27469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":27469},{"type":"v1","addr":"172.21.15.120:6815","nonce":27469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":27469},{"type":"v1","addr":"172.21.15.120:6813","nonce":27469}]},"public_addr":"172.21.15.120:6809/27469","cluster_addr":"172.21.15.120:6811/27469","heartbeat_back_addr":"172.21.15.120:6815/27469","heartbeat_front_addr":"172.21.15.120:6813/27469","state":["exists","up"]},{"osd":4,"uuid":"8e9f530f-6bab-4b23-a1a3-a71362fefcc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":28102},{"type":"v1","addr":"172.21.15.132:6825","nonce":28102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":28102},{"type":"v1","addr":"172.21.15.132:6827","nonce":28102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":28102},{"type":"v1","addr":"172.21.15.132:6831","nonce":28102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":28102},{"type":"v1","addr":"172.21.15.132:6829","nonce":28102}]},"public_addr":"172.21.15.132:6825/28102","cluster_addr":"172.21.15.132:6827/28102","heartbeat_back_addr":"172.21.15.132:6831/28102","heartbeat_front_addr":"172.21.15.132:6829/28102","state":["exists","up"]},{"osd":5,"uuid":"2243fabe-cc81-40cf-91bc-f106fe275a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":28104},{"type":"v1","addr":"172.21.15.132:6809","nonce":28104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":28104},{"type":"v1","addr":"172.21.15.132:6811","nonce":28104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":28104},{"type":"v1","addr":"172.21.15.132:6815","nonce":28104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":28104},{"type":"v1","addr":"172.21.15.132:6813","nonce":28104}]},"public_addr":"172.21.15.132:6809/28104","cluster_addr":"172.21.15.132:6811/28104","heartbeat_back_addr":"172.21.15.132:6815/28104","heartbeat_front_addr":"172.21.15.132:6813/28104","state":["exists","up"]},{"osd":6,"uuid":"c093a5ed-25c8-41a7-a20d-606a1a1661e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":28103},{"type":"v1","addr":"172.21.15.132:6801","nonce":28103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":28103},{"type":"v1","addr":"172.21.15.132:6803","nonce":28103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":28103},{"type":"v1","addr":"172.21.15.132:6807","nonce":28103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":28103},{"type":"v1","addr":"172.21.15.132:6805","nonce":28103}]},"public_addr":"172.21.15.132:6801/28103","cluster_addr":"172.21.15.132:6803/28103","heartbeat_back_addr":"172.21.15.132:6807/28103","heartbeat_front_addr":"172.21.15.132:6805/28103","state":["exists","up"]},{"osd":7,"uuid":"c37426b7-1080-4434-9f3e-a3afbbdc0fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":28129},{"type":"v1","addr":"172.21.15.132:6817","nonce":28129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":28129},{"type":"v1","addr":"172.21.15.132:6819","nonce":28129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":28129},{"type":"v1","addr":"172.21.15.132:6823","nonce":28129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":28129},{"type":"v1","addr":"172.21.15.132:6821","nonce":28129}]},"public_addr":"172.21.15.132:6817/28129","cluster_addr":"172.21.15.132:6819/28129","heartbeat_back_addr":"172.21.15.132:6823/28129","heartbeat_front_addr":"172.21.15.132:6821/28129","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.053825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.289753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.274645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.146361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.943883+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.701955+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.851076+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.800782+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T04:44:36.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.425+0000 7fc926200640 1 -- 172.21.15.120:0/269873094 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc8fc0666c0 msgr2=0x7fc8fc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:36.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.425+0000 7fc926200640 1 --2- 172.21.15.120:0/269873094 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc8fc0666c0 0x7fc8fc068b80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc9200c4a10 tx=0x7fc908009040 comp rx=0 tx=0).stop 2024-04-18T04:44:36.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.425+0000 7fc926200640 1 -- 172.21.15.120:0/269873094 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc904005190 msgr2=0x7fc9201591b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:36.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.425+0000 7fc926200640 1 --2- 172.21.15.120:0/269873094 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc904005190 0x7fc9201591b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc910011a60 tx=0x7fc910011f20 comp rx=0 tx=0).stop 2024-04-18T04:44:36.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.425+0000 7fc926200640 1 -- 172.21.15.120:0/269873094 shutdown_connections 2024-04-18T04:44:36.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.425+0000 7fc926200640 1 --2- 172.21.15.120:0/269873094 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc8fc0666c0 0x7fc8fc068b80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:36.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.425+0000 7fc926200640 1 --2- 172.21.15.120:0/269873094 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc9201ecd50 0x7fc9201ed1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:36.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.425+0000 7fc926200640 1 --2- 172.21.15.120:0/269873094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc920149650 0x7fc920149ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:36.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.425+0000 7fc926200640 1 --2- 172.21.15.120:0/269873094 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc904005190 0x7fc9201591b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:36.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.425+0000 7fc926200640 1 -- 172.21.15.120:0/269873094 >> 172.21.15.120:0/269873094 conn(0x7fc9200c78c0 msgr2=0x7fc920071870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:36.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.425+0000 7fc926200640 1 -- 172.21.15.120:0/269873094 shutdown_connections 2024-04-18T04:44:36.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:36.425+0000 7fc926200640 1 -- 172.21.15.120:0/269873094 wait complete. 2024-04-18T04:44:37.047 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-18T04:44:30.251235+0000', 'modified': '2024-04-18T04:44:35.678432+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4288}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4288': {'gid': 4288, 'name': 'e', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.120:6837/76856194', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6835', 'nonce': 76856194}, {'type': 'v1', 'addr': '172.21.15.120:6837', 'nonce': 76856194}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-04-18T04:44:37.047 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-18T04:44:37.047 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-04-18T04:44:37.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.189+0000 7fe29d800640 1 Processor -- start 2024-04-18T04:44:37.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.189+0000 7fe29d800640 1 -- start start 2024-04-18T04:44:37.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.193+0000 7fe29d800640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe2981572e0 0x7fe2980c74d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:37.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.193+0000 7fe29d800640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2980c7a10 con 0x7fe298151620 2024-04-18T04:44:37.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.193+0000 7fe29d800640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe298151a00 con 0x7fe29815b4a0 2024-04-18T04:44:37.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.193+0000 7fe29d800640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2980c4710 con 0x7fe2981572e0 2024-04-18T04:44:37.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.193+0000 7fe296a00640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fe298151620 0x7fe29806d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:38428/0 (socket says 172.21.15.120:38428) 2024-04-18T04:44:37.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.193+0000 7fe296a00640 1 -- 172.21.15.120:0/308846518 learned_addr learned my addr 172.21.15.120:0/308846518 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:44:37.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.193+0000 7fe297400640 1 --2- 172.21.15.120:0/308846518 >> v2:172.21.15.120:3300/0 conn(0x7fe2981572e0 0x7fe2980c74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:37.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.193+0000 7fe295600640 1 -- 172.21.15.120:0/308846518 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3205214749 0 0) 0x7fe288001120 con 0x7fe298151620 2024-04-18T04:44:37.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.193+0000 7fe295600640 1 -- 172.21.15.120:0/308846518 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe27c003530 con 0x7fe298151620 2024-04-18T04:44:37.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.193+0000 7fe297400640 1 -- 172.21.15.120:0/308846518 >> v1:172.21.15.132:6789/0 conn(0x7fe29815b4a0 legacy=0x7fe29806e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:37.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.193+0000 7fe297400640 1 -- 172.21.15.120:0/308846518 >> v1:172.21.15.120:6789/0 conn(0x7fe298151620 legacy=0x7fe29806d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:37.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.193+0000 7fe297400640 1 -- 172.21.15.120:0/308846518 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2980c6890 con 0x7fe2981572e0 2024-04-18T04:44:37.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.197+0000 7fe297400640 1 --2- 172.21.15.120:0/308846518 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2981572e0 0x7fe2980c74d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe290009d90 tx=0x7fe29001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac0b0b1661e075ab server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:37.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.197+0000 7fe295600640 1 -- 172.21.15.120:0/308846518 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2900a5830 con 0x7fe2981572e0 2024-04-18T04:44:37.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.197+0000 7fe295600640 1 -- 172.21.15.120:0/308846518 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2900a5990 con 0x7fe2981572e0 2024-04-18T04:44:37.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.197+0000 7fe295600640 1 -- 172.21.15.120:0/308846518 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2900a5d20 con 0x7fe2981572e0 2024-04-18T04:44:37.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.197+0000 7fe29d800640 1 -- 172.21.15.120:0/308846518 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2981572e0 msgr2=0x7fe2980c74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:37.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.197+0000 7fe29d800640 1 --2- 172.21.15.120:0/308846518 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2981572e0 0x7fe2980c74d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe290009d90 tx=0x7fe29001c970 comp rx=0 tx=0).stop 2024-04-18T04:44:37.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.197+0000 7fe29d800640 1 -- 172.21.15.120:0/308846518 shutdown_connections 2024-04-18T04:44:37.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.197+0000 7fe29d800640 1 --2- 172.21.15.120:0/308846518 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2981572e0 0x7fe2980c74d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:37.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.197+0000 7fe29d800640 1 -- 172.21.15.120:0/308846518 >> 172.21.15.120:0/308846518 conn(0x7fe298069ec0 msgr2=0x7fe29806a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:37.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.197+0000 7fe29d800640 1 -- 172.21.15.120:0/308846518 shutdown_connections 2024-04-18T04:44:37.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.197+0000 7fe29d800640 1 -- 172.21.15.120:0/308846518 wait complete. 2024-04-18T04:44:37.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.197+0000 7fe29d800640 1 Processor -- start 2024-04-18T04:44:37.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.197+0000 7fe29d800640 1 -- start start 2024-04-18T04:44:37.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.197+0000 7fe29d800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe298151620 0x7fe2980ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:37.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.197+0000 7fe29d800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2981572e0 0x7fe298141f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:37.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.197+0000 7fe29d800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe29815b4a0 0x7fe2981f33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:37.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.197+0000 7fe29d800640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2981424a0 con 0x7fe298151620 2024-04-18T04:44:37.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.197+0000 7fe29d800640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe298140210 con 0x7fe2981572e0 2024-04-18T04:44:37.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.197+0000 7fe29d800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe298142c60 con 0x7fe29815b4a0 2024-04-18T04:44:37.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.197+0000 7fe296a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe298151620 0x7fe2980ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:37.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.197+0000 7fe296a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe298151620 0x7fe2980ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53402/0 (socket says 172.21.15.120:53402) 2024-04-18T04:44:37.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.197+0000 7fe296a00640 1 -- 172.21.15.120:0/2391638199 learned_addr learned my addr 172.21.15.120:0/2391638199 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:37.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.197+0000 7fe297400640 1 --2- 172.21.15.120:0/2391638199 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe29815b4a0 0x7fe2981f33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:37.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.197+0000 7fe296000640 1 --2- 172.21.15.120:0/2391638199 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2981572e0 0x7fe298141f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:37.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.201+0000 7fe296a00640 1 -- 172.21.15.120:0/2391638199 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe29815b4a0 msgr2=0x7fe2981f33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:37.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.201+0000 7fe296a00640 1 --2- 172.21.15.120:0/2391638199 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe29815b4a0 0x7fe2981f33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:37.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.201+0000 7fe296a00640 1 -- 172.21.15.120:0/2391638199 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2981572e0 msgr2=0x7fe298141f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:37.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.201+0000 7fe296a00640 1 --2- 172.21.15.120:0/2391638199 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2981572e0 0x7fe298141f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:37.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.201+0000 7fe296a00640 1 -- 172.21.15.120:0/2391638199 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe290009a70 con 0x7fe298151620 2024-04-18T04:44:37.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.201+0000 7fe296a00640 1 --2- 172.21.15.120:0/2391638199 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe298151620 0x7fe2980ca4a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe28800c420 tx=0x7fe28800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:37.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.201+0000 7fe28ea00640 1 -- 172.21.15.120:0/2391638199 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe288005cf0 con 0x7fe298151620 2024-04-18T04:44:37.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.201+0000 7fe28ea00640 1 -- 172.21.15.120:0/2391638199 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe288005e50 con 0x7fe298151620 2024-04-18T04:44:37.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.201+0000 7fe29d800640 1 -- 172.21.15.120:0/2391638199 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2981f38e0 con 0x7fe298151620 2024-04-18T04:44:37.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.201+0000 7fe28ea00640 1 -- 172.21.15.120:0/2391638199 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2880072f0 con 0x7fe298151620 2024-04-18T04:44:37.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.201+0000 7fe29d800640 1 -- 172.21.15.120:0/2391638199 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe298142980 con 0x7fe298151620 2024-04-18T04:44:37.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.201+0000 7fe28ea00640 1 -- 172.21.15.120:0/2391638199 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe288007450 con 0x7fe298151620 2024-04-18T04:44:37.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.201+0000 7fe28ea00640 1 --2- 172.21.15.120:0/2391638199 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fe278066690 0x7fe278068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:37.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.201+0000 7fe28ea00640 1 -- 172.21.15.120:0/2391638199 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe2880839b0 con 0x7fe298151620 2024-04-18T04:44:37.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.201+0000 7fe296000640 1 --2- 172.21.15.120:0/2391638199 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fe278066690 0x7fe278068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:37.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.201+0000 7fe2a0cfd000 1 Processor -- start 2024-04-18T04:44:37.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.205+0000 7fe2a0cfd000 1 -- start start 2024-04-18T04:44:37.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.205+0000 7fe296000640 1 --2- 172.21.15.120:0/2391638199 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fe278066690 0x7fe278068b50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe298066370 tx=0x7fe284009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:37.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.205+0000 7fe2a0cfd000 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f284c3eb30 0x55f284c3ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:37.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.205+0000 7fe2a0cfd000 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55f284c3f450 0x55f284c3f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:37.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.205+0000 7fe2a0cfd000 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f284c3fd70 0x55f284c4ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:37.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.205+0000 7fe2a0cfd000 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f284ac6e80 con 0x55f284c3fd70 2024-04-18T04:44:37.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.205+0000 7fe2a0cfd000 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f284a54af0 con 0x55f284c3eb30 2024-04-18T04:44:37.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.205+0000 7fe2a0cfd000 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f284a520c0 con 0x55f284c3f450 2024-04-18T04:44:37.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.205+0000 7fe297400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f284c3fd70 0x55f284c4ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:37.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.205+0000 7fe297400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f284c3fd70 0x55f284c4ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53418/0 (socket says 172.21.15.120:53418) 2024-04-18T04:44:37.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.205+0000 7fe297400640 1 -- 172.21.15.120:0/1824944181 learned_addr learned my addr 172.21.15.120:0/1824944181 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:37.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.205+0000 7fe296000640 1 --2- 172.21.15.120:0/1824944181 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55f284c3f450 0x55f284c3f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:37.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.205+0000 7fe296a00640 1 --2- 172.21.15.120:0/1824944181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f284c3eb30 0x55f284c3ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:37.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.205+0000 7fe297400640 1 -- 172.21.15.120:0/1824944181 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55f284c3f450 msgr2=0x55f284c3f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:37.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.205+0000 7fe297400640 1 --2- 172.21.15.120:0/1824944181 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55f284c3f450 0x55f284c3f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:37.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.205+0000 7fe297400640 1 -- 172.21.15.120:0/1824944181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f284c3eb30 msgr2=0x55f284c3ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:37.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.205+0000 7fe297400640 1 --2- 172.21.15.120:0/1824944181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f284c3eb30 0x55f284c3ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:37.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.205+0000 7fe297400640 1 -- 172.21.15.120:0/1824944181 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f284749890 con 0x55f284c3fd70 2024-04-18T04:44:37.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.205+0000 7fe296000640 1 --2- 172.21.15.120:0/1824944181 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55f284c3f450 0x55f284c3f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:44:37.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.205+0000 7fe297400640 1 --2- 172.21.15.120:0/1824944181 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f284c3fd70 0x55f284c4ee10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe290009d90 tx=0x7fe290004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0d8b76ae4843d0e server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:37.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.205+0000 7fe283400640 1 -- 172.21.15.120:0/1824944181 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2900a5d00 con 0x55f284c3fd70 2024-04-18T04:44:37.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.205+0000 7fe283400640 1 -- 172.21.15.120:0/1824944181 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2900a5e60 con 0x55f284c3fd70 2024-04-18T04:44:37.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.205+0000 7fe283400640 1 -- 172.21.15.120:0/1824944181 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe290003bc0 con 0x55f284c3fd70 2024-04-18T04:44:37.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.205+0000 7fe2a0cfd000 1 -- 172.21.15.120:0/1824944181 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f284c3fd70 msgr2=0x55f284c4ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:37.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.205+0000 7fe2a0cfd000 1 --2- 172.21.15.120:0/1824944181 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f284c3fd70 0x55f284c4ee10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe290009d90 tx=0x7fe290004ac0 comp rx=0 tx=0).stop 2024-04-18T04:44:37.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.205+0000 7fe2a0cfd000 1 -- 172.21.15.120:0/1824944181 shutdown_connections 2024-04-18T04:44:37.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.205+0000 7fe2a0cfd000 1 --2- 172.21.15.120:0/1824944181 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f284c3fd70 0x55f284c4ee10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:37.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.205+0000 7fe2a0cfd000 1 --2- 172.21.15.120:0/1824944181 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55f284c3f450 0x55f284c3f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:37.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.205+0000 7fe2a0cfd000 1 --2- 172.21.15.120:0/1824944181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f284c3eb30 0x55f284c3ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:37.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.205+0000 7fe2a0cfd000 1 -- 172.21.15.120:0/1824944181 >> 172.21.15.120:0/1824944181 conn(0x55f284c05190 msgr2=0x55f284c05570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:37.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.205+0000 7fe2a0cfd000 1 -- 172.21.15.120:0/1824944181 shutdown_connections 2024-04-18T04:44:37.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.205+0000 7fe2a0cfd000 1 -- 172.21.15.120:0/1824944181 wait complete. 2024-04-18T04:44:37.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.205+0000 7fe2a0cfd000 1 -- start start 2024-04-18T04:44:37.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.205+0000 7fe2a0cfd000 1 Processor -- start 2024-04-18T04:44:37.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.209+0000 7fe2a0cfd000 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f284c3eb30 0x55f284c3a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:37.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.209+0000 7fe2a0cfd000 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f284c3f450 0x55f284c3abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:37.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.209+0000 7fe2a0cfd000 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55f284c3fd70 0x55f284c02270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:37.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.209+0000 7fe2a0cfd000 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f284a4d9b0 con 0x55f284c3f450 2024-04-18T04:44:37.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.209+0000 7fe2a0cfd000 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2849ecc00 con 0x55f284c3eb30 2024-04-18T04:44:37.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.209+0000 7fe2a0cfd000 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f284a0b070 con 0x55f284c3fd70 2024-04-18T04:44:37.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.209+0000 7fe2a0cfd000 10 client.0 _ll_register_callbacks cb 0x55f284beaae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-18T04:44:37.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.209+0000 7fe296000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f284c3f450 0x55f284c3abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:37.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.209+0000 7fe296000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f284c3f450 0x55f284c3abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53424/0 (socket says 172.21.15.120:53424) 2024-04-18T04:44:37.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.209+0000 7fe296000640 1 -- 172.21.15.120:0/775768579 learned_addr learned my addr 172.21.15.120:0/775768579 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:37.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.209+0000 7fe296a00640 1 --2- 172.21.15.120:0/775768579 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f284c3eb30 0x55f284c3a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:37.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.209+0000 7fe297400640 1 --2- 172.21.15.120:0/775768579 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55f284c3fd70 0x55f284c02270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:37.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.209+0000 7fe296000640 1 -- 172.21.15.120:0/775768579 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55f284c3fd70 msgr2=0x55f284c02270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:37.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.209+0000 7fe296000640 1 --2- 172.21.15.120:0/775768579 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55f284c3fd70 0x55f284c02270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:37.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.209+0000 7fe296000640 1 -- 172.21.15.120:0/775768579 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f284c3eb30 msgr2=0x55f284c3a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:37.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.209+0000 7fe296000640 1 --2- 172.21.15.120:0/775768579 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f284c3eb30 0x55f284c3a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:37.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.209+0000 7fe296000640 1 -- 172.21.15.120:0/775768579 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2980c6890 con 0x55f284c3f450 2024-04-18T04:44:37.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.209+0000 7fe297400640 1 --2- 172.21.15.120:0/775768579 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55f284c3fd70 0x55f284c02270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:44:37.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.209+0000 7fe296000640 1 --2- 172.21.15.120:0/775768579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f284c3f450 0x55f284c3abe0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe284003960 tx=0x7fe284000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=241e49197029d638 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:37.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.209+0000 7fe277e00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-04-18T04:44:37.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.209+0000 7fe277e00640 1 -- 172.21.15.120:0/775768579 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe284003e20 con 0x55f284c3f450 2024-04-18T04:44:37.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.209+0000 7fe2a0cfd000 1 -- 172.21.15.120:0/775768579 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f284a0a5f0 con 0x55f284c3f450 2024-04-18T04:44:37.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.209+0000 7fe277e00640 1 -- 172.21.15.120:0/775768579 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe284022d80 con 0x55f284c3f450 2024-04-18T04:44:37.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.209+0000 7fe277e00640 1 -- 172.21.15.120:0/775768579 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe28400ec90 con 0x55f284c3f450 2024-04-18T04:44:37.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.209+0000 7fe2a0cfd000 10 client.4401 fetch_fsmap learned FSMap version 7 2024-04-18T04:44:37.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.209+0000 7fe2a0cfd000 1 -- 172.21.15.120:0/775768579 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55f284a12ab0 con 0x55f284c3f450 2024-04-18T04:44:37.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.209+0000 7fe277e00640 1 -- 172.21.15.120:0/775768579 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f284a0a5f0 con 0x55f284c3f450 2024-04-18T04:44:37.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.209+0000 7fe277e00640 1 -- 172.21.15.120:0/775768579 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 7) v1 ==== 4212+0+0 (secure 0 0 0) 0x7fe2840224c0 con 0x55f284c3f450 2024-04-18T04:44:37.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.209+0000 7fe2a0cfd000 10 client.4401 fetch_fsmap finished waiting for FSMap version 7 2024-04-18T04:44:37.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.209+0000 7fe2a0cfd000 10 client.4401 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-18T04:44:37.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.209+0000 7fe2a0cfd000 20 client.4401 populate_metadata read hostname 'smithi120' 2024-04-18T04:44:37.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.209+0000 7fe2a0cfd000 1 --2- 172.21.15.120:0/775768579 >> [v2:172.21.15.120:6835/76856194,v1:172.21.15.120:6837/76856194] conn(0x55f284c03010 0x55f284c033f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:37.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.209+0000 7fe2a0cfd000 4 client.4401 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-18T04:44:37.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.209+0000 7fe2a0cfd000 1 -- 172.21.15.120:0/775768579 --> [v2:172.21.15.120:6835/76856194,v1:172.21.15.120:6837/76856194] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f284a4a790 con 0x55f284c03010 2024-04-18T04:44:37.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.209+0000 7fe296a00640 1 --2- 172.21.15.120:0/775768579 >> [v2:172.21.15.120:6835/76856194,v1:172.21.15.120:6837/76856194] conn(0x55f284c03010 0x55f284c033f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:37.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.209+0000 7fe296a00640 1 --2- 172.21.15.120:0/775768579 >> [v2:172.21.15.120:6835/76856194,v1:172.21.15.120:6837/76856194] conn(0x55f284c03010 0x55f284c033f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d98b72ab3e05371 server_cookie=134d24070dbc5479 in_seq=0 out_seq=0 2024-04-18T04:44:37.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:37.209+0000 7fe277e00640 10 client.4401 ms_handle_connect on v2:172.21.15.120:6835/76856194 2024-04-18T04:44:40.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.681+0000 7fe277e00640 1 -- 172.21.15.120:0/775768579 <== mds.0 v2:172.21.15.120:6835/76856194 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f284a4a790 con 0x55f284c03010 2024-04-18T04:44:40.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.681+0000 7fe277e00640 10 client.4401 handle_command_reply: tid=0 2024-04-18T04:44:40.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.681+0000 7fe2a0cfd000 1 client.4401 shutdown 2024-04-18T04:44:40.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.681+0000 7fe2a0cfd000 1 -- 172.21.15.120:0/775768579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f284c3f450 msgr2=0x55f284c3abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:40.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.681+0000 7fe2a0cfd000 1 --2- 172.21.15.120:0/775768579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f284c3f450 0x55f284c3abe0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe284003960 tx=0x7fe284000bd0 comp rx=0 tx=0).stop 2024-04-18T04:44:40.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.681+0000 7fe2a0cfd000 1 -- 172.21.15.120:0/775768579 shutdown_connections 2024-04-18T04:44:40.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.681+0000 7fe2a0cfd000 1 --2- 172.21.15.120:0/775768579 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55f284c3fd70 0x55f284c02270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:40.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.681+0000 7fe2a0cfd000 1 --2- 172.21.15.120:0/775768579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f284c3f450 0x55f284c3abe0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:40.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.681+0000 7fe2a0cfd000 1 --2- 172.21.15.120:0/775768579 >> [v2:172.21.15.120:6835/76856194,v1:172.21.15.120:6837/76856194] conn(0x55f284c03010 0x55f284c033f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:40.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.681+0000 7fe2a0cfd000 1 --2- 172.21.15.120:0/775768579 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f284c3eb30 0x55f284c3a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:40.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.681+0000 7fe2a0cfd000 1 -- 172.21.15.120:0/775768579 >> 172.21.15.120:0/775768579 conn(0x55f284c05190 msgr2=0x55f284c048c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:40.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.681+0000 7fe277e00640 0 client.4401 ms_handle_reset on v2:172.21.15.120:6835/76856194 2024-04-18T04:44:40.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.681+0000 7fe2a0cfd000 1 -- 172.21.15.120:0/775768579 shutdown_connections 2024-04-18T04:44:40.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.681+0000 7fe2a0cfd000 1 -- 172.21.15.120:0/775768579 wait complete. 2024-04-18T04:44:40.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.681+0000 7fe2a0cfd000 20 client.4401 trim_cache size 0 max 16384 2024-04-18T04:44:40.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.697+0000 7fe2a0cfd000 1 Processor -- start 2024-04-18T04:44:40.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.697+0000 7fe2a0cfd000 1 -- start start 2024-04-18T04:44:40.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.701+0000 7fe2a0cfd000 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55f284c3eb30 0x55f284c02260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:40.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.701+0000 7fe2a0cfd000 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f284c3f450 0x55f284c03b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:40.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.701+0000 7fe2a0cfd000 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f284c3fd70 0x55f284c04040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:40.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.701+0000 7fe2a0cfd000 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f28470a940 con 0x55f284c3fd70 2024-04-18T04:44:40.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.701+0000 7fe2a0cfd000 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2849f22b0 con 0x55f284c3f450 2024-04-18T04:44:40.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.701+0000 7fe2a0cfd000 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f2849fe5b0 con 0x55f284c3eb30 2024-04-18T04:44:40.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.701+0000 7fe297400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f284c3fd70 0x55f284c04040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:40.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.701+0000 7fe297400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f284c3fd70 0x55f284c04040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53440/0 (socket says 172.21.15.120:53440) 2024-04-18T04:44:40.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.701+0000 7fe297400640 1 -- 172.21.15.120:0/1133924779 learned_addr learned my addr 172.21.15.120:0/1133924779 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:40.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.701+0000 7fe296a00640 1 --2- 172.21.15.120:0/1133924779 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55f284c3eb30 0x55f284c02260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:40.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.701+0000 7fe296000640 1 --2- 172.21.15.120:0/1133924779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f284c3f450 0x55f284c03b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:40.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.701+0000 7fe297400640 1 -- 172.21.15.120:0/1133924779 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55f284c3eb30 msgr2=0x55f284c02260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:40.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.701+0000 7fe297400640 1 --2- 172.21.15.120:0/1133924779 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55f284c3eb30 0x55f284c02260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:40.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.701+0000 7fe297400640 1 -- 172.21.15.120:0/1133924779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f284c3f450 msgr2=0x55f284c03b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:40.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.701+0000 7fe297400640 1 --2- 172.21.15.120:0/1133924779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f284c3f450 0x55f284c03b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:40.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.701+0000 7fe297400640 1 -- 172.21.15.120:0/1133924779 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f284c3f280 con 0x55f284c3fd70 2024-04-18T04:44:40.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.701+0000 7fe296a00640 1 --2- 172.21.15.120:0/1133924779 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55f284c3eb30 0x55f284c02260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:44:40.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.701+0000 7fe297400640 1 --2- 172.21.15.120:0/1133924779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f284c3fd70 0x55f284c04040 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe29001b020 tx=0x7fe2900a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c54ce19fdfb13179 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:40.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.701+0000 7fe283e00640 1 -- 172.21.15.120:0/1133924779 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2900a5b00 con 0x55f284c3fd70 2024-04-18T04:44:40.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.701+0000 7fe283e00640 1 -- 172.21.15.120:0/1133924779 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2900a5c80 con 0x55f284c3fd70 2024-04-18T04:44:40.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.701+0000 7fe283e00640 1 -- 172.21.15.120:0/1133924779 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2900039a0 con 0x55f284c3fd70 2024-04-18T04:44:40.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.701+0000 7fe2a0cfd000 1 -- 172.21.15.120:0/1133924779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f284c3fd70 msgr2=0x55f284c04040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:40.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.701+0000 7fe2a0cfd000 1 --2- 172.21.15.120:0/1133924779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f284c3fd70 0x55f284c04040 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe29001b020 tx=0x7fe2900a7000 comp rx=0 tx=0).stop 2024-04-18T04:44:40.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.701+0000 7fe2a0cfd000 1 -- 172.21.15.120:0/1133924779 shutdown_connections 2024-04-18T04:44:40.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.701+0000 7fe2a0cfd000 1 --2- 172.21.15.120:0/1133924779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f284c3fd70 0x55f284c04040 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:40.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.701+0000 7fe2a0cfd000 1 --2- 172.21.15.120:0/1133924779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f284c3f450 0x55f284c03b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:40.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.701+0000 7fe2a0cfd000 1 --2- 172.21.15.120:0/1133924779 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55f284c3eb30 0x55f284c02260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:40.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.701+0000 7fe2a0cfd000 1 -- 172.21.15.120:0/1133924779 >> 172.21.15.120:0/1133924779 conn(0x55f284c05190 msgr2=0x55f284c033f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:40.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.701+0000 7fe2a0cfd000 1 -- 172.21.15.120:0/1133924779 shutdown_connections 2024-04-18T04:44:40.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.701+0000 7fe2a0cfd000 1 -- 172.21.15.120:0/1133924779 wait complete. 2024-04-18T04:44:40.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.701+0000 7fe2a0cfd000 1 -- start start 2024-04-18T04:44:40.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.701+0000 7fe2a0cfd000 1 Processor -- start 2024-04-18T04:44:40.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.705+0000 7fe2a0cfd000 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f284c3eb30 0x55f284c5c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:40.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.705+0000 7fe2a0cfd000 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f284c3f450 0x55f284c5c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:40.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.705+0000 7fe2a0cfd000 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55f284c3fd70 0x55f284c5cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:40.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.705+0000 7fe2a0cfd000 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2849f18d0 con 0x55f284c3eb30 2024-04-18T04:44:40.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.705+0000 7fe2a0cfd000 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f284a4ef40 con 0x55f284c3f450 2024-04-18T04:44:40.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.705+0000 7fe2a0cfd000 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f284a0f4c0 con 0x55f284c3fd70 2024-04-18T04:44:40.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.705+0000 7fe2a0cfd000 10 client.0 _ll_register_callbacks cb 0x55f284a1aff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-18T04:44:40.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.705+0000 7fe296a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f284c3eb30 0x55f284c5c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:40.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.705+0000 7fe296a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f284c3eb30 0x55f284c5c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53448/0 (socket says 172.21.15.120:53448) 2024-04-18T04:44:40.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.705+0000 7fe296a00640 1 -- 172.21.15.120:0/1389737640 learned_addr learned my addr 172.21.15.120:0/1389737640 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:40.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.705+0000 7fe296000640 1 --2- 172.21.15.120:0/1389737640 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f284c3f450 0x55f284c5c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:40.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.705+0000 7fe297400640 1 --2- 172.21.15.120:0/1389737640 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55f284c3fd70 0x55f284c5cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:40.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.705+0000 7fe296a00640 1 -- 172.21.15.120:0/1389737640 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55f284c3fd70 msgr2=0x55f284c5cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:40.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.705+0000 7fe296a00640 1 --2- 172.21.15.120:0/1389737640 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55f284c3fd70 0x55f284c5cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:40.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.705+0000 7fe296a00640 1 -- 172.21.15.120:0/1389737640 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f284c3f450 msgr2=0x55f284c5c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:40.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.705+0000 7fe296a00640 1 --2- 172.21.15.120:0/1389737640 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f284c3f450 0x55f284c5c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:40.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.705+0000 7fe296a00640 1 -- 172.21.15.120:0/1389737640 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f284749890 con 0x55f284c3eb30 2024-04-18T04:44:40.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.705+0000 7fe296000640 1 --2- 172.21.15.120:0/1389737640 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f284c3f450 0x55f284c5c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:44:40.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.705+0000 7fe296a00640 1 --2- 172.21.15.120:0/1389737640 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f284c3eb30 0x55f284c5c1e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe288000f70 tx=0x7fe288081a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beca22c6963cb36b server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:40.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.705+0000 7fe277e00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-04-18T04:44:40.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.705+0000 7fe277e00640 1 -- 172.21.15.120:0/1389737640 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2880077c0 con 0x55f284c3eb30 2024-04-18T04:44:40.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.705+0000 7fe277e00640 1 -- 172.21.15.120:0/1389737640 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe288050d60 con 0x55f284c3eb30 2024-04-18T04:44:40.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.705+0000 7fe2a0cfd000 1 -- 172.21.15.120:0/1389737640 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f284bffdd0 con 0x55f284c3eb30 2024-04-18T04:44:40.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.705+0000 7fe277e00640 1 -- 172.21.15.120:0/1389737640 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe288050f40 con 0x55f284c3eb30 2024-04-18T04:44:40.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.705+0000 7fe2a0cfd000 10 client.4407 fetch_fsmap learned FSMap version 7 2024-04-18T04:44:40.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.705+0000 7fe2a0cfd000 1 -- 172.21.15.120:0/1389737640 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55f2849f8c00 con 0x55f284c3eb30 2024-04-18T04:44:40.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.705+0000 7fe277e00640 1 -- 172.21.15.120:0/1389737640 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f284bffdd0 con 0x55f284c3eb30 2024-04-18T04:44:40.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.705+0000 7fe277e00640 1 -- 172.21.15.120:0/1389737640 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 7) v1 ==== 4212+0+0 (secure 0 0 0) 0x7fe288053b40 con 0x55f284c3eb30 2024-04-18T04:44:40.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.705+0000 7fe2a0cfd000 10 client.4407 fetch_fsmap finished waiting for FSMap version 7 2024-04-18T04:44:40.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.705+0000 7fe2a0cfd000 10 client.4407 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-18T04:44:40.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.705+0000 7fe2a0cfd000 20 client.4407 populate_metadata read hostname 'smithi120' 2024-04-18T04:44:40.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.705+0000 7fe2a0cfd000 1 --2- 172.21.15.120:0/1389737640 >> [v2:172.21.15.120:6835/76856194,v1:172.21.15.120:6837/76856194] conn(0x55f284cad660 0x55f284cafa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:40.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.705+0000 7fe2a0cfd000 4 client.4407 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-18T04:44:40.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.705+0000 7fe2a0cfd000 1 -- 172.21.15.120:0/1389737640 --> [v2:172.21.15.120:6835/76856194,v1:172.21.15.120:6837/76856194] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f284a1d460 con 0x55f284cad660 2024-04-18T04:44:40.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.705+0000 7fe296000640 1 --2- 172.21.15.120:0/1389737640 >> [v2:172.21.15.120:6835/76856194,v1:172.21.15.120:6837/76856194] conn(0x55f284cad660 0x55f284cafa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:40.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.705+0000 7fe296000640 1 -- 172.21.15.120:0/1389737640 >> [v2:172.21.15.120:6835/76856194,v1:172.21.15.120:6837/76856194] conn(0x55f284cad660 msgr2=0x55f284cafa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 19 2024-04-18T04:44:40.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.705+0000 7fe296000640 1 -- 172.21.15.120:0/1389737640 >> [v2:172.21.15.120:6835/76856194,v1:172.21.15.120:6837/76856194] conn(0x55f284cad660 msgr2=0x55f284cafa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:44:40.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.705+0000 7fe296000640 1 --2- 172.21.15.120:0/1389737640 >> [v2:172.21.15.120:6835/76856194,v1:172.21.15.120:6837/76856194] conn(0x55f284cad660 0x55f284cafa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:44:40.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.705+0000 7fe296000640 1 --2- 172.21.15.120:0/1389737640 >> [v2:172.21.15.120:6835/76856194,v1:172.21.15.120:6837/76856194] conn(0x55f284cad660 0x55f284cafa50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T04:44:40.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.909+0000 7fe296000640 1 --2- 172.21.15.120:0/1389737640 >> [v2:172.21.15.120:6835/76856194,v1:172.21.15.120:6837/76856194] conn(0x55f284cad660 0x55f284cafa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:40.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.909+0000 7fe296000640 1 --2- 172.21.15.120:0/1389737640 >> [v2:172.21.15.120:6835/76856194,v1:172.21.15.120:6837/76856194] conn(0x55f284cad660 0x55f284cafa50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8405d058a34dd60c server_cookie=fc08ce36dc15958f in_seq=0 out_seq=0 2024-04-18T04:44:40.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.909+0000 7fe277e00640 10 client.4407 ms_handle_connect on v2:172.21.15.120:6835/76856194 2024-04-18T04:44:40.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.909+0000 7fe277e00640 1 -- 172.21.15.120:0/1389737640 <== mds.0 v2:172.21.15.120:6835/76856194 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55f284a1d460 con 0x55f284cad660 2024-04-18T04:44:40.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.909+0000 7fe277e00640 10 client.4407 handle_command_reply: tid=0 2024-04-18T04:44:40.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.909+0000 7fe2a0cfd000 1 client.4407 shutdown 2024-04-18T04:44:40.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.909+0000 7fe2a0cfd000 1 -- 172.21.15.120:0/1389737640 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f284c3eb30 msgr2=0x55f284c5c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:40.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.909+0000 7fe2a0cfd000 1 --2- 172.21.15.120:0/1389737640 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f284c3eb30 0x55f284c5c1e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe288000f70 tx=0x7fe288081a20 comp rx=0 tx=0).stop 2024-04-18T04:44:40.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.909+0000 7fe2a0cfd000 1 -- 172.21.15.120:0/1389737640 shutdown_connections 2024-04-18T04:44:40.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.909+0000 7fe2a0cfd000 1 --2- 172.21.15.120:0/1389737640 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55f284c3fd70 0x55f284c5cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:40.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.909+0000 7fe2a0cfd000 1 --2- 172.21.15.120:0/1389737640 >> [v2:172.21.15.120:6835/76856194,v1:172.21.15.120:6837/76856194] conn(0x55f284cad660 0x55f284cafa50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:40.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.909+0000 7fe2a0cfd000 1 --2- 172.21.15.120:0/1389737640 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f284c3f450 0x55f284c5c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:40.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.909+0000 7fe2a0cfd000 1 --2- 172.21.15.120:0/1389737640 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f284c3eb30 0x55f284c5c1e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:40.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.909+0000 7fe2a0cfd000 1 -- 172.21.15.120:0/1389737640 >> 172.21.15.120:0/1389737640 conn(0x55f284c05190 msgr2=0x55f284c03c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:40.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.909+0000 7fe277e00640 0 client.4407 ms_handle_reset on v2:172.21.15.120:6835/76856194 2024-04-18T04:44:40.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.909+0000 7fe2a0cfd000 1 -- 172.21.15.120:0/1389737640 shutdown_connections 2024-04-18T04:44:40.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.909+0000 7fe2a0cfd000 1 -- 172.21.15.120:0/1389737640 wait complete. 2024-04-18T04:44:40.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.909+0000 7fe2a0cfd000 20 client.4407 trim_cache size 0 max 16384 2024-04-18T04:44:40.912 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-18T04:44:40.912 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_fsid": "8e73592f-08e2-4957-a98f-9d044cec4ba5", 2024-04-18T04:44:40.912 INFO:teuthology.orchestra.run.smithi120.stdout: "whoami": 0, 2024-04-18T04:44:40.912 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4288, 2024-04-18T04:44:40.912 INFO:teuthology.orchestra.run.smithi120.stdout: "want_state": "up:active", 2024-04-18T04:44:40.913 INFO:teuthology.orchestra.run.smithi120.stdout: "state": "up:active", 2024-04-18T04:44:40.913 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs", 2024-04-18T04:44:40.913 INFO:teuthology.orchestra.run.smithi120.stdout: "rank_uptime": 10.656545972, 2024-04-18T04:44:40.913 INFO:teuthology.orchestra.run.smithi120.stdout: "mdsmap_epoch": 6, 2024-04-18T04:44:40.913 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch": 25, 2024-04-18T04:44:40.913 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch_barrier": 25, 2024-04-18T04:44:40.913 INFO:teuthology.orchestra.run.smithi120.stdout: "uptime": 16.727441110000001 2024-04-18T04:44:40.913 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-18T04:44:40.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.909+0000 7fe29d800640 1 -- 172.21.15.120:0/2391638199 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fe278066690 msgr2=0x7fe278068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:40.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.909+0000 7fe29d800640 1 --2- 172.21.15.120:0/2391638199 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fe278066690 0x7fe278068b50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe298066370 tx=0x7fe284009040 comp rx=0 tx=0).stop 2024-04-18T04:44:40.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.909+0000 7fe29d800640 1 -- 172.21.15.120:0/2391638199 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe298151620 msgr2=0x7fe2980ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:40.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.909+0000 7fe29d800640 1 --2- 172.21.15.120:0/2391638199 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe298151620 0x7fe2980ca4a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe28800c420 tx=0x7fe28800c8e0 comp rx=0 tx=0).stop 2024-04-18T04:44:40.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.909+0000 7fe29d800640 1 -- 172.21.15.120:0/2391638199 shutdown_connections 2024-04-18T04:44:40.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.909+0000 7fe29d800640 1 --2- 172.21.15.120:0/2391638199 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fe278066690 0x7fe278068b50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:40.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.909+0000 7fe29d800640 1 --2- 172.21.15.120:0/2391638199 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe29815b4a0 0x7fe2981f33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:40.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.909+0000 7fe29d800640 1 --2- 172.21.15.120:0/2391638199 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2981572e0 0x7fe298141f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:40.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.909+0000 7fe29d800640 1 --2- 172.21.15.120:0/2391638199 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe298151620 0x7fe2980ca4a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:40.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.909+0000 7fe29d800640 1 -- 172.21.15.120:0/2391638199 >> 172.21.15.120:0/2391638199 conn(0x7fe298069ec0 msgr2=0x7fe29814e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:40.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.909+0000 7fe29d800640 1 -- 172.21.15.120:0/2391638199 shutdown_connections 2024-04-18T04:44:40.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:40.909+0000 7fe29d800640 1 -- 172.21.15.120:0/2391638199 wait complete. 2024-04-18T04:44:40.935 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-18T04:44:40.935 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-18T04:44:40.935 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-18T04:44:41.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.077+0000 7f399ee00640 1 Processor -- start 2024-04-18T04:44:41.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.077+0000 7f399ee00640 1 -- start start 2024-04-18T04:44:41.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.077+0000 7f399ee00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f399806b8c0 0x7f39980c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:41.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.077+0000 7f399ee00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f399806bca0 0x7f399806c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:41.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.077+0000 7f399ee00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3998151440 0x7f39981518d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:41.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.077+0000 7f399ee00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3998158610 con 0x7f399806bca0 2024-04-18T04:44:41.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.077+0000 7f399ee00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39980c7740 con 0x7f3998151440 2024-04-18T04:44:41.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.077+0000 7f399ee00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39981576f0 con 0x7f399806b8c0 2024-04-18T04:44:41.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.077+0000 7f3997400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f399806bca0 0x7f399806c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:41.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.077+0000 7f3997400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f399806bca0 0x7f399806c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46886/0 (socket says 172.21.15.120:46886) 2024-04-18T04:44:41.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.077+0000 7f3997400640 1 -- 172.21.15.120:0/472705633 learned_addr learned my addr 172.21.15.120:0/472705633 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:41.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.077+0000 7f3997e00640 1 --2- 172.21.15.120:0/472705633 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f399806b8c0 0x7f39980c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:41.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.077+0000 7f399ce00640 1 --2- 172.21.15.120:0/472705633 >> v2:172.21.15.132:3300/0 conn(0x7f3998151440 0x7f39981518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:41.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.077+0000 7f3997400640 1 -- 172.21.15.120:0/472705633 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f399806b8c0 msgr2=0x7f39980c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:41.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.077+0000 7f3997400640 1 --2- 172.21.15.120:0/472705633 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f399806b8c0 0x7f39980c7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:41.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.077+0000 7f3997400640 1 -- 172.21.15.120:0/472705633 >> v2:172.21.15.132:3300/0 conn(0x7f3998151440 msgr2=0x7f39981518d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:41.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.077+0000 7f3997400640 1 --2- 172.21.15.120:0/472705633 >> v2:172.21.15.132:3300/0 conn(0x7f3998151440 0x7f39981518d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:41.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.077+0000 7f3997400640 1 -- 172.21.15.120:0/472705633 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3998157990 con 0x7f399806bca0 2024-04-18T04:44:41.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.081+0000 7f3997400640 1 --2- 172.21.15.120:0/472705633 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f399806bca0 0x7f399806c0c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f39980c88b0 tx=0x7f398401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7ce7a212a31f073 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:41.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.081+0000 7f3996a00640 1 -- 172.21.15.120:0/472705633 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39840a89d0 con 0x7f399806bca0 2024-04-18T04:44:41.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.081+0000 7f3996a00640 1 -- 172.21.15.120:0/472705633 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39840a8b30 con 0x7f399806bca0 2024-04-18T04:44:41.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.081+0000 7f3996a00640 1 -- 172.21.15.120:0/472705633 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39840b0440 con 0x7f399806bca0 2024-04-18T04:44:41.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.081+0000 7f399ee00640 1 -- 172.21.15.120:0/472705633 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f399806bca0 msgr2=0x7f399806c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:41.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.081+0000 7f399ee00640 1 --2- 172.21.15.120:0/472705633 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f399806bca0 0x7f399806c0c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f39980c88b0 tx=0x7f398401ed10 comp rx=0 tx=0).stop 2024-04-18T04:44:41.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.081+0000 7f399ee00640 1 -- 172.21.15.120:0/472705633 shutdown_connections 2024-04-18T04:44:41.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.081+0000 7f399ee00640 1 --2- 172.21.15.120:0/472705633 >> v2:172.21.15.132:3300/0 conn(0x7f3998151440 0x7f39981518d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:41.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.081+0000 7f399ee00640 1 --2- 172.21.15.120:0/472705633 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f399806bca0 0x7f399806c0c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:41.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.081+0000 7f399ee00640 1 --2- 172.21.15.120:0/472705633 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f399806b8c0 0x7f39980c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:41.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.081+0000 7f399ee00640 1 -- 172.21.15.120:0/472705633 >> 172.21.15.120:0/472705633 conn(0x7f39980c78c0 msgr2=0x7f39980c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:41.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.081+0000 7f399ee00640 1 -- 172.21.15.120:0/472705633 shutdown_connections 2024-04-18T04:44:41.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.081+0000 7f399ee00640 1 -- 172.21.15.120:0/472705633 wait complete. 2024-04-18T04:44:41.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.085+0000 7f399ee00640 1 Processor -- start 2024-04-18T04:44:41.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.085+0000 7f399ee00640 1 -- start start 2024-04-18T04:44:41.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.085+0000 7f399ee00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f399806b8c0 0x7f39980c9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:41.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.085+0000 7f399ee00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f399806bca0 0x7f3998146d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:41.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.085+0000 7f399ee00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3998151440 0x7f3998147270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:41.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.085+0000 7f399ee00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39980c34b0 con 0x7f3998151440 2024-04-18T04:44:41.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.085+0000 7f399ee00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39981535a0 con 0x7f399806b8c0 2024-04-18T04:44:41.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.085+0000 7f399ee00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3998153ef0 con 0x7f399806bca0 2024-04-18T04:44:41.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.085+0000 7f399ce00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3998151440 0x7f3998147270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:41.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.085+0000 7f399ce00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3998151440 0x7f3998147270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46892/0 (socket says 172.21.15.120:46892) 2024-04-18T04:44:41.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.085+0000 7f399ce00640 1 -- 172.21.15.120:0/2895549962 learned_addr learned my addr 172.21.15.120:0/2895549962 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:41.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.085+0000 7f3997e00640 1 --2- 172.21.15.120:0/2895549962 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f399806b8c0 0x7f39980c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:41.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.085+0000 7f3997400640 1 --2- 172.21.15.120:0/2895549962 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f399806bca0 0x7f3998146d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:41.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.085+0000 7f399ce00640 1 -- 172.21.15.120:0/2895549962 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f399806bca0 msgr2=0x7f3998146d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:41.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.085+0000 7f399ce00640 1 --2- 172.21.15.120:0/2895549962 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f399806bca0 0x7f3998146d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:41.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.085+0000 7f399ce00640 1 -- 172.21.15.120:0/2895549962 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f399806b8c0 msgr2=0x7f39980c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:41.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.085+0000 7f399ce00640 1 --2- 172.21.15.120:0/2895549962 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f399806b8c0 0x7f39980c9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:41.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.085+0000 7f399ce00640 1 -- 172.21.15.120:0/2895549962 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39840094d0 con 0x7f3998151440 2024-04-18T04:44:41.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.085+0000 7f3997e00640 1 --2- 172.21.15.120:0/2895549962 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f399806b8c0 0x7f39980c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:44:41.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.085+0000 7f399ce00640 1 --2- 172.21.15.120:0/2895549962 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3998151440 0x7f3998147270 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3990007d90 tx=0x7f399000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:41.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.085+0000 7f398fe00640 1 -- 172.21.15.120:0/2895549962 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3990014420 con 0x7f3998151440 2024-04-18T04:44:41.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.085+0000 7f398fe00640 1 -- 172.21.15.120:0/2895549962 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39900145a0 con 0x7f3998151440 2024-04-18T04:44:41.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.085+0000 7f398fe00640 1 -- 172.21.15.120:0/2895549962 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3990014950 con 0x7f3998151440 2024-04-18T04:44:41.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.085+0000 7f399ee00640 1 -- 172.21.15.120:0/2895549962 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3998151ed0 con 0x7f3998151440 2024-04-18T04:44:41.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.085+0000 7f399ee00640 1 -- 172.21.15.120:0/2895549962 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3998152470 con 0x7f3998151440 2024-04-18T04:44:41.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.089+0000 7f399ee00640 1 -- 172.21.15.120:0/2895549962 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39980c35f0 con 0x7f3998151440 2024-04-18T04:44:41.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.089+0000 7f398fe00640 1 -- 172.21.15.120:0/2895549962 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3990014ab0 con 0x7f3998151440 2024-04-18T04:44:41.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.089+0000 7f398fe00640 1 --2- 172.21.15.120:0/2895549962 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3978066690 0x7f3978068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:41.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.089+0000 7f398fe00640 1 -- 172.21.15.120:0/2895549962 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3990084f10 con 0x7f3998151440 2024-04-18T04:44:41.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.089+0000 7f3997e00640 1 --2- 172.21.15.120:0/2895549962 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3978066690 0x7f3978068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:41.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.089+0000 7f3997e00640 1 --2- 172.21.15.120:0/2895549962 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3978066690 0x7f3978068b50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f398800ba50 tx=0x7f3988008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:41.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.093+0000 7f398fe00640 1 -- 172.21.15.120:0/2895549962 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f39980c35f0 con 0x7f3998151440 2024-04-18T04:44:41.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.277+0000 7f399ee00640 1 -- 172.21.15.120:0/2895549962 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f39980c35f0 con 0x7f3998151440 2024-04-18T04:44:41.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.277+0000 7f398fe00640 1 -- 172.21.15.120:0/2895549962 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f39980c35f0 con 0x7f3998151440 2024-04-18T04:44:41.278 INFO:teuthology.orchestra.run.smithi120.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-18T04:44:41.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.281+0000 7f399ee00640 1 -- 172.21.15.120:0/2895549962 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3978066690 msgr2=0x7f3978068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:41.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.281+0000 7f399ee00640 1 --2- 172.21.15.120:0/2895549962 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3978066690 0x7f3978068b50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f398800ba50 tx=0x7f3988008040 comp rx=0 tx=0).stop 2024-04-18T04:44:41.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.281+0000 7f399ee00640 1 -- 172.21.15.120:0/2895549962 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3998151440 msgr2=0x7f3998147270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:41.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.281+0000 7f399ee00640 1 --2- 172.21.15.120:0/2895549962 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3998151440 0x7f3998147270 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3990007d90 tx=0x7f399000e4b0 comp rx=0 tx=0).stop 2024-04-18T04:44:41.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.281+0000 7f399ee00640 1 -- 172.21.15.120:0/2895549962 shutdown_connections 2024-04-18T04:44:41.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.281+0000 7f399ee00640 1 --2- 172.21.15.120:0/2895549962 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3978066690 0x7f3978068b50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:41.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.281+0000 7f399ee00640 1 --2- 172.21.15.120:0/2895549962 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3998151440 0x7f3998147270 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:41.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.281+0000 7f399ee00640 1 --2- 172.21.15.120:0/2895549962 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f399806bca0 0x7f3998146d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:41.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.281+0000 7f399ee00640 1 --2- 172.21.15.120:0/2895549962 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f399806b8c0 0x7f39980c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:41.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.281+0000 7f399ee00640 1 -- 172.21.15.120:0/2895549962 >> 172.21.15.120:0/2895549962 conn(0x7f39980c78c0 msgr2=0x7f3998156f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:41.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.281+0000 7f399ee00640 1 -- 172.21.15.120:0/2895549962 shutdown_connections 2024-04-18T04:44:41.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:41.281+0000 7f399ee00640 1 -- 172.21.15.120:0/2895549962 wait complete. 2024-04-18T04:44:41.299 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-18T04:44:41.300 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-18T04:44:41.300 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi120.front.sepia.ceph.com 2024-04-18T04:44:41.300 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-18T04:44:41.300 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-18T04:44:41.300 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-18T04:44:41.300 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-18T04:44:41.300 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-18T04:44:41.300 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-18T04:44:41.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:44:41.300 DEBUG:teuthology.orchestra.run.smithi120:> ip addr 2024-04-18T04:44:41.309 INFO:teuthology.orchestra.run.smithi120.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-18T04:44:41.309 INFO:teuthology.orchestra.run.smithi120.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-18T04:44:41.309 INFO:teuthology.orchestra.run.smithi120.stdout: inet 127.0.0.1/8 scope host lo 2024-04-18T04:44:41.309 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-04-18T04:44:41.309 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 ::1/128 scope host 2024-04-18T04:44:41.310 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-04-18T04:44:41.310 INFO:teuthology.orchestra.run.smithi120.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-18T04:44:41.310 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:26 brd ff:ff:ff:ff:ff:ff 2024-04-18T04:44:41.310 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f0 2024-04-18T04:44:41.310 INFO:teuthology.orchestra.run.smithi120.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-18T04:44:41.310 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:27 brd ff:ff:ff:ff:ff:ff 2024-04-18T04:44:41.310 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f1 2024-04-18T04:44:41.310 INFO:teuthology.orchestra.run.smithi120.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-18T04:44:41.310 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8e brd ff:ff:ff:ff:ff:ff 2024-04-18T04:44:41.310 INFO:teuthology.orchestra.run.smithi120.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-18T04:44:41.310 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8f brd ff:ff:ff:ff:ff:ff 2024-04-18T04:44:41.310 INFO:teuthology.orchestra.run.smithi120.stdout: inet 172.21.15.120/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-18T04:44:41.310 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft 42482sec preferred_lft 42482sec 2024-04-18T04:44:41.310 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::ec4:7aff:fe8f:478f/64 scope link 2024-04-18T04:44:41.311 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-04-18T04:44:41.311 INFO:teuthology.orchestra.run.smithi120.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-18T04:44:41.311 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 02:42:e3:e8:23:da brd ff:ff:ff:ff:ff:ff 2024-04-18T04:44:41.311 INFO:teuthology.orchestra.run.smithi120.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-18T04:44:41.311 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-04-18T04:44:41.311 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-18T04:44:41.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:44:41.312 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec bash -c ' 2024-04-18T04:44:41.312 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-04-18T04:44:41.312 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link add name ceph-brx type bridge 2024-04-18T04:44:41.312 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip addr flush dev ceph-brx 2024-04-18T04:44:41.312 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set ceph-brx up 2024-04-18T04:44:41.313 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-18T04:44:41.313 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-04-18T04:44:41.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:44:41.420 DEBUG:teuthology.orchestra.run.smithi120:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-18T04:44:41.439 INFO:teuthology.orchestra.run.smithi120.stdout:1 2024-04-18T04:44:41.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:44:41.441 DEBUG:teuthology.orchestra.run.smithi120:> route 2024-04-18T04:44:41.514 INFO:teuthology.orchestra.run.smithi120.stdout:Kernel IP routing table 2024-04-18T04:44:41.514 INFO:teuthology.orchestra.run.smithi120.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-18T04:44:41.515 INFO:teuthology.orchestra.run.smithi120.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-18T04:44:41.515 INFO:teuthology.orchestra.run.smithi120.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-18T04:44:41.515 INFO:teuthology.orchestra.run.smithi120.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-18T04:44:41.515 INFO:teuthology.orchestra.run.smithi120.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-18T04:44:41.515 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-18T04:44:41.515 INFO:teuthology.orchestra.run.smithi120.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-18T04:44:41.515 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-18T04:44:41.515 INFO:teuthology.orchestra.run.smithi120.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-18T04:44:41.515 INFO:teuthology.orchestra.run.smithi120.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-18T04:44:41.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:44:41.516 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec bash -c ' 2024-04-18T04:44:41.516 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-04-18T04:44:41.516 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-18T04:44:41.516 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-18T04:44:41.516 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-18T04:44:41.516 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-04-18T04:44:41.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:44:41.606 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list 2024-04-18T04:44:41.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:44:41.616 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list-id 2024-04-18T04:44:41.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:44:41.667 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec bash -c ' 2024-04-18T04:44:41.667 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-04-18T04:44:41.667 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-18T04:44:41.667 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-18T04:44:41.667 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-04-18T04:44:41.748 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-18T04:44:41.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:44:41.748 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec bash -c ' 2024-04-18T04:44:41.748 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-04-18T04:44:41.748 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-18T04:44:41.748 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-18T04:44:41.748 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-18T04:44:41.749 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-18T04:44:41.749 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-18T04:44:41.749 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-04-18T04:44:41.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:44:41.937 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec bash -c ' 2024-04-18T04:44:41.937 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-04-18T04:44:41.938 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set brx.0 up 2024-04-18T04:44:41.938 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set dev brx.0 master ceph-brx 2024-04-18T04:44:41.938 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-04-18T04:44:41.977 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-18T04:44:41.977 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-18T04:44:41.978 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-18T04:44:42.026 INFO:teuthology.orchestra.run.smithi120.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-18T04:44:42.026 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-18T04:44:42.027 DEBUG:teuthology.orchestra.run.smithi120:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-18T04:44:42.082 DEBUG:teuthology.orchestra.run.smithi120:> sudo modprobe fuse 2024-04-18T04:44:42.147 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-18T04:44:42.147 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-18T04:44:42.208 INFO:teuthology.orchestra.run.smithi120.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-18T04:44:42.210 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-18T04:44:42.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:44:42.210 DEBUG:teuthology.orchestra.run.smithi120:> ls /sys/fs/fuse/connections 2024-04-18T04:44:42.262 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-18T04:44:42.262 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-18T04:44:42.309 DEBUG:teuthology.orchestra.run.smithi120:> sudo modprobe fuse 2024-04-18T04:44:42.330 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-18T04:44:42.331 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-18T04:44:42.392 INFO:teuthology.orchestra.run.smithi120.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-18T04:44:42.394 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-18T04:44:42.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:44:42.395 DEBUG:teuthology.orchestra.run.smithi120:> ls /sys/fs/fuse/connections 2024-04-18T04:44:42.407 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi120.stderr:2024-04-18T04:44:42.409+0000 7f2a93848580 -1 init, newargv = 0x56143b7f4470 newargc=15 2024-04-18T04:44:42.407 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi120.stderr:ceph-fuse[31971]: starting ceph client 2024-04-18T04:44:42.417 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi120.stderr:ceph-fuse[31971]: starting fuse 2024-04-18T04:44:43.517 DEBUG:teuthology.orchestra.run.smithi120:> sudo modprobe fuse 2024-04-18T04:44:43.541 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-18T04:44:43.541 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-18T04:44:43.601 INFO:teuthology.orchestra.run.smithi120.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-18T04:44:43.603 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-18T04:44:43.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:44:43.604 DEBUG:teuthology.orchestra.run.smithi120:> ls /sys/fs/fuse/connections 2024-04-18T04:44:43.659 INFO:teuthology.orchestra.run.smithi120.stdout:44 2024-04-18T04:44:43.659 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-04-18T04:44:43.659 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-04-18T04:44:43.659 DEBUG:teuthology.orchestra.run.smithi120:> import glob 2024-04-18T04:44:43.659 DEBUG:teuthology.orchestra.run.smithi120:> import re 2024-04-18T04:44:43.659 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-04-18T04:44:43.660 DEBUG:teuthology.orchestra.run.smithi120:> import subprocess 2024-04-18T04:44:43.660 DEBUG:teuthology.orchestra.run.smithi120:> 2024-04-18T04:44:43.660 DEBUG:teuthology.orchestra.run.smithi120:> def _find_admin_socket(client_name): 2024-04-18T04:44:43.660 DEBUG:teuthology.orchestra.run.smithi120:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-18T04:44:43.660 DEBUG:teuthology.orchestra.run.smithi120:> files = glob.glob(asok_path) 2024-04-18T04:44:43.660 DEBUG:teuthology.orchestra.run.smithi120:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-18T04:44:43.660 DEBUG:teuthology.orchestra.run.smithi120:> 2024-04-18T04:44:43.660 DEBUG:teuthology.orchestra.run.smithi120:> # Given a non-glob path, it better be there 2024-04-18T04:44:43.660 DEBUG:teuthology.orchestra.run.smithi120:> if "*" not in asok_path: 2024-04-18T04:44:43.660 DEBUG:teuthology.orchestra.run.smithi120:> assert(len(files) == 1) 2024-04-18T04:44:43.660 DEBUG:teuthology.orchestra.run.smithi120:> return files[0] 2024-04-18T04:44:43.660 DEBUG:teuthology.orchestra.run.smithi120:> 2024-04-18T04:44:43.660 DEBUG:teuthology.orchestra.run.smithi120:> for f in files: 2024-04-18T04:44:43.660 DEBUG:teuthology.orchestra.run.smithi120:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-18T04:44:43.660 DEBUG:teuthology.orchestra.run.smithi120:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-18T04:44:43.660 DEBUG:teuthology.orchestra.run.smithi120:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-18T04:44:43.661 DEBUG:teuthology.orchestra.run.smithi120:> contents = proc_f.read() 2024-04-18T04:44:43.661 DEBUG:teuthology.orchestra.run.smithi120:> if mountpoint in contents: 2024-04-18T04:44:43.661 DEBUG:teuthology.orchestra.run.smithi120:> return f 2024-04-18T04:44:43.661 DEBUG:teuthology.orchestra.run.smithi120:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-18T04:44:43.661 DEBUG:teuthology.orchestra.run.smithi120:> 2024-04-18T04:44:43.661 DEBUG:teuthology.orchestra.run.smithi120:> print(_find_admin_socket("client.admin")) 2024-04-18T04:44:43.661 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-04-18T04:44:43.788 INFO:teuthology.orchestra.run.smithi120.stdout:/var/run/ceph/ceph-client.admin.31971.asok 2024-04-18T04:44:43.972 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.31971.asok 2024-04-18T04:44:43.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:44:43.973 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.31971.asok status 2024-04-18T04:44:44.144 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-18T04:44:44.144 INFO:teuthology.orchestra.run.smithi120.stdout: "metadata": { 2024-04-18T04:44:44.144 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_sha1": "56a91dd158be807f143cc918a11685fc9ee164ae", 2024-04-18T04:44:44.144 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_version": "ceph version 18.2.2-1229-g56a91dd1 (56a91dd158be807f143cc918a11685fc9ee164ae) reef (stable)", 2024-04-18T04:44:44.144 INFO:teuthology.orchestra.run.smithi120.stdout: "entity_id": "admin", 2024-04-18T04:44:44.144 INFO:teuthology.orchestra.run.smithi120.stdout: "hostname": "smithi120", 2024-04-18T04:44:44.144 INFO:teuthology.orchestra.run.smithi120.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-18T04:44:44.144 INFO:teuthology.orchestra.run.smithi120.stdout: "pid": "31971", 2024-04-18T04:44:44.144 INFO:teuthology.orchestra.run.smithi120.stdout: "root": "/" 2024-04-18T04:44:44.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-18T04:44:44.145 INFO:teuthology.orchestra.run.smithi120.stdout: "dentry_count": 0, 2024-04-18T04:44:44.145 INFO:teuthology.orchestra.run.smithi120.stdout: "dentry_pinned_count": 0, 2024-04-18T04:44:44.145 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4419, 2024-04-18T04:44:44.145 INFO:teuthology.orchestra.run.smithi120.stdout: "inst": { 2024-04-18T04:44:44.145 INFO:teuthology.orchestra.run.smithi120.stdout: "name": { 2024-04-18T04:44:44.145 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "client", 2024-04-18T04:44:44.145 INFO:teuthology.orchestra.run.smithi120.stdout: "num": 4419 2024-04-18T04:44:44.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-18T04:44:44.145 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": { 2024-04-18T04:44:44.145 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-04-18T04:44:44.145 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "192.168.0.1:0", 2024-04-18T04:44:44.145 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3562819310 2024-04-18T04:44:44.145 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-18T04:44:44.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-18T04:44:44.146 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": { 2024-04-18T04:44:44.146 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-04-18T04:44:44.146 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "192.168.0.1:0", 2024-04-18T04:44:44.146 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3562819310 2024-04-18T04:44:44.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-18T04:44:44.146 INFO:teuthology.orchestra.run.smithi120.stdout: "inst_str": "client.4419 192.168.0.1:0/3562819310", 2024-04-18T04:44:44.146 INFO:teuthology.orchestra.run.smithi120.stdout: "addr_str": "192.168.0.1:0/3562819310", 2024-04-18T04:44:44.146 INFO:teuthology.orchestra.run.smithi120.stdout: "inode_count": 1, 2024-04-18T04:44:44.146 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_epoch": 6, 2024-04-18T04:44:44.146 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_epoch": 25, 2024-04-18T04:44:44.146 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_epoch_barrier": 0, 2024-04-18T04:44:44.146 INFO:teuthology.orchestra.run.smithi120.stdout: "blocklisted": false, 2024-04-18T04:44:44.146 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs" 2024-04-18T04:44:44.147 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-18T04:44:44.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:44:44.159 DEBUG:teuthology.orchestra.run.smithi120:> stat --file-system '--printf=%T 2024-04-18T04:44:44.159 DEBUG:teuthology.orchestra.run.smithi120:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-18T04:44:44.168 INFO:teuthology.orchestra.run.smithi120.stdout:fuseblk 2024-04-18T04:44:44.168 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-18T04:44:44.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:44:44.169 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-18T04:44:44.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:44:44.234 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-18T04:44:44.312 INFO:teuthology.orchestra.run.smithi120.stdout:# file: . 2024-04-18T04:44:44.313 INFO:teuthology.orchestra.run.smithi120.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-18T04:44:44.313 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:44:44.314 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-18T04:44:44.314 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-18T04:44:44.363 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T04:44:44.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.545+0000 7f7932600640 1 Processor -- start 2024-04-18T04:44:44.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.545+0000 7f7932600640 1 -- start start 2024-04-18T04:44:44.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.545+0000 7f7932600640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f792c1516a0 0x7f792c0c3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:44.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.545+0000 7f7932600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f792c0c7870 0x7f792c157490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:44.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.545+0000 7f7932600640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f792c0c8bd0 con 0x7f792c0c3dd0 2024-04-18T04:44:44.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.545+0000 7f7932600640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f792c06dad0 con 0x7f792c1516a0 2024-04-18T04:44:44.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.545+0000 7f7932600640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792c06e9b0 con 0x7f792c0c7870 2024-04-18T04:44:44.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.545+0000 7f792b400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f792c1516a0 0x7f792c0c3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:44.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.545+0000 7f792b400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f792c1516a0 0x7f792c0c3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46894/0 (socket says 172.21.15.120:46894) 2024-04-18T04:44:44.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.545+0000 7f792b400640 1 -- 172.21.15.120:0/4235699465 learned_addr learned my addr 172.21.15.120:0/4235699465 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:44.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.549+0000 7f7922a00640 1 --2- 172.21.15.120:0/4235699465 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f792c0c7870 0x7f792c157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:44.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.549+0000 7f792b400640 1 -- 172.21.15.120:0/4235699465 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f792c0c7870 msgr2=0x7f792c157490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:44.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.549+0000 7f792b400640 1 --2- 172.21.15.120:0/4235699465 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f792c0c7870 0x7f792c157490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:44.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.549+0000 7f792b400640 1 -- 172.21.15.120:0/4235699465 >> v1:172.21.15.120:6789/0 conn(0x7f792c0c3dd0 legacy=0x7f792c1579d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:44.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.549+0000 7f792b400640 1 -- 172.21.15.120:0/4235699465 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f792c06fe60 con 0x7f792c1516a0 2024-04-18T04:44:44.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.549+0000 7f792b400640 1 --2- 172.21.15.120:0/4235699465 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f792c1516a0 0x7f792c0c3890 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f791c009870 tx=0x7f791c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8a285c72972ded0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:44.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.549+0000 7f792aa00640 1 -- 172.21.15.120:0/4235699465 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c0ab650 con 0x7f792c1516a0 2024-04-18T04:44:44.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.549+0000 7f792aa00640 1 -- 172.21.15.120:0/4235699465 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f791c0ab7b0 con 0x7f792c1516a0 2024-04-18T04:44:44.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.549+0000 7f792aa00640 1 -- 172.21.15.120:0/4235699465 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c0abb40 con 0x7f792c1516a0 2024-04-18T04:44:44.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.549+0000 7f7932600640 1 -- 172.21.15.120:0/4235699465 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f792c1516a0 msgr2=0x7f792c0c3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:44.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.549+0000 7f7932600640 1 --2- 172.21.15.120:0/4235699465 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f792c1516a0 0x7f792c0c3890 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f791c009870 tx=0x7f791c01c560 comp rx=0 tx=0).stop 2024-04-18T04:44:44.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.549+0000 7f7932600640 1 -- 172.21.15.120:0/4235699465 shutdown_connections 2024-04-18T04:44:44.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.549+0000 7f7932600640 1 --2- 172.21.15.120:0/4235699465 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f792c0c7870 0x7f792c157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:44.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.549+0000 7f7932600640 1 --2- 172.21.15.120:0/4235699465 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f792c1516a0 0x7f792c0c3890 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:44.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.549+0000 7f7932600640 1 -- 172.21.15.120:0/4235699465 >> 172.21.15.120:0/4235699465 conn(0x7f792c0720e0 msgr2=0x7f792c065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:44.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.549+0000 7f7932600640 1 -- 172.21.15.120:0/4235699465 shutdown_connections 2024-04-18T04:44:44.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.549+0000 7f7932600640 1 -- 172.21.15.120:0/4235699465 wait complete. 2024-04-18T04:44:44.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.553+0000 7f7932600640 1 Processor -- start 2024-04-18T04:44:44.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.553+0000 7f7932600640 1 -- start start 2024-04-18T04:44:44.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.553+0000 7f7932600640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f792c0c3dd0 0x7f792c153ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:44.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.553+0000 7f7932600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f792c0c7870 0x7f792c0c6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:44.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.553+0000 7f7932600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f792c1516a0 0x7f792c145d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:44.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.553+0000 7f7932600640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792c0c4b50 con 0x7f792c1516a0 2024-04-18T04:44:44.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.553+0000 7f7932600640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792c154410 con 0x7f792c0c3dd0 2024-04-18T04:44:44.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.553+0000 7f7932600640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792c06ced0 con 0x7f792c0c7870 2024-04-18T04:44:44.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.553+0000 7f792be00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f792c1516a0 0x7f792c145d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:44.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.553+0000 7f792be00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f792c1516a0 0x7f792c145d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46910/0 (socket says 172.21.15.120:46910) 2024-04-18T04:44:44.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.553+0000 7f792be00640 1 -- 172.21.15.120:0/1322449518 learned_addr learned my addr 172.21.15.120:0/1322449518 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:44.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.553+0000 7f792b400640 1 --2- 172.21.15.120:0/1322449518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f792c0c3dd0 0x7f792c153ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:44.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.553+0000 7f7922a00640 1 --2- 172.21.15.120:0/1322449518 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f792c0c7870 0x7f792c0c6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:44.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.553+0000 7f792be00640 1 -- 172.21.15.120:0/1322449518 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f792c0c7870 msgr2=0x7f792c0c6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:44.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.553+0000 7f792be00640 1 --2- 172.21.15.120:0/1322449518 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f792c0c7870 0x7f792c0c6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:44.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.553+0000 7f792be00640 1 -- 172.21.15.120:0/1322449518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f792c0c3dd0 msgr2=0x7f792c153ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:44.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.553+0000 7f792be00640 1 --2- 172.21.15.120:0/1322449518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f792c0c3dd0 0x7f792c153ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:44.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.553+0000 7f792be00640 1 -- 172.21.15.120:0/1322449518 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f791c0094d0 con 0x7f792c1516a0 2024-04-18T04:44:44.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.553+0000 7f7922a00640 1 --2- 172.21.15.120:0/1322449518 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f792c0c7870 0x7f792c0c6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:44:44.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.553+0000 7f792be00640 1 --2- 172.21.15.120:0/1322449518 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f792c1516a0 0x7f792c145d40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f792400c7a0 tx=0x7f792400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:44.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.553+0000 7f7923e00640 1 -- 172.21.15.120:0/1322449518 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7924003b80 con 0x7f792c1516a0 2024-04-18T04:44:44.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.553+0000 7f7923e00640 1 -- 172.21.15.120:0/1322449518 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7924003ce0 con 0x7f792c1516a0 2024-04-18T04:44:44.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.553+0000 7f7923e00640 1 -- 172.21.15.120:0/1322449518 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792400aa90 con 0x7f792c1516a0 2024-04-18T04:44:44.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.553+0000 7f7932600640 1 -- 172.21.15.120:0/1322449518 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f792c147160 con 0x7f792c1516a0 2024-04-18T04:44:44.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.553+0000 7f7932600640 1 -- 172.21.15.120:0/1322449518 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f792c151f80 con 0x7f792c1516a0 2024-04-18T04:44:44.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.557+0000 7f7932600640 1 -- 172.21.15.120:0/1322449518 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f792c1472f0 con 0x7f792c1516a0 2024-04-18T04:44:44.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.557+0000 7f7923e00640 1 -- 172.21.15.120:0/1322449518 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f792400abf0 con 0x7f792c1516a0 2024-04-18T04:44:44.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.557+0000 7f7923e00640 1 --2- 172.21.15.120:0/1322449518 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f79080666c0 0x7f7908068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:44.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.557+0000 7f7923e00640 1 -- 172.21.15.120:0/1322449518 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f79240842c0 con 0x7f792c1516a0 2024-04-18T04:44:44.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.557+0000 7f792b400640 1 --2- 172.21.15.120:0/1322449518 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f79080666c0 0x7f7908068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:44.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.557+0000 7f792b400640 1 --2- 172.21.15.120:0/1322449518 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f79080666c0 0x7f7908068b80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f791c0af000 tx=0x7f791c0a7000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:44.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.561+0000 7f7923e00640 1 -- 172.21.15.120:0/1322449518 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f7924051330 con 0x7f792c1516a0 2024-04-18T04:44:44.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.717+0000 7f7932600640 1 -- 172.21.15.120:0/1322449518 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f792c0c2550 con 0x7f792c1516a0 2024-04-18T04:44:44.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.717+0000 7f7923e00640 1 -- 172.21.15.120:0/1322449518 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f7924054950 con 0x7f792c1516a0 2024-04-18T04:44:44.717 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:44:44.717 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":25,"fsid":"8e73592f-08e2-4957-a98f-9d044cec4ba5","created":"2024-04-18T04:44:06.139983+0000","modified":"2024-04-18T04:44:34.676253+0000","last_up_change":"2024-04-18T04:44:17.410146+0000","last_in_change":"2024-04-18T04:44:08.470250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T04:44:16.864728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T04:44:28.825773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T04:44:29.245857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-18T04:44:32.314302+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a80903bd-d9be-4fb9-af99-6125cb26bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":27468},{"type":"v1","addr":"172.21.15.120:6801","nonce":27468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":27468},{"type":"v1","addr":"172.21.15.120:6803","nonce":27468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":27468},{"type":"v1","addr":"172.21.15.120:6807","nonce":27468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":27468},{"type":"v1","addr":"172.21.15.120:6805","nonce":27468}]},"public_addr":"172.21.15.120:6801/27468","cluster_addr":"172.21.15.120:6803/27468","heartbeat_back_addr":"172.21.15.120:6807/27468","heartbeat_front_addr":"172.21.15.120:6805/27468","state":["exists","up"]},{"osd":1,"uuid":"8f5f004b-6870-4c78-8d50-9622e631ec25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":27470},{"type":"v1","addr":"172.21.15.120:6823","nonce":27470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":27470},{"type":"v1","addr":"172.21.15.120:6827","nonce":27470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":27470},{"type":"v1","addr":"172.21.15.120:6831","nonce":27470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":27470},{"type":"v1","addr":"172.21.15.120:6829","nonce":27470}]},"public_addr":"172.21.15.120:6823/27470","cluster_addr":"172.21.15.120:6827/27470","heartbeat_back_addr":"172.21.15.120:6831/27470","heartbeat_front_addr":"172.21.15.120:6829/27470","state":["exists","up"]},{"osd":2,"uuid":"6e228a2b-6103-4301-a8b5-ee81dbb1f920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":27471},{"type":"v1","addr":"172.21.15.120:6817","nonce":27471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":27471},{"type":"v1","addr":"172.21.15.120:6819","nonce":27471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":27471},{"type":"v1","addr":"172.21.15.120:6826","nonce":27471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":27471},{"type":"v1","addr":"172.21.15.120:6822","nonce":27471}]},"public_addr":"172.21.15.120:6817/27471","cluster_addr":"172.21.15.120:6819/27471","heartbeat_back_addr":"172.21.15.120:6826/27471","heartbeat_front_addr":"172.21.15.120:6822/27471","state":["exists","up"]},{"osd":3,"uuid":"7a5cabd7-d898-4e32-a03c-25b46e790134","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":27469},{"type":"v1","addr":"172.21.15.120:6809","nonce":27469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":27469},{"type":"v1","addr":"172.21.15.120:6811","nonce":27469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":27469},{"type":"v1","addr":"172.21.15.120:6815","nonce":27469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":27469},{"type":"v1","addr":"172.21.15.120:6813","nonce":27469}]},"public_addr":"172.21.15.120:6809/27469","cluster_addr":"172.21.15.120:6811/27469","heartbeat_back_addr":"172.21.15.120:6815/27469","heartbeat_front_addr":"172.21.15.120:6813/27469","state":["exists","up"]},{"osd":4,"uuid":"8e9f530f-6bab-4b23-a1a3-a71362fefcc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":28102},{"type":"v1","addr":"172.21.15.132:6825","nonce":28102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":28102},{"type":"v1","addr":"172.21.15.132:6827","nonce":28102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":28102},{"type":"v1","addr":"172.21.15.132:6831","nonce":28102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":28102},{"type":"v1","addr":"172.21.15.132:6829","nonce":28102}]},"public_addr":"172.21.15.132:6825/28102","cluster_addr":"172.21.15.132:6827/28102","heartbeat_back_addr":"172.21.15.132:6831/28102","heartbeat_front_addr":"172.21.15.132:6829/28102","state":["exists","up"]},{"osd":5,"uuid":"2243fabe-cc81-40cf-91bc-f106fe275a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":28104},{"type":"v1","addr":"172.21.15.132:6809","nonce":28104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":28104},{"type":"v1","addr":"172.21.15.132:6811","nonce":28104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":28104},{"type":"v1","addr":"172.21.15.132:6815","nonce":28104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":28104},{"type":"v1","addr":"172.21.15.132:6813","nonce":28104}]},"public_addr":"172.21.15.132:6809/28104","cluster_addr":"172.21.15.132:6811/28104","heartbeat_back_addr":"172.21.15.132:6815/28104","heartbeat_front_addr":"172.21.15.132:6813/28104","state":["exists","up"]},{"osd":6,"uuid":"c093a5ed-25c8-41a7-a20d-606a1a1661e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":28103},{"type":"v1","addr":"172.21.15.132:6801","nonce":28103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":28103},{"type":"v1","addr":"172.21.15.132:6803","nonce":28103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":28103},{"type":"v1","addr":"172.21.15.132:6807","nonce":28103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":28103},{"type":"v1","addr":"172.21.15.132:6805","nonce":28103}]},"public_addr":"172.21.15.132:6801/28103","cluster_addr":"172.21.15.132:6803/28103","heartbeat_back_addr":"172.21.15.132:6807/28103","heartbeat_front_addr":"172.21.15.132:6805/28103","state":["exists","up"]},{"osd":7,"uuid":"c37426b7-1080-4434-9f3e-a3afbbdc0fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":28129},{"type":"v1","addr":"172.21.15.132:6817","nonce":28129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":28129},{"type":"v1","addr":"172.21.15.132:6819","nonce":28129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":28129},{"type":"v1","addr":"172.21.15.132:6823","nonce":28129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":28129},{"type":"v1","addr":"172.21.15.132:6821","nonce":28129}]},"public_addr":"172.21.15.132:6817/28129","cluster_addr":"172.21.15.132:6819/28129","heartbeat_back_addr":"172.21.15.132:6823/28129","heartbeat_front_addr":"172.21.15.132:6821/28129","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.053825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.289753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.274645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.146361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.943883+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.701955+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.851076+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.800782+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T04:44:44.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.717+0000 7f7932600640 1 -- 172.21.15.120:0/1322449518 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f79080666c0 msgr2=0x7f7908068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:44.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.717+0000 7f7932600640 1 --2- 172.21.15.120:0/1322449518 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f79080666c0 0x7f7908068b80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f791c0af000 tx=0x7f791c0a7000 comp rx=0 tx=0).stop 2024-04-18T04:44:44.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.717+0000 7f7932600640 1 -- 172.21.15.120:0/1322449518 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f792c1516a0 msgr2=0x7f792c145d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:44.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.717+0000 7f7932600640 1 --2- 172.21.15.120:0/1322449518 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f792c1516a0 0x7f792c145d40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f792400c7a0 tx=0x7f792400cc60 comp rx=0 tx=0).stop 2024-04-18T04:44:44.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.721+0000 7f7932600640 1 -- 172.21.15.120:0/1322449518 shutdown_connections 2024-04-18T04:44:44.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.721+0000 7f7932600640 1 --2- 172.21.15.120:0/1322449518 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f79080666c0 0x7f7908068b80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:44.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.721+0000 7f7932600640 1 --2- 172.21.15.120:0/1322449518 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f792c1516a0 0x7f792c145d40 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:44.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.721+0000 7f7932600640 1 --2- 172.21.15.120:0/1322449518 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f792c0c7870 0x7f792c0c6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:44.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.721+0000 7f7932600640 1 --2- 172.21.15.120:0/1322449518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f792c0c3dd0 0x7f792c153ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:44.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.721+0000 7f7932600640 1 -- 172.21.15.120:0/1322449518 >> 172.21.15.120:0/1322449518 conn(0x7f792c0720e0 msgr2=0x7f792c06afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:44.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.721+0000 7f7932600640 1 -- 172.21.15.120:0/1322449518 shutdown_connections 2024-04-18T04:44:44.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.721+0000 7f7932600640 1 -- 172.21.15.120:0/1322449518 wait complete. 2024-04-18T04:44:44.738 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T04:44:16.864728+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T04:44:28.825773+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T04:44:29.245857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-18T04:44:32.314302+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-18T04:44:44.738 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T04:44:44.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.877+0000 7f7b77600640 1 Processor -- start 2024-04-18T04:44:44.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.877+0000 7f7b77600640 1 -- start start 2024-04-18T04:44:44.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.881+0000 7f7b77600640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7b701537f0 0x7f7b7006ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:44.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.881+0000 7f7b77600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7b700cae00 0x7f7b700cf390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:44.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.881+0000 7f7b77600640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7b700cf8d0 0x7f7b700c4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:44.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.881+0000 7f7b77600640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b700c9850 con 0x7f7b700cf8d0 2024-04-18T04:44:44.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.881+0000 7f7b77600640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b700c41c0 con 0x7f7b701537f0 2024-04-18T04:44:44.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.881+0000 7f7b77600640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b700c3e90 con 0x7f7b700cae00 2024-04-18T04:44:44.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.881+0000 7f7b75600640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7b700cf8d0 0x7f7b700c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:44.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.881+0000 7f7b75600640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7b700cf8d0 0x7f7b700c4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46916/0 (socket says 172.21.15.120:46916) 2024-04-18T04:44:44.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.881+0000 7f7b75600640 1 -- 172.21.15.120:0/1192426597 learned_addr learned my addr 172.21.15.120:0/1192426597 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:44.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.881+0000 7f7b6fe00640 1 --2- 172.21.15.120:0/1192426597 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7b700cae00 0x7f7b700cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:44.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.881+0000 7f7b74c00640 1 --2- 172.21.15.120:0/1192426597 >> v2:172.21.15.132:3300/0 conn(0x7f7b701537f0 0x7f7b7006ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:44.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.881+0000 7f7b75600640 1 -- 172.21.15.120:0/1192426597 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7b700cae00 msgr2=0x7f7b700cf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:44.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.881+0000 7f7b75600640 1 --2- 172.21.15.120:0/1192426597 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7b700cae00 0x7f7b700cf390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:44.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.881+0000 7f7b75600640 1 -- 172.21.15.120:0/1192426597 >> v2:172.21.15.132:3300/0 conn(0x7f7b701537f0 msgr2=0x7f7b7006ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:44.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.881+0000 7f7b75600640 1 --2- 172.21.15.120:0/1192426597 >> v2:172.21.15.132:3300/0 conn(0x7f7b701537f0 0x7f7b7006ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:44.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.881+0000 7f7b75600640 1 -- 172.21.15.120:0/1192426597 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b700ca950 con 0x7f7b700cf8d0 2024-04-18T04:44:44.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.881+0000 7f7b6fe00640 1 --2- 172.21.15.120:0/1192426597 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7b700cae00 0x7f7b700cf390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:44:44.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.881+0000 7f7b74c00640 1 --2- 172.21.15.120:0/1192426597 >> v2:172.21.15.132:3300/0 conn(0x7f7b701537f0 0x7f7b7006ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:44:44.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.885+0000 7f7b75600640 1 --2- 172.21.15.120:0/1192426597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b700cf8d0 0x7f7b700c4650 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7b700cee10 tx=0x7f7b6801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a88cc86e4344f3e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:44.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.885+0000 7f7b6f400640 1 -- 172.21.15.120:0/1192426597 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b680a89d0 con 0x7f7b700cf8d0 2024-04-18T04:44:44.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.885+0000 7f7b6f400640 1 -- 172.21.15.120:0/1192426597 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b680a8b30 con 0x7f7b700cf8d0 2024-04-18T04:44:44.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.885+0000 7f7b6f400640 1 -- 172.21.15.120:0/1192426597 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b680b0440 con 0x7f7b700cf8d0 2024-04-18T04:44:44.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.885+0000 7f7b77600640 1 -- 172.21.15.120:0/1192426597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b700cf8d0 msgr2=0x7f7b700c4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:44.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.885+0000 7f7b77600640 1 --2- 172.21.15.120:0/1192426597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b700cf8d0 0x7f7b700c4650 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7b700cee10 tx=0x7f7b6801ed10 comp rx=0 tx=0).stop 2024-04-18T04:44:44.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.885+0000 7f7b77600640 1 -- 172.21.15.120:0/1192426597 shutdown_connections 2024-04-18T04:44:44.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.885+0000 7f7b77600640 1 --2- 172.21.15.120:0/1192426597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b700cf8d0 0x7f7b700c4650 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:44.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.885+0000 7f7b77600640 1 --2- 172.21.15.120:0/1192426597 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7b700cae00 0x7f7b700cf390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:44.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.885+0000 7f7b77600640 1 --2- 172.21.15.120:0/1192426597 >> v2:172.21.15.132:3300/0 conn(0x7f7b701537f0 0x7f7b7006ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:44.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.885+0000 7f7b77600640 1 -- 172.21.15.120:0/1192426597 >> 172.21.15.120:0/1192426597 conn(0x7f7b70065fc0 msgr2=0x7f7b700663d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:44.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.885+0000 7f7b77600640 1 -- 172.21.15.120:0/1192426597 shutdown_connections 2024-04-18T04:44:44.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.885+0000 7f7b77600640 1 -- 172.21.15.120:0/1192426597 wait complete. 2024-04-18T04:44:44.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.885+0000 7f7b77600640 1 Processor -- start 2024-04-18T04:44:44.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.885+0000 7f7b77600640 1 -- start start 2024-04-18T04:44:44.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.885+0000 7f7b77600640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b700cae00 0x7f7b700b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:44.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.885+0000 7f7b77600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7b700cf8d0 0x7f7b701eea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:44.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.885+0000 7f7b77600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b701537f0 0x7f7b7014eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:44.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.885+0000 7f7b77600640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b700c6280 con 0x7f7b701537f0 2024-04-18T04:44:44.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.885+0000 7f7b77600640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b700c90e0 con 0x7f7b700cae00 2024-04-18T04:44:44.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.885+0000 7f7b77600640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b701f2e30 con 0x7f7b700cf8d0 2024-04-18T04:44:44.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.889+0000 7f7b75600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b701537f0 0x7f7b7014eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:44.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.889+0000 7f7b75600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b701537f0 0x7f7b7014eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46928/0 (socket says 172.21.15.120:46928) 2024-04-18T04:44:44.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.889+0000 7f7b75600640 1 -- 172.21.15.120:0/3095893037 learned_addr learned my addr 172.21.15.120:0/3095893037 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:44.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.889+0000 7f7b74c00640 1 --2- 172.21.15.120:0/3095893037 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b700cae00 0x7f7b700b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:44.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.889+0000 7f7b6fe00640 1 --2- 172.21.15.120:0/3095893037 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7b700cf8d0 0x7f7b701eea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:44.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.889+0000 7f7b75600640 1 -- 172.21.15.120:0/3095893037 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7b700cf8d0 msgr2=0x7f7b701eea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:44.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.889+0000 7f7b75600640 1 --2- 172.21.15.120:0/3095893037 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7b700cf8d0 0x7f7b701eea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:44.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.889+0000 7f7b75600640 1 -- 172.21.15.120:0/3095893037 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b700cae00 msgr2=0x7f7b700b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:44.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.889+0000 7f7b75600640 1 --2- 172.21.15.120:0/3095893037 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b700cae00 0x7f7b700b37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:44.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.889+0000 7f7b75600640 1 -- 172.21.15.120:0/3095893037 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b680094d0 con 0x7f7b701537f0 2024-04-18T04:44:44.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.889+0000 7f7b74c00640 1 --2- 172.21.15.120:0/3095893037 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b700cae00 0x7f7b700b37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:44:44.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.889+0000 7f7b75600640 1 --2- 172.21.15.120:0/3095893037 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b701537f0 0x7f7b7014eba0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7b680b3040 tx=0x7f7b6801bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:44.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.889+0000 7f7b6cc00640 1 -- 172.21.15.120:0/3095893037 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b680ba600 con 0x7f7b701537f0 2024-04-18T04:44:44.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.889+0000 7f7b6cc00640 1 -- 172.21.15.120:0/3095893037 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b680ba760 con 0x7f7b701537f0 2024-04-18T04:44:44.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.889+0000 7f7b77600640 1 -- 172.21.15.120:0/3095893037 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b701f2b50 con 0x7f7b701537f0 2024-04-18T04:44:44.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.889+0000 7f7b6cc00640 1 -- 172.21.15.120:0/3095893037 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b680bab10 con 0x7f7b701537f0 2024-04-18T04:44:44.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.889+0000 7f7b77600640 1 -- 172.21.15.120:0/3095893037 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b700c8e00 con 0x7f7b701537f0 2024-04-18T04:44:44.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.889+0000 7f7b77600640 1 -- 172.21.15.120:0/3095893037 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b700729d0 con 0x7f7b701537f0 2024-04-18T04:44:44.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.889+0000 7f7b6cc00640 1 -- 172.21.15.120:0/3095893037 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7b680bac70 con 0x7f7b701537f0 2024-04-18T04:44:44.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.889+0000 7f7b6cc00640 1 --2- 172.21.15.120:0/3095893037 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7b50066690 0x7f7b50068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:44.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.893+0000 7f7b6cc00640 1 -- 172.21.15.120:0/3095893037 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7b68122ba0 con 0x7f7b701537f0 2024-04-18T04:44:44.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.893+0000 7f7b74c00640 1 --2- 172.21.15.120:0/3095893037 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7b50066690 0x7f7b50068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:44.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.893+0000 7f7b74c00640 1 --2- 172.21.15.120:0/3095893037 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7b50066690 0x7f7b50068b50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7b60003fd0 tx=0x7f7b60009530 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:44.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:44.893+0000 7f7b6cc00640 1 -- 172.21.15.120:0/3095893037 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f7b680efb80 con 0x7f7b701537f0 2024-04-18T04:44:45.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.049+0000 7f7b77600640 1 -- 172.21.15.120:0/3095893037 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7b700ce770 con 0x7f7b701537f0 2024-04-18T04:44:45.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.049+0000 7f7b6cc00640 1 -- 172.21.15.120:0/3095893037 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7b680b5020 con 0x7f7b701537f0 2024-04-18T04:44:45.048 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2024-04-18T04:44:45.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.049+0000 7f7b77600640 1 -- 172.21.15.120:0/3095893037 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7b50066690 msgr2=0x7f7b50068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:45.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.049+0000 7f7b77600640 1 --2- 172.21.15.120:0/3095893037 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7b50066690 0x7f7b50068b50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7b60003fd0 tx=0x7f7b60009530 comp rx=0 tx=0).stop 2024-04-18T04:44:45.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.049+0000 7f7b77600640 1 -- 172.21.15.120:0/3095893037 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b701537f0 msgr2=0x7f7b7014eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:45.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.049+0000 7f7b77600640 1 --2- 172.21.15.120:0/3095893037 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b701537f0 0x7f7b7014eba0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7b680b3040 tx=0x7f7b6801bab0 comp rx=0 tx=0).stop 2024-04-18T04:44:45.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.049+0000 7f7b77600640 1 -- 172.21.15.120:0/3095893037 shutdown_connections 2024-04-18T04:44:45.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.049+0000 7f7b77600640 1 --2- 172.21.15.120:0/3095893037 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7b50066690 0x7f7b50068b50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:45.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.049+0000 7f7b77600640 1 --2- 172.21.15.120:0/3095893037 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b701537f0 0x7f7b7014eba0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:45.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.049+0000 7f7b77600640 1 --2- 172.21.15.120:0/3095893037 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7b700cf8d0 0x7f7b701eea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:45.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.049+0000 7f7b77600640 1 --2- 172.21.15.120:0/3095893037 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b700cae00 0x7f7b700b37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:45.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.049+0000 7f7b77600640 1 -- 172.21.15.120:0/3095893037 >> 172.21.15.120:0/3095893037 conn(0x7f7b70065fc0 msgr2=0x7f7b70152350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:45.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.049+0000 7f7b77600640 1 -- 172.21.15.120:0/3095893037 shutdown_connections 2024-04-18T04:44:45.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.049+0000 7f7b77600640 1 -- 172.21.15.120:0/3095893037 wait complete. 2024-04-18T04:44:45.069 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T04:44:45.172 INFO:tasks.ceph.mds.e.smithi120.stderr:2024-04-18T04:44:45.173+0000 7fbec2000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-18T04:44:45.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.209+0000 7f7e15e00640 1 Processor -- start 2024-04-18T04:44:45.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.209+0000 7f7e15e00640 1 -- start start 2024-04-18T04:44:45.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.209+0000 7f7e15e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7e10151730 0x7f7e10158150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:45.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.209+0000 7f7e15e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7e100caff0 0x7f7e100cb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:45.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.209+0000 7f7e15e00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e10072640 con 0x7f7e1006dcf0 2024-04-18T04:44:45.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.209+0000 7f7e15e00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e10071120 con 0x7f7e10151730 2024-04-18T04:44:45.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.209+0000 7f7e15e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e10072360 con 0x7f7e100caff0 2024-04-18T04:44:45.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.213+0000 7f7e0ea00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7e10151730 0x7f7e10158150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:45.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.213+0000 7f7e0ea00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7e10151730 0x7f7e10158150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46942/0 (socket says 172.21.15.120:46942) 2024-04-18T04:44:45.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.213+0000 7f7e0ea00640 1 -- 172.21.15.120:0/2188118539 learned_addr learned my addr 172.21.15.120:0/2188118539 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:45.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.213+0000 7f7e0f400640 1 --2- 172.21.15.120:0/2188118539 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7e100caff0 0x7f7e100cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:45.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.213+0000 7f7e0ea00640 1 -- 172.21.15.120:0/2188118539 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7e100caff0 msgr2=0x7f7e100cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:45.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.213+0000 7f7e0ea00640 1 --2- 172.21.15.120:0/2188118539 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7e100caff0 0x7f7e100cb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:45.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.213+0000 7f7e0ea00640 1 -- 172.21.15.120:0/2188118539 >> v1:172.21.15.132:6789/0 conn(0x7f7e1006dcf0 legacy=0x7f7e100c73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:45.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.213+0000 7f7e0ea00640 1 -- 172.21.15.120:0/2188118539 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1006f9d0 con 0x7f7e10151730 2024-04-18T04:44:45.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.213+0000 7f7e0ea00640 1 --2- 172.21.15.120:0/2188118539 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7e10151730 0x7f7e10158150 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7e00009e50 tx=0x7f7e0001f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c689eefdf92e6b90 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:45.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.213+0000 7f7e0d600640 1 -- 172.21.15.120:0/2188118539 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e000af400 con 0x7f7e10151730 2024-04-18T04:44:45.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.217+0000 7f7e0d600640 1 -- 172.21.15.120:0/2188118539 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e000ab050 con 0x7f7e10151730 2024-04-18T04:44:45.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.217+0000 7f7e0d600640 1 -- 172.21.15.120:0/2188118539 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e000af780 con 0x7f7e10151730 2024-04-18T04:44:45.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.217+0000 7f7e15e00640 1 -- 172.21.15.120:0/2188118539 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7e10151730 msgr2=0x7f7e10158150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:45.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.217+0000 7f7e15e00640 1 --2- 172.21.15.120:0/2188118539 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7e10151730 0x7f7e10158150 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7e00009e50 tx=0x7f7e0001f210 comp rx=0 tx=0).stop 2024-04-18T04:44:45.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.217+0000 7f7e15e00640 1 -- 172.21.15.120:0/2188118539 shutdown_connections 2024-04-18T04:44:45.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.217+0000 7f7e15e00640 1 --2- 172.21.15.120:0/2188118539 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7e100caff0 0x7f7e100cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:45.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.217+0000 7f7e15e00640 1 --2- 172.21.15.120:0/2188118539 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7e10151730 0x7f7e10158150 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:45.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.217+0000 7f7e15e00640 1 -- 172.21.15.120:0/2188118539 >> 172.21.15.120:0/2188118539 conn(0x7f7e1006b780 msgr2=0x7f7e1006bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:45.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.217+0000 7f7e15e00640 1 -- 172.21.15.120:0/2188118539 shutdown_connections 2024-04-18T04:44:45.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.217+0000 7f7e15e00640 1 -- 172.21.15.120:0/2188118539 wait complete. 2024-04-18T04:44:45.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.217+0000 7f7e15e00640 1 Processor -- start 2024-04-18T04:44:45.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.217+0000 7f7e15e00640 1 -- start start 2024-04-18T04:44:45.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.217+0000 7f7e15e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7e1006dcf0 0x7f7e10158990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:45.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.217+0000 7f7e15e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e100caff0 0x7f7e100c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:45.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.217+0000 7f7e15e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7e10151730 0x7f7e101e20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:45.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.217+0000 7f7e15e00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e10156d20 con 0x7f7e1006dcf0 2024-04-18T04:44:45.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.217+0000 7f7e15e00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e10155e30 con 0x7f7e100caff0 2024-04-18T04:44:45.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.217+0000 7f7e15e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e10156110 con 0x7f7e10151730 2024-04-18T04:44:45.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.217+0000 7f7e0ea00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7e1006dcf0 0x7f7e10158990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:45.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.217+0000 7f7e0ea00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7e1006dcf0 0x7f7e10158990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46956/0 (socket says 172.21.15.120:46956) 2024-04-18T04:44:45.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.217+0000 7f7e0ea00640 1 -- 172.21.15.120:0/848695016 learned_addr learned my addr 172.21.15.120:0/848695016 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:45.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.217+0000 7f7e0e000640 1 --2- 172.21.15.120:0/848695016 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e100caff0 0x7f7e100c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:45.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.217+0000 7f7e0f400640 1 --2- 172.21.15.120:0/848695016 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7e10151730 0x7f7e101e20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:45.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.217+0000 7f7e0ea00640 1 -- 172.21.15.120:0/848695016 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7e10151730 msgr2=0x7f7e101e20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:45.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.217+0000 7f7e0ea00640 1 --2- 172.21.15.120:0/848695016 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7e10151730 0x7f7e101e20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:45.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.217+0000 7f7e0ea00640 1 -- 172.21.15.120:0/848695016 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e100caff0 msgr2=0x7f7e100c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:45.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.217+0000 7f7e0ea00640 1 --2- 172.21.15.120:0/848695016 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e100caff0 0x7f7e100c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:45.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.217+0000 7f7e0ea00640 1 -- 172.21.15.120:0/848695016 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e00009b30 con 0x7f7e1006dcf0 2024-04-18T04:44:45.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.217+0000 7f7e0e000640 1 --2- 172.21.15.120:0/848695016 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e100caff0 0x7f7e100c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:44:45.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.221+0000 7f7e0ea00640 1 --2- 172.21.15.120:0/848695016 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7e1006dcf0 0x7f7e10158990 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7e0001ce40 tx=0x7f7e0001bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:45.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.221+0000 7f7e07400640 1 -- 172.21.15.120:0/848695016 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e000afdb0 con 0x7f7e1006dcf0 2024-04-18T04:44:45.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.221+0000 7f7e07400640 1 -- 172.21.15.120:0/848695016 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e00009510 con 0x7f7e1006dcf0 2024-04-18T04:44:45.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.221+0000 7f7e07400640 1 -- 172.21.15.120:0/848695016 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e000b9630 con 0x7f7e1006dcf0 2024-04-18T04:44:45.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.221+0000 7f7e15e00640 1 -- 172.21.15.120:0/848695016 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e101563f0 con 0x7f7e1006dcf0 2024-04-18T04:44:45.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.221+0000 7f7e15e00640 1 -- 172.21.15.120:0/848695016 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e101569b0 con 0x7f7e1006dcf0 2024-04-18T04:44:45.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.221+0000 7f7e15e00640 1 -- 172.21.15.120:0/848695016 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e100729d0 con 0x7f7e1006dcf0 2024-04-18T04:44:45.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.221+0000 7f7e07400640 1 -- 172.21.15.120:0/848695016 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7e000b6070 con 0x7f7e1006dcf0 2024-04-18T04:44:45.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.221+0000 7f7e07400640 1 --2- 172.21.15.120:0/848695016 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7df0066690 0x7f7df0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:45.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.221+0000 7f7e07400640 1 -- 172.21.15.120:0/848695016 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7e00122510 con 0x7f7e1006dcf0 2024-04-18T04:44:45.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.221+0000 7f7e0e000640 1 --2- 172.21.15.120:0/848695016 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7df0066690 0x7f7df0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:45.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.225+0000 7f7e0e000640 1 --2- 172.21.15.120:0/848695016 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7df0066690 0x7f7df0068b50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7e101e1ea0 tx=0x7f7dfc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:45.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.225+0000 7f7e07400640 1 -- 172.21.15.120:0/848695016 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f7e000ef580 con 0x7f7e1006dcf0 2024-04-18T04:44:45.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.381+0000 7f7e15e00640 1 -- 172.21.15.120:0/848695016 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7e100cb8b0 con 0x7f7e1006dcf0 2024-04-18T04:44:45.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.381+0000 7f7e07400640 1 -- 172.21.15.120:0/848695016 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7e000f2ba0 con 0x7f7e1006dcf0 2024-04-18T04:44:45.380 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2024-04-18T04:44:45.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.381+0000 7f7e15e00640 1 -- 172.21.15.120:0/848695016 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7df0066690 msgr2=0x7f7df0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:45.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.381+0000 7f7e15e00640 1 --2- 172.21.15.120:0/848695016 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7df0066690 0x7f7df0068b50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7e101e1ea0 tx=0x7f7dfc009040 comp rx=0 tx=0).stop 2024-04-18T04:44:45.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.381+0000 7f7e15e00640 1 -- 172.21.15.120:0/848695016 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7e1006dcf0 msgr2=0x7f7e10158990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:45.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.381+0000 7f7e15e00640 1 --2- 172.21.15.120:0/848695016 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7e1006dcf0 0x7f7e10158990 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7e0001ce40 tx=0x7f7e0001bfb0 comp rx=0 tx=0).stop 2024-04-18T04:44:45.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.381+0000 7f7e15e00640 1 -- 172.21.15.120:0/848695016 shutdown_connections 2024-04-18T04:44:45.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.381+0000 7f7e15e00640 1 --2- 172.21.15.120:0/848695016 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7df0066690 0x7f7df0068b50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:45.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.381+0000 7f7e15e00640 1 --2- 172.21.15.120:0/848695016 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7e10151730 0x7f7e101e20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:45.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.381+0000 7f7e15e00640 1 --2- 172.21.15.120:0/848695016 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e100caff0 0x7f7e100c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:45.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.381+0000 7f7e15e00640 1 --2- 172.21.15.120:0/848695016 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7e1006dcf0 0x7f7e10158990 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:45.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.381+0000 7f7e15e00640 1 -- 172.21.15.120:0/848695016 >> 172.21.15.120:0/848695016 conn(0x7f7e1006b780 msgr2=0x7f7e1006bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:45.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.381+0000 7f7e15e00640 1 -- 172.21.15.120:0/848695016 shutdown_connections 2024-04-18T04:44:45.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.385+0000 7f7e15e00640 1 -- 172.21.15.120:0/848695016 wait complete. 2024-04-18T04:44:45.402 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T04:44:45.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.541+0000 7f404a000640 1 Processor -- start 2024-04-18T04:44:45.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.541+0000 7f404a000640 1 -- start start 2024-04-18T04:44:45.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.541+0000 7f404a000640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f40440c1fe0 0x7f4044157db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:45.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.541+0000 7f404a000640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4044157920 con 0x7f40440c79c0 2024-04-18T04:44:45.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.541+0000 7f404a000640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f404406e9a0 con 0x7f40440c3ef0 2024-04-18T04:44:45.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.541+0000 7f404a000640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40441582f0 con 0x7f40440c1fe0 2024-04-18T04:44:45.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.541+0000 7f4043400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f40440c1fe0 0x7f4044157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:45.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.541+0000 7f4043400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f40440c1fe0 0x7f4044157db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46970/0 (socket says 172.21.15.120:46970) 2024-04-18T04:44:45.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.541+0000 7f4043400640 1 -- 172.21.15.120:0/2807361130 learned_addr learned my addr 172.21.15.120:0/2807361130 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:45.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.541+0000 7f4043400640 1 -- 172.21.15.120:0/2807361130 >> v1:172.21.15.132:6789/0 conn(0x7f40440c3ef0 legacy=0x7f404415b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:45.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.541+0000 7f4043400640 1 -- 172.21.15.120:0/2807361130 >> v1:172.21.15.120:6789/0 conn(0x7f40440c79c0 legacy=0x7f404415a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:45.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.541+0000 7f4043400640 1 -- 172.21.15.120:0/2807361130 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4044157330 con 0x7f40440c1fe0 2024-04-18T04:44:45.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.545+0000 7f4043400640 1 --2- 172.21.15.120:0/2807361130 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40440c1fe0 0x7f4044157db0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4044158430 tx=0x7f403401ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c10161577f519ce server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:45.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.545+0000 7f4042000640 1 -- 172.21.15.120:0/2807361130 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40340a8a30 con 0x7f40440c1fe0 2024-04-18T04:44:45.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.545+0000 7f4042000640 1 -- 172.21.15.120:0/2807361130 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40340a8b90 con 0x7f40440c1fe0 2024-04-18T04:44:45.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.545+0000 7f4042000640 1 -- 172.21.15.120:0/2807361130 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40340b0440 con 0x7f40440c1fe0 2024-04-18T04:44:45.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.545+0000 7f404a000640 1 -- 172.21.15.120:0/2807361130 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40440c1fe0 msgr2=0x7f4044157db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:45.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.545+0000 7f404a000640 1 --2- 172.21.15.120:0/2807361130 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40440c1fe0 0x7f4044157db0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4044158430 tx=0x7f403401ed30 comp rx=0 tx=0).stop 2024-04-18T04:44:45.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.545+0000 7f404a000640 1 -- 172.21.15.120:0/2807361130 shutdown_connections 2024-04-18T04:44:45.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.545+0000 7f404a000640 1 --2- 172.21.15.120:0/2807361130 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40440c1fe0 0x7f4044157db0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:45.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.545+0000 7f404a000640 1 -- 172.21.15.120:0/2807361130 >> 172.21.15.120:0/2807361130 conn(0x7f4044072190 msgr2=0x7f4044065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:45.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.545+0000 7f404a000640 1 -- 172.21.15.120:0/2807361130 shutdown_connections 2024-04-18T04:44:45.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.545+0000 7f404a000640 1 -- 172.21.15.120:0/2807361130 wait complete. 2024-04-18T04:44:45.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.549+0000 7f404a000640 1 Processor -- start 2024-04-18T04:44:45.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.549+0000 7f404a000640 1 -- start start 2024-04-18T04:44:45.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.549+0000 7f404a000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f40440c1fe0 0x7f40441503e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:45.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.549+0000 7f404a000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40440c3ef0 0x7f40441f2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:45.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.549+0000 7f404a000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40440c79c0 0x7f40441f2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:45.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.549+0000 7f404a000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40441e42a0 con 0x7f40440c79c0 2024-04-18T04:44:45.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.549+0000 7f404a000640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40441f1ee0 con 0x7f40440c3ef0 2024-04-18T04:44:45.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.549+0000 7f404a000640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f404406b100 con 0x7f40440c1fe0 2024-04-18T04:44:45.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.549+0000 7f4043e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40440c79c0 0x7f40441f2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:45.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.549+0000 7f4043e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40440c79c0 0x7f40441f2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46972/0 (socket says 172.21.15.120:46972) 2024-04-18T04:44:45.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.549+0000 7f4043e00640 1 -- 172.21.15.120:0/1803465407 learned_addr learned my addr 172.21.15.120:0/1803465407 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:45.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.549+0000 7f4043400640 1 --2- 172.21.15.120:0/1803465407 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f40440c1fe0 0x7f40441503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:45.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.549+0000 7f4042a00640 1 --2- 172.21.15.120:0/1803465407 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40440c3ef0 0x7f40441f2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:45.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.549+0000 7f4043e00640 1 -- 172.21.15.120:0/1803465407 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f40440c1fe0 msgr2=0x7f40441503e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:45.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.549+0000 7f4043e00640 1 --2- 172.21.15.120:0/1803465407 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f40440c1fe0 0x7f40441503e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:45.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.549+0000 7f4043e00640 1 -- 172.21.15.120:0/1803465407 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40440c3ef0 msgr2=0x7f40441f2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:45.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.549+0000 7f4043e00640 1 --2- 172.21.15.120:0/1803465407 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40440c3ef0 0x7f40441f2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:45.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.549+0000 7f4043e00640 1 -- 172.21.15.120:0/1803465407 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40340094d0 con 0x7f40440c79c0 2024-04-18T04:44:45.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.549+0000 7f4043e00640 1 --2- 172.21.15.120:0/1803465407 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40440c79c0 0x7f40441f2680 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f403c00c770 tx=0x7f403c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:45.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.549+0000 7f403b400640 1 -- 172.21.15.120:0/1803465407 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403c003b80 con 0x7f40440c79c0 2024-04-18T04:44:45.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.549+0000 7f403b400640 1 -- 172.21.15.120:0/1803465407 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f403c003ce0 con 0x7f40440c79c0 2024-04-18T04:44:45.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.549+0000 7f404a000640 1 -- 172.21.15.120:0/1803465407 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40441f2d00 con 0x7f40440c79c0 2024-04-18T04:44:45.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.549+0000 7f403b400640 1 -- 172.21.15.120:0/1803465407 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403c00aa90 con 0x7f40440c79c0 2024-04-18T04:44:45.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.549+0000 7f404a000640 1 -- 172.21.15.120:0/1803465407 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f404406b3a0 con 0x7f40440c79c0 2024-04-18T04:44:45.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.549+0000 7f404a000640 1 -- 172.21.15.120:0/1803465407 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4044067590 con 0x7f40440c79c0 2024-04-18T04:44:45.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.553+0000 7f403b400640 1 -- 172.21.15.120:0/1803465407 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f403c00abf0 con 0x7f40440c79c0 2024-04-18T04:44:45.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.553+0000 7f403b400640 1 --2- 172.21.15.120:0/1803465407 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4024066690 0x7f4024068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:45.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.553+0000 7f403b400640 1 -- 172.21.15.120:0/1803465407 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f403c0842b0 con 0x7f40440c79c0 2024-04-18T04:44:45.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.553+0000 7f4043400640 1 --2- 172.21.15.120:0/1803465407 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4024066690 0x7f4024068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:45.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.553+0000 7f4043400640 1 --2- 172.21.15.120:0/1803465407 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4024066690 0x7f4024068b50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f40340b2000 tx=0x7f4034009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:45.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.557+0000 7f403b400640 1 -- 172.21.15.120:0/1803465407 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f403c051320 con 0x7f40440c79c0 2024-04-18T04:44:45.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.709+0000 7f404a000640 1 -- 172.21.15.120:0/1803465407 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f404406b5c0 con 0x7f40440c79c0 2024-04-18T04:44:45.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.709+0000 7f403b400640 1 -- 172.21.15.120:0/1803465407 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f403c054940 con 0x7f40440c79c0 2024-04-18T04:44:45.710 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 64 2024-04-18T04:44:45.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.713+0000 7f404a000640 1 -- 172.21.15.120:0/1803465407 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4024066690 msgr2=0x7f4024068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:45.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.713+0000 7f404a000640 1 --2- 172.21.15.120:0/1803465407 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4024066690 0x7f4024068b50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f40340b2000 tx=0x7f4034009040 comp rx=0 tx=0).stop 2024-04-18T04:44:45.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.713+0000 7f404a000640 1 -- 172.21.15.120:0/1803465407 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40440c79c0 msgr2=0x7f40441f2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:45.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.713+0000 7f404a000640 1 --2- 172.21.15.120:0/1803465407 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40440c79c0 0x7f40441f2680 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f403c00c770 tx=0x7f403c00cc30 comp rx=0 tx=0).stop 2024-04-18T04:44:45.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.713+0000 7f404a000640 1 -- 172.21.15.120:0/1803465407 shutdown_connections 2024-04-18T04:44:45.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.713+0000 7f404a000640 1 --2- 172.21.15.120:0/1803465407 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4024066690 0x7f4024068b50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:45.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.713+0000 7f404a000640 1 --2- 172.21.15.120:0/1803465407 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40440c79c0 0x7f40441f2680 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:45.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.713+0000 7f404a000640 1 --2- 172.21.15.120:0/1803465407 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40440c3ef0 0x7f40441f2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:45.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.713+0000 7f404a000640 1 --2- 172.21.15.120:0/1803465407 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f40440c1fe0 0x7f40441503e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:45.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.713+0000 7f404a000640 1 -- 172.21.15.120:0/1803465407 >> 172.21.15.120:0/1803465407 conn(0x7f4044072190 msgr2=0x7f4044156200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:45.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.713+0000 7f404a000640 1 -- 172.21.15.120:0/1803465407 shutdown_connections 2024-04-18T04:44:45.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.713+0000 7f404a000640 1 -- 172.21.15.120:0/1803465407 wait complete. 2024-04-18T04:44:45.732 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-18T04:44:45.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.873+0000 7fc659e00640 1 Processor -- start 2024-04-18T04:44:45.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.873+0000 7fc659e00640 1 -- start start 2024-04-18T04:44:45.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.873+0000 7fc659e00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc6540c6da0 0x7fc6540ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:45.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.873+0000 7fc659e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc6540c8c30 0x7fc654159530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:45.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.873+0000 7fc659e00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6540c7180 con 0x7fc6540cd0b0 2024-04-18T04:44:45.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.873+0000 7fc659e00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc654150440 con 0x7fc6540c6da0 2024-04-18T04:44:45.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.873+0000 7fc659e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc65415cbc0 con 0x7fc6540c8c30 2024-04-18T04:44:45.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.873+0000 7fc653e00640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fc6540cd0b0 0x7fc6540c8520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:40356/0 (socket says 172.21.15.120:40356) 2024-04-18T04:44:45.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.873+0000 7fc653e00640 1 -- 172.21.15.120:0/4226402186 learned_addr learned my addr 172.21.15.120:0/4226402186 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:44:45.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.873+0000 7fc658a00640 1 --2- 172.21.15.120:0/4226402186 >> v2:172.21.15.132:3300/0 conn(0x7fc6540c6da0 0x7fc6540ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:45.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.873+0000 7fc659400640 1 --2- 172.21.15.120:0/4226402186 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc6540c8c30 0x7fc654159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:45.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.873+0000 7fc653400640 1 -- 172.21.15.120:0/4226402186 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3902974858 0 0) 0x7fc6540c7180 con 0x7fc6540cd0b0 2024-04-18T04:44:45.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.873+0000 7fc653400640 1 -- 172.21.15.120:0/4226402186 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc63c003530 con 0x7fc6540cd0b0 2024-04-18T04:44:45.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.873+0000 7fc653400640 1 -- 172.21.15.120:0/4226402186 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 827255024 0 0) 0x7fc63c003530 con 0x7fc6540cd0b0 2024-04-18T04:44:45.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.873+0000 7fc653400640 1 -- 172.21.15.120:0/4226402186 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc6540c8c30 msgr2=0x7fc654159530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:45.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.873+0000 7fc653400640 1 --2- 172.21.15.120:0/4226402186 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc6540c8c30 0x7fc654159530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:45.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.873+0000 7fc653400640 1 -- 172.21.15.120:0/4226402186 >> v2:172.21.15.132:3300/0 conn(0x7fc6540c6da0 msgr2=0x7fc6540ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:45.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.873+0000 7fc653400640 1 --2- 172.21.15.120:0/4226402186 >> v2:172.21.15.132:3300/0 conn(0x7fc6540c6da0 0x7fc6540ccb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:45.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.873+0000 7fc653400640 1 -- 172.21.15.120:0/4226402186 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc65415cea0 con 0x7fc6540cd0b0 2024-04-18T04:44:45.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.873+0000 7fc653400640 1 -- 172.21.15.120:0/4226402186 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7fc640001680 con 0x7fc6540cd0b0 2024-04-18T04:44:45.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.873+0000 7fc653400640 1 -- 172.21.15.120:0/4226402186 >> v1:172.21.15.120:6789/0 conn(0x7fc6540cd0b0 legacy=0x7fc6540c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:45.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.873+0000 7fc653400640 1 --2- 172.21.15.120:0/4226402186 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc6540c8c30 0x7fc63c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:45.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.873+0000 7fc653400640 1 --2- 172.21.15.120:0/4226402186 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc63c003f00 0x7fc63c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:45.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.873+0000 7fc653400640 1 --2- 172.21.15.120:0/4226402186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc63c004d10 0x7fc63c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:45.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.873+0000 7fc653400640 1 -- 172.21.15.120:0/4226402186 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc654150440 con 0x7fc63c003f00 2024-04-18T04:44:45.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.873+0000 7fc653400640 1 -- 172.21.15.120:0/4226402186 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc65415cbc0 con 0x7fc63c004d10 2024-04-18T04:44:45.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.873+0000 7fc653400640 1 -- 172.21.15.120:0/4226402186 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c00b990 con 0x7fc6540c8c30 2024-04-18T04:44:45.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.873+0000 7fc653e00640 1 --2- 172.21.15.120:0/4226402186 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc63c003f00 0x7fc63c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:45.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.873+0000 7fc658a00640 1 --2- 172.21.15.120:0/4226402186 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc6540c8c30 0x7fc63c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:45.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.873+0000 7fc659400640 1 --2- 172.21.15.120:0/4226402186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc63c004d10 0x7fc63c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:45.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.873+0000 7fc653e00640 1 -- 172.21.15.120:0/4226402186 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc6540c8c30 msgr2=0x7fc63c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:45.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.873+0000 7fc653e00640 1 --2- 172.21.15.120:0/4226402186 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc6540c8c30 0x7fc63c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:45.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.873+0000 7fc653e00640 1 -- 172.21.15.120:0/4226402186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc63c004d10 msgr2=0x7fc63c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:45.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.873+0000 7fc653e00640 1 --2- 172.21.15.120:0/4226402186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc63c004d10 0x7fc63c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:45.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.873+0000 7fc653e00640 1 -- 172.21.15.120:0/4226402186 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63c003530 con 0x7fc63c003f00 2024-04-18T04:44:45.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.873+0000 7fc658a00640 1 --2- 172.21.15.120:0/4226402186 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc6540c8c30 0x7fc63c003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:44:45.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.877+0000 7fc653e00640 1 --2- 172.21.15.120:0/4226402186 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc63c003f00 0x7fc63c0047d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc64000c210 tx=0x7fc64001f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93288693c6970546 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:45.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.877+0000 7fc653400640 1 -- 172.21.15.120:0/4226402186 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc640005ae0 con 0x7fc63c003f00 2024-04-18T04:44:45.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.877+0000 7fc653400640 1 -- 172.21.15.120:0/4226402186 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6400ab070 con 0x7fc63c003f00 2024-04-18T04:44:45.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.877+0000 7fc653400640 1 -- 172.21.15.120:0/4226402186 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc640007070 con 0x7fc63c003f00 2024-04-18T04:44:45.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.877+0000 7fc659e00640 1 -- 172.21.15.120:0/4226402186 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc63c003f00 msgr2=0x7fc63c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:45.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.877+0000 7fc659e00640 1 --2- 172.21.15.120:0/4226402186 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc63c003f00 0x7fc63c0047d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc64000c210 tx=0x7fc64001f370 comp rx=0 tx=0).stop 2024-04-18T04:44:45.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.877+0000 7fc659400640 1 -- 172.21.15.120:0/4226402186 reap_dead start 2024-04-18T04:44:45.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.877+0000 7fc659e00640 1 -- 172.21.15.120:0/4226402186 shutdown_connections 2024-04-18T04:44:45.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.877+0000 7fc659e00640 1 -- 172.21.15.120:0/4226402186 >> 172.21.15.120:0/4226402186 conn(0x7fc65406f4b0 msgr2=0x7fc65406f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:45.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.877+0000 7fc659e00640 1 -- 172.21.15.120:0/4226402186 shutdown_connections 2024-04-18T04:44:45.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.877+0000 7fc659e00640 1 -- 172.21.15.120:0/4226402186 wait complete. 2024-04-18T04:44:45.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.881+0000 7fc659e00640 1 Processor -- start 2024-04-18T04:44:45.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.881+0000 7fc659e00640 1 -- start start 2024-04-18T04:44:45.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.881+0000 7fc659e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc63c003f00 0x7fc6540c2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:45.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.881+0000 7fc659e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc65415c700 0x7fc6541e2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:45.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.881+0000 7fc659e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6541530e0 0x7fc65414f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:45.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.881+0000 7fc659e00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc654153690 con 0x7fc65415c700 2024-04-18T04:44:45.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.881+0000 7fc659e00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc654152e70 con 0x7fc6541530e0 2024-04-18T04:44:45.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.881+0000 7fc659e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6541e46e0 con 0x7fc63c003f00 2024-04-18T04:44:45.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.881+0000 7fc653e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc65415c700 0x7fc6541e2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:45.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.881+0000 7fc653e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc65415c700 0x7fc6541e2940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46988/0 (socket says 172.21.15.120:46988) 2024-04-18T04:44:45.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.881+0000 7fc653e00640 1 -- 172.21.15.120:0/1433018763 learned_addr learned my addr 172.21.15.120:0/1433018763 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:45.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.881+0000 7fc659400640 1 --2- 172.21.15.120:0/1433018763 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6541530e0 0x7fc65414f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:45.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.881+0000 7fc658a00640 1 --2- 172.21.15.120:0/1433018763 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc63c003f00 0x7fc6540c2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:45.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.881+0000 7fc653e00640 1 -- 172.21.15.120:0/1433018763 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc63c003f00 msgr2=0x7fc6540c2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:45.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.881+0000 7fc653e00640 1 --2- 172.21.15.120:0/1433018763 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc63c003f00 0x7fc6540c2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:45.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.881+0000 7fc653e00640 1 -- 172.21.15.120:0/1433018763 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6541530e0 msgr2=0x7fc65414f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:45.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.881+0000 7fc653e00640 1 --2- 172.21.15.120:0/1433018763 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6541530e0 0x7fc65414f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:45.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.881+0000 7fc653e00640 1 -- 172.21.15.120:0/1433018763 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6541eeff0 con 0x7fc65415c700 2024-04-18T04:44:45.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.881+0000 7fc659400640 1 --2- 172.21.15.120:0/1433018763 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6541530e0 0x7fc65414f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:44:45.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.881+0000 7fc653e00640 1 --2- 172.21.15.120:0/1433018763 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc65415c700 0x7fc6541e2940 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc64001fc10 tx=0x7fc63c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:45.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.881+0000 7fc650c00640 1 -- 172.21.15.120:0/1433018763 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6400b7070 con 0x7fc65415c700 2024-04-18T04:44:45.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.881+0000 7fc650c00640 1 -- 172.21.15.120:0/1433018763 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc640005940 con 0x7fc65415c700 2024-04-18T04:44:45.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.881+0000 7fc650c00640 1 -- 172.21.15.120:0/1433018763 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc640005cd0 con 0x7fc65415c700 2024-04-18T04:44:45.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.881+0000 7fc659e00640 1 -- 172.21.15.120:0/1433018763 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6541ef2d0 con 0x7fc65415c700 2024-04-18T04:44:45.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.881+0000 7fc659e00640 1 -- 172.21.15.120:0/1433018763 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6540c3420 con 0x7fc65415c700 2024-04-18T04:44:45.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.885+0000 7fc659e00640 1 -- 172.21.15.120:0/1433018763 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6541534c0 con 0x7fc65415c700 2024-04-18T04:44:45.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.885+0000 7fc650c00640 1 -- 172.21.15.120:0/1433018763 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc6400ad020 con 0x7fc65415c700 2024-04-18T04:44:45.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.885+0000 7fc650c00640 1 --2- 172.21.15.120:0/1433018763 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc6340666c0 0x7fc634068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:45.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.885+0000 7fc650c00640 1 -- 172.21.15.120:0/1433018763 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc640120db0 con 0x7fc65415c700 2024-04-18T04:44:45.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.885+0000 7fc658a00640 1 --2- 172.21.15.120:0/1433018763 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc6340666c0 0x7fc634068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:45.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.885+0000 7fc658a00640 1 --2- 172.21.15.120:0/1433018763 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc6340666c0 0x7fc634068b80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc648009a30 tx=0x7fc648008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:45.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:45.889+0000 7fc650c00640 1 -- 172.21.15.120:0/1433018763 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fc6400f1820 con 0x7fc65415c700 2024-04-18T04:44:46.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.045+0000 7fc659e00640 1 -- 172.21.15.120:0/1433018763 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc6540728f0 con 0x7fc65415c700 2024-04-18T04:44:46.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.045+0000 7fc650c00640 1 -- 172.21.15.120:0/1433018763 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc6400f13b0 con 0x7fc65415c700 2024-04-18T04:44:46.045 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2024-04-18T04:44:46.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.049+0000 7fc659e00640 1 -- 172.21.15.120:0/1433018763 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc6340666c0 msgr2=0x7fc634068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:46.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.049+0000 7fc659e00640 1 --2- 172.21.15.120:0/1433018763 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc6340666c0 0x7fc634068b80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc648009a30 tx=0x7fc648008040 comp rx=0 tx=0).stop 2024-04-18T04:44:46.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.049+0000 7fc659e00640 1 -- 172.21.15.120:0/1433018763 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc65415c700 msgr2=0x7fc6541e2940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:46.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.049+0000 7fc659e00640 1 --2- 172.21.15.120:0/1433018763 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc65415c700 0x7fc6541e2940 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc64001fc10 tx=0x7fc63c005800 comp rx=0 tx=0).stop 2024-04-18T04:44:46.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.049+0000 7fc659e00640 1 -- 172.21.15.120:0/1433018763 shutdown_connections 2024-04-18T04:44:46.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.049+0000 7fc659e00640 1 --2- 172.21.15.120:0/1433018763 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc6340666c0 0x7fc634068b80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:46.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.049+0000 7fc659e00640 1 --2- 172.21.15.120:0/1433018763 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6541530e0 0x7fc65414f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:46.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.049+0000 7fc659e00640 1 --2- 172.21.15.120:0/1433018763 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc65415c700 0x7fc6541e2940 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:46.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.049+0000 7fc659e00640 1 --2- 172.21.15.120:0/1433018763 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc63c003f00 0x7fc6540c2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:46.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.049+0000 7fc659e00640 1 -- 172.21.15.120:0/1433018763 >> 172.21.15.120:0/1433018763 conn(0x7fc65406f4b0 msgr2=0x7fc65406f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:46.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.049+0000 7fc659e00640 1 -- 172.21.15.120:0/1433018763 shutdown_connections 2024-04-18T04:44:46.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.049+0000 7fc659e00640 1 -- 172.21.15.120:0/1433018763 wait complete. 2024-04-18T04:44:46.067 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-18T04:44:46.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.205+0000 7f0b88c00640 1 Processor -- start 2024-04-18T04:44:46.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.205+0000 7f0b88c00640 1 -- start start 2024-04-18T04:44:46.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.205+0000 7f0b88c00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0b84072340 0x7f0b8415c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:46.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.205+0000 7f0b88c00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0b8415a1a0 0x7f0b8406cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:46.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.205+0000 7f0b88c00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b8415d880 con 0x7f0b84159d80 2024-04-18T04:44:46.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.205+0000 7f0b88c00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b84072720 con 0x7f0b8415a1a0 2024-04-18T04:44:46.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.205+0000 7f0b88c00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b840c7e90 con 0x7f0b84072340 2024-04-18T04:44:46.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.209+0000 7f0b83e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0b8415a1a0 0x7f0b8406cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:46.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.209+0000 7f0b83e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0b8415a1a0 0x7f0b8406cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47004/0 (socket says 172.21.15.120:47004) 2024-04-18T04:44:46.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.209+0000 7f0b83e00640 1 -- 172.21.15.120:0/3869769586 learned_addr learned my addr 172.21.15.120:0/3869769586 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:46.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.209+0000 7f0b83400640 1 --2- 172.21.15.120:0/3869769586 >> v2:172.21.15.132:3300/0 conn(0x7f0b84072340 0x7f0b8415c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:46.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.209+0000 7f0b83e00640 1 -- 172.21.15.120:0/3869769586 >> v2:172.21.15.132:3300/0 conn(0x7f0b84072340 msgr2=0x7f0b8415c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:46.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.209+0000 7f0b83e00640 1 --2- 172.21.15.120:0/3869769586 >> v2:172.21.15.132:3300/0 conn(0x7f0b84072340 0x7f0b8415c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:46.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.209+0000 7f0b83e00640 1 -- 172.21.15.120:0/3869769586 >> v1:172.21.15.132:6789/0 conn(0x7f0b84159d80 legacy=0x7f0b8406b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:46.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.209+0000 7f0b83e00640 1 -- 172.21.15.120:0/3869769586 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b8415cfe0 con 0x7f0b8415a1a0 2024-04-18T04:44:46.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.209+0000 7f0b83e00640 1 --2- 172.21.15.120:0/3869769586 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b8415a1a0 0x7f0b8406cee0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0b840c9670 tx=0x7f0b7c01f1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2180b6708c90f3af server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:46.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.209+0000 7f0b82a00640 1 -- 172.21.15.120:0/3869769586 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c0af400 con 0x7f0b8415a1a0 2024-04-18T04:44:46.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.209+0000 7f0b82a00640 1 -- 172.21.15.120:0/3869769586 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b7c0ab050 con 0x7f0b8415a1a0 2024-04-18T04:44:46.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.209+0000 7f0b82a00640 1 -- 172.21.15.120:0/3869769586 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c0af780 con 0x7f0b8415a1a0 2024-04-18T04:44:46.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.213+0000 7f0b88c00640 1 -- 172.21.15.120:0/3869769586 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b8415a1a0 msgr2=0x7f0b8406cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:46.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.213+0000 7f0b88c00640 1 --2- 172.21.15.120:0/3869769586 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b8415a1a0 0x7f0b8406cee0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0b840c9670 tx=0x7f0b7c01f1a0 comp rx=0 tx=0).stop 2024-04-18T04:44:46.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.213+0000 7f0b88c00640 1 -- 172.21.15.120:0/3869769586 shutdown_connections 2024-04-18T04:44:46.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.213+0000 7f0b88c00640 1 --2- 172.21.15.120:0/3869769586 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b8415a1a0 0x7f0b8406cee0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:46.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.213+0000 7f0b88c00640 1 --2- 172.21.15.120:0/3869769586 >> v2:172.21.15.132:3300/0 conn(0x7f0b84072340 0x7f0b8415c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:46.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.213+0000 7f0b88c00640 1 -- 172.21.15.120:0/3869769586 >> 172.21.15.120:0/3869769586 conn(0x7f0b840cbeb0 msgr2=0x7f0b840cc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:46.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.213+0000 7f0b88c00640 1 -- 172.21.15.120:0/3869769586 shutdown_connections 2024-04-18T04:44:46.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.213+0000 7f0b88c00640 1 -- 172.21.15.120:0/3869769586 wait complete. 2024-04-18T04:44:46.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.213+0000 7f0b88c00640 1 Processor -- start 2024-04-18T04:44:46.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.213+0000 7f0b88c00640 1 -- start start 2024-04-18T04:44:46.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.213+0000 7f0b88c00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b84072340 0x7f0b8415c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:46.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.213+0000 7f0b88c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b84159d80 0x7f0b841ef320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:46.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.213+0000 7f0b88c00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b8415a1a0 0x7f0b8414ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:46.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.213+0000 7f0b88c00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b841eee90 con 0x7f0b84159d80 2024-04-18T04:44:46.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.213+0000 7f0b88c00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b84153de0 con 0x7f0b84072340 2024-04-18T04:44:46.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.213+0000 7f0b88c00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b841eeb80 con 0x7f0b8415a1a0 2024-04-18T04:44:46.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.213+0000 7f0b7be00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b84159d80 0x7f0b841ef320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:46.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.213+0000 7f0b7be00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b84159d80 0x7f0b841ef320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47006/0 (socket says 172.21.15.120:47006) 2024-04-18T04:44:46.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.213+0000 7f0b7be00640 1 -- 172.21.15.120:0/1920739841 learned_addr learned my addr 172.21.15.120:0/1920739841 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:46.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.213+0000 7f0b83400640 1 --2- 172.21.15.120:0/1920739841 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b84072340 0x7f0b8415c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:46.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.213+0000 7f0b83e00640 1 --2- 172.21.15.120:0/1920739841 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b8415a1a0 0x7f0b8414ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:46.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.213+0000 7f0b7be00640 1 -- 172.21.15.120:0/1920739841 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b8415a1a0 msgr2=0x7f0b8414ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:46.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.213+0000 7f0b7be00640 1 --2- 172.21.15.120:0/1920739841 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b8415a1a0 0x7f0b8414ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:46.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.213+0000 7f0b7be00640 1 -- 172.21.15.120:0/1920739841 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b84072340 msgr2=0x7f0b8415c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:46.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.213+0000 7f0b7be00640 1 --2- 172.21.15.120:0/1920739841 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b84072340 0x7f0b8415c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:46.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.213+0000 7f0b7be00640 1 -- 172.21.15.120:0/1920739841 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b7c009b30 con 0x7f0b84159d80 2024-04-18T04:44:46.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.213+0000 7f0b7be00640 1 --2- 172.21.15.120:0/1920739841 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b84159d80 0x7f0b841ef320 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c00c450 tx=0x7f0b6c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:46.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.217+0000 7f0b7b400640 1 -- 172.21.15.120:0/1920739841 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c012830 con 0x7f0b84159d80 2024-04-18T04:44:46.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.217+0000 7f0b7b400640 1 -- 172.21.15.120:0/1920739841 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6c0129b0 con 0x7f0b84159d80 2024-04-18T04:44:46.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.217+0000 7f0b7b400640 1 -- 172.21.15.120:0/1920739841 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c012d60 con 0x7f0b84159d80 2024-04-18T04:44:46.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.217+0000 7f0b88c00640 1 -- 172.21.15.120:0/1920739841 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b841e5bc0 con 0x7f0b84159d80 2024-04-18T04:44:46.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.217+0000 7f0b88c00640 1 -- 172.21.15.120:0/1920739841 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b841e6180 con 0x7f0b84159d80 2024-04-18T04:44:46.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.217+0000 7f0b88c00640 1 -- 172.21.15.120:0/1920739841 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b841ef040 con 0x7f0b84159d80 2024-04-18T04:44:46.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.217+0000 7f0b7b400640 1 -- 172.21.15.120:0/1920739841 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0b6c01c460 con 0x7f0b84159d80 2024-04-18T04:44:46.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.217+0000 7f0b7b400640 1 --2- 172.21.15.120:0/1920739841 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0b600666c0 0x7f0b60068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:46.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.217+0000 7f0b7b400640 1 -- 172.21.15.120:0/1920739841 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0b6c084130 con 0x7f0b84159d80 2024-04-18T04:44:46.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.217+0000 7f0b83400640 1 --2- 172.21.15.120:0/1920739841 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0b600666c0 0x7f0b60068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:46.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.221+0000 7f0b83400640 1 --2- 172.21.15.120:0/1920739841 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0b600666c0 0x7f0b60068b80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0b74007a60 tx=0x7f0b74008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:46.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.221+0000 7f0b7b400640 1 -- 172.21.15.120:0/1920739841 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f0b841ef040 con 0x7f0b84159d80 2024-04-18T04:44:46.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.393+0000 7f0b88c00640 1 -- 172.21.15.120:0/1920739841 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0b8404f100 con 0x7f0b84159d80 2024-04-18T04:44:46.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.393+0000 7f0b7b400640 1 -- 172.21.15.120:0/1920739841 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0b6c051250 con 0x7f0b84159d80 2024-04-18T04:44:46.392 INFO:teuthology.orchestra.run.smithi120.stderr:listed 0 entries 2024-04-18T04:44:46.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.393+0000 7f0b88c00640 1 -- 172.21.15.120:0/1920739841 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0b600666c0 msgr2=0x7f0b60068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:46.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.393+0000 7f0b88c00640 1 --2- 172.21.15.120:0/1920739841 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0b600666c0 0x7f0b60068b80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0b74007a60 tx=0x7f0b74008040 comp rx=0 tx=0).stop 2024-04-18T04:44:46.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.393+0000 7f0b88c00640 1 -- 172.21.15.120:0/1920739841 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b84159d80 msgr2=0x7f0b841ef320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:46.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.393+0000 7f0b88c00640 1 --2- 172.21.15.120:0/1920739841 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b84159d80 0x7f0b841ef320 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c00c450 tx=0x7f0b6c00c910 comp rx=0 tx=0).stop 2024-04-18T04:44:46.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.393+0000 7f0b88c00640 1 -- 172.21.15.120:0/1920739841 shutdown_connections 2024-04-18T04:44:46.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.393+0000 7f0b88c00640 1 --2- 172.21.15.120:0/1920739841 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0b600666c0 0x7f0b60068b80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:46.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.393+0000 7f0b88c00640 1 --2- 172.21.15.120:0/1920739841 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b8415a1a0 0x7f0b8414ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:46.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.393+0000 7f0b88c00640 1 --2- 172.21.15.120:0/1920739841 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b84159d80 0x7f0b841ef320 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:46.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.393+0000 7f0b88c00640 1 --2- 172.21.15.120:0/1920739841 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b84072340 0x7f0b8415c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:46.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.393+0000 7f0b88c00640 1 -- 172.21.15.120:0/1920739841 >> 172.21.15.120:0/1920739841 conn(0x7f0b840cbeb0 msgr2=0x7f0b8406b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:46.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.393+0000 7f0b88c00640 1 -- 172.21.15.120:0/1920739841 shutdown_connections 2024-04-18T04:44:46.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.393+0000 7f0b88c00640 1 -- 172.21.15.120:0/1920739841 wait complete. 2024-04-18T04:44:46.414 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-18T04:44:46.414 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-18T04:44:46.423 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T04:44:46.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.601+0000 7f3e01c00640 1 Processor -- start 2024-04-18T04:44:46.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.601+0000 7f3e01c00640 1 -- start start 2024-04-18T04:44:46.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.601+0000 7f3e01c00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3dfc0c7870 0x7f3dfc0c9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:46.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.601+0000 7f3e01c00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3dfc06afd0 0x7f3dfc0c9e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:46.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.601+0000 7f3e01c00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dfc06b4f0 con 0x7f3dfc0c3780 2024-04-18T04:44:46.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.601+0000 7f3e01c00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dfc15a3f0 con 0x7f3dfc06afd0 2024-04-18T04:44:46.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.601+0000 7f3e01c00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc06cad0 con 0x7f3dfc0c7870 2024-04-18T04:44:46.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.605+0000 7f3dfb400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3dfc06afd0 0x7f3dfc0c9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:46.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.605+0000 7f3dfb400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3dfc06afd0 0x7f3dfc0c9e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47022/0 (socket says 172.21.15.120:47022) 2024-04-18T04:44:46.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.605+0000 7f3dfb400640 1 -- 172.21.15.120:0/610675186 learned_addr learned my addr 172.21.15.120:0/610675186 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:46.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.605+0000 7f3dfa000640 1 --2- 172.21.15.120:0/610675186 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3dfc0c7870 0x7f3dfc0c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:46.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.605+0000 7f3dfb400640 1 -- 172.21.15.120:0/610675186 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3dfc0c7870 msgr2=0x7f3dfc0c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:46.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.605+0000 7f3dfb400640 1 --2- 172.21.15.120:0/610675186 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3dfc0c7870 0x7f3dfc0c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:46.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.605+0000 7f3dfb400640 1 -- 172.21.15.120:0/610675186 >> v1:172.21.15.132:6789/0 conn(0x7f3dfc0c3780 legacy=0x7f3dfc06f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:46.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.605+0000 7f3dfb400640 1 -- 172.21.15.120:0/610675186 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dfc06cdb0 con 0x7f3dfc06afd0 2024-04-18T04:44:46.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.605+0000 7f3dfb400640 1 --2- 172.21.15.120:0/610675186 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3dfc06afd0 0x7f3dfc0c9e40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3df4009870 tx=0x7f3df401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68f168d5de6f83c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:46.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.605+0000 7f3df9600640 1 -- 172.21.15.120:0/610675186 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df40ab610 con 0x7f3dfc06afd0 2024-04-18T04:44:46.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.605+0000 7f3df9600640 1 -- 172.21.15.120:0/610675186 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df40ab770 con 0x7f3dfc06afd0 2024-04-18T04:44:46.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.605+0000 7f3df9600640 1 -- 172.21.15.120:0/610675186 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df40abb00 con 0x7f3dfc06afd0 2024-04-18T04:44:46.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.609+0000 7f3e01c00640 1 -- 172.21.15.120:0/610675186 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3dfc06afd0 msgr2=0x7f3dfc0c9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:46.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.609+0000 7f3e01c00640 1 --2- 172.21.15.120:0/610675186 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3dfc06afd0 0x7f3dfc0c9e40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3df4009870 tx=0x7f3df401c500 comp rx=0 tx=0).stop 2024-04-18T04:44:46.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.609+0000 7f3e01c00640 1 -- 172.21.15.120:0/610675186 shutdown_connections 2024-04-18T04:44:46.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.609+0000 7f3e01c00640 1 --2- 172.21.15.120:0/610675186 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3dfc06afd0 0x7f3dfc0c9e40 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:46.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.609+0000 7f3e01c00640 1 --2- 172.21.15.120:0/610675186 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3dfc0c7870 0x7f3dfc0c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:46.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.609+0000 7f3e01c00640 1 -- 172.21.15.120:0/610675186 >> 172.21.15.120:0/610675186 conn(0x7f3dfc0720e0 msgr2=0x7f3dfc065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:46.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.609+0000 7f3e01c00640 1 -- 172.21.15.120:0/610675186 shutdown_connections 2024-04-18T04:44:46.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.609+0000 7f3e01c00640 1 -- 172.21.15.120:0/610675186 wait complete. 2024-04-18T04:44:46.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.609+0000 7f3e01c00640 1 Processor -- start 2024-04-18T04:44:46.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.609+0000 7f3e01c00640 1 -- start start 2024-04-18T04:44:46.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.609+0000 7f3e01c00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3dfc06afd0 0x7f3dfc0cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:46.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.609+0000 7f3e01c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3dfc0c3780 0x7f3dfc153600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:46.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.609+0000 7f3e01c00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3dfc0c7870 0x7f3dfc153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:46.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.609+0000 7f3e01c00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc1f1e80 con 0x7f3dfc0c3780 2024-04-18T04:44:46.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.609+0000 7f3e01c00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc14d870 con 0x7f3dfc06afd0 2024-04-18T04:44:46.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.609+0000 7f3e01c00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc1f2090 con 0x7f3dfc0c7870 2024-04-18T04:44:46.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.609+0000 7f3dfa000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3dfc0c3780 0x7f3dfc153600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:46.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.609+0000 7f3dfa000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3dfc0c3780 0x7f3dfc153600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47032/0 (socket says 172.21.15.120:47032) 2024-04-18T04:44:46.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.609+0000 7f3dfa000640 1 -- 172.21.15.120:0/730062869 learned_addr learned my addr 172.21.15.120:0/730062869 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:46.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.609+0000 7f3dfaa00640 1 --2- 172.21.15.120:0/730062869 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3dfc06afd0 0x7f3dfc0cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:46.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.609+0000 7f3dfb400640 1 --2- 172.21.15.120:0/730062869 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3dfc0c7870 0x7f3dfc153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:46.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.609+0000 7f3dfa000640 1 -- 172.21.15.120:0/730062869 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3dfc0c7870 msgr2=0x7f3dfc153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:46.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.609+0000 7f3dfa000640 1 --2- 172.21.15.120:0/730062869 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3dfc0c7870 0x7f3dfc153b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:46.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.609+0000 7f3dfa000640 1 -- 172.21.15.120:0/730062869 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3dfc06afd0 msgr2=0x7f3dfc0cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:46.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.609+0000 7f3dfa000640 1 --2- 172.21.15.120:0/730062869 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3dfc06afd0 0x7f3dfc0cd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:46.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.609+0000 7f3dfa000640 1 -- 172.21.15.120:0/730062869 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df40094d0 con 0x7f3dfc0c3780 2024-04-18T04:44:46.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.609+0000 7f3dfaa00640 1 --2- 172.21.15.120:0/730062869 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3dfc06afd0 0x7f3dfc0cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:44:46.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.613+0000 7f3dfa000640 1 --2- 172.21.15.120:0/730062869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3dfc0c3780 0x7f3dfc153600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3de800d5c0 tx=0x7f3de800da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:46.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.613+0000 7f3df2a00640 1 -- 172.21.15.120:0/730062869 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de80125f0 con 0x7f3dfc0c3780 2024-04-18T04:44:46.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.613+0000 7f3df2a00640 1 -- 172.21.15.120:0/730062869 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de8012750 con 0x7f3dfc0c3780 2024-04-18T04:44:46.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.613+0000 7f3e01c00640 1 -- 172.21.15.120:0/730062869 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dfc1f2370 con 0x7f3dfc0c3780 2024-04-18T04:44:46.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.613+0000 7f3df2a00640 1 -- 172.21.15.120:0/730062869 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de8012b00 con 0x7f3dfc0c3780 2024-04-18T04:44:46.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.613+0000 7f3e01c00640 1 -- 172.21.15.120:0/730062869 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dfc1f2930 con 0x7f3dfc0c3780 2024-04-18T04:44:46.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.613+0000 7f3e01c00640 1 -- 172.21.15.120:0/730062869 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dfc14d9e0 con 0x7f3dfc0c3780 2024-04-18T04:44:46.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.613+0000 7f3df2a00640 1 -- 172.21.15.120:0/730062869 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3de8012c60 con 0x7f3dfc0c3780 2024-04-18T04:44:46.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.613+0000 7f3df2a00640 1 --2- 172.21.15.120:0/730062869 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3ddc066690 0x7f3ddc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:46.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.613+0000 7f3df2a00640 1 -- 172.21.15.120:0/730062869 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3de8084820 con 0x7f3dfc0c3780 2024-04-18T04:44:46.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.613+0000 7f3dfaa00640 1 --2- 172.21.15.120:0/730062869 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3ddc066690 0x7f3ddc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:46.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.617+0000 7f3dfaa00640 1 --2- 172.21.15.120:0/730062869 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3ddc066690 0x7f3ddc068b50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3dec0012f0 tx=0x7f3dec009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:46.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.617+0000 7f3df2a00640 1 -- 172.21.15.120:0/730062869 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f3de8051800 con 0x7f3dfc0c3780 2024-04-18T04:44:46.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.773+0000 7f3e01c00640 1 -- 172.21.15.120:0/730062869 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3dfc072a70 con 0x7f3dfc0c3780 2024-04-18T04:44:46.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.773+0000 7f3df2a00640 1 -- 172.21.15.120:0/730062869 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f3de8054e20 con 0x7f3dfc0c3780 2024-04-18T04:44:46.774 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:44:46.774 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":25,"fsid":"8e73592f-08e2-4957-a98f-9d044cec4ba5","created":"2024-04-18T04:44:06.139983+0000","modified":"2024-04-18T04:44:34.676253+0000","last_up_change":"2024-04-18T04:44:17.410146+0000","last_in_change":"2024-04-18T04:44:08.470250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T04:44:16.864728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T04:44:28.825773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T04:44:29.245857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-18T04:44:32.314302+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a80903bd-d9be-4fb9-af99-6125cb26bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":27468},{"type":"v1","addr":"172.21.15.120:6801","nonce":27468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":27468},{"type":"v1","addr":"172.21.15.120:6803","nonce":27468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":27468},{"type":"v1","addr":"172.21.15.120:6807","nonce":27468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":27468},{"type":"v1","addr":"172.21.15.120:6805","nonce":27468}]},"public_addr":"172.21.15.120:6801/27468","cluster_addr":"172.21.15.120:6803/27468","heartbeat_back_addr":"172.21.15.120:6807/27468","heartbeat_front_addr":"172.21.15.120:6805/27468","state":["exists","up"]},{"osd":1,"uuid":"8f5f004b-6870-4c78-8d50-9622e631ec25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":27470},{"type":"v1","addr":"172.21.15.120:6823","nonce":27470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":27470},{"type":"v1","addr":"172.21.15.120:6827","nonce":27470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":27470},{"type":"v1","addr":"172.21.15.120:6831","nonce":27470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":27470},{"type":"v1","addr":"172.21.15.120:6829","nonce":27470}]},"public_addr":"172.21.15.120:6823/27470","cluster_addr":"172.21.15.120:6827/27470","heartbeat_back_addr":"172.21.15.120:6831/27470","heartbeat_front_addr":"172.21.15.120:6829/27470","state":["exists","up"]},{"osd":2,"uuid":"6e228a2b-6103-4301-a8b5-ee81dbb1f920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":27471},{"type":"v1","addr":"172.21.15.120:6817","nonce":27471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":27471},{"type":"v1","addr":"172.21.15.120:6819","nonce":27471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":27471},{"type":"v1","addr":"172.21.15.120:6826","nonce":27471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":27471},{"type":"v1","addr":"172.21.15.120:6822","nonce":27471}]},"public_addr":"172.21.15.120:6817/27471","cluster_addr":"172.21.15.120:6819/27471","heartbeat_back_addr":"172.21.15.120:6826/27471","heartbeat_front_addr":"172.21.15.120:6822/27471","state":["exists","up"]},{"osd":3,"uuid":"7a5cabd7-d898-4e32-a03c-25b46e790134","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":27469},{"type":"v1","addr":"172.21.15.120:6809","nonce":27469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":27469},{"type":"v1","addr":"172.21.15.120:6811","nonce":27469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":27469},{"type":"v1","addr":"172.21.15.120:6815","nonce":27469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":27469},{"type":"v1","addr":"172.21.15.120:6813","nonce":27469}]},"public_addr":"172.21.15.120:6809/27469","cluster_addr":"172.21.15.120:6811/27469","heartbeat_back_addr":"172.21.15.120:6815/27469","heartbeat_front_addr":"172.21.15.120:6813/27469","state":["exists","up"]},{"osd":4,"uuid":"8e9f530f-6bab-4b23-a1a3-a71362fefcc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":28102},{"type":"v1","addr":"172.21.15.132:6825","nonce":28102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":28102},{"type":"v1","addr":"172.21.15.132:6827","nonce":28102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":28102},{"type":"v1","addr":"172.21.15.132:6831","nonce":28102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":28102},{"type":"v1","addr":"172.21.15.132:6829","nonce":28102}]},"public_addr":"172.21.15.132:6825/28102","cluster_addr":"172.21.15.132:6827/28102","heartbeat_back_addr":"172.21.15.132:6831/28102","heartbeat_front_addr":"172.21.15.132:6829/28102","state":["exists","up"]},{"osd":5,"uuid":"2243fabe-cc81-40cf-91bc-f106fe275a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":28104},{"type":"v1","addr":"172.21.15.132:6809","nonce":28104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":28104},{"type":"v1","addr":"172.21.15.132:6811","nonce":28104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":28104},{"type":"v1","addr":"172.21.15.132:6815","nonce":28104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":28104},{"type":"v1","addr":"172.21.15.132:6813","nonce":28104}]},"public_addr":"172.21.15.132:6809/28104","cluster_addr":"172.21.15.132:6811/28104","heartbeat_back_addr":"172.21.15.132:6815/28104","heartbeat_front_addr":"172.21.15.132:6813/28104","state":["exists","up"]},{"osd":6,"uuid":"c093a5ed-25c8-41a7-a20d-606a1a1661e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":28103},{"type":"v1","addr":"172.21.15.132:6801","nonce":28103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":28103},{"type":"v1","addr":"172.21.15.132:6803","nonce":28103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":28103},{"type":"v1","addr":"172.21.15.132:6807","nonce":28103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":28103},{"type":"v1","addr":"172.21.15.132:6805","nonce":28103}]},"public_addr":"172.21.15.132:6801/28103","cluster_addr":"172.21.15.132:6803/28103","heartbeat_back_addr":"172.21.15.132:6807/28103","heartbeat_front_addr":"172.21.15.132:6805/28103","state":["exists","up"]},{"osd":7,"uuid":"c37426b7-1080-4434-9f3e-a3afbbdc0fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":28129},{"type":"v1","addr":"172.21.15.132:6817","nonce":28129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":28129},{"type":"v1","addr":"172.21.15.132:6819","nonce":28129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":28129},{"type":"v1","addr":"172.21.15.132:6823","nonce":28129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":28129},{"type":"v1","addr":"172.21.15.132:6821","nonce":28129}]},"public_addr":"172.21.15.132:6817/28129","cluster_addr":"172.21.15.132:6819/28129","heartbeat_back_addr":"172.21.15.132:6823/28129","heartbeat_front_addr":"172.21.15.132:6821/28129","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.053825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.289753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.274645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.146361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.943883+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.701955+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.851076+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.800782+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T04:44:46.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.777+0000 7f3e01c00640 1 -- 172.21.15.120:0/730062869 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3ddc066690 msgr2=0x7f3ddc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:46.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.777+0000 7f3e01c00640 1 --2- 172.21.15.120:0/730062869 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3ddc066690 0x7f3ddc068b50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3dec0012f0 tx=0x7f3dec009040 comp rx=0 tx=0).stop 2024-04-18T04:44:46.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.777+0000 7f3e01c00640 1 -- 172.21.15.120:0/730062869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3dfc0c3780 msgr2=0x7f3dfc153600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:46.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.777+0000 7f3e01c00640 1 --2- 172.21.15.120:0/730062869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3dfc0c3780 0x7f3dfc153600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3de800d5c0 tx=0x7f3de800da80 comp rx=0 tx=0).stop 2024-04-18T04:44:46.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.777+0000 7f3e01c00640 1 -- 172.21.15.120:0/730062869 shutdown_connections 2024-04-18T04:44:46.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.777+0000 7f3e01c00640 1 --2- 172.21.15.120:0/730062869 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3ddc066690 0x7f3ddc068b50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:46.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.777+0000 7f3e01c00640 1 --2- 172.21.15.120:0/730062869 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3dfc0c7870 0x7f3dfc153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:46.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.777+0000 7f3e01c00640 1 --2- 172.21.15.120:0/730062869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3dfc0c3780 0x7f3dfc153600 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:46.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.777+0000 7f3e01c00640 1 --2- 172.21.15.120:0/730062869 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3dfc06afd0 0x7f3dfc0cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:46.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.777+0000 7f3e01c00640 1 -- 172.21.15.120:0/730062869 >> 172.21.15.120:0/730062869 conn(0x7f3dfc0720e0 msgr2=0x7f3dfc0cb900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:46.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.777+0000 7f3e01c00640 1 -- 172.21.15.120:0/730062869 shutdown_connections 2024-04-18T04:44:46.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.777+0000 7f3e01c00640 1 -- 172.21.15.120:0/730062869 wait complete. 2024-04-18T04:44:46.794 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T04:44:16.864728+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T04:44:28.825773+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T04:44:29.245857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-18T04:44:32.314302+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-18T04:44:46.795 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T04:44:46.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.933+0000 7f1c59e00640 1 Processor -- start 2024-04-18T04:44:46.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.933+0000 7f1c59e00640 1 -- start start 2024-04-18T04:44:46.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.933+0000 7f1c59e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c54151730 0x7f1c54158150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:46.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.933+0000 7f1c59e00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c54072640 con 0x7f1c540caff0 2024-04-18T04:44:46.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.933+0000 7f1c59e00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c54072360 con 0x7f1c5406dcf0 2024-04-18T04:44:46.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.933+0000 7f1c59e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c54071120 con 0x7f1c54151730 2024-04-18T04:44:46.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.937+0000 7f1c53400640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f1c540caff0 0x7f1c54161eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:40368/0 (socket says 172.21.15.120:40368) 2024-04-18T04:44:46.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.937+0000 7f1c53400640 1 -- 172.21.15.120:0/3529216373 learned_addr learned my addr 172.21.15.120:0/3529216373 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:44:46.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.937+0000 7f1c52a00640 1 --2- 172.21.15.120:0/3529216373 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c54151730 0x7f1c54158150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:46.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.937+0000 7f1c51600640 1 -- 172.21.15.120:0/3529216373 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2494393674 0 0) 0x7f1c54072640 con 0x7f1c540caff0 2024-04-18T04:44:46.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.937+0000 7f1c51600640 1 -- 172.21.15.120:0/3529216373 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c38003530 con 0x7f1c540caff0 2024-04-18T04:44:46.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.937+0000 7f1c52a00640 1 -- 172.21.15.120:0/3529216373 >> v1:172.21.15.132:6789/0 conn(0x7f1c5406dcf0 legacy=0x7f1c540c73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:46.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.937+0000 7f1c51600640 1 -- 172.21.15.120:0/3529216373 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1506773840 0 0) 0x7f1c54072360 con 0x7f1c5406dcf0 2024-04-18T04:44:46.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.937+0000 7f1c52a00640 1 -- 172.21.15.120:0/3529216373 >> v1:172.21.15.120:6789/0 conn(0x7f1c540caff0 legacy=0x7f1c54161eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:46.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.937+0000 7f1c52a00640 1 -- 172.21.15.120:0/3529216373 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c5406f9d0 con 0x7f1c54151730 2024-04-18T04:44:46.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.937+0000 7f1c52a00640 1 --2- 172.21.15.120:0/3529216373 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c54151730 0x7f1c54158150 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1c440097f0 tx=0x7f1c4401ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe5625841a1d7cd3 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:46.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.941+0000 7f1c51600640 1 -- 172.21.15.120:0/3529216373 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c440a89d0 con 0x7f1c54151730 2024-04-18T04:44:46.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.941+0000 7f1c51600640 1 -- 172.21.15.120:0/3529216373 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c440a8b30 con 0x7f1c54151730 2024-04-18T04:44:46.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.941+0000 7f1c51600640 1 -- 172.21.15.120:0/3529216373 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c440a8ea0 con 0x7f1c54151730 2024-04-18T04:44:46.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.941+0000 7f1c59e00640 1 -- 172.21.15.120:0/3529216373 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c54151730 msgr2=0x7f1c54158150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:46.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.941+0000 7f1c59e00640 1 --2- 172.21.15.120:0/3529216373 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c54151730 0x7f1c54158150 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1c440097f0 tx=0x7f1c4401ecd0 comp rx=0 tx=0).stop 2024-04-18T04:44:46.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.941+0000 7f1c59e00640 1 -- 172.21.15.120:0/3529216373 shutdown_connections 2024-04-18T04:44:46.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.941+0000 7f1c59e00640 1 --2- 172.21.15.120:0/3529216373 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c54151730 0x7f1c54158150 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:46.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.941+0000 7f1c59e00640 1 -- 172.21.15.120:0/3529216373 >> 172.21.15.120:0/3529216373 conn(0x7f1c5406b780 msgr2=0x7f1c5406bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:46.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.941+0000 7f1c59e00640 1 -- 172.21.15.120:0/3529216373 shutdown_connections 2024-04-18T04:44:46.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.941+0000 7f1c59e00640 1 -- 172.21.15.120:0/3529216373 wait complete. 2024-04-18T04:44:46.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.941+0000 7f1c59e00640 1 Processor -- start 2024-04-18T04:44:46.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.941+0000 7f1c59e00640 1 -- start start 2024-04-18T04:44:46.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.941+0000 7f1c59e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c5406dcf0 0x7f1c540c5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:46.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.941+0000 7f1c59e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c540caff0 0x7f1c5415b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:46.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.941+0000 7f1c59e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c54151730 0x7f1c54149550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:46.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.941+0000 7f1c59e00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c541ec6d0 con 0x7f1c5406dcf0 2024-04-18T04:44:46.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.941+0000 7f1c59e00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c541ec9b0 con 0x7f1c540caff0 2024-04-18T04:44:46.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.941+0000 7f1c59e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c541ecc90 con 0x7f1c54151730 2024-04-18T04:44:46.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.941+0000 7f1c52a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c5406dcf0 0x7f1c540c5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:46.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.941+0000 7f1c52a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c5406dcf0 0x7f1c540c5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47034/0 (socket says 172.21.15.120:47034) 2024-04-18T04:44:46.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.941+0000 7f1c52a00640 1 -- 172.21.15.120:0/3375434102 learned_addr learned my addr 172.21.15.120:0/3375434102 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:46.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.941+0000 7f1c53400640 1 --2- 172.21.15.120:0/3375434102 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c54151730 0x7f1c54149550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:46.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.941+0000 7f1c52000640 1 --2- 172.21.15.120:0/3375434102 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c540caff0 0x7f1c5415b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:46.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.945+0000 7f1c52a00640 1 -- 172.21.15.120:0/3375434102 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c54151730 msgr2=0x7f1c54149550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:46.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.945+0000 7f1c52a00640 1 --2- 172.21.15.120:0/3375434102 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c54151730 0x7f1c54149550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:46.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.945+0000 7f1c52a00640 1 -- 172.21.15.120:0/3375434102 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c540caff0 msgr2=0x7f1c5415b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:46.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.945+0000 7f1c52a00640 1 --2- 172.21.15.120:0/3375434102 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c540caff0 0x7f1c5415b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:46.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.945+0000 7f1c52a00640 1 -- 172.21.15.120:0/3375434102 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c44009420 con 0x7f1c5406dcf0 2024-04-18T04:44:46.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.945+0000 7f1c53400640 1 --2- 172.21.15.120:0/3375434102 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c54151730 0x7f1c54149550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:44:46.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.945+0000 7f1c52a00640 1 --2- 172.21.15.120:0/3375434102 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c5406dcf0 0x7f1c540c5710 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1c4401b8e0 tx=0x7f1c4401ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:46.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.945+0000 7f1c4b400640 1 -- 172.21.15.120:0/3375434102 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c440a89d0 con 0x7f1c5406dcf0 2024-04-18T04:44:46.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.945+0000 7f1c4b400640 1 -- 172.21.15.120:0/3375434102 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c44003620 con 0x7f1c5406dcf0 2024-04-18T04:44:46.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.945+0000 7f1c4b400640 1 -- 172.21.15.120:0/3375434102 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c44003990 con 0x7f1c5406dcf0 2024-04-18T04:44:46.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.945+0000 7f1c59e00640 1 -- 172.21.15.120:0/3375434102 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c541ecf70 con 0x7f1c5406dcf0 2024-04-18T04:44:46.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.945+0000 7f1c59e00640 1 -- 172.21.15.120:0/3375434102 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c540c5c50 con 0x7f1c5406dcf0 2024-04-18T04:44:46.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.945+0000 7f1c59e00640 1 -- 172.21.15.120:0/3375434102 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c541ecdd0 con 0x7f1c5406dcf0 2024-04-18T04:44:46.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.945+0000 7f1c4b400640 1 -- 172.21.15.120:0/3375434102 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1c440b7040 con 0x7f1c5406dcf0 2024-04-18T04:44:46.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.945+0000 7f1c4b400640 1 --2- 172.21.15.120:0/3375434102 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1c300666c0 0x7f1c30068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:46.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.945+0000 7f1c4b400640 1 -- 172.21.15.120:0/3375434102 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1c44121da0 con 0x7f1c5406dcf0 2024-04-18T04:44:46.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.949+0000 7f1c52000640 1 --2- 172.21.15.120:0/3375434102 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1c300666c0 0x7f1c30068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:46.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.949+0000 7f1c52000640 1 --2- 172.21.15.120:0/3375434102 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1c300666c0 0x7f1c30068b80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1c54151400 tx=0x7f1c3c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:46.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:46.949+0000 7f1c4b400640 1 -- 172.21.15.120:0/3375434102 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f1c541ecdd0 con 0x7f1c5406dcf0 2024-04-18T04:44:47.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.101+0000 7f1c59e00640 1 -- 172.21.15.120:0/3375434102 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1c541ecdd0 con 0x7f1c5406dcf0 2024-04-18T04:44:47.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.105+0000 7f1c4b400640 1 -- 172.21.15.120:0/3375434102 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1c541ecdd0 con 0x7f1c5406dcf0 2024-04-18T04:44:47.103 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2024-04-18T04:44:47.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.105+0000 7f1c59e00640 1 -- 172.21.15.120:0/3375434102 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1c300666c0 msgr2=0x7f1c30068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:47.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.105+0000 7f1c59e00640 1 --2- 172.21.15.120:0/3375434102 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1c300666c0 0x7f1c30068b80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1c54151400 tx=0x7f1c3c009040 comp rx=0 tx=0).stop 2024-04-18T04:44:47.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.105+0000 7f1c59e00640 1 -- 172.21.15.120:0/3375434102 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c5406dcf0 msgr2=0x7f1c540c5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:47.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.105+0000 7f1c59e00640 1 --2- 172.21.15.120:0/3375434102 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c5406dcf0 0x7f1c540c5710 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1c4401b8e0 tx=0x7f1c4401ba70 comp rx=0 tx=0).stop 2024-04-18T04:44:47.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.105+0000 7f1c59e00640 1 -- 172.21.15.120:0/3375434102 shutdown_connections 2024-04-18T04:44:47.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.105+0000 7f1c59e00640 1 --2- 172.21.15.120:0/3375434102 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1c300666c0 0x7f1c30068b80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:47.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.105+0000 7f1c59e00640 1 --2- 172.21.15.120:0/3375434102 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c54151730 0x7f1c54149550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:47.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.105+0000 7f1c59e00640 1 --2- 172.21.15.120:0/3375434102 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c540caff0 0x7f1c5415b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:47.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.105+0000 7f1c59e00640 1 --2- 172.21.15.120:0/3375434102 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c5406dcf0 0x7f1c540c5710 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:47.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.105+0000 7f1c59e00640 1 -- 172.21.15.120:0/3375434102 >> 172.21.15.120:0/3375434102 conn(0x7f1c5406b780 msgr2=0x7f1c54157e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:47.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.105+0000 7f1c59e00640 1 -- 172.21.15.120:0/3375434102 shutdown_connections 2024-04-18T04:44:47.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.105+0000 7f1c59e00640 1 -- 172.21.15.120:0/3375434102 wait complete. 2024-04-18T04:44:47.125 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T04:44:47.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.265+0000 7feba3a00640 1 Processor -- start 2024-04-18T04:44:47.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.265+0000 7feba3a00640 1 -- start start 2024-04-18T04:44:47.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.265+0000 7feba3a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb9c151730 0x7feb9c158150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:47.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.265+0000 7feba3a00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7feb9c0caff0 0x7feb9c0cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:47.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.265+0000 7feba3a00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb9c072640 con 0x7feb9c06dcf0 2024-04-18T04:44:47.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.265+0000 7feba3a00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb9c071120 con 0x7feb9c0caff0 2024-04-18T04:44:47.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.265+0000 7feba3a00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c072360 con 0x7feb9c151730 2024-04-18T04:44:47.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.265+0000 7feb9be00640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7feb9c06dcf0 0x7feb9c0c73d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:40382/0 (socket says 172.21.15.120:40382) 2024-04-18T04:44:47.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.265+0000 7feb9be00640 1 -- 172.21.15.120:0/1575598355 learned_addr learned my addr 172.21.15.120:0/1575598355 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:44:47.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.265+0000 7feba1000640 1 --2- 172.21.15.120:0/1575598355 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb9c151730 0x7feb9c158150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:47.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.265+0000 7feba1a00640 1 --2- 172.21.15.120:0/1575598355 >> v2:172.21.15.132:3300/0 conn(0x7feb9c0caff0 0x7feb9c0cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:47.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.265+0000 7feb9b400640 1 -- 172.21.15.120:0/1575598355 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2786205494 0 0) 0x7feb9c072640 con 0x7feb9c06dcf0 2024-04-18T04:44:47.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.265+0000 7feb9b400640 1 -- 172.21.15.120:0/1575598355 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb80003530 con 0x7feb9c06dcf0 2024-04-18T04:44:47.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.265+0000 7feb9b400640 1 -- 172.21.15.120:0/1575598355 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 588904691 0 0) 0x7feb80003530 con 0x7feb9c06dcf0 2024-04-18T04:44:47.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.265+0000 7feb9b400640 1 -- 172.21.15.120:0/1575598355 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb9c151730 msgr2=0x7feb9c158150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:47.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.265+0000 7feb9b400640 1 --2- 172.21.15.120:0/1575598355 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb9c151730 0x7feb9c158150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:47.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.265+0000 7feb9b400640 1 -- 172.21.15.120:0/1575598355 >> v2:172.21.15.132:3300/0 conn(0x7feb9c0caff0 msgr2=0x7feb9c0cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:47.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.265+0000 7feb9b400640 1 --2- 172.21.15.120:0/1575598355 >> v2:172.21.15.132:3300/0 conn(0x7feb9c0caff0 0x7feb9c0cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:47.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.265+0000 7feb9b400640 1 -- 172.21.15.120:0/1575598355 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb9c06f9d0 con 0x7feb9c06dcf0 2024-04-18T04:44:47.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.269+0000 7feb9b400640 1 -- 172.21.15.120:0/1575598355 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7feb88001680 con 0x7feb9c06dcf0 2024-04-18T04:44:47.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.269+0000 7feb9b400640 1 -- 172.21.15.120:0/1575598355 >> v1:172.21.15.120:6789/0 conn(0x7feb9c06dcf0 legacy=0x7feb9c0c73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:47.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.269+0000 7feb9b400640 1 --2- 172.21.15.120:0/1575598355 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb9c151730 0x7feb80003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:47.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.269+0000 7feb9b400640 1 --2- 172.21.15.120:0/1575598355 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb80003f00 0x7feb800047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:47.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.269+0000 7feb9b400640 1 --2- 172.21.15.120:0/1575598355 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb80004d10 0x7feb80005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:47.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.269+0000 7feb9b400640 1 -- 172.21.15.120:0/1575598355 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c071120 con 0x7feb80003f00 2024-04-18T04:44:47.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.269+0000 7feb9b400640 1 -- 172.21.15.120:0/1575598355 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c072360 con 0x7feb80004d10 2024-04-18T04:44:47.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.269+0000 7feb9b400640 1 -- 172.21.15.120:0/1575598355 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb8000b9c0 con 0x7feb9c151730 2024-04-18T04:44:47.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.269+0000 7feb9be00640 1 --2- 172.21.15.120:0/1575598355 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb80003f00 0x7feb800047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:47.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.269+0000 7feba1a00640 1 --2- 172.21.15.120:0/1575598355 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb80004d10 0x7feb80005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:47.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.269+0000 7feba1000640 1 --2- 172.21.15.120:0/1575598355 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb9c151730 0x7feb80003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:47.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.269+0000 7feb9be00640 1 -- 172.21.15.120:0/1575598355 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb9c151730 msgr2=0x7feb80003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:47.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.269+0000 7feb9be00640 1 --2- 172.21.15.120:0/1575598355 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb9c151730 0x7feb80003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:47.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.269+0000 7feb9be00640 1 -- 172.21.15.120:0/1575598355 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb80004d10 msgr2=0x7feb80005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:47.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.269+0000 7feb9be00640 1 --2- 172.21.15.120:0/1575598355 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb80004d10 0x7feb80005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:47.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.269+0000 7feb9be00640 1 -- 172.21.15.120:0/1575598355 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb80003530 con 0x7feb80003f00 2024-04-18T04:44:47.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.269+0000 7feba1a00640 1 --2- 172.21.15.120:0/1575598355 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb80004d10 0x7feb80005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:44:47.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.269+0000 7feb9be00640 1 --2- 172.21.15.120:0/1575598355 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb80003f00 0x7feb800047d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7feb8800c240 tx=0x7feb8801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec6f70e1defe0bfd server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:47.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.269+0000 7feb9b400640 1 -- 172.21.15.120:0/1575598355 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb880a5980 con 0x7feb80003f00 2024-04-18T04:44:47.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.269+0000 7feb9b400640 1 -- 172.21.15.120:0/1575598355 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb880a5ae0 con 0x7feb80003f00 2024-04-18T04:44:47.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.269+0000 7feb9b400640 1 -- 172.21.15.120:0/1575598355 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb880058e0 con 0x7feb80003f00 2024-04-18T04:44:47.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.273+0000 7feba3a00640 1 -- 172.21.15.120:0/1575598355 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb80003f00 msgr2=0x7feb800047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:47.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.273+0000 7feba3a00640 1 --2- 172.21.15.120:0/1575598355 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb80003f00 0x7feb800047d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7feb8800c240 tx=0x7feb8801cc80 comp rx=0 tx=0).stop 2024-04-18T04:44:47.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.273+0000 7feba1a00640 1 -- 172.21.15.120:0/1575598355 reap_dead start 2024-04-18T04:44:47.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.273+0000 7feba3a00640 1 -- 172.21.15.120:0/1575598355 shutdown_connections 2024-04-18T04:44:47.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.273+0000 7feba3a00640 1 -- 172.21.15.120:0/1575598355 >> 172.21.15.120:0/1575598355 conn(0x7feb9c06b780 msgr2=0x7feb9c06bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:47.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.273+0000 7feba3a00640 1 -- 172.21.15.120:0/1575598355 shutdown_connections 2024-04-18T04:44:47.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.273+0000 7feba3a00640 1 -- 172.21.15.120:0/1575598355 wait complete. 2024-04-18T04:44:47.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.273+0000 7feba3a00640 1 Processor -- start 2024-04-18T04:44:47.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.273+0000 7feba3a00640 1 -- start start 2024-04-18T04:44:47.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.273+0000 7feba3a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb80003f00 0x7feb9c14e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:47.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.273+0000 7feba3a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb9c0c6020 0x7feb9c0c04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:47.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.273+0000 7feba3a00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb9c0c4160 0x7feb9c0c0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:47.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.273+0000 7feba3a00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c0b02d0 con 0x7feb80003f00 2024-04-18T04:44:47.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.273+0000 7feba3a00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c0c0030 con 0x7feb9c0c4160 2024-04-18T04:44:47.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.273+0000 7feba3a00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c15b970 con 0x7feb9c0c6020 2024-04-18T04:44:47.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.273+0000 7feba1000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb80003f00 0x7feb9c14e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:47.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.273+0000 7feba1000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb80003f00 0x7feb9c14e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47054/0 (socket says 172.21.15.120:47054) 2024-04-18T04:44:47.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.273+0000 7feba1000640 1 -- 172.21.15.120:0/2509396272 learned_addr learned my addr 172.21.15.120:0/2509396272 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:47.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.273+0000 7feba1a00640 1 --2- 172.21.15.120:0/2509396272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb9c0c4160 0x7feb9c0c0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:47.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.273+0000 7feb9be00640 1 --2- 172.21.15.120:0/2509396272 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb9c0c6020 0x7feb9c0c04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:47.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.273+0000 7feba1000640 1 -- 172.21.15.120:0/2509396272 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb9c0c6020 msgr2=0x7feb9c0c04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:47.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.273+0000 7feba1000640 1 --2- 172.21.15.120:0/2509396272 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb9c0c6020 0x7feb9c0c04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:47.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.273+0000 7feba1000640 1 -- 172.21.15.120:0/2509396272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb9c0c4160 msgr2=0x7feb9c0c0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:47.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.273+0000 7feba1000640 1 --2- 172.21.15.120:0/2509396272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb9c0c4160 0x7feb9c0c0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:47.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.273+0000 7feba1000640 1 -- 172.21.15.120:0/2509396272 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb9c0c46c0 con 0x7feb80003f00 2024-04-18T04:44:47.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.277+0000 7feba1000640 1 --2- 172.21.15.120:0/2509396272 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb80003f00 0x7feb9c14e690 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7feb8c007f60 tx=0x7feb8c007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:47.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.277+0000 7feb98c00640 1 -- 172.21.15.120:0/2509396272 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c00e030 con 0x7feb80003f00 2024-04-18T04:44:47.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.277+0000 7feb98c00640 1 -- 172.21.15.120:0/2509396272 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8c016470 con 0x7feb80003f00 2024-04-18T04:44:47.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.277+0000 7feb98c00640 1 -- 172.21.15.120:0/2509396272 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c016820 con 0x7feb80003f00 2024-04-18T04:44:47.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.277+0000 7feba3a00640 1 -- 172.21.15.120:0/2509396272 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb9c0ae740 con 0x7feb80003f00 2024-04-18T04:44:47.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.277+0000 7feba3a00640 1 -- 172.21.15.120:0/2509396272 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb9c0aed00 con 0x7feb80003f00 2024-04-18T04:44:47.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.277+0000 7feba3a00640 1 -- 172.21.15.120:0/2509396272 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb9c0729d0 con 0x7feb80003f00 2024-04-18T04:44:47.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.277+0000 7feb98c00640 1 -- 172.21.15.120:0/2509396272 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7feb8c016980 con 0x7feb80003f00 2024-04-18T04:44:47.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.277+0000 7feb98c00640 1 --2- 172.21.15.120:0/2509396272 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7feb7c0666c0 0x7feb7c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:47.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.277+0000 7feb98c00640 1 -- 172.21.15.120:0/2509396272 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7feb8c00f070 con 0x7feb80003f00 2024-04-18T04:44:47.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.277+0000 7feb9be00640 1 --2- 172.21.15.120:0/2509396272 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7feb7c0666c0 0x7feb7c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:47.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.281+0000 7feb9be00640 1 --2- 172.21.15.120:0/2509396272 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7feb7c0666c0 0x7feb7c068b80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7feb880aa000 tx=0x7feb88001a80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:47.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.281+0000 7feb98c00640 1 -- 172.21.15.120:0/2509396272 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7feb8c0523a0 con 0x7feb80003f00 2024-04-18T04:44:47.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.433+0000 7feba3a00640 1 -- 172.21.15.120:0/2509396272 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feb9c155180 con 0x7feb80003f00 2024-04-18T04:44:47.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.437+0000 7feb98c00640 1 -- 172.21.15.120:0/2509396272 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7feb8c0559c0 con 0x7feb80003f00 2024-04-18T04:44:47.435 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2024-04-18T04:44:47.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.437+0000 7feba3a00640 1 -- 172.21.15.120:0/2509396272 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7feb7c0666c0 msgr2=0x7feb7c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:47.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.437+0000 7feba3a00640 1 --2- 172.21.15.120:0/2509396272 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7feb7c0666c0 0x7feb7c068b80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7feb880aa000 tx=0x7feb88001a80 comp rx=0 tx=0).stop 2024-04-18T04:44:47.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.437+0000 7feba3a00640 1 -- 172.21.15.120:0/2509396272 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb80003f00 msgr2=0x7feb9c14e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:47.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.437+0000 7feba3a00640 1 --2- 172.21.15.120:0/2509396272 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb80003f00 0x7feb9c14e690 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7feb8c007f60 tx=0x7feb8c007f90 comp rx=0 tx=0).stop 2024-04-18T04:44:47.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.437+0000 7feba3a00640 1 -- 172.21.15.120:0/2509396272 shutdown_connections 2024-04-18T04:44:47.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.437+0000 7feba3a00640 1 --2- 172.21.15.120:0/2509396272 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7feb7c0666c0 0x7feb7c068b80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:47.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.437+0000 7feba3a00640 1 --2- 172.21.15.120:0/2509396272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb9c0c4160 0x7feb9c0c0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:47.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.437+0000 7feba3a00640 1 --2- 172.21.15.120:0/2509396272 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb9c0c6020 0x7feb9c0c04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:47.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.437+0000 7feba3a00640 1 --2- 172.21.15.120:0/2509396272 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb80003f00 0x7feb9c14e690 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:47.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.437+0000 7feba3a00640 1 -- 172.21.15.120:0/2509396272 >> 172.21.15.120:0/2509396272 conn(0x7feb9c06b780 msgr2=0x7feb9c0c2390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:47.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.437+0000 7feba3a00640 1 -- 172.21.15.120:0/2509396272 shutdown_connections 2024-04-18T04:44:47.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.437+0000 7feba3a00640 1 -- 172.21.15.120:0/2509396272 wait complete. 2024-04-18T04:44:47.456 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T04:44:47.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.593+0000 7f2697800640 1 Processor -- start 2024-04-18T04:44:47.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.593+0000 7f2697800640 1 -- start start 2024-04-18T04:44:47.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.597+0000 7f2697800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26900c0d80 0x7f2690159860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:47.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.597+0000 7f2697800640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26900c5d20 con 0x7f269006e0d0 2024-04-18T04:44:47.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.597+0000 7f2697800640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26900c6000 con 0x7f26900c8230 2024-04-18T04:44:47.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.597+0000 7f2697800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26900c0250 con 0x7f26900c0d80 2024-04-18T04:44:47.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.597+0000 7f268fe00640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f269006e0d0 0x7f26900c0670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:40398/0 (socket says 172.21.15.120:40398) 2024-04-18T04:44:47.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.597+0000 7f268fe00640 1 -- 172.21.15.120:0/4081739974 learned_addr learned my addr 172.21.15.120:0/4081739974 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:44:47.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.597+0000 7f2695800640 1 --2- 172.21.15.120:0/4081739974 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26900c0d80 0x7f2690159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:47.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.597+0000 7f268f400640 1 -- 172.21.15.120:0/4081739974 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2224102683 0 0) 0x7f26900c5d20 con 0x7f269006e0d0 2024-04-18T04:44:47.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.597+0000 7f268f400640 1 -- 172.21.15.120:0/4081739974 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2674003530 con 0x7f269006e0d0 2024-04-18T04:44:47.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.597+0000 7f268f400640 1 -- 172.21.15.120:0/4081739974 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 774653349 0 0) 0x7f2674003530 con 0x7f269006e0d0 2024-04-18T04:44:47.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.597+0000 7f268f400640 1 -- 172.21.15.120:0/4081739974 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26900c0d80 msgr2=0x7f2690159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:47.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.597+0000 7f268f400640 1 --2- 172.21.15.120:0/4081739974 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26900c0d80 0x7f2690159860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:47.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.597+0000 7f268f400640 1 -- 172.21.15.120:0/4081739974 >> v1:172.21.15.132:6789/0 conn(0x7f26900c8230 legacy=0x7f26900caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:47.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.597+0000 7f268f400640 1 -- 172.21.15.120:0/4081739974 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26900c62e0 con 0x7f269006e0d0 2024-04-18T04:44:47.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.597+0000 7f268f400640 1 -- 172.21.15.120:0/4081739974 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7f267c001680 con 0x7f269006e0d0 2024-04-18T04:44:47.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.597+0000 7f268f400640 1 -- 172.21.15.120:0/4081739974 >> v1:172.21.15.120:6789/0 conn(0x7f269006e0d0 legacy=0x7f26900c0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:47.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.597+0000 7f268f400640 1 --2- 172.21.15.120:0/4081739974 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26900c0d80 0x7f26740039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:47.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.597+0000 7f268f400640 1 --2- 172.21.15.120:0/4081739974 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2674003ef0 0x7f26740047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:47.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.597+0000 7f268f400640 1 --2- 172.21.15.120:0/4081739974 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2674004d10 0x7f2674005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:47.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.597+0000 7f268f400640 1 -- 172.21.15.120:0/4081739974 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26900c0250 con 0x7f2674003ef0 2024-04-18T04:44:47.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.597+0000 7f268f400640 1 -- 172.21.15.120:0/4081739974 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f267400b9f0 con 0x7f2674004d10 2024-04-18T04:44:47.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.597+0000 7f268f400640 1 -- 172.21.15.120:0/4081739974 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f267400bbb0 con 0x7f26900c0d80 2024-04-18T04:44:47.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.597+0000 7f268fe00640 1 --2- 172.21.15.120:0/4081739974 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2674003ef0 0x7f26740047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:47.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.597+0000 7f2694e00640 1 --2- 172.21.15.120:0/4081739974 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26900c0d80 0x7f26740039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:47.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.597+0000 7f2695800640 1 --2- 172.21.15.120:0/4081739974 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2674004d10 0x7f2674005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:47.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.597+0000 7f268fe00640 1 -- 172.21.15.120:0/4081739974 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26900c0d80 msgr2=0x7f26740039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:47.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.597+0000 7f268fe00640 1 --2- 172.21.15.120:0/4081739974 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26900c0d80 0x7f26740039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:47.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.597+0000 7f268fe00640 1 -- 172.21.15.120:0/4081739974 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2674004d10 msgr2=0x7f2674005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:47.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.597+0000 7f268fe00640 1 --2- 172.21.15.120:0/4081739974 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2674004d10 0x7f2674005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:47.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.597+0000 7f268fe00640 1 -- 172.21.15.120:0/4081739974 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2674003530 con 0x7f2674003ef0 2024-04-18T04:44:47.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.601+0000 7f268fe00640 1 --2- 172.21.15.120:0/4081739974 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2674003ef0 0x7f26740047d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f267c00c160 tx=0x7f267c01cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=651618c687126cd0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:47.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.601+0000 7f268f400640 1 -- 172.21.15.120:0/4081739974 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267c005ae0 con 0x7f2674003ef0 2024-04-18T04:44:47.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.601+0000 7f268f400640 1 -- 172.21.15.120:0/4081739974 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f267c005c60 con 0x7f2674003ef0 2024-04-18T04:44:47.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.601+0000 7f268f400640 1 -- 172.21.15.120:0/4081739974 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267c0a5a40 con 0x7f2674003ef0 2024-04-18T04:44:47.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.601+0000 7f2697800640 1 -- 172.21.15.120:0/4081739974 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2674003ef0 msgr2=0x7f26740047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:47.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.601+0000 7f2697800640 1 --2- 172.21.15.120:0/4081739974 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2674003ef0 0x7f26740047d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f267c00c160 tx=0x7f267c01cb00 comp rx=0 tx=0).stop 2024-04-18T04:44:47.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.601+0000 7f2695800640 1 -- 172.21.15.120:0/4081739974 reap_dead start 2024-04-18T04:44:47.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.601+0000 7f2697800640 1 -- 172.21.15.120:0/4081739974 shutdown_connections 2024-04-18T04:44:47.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.601+0000 7f2697800640 1 -- 172.21.15.120:0/4081739974 >> 172.21.15.120:0/4081739974 conn(0x7f269006b780 msgr2=0x7f269006bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:47.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.601+0000 7f2697800640 1 -- 172.21.15.120:0/4081739974 shutdown_connections 2024-04-18T04:44:47.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.601+0000 7f2697800640 1 -- 172.21.15.120:0/4081739974 wait complete. 2024-04-18T04:44:47.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.601+0000 7f2697800640 1 Processor -- start 2024-04-18T04:44:47.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.605+0000 7f2697800640 1 -- start start 2024-04-18T04:44:47.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.605+0000 7f2697800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2674003ef0 0x7f2690155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:47.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.605+0000 7f2697800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2690155130 0x7f2690155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:47.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.605+0000 7f2697800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f269014f540 0x7f269014f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:47.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.605+0000 7f2697800640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26900caad0 con 0x7f2690155130 2024-04-18T04:44:47.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.605+0000 7f2697800640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26901575a0 con 0x7f269014f540 2024-04-18T04:44:47.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.605+0000 7f2697800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26900ca550 con 0x7f2674003ef0 2024-04-18T04:44:47.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.605+0000 7f268fe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2690155130 0x7f2690155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:47.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.605+0000 7f268fe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2690155130 0x7f2690155bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47058/0 (socket says 172.21.15.120:47058) 2024-04-18T04:44:47.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.605+0000 7f268fe00640 1 -- 172.21.15.120:0/1796448916 learned_addr learned my addr 172.21.15.120:0/1796448916 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:47.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.605+0000 7f2695800640 1 --2- 172.21.15.120:0/1796448916 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f269014f540 0x7f269014f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:47.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.605+0000 7f2694e00640 1 --2- 172.21.15.120:0/1796448916 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2674003ef0 0x7f2690155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:47.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.605+0000 7f268fe00640 1 -- 172.21.15.120:0/1796448916 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2674003ef0 msgr2=0x7f2690155680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:47.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.605+0000 7f268fe00640 1 --2- 172.21.15.120:0/1796448916 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2674003ef0 0x7f2690155680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:47.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.605+0000 7f268fe00640 1 -- 172.21.15.120:0/1796448916 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f269014f540 msgr2=0x7f269014f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:47.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.605+0000 7f268fe00640 1 --2- 172.21.15.120:0/1796448916 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f269014f540 0x7f269014f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:47.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.605+0000 7f268fe00640 1 -- 172.21.15.120:0/1796448916 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2690154860 con 0x7f2690155130 2024-04-18T04:44:47.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.605+0000 7f268fe00640 1 --2- 172.21.15.120:0/1796448916 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2690155130 0x7f2690155bc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f267c01c930 tx=0x7f2674005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:47.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.605+0000 7f268cc00640 1 -- 172.21.15.120:0/1796448916 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267c0b4070 con 0x7f2690155130 2024-04-18T04:44:47.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.605+0000 7f268cc00640 1 -- 172.21.15.120:0/1796448916 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f267c0a5800 con 0x7f2690155130 2024-04-18T04:44:47.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.605+0000 7f268cc00640 1 -- 172.21.15.120:0/1796448916 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267c0a5b70 con 0x7f2690155130 2024-04-18T04:44:47.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.605+0000 7f2697800640 1 -- 172.21.15.120:0/1796448916 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2690154080 con 0x7f2690155130 2024-04-18T04:44:47.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.605+0000 7f2697800640 1 -- 172.21.15.120:0/1796448916 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2690154b00 con 0x7f2690155130 2024-04-18T04:44:47.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.605+0000 7f2697800640 1 -- 172.21.15.120:0/1796448916 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2690154cc0 con 0x7f2690155130 2024-04-18T04:44:47.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.609+0000 7f268cc00640 1 -- 172.21.15.120:0/1796448916 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f267c0a5cd0 con 0x7f2690155130 2024-04-18T04:44:47.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.609+0000 7f268cc00640 1 --2- 172.21.15.120:0/1796448916 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2670066690 0x7f2670068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:47.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.609+0000 7f268cc00640 1 -- 172.21.15.120:0/1796448916 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f267c11e340 con 0x7f2690155130 2024-04-18T04:44:47.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.609+0000 7f2694e00640 1 --2- 172.21.15.120:0/1796448916 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2670066690 0x7f2670068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:47.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.609+0000 7f2694e00640 1 --2- 172.21.15.120:0/1796448916 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2670066690 0x7f2670068b50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2680007fd0 tx=0x7f26800017d0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:47.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.613+0000 7f268cc00640 1 -- 172.21.15.120:0/1796448916 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f267c0eb3e0 con 0x7f2690155130 2024-04-18T04:44:47.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.765+0000 7f2697800640 1 -- 172.21.15.120:0/1796448916 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f26900729d0 con 0x7f2690155130 2024-04-18T04:44:47.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.765+0000 7f268cc00640 1 -- 172.21.15.120:0/1796448916 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f267c0eea00 con 0x7f2690155130 2024-04-18T04:44:47.766 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 64 2024-04-18T04:44:47.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.769+0000 7f2697800640 1 -- 172.21.15.120:0/1796448916 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2670066690 msgr2=0x7f2670068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:47.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.769+0000 7f2697800640 1 --2- 172.21.15.120:0/1796448916 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2670066690 0x7f2670068b50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2680007fd0 tx=0x7f26800017d0 comp rx=0 tx=0).stop 2024-04-18T04:44:47.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.769+0000 7f2697800640 1 -- 172.21.15.120:0/1796448916 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2690155130 msgr2=0x7f2690155bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:47.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.769+0000 7f2697800640 1 --2- 172.21.15.120:0/1796448916 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2690155130 0x7f2690155bc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f267c01c930 tx=0x7f2674005800 comp rx=0 tx=0).stop 2024-04-18T04:44:47.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.769+0000 7f2697800640 1 -- 172.21.15.120:0/1796448916 shutdown_connections 2024-04-18T04:44:47.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.769+0000 7f2697800640 1 --2- 172.21.15.120:0/1796448916 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2670066690 0x7f2670068b50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:47.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.769+0000 7f2697800640 1 --2- 172.21.15.120:0/1796448916 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f269014f540 0x7f269014f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:47.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.769+0000 7f2697800640 1 --2- 172.21.15.120:0/1796448916 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2690155130 0x7f2690155bc0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:47.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.769+0000 7f2697800640 1 --2- 172.21.15.120:0/1796448916 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2674003ef0 0x7f2690155680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:47.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.769+0000 7f2697800640 1 -- 172.21.15.120:0/1796448916 >> 172.21.15.120:0/1796448916 conn(0x7f269006b780 msgr2=0x7f26900c0670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:47.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.769+0000 7f2697800640 1 -- 172.21.15.120:0/1796448916 shutdown_connections 2024-04-18T04:44:47.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.769+0000 7f2697800640 1 -- 172.21.15.120:0/1796448916 wait complete. 2024-04-18T04:44:47.787 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-18T04:44:47.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.925+0000 7fe9e9a00640 1 Processor -- start 2024-04-18T04:44:47.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.925+0000 7fe9e9a00640 1 -- start start 2024-04-18T04:44:47.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.925+0000 7fe9e9a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe9e4158150 0x7fe9e40c73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:47.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.925+0000 7fe9e9a00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe9e40caff0 0x7fe9e40cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:47.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.925+0000 7fe9e9a00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9e4072640 con 0x7fe9e4151730 2024-04-18T04:44:47.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.925+0000 7fe9e9a00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9e4071120 con 0x7fe9e40caff0 2024-04-18T04:44:47.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.925+0000 7fe9e9a00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e4158570 con 0x7fe9e4158150 2024-04-18T04:44:47.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.929+0000 7fe9e3400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe9e40caff0 0x7fe9e40cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:47.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.929+0000 7fe9e2a00640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fe9e4151730 0x7fe9e406dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:40414/0 (socket says 172.21.15.120:40414) 2024-04-18T04:44:47.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.929+0000 7fe9e2a00640 1 -- 172.21.15.120:0/3460697385 learned_addr learned my addr 172.21.15.120:0/3460697385 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:44:47.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.929+0000 7fe9da000640 1 --2- 172.21.15.120:0/3460697385 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe9e4158150 0x7fe9e40c73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:47.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.929+0000 7fe9e3400640 1 -- 172.21.15.120:0/3460697385 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe9e4158150 msgr2=0x7fe9e40c73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:47.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.929+0000 7fe9e3400640 1 --2- 172.21.15.120:0/3460697385 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe9e4158150 0x7fe9e40c73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:47.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.929+0000 7fe9e3400640 1 -- 172.21.15.120:0/3460697385 >> v1:172.21.15.120:6789/0 conn(0x7fe9e4151730 legacy=0x7fe9e406dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:47.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.929+0000 7fe9e3400640 1 -- 172.21.15.120:0/3460697385 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e4072360 con 0x7fe9e40caff0 2024-04-18T04:44:47.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.929+0000 7fe9e3400640 1 --2- 172.21.15.120:0/3460697385 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9e40caff0 0x7fe9e40cb440 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc009dc0 tx=0x7fe9dc01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=386d9b3b661f0ee1 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:47.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.929+0000 7fe9e2000640 1 -- 172.21.15.120:0/3460697385 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc0a59e0 con 0x7fe9e40caff0 2024-04-18T04:44:47.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.929+0000 7fe9e2000640 1 -- 172.21.15.120:0/3460697385 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9dc0a5b40 con 0x7fe9e40caff0 2024-04-18T04:44:47.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.929+0000 7fe9e2000640 1 -- 172.21.15.120:0/3460697385 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc0ad440 con 0x7fe9e40caff0 2024-04-18T04:44:47.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.933+0000 7fe9e9a00640 1 -- 172.21.15.120:0/3460697385 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9e40caff0 msgr2=0x7fe9e40cb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:47.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.933+0000 7fe9e9a00640 1 --2- 172.21.15.120:0/3460697385 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9e40caff0 0x7fe9e40cb440 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc009dc0 tx=0x7fe9dc01c920 comp rx=0 tx=0).stop 2024-04-18T04:44:47.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.933+0000 7fe9e9a00640 1 -- 172.21.15.120:0/3460697385 shutdown_connections 2024-04-18T04:44:47.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.933+0000 7fe9e9a00640 1 --2- 172.21.15.120:0/3460697385 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9e40caff0 0x7fe9e40cb440 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:47.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.933+0000 7fe9e9a00640 1 --2- 172.21.15.120:0/3460697385 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe9e4158150 0x7fe9e40c73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:47.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.933+0000 7fe9e9a00640 1 -- 172.21.15.120:0/3460697385 >> 172.21.15.120:0/3460697385 conn(0x7fe9e406b780 msgr2=0x7fe9e406bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:47.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.933+0000 7fe9e9a00640 1 -- 172.21.15.120:0/3460697385 shutdown_connections 2024-04-18T04:44:47.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.933+0000 7fe9e9a00640 1 -- 172.21.15.120:0/3460697385 wait complete. 2024-04-18T04:44:47.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.933+0000 7fe9e9a00640 1 Processor -- start 2024-04-18T04:44:47.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.933+0000 7fe9e9a00640 1 -- start start 2024-04-18T04:44:47.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.933+0000 7fe9e9a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe9e40caff0 0x7fe9e41539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:47.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.933+0000 7fe9e9a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9e4151730 0x7fe9e4150870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:47.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.933+0000 7fe9e9a00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9e4158150 0x7fe9e41545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:47.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.933+0000 7fe9e9a00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e414d1e0 con 0x7fe9e4151730 2024-04-18T04:44:47.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.933+0000 7fe9e9a00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e4153ee0 con 0x7fe9e4158150 2024-04-18T04:44:47.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.933+0000 7fe9e9a00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e414b010 con 0x7fe9e40caff0 2024-04-18T04:44:47.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.933+0000 7fe9da000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9e4151730 0x7fe9e4150870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:47.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.933+0000 7fe9da000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9e4151730 0x7fe9e4150870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47074/0 (socket says 172.21.15.120:47074) 2024-04-18T04:44:47.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.933+0000 7fe9da000640 1 -- 172.21.15.120:0/645910270 learned_addr learned my addr 172.21.15.120:0/645910270 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:47.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.933+0000 7fe9e3400640 1 --2- 172.21.15.120:0/645910270 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9e4158150 0x7fe9e41545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:47.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.933+0000 7fe9e2a00640 1 --2- 172.21.15.120:0/645910270 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe9e40caff0 0x7fe9e41539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:47.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.933+0000 7fe9da000640 1 -- 172.21.15.120:0/645910270 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe9e40caff0 msgr2=0x7fe9e41539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:47.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.933+0000 7fe9da000640 1 --2- 172.21.15.120:0/645910270 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe9e40caff0 0x7fe9e41539a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:47.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.933+0000 7fe9da000640 1 -- 172.21.15.120:0/645910270 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9e4158150 msgr2=0x7fe9e41545d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:47.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.933+0000 7fe9da000640 1 --2- 172.21.15.120:0/645910270 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9e4158150 0x7fe9e41545d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:47.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.933+0000 7fe9da000640 1 -- 172.21.15.120:0/645910270 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9dc009a70 con 0x7fe9e4151730 2024-04-18T04:44:47.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.933+0000 7fe9da000640 1 --2- 172.21.15.120:0/645910270 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9e4151730 0x7fe9e4150870 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc00d620 tx=0x7fe9cc00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:47.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.937+0000 7fe9db400640 1 -- 172.21.15.120:0/645910270 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc00b620 con 0x7fe9e4151730 2024-04-18T04:44:47.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.937+0000 7fe9db400640 1 -- 172.21.15.120:0/645910270 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9cc00b780 con 0x7fe9e4151730 2024-04-18T04:44:47.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.937+0000 7fe9db400640 1 -- 172.21.15.120:0/645910270 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc00bb10 con 0x7fe9e4151730 2024-04-18T04:44:47.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.937+0000 7fe9e9a00640 1 -- 172.21.15.120:0/645910270 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9e414ace0 con 0x7fe9e4151730 2024-04-18T04:44:47.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.937+0000 7fe9e9a00640 1 -- 172.21.15.120:0/645910270 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9e41534c0 con 0x7fe9e4151730 2024-04-18T04:44:47.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.937+0000 7fe9e9a00640 1 -- 172.21.15.120:0/645910270 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9e40729d0 con 0x7fe9e4151730 2024-04-18T04:44:47.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.937+0000 7fe9db400640 1 -- 172.21.15.120:0/645910270 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe9cc00bc70 con 0x7fe9e4151730 2024-04-18T04:44:47.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.937+0000 7fe9db400640 1 --2- 172.21.15.120:0/645910270 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fe9c0066690 0x7fe9c0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:47.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.937+0000 7fe9db400640 1 -- 172.21.15.120:0/645910270 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe9cc084ad0 con 0x7fe9e4151730 2024-04-18T04:44:47.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.937+0000 7fe9e2a00640 1 --2- 172.21.15.120:0/645910270 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fe9c0066690 0x7fe9c0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:47.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.941+0000 7fe9e2a00640 1 --2- 172.21.15.120:0/645910270 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fe9c0066690 0x7fe9c0068b50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4005890 tx=0x7fe9d4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:47.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:47.941+0000 7fe9db400640 1 -- 172.21.15.120:0/645910270 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fe9cc051a20 con 0x7fe9e4151730 2024-04-18T04:44:48.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.093+0000 7fe9e9a00640 1 -- 172.21.15.120:0/645910270 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe9e40c4ee0 con 0x7fe9e4151730 2024-04-18T04:44:48.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.093+0000 7fe9db400640 1 -- 172.21.15.120:0/645910270 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe9cc055040 con 0x7fe9e4151730 2024-04-18T04:44:48.094 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2024-04-18T04:44:48.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.097+0000 7fe9e9a00640 1 -- 172.21.15.120:0/645910270 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fe9c0066690 msgr2=0x7fe9c0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:48.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.097+0000 7fe9e9a00640 1 --2- 172.21.15.120:0/645910270 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fe9c0066690 0x7fe9c0068b50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4005890 tx=0x7fe9d4009040 comp rx=0 tx=0).stop 2024-04-18T04:44:48.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.097+0000 7fe9e9a00640 1 -- 172.21.15.120:0/645910270 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9e4151730 msgr2=0x7fe9e4150870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:48.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.097+0000 7fe9e9a00640 1 --2- 172.21.15.120:0/645910270 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9e4151730 0x7fe9e4150870 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc00d620 tx=0x7fe9cc00dae0 comp rx=0 tx=0).stop 2024-04-18T04:44:48.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.097+0000 7fe9e9a00640 1 -- 172.21.15.120:0/645910270 shutdown_connections 2024-04-18T04:44:48.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.097+0000 7fe9e9a00640 1 --2- 172.21.15.120:0/645910270 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fe9c0066690 0x7fe9c0068b50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:48.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.097+0000 7fe9e9a00640 1 --2- 172.21.15.120:0/645910270 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9e4158150 0x7fe9e41545d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:48.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.097+0000 7fe9e9a00640 1 --2- 172.21.15.120:0/645910270 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9e4151730 0x7fe9e4150870 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:48.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.097+0000 7fe9e9a00640 1 --2- 172.21.15.120:0/645910270 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe9e40caff0 0x7fe9e41539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:48.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.097+0000 7fe9e9a00640 1 -- 172.21.15.120:0/645910270 >> 172.21.15.120:0/645910270 conn(0x7fe9e406b780 msgr2=0x7fe9e40c9210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:48.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.097+0000 7fe9e9a00640 1 -- 172.21.15.120:0/645910270 shutdown_connections 2024-04-18T04:44:48.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.097+0000 7fe9e9a00640 1 -- 172.21.15.120:0/645910270 wait complete. 2024-04-18T04:44:48.115 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-18T04:44:48.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.253+0000 7fe7d8a00640 1 Processor -- start 2024-04-18T04:44:48.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.253+0000 7fe7d8a00640 1 -- start start 2024-04-18T04:44:48.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.253+0000 7fe7d8a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7d40c6f50 0x7fe7d40bfe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:48.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.253+0000 7fe7d8a00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe7d40c03b0 0x7fe7d40caff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:48.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.253+0000 7fe7d8a00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7d4071b20 con 0x7fe7d4150800 2024-04-18T04:44:48.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.253+0000 7fe7d8a00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7d4157340 con 0x7fe7d40c03b0 2024-04-18T04:44:48.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.253+0000 7fe7d8a00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d40725e0 con 0x7fe7d40c6f50 2024-04-18T04:44:48.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.253+0000 7fe7d1e00640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fe7d4150800 0x7fe7d4070e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:40418/0 (socket says 172.21.15.120:40418) 2024-04-18T04:44:48.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.253+0000 7fe7d1e00640 1 -- 172.21.15.120:0/3667191106 learned_addr learned my addr 172.21.15.120:0/3667191106 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:44:48.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.257+0000 7fe7d2800640 1 --2- 172.21.15.120:0/3667191106 >> v2:172.21.15.132:3300/0 conn(0x7fe7d40c03b0 0x7fe7d40caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:48.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.257+0000 7fe7c9400640 1 --2- 172.21.15.120:0/3667191106 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7d40c6f50 0x7fe7d40bfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:48.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.257+0000 7fe7d1400640 1 -- 172.21.15.120:0/3667191106 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1376329551 0 0) 0x7fe7d4071b20 con 0x7fe7d4150800 2024-04-18T04:44:48.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.257+0000 7fe7d1400640 1 -- 172.21.15.120:0/3667191106 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7b8003530 con 0x7fe7d4150800 2024-04-18T04:44:48.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.257+0000 7fe7d2800640 1 -- 172.21.15.120:0/3667191106 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7d40c6f50 msgr2=0x7fe7d40bfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:48.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.257+0000 7fe7d2800640 1 --2- 172.21.15.120:0/3667191106 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7d40c6f50 0x7fe7d40bfe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:48.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.257+0000 7fe7d2800640 1 -- 172.21.15.120:0/3667191106 >> v1:172.21.15.120:6789/0 conn(0x7fe7d4150800 legacy=0x7fe7d4070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:48.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.257+0000 7fe7d1400640 1 -- 172.21.15.120:0/3667191106 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1980571911 0 0) 0x7fe7b8003530 con 0x7fe7d4150800 2024-04-18T04:44:48.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.257+0000 7fe7d2800640 1 -- 172.21.15.120:0/3667191106 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d4071840 con 0x7fe7d40c03b0 2024-04-18T04:44:48.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.257+0000 7fe7c9400640 1 --2- 172.21.15.120:0/3667191106 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7d40c6f50 0x7fe7d40bfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:44:48.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.257+0000 7fe7d2800640 1 --2- 172.21.15.120:0/3667191106 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7d40c03b0 0x7fe7d40caff0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc0097c0 tx=0x7fe7cc01c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3ca6898ac0b9ee7 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:48.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.257+0000 7fe7d1400640 1 -- 172.21.15.120:0/3667191106 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc0ad680 con 0x7fe7d40c03b0 2024-04-18T04:44:48.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.257+0000 7fe7d1400640 1 -- 172.21.15.120:0/3667191106 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7cc0ad7e0 con 0x7fe7d40c03b0 2024-04-18T04:44:48.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.257+0000 7fe7d1400640 1 -- 172.21.15.120:0/3667191106 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc0adb50 con 0x7fe7d40c03b0 2024-04-18T04:44:48.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.261+0000 7fe7d8a00640 1 -- 172.21.15.120:0/3667191106 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7d40c03b0 msgr2=0x7fe7d40caff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:48.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.261+0000 7fe7d8a00640 1 --2- 172.21.15.120:0/3667191106 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7d40c03b0 0x7fe7d40caff0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc0097c0 tx=0x7fe7cc01c470 comp rx=0 tx=0).stop 2024-04-18T04:44:48.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.261+0000 7fe7d8a00640 1 -- 172.21.15.120:0/3667191106 shutdown_connections 2024-04-18T04:44:48.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.261+0000 7fe7d8a00640 1 --2- 172.21.15.120:0/3667191106 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7d40c03b0 0x7fe7d40caff0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:48.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.261+0000 7fe7d8a00640 1 --2- 172.21.15.120:0/3667191106 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7d40c6f50 0x7fe7d40bfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:48.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.261+0000 7fe7d8a00640 1 -- 172.21.15.120:0/3667191106 >> 172.21.15.120:0/3667191106 conn(0x7fe7d406b780 msgr2=0x7fe7d406bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:48.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.261+0000 7fe7d8a00640 1 -- 172.21.15.120:0/3667191106 shutdown_connections 2024-04-18T04:44:48.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.261+0000 7fe7d8a00640 1 -- 172.21.15.120:0/3667191106 wait complete. 2024-04-18T04:44:48.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.261+0000 7fe7d8a00640 1 Processor -- start 2024-04-18T04:44:48.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.261+0000 7fe7d8a00640 1 -- start start 2024-04-18T04:44:48.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.261+0000 7fe7d8a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7d40c03b0 0x7fe7d413ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:48.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.261+0000 7fe7d8a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7d40c6f50 0x7fe7d40c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:48.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.261+0000 7fe7d8a00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7d4150800 0x7fe7d41360d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:48.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.261+0000 7fe7d8a00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d40c94b0 con 0x7fe7d40c6f50 2024-04-18T04:44:48.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.261+0000 7fe7d8a00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d40ca2e0 con 0x7fe7d4150800 2024-04-18T04:44:48.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.261+0000 7fe7d8a00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d415ffa0 con 0x7fe7d40c03b0 2024-04-18T04:44:48.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.261+0000 7fe7c9400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7d40c6f50 0x7fe7d40c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:48.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.261+0000 7fe7c9400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7d40c6f50 0x7fe7d40c7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47080/0 (socket says 172.21.15.120:47080) 2024-04-18T04:44:48.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.261+0000 7fe7c9400640 1 -- 172.21.15.120:0/381111690 learned_addr learned my addr 172.21.15.120:0/381111690 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:48.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.261+0000 7fe7d2800640 1 --2- 172.21.15.120:0/381111690 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7d4150800 0x7fe7d41360d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:48.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.261+0000 7fe7d1e00640 1 --2- 172.21.15.120:0/381111690 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7d40c03b0 0x7fe7d413ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:48.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.261+0000 7fe7c9400640 1 -- 172.21.15.120:0/381111690 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7d40c03b0 msgr2=0x7fe7d413ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:48.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.261+0000 7fe7c9400640 1 --2- 172.21.15.120:0/381111690 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7d40c03b0 0x7fe7d413ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:48.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.261+0000 7fe7c9400640 1 -- 172.21.15.120:0/381111690 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7d4150800 msgr2=0x7fe7d41360d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:48.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.261+0000 7fe7c9400640 1 --2- 172.21.15.120:0/381111690 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7d4150800 0x7fe7d41360d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:48.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.261+0000 7fe7c9400640 1 -- 172.21.15.120:0/381111690 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7bc009420 con 0x7fe7d40c6f50 2024-04-18T04:44:48.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.265+0000 7fe7c9400640 1 --2- 172.21.15.120:0/381111690 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7d40c6f50 0x7fe7d40c7f40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc00ebe0 tx=0x7fe7bc00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:48.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.265+0000 7fe7caa00640 1 -- 172.21.15.120:0/381111690 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7bc00eee0 con 0x7fe7d40c6f50 2024-04-18T04:44:48.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.265+0000 7fe7caa00640 1 -- 172.21.15.120:0/381111690 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7bc00cc30 con 0x7fe7d40c6f50 2024-04-18T04:44:48.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.265+0000 7fe7caa00640 1 -- 172.21.15.120:0/381111690 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7bc013470 con 0x7fe7d40c6f50 2024-04-18T04:44:48.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.265+0000 7fe7d8a00640 1 -- 172.21.15.120:0/381111690 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7cc009420 con 0x7fe7d40c6f50 2024-04-18T04:44:48.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.265+0000 7fe7d8a00640 1 -- 172.21.15.120:0/381111690 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d40c8c60 con 0x7fe7d40c6f50 2024-04-18T04:44:48.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.265+0000 7fe7d8a00640 1 -- 172.21.15.120:0/381111690 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7d4067590 con 0x7fe7d40c6f50 2024-04-18T04:44:48.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.265+0000 7fe7caa00640 1 -- 172.21.15.120:0/381111690 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe7bc0135d0 con 0x7fe7d40c6f50 2024-04-18T04:44:48.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.265+0000 7fe7caa00640 1 --2- 172.21.15.120:0/381111690 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fe7b0066690 0x7fe7b0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:48.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.265+0000 7fe7caa00640 1 -- 172.21.15.120:0/381111690 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe7bc084750 con 0x7fe7d40c6f50 2024-04-18T04:44:48.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.265+0000 7fe7d1e00640 1 --2- 172.21.15.120:0/381111690 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fe7b0066690 0x7fe7b0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:48.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.269+0000 7fe7d1e00640 1 --2- 172.21.15.120:0/381111690 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fe7b0066690 0x7fe7b0068b50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe7c40016f0 tx=0x7fe7c4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:48.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.269+0000 7fe7caa00640 1 -- 172.21.15.120:0/381111690 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fe7bc051860 con 0x7fe7d40c6f50 2024-04-18T04:44:48.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.433+0000 7fe7d8a00640 1 -- 172.21.15.120:0/381111690 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe7d40cabc0 con 0x7fe7d40c6f50 2024-04-18T04:44:48.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.433+0000 7fe7caa00640 1 -- 172.21.15.120:0/381111690 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe7bc054e80 con 0x7fe7d40c6f50 2024-04-18T04:44:48.434 INFO:teuthology.orchestra.run.smithi120.stderr:listed 0 entries 2024-04-18T04:44:48.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.437+0000 7fe7d8a00640 1 -- 172.21.15.120:0/381111690 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fe7b0066690 msgr2=0x7fe7b0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:48.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.437+0000 7fe7d8a00640 1 --2- 172.21.15.120:0/381111690 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fe7b0066690 0x7fe7b0068b50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe7c40016f0 tx=0x7fe7c4009040 comp rx=0 tx=0).stop 2024-04-18T04:44:48.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.437+0000 7fe7d8a00640 1 -- 172.21.15.120:0/381111690 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7d40c6f50 msgr2=0x7fe7d40c7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:48.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.437+0000 7fe7d8a00640 1 --2- 172.21.15.120:0/381111690 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7d40c6f50 0x7fe7d40c7f40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc00ebe0 tx=0x7fe7bc00c520 comp rx=0 tx=0).stop 2024-04-18T04:44:48.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.437+0000 7fe7d8a00640 1 -- 172.21.15.120:0/381111690 shutdown_connections 2024-04-18T04:44:48.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.437+0000 7fe7d8a00640 1 --2- 172.21.15.120:0/381111690 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fe7b0066690 0x7fe7b0068b50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:48.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.437+0000 7fe7d8a00640 1 --2- 172.21.15.120:0/381111690 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7d4150800 0x7fe7d41360d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:48.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.437+0000 7fe7d8a00640 1 --2- 172.21.15.120:0/381111690 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7d40c6f50 0x7fe7d40c7f40 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:48.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.437+0000 7fe7d8a00640 1 --2- 172.21.15.120:0/381111690 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7d40c03b0 0x7fe7d413ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:48.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.437+0000 7fe7d8a00640 1 -- 172.21.15.120:0/381111690 >> 172.21.15.120:0/381111690 conn(0x7fe7d406b780 msgr2=0x7fe7d414e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:48.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.437+0000 7fe7d8a00640 1 -- 172.21.15.120:0/381111690 shutdown_connections 2024-04-18T04:44:48.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:48.437+0000 7fe7d8a00640 1 -- 172.21.15.120:0/381111690 wait complete. 2024-04-18T04:44:48.456 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi120.front.sepia.ceph.com... 2024-04-18T04:44:48.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:44:48.456 DEBUG:teuthology.orchestra.run.smithi120:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-18T04:44:48.481 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi120.stderr:ceph-fuse[31971]: fuse finished with error 0 and tester_r 0 2024-04-18T04:44:48.484 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T04:44:54.585 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi120.front.sepia.ceph.com 2024-04-18T04:44:54.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:44:54.586 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-18T04:44:54.637 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T04:44:54.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.777+0000 7f8214a00640 1 Processor -- start 2024-04-18T04:44:54.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.777+0000 7f8214a00640 1 -- start start 2024-04-18T04:44:54.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.781+0000 7f8214a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8210150670 0x7f821006db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:54.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.781+0000 7f8214a00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8210156270 0x7f82101566e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:54.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.781+0000 7f8214a00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82100c0880 con 0x7f82100b0c40 2024-04-18T04:44:54.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.781+0000 7f8214a00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8210150a50 con 0x7f8210156270 2024-04-18T04:44:54.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.781+0000 7f8214a00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8210156c20 con 0x7f8210150670 2024-04-18T04:44:54.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.781+0000 7f8207e00640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f82100b0c40 0x7f82100c68d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:58908/0 (socket says 172.21.15.120:58908) 2024-04-18T04:44:54.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.781+0000 7f8207e00640 1 -- 172.21.15.120:0/1304626720 learned_addr learned my addr 172.21.15.120:0/1304626720 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:44:54.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.781+0000 7f820f400640 1 --2- 172.21.15.120:0/1304626720 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8210150670 0x7f821006db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:54.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.781+0000 7f820fe00640 1 --2- 172.21.15.120:0/1304626720 >> v2:172.21.15.132:3300/0 conn(0x7f8210156270 0x7f82101566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:54.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.781+0000 7f820ea00640 1 -- 172.21.15.120:0/1304626720 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2671417693 0 0) 0x7f81f8001120 con 0x7f82100b0c40 2024-04-18T04:44:54.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.781+0000 7f820ea00640 1 -- 172.21.15.120:0/1304626720 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81f4003530 con 0x7f82100b0c40 2024-04-18T04:44:54.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.781+0000 7f820ea00640 1 -- 172.21.15.120:0/1304626720 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2301232269 0 0) 0x7f81f4003530 con 0x7f82100b0c40 2024-04-18T04:44:54.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.781+0000 7f820ea00640 1 -- 172.21.15.120:0/1304626720 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8210150670 msgr2=0x7f821006db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:54.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.781+0000 7f820ea00640 1 --2- 172.21.15.120:0/1304626720 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8210150670 0x7f821006db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:54.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.781+0000 7f820ea00640 1 -- 172.21.15.120:0/1304626720 >> v2:172.21.15.132:3300/0 conn(0x7f8210156270 msgr2=0x7f82101566e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:54.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.781+0000 7f820ea00640 1 --2- 172.21.15.120:0/1304626720 >> v2:172.21.15.132:3300/0 conn(0x7f8210156270 0x7f82101566e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:54.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.781+0000 7f820ea00640 1 -- 172.21.15.120:0/1304626720 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82100c05a0 con 0x7f82100b0c40 2024-04-18T04:44:54.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.781+0000 7f820ea00640 1 -- 172.21.15.120:0/1304626720 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7f81f8001810 con 0x7f82100b0c40 2024-04-18T04:44:54.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.781+0000 7f820ea00640 1 -- 172.21.15.120:0/1304626720 >> v1:172.21.15.120:6789/0 conn(0x7f82100b0c40 legacy=0x7f82100c68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:54.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.781+0000 7f820ea00640 1 --2- 172.21.15.120:0/1304626720 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8210150670 0x7f81f4003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:54.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.781+0000 7f820ea00640 1 --2- 172.21.15.120:0/1304626720 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81f4003f00 0x7f81f40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:54.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.781+0000 7f820ea00640 1 --2- 172.21.15.120:0/1304626720 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81f4004d10 0x7f81f4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:54.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.781+0000 7f820ea00640 1 -- 172.21.15.120:0/1304626720 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f400b990 con 0x7f81f4004d10 2024-04-18T04:44:54.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.781+0000 7f820ea00640 1 -- 172.21.15.120:0/1304626720 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f400bad0 con 0x7f81f4003f00 2024-04-18T04:44:54.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.781+0000 7f820ea00640 1 -- 172.21.15.120:0/1304626720 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f400bc10 con 0x7f8210150670 2024-04-18T04:44:54.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.781+0000 7f820fe00640 1 --2- 172.21.15.120:0/1304626720 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81f4004d10 0x7f81f4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:54.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.781+0000 7f820f400640 1 --2- 172.21.15.120:0/1304626720 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8210150670 0x7f81f4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:54.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.781+0000 7f8207e00640 1 --2- 172.21.15.120:0/1304626720 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81f4003f00 0x7f81f40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:54.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.781+0000 7f820fe00640 1 -- 172.21.15.120:0/1304626720 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8210150670 msgr2=0x7f81f4003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:54.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.781+0000 7f820fe00640 1 --2- 172.21.15.120:0/1304626720 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8210150670 0x7f81f4003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:54.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.781+0000 7f820fe00640 1 -- 172.21.15.120:0/1304626720 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81f4003f00 msgr2=0x7f81f40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:54.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.781+0000 7f820fe00640 1 --2- 172.21.15.120:0/1304626720 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81f4003f00 0x7f81f40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:54.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.781+0000 7f820fe00640 1 -- 172.21.15.120:0/1304626720 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f4003530 con 0x7f81f4004d10 2024-04-18T04:44:54.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.785+0000 7f820fe00640 1 --2- 172.21.15.120:0/1304626720 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81f4004d10 0x7f81f4005190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8208009fc0 tx=0x7f820801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80934d1c0b0bed86 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:54.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.785+0000 7f820ea00640 1 -- 172.21.15.120:0/1304626720 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82080a5cd0 con 0x7f81f4004d10 2024-04-18T04:44:54.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.785+0000 7f820ea00640 1 -- 172.21.15.120:0/1304626720 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820800f040 con 0x7f81f4004d10 2024-04-18T04:44:54.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.785+0000 7f820ea00640 1 -- 172.21.15.120:0/1304626720 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82080ad680 con 0x7f81f4004d10 2024-04-18T04:44:54.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.785+0000 7f8214a00640 1 -- 172.21.15.120:0/1304626720 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81f4004d10 msgr2=0x7f81f4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:54.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.785+0000 7f8214a00640 1 --2- 172.21.15.120:0/1304626720 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81f4004d10 0x7f81f4005190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8208009fc0 tx=0x7f820801cc60 comp rx=0 tx=0).stop 2024-04-18T04:44:54.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.785+0000 7f820fe00640 1 -- 172.21.15.120:0/1304626720 reap_dead start 2024-04-18T04:44:54.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.785+0000 7f8214a00640 1 -- 172.21.15.120:0/1304626720 shutdown_connections 2024-04-18T04:44:54.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.785+0000 7f8214a00640 1 -- 172.21.15.120:0/1304626720 >> 172.21.15.120:0/1304626720 conn(0x7f821006d000 msgr2=0x7f821006d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:54.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.785+0000 7f8214a00640 1 -- 172.21.15.120:0/1304626720 shutdown_connections 2024-04-18T04:44:54.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.785+0000 7f8214a00640 1 -- 172.21.15.120:0/1304626720 wait complete. 2024-04-18T04:44:54.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.789+0000 7f8214a00640 1 Processor -- start 2024-04-18T04:44:54.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.789+0000 7f8214a00640 1 -- start start 2024-04-18T04:44:54.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.789+0000 7f8214a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81f4004d10 0x7f82101e4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:54.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.789+0000 7f8214a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f821014b840 0x7f82101491f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:54.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.789+0000 7f8214a00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f821014bd90 0x7f8210146520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:54.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.789+0000 7f8214a00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8210148930 con 0x7f81f4004d10 2024-04-18T04:44:54.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.789+0000 7f8214a00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82101e59d0 con 0x7f821014bd90 2024-04-18T04:44:54.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.789+0000 7f8214a00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82100cabe0 con 0x7f821014b840 2024-04-18T04:44:54.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.789+0000 7f820f400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81f4004d10 0x7f82101e4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:54.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.789+0000 7f820f400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81f4004d10 0x7f82101e4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45862/0 (socket says 172.21.15.120:45862) 2024-04-18T04:44:54.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.789+0000 7f820f400640 1 -- 172.21.15.120:0/3384901244 learned_addr learned my addr 172.21.15.120:0/3384901244 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:54.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.789+0000 7f8207e00640 1 --2- 172.21.15.120:0/3384901244 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f821014b840 0x7f82101491f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:54.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.789+0000 7f820fe00640 1 --2- 172.21.15.120:0/3384901244 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f821014bd90 0x7f8210146520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:54.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.789+0000 7f820f400640 1 -- 172.21.15.120:0/3384901244 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f821014b840 msgr2=0x7f82101491f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:54.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.789+0000 7f820f400640 1 --2- 172.21.15.120:0/3384901244 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f821014b840 0x7f82101491f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:54.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.789+0000 7f820f400640 1 -- 172.21.15.120:0/3384901244 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f821014bd90 msgr2=0x7f8210146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:54.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.789+0000 7f820f400640 1 --2- 172.21.15.120:0/3384901244 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f821014bd90 0x7f8210146520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:54.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.789+0000 7f820f400640 1 -- 172.21.15.120:0/3384901244 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82100ca750 con 0x7f81f4004d10 2024-04-18T04:44:54.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.789+0000 7f8207e00640 1 --2- 172.21.15.120:0/3384901244 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f821014b840 0x7f82101491f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:44:54.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.789+0000 7f820f400640 1 --2- 172.21.15.120:0/3384901244 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81f4004d10 0x7f82101e4090 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8200011e60 tx=0x7f8200010810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:54.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.789+0000 7f8207400640 1 -- 172.21.15.120:0/3384901244 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820000f7e0 con 0x7f81f4004d10 2024-04-18T04:44:54.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.789+0000 7f8207400640 1 -- 172.21.15.120:0/3384901244 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820000f940 con 0x7f81f4004d10 2024-04-18T04:44:54.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.789+0000 7f8207400640 1 -- 172.21.15.120:0/3384901244 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820000fcf0 con 0x7f81f4004d10 2024-04-18T04:44:54.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.789+0000 7f8214a00640 1 -- 172.21.15.120:0/3384901244 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f821014c380 con 0x7f81f4004d10 2024-04-18T04:44:54.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.789+0000 7f8214a00640 1 -- 172.21.15.120:0/3384901244 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f821014c940 con 0x7f81f4004d10 2024-04-18T04:44:54.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.789+0000 7f8214a00640 1 -- 172.21.15.120:0/3384901244 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82100728f0 con 0x7f81f4004d10 2024-04-18T04:44:54.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.793+0000 7f8207400640 1 -- 172.21.15.120:0/3384901244 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8200022440 con 0x7f81f4004d10 2024-04-18T04:44:54.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.793+0000 7f8207400640 1 --2- 172.21.15.120:0/3384901244 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f81ec0666c0 0x7f81ec068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:54.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.793+0000 7f8207400640 1 -- 172.21.15.120:0/3384901244 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8200085150 con 0x7f81f4004d10 2024-04-18T04:44:54.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.793+0000 7f8207e00640 1 --2- 172.21.15.120:0/3384901244 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f81ec0666c0 0x7f81ec068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:54.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.793+0000 7f8207e00640 1 --2- 172.21.15.120:0/3384901244 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f81ec0666c0 0x7f81ec068b80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f81f8001280 tx=0x7f81f8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:54.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.797+0000 7f8207400640 1 -- 172.21.15.120:0/3384901244 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f82000521c0 con 0x7f81f4004d10 2024-04-18T04:44:54.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.953+0000 7f8214a00640 1 -- 172.21.15.120:0/3384901244 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f82100bff40 con 0x7f81f4004d10 2024-04-18T04:44:54.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.953+0000 7f8207400640 1 -- 172.21.15.120:0/3384901244 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f82000557e0 con 0x7f81f4004d10 2024-04-18T04:44:54.954 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:44:54.954 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":25,"fsid":"8e73592f-08e2-4957-a98f-9d044cec4ba5","created":"2024-04-18T04:44:06.139983+0000","modified":"2024-04-18T04:44:34.676253+0000","last_up_change":"2024-04-18T04:44:17.410146+0000","last_in_change":"2024-04-18T04:44:08.470250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T04:44:16.864728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T04:44:28.825773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T04:44:29.245857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-18T04:44:32.314302+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a80903bd-d9be-4fb9-af99-6125cb26bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":27468},{"type":"v1","addr":"172.21.15.120:6801","nonce":27468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":27468},{"type":"v1","addr":"172.21.15.120:6803","nonce":27468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":27468},{"type":"v1","addr":"172.21.15.120:6807","nonce":27468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":27468},{"type":"v1","addr":"172.21.15.120:6805","nonce":27468}]},"public_addr":"172.21.15.120:6801/27468","cluster_addr":"172.21.15.120:6803/27468","heartbeat_back_addr":"172.21.15.120:6807/27468","heartbeat_front_addr":"172.21.15.120:6805/27468","state":["exists","up"]},{"osd":1,"uuid":"8f5f004b-6870-4c78-8d50-9622e631ec25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":27470},{"type":"v1","addr":"172.21.15.120:6823","nonce":27470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":27470},{"type":"v1","addr":"172.21.15.120:6827","nonce":27470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":27470},{"type":"v1","addr":"172.21.15.120:6831","nonce":27470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":27470},{"type":"v1","addr":"172.21.15.120:6829","nonce":27470}]},"public_addr":"172.21.15.120:6823/27470","cluster_addr":"172.21.15.120:6827/27470","heartbeat_back_addr":"172.21.15.120:6831/27470","heartbeat_front_addr":"172.21.15.120:6829/27470","state":["exists","up"]},{"osd":2,"uuid":"6e228a2b-6103-4301-a8b5-ee81dbb1f920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":27471},{"type":"v1","addr":"172.21.15.120:6817","nonce":27471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":27471},{"type":"v1","addr":"172.21.15.120:6819","nonce":27471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":27471},{"type":"v1","addr":"172.21.15.120:6826","nonce":27471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":27471},{"type":"v1","addr":"172.21.15.120:6822","nonce":27471}]},"public_addr":"172.21.15.120:6817/27471","cluster_addr":"172.21.15.120:6819/27471","heartbeat_back_addr":"172.21.15.120:6826/27471","heartbeat_front_addr":"172.21.15.120:6822/27471","state":["exists","up"]},{"osd":3,"uuid":"7a5cabd7-d898-4e32-a03c-25b46e790134","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":27469},{"type":"v1","addr":"172.21.15.120:6809","nonce":27469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":27469},{"type":"v1","addr":"172.21.15.120:6811","nonce":27469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":27469},{"type":"v1","addr":"172.21.15.120:6815","nonce":27469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":27469},{"type":"v1","addr":"172.21.15.120:6813","nonce":27469}]},"public_addr":"172.21.15.120:6809/27469","cluster_addr":"172.21.15.120:6811/27469","heartbeat_back_addr":"172.21.15.120:6815/27469","heartbeat_front_addr":"172.21.15.120:6813/27469","state":["exists","up"]},{"osd":4,"uuid":"8e9f530f-6bab-4b23-a1a3-a71362fefcc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":28102},{"type":"v1","addr":"172.21.15.132:6825","nonce":28102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":28102},{"type":"v1","addr":"172.21.15.132:6827","nonce":28102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":28102},{"type":"v1","addr":"172.21.15.132:6831","nonce":28102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":28102},{"type":"v1","addr":"172.21.15.132:6829","nonce":28102}]},"public_addr":"172.21.15.132:6825/28102","cluster_addr":"172.21.15.132:6827/28102","heartbeat_back_addr":"172.21.15.132:6831/28102","heartbeat_front_addr":"172.21.15.132:6829/28102","state":["exists","up"]},{"osd":5,"uuid":"2243fabe-cc81-40cf-91bc-f106fe275a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":28104},{"type":"v1","addr":"172.21.15.132:6809","nonce":28104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":28104},{"type":"v1","addr":"172.21.15.132:6811","nonce":28104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":28104},{"type":"v1","addr":"172.21.15.132:6815","nonce":28104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":28104},{"type":"v1","addr":"172.21.15.132:6813","nonce":28104}]},"public_addr":"172.21.15.132:6809/28104","cluster_addr":"172.21.15.132:6811/28104","heartbeat_back_addr":"172.21.15.132:6815/28104","heartbeat_front_addr":"172.21.15.132:6813/28104","state":["exists","up"]},{"osd":6,"uuid":"c093a5ed-25c8-41a7-a20d-606a1a1661e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":28103},{"type":"v1","addr":"172.21.15.132:6801","nonce":28103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":28103},{"type":"v1","addr":"172.21.15.132:6803","nonce":28103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":28103},{"type":"v1","addr":"172.21.15.132:6807","nonce":28103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":28103},{"type":"v1","addr":"172.21.15.132:6805","nonce":28103}]},"public_addr":"172.21.15.132:6801/28103","cluster_addr":"172.21.15.132:6803/28103","heartbeat_back_addr":"172.21.15.132:6807/28103","heartbeat_front_addr":"172.21.15.132:6805/28103","state":["exists","up"]},{"osd":7,"uuid":"c37426b7-1080-4434-9f3e-a3afbbdc0fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":28129},{"type":"v1","addr":"172.21.15.132:6817","nonce":28129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":28129},{"type":"v1","addr":"172.21.15.132:6819","nonce":28129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":28129},{"type":"v1","addr":"172.21.15.132:6823","nonce":28129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":28129},{"type":"v1","addr":"172.21.15.132:6821","nonce":28129}]},"public_addr":"172.21.15.132:6817/28129","cluster_addr":"172.21.15.132:6819/28129","heartbeat_back_addr":"172.21.15.132:6823/28129","heartbeat_front_addr":"172.21.15.132:6821/28129","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.053825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.289753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.274645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.146361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.943883+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.701955+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.851076+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.800782+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T04:44:54.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.957+0000 7f8214a00640 1 -- 172.21.15.120:0/3384901244 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f81ec0666c0 msgr2=0x7f81ec068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:54.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.957+0000 7f8214a00640 1 --2- 172.21.15.120:0/3384901244 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f81ec0666c0 0x7f81ec068b80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f81f8001280 tx=0x7f81f8009040 comp rx=0 tx=0).stop 2024-04-18T04:44:54.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.957+0000 7f8214a00640 1 -- 172.21.15.120:0/3384901244 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81f4004d10 msgr2=0x7f82101e4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:54.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.957+0000 7f8214a00640 1 --2- 172.21.15.120:0/3384901244 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81f4004d10 0x7f82101e4090 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8200011e60 tx=0x7f8200010810 comp rx=0 tx=0).stop 2024-04-18T04:44:54.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.957+0000 7f8214a00640 1 -- 172.21.15.120:0/3384901244 shutdown_connections 2024-04-18T04:44:54.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.957+0000 7f8214a00640 1 --2- 172.21.15.120:0/3384901244 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f81ec0666c0 0x7f81ec068b80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:54.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.957+0000 7f8214a00640 1 --2- 172.21.15.120:0/3384901244 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f821014bd90 0x7f8210146520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:54.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.957+0000 7f8214a00640 1 --2- 172.21.15.120:0/3384901244 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f821014b840 0x7f82101491f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:54.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.957+0000 7f8214a00640 1 --2- 172.21.15.120:0/3384901244 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81f4004d10 0x7f82101e4090 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:54.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.957+0000 7f8214a00640 1 -- 172.21.15.120:0/3384901244 >> 172.21.15.120:0/3384901244 conn(0x7f821006d000 msgr2=0x7f821006f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:54.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.957+0000 7f8214a00640 1 -- 172.21.15.120:0/3384901244 shutdown_connections 2024-04-18T04:44:54.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:54.957+0000 7f8214a00640 1 -- 172.21.15.120:0/3384901244 wait complete. 2024-04-18T04:44:54.975 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T04:44:55.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.109+0000 7f9327a00640 1 Processor -- start 2024-04-18T04:44:55.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.109+0000 7f9327a00640 1 -- start start 2024-04-18T04:44:55.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.113+0000 7f9327a00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9320150340 0x7f9320156430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:55.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.113+0000 7f9327a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f93200c7480 0x7f9320160db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:55.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.113+0000 7f9327a00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f932006f9b0 con 0x7f9320156970 2024-04-18T04:44:55.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.113+0000 7f9327a00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93200c0520 con 0x7f9320150340 2024-04-18T04:44:55.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.113+0000 7f9327a00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93200c0800 con 0x7f93200c7480 2024-04-18T04:44:55.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.113+0000 7f9325000640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9320150340 0x7f9320156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:55.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.113+0000 7f931fe00640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f9320156970 0x7f93200c68d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:58914/0 (socket says 172.21.15.120:58914) 2024-04-18T04:44:55.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.113+0000 7f931fe00640 1 -- 172.21.15.120:0/1092735985 learned_addr learned my addr 172.21.15.120:0/1092735985 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:44:55.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.113+0000 7f9325a00640 1 --2- 172.21.15.120:0/1092735985 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f93200c7480 0x7f9320160db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:55.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.113+0000 7f9325000640 1 -- 172.21.15.120:0/1092735985 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f93200c7480 msgr2=0x7f9320160db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:55.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.113+0000 7f9325000640 1 --2- 172.21.15.120:0/1092735985 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f93200c7480 0x7f9320160db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:55.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.113+0000 7f9325000640 1 -- 172.21.15.120:0/1092735985 >> v1:172.21.15.120:6789/0 conn(0x7f9320156970 legacy=0x7f93200c68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:55.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.113+0000 7f9325000640 1 -- 172.21.15.120:0/1092735985 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f932006fc20 con 0x7f9320150340 2024-04-18T04:44:55.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.113+0000 7f931f400640 1 -- 172.21.15.120:0/1092735985 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1483644503 0 0) 0x7f932006f9b0 con 0x7f9320156970 2024-04-18T04:44:55.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.113+0000 7f9325000640 1 --2- 172.21.15.120:0/1092735985 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9320150340 0x7f9320156430 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f93100097c0 tx=0x7f931001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50fe2b15f9861009 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:55.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.113+0000 7f931f400640 1 -- 172.21.15.120:0/1092735985 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93100a8990 con 0x7f9320150340 2024-04-18T04:44:55.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.113+0000 7f931f400640 1 -- 172.21.15.120:0/1092735985 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93100a8af0 con 0x7f9320150340 2024-04-18T04:44:55.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.117+0000 7f931f400640 1 -- 172.21.15.120:0/1092735985 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93100a8e80 con 0x7f9320150340 2024-04-18T04:44:55.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.117+0000 7f9327a00640 1 -- 172.21.15.120:0/1092735985 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9320150340 msgr2=0x7f9320156430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:55.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.117+0000 7f9327a00640 1 --2- 172.21.15.120:0/1092735985 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9320150340 0x7f9320156430 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f93100097c0 tx=0x7f931001ec90 comp rx=0 tx=0).stop 2024-04-18T04:44:55.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.117+0000 7f9327a00640 1 -- 172.21.15.120:0/1092735985 shutdown_connections 2024-04-18T04:44:55.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.117+0000 7f9327a00640 1 --2- 172.21.15.120:0/1092735985 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f93200c7480 0x7f9320160db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:55.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.117+0000 7f9327a00640 1 --2- 172.21.15.120:0/1092735985 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9320150340 0x7f9320156430 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:55.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.117+0000 7f9327a00640 1 -- 172.21.15.120:0/1092735985 >> 172.21.15.120:0/1092735985 conn(0x7f93200c78c0 msgr2=0x7f93200c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:55.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.117+0000 7f9327a00640 1 -- 172.21.15.120:0/1092735985 shutdown_connections 2024-04-18T04:44:55.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.117+0000 7f9327a00640 1 -- 172.21.15.120:0/1092735985 wait complete. 2024-04-18T04:44:55.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.117+0000 7f9327a00640 1 Processor -- start 2024-04-18T04:44:55.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.117+0000 7f9327a00640 1 -- start start 2024-04-18T04:44:55.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.117+0000 7f9327a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93200c7480 0x7f9320150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:55.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.117+0000 7f9327a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9320150340 0x7f93201553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:55.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.117+0000 7f9327a00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9320152420 0x7f93201576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:55.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.117+0000 7f9327a00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9320151260 con 0x7f93200c7480 2024-04-18T04:44:55.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.117+0000 7f9327a00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9320151460 con 0x7f9320152420 2024-04-18T04:44:55.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.117+0000 7f9327a00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9320152e40 con 0x7f9320150340 2024-04-18T04:44:55.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.117+0000 7f9325000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93200c7480 0x7f9320150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:55.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.117+0000 7f9325000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93200c7480 0x7f9320150d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45884/0 (socket says 172.21.15.120:45884) 2024-04-18T04:44:55.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.117+0000 7f9325000640 1 -- 172.21.15.120:0/3716853417 learned_addr learned my addr 172.21.15.120:0/3716853417 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:55.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.117+0000 7f931fe00640 1 --2- 172.21.15.120:0/3716853417 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9320150340 0x7f93201553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:55.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.117+0000 7f9325a00640 1 --2- 172.21.15.120:0/3716853417 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9320152420 0x7f93201576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:55.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.117+0000 7f9325000640 1 -- 172.21.15.120:0/3716853417 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9320150340 msgr2=0x7f93201553a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:55.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.117+0000 7f9325000640 1 --2- 172.21.15.120:0/3716853417 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9320150340 0x7f93201553a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:55.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.117+0000 7f9325000640 1 -- 172.21.15.120:0/3716853417 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9320152420 msgr2=0x7f93201576f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:55.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.117+0000 7f9325000640 1 --2- 172.21.15.120:0/3716853417 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9320152420 0x7f93201576f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:55.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.117+0000 7f9325000640 1 -- 172.21.15.120:0/3716853417 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9310009420 con 0x7f93200c7480 2024-04-18T04:44:55.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.121+0000 7f9325000640 1 --2- 172.21.15.120:0/3716853417 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93200c7480 0x7f9320150d20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f931001c8c0 tx=0x7f931001d4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:55.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.121+0000 7f931cc00640 1 -- 172.21.15.120:0/3716853417 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93100a8990 con 0x7f93200c7480 2024-04-18T04:44:55.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.121+0000 7f931cc00640 1 -- 172.21.15.120:0/3716853417 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9310006e20 con 0x7f93200c7480 2024-04-18T04:44:55.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.121+0000 7f9327a00640 1 -- 172.21.15.120:0/3716853417 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9320153120 con 0x7f93200c7480 2024-04-18T04:44:55.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.121+0000 7f931cc00640 1 -- 172.21.15.120:0/3716853417 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9310004220 con 0x7f93200c7480 2024-04-18T04:44:55.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.121+0000 7f9327a00640 1 -- 172.21.15.120:0/3716853417 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93201536e0 con 0x7f93200c7480 2024-04-18T04:44:55.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.121+0000 7f9327a00640 1 -- 172.21.15.120:0/3716853417 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93200726d0 con 0x7f93200c7480 2024-04-18T04:44:55.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.121+0000 7f931cc00640 1 -- 172.21.15.120:0/3716853417 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9310004380 con 0x7f93200c7480 2024-04-18T04:44:55.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.121+0000 7f931cc00640 1 --2- 172.21.15.120:0/3716853417 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f93000666c0 0x7f9300068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:55.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.121+0000 7f931cc00640 1 -- 172.21.15.120:0/3716853417 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9310121e90 con 0x7f93200c7480 2024-04-18T04:44:55.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.121+0000 7f931fe00640 1 --2- 172.21.15.120:0/3716853417 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f93000666c0 0x7f9300068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:55.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.125+0000 7f931fe00640 1 --2- 172.21.15.120:0/3716853417 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f93000666c0 0x7f9300068b80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f93201587e0 tx=0x7f930c007c10 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:55.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.125+0000 7f931cc00640 1 -- 172.21.15.120:0/3716853417 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f93100eef00 con 0x7f93200c7480 2024-04-18T04:44:55.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.281+0000 7f9327a00640 1 -- 172.21.15.120:0/3716853417 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9320073e10 con 0x7f93200c7480 2024-04-18T04:44:55.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.285+0000 7f931cc00640 1 -- 172.21.15.120:0/3716853417 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f9310123090 con 0x7f93200c7480 2024-04-18T04:44:55.284 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:44:55.284 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":25,"fsid":"8e73592f-08e2-4957-a98f-9d044cec4ba5","created":"2024-04-18T04:44:06.139983+0000","modified":"2024-04-18T04:44:34.676253+0000","last_up_change":"2024-04-18T04:44:17.410146+0000","last_in_change":"2024-04-18T04:44:08.470250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T04:44:16.864728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T04:44:28.825773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T04:44:29.245857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-18T04:44:32.314302+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a80903bd-d9be-4fb9-af99-6125cb26bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":27468},{"type":"v1","addr":"172.21.15.120:6801","nonce":27468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":27468},{"type":"v1","addr":"172.21.15.120:6803","nonce":27468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":27468},{"type":"v1","addr":"172.21.15.120:6807","nonce":27468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":27468},{"type":"v1","addr":"172.21.15.120:6805","nonce":27468}]},"public_addr":"172.21.15.120:6801/27468","cluster_addr":"172.21.15.120:6803/27468","heartbeat_back_addr":"172.21.15.120:6807/27468","heartbeat_front_addr":"172.21.15.120:6805/27468","state":["exists","up"]},{"osd":1,"uuid":"8f5f004b-6870-4c78-8d50-9622e631ec25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":27470},{"type":"v1","addr":"172.21.15.120:6823","nonce":27470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":27470},{"type":"v1","addr":"172.21.15.120:6827","nonce":27470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":27470},{"type":"v1","addr":"172.21.15.120:6831","nonce":27470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":27470},{"type":"v1","addr":"172.21.15.120:6829","nonce":27470}]},"public_addr":"172.21.15.120:6823/27470","cluster_addr":"172.21.15.120:6827/27470","heartbeat_back_addr":"172.21.15.120:6831/27470","heartbeat_front_addr":"172.21.15.120:6829/27470","state":["exists","up"]},{"osd":2,"uuid":"6e228a2b-6103-4301-a8b5-ee81dbb1f920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":27471},{"type":"v1","addr":"172.21.15.120:6817","nonce":27471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":27471},{"type":"v1","addr":"172.21.15.120:6819","nonce":27471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":27471},{"type":"v1","addr":"172.21.15.120:6826","nonce":27471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":27471},{"type":"v1","addr":"172.21.15.120:6822","nonce":27471}]},"public_addr":"172.21.15.120:6817/27471","cluster_addr":"172.21.15.120:6819/27471","heartbeat_back_addr":"172.21.15.120:6826/27471","heartbeat_front_addr":"172.21.15.120:6822/27471","state":["exists","up"]},{"osd":3,"uuid":"7a5cabd7-d898-4e32-a03c-25b46e790134","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":27469},{"type":"v1","addr":"172.21.15.120:6809","nonce":27469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":27469},{"type":"v1","addr":"172.21.15.120:6811","nonce":27469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":27469},{"type":"v1","addr":"172.21.15.120:6815","nonce":27469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":27469},{"type":"v1","addr":"172.21.15.120:6813","nonce":27469}]},"public_addr":"172.21.15.120:6809/27469","cluster_addr":"172.21.15.120:6811/27469","heartbeat_back_addr":"172.21.15.120:6815/27469","heartbeat_front_addr":"172.21.15.120:6813/27469","state":["exists","up"]},{"osd":4,"uuid":"8e9f530f-6bab-4b23-a1a3-a71362fefcc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":28102},{"type":"v1","addr":"172.21.15.132:6825","nonce":28102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":28102},{"type":"v1","addr":"172.21.15.132:6827","nonce":28102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":28102},{"type":"v1","addr":"172.21.15.132:6831","nonce":28102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":28102},{"type":"v1","addr":"172.21.15.132:6829","nonce":28102}]},"public_addr":"172.21.15.132:6825/28102","cluster_addr":"172.21.15.132:6827/28102","heartbeat_back_addr":"172.21.15.132:6831/28102","heartbeat_front_addr":"172.21.15.132:6829/28102","state":["exists","up"]},{"osd":5,"uuid":"2243fabe-cc81-40cf-91bc-f106fe275a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":28104},{"type":"v1","addr":"172.21.15.132:6809","nonce":28104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":28104},{"type":"v1","addr":"172.21.15.132:6811","nonce":28104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":28104},{"type":"v1","addr":"172.21.15.132:6815","nonce":28104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":28104},{"type":"v1","addr":"172.21.15.132:6813","nonce":28104}]},"public_addr":"172.21.15.132:6809/28104","cluster_addr":"172.21.15.132:6811/28104","heartbeat_back_addr":"172.21.15.132:6815/28104","heartbeat_front_addr":"172.21.15.132:6813/28104","state":["exists","up"]},{"osd":6,"uuid":"c093a5ed-25c8-41a7-a20d-606a1a1661e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":28103},{"type":"v1","addr":"172.21.15.132:6801","nonce":28103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":28103},{"type":"v1","addr":"172.21.15.132:6803","nonce":28103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":28103},{"type":"v1","addr":"172.21.15.132:6807","nonce":28103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":28103},{"type":"v1","addr":"172.21.15.132:6805","nonce":28103}]},"public_addr":"172.21.15.132:6801/28103","cluster_addr":"172.21.15.132:6803/28103","heartbeat_back_addr":"172.21.15.132:6807/28103","heartbeat_front_addr":"172.21.15.132:6805/28103","state":["exists","up"]},{"osd":7,"uuid":"c37426b7-1080-4434-9f3e-a3afbbdc0fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":28129},{"type":"v1","addr":"172.21.15.132:6817","nonce":28129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":28129},{"type":"v1","addr":"172.21.15.132:6819","nonce":28129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":28129},{"type":"v1","addr":"172.21.15.132:6823","nonce":28129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":28129},{"type":"v1","addr":"172.21.15.132:6821","nonce":28129}]},"public_addr":"172.21.15.132:6817/28129","cluster_addr":"172.21.15.132:6819/28129","heartbeat_back_addr":"172.21.15.132:6823/28129","heartbeat_front_addr":"172.21.15.132:6821/28129","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.053825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.289753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.274645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.146361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.943883+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.701955+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.851076+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.800782+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T04:44:55.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.285+0000 7f9327a00640 1 -- 172.21.15.120:0/3716853417 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f93000666c0 msgr2=0x7f9300068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:55.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.285+0000 7f9327a00640 1 --2- 172.21.15.120:0/3716853417 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f93000666c0 0x7f9300068b80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f93201587e0 tx=0x7f930c007c10 comp rx=0 tx=0).stop 2024-04-18T04:44:55.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.285+0000 7f9327a00640 1 -- 172.21.15.120:0/3716853417 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93200c7480 msgr2=0x7f9320150d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:55.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.285+0000 7f9327a00640 1 --2- 172.21.15.120:0/3716853417 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93200c7480 0x7f9320150d20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f931001c8c0 tx=0x7f931001d4d0 comp rx=0 tx=0).stop 2024-04-18T04:44:55.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.285+0000 7f9327a00640 1 -- 172.21.15.120:0/3716853417 shutdown_connections 2024-04-18T04:44:55.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.285+0000 7f9327a00640 1 --2- 172.21.15.120:0/3716853417 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f93000666c0 0x7f9300068b80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:55.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.285+0000 7f9327a00640 1 --2- 172.21.15.120:0/3716853417 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9320152420 0x7f93201576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:55.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.285+0000 7f9327a00640 1 --2- 172.21.15.120:0/3716853417 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9320150340 0x7f93201553a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:55.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.285+0000 7f9327a00640 1 --2- 172.21.15.120:0/3716853417 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93200c7480 0x7f9320150d20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:55.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.285+0000 7f9327a00640 1 -- 172.21.15.120:0/3716853417 >> 172.21.15.120:0/3716853417 conn(0x7f93200c78c0 msgr2=0x7f9320071b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:55.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.285+0000 7f9327a00640 1 -- 172.21.15.120:0/3716853417 shutdown_connections 2024-04-18T04:44:55.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.285+0000 7f9327a00640 1 -- 172.21.15.120:0/3716853417 wait complete. 2024-04-18T04:44:55.306 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-18T04:44:55.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.445+0000 7f9c0bc00640 1 Processor -- start 2024-04-18T04:44:55.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.445+0000 7f9c0bc00640 1 -- start start 2024-04-18T04:44:55.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.445+0000 7f9c0bc00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9c04156d00 0x7f9c040714d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:55.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.445+0000 7f9c0bc00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9c04071a10 0x7f9c040c2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:55.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.445+0000 7f9c0bc00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c04070e50 con 0x7f9c04150620 2024-04-18T04:44:55.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.445+0000 7f9c0bc00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c04072720 con 0x7f9c04156d00 2024-04-18T04:44:55.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.445+0000 7f9c0bc00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c040c81c0 con 0x7f9c04071a10 2024-04-18T04:44:55.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.445+0000 7f9c03e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9c04156d00 0x7f9c040714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:55.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.445+0000 7f9c03e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9c04156d00 0x7f9c040714d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45900/0 (socket says 172.21.15.120:45900) 2024-04-18T04:44:55.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.445+0000 7f9c03e00640 1 -- 172.21.15.120:0/2269662143 learned_addr learned my addr 172.21.15.120:0/2269662143 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:55.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.445+0000 7f9c09c00640 1 --2- 172.21.15.120:0/2269662143 >> v2:172.21.15.132:3300/0 conn(0x7f9c04071a10 0x7f9c040c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:55.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.445+0000 7f9c03e00640 1 -- 172.21.15.120:0/2269662143 >> v2:172.21.15.132:3300/0 conn(0x7f9c04071a10 msgr2=0x7f9c040c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:55.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.445+0000 7f9c03e00640 1 --2- 172.21.15.120:0/2269662143 >> v2:172.21.15.132:3300/0 conn(0x7f9c04071a10 0x7f9c040c2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:55.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.445+0000 7f9c03e00640 1 -- 172.21.15.120:0/2269662143 >> v1:172.21.15.132:6789/0 conn(0x7f9c04150620 legacy=0x7f9c04072010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:55.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.445+0000 7f9c03e00640 1 -- 172.21.15.120:0/2269662143 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c040c7360 con 0x7f9c04156d00 2024-04-18T04:44:55.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.449+0000 7f9c03e00640 1 --2- 172.21.15.120:0/2269662143 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9c04156d00 0x7f9c040714d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9c0415a880 tx=0x7f9bf001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b13c67412456904 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:55.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.449+0000 7f9c03400640 1 -- 172.21.15.120:0/2269662143 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf00ac620 con 0x7f9c04156d00 2024-04-18T04:44:55.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.449+0000 7f9c03400640 1 -- 172.21.15.120:0/2269662143 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf00ac780 con 0x7f9c04156d00 2024-04-18T04:44:55.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.449+0000 7f9c03400640 1 -- 172.21.15.120:0/2269662143 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf00acb10 con 0x7f9c04156d00 2024-04-18T04:44:55.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.449+0000 7f9c0bc00640 1 -- 172.21.15.120:0/2269662143 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9c04156d00 msgr2=0x7f9c040714d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:55.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.449+0000 7f9c0bc00640 1 --2- 172.21.15.120:0/2269662143 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9c04156d00 0x7f9c040714d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9c0415a880 tx=0x7f9bf001c4b0 comp rx=0 tx=0).stop 2024-04-18T04:44:55.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.449+0000 7f9c0bc00640 1 -- 172.21.15.120:0/2269662143 shutdown_connections 2024-04-18T04:44:55.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.449+0000 7f9c0bc00640 1 --2- 172.21.15.120:0/2269662143 >> v2:172.21.15.132:3300/0 conn(0x7f9c04071a10 0x7f9c040c2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:55.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.449+0000 7f9c0bc00640 1 --2- 172.21.15.120:0/2269662143 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9c04156d00 0x7f9c040714d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:55.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.449+0000 7f9c0bc00640 1 -- 172.21.15.120:0/2269662143 >> 172.21.15.120:0/2269662143 conn(0x7f9c040cbfb0 msgr2=0x7f9c040cc3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:55.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.449+0000 7f9c0bc00640 1 -- 172.21.15.120:0/2269662143 shutdown_connections 2024-04-18T04:44:55.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.449+0000 7f9c0bc00640 1 -- 172.21.15.120:0/2269662143 wait complete. 2024-04-18T04:44:55.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.453+0000 7f9c0bc00640 1 Processor -- start 2024-04-18T04:44:55.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.453+0000 7f9c0bc00640 1 -- start start 2024-04-18T04:44:55.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.453+0000 7f9c0bc00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c04071a10 0x7f9c04150ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:55.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.453+0000 7f9c0bc00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9c04150620 0x7f9c04151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:55.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.453+0000 7f9c0bc00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9c04156d00 0x7f9c0406d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:55.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.453+0000 7f9c0bc00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c04154060 con 0x7f9c04156d00 2024-04-18T04:44:55.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.453+0000 7f9c0bc00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c040c3b20 con 0x7f9c04071a10 2024-04-18T04:44:55.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.453+0000 7f9c0bc00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c04154ba0 con 0x7f9c04150620 2024-04-18T04:44:55.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.453+0000 7f9c09c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9c04156d00 0x7f9c0406d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:55.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.453+0000 7f9c09c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9c04156d00 0x7f9c0406d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45906/0 (socket says 172.21.15.120:45906) 2024-04-18T04:44:55.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.453+0000 7f9c09c00640 1 -- 172.21.15.120:0/1172842452 learned_addr learned my addr 172.21.15.120:0/1172842452 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:55.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.453+0000 7f9c09200640 1 --2- 172.21.15.120:0/1172842452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c04071a10 0x7f9c04150ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:55.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.453+0000 7f9c03e00640 1 --2- 172.21.15.120:0/1172842452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9c04150620 0x7f9c04151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:55.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.453+0000 7f9c09c00640 1 -- 172.21.15.120:0/1172842452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9c04150620 msgr2=0x7f9c04151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:55.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.453+0000 7f9c09c00640 1 --2- 172.21.15.120:0/1172842452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9c04150620 0x7f9c04151e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:55.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.453+0000 7f9c09c00640 1 -- 172.21.15.120:0/1172842452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c04071a10 msgr2=0x7f9c04150ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:55.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.453+0000 7f9c09c00640 1 --2- 172.21.15.120:0/1172842452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c04071a10 0x7f9c04150ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:55.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.453+0000 7f9c09c00640 1 -- 172.21.15.120:0/1172842452 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf00094d0 con 0x7f9c04156d00 2024-04-18T04:44:55.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.453+0000 7f9c09c00640 1 --2- 172.21.15.120:0/1172842452 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9c04156d00 0x7f9c0406d500 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc007e90 tx=0x7f9bfc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:55.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.453+0000 7f9c00c00640 1 -- 172.21.15.120:0/1172842452 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc014420 con 0x7f9c04156d00 2024-04-18T04:44:55.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.453+0000 7f9c00c00640 1 -- 172.21.15.120:0/1172842452 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bfc014580 con 0x7f9c04156d00 2024-04-18T04:44:55.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.453+0000 7f9c00c00640 1 -- 172.21.15.120:0/1172842452 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc014930 con 0x7f9c04156d00 2024-04-18T04:44:55.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.453+0000 7f9c0bc00640 1 -- 172.21.15.120:0/1172842452 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c041511d0 con 0x7f9c04156d00 2024-04-18T04:44:55.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.453+0000 7f9c0bc00640 1 -- 172.21.15.120:0/1172842452 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c040c6cd0 con 0x7f9c04156d00 2024-04-18T04:44:55.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.457+0000 7f9c0bc00640 1 -- 172.21.15.120:0/1172842452 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c040729d0 con 0x7f9c04156d00 2024-04-18T04:44:55.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.457+0000 7f9c00c00640 1 -- 172.21.15.120:0/1172842452 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9bfc014a90 con 0x7f9c04156d00 2024-04-18T04:44:55.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.457+0000 7f9c00c00640 1 --2- 172.21.15.120:0/1172842452 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9be40666c0 0x7f9be4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:55.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.457+0000 7f9c00c00640 1 -- 172.21.15.120:0/1172842452 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9bfc084c60 con 0x7f9c04156d00 2024-04-18T04:44:55.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.457+0000 7f9c09200640 1 --2- 172.21.15.120:0/1172842452 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9be40666c0 0x7f9be4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:55.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.457+0000 7f9c09200640 1 --2- 172.21.15.120:0/1172842452 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9be40666c0 0x7f9be4068b80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9bf40098e0 tx=0x7f9bf4009060 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:55.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.461+0000 7f9c00c00640 1 -- 172.21.15.120:0/1172842452 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f9bfc051cf0 con 0x7f9c04156d00 2024-04-18T04:44:55.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.645+0000 7f9c0bc00640 1 -- 172.21.15.120:0/1172842452 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9c04154ce0 con 0x7f9c04156d00 2024-04-18T04:44:55.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.905+0000 7f9c00c00640 1 -- 172.21.15.120:0/1172842452 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9bfc055310 con 0x7f9c04156d00 2024-04-18T04:44:55.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.905+0000 7f9c0bc00640 1 -- 172.21.15.120:0/1172842452 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9be40666c0 msgr2=0x7f9be4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:55.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.905+0000 7f9c0bc00640 1 --2- 172.21.15.120:0/1172842452 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9be40666c0 0x7f9be4068b80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9bf40098e0 tx=0x7f9bf4009060 comp rx=0 tx=0).stop 2024-04-18T04:44:55.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.905+0000 7f9c0bc00640 1 -- 172.21.15.120:0/1172842452 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9c04156d00 msgr2=0x7f9c0406d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:55.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.905+0000 7f9c0bc00640 1 --2- 172.21.15.120:0/1172842452 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9c04156d00 0x7f9c0406d500 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc007e90 tx=0x7f9bfc00e4b0 comp rx=0 tx=0).stop 2024-04-18T04:44:55.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.905+0000 7f9c0bc00640 1 -- 172.21.15.120:0/1172842452 shutdown_connections 2024-04-18T04:44:55.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.905+0000 7f9c0bc00640 1 --2- 172.21.15.120:0/1172842452 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9be40666c0 0x7f9be4068b80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:55.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.905+0000 7f9c0bc00640 1 --2- 172.21.15.120:0/1172842452 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9c04156d00 0x7f9c0406d500 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:55.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.905+0000 7f9c0bc00640 1 --2- 172.21.15.120:0/1172842452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9c04150620 0x7f9c04151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:55.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.905+0000 7f9c0bc00640 1 --2- 172.21.15.120:0/1172842452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c04071a10 0x7f9c04150ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:55.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.905+0000 7f9c0bc00640 1 -- 172.21.15.120:0/1172842452 >> 172.21.15.120:0/1172842452 conn(0x7f9c040cbfb0 msgr2=0x7f9c04072010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:55.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.905+0000 7f9c0bc00640 1 -- 172.21.15.120:0/1172842452 shutdown_connections 2024-04-18T04:44:55.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:55.905+0000 7f9c0bc00640 1 -- 172.21.15.120:0/1172842452 wait complete. 2024-04-18T04:44:55.926 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300} 2024-04-18T04:44:55.926 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-04-18T04:44:56.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.065+0000 7f9365600640 1 Processor -- start 2024-04-18T04:44:56.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.065+0000 7f9365600640 1 -- start start 2024-04-18T04:44:56.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.065+0000 7f9365600640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f936014fc40 0x7f9360156610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:56.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.065+0000 7f9365600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9360150020 0x7f936006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:56.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.065+0000 7f9365600640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93600c6a90 con 0x7f93600c1270 2024-04-18T04:44:56.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.065+0000 7f9365600640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93600c0860 con 0x7f936014fc40 2024-04-18T04:44:56.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.065+0000 7f9365600640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936006d980 con 0x7f9360150020 2024-04-18T04:44:56.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.065+0000 7f935ea00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f936014fc40 0x7f9360156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:56.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.065+0000 7f935ea00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f936014fc40 0x7f9360156610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45914/0 (socket says 172.21.15.120:45914) 2024-04-18T04:44:56.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.065+0000 7f935ea00640 1 -- 172.21.15.120:0/3666948175 learned_addr learned my addr 172.21.15.120:0/3666948175 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:56.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.065+0000 7f9356000640 1 --2- 172.21.15.120:0/3666948175 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9360150020 0x7f936006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:56.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.065+0000 7f935ea00640 1 -- 172.21.15.120:0/3666948175 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9360150020 msgr2=0x7f936006d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:56.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.065+0000 7f935ea00640 1 --2- 172.21.15.120:0/3666948175 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9360150020 0x7f936006d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:56.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.065+0000 7f935ea00640 1 -- 172.21.15.120:0/3666948175 >> v1:172.21.15.132:6789/0 conn(0x7f93600c1270 legacy=0x7f93600c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:56.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.065+0000 7f935ea00640 1 -- 172.21.15.120:0/3666948175 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9360156b50 con 0x7f936014fc40 2024-04-18T04:44:56.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.065+0000 7f9356000640 1 --2- 172.21.15.120:0/3666948175 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9360150020 0x7f936006d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:44:56.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.069+0000 7f935ea00640 1 --2- 172.21.15.120:0/3666948175 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f936014fc40 0x7f9360156610 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9350006fd0 tx=0x7f93500211e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef51e92497fed9ab server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:56.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.069+0000 7f935e000640 1 -- 172.21.15.120:0/3666948175 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9350004030 con 0x7f936014fc40 2024-04-18T04:44:56.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.069+0000 7f935e000640 1 -- 172.21.15.120:0/3666948175 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93500ad030 con 0x7f936014fc40 2024-04-18T04:44:56.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.069+0000 7f935e000640 1 -- 172.21.15.120:0/3666948175 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9350004410 con 0x7f936014fc40 2024-04-18T04:44:56.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.069+0000 7f9365600640 1 -- 172.21.15.120:0/3666948175 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f936014fc40 msgr2=0x7f9360156610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:56.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.069+0000 7f9365600640 1 --2- 172.21.15.120:0/3666948175 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f936014fc40 0x7f9360156610 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9350006fd0 tx=0x7f93500211e0 comp rx=0 tx=0).stop 2024-04-18T04:44:56.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.069+0000 7f9365600640 1 -- 172.21.15.120:0/3666948175 shutdown_connections 2024-04-18T04:44:56.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.069+0000 7f9365600640 1 --2- 172.21.15.120:0/3666948175 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9360150020 0x7f936006d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:56.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.069+0000 7f9365600640 1 --2- 172.21.15.120:0/3666948175 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f936014fc40 0x7f9360156610 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:56.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.069+0000 7f9365600640 1 -- 172.21.15.120:0/3666948175 >> 172.21.15.120:0/3666948175 conn(0x7f936006b780 msgr2=0x7f936006bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:56.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.069+0000 7f9365600640 1 -- 172.21.15.120:0/3666948175 shutdown_connections 2024-04-18T04:44:56.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.069+0000 7f9365600640 1 -- 172.21.15.120:0/3666948175 wait complete. 2024-04-18T04:44:56.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.073+0000 7f9365600640 1 Processor -- start 2024-04-18T04:44:56.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.073+0000 7f9365600640 1 -- start start 2024-04-18T04:44:56.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.073+0000 7f9365600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f93600c1270 0x7f936014e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:56.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.073+0000 7f9365600640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f936014fc40 0x7f93601ef6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:56.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.073+0000 7f9365600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93601f3510 0x7f93601efc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:56.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.073+0000 7f9365600640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9360150b50 con 0x7f93601f3510 2024-04-18T04:44:56.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.073+0000 7f9365600640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936014a8a0 con 0x7f936014fc40 2024-04-18T04:44:56.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.073+0000 7f9365600640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93600aef00 con 0x7f93600c1270 2024-04-18T04:44:56.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.073+0000 7f935f400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93601f3510 0x7f93601efc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:56.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.073+0000 7f935f400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93601f3510 0x7f93601efc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45928/0 (socket says 172.21.15.120:45928) 2024-04-18T04:44:56.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.073+0000 7f935f400640 1 -- 172.21.15.120:0/1475988851 learned_addr learned my addr 172.21.15.120:0/1475988851 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:56.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.073+0000 7f935ea00640 1 --2- 172.21.15.120:0/1475988851 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f93600c1270 0x7f936014e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:56.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.073+0000 7f9356000640 1 --2- 172.21.15.120:0/1475988851 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f936014fc40 0x7f93601ef6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:56.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.073+0000 7f935f400640 1 -- 172.21.15.120:0/1475988851 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f93600c1270 msgr2=0x7f936014e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:56.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.073+0000 7f935f400640 1 --2- 172.21.15.120:0/1475988851 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f93600c1270 0x7f936014e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:56.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.073+0000 7f935f400640 1 -- 172.21.15.120:0/1475988851 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f936014fc40 msgr2=0x7f93601ef6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:56.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.073+0000 7f935f400640 1 --2- 172.21.15.120:0/1475988851 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f936014fc40 0x7f93601ef6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:56.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.073+0000 7f935f400640 1 -- 172.21.15.120:0/1475988851 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f935000b780 con 0x7f93601f3510 2024-04-18T04:44:56.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.073+0000 7f9356000640 1 --2- 172.21.15.120:0/1475988851 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f936014fc40 0x7f93601ef6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:44:56.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.073+0000 7f935f400640 1 --2- 172.21.15.120:0/1475988851 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93601f3510 0x7f93601efc20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f935800c770 tx=0x7f935800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:56.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.073+0000 7f9357400640 1 -- 172.21.15.120:0/1475988851 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9358003b80 con 0x7f93601f3510 2024-04-18T04:44:56.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.073+0000 7f9357400640 1 -- 172.21.15.120:0/1475988851 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9358003ce0 con 0x7f93601f3510 2024-04-18T04:44:56.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.073+0000 7f9357400640 1 -- 172.21.15.120:0/1475988851 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935800aa30 con 0x7f93601f3510 2024-04-18T04:44:56.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.073+0000 7f9365600640 1 -- 172.21.15.120:0/1475988851 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f936014ae20 con 0x7f93601f3510 2024-04-18T04:44:56.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.073+0000 7f9365600640 1 -- 172.21.15.120:0/1475988851 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93600af810 con 0x7f93601f3510 2024-04-18T04:44:56.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.077+0000 7f9365600640 1 -- 172.21.15.120:0/1475988851 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93600c1ef0 con 0x7f93601f3510 2024-04-18T04:44:56.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.077+0000 7f9357400640 1 -- 172.21.15.120:0/1475988851 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f935800ab90 con 0x7f93601f3510 2024-04-18T04:44:56.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.077+0000 7f9357400640 1 --2- 172.21.15.120:0/1475988851 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f933c0666c0 0x7f933c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:56.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.077+0000 7f9357400640 1 -- 172.21.15.120:0/1475988851 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9358084180 con 0x7f93601f3510 2024-04-18T04:44:56.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.077+0000 7f935ea00640 1 --2- 172.21.15.120:0/1475988851 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f933c0666c0 0x7f933c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:56.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.077+0000 7f935ea00640 1 --2- 172.21.15.120:0/1475988851 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f933c0666c0 0x7f933c068b80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f93500b4000 tx=0x7f93500ac000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:56.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.081+0000 7f9357400640 1 -- 172.21.15.120:0/1475988851 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f93580511f0 con 0x7f93601f3510 2024-04-18T04:44:56.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.273+0000 7f9365600640 1 -- 172.21.15.120:0/1475988851 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7f936014afb0 con 0x7f93601f3510 2024-04-18T04:44:56.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.917+0000 7f9357400640 1 -- 172.21.15.120:0/1475988851 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v9) v1 ==== 105+0+0 (secure 0 0 0) 0x7f9358054810 con 0x7f93601f3510 2024-04-18T04:44:56.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.921+0000 7f9365600640 1 -- 172.21.15.120:0/1475988851 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f933c0666c0 msgr2=0x7f933c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:56.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.921+0000 7f9365600640 1 --2- 172.21.15.120:0/1475988851 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f933c0666c0 0x7f933c068b80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f93500b4000 tx=0x7f93500ac000 comp rx=0 tx=0).stop 2024-04-18T04:44:56.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.921+0000 7f9365600640 1 -- 172.21.15.120:0/1475988851 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93601f3510 msgr2=0x7f93601efc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:56.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.921+0000 7f9365600640 1 --2- 172.21.15.120:0/1475988851 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93601f3510 0x7f93601efc20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f935800c770 tx=0x7f935800cc30 comp rx=0 tx=0).stop 2024-04-18T04:44:56.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.921+0000 7f9365600640 1 -- 172.21.15.120:0/1475988851 shutdown_connections 2024-04-18T04:44:56.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.921+0000 7f9365600640 1 --2- 172.21.15.120:0/1475988851 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f933c0666c0 0x7f933c068b80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:56.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.921+0000 7f9365600640 1 --2- 172.21.15.120:0/1475988851 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93601f3510 0x7f93601efc20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:56.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.921+0000 7f9365600640 1 --2- 172.21.15.120:0/1475988851 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f936014fc40 0x7f93601ef6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:56.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.921+0000 7f9365600640 1 --2- 172.21.15.120:0/1475988851 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f93600c1270 0x7f936014e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:56.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.921+0000 7f9365600640 1 -- 172.21.15.120:0/1475988851 >> 172.21.15.120:0/1475988851 conn(0x7f936006b780 msgr2=0x7f93600c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:56.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.921+0000 7f9365600640 1 -- 172.21.15.120:0/1475988851 shutdown_connections 2024-04-18T04:44:56.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:56.921+0000 7f9365600640 1 -- 172.21.15.120:0/1475988851 wait complete. 2024-04-18T04:44:56.943 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-18T04:44:57.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.085+0000 7fd338600640 1 Processor -- start 2024-04-18T04:44:57.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.085+0000 7fd338600640 1 -- start start 2024-04-18T04:44:57.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.085+0000 7fd338600640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd330153c70 0x7fd330070c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:57.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.085+0000 7fd338600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd330071160 0x7fd3300c6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:57.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.085+0000 7fd338600640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd330070790 con 0x7fd330153890 2024-04-18T04:44:57.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.085+0000 7fd338600640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd330071ae0 con 0x7fd330153c70 2024-04-18T04:44:57.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.085+0000 7fd338600640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd330159e90 con 0x7fd330071160 2024-04-18T04:44:57.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.085+0000 7fd335c00640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fd330153890 0x7fd3301596e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:58920/0 (socket says 172.21.15.120:58920) 2024-04-18T04:44:57.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.085+0000 7fd335c00640 1 -- 172.21.15.120:0/2566827862 learned_addr learned my addr 172.21.15.120:0/2566827862 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:44:57.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.085+0000 7fd336600640 1 --2- 172.21.15.120:0/2566827862 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd330071160 0x7fd3300c6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:57.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.085+0000 7fd335200640 1 --2- 172.21.15.120:0/2566827862 >> v2:172.21.15.132:3300/0 conn(0x7fd330153c70 0x7fd330070c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:57.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.085+0000 7fd32fe00640 1 -- 172.21.15.120:0/2566827862 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1452169980 0 0) 0x7fd330070790 con 0x7fd330153890 2024-04-18T04:44:57.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.085+0000 7fd32fe00640 1 -- 172.21.15.120:0/2566827862 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd318003530 con 0x7fd330153890 2024-04-18T04:44:57.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.085+0000 7fd32fe00640 1 -- 172.21.15.120:0/2566827862 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3164329187 0 0) 0x7fd318003530 con 0x7fd330153890 2024-04-18T04:44:57.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.085+0000 7fd32fe00640 1 -- 172.21.15.120:0/2566827862 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd330071160 msgr2=0x7fd3300c6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:57.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.085+0000 7fd32fe00640 1 --2- 172.21.15.120:0/2566827862 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd330071160 0x7fd3300c6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:57.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.085+0000 7fd32fe00640 1 -- 172.21.15.120:0/2566827862 >> v2:172.21.15.132:3300/0 conn(0x7fd330153c70 msgr2=0x7fd330070c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:57.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.085+0000 7fd32fe00640 1 --2- 172.21.15.120:0/2566827862 >> v2:172.21.15.132:3300/0 conn(0x7fd330153c70 0x7fd330070c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:57.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.085+0000 7fd32fe00640 1 -- 172.21.15.120:0/2566827862 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33015a130 con 0x7fd330153890 2024-04-18T04:44:57.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.085+0000 7fd32fe00640 1 -- 172.21.15.120:0/2566827862 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7fd324001680 con 0x7fd330153890 2024-04-18T04:44:57.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.085+0000 7fd32fe00640 1 -- 172.21.15.120:0/2566827862 >> v1:172.21.15.120:6789/0 conn(0x7fd330153890 legacy=0x7fd3301596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:57.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.085+0000 7fd32fe00640 1 --2- 172.21.15.120:0/2566827862 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd318003980 0x7fd318003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:57.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.085+0000 7fd32fe00640 1 --2- 172.21.15.120:0/2566827862 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd330071160 0x7fd3180047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:57.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.085+0000 7fd32fe00640 1 --2- 172.21.15.120:0/2566827862 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd318004d10 0x7fd318005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:57.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.085+0000 7fd32fe00640 1 -- 172.21.15.120:0/2566827862 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd330159e90 con 0x7fd318004d10 2024-04-18T04:44:57.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.085+0000 7fd32fe00640 1 -- 172.21.15.120:0/2566827862 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31800b990 con 0x7fd318003980 2024-04-18T04:44:57.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.085+0000 7fd32fe00640 1 -- 172.21.15.120:0/2566827862 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd31800bad0 con 0x7fd330071160 2024-04-18T04:44:57.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.085+0000 7fd336600640 1 --2- 172.21.15.120:0/2566827862 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd318004d10 0x7fd318005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:57.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.085+0000 7fd335200640 1 --2- 172.21.15.120:0/2566827862 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd330071160 0x7fd3180047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:57.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.085+0000 7fd335c00640 1 --2- 172.21.15.120:0/2566827862 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd318003980 0x7fd318003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:57.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.089+0000 7fd336600640 1 -- 172.21.15.120:0/2566827862 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd330071160 msgr2=0x7fd3180047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:57.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.089+0000 7fd336600640 1 --2- 172.21.15.120:0/2566827862 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd330071160 0x7fd3180047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:57.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.089+0000 7fd336600640 1 -- 172.21.15.120:0/2566827862 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd318003980 msgr2=0x7fd318003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:57.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.089+0000 7fd336600640 1 --2- 172.21.15.120:0/2566827862 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd318003980 0x7fd318003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:57.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.089+0000 7fd336600640 1 -- 172.21.15.120:0/2566827862 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd318003530 con 0x7fd318004d10 2024-04-18T04:44:57.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.089+0000 7fd336600640 1 --2- 172.21.15.120:0/2566827862 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd318004d10 0x7fd318005190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd328009fc0 tx=0x7fd32801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf7721c1eee0eb4 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:57.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.089+0000 7fd32fe00640 1 -- 172.21.15.120:0/2566827862 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3280a5c90 con 0x7fd318004d10 2024-04-18T04:44:57.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.089+0000 7fd32fe00640 1 -- 172.21.15.120:0/2566827862 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32800f040 con 0x7fd318004d10 2024-04-18T04:44:57.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.089+0000 7fd32fe00640 1 -- 172.21.15.120:0/2566827862 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3280ad440 con 0x7fd318004d10 2024-04-18T04:44:57.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.089+0000 7fd338600640 1 -- 172.21.15.120:0/2566827862 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd318004d10 msgr2=0x7fd318005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:57.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.089+0000 7fd338600640 1 --2- 172.21.15.120:0/2566827862 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd318004d10 0x7fd318005190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd328009fc0 tx=0x7fd32801cc80 comp rx=0 tx=0).stop 2024-04-18T04:44:57.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.089+0000 7fd336600640 1 -- 172.21.15.120:0/2566827862 reap_dead start 2024-04-18T04:44:57.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.089+0000 7fd338600640 1 -- 172.21.15.120:0/2566827862 shutdown_connections 2024-04-18T04:44:57.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.089+0000 7fd338600640 1 -- 172.21.15.120:0/2566827862 >> 172.21.15.120:0/2566827862 conn(0x7fd330066a50 msgr2=0x7fd330069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:57.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.089+0000 7fd338600640 1 -- 172.21.15.120:0/2566827862 shutdown_connections 2024-04-18T04:44:57.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.089+0000 7fd338600640 1 -- 172.21.15.120:0/2566827862 wait complete. 2024-04-18T04:44:57.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.093+0000 7fd338600640 1 Processor -- start 2024-04-18T04:44:57.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.093+0000 7fd338600640 1 -- start start 2024-04-18T04:44:57.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.093+0000 7fd338600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd318004d10 0x7fd3301550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:57.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.093+0000 7fd338600640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd33014e770 0x7fd3301f21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:57.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.093+0000 7fd338600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd33014d1c0 0x7fd33015baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:57.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.093+0000 7fd338600640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd330070e50 con 0x7fd33014d1c0 2024-04-18T04:44:57.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.093+0000 7fd338600640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3301f1d10 con 0x7fd33014e770 2024-04-18T04:44:57.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.093+0000 7fd338600640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3301f1700 con 0x7fd318004d10 2024-04-18T04:44:57.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.093+0000 7fd336600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd33014d1c0 0x7fd33015baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:57.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.093+0000 7fd336600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd33014d1c0 0x7fd33015baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45954/0 (socket says 172.21.15.120:45954) 2024-04-18T04:44:57.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.093+0000 7fd336600640 1 -- 172.21.15.120:0/2474043666 learned_addr learned my addr 172.21.15.120:0/2474043666 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:57.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.093+0000 7fd335200640 1 --2- 172.21.15.120:0/2474043666 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd33014e770 0x7fd3301f21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:57.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.093+0000 7fd335c00640 1 --2- 172.21.15.120:0/2474043666 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd318004d10 0x7fd3301550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:57.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.093+0000 7fd336600640 1 -- 172.21.15.120:0/2474043666 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd318004d10 msgr2=0x7fd3301550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:57.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.093+0000 7fd336600640 1 --2- 172.21.15.120:0/2474043666 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd318004d10 0x7fd3301550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:57.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.093+0000 7fd336600640 1 -- 172.21.15.120:0/2474043666 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd33014e770 msgr2=0x7fd3301f21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:57.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.093+0000 7fd336600640 1 --2- 172.21.15.120:0/2474043666 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd33014e770 0x7fd3301f21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:57.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.093+0000 7fd336600640 1 -- 172.21.15.120:0/2474043666 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3301eed10 con 0x7fd33014d1c0 2024-04-18T04:44:57.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.093+0000 7fd335c00640 1 --2- 172.21.15.120:0/2474043666 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd318004d10 0x7fd3301550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:44:57.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.093+0000 7fd336600640 1 --2- 172.21.15.120:0/2474043666 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd33014d1c0 0x7fd33015baa0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd328002240 tx=0x7fd328009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:57.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.093+0000 7fd32d600640 1 -- 172.21.15.120:0/2474043666 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3280039a0 con 0x7fd33014d1c0 2024-04-18T04:44:57.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.093+0000 7fd32d600640 1 -- 172.21.15.120:0/2474043666 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd328003b00 con 0x7fd33014d1c0 2024-04-18T04:44:57.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.093+0000 7fd32d600640 1 -- 172.21.15.120:0/2474043666 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd328003e90 con 0x7fd33014d1c0 2024-04-18T04:44:57.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.093+0000 7fd338600640 1 -- 172.21.15.120:0/2474043666 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3301f19a0 con 0x7fd33014d1c0 2024-04-18T04:44:57.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.093+0000 7fd338600640 1 -- 172.21.15.120:0/2474043666 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3300ca2a0 con 0x7fd33014d1c0 2024-04-18T04:44:57.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.097+0000 7fd338600640 1 -- 172.21.15.120:0/2474043666 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3301f1b30 con 0x7fd33014d1c0 2024-04-18T04:44:57.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.097+0000 7fd32d600640 1 -- 172.21.15.120:0/2474043666 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd3280b4040 con 0x7fd33014d1c0 2024-04-18T04:44:57.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.097+0000 7fd32d600640 1 --2- 172.21.15.120:0/2474043666 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd3100666c0 0x7fd310068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:57.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.097+0000 7fd32d600640 1 -- 172.21.15.120:0/2474043666 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd32811e160 con 0x7fd33014d1c0 2024-04-18T04:44:57.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.097+0000 7fd335c00640 1 --2- 172.21.15.120:0/2474043666 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd3100666c0 0x7fd310068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:57.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.097+0000 7fd335c00640 1 --2- 172.21.15.120:0/2474043666 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd3100666c0 0x7fd310068b80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd324001ec0 tx=0x7fd324009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:57.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.101+0000 7fd32d600640 1 -- 172.21.15.120:0/2474043666 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fd3280eb160 con 0x7fd33014d1c0 2024-04-18T04:44:57.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.289+0000 7fd338600640 1 -- 172.21.15.120:0/2474043666 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd3300729d0 con 0x7fd33014d1c0 2024-04-18T04:44:57.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.925+0000 7fd32d600640 1 -- 172.21.15.120:0/2474043666 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v11) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd3280be0c0 con 0x7fd33014d1c0 2024-04-18T04:44:57.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.929+0000 7fd338600640 1 -- 172.21.15.120:0/2474043666 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd3100666c0 msgr2=0x7fd310068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:57.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.929+0000 7fd338600640 1 --2- 172.21.15.120:0/2474043666 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd3100666c0 0x7fd310068b80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd324001ec0 tx=0x7fd324009040 comp rx=0 tx=0).stop 2024-04-18T04:44:57.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.929+0000 7fd338600640 1 -- 172.21.15.120:0/2474043666 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd33014d1c0 msgr2=0x7fd33015baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:57.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.929+0000 7fd338600640 1 --2- 172.21.15.120:0/2474043666 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd33014d1c0 0x7fd33015baa0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd328002240 tx=0x7fd328009750 comp rx=0 tx=0).stop 2024-04-18T04:44:57.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.929+0000 7fd338600640 1 -- 172.21.15.120:0/2474043666 shutdown_connections 2024-04-18T04:44:57.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.929+0000 7fd338600640 1 --2- 172.21.15.120:0/2474043666 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd3100666c0 0x7fd310068b80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:57.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.929+0000 7fd338600640 1 --2- 172.21.15.120:0/2474043666 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd33014d1c0 0x7fd33015baa0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:57.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.929+0000 7fd338600640 1 --2- 172.21.15.120:0/2474043666 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd33014e770 0x7fd3301f21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:57.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.929+0000 7fd338600640 1 --2- 172.21.15.120:0/2474043666 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd318004d10 0x7fd3301550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:57.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.929+0000 7fd338600640 1 -- 172.21.15.120:0/2474043666 >> 172.21.15.120:0/2474043666 conn(0x7fd330066a50 msgr2=0x7fd3300cb540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:57.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.929+0000 7fd338600640 1 -- 172.21.15.120:0/2474043666 shutdown_connections 2024-04-18T04:44:57.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:57.929+0000 7fd338600640 1 -- 172.21.15.120:0/2474043666 wait complete. 2024-04-18T04:44:57.951 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-04-18T04:44:58.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.093+0000 7f5a79c00640 1 Processor -- start 2024-04-18T04:44:58.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.093+0000 7f5a79c00640 1 -- start start 2024-04-18T04:44:58.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.093+0000 7f5a79c00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5a740c1fe0 0x7f5a74157db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:58.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.093+0000 7f5a79c00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f5a740c3ef0 0x7f5a740c23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:58.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.093+0000 7f5a79c00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a74157920 con 0x7f5a740c79c0 2024-04-18T04:44:58.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.093+0000 7f5a79c00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a741582f0 con 0x7f5a740c3ef0 2024-04-18T04:44:58.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.093+0000 7f5a79c00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a740c2900 con 0x7f5a740c1fe0 2024-04-18T04:44:58.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.093+0000 7f5a73400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f5a740c3ef0 0x7f5a740c23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:58.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.093+0000 7f5a6a000640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f5a740c79c0 0x7f5a7415a920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:58934/0 (socket says 172.21.15.120:58934) 2024-04-18T04:44:58.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.093+0000 7f5a6a000640 1 -- 172.21.15.120:0/1000515532 learned_addr learned my addr 172.21.15.120:0/1000515532 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:44:58.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.097+0000 7f5a72a00640 1 --2- 172.21.15.120:0/1000515532 >> v2:172.21.15.132:3300/0 conn(0x7f5a740c1fe0 0x7f5a74157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:58.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.097+0000 7f5a73400640 1 -- 172.21.15.120:0/1000515532 >> v2:172.21.15.132:3300/0 conn(0x7f5a740c1fe0 msgr2=0x7f5a74157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:58.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.097+0000 7f5a73400640 1 --2- 172.21.15.120:0/1000515532 >> v2:172.21.15.132:3300/0 conn(0x7f5a740c1fe0 0x7f5a74157db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:58.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.097+0000 7f5a73400640 1 -- 172.21.15.120:0/1000515532 >> v1:172.21.15.120:6789/0 conn(0x7f5a740c79c0 legacy=0x7f5a7415a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:58.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.097+0000 7f5a73400640 1 -- 172.21.15.120:0/1000515532 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a7406e9a0 con 0x7f5a740c3ef0 2024-04-18T04:44:58.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.097+0000 7f5a72000640 1 -- 172.21.15.120:0/1000515532 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1603326340 0 0) 0x7f5a74157920 con 0x7f5a740c79c0 2024-04-18T04:44:58.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.097+0000 7f5a73400640 1 --2- 172.21.15.120:0/1000515532 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a740c3ef0 0x7f5a740c23c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5a740cdc90 tx=0x7f5a6c01f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2514ebe36cc24399 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:58.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.097+0000 7f5a72000640 1 -- 172.21.15.120:0/1000515532 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c0af600 con 0x7f5a740c3ef0 2024-04-18T04:44:58.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.097+0000 7f5a72000640 1 -- 172.21.15.120:0/1000515532 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6c0ab050 con 0x7f5a740c3ef0 2024-04-18T04:44:58.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.097+0000 7f5a72000640 1 -- 172.21.15.120:0/1000515532 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c0af980 con 0x7f5a740c3ef0 2024-04-18T04:44:58.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.097+0000 7f5a79c00640 1 -- 172.21.15.120:0/1000515532 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a740c3ef0 msgr2=0x7f5a740c23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:58.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.097+0000 7f5a79c00640 1 --2- 172.21.15.120:0/1000515532 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a740c3ef0 0x7f5a740c23c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5a740cdc90 tx=0x7f5a6c01f110 comp rx=0 tx=0).stop 2024-04-18T04:44:58.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.101+0000 7f5a79c00640 1 -- 172.21.15.120:0/1000515532 shutdown_connections 2024-04-18T04:44:58.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.101+0000 7f5a79c00640 1 --2- 172.21.15.120:0/1000515532 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a740c3ef0 0x7f5a740c23c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:58.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.101+0000 7f5a79c00640 1 --2- 172.21.15.120:0/1000515532 >> v2:172.21.15.132:3300/0 conn(0x7f5a740c1fe0 0x7f5a74157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:58.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.101+0000 7f5a79c00640 1 -- 172.21.15.120:0/1000515532 >> 172.21.15.120:0/1000515532 conn(0x7f5a74072190 msgr2=0x7f5a74065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:58.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.101+0000 7f5a79c00640 1 -- 172.21.15.120:0/1000515532 shutdown_connections 2024-04-18T04:44:58.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.101+0000 7f5a79c00640 1 -- 172.21.15.120:0/1000515532 wait complete. 2024-04-18T04:44:58.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.101+0000 7f5a79c00640 1 Processor -- start 2024-04-18T04:44:58.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.101+0000 7f5a79c00640 1 -- start start 2024-04-18T04:44:58.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.101+0000 7f5a79c00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5a740c1fe0 0x7f5a74146cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:58.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.101+0000 7f5a79c00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a740c3ef0 0x7f5a741ec3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:58.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.101+0000 7f5a79c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a740c79c0 0x7f5a7414b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:58.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.101+0000 7f5a79c00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a741471f0 con 0x7f5a740c79c0 2024-04-18T04:44:58.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.101+0000 7f5a79c00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a740cadc0 con 0x7f5a740c3ef0 2024-04-18T04:44:58.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.101+0000 7f5a79c00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a740c55a0 con 0x7f5a740c1fe0 2024-04-18T04:44:58.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.101+0000 7f5a73400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a740c79c0 0x7f5a7414b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:58.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.101+0000 7f5a73400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a740c79c0 0x7f5a7414b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45964/0 (socket says 172.21.15.120:45964) 2024-04-18T04:44:58.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.101+0000 7f5a73400640 1 -- 172.21.15.120:0/873562930 learned_addr learned my addr 172.21.15.120:0/873562930 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:58.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.101+0000 7f5a6a000640 1 --2- 172.21.15.120:0/873562930 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a740c3ef0 0x7f5a741ec3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:58.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.101+0000 7f5a72a00640 1 --2- 172.21.15.120:0/873562930 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5a740c1fe0 0x7f5a74146cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:58.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.101+0000 7f5a73400640 1 -- 172.21.15.120:0/873562930 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5a740c1fe0 msgr2=0x7f5a74146cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:58.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.101+0000 7f5a73400640 1 --2- 172.21.15.120:0/873562930 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5a740c1fe0 0x7f5a74146cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:58.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.101+0000 7f5a73400640 1 -- 172.21.15.120:0/873562930 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a740c3ef0 msgr2=0x7f5a741ec3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:58.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.101+0000 7f5a73400640 1 --2- 172.21.15.120:0/873562930 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a740c3ef0 0x7f5a741ec3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:58.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.101+0000 7f5a73400640 1 -- 172.21.15.120:0/873562930 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a6c009a70 con 0x7f5a740c79c0 2024-04-18T04:44:58.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.101+0000 7f5a73400640 1 --2- 172.21.15.120:0/873562930 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a740c79c0 0x7f5a7414b9b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c0b2040 tx=0x7f5a6c01beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:58.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.101+0000 7f5a6b400640 1 -- 172.21.15.120:0/873562930 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c009450 con 0x7f5a740c79c0 2024-04-18T04:44:58.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.105+0000 7f5a6b400640 1 -- 172.21.15.120:0/873562930 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6c0b9410 con 0x7f5a740c79c0 2024-04-18T04:44:58.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.105+0000 7f5a6b400640 1 -- 172.21.15.120:0/873562930 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c0b97c0 con 0x7f5a740c79c0 2024-04-18T04:44:58.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.105+0000 7f5a79c00640 1 -- 172.21.15.120:0/873562930 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a740cb020 con 0x7f5a740c79c0 2024-04-18T04:44:58.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.105+0000 7f5a79c00640 1 -- 172.21.15.120:0/873562930 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a740cb5e0 con 0x7f5a740c79c0 2024-04-18T04:44:58.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.105+0000 7f5a79c00640 1 -- 172.21.15.120:0/873562930 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a74067590 con 0x7f5a740c79c0 2024-04-18T04:44:58.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.105+0000 7f5a6b400640 1 -- 172.21.15.120:0/873562930 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5a6c0b6050 con 0x7f5a740c79c0 2024-04-18T04:44:58.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.105+0000 7f5a6b400640 1 --2- 172.21.15.120:0/873562930 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f5a50066690 0x7f5a50068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:58.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.105+0000 7f5a6b400640 1 -- 172.21.15.120:0/873562930 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5a6c1229c0 con 0x7f5a740c79c0 2024-04-18T04:44:58.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.105+0000 7f5a72a00640 1 --2- 172.21.15.120:0/873562930 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f5a50066690 0x7f5a50068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:58.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.109+0000 7f5a72a00640 1 --2- 172.21.15.120:0/873562930 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f5a50066690 0x7f5a50068b50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5a64009af0 tx=0x7f5a64008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:58.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.109+0000 7f5a6b400640 1 -- 172.21.15.120:0/873562930 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f5a6c0ef9a0 con 0x7f5a740c79c0 2024-04-18T04:44:58.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.297+0000 7f5a79c00640 1 -- 172.21.15.120:0/873562930 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f5a740729d0 con 0x7f5a740c79c0 2024-04-18T04:44:58.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.937+0000 7f5a6b400640 1 -- 172.21.15.120:0/873562930 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v12) v1 ==== 115+0+0 (secure 0 0 0) 0x7f5a6c0b40b0 con 0x7f5a740c79c0 2024-04-18T04:44:58.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.937+0000 7f5a79c00640 1 -- 172.21.15.120:0/873562930 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f5a50066690 msgr2=0x7f5a50068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:58.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.937+0000 7f5a79c00640 1 --2- 172.21.15.120:0/873562930 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f5a50066690 0x7f5a50068b50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5a64009af0 tx=0x7f5a64008040 comp rx=0 tx=0).stop 2024-04-18T04:44:58.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.937+0000 7f5a79c00640 1 -- 172.21.15.120:0/873562930 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a740c79c0 msgr2=0x7f5a7414b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:58.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.937+0000 7f5a79c00640 1 --2- 172.21.15.120:0/873562930 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a740c79c0 0x7f5a7414b9b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c0b2040 tx=0x7f5a6c01beb0 comp rx=0 tx=0).stop 2024-04-18T04:44:58.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.937+0000 7f5a79c00640 1 -- 172.21.15.120:0/873562930 shutdown_connections 2024-04-18T04:44:58.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.937+0000 7f5a79c00640 1 --2- 172.21.15.120:0/873562930 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f5a50066690 0x7f5a50068b50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:58.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.937+0000 7f5a79c00640 1 --2- 172.21.15.120:0/873562930 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a740c79c0 0x7f5a7414b9b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:58.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.937+0000 7f5a79c00640 1 --2- 172.21.15.120:0/873562930 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a740c3ef0 0x7f5a741ec3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:58.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.937+0000 7f5a79c00640 1 --2- 172.21.15.120:0/873562930 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5a740c1fe0 0x7f5a74146cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:58.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.937+0000 7f5a79c00640 1 -- 172.21.15.120:0/873562930 >> 172.21.15.120:0/873562930 conn(0x7f5a74072190 msgr2=0x7f5a74065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:58.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.937+0000 7f5a79c00640 1 -- 172.21.15.120:0/873562930 shutdown_connections 2024-04-18T04:44:58.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:58.937+0000 7f5a79c00640 1 -- 172.21.15.120:0/873562930 wait complete. 2024-04-18T04:44:58.960 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-18T04:44:58.960 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:44:59.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.097+0000 7f6c8f600640 1 Processor -- start 2024-04-18T04:44:59.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.097+0000 7f6c8f600640 1 -- start start 2024-04-18T04:44:59.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.097+0000 7f6c8f600640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6c8806a120 0x7f6c8806c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:59.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.097+0000 7f6c8f600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c88153890 0x7f6c8806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:59.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.097+0000 7f6c8f600640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c880c7830 con 0x7f6c8806a500 2024-04-18T04:44:59.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.097+0000 7f6c8f600640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c8806c070 con 0x7f6c8806a120 2024-04-18T04:44:59.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.097+0000 7f6c8f600640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c881599d0 con 0x7f6c88153890 2024-04-18T04:44:59.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.101+0000 7f6c8cc00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6c8806a120 0x7f6c8806c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:59.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.101+0000 7f6c8cc00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6c8806a120 0x7f6c8806c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45974/0 (socket says 172.21.15.120:45974) 2024-04-18T04:44:59.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.101+0000 7f6c8cc00640 1 -- 172.21.15.120:0/4197709600 learned_addr learned my addr 172.21.15.120:0/4197709600 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:59.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.101+0000 7f6c8d600640 1 --2- 172.21.15.120:0/4197709600 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c88153890 0x7f6c8806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:59.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.101+0000 7f6c8cc00640 1 -- 172.21.15.120:0/4197709600 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c88153890 msgr2=0x7f6c8806ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:59.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.101+0000 7f6c8cc00640 1 --2- 172.21.15.120:0/4197709600 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c88153890 0x7f6c8806ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:59.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.101+0000 7f6c8cc00640 1 -- 172.21.15.120:0/4197709600 >> v1:172.21.15.132:6789/0 conn(0x7f6c8806a500 legacy=0x7f6c88153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:59.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.101+0000 7f6c8cc00640 1 -- 172.21.15.120:0/4197709600 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c88159cb0 con 0x7f6c8806a120 2024-04-18T04:44:59.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.101+0000 7f6c8cc00640 1 --2- 172.21.15.120:0/4197709600 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c8806a120 0x7f6c8806c500 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6c78009870 tx=0x7f6c7801ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=364dd0678423ef6b server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:59.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.101+0000 7f6c87e00640 1 -- 172.21.15.120:0/4197709600 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c780a8a50 con 0x7f6c8806a120 2024-04-18T04:44:59.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.101+0000 7f6c87e00640 1 -- 172.21.15.120:0/4197709600 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c780a8bb0 con 0x7f6c8806a120 2024-04-18T04:44:59.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.101+0000 7f6c87e00640 1 -- 172.21.15.120:0/4197709600 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c780b0440 con 0x7f6c8806a120 2024-04-18T04:44:59.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.105+0000 7f6c8f600640 1 -- 172.21.15.120:0/4197709600 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c8806a120 msgr2=0x7f6c8806c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:59.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.105+0000 7f6c8f600640 1 --2- 172.21.15.120:0/4197709600 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c8806a120 0x7f6c8806c500 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6c78009870 tx=0x7f6c7801ed50 comp rx=0 tx=0).stop 2024-04-18T04:44:59.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.105+0000 7f6c8f600640 1 -- 172.21.15.120:0/4197709600 shutdown_connections 2024-04-18T04:44:59.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.105+0000 7f6c8f600640 1 --2- 172.21.15.120:0/4197709600 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c88153890 0x7f6c8806ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:59.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.105+0000 7f6c8f600640 1 --2- 172.21.15.120:0/4197709600 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c8806a120 0x7f6c8806c500 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:59.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.105+0000 7f6c8f600640 1 -- 172.21.15.120:0/4197709600 >> 172.21.15.120:0/4197709600 conn(0x7f6c880c8a40 msgr2=0x7f6c880c8e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:59.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.105+0000 7f6c8f600640 1 -- 172.21.15.120:0/4197709600 shutdown_connections 2024-04-18T04:44:59.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.105+0000 7f6c8f600640 1 -- 172.21.15.120:0/4197709600 wait complete. 2024-04-18T04:44:59.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.105+0000 7f6c8f600640 1 Processor -- start 2024-04-18T04:44:59.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.105+0000 7f6c8f600640 1 -- start start 2024-04-18T04:44:59.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.105+0000 7f6c8f600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c8806a120 0x7f6c88147710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:59.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.105+0000 7f6c8f600640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c8806a500 0x7f6c8814fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:59.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.105+0000 7f6c8f600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c88153890 0x7f6c88150330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:59.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.105+0000 7f6c8f600640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8814a070 con 0x7f6c88153890 2024-04-18T04:44:59.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.105+0000 7f6c8f600640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c881497a0 con 0x7f6c8806a500 2024-04-18T04:44:59.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.105+0000 7f6c8f600640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8815d910 con 0x7f6c8806a120 2024-04-18T04:44:59.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.105+0000 7f6c8d600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c88153890 0x7f6c88150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:59.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.105+0000 7f6c8d600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c88153890 0x7f6c88150330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45988/0 (socket says 172.21.15.120:45988) 2024-04-18T04:44:59.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.105+0000 7f6c8d600640 1 -- 172.21.15.120:0/1121776922 learned_addr learned my addr 172.21.15.120:0/1121776922 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:59.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.105+0000 7f6c8cc00640 1 --2- 172.21.15.120:0/1121776922 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c8806a120 0x7f6c88147710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:59.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.105+0000 7f6c7fe00640 1 --2- 172.21.15.120:0/1121776922 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c8806a500 0x7f6c8814fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:59.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.105+0000 7f6c8d600640 1 -- 172.21.15.120:0/1121776922 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c8806a120 msgr2=0x7f6c88147710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:59.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.105+0000 7f6c8d600640 1 --2- 172.21.15.120:0/1121776922 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c8806a120 0x7f6c88147710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:59.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.105+0000 7f6c8d600640 1 -- 172.21.15.120:0/1121776922 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c8806a500 msgr2=0x7f6c8814fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:59.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.105+0000 7f6c8d600640 1 --2- 172.21.15.120:0/1121776922 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c8806a500 0x7f6c8814fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:59.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.105+0000 7f6c8d600640 1 -- 172.21.15.120:0/1121776922 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c780094d0 con 0x7f6c88153890 2024-04-18T04:44:59.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.109+0000 7f6c8d600640 1 --2- 172.21.15.120:0/1121776922 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c88153890 0x7f6c88150330 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6c80007e90 tx=0x7f6c8000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:59.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.109+0000 7f6c85600640 1 -- 172.21.15.120:0/1121776922 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c80014420 con 0x7f6c88153890 2024-04-18T04:44:59.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.109+0000 7f6c85600640 1 -- 172.21.15.120:0/1121776922 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c80014580 con 0x7f6c88153890 2024-04-18T04:44:59.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.109+0000 7f6c8f600640 1 -- 172.21.15.120:0/1121776922 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c88147c50 con 0x7f6c88153890 2024-04-18T04:44:59.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.109+0000 7f6c85600640 1 -- 172.21.15.120:0/1121776922 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c80014930 con 0x7f6c88153890 2024-04-18T04:44:59.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.109+0000 7f6c8f600640 1 -- 172.21.15.120:0/1121776922 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c88147470 con 0x7f6c88153890 2024-04-18T04:44:59.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.109+0000 7f6c8f600640 1 -- 172.21.15.120:0/1121776922 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c8814a1b0 con 0x7f6c88153890 2024-04-18T04:44:59.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.109+0000 7f6c85600640 1 -- 172.21.15.120:0/1121776922 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6c80014a90 con 0x7f6c88153890 2024-04-18T04:44:59.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.109+0000 7f6c85600640 1 --2- 172.21.15.120:0/1121776922 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6c64066690 0x7f6c64068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:59.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.109+0000 7f6c85600640 1 -- 172.21.15.120:0/1121776922 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6c80084ca0 con 0x7f6c88153890 2024-04-18T04:44:59.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.109+0000 7f6c8cc00640 1 --2- 172.21.15.120:0/1121776922 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6c64066690 0x7f6c64068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:59.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.113+0000 7f6c8cc00640 1 --2- 172.21.15.120:0/1121776922 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6c64066690 0x7f6c64068b50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6c780b2000 tx=0x7f6c78008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:59.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.113+0000 7f6c85600640 1 -- 172.21.15.120:0/1121776922 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f6c8814a1b0 con 0x7f6c88153890 2024-04-18T04:44:59.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.301+0000 7f6c8f600640 1 -- 172.21.15.120:0/1121776922 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c88147470 con 0x7f6c88153890 2024-04-18T04:44:59.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.301+0000 7f6c85600640 1 -- 172.21.15.120:0/1121776922 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+6274 (secure 0 0 0) 0x7f6c88147470 con 0x7f6c88153890 2024-04-18T04:44:59.302 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:44:59.302 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/1552155328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1552155328},{"type":"v1","addr":"172.21.15.132:6835","nonce":1552155328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6833/2564667113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2564667113},{"type":"v1","addr":"172.21.15.120:6833","nonce":2564667113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:44:58.927993+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1],"up":{"mds_0":4288,"mds_1":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:creating","state_seq":1,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:44:59.304 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 12 2024-04-18T04:44:59.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.305+0000 7f6c8f600640 1 -- 172.21.15.120:0/1121776922 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6c64066690 msgr2=0x7f6c64068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:59.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.305+0000 7f6c8f600640 1 --2- 172.21.15.120:0/1121776922 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6c64066690 0x7f6c64068b50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6c780b2000 tx=0x7f6c78008040 comp rx=0 tx=0).stop 2024-04-18T04:44:59.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.305+0000 7f6c8f600640 1 -- 172.21.15.120:0/1121776922 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c88153890 msgr2=0x7f6c88150330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:59.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.305+0000 7f6c8f600640 1 --2- 172.21.15.120:0/1121776922 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c88153890 0x7f6c88150330 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6c80007e90 tx=0x7f6c8000e4b0 comp rx=0 tx=0).stop 2024-04-18T04:44:59.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.305+0000 7f6c8f600640 1 -- 172.21.15.120:0/1121776922 shutdown_connections 2024-04-18T04:44:59.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.305+0000 7f6c8f600640 1 --2- 172.21.15.120:0/1121776922 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6c64066690 0x7f6c64068b50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:59.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.305+0000 7f6c8f600640 1 --2- 172.21.15.120:0/1121776922 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c88153890 0x7f6c88150330 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:59.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.305+0000 7f6c8f600640 1 --2- 172.21.15.120:0/1121776922 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c8806a500 0x7f6c8814fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:59.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.305+0000 7f6c8f600640 1 --2- 172.21.15.120:0/1121776922 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c8806a120 0x7f6c88147710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:59.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.305+0000 7f6c8f600640 1 -- 172.21.15.120:0/1121776922 >> 172.21.15.120:0/1121776922 conn(0x7f6c880c8a40 msgr2=0x7f6c880c6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:59.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.305+0000 7f6c8f600640 1 -- 172.21.15.120:0/1121776922 shutdown_connections 2024-04-18T04:44:59.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.305+0000 7f6c8f600640 1 -- 172.21.15.120:0/1121776922 wait complete. 2024-04-18T04:44:59.322 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T04:44:59.441 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:44:59.444 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:44:59.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.457+0000 7f9590400640 1 Processor -- start 2024-04-18T04:44:59.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.457+0000 7f9590400640 1 -- start start 2024-04-18T04:44:59.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.461+0000 7f9590400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f958815d7a0 0x7f958806fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:59.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.461+0000 7f9590400640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95880703b0 con 0x7f95880c8850 2024-04-18T04:44:59.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.461+0000 7f9590400640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95880c9520 con 0x7f9588153830 2024-04-18T04:44:59.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.461+0000 7f9590400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95880c4200 con 0x7f958815d7a0 2024-04-18T04:44:59.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.461+0000 7f958d000640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f95880c8850 0x7f958815d090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:58940/0 (socket says 172.21.15.120:58940) 2024-04-18T04:44:59.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.461+0000 7f958d000640 1 -- 172.21.15.120:0/2072677806 learned_addr learned my addr 172.21.15.120:0/2072677806 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:44:59.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.461+0000 7f958e400640 1 --2- 172.21.15.120:0/2072677806 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f958815d7a0 0x7f958806fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:59.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.461+0000 7f9587e00640 1 -- 172.21.15.120:0/2072677806 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2648895142 0 0) 0x7f95880703b0 con 0x7f95880c8850 2024-04-18T04:44:59.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.461+0000 7f9587e00640 1 -- 172.21.15.120:0/2072677806 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9570003530 con 0x7f95880c8850 2024-04-18T04:44:59.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.461+0000 7f958e400640 1 -- 172.21.15.120:0/2072677806 >> v1:172.21.15.132:6789/0 conn(0x7f9588153830 legacy=0x7f95880ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:59.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.461+0000 7f958e400640 1 -- 172.21.15.120:0/2072677806 >> v1:172.21.15.120:6789/0 conn(0x7f95880c8850 legacy=0x7f958815d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:59.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.461+0000 7f958e400640 1 -- 172.21.15.120:0/2072677806 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f958815cc00 con 0x7f958815d7a0 2024-04-18T04:44:59.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.465+0000 7f958e400640 1 --2- 172.21.15.120:0/2072677806 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f958815d7a0 0x7f958806fe70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9580009dc0 tx=0x7f958001c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ceb34087f9d9a3d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:59.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.465+0000 7f9587e00640 1 -- 172.21.15.120:0/2072677806 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95800a5a20 con 0x7f958815d7a0 2024-04-18T04:44:59.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.465+0000 7f9587e00640 1 -- 172.21.15.120:0/2072677806 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95800a5b80 con 0x7f958815d7a0 2024-04-18T04:44:59.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.465+0000 7f9587e00640 1 -- 172.21.15.120:0/2072677806 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95800ad440 con 0x7f958815d7a0 2024-04-18T04:44:59.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.465+0000 7f9590400640 1 -- 172.21.15.120:0/2072677806 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f958815d7a0 msgr2=0x7f958806fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:59.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.465+0000 7f9590400640 1 --2- 172.21.15.120:0/2072677806 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f958815d7a0 0x7f958806fe70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9580009dc0 tx=0x7f958001c960 comp rx=0 tx=0).stop 2024-04-18T04:44:59.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.465+0000 7f9590400640 1 -- 172.21.15.120:0/2072677806 shutdown_connections 2024-04-18T04:44:59.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.465+0000 7f9590400640 1 --2- 172.21.15.120:0/2072677806 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f958815d7a0 0x7f958806fe70 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:59.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.465+0000 7f9590400640 1 -- 172.21.15.120:0/2072677806 >> 172.21.15.120:0/2072677806 conn(0x7f958806e0f0 msgr2=0x7f9588071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:59.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.465+0000 7f9590400640 1 -- 172.21.15.120:0/2072677806 shutdown_connections 2024-04-18T04:44:59.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.465+0000 7f9590400640 1 -- 172.21.15.120:0/2072677806 wait complete. 2024-04-18T04:44:59.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.465+0000 7f9590400640 1 Processor -- start 2024-04-18T04:44:59.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.465+0000 7f9590400640 1 -- start start 2024-04-18T04:44:59.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.469+0000 7f9590400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95880c8850 0x7f958814abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:59.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.469+0000 7f9590400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9588153830 0x7f9588146830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:59.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.469+0000 7f9590400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f958815d7a0 0x7f9588146d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:59.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.469+0000 7f9590400640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95880c47f0 con 0x7f95880c8850 2024-04-18T04:44:59.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.469+0000 7f9590400640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95880cad50 con 0x7f9588153830 2024-04-18T04:44:59.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.469+0000 7f9590400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95880cbbb0 con 0x7f958815d7a0 2024-04-18T04:44:59.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.469+0000 7f958da00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95880c8850 0x7f958814abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:59.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.469+0000 7f958da00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95880c8850 0x7f958814abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46004/0 (socket says 172.21.15.120:46004) 2024-04-18T04:44:59.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.469+0000 7f958da00640 1 -- 172.21.15.120:0/3931291081 learned_addr learned my addr 172.21.15.120:0/3931291081 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:59.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.469+0000 7f958e400640 1 --2- 172.21.15.120:0/3931291081 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f958815d7a0 0x7f9588146d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:59.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.469+0000 7f958d000640 1 --2- 172.21.15.120:0/3931291081 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9588153830 0x7f9588146830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:59.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.469+0000 7f958da00640 1 -- 172.21.15.120:0/3931291081 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f958815d7a0 msgr2=0x7f9588146d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:59.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.469+0000 7f958da00640 1 --2- 172.21.15.120:0/3931291081 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f958815d7a0 0x7f9588146d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:59.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.469+0000 7f958da00640 1 -- 172.21.15.120:0/3931291081 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9588153830 msgr2=0x7f9588146830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:59.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.469+0000 7f958da00640 1 --2- 172.21.15.120:0/3931291081 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9588153830 0x7f9588146830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:59.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.469+0000 7f958da00640 1 -- 172.21.15.120:0/3931291081 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9580009a70 con 0x7f95880c8850 2024-04-18T04:44:59.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.469+0000 7f958da00640 1 --2- 172.21.15.120:0/3931291081 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95880c8850 0x7f958814abc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f957c00c530 tx=0x7f957c00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:59.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.469+0000 7f9585600640 1 -- 172.21.15.120:0/3931291081 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957c005220 con 0x7f95880c8850 2024-04-18T04:44:59.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.469+0000 7f9585600640 1 -- 172.21.15.120:0/3931291081 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957c005380 con 0x7f95880c8850 2024-04-18T04:44:59.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.469+0000 7f9590400640 1 -- 172.21.15.120:0/3931291081 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f958814b820 con 0x7f95880c8850 2024-04-18T04:44:59.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.469+0000 7f9585600640 1 -- 172.21.15.120:0/3931291081 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957c007270 con 0x7f95880c8850 2024-04-18T04:44:59.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.469+0000 7f9590400640 1 -- 172.21.15.120:0/3931291081 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95880cb280 con 0x7f95880c8850 2024-04-18T04:44:59.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.469+0000 7f9590400640 1 -- 172.21.15.120:0/3931291081 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9588067590 con 0x7f95880c8850 2024-04-18T04:44:59.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.469+0000 7f9585600640 1 -- 172.21.15.120:0/3931291081 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f957c0073d0 con 0x7f95880c8850 2024-04-18T04:44:59.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.473+0000 7f9585600640 1 --2- 172.21.15.120:0/3931291081 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9568066690 0x7f9568068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:59.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.473+0000 7f9585600640 1 -- 172.21.15.120:0/3931291081 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f957c083ce0 con 0x7f95880c8850 2024-04-18T04:44:59.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.473+0000 7f958d000640 1 --2- 172.21.15.120:0/3931291081 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9568066690 0x7f9568068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:59.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.473+0000 7f958d000640 1 --2- 172.21.15.120:0/3931291081 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9568066690 0x7f9568068b50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9588071a00 tx=0x7f9574009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:59.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.477+0000 7f9585600640 1 -- 172.21.15.120:0/3931291081 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f957c050dd0 con 0x7f95880c8850 2024-04-18T04:44:59.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.633+0000 7f9590400640 1 -- 172.21.15.120:0/3931291081 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95880cbcf0 con 0x7f95880c8850 2024-04-18T04:44:59.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.633+0000 7f9585600640 1 -- 172.21.15.120:0/3931291081 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f957c0543f0 con 0x7f95880c8850 2024-04-18T04:44:59.634 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:44:59.635 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":25,"fsid":"8e73592f-08e2-4957-a98f-9d044cec4ba5","created":"2024-04-18T04:44:06.139983+0000","modified":"2024-04-18T04:44:34.676253+0000","last_up_change":"2024-04-18T04:44:17.410146+0000","last_in_change":"2024-04-18T04:44:08.470250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T04:44:16.864728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T04:44:28.825773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T04:44:29.245857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-18T04:44:32.314302+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a80903bd-d9be-4fb9-af99-6125cb26bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":27468},{"type":"v1","addr":"172.21.15.120:6801","nonce":27468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":27468},{"type":"v1","addr":"172.21.15.120:6803","nonce":27468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":27468},{"type":"v1","addr":"172.21.15.120:6807","nonce":27468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":27468},{"type":"v1","addr":"172.21.15.120:6805","nonce":27468}]},"public_addr":"172.21.15.120:6801/27468","cluster_addr":"172.21.15.120:6803/27468","heartbeat_back_addr":"172.21.15.120:6807/27468","heartbeat_front_addr":"172.21.15.120:6805/27468","state":["exists","up"]},{"osd":1,"uuid":"8f5f004b-6870-4c78-8d50-9622e631ec25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":27470},{"type":"v1","addr":"172.21.15.120:6823","nonce":27470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":27470},{"type":"v1","addr":"172.21.15.120:6827","nonce":27470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":27470},{"type":"v1","addr":"172.21.15.120:6831","nonce":27470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":27470},{"type":"v1","addr":"172.21.15.120:6829","nonce":27470}]},"public_addr":"172.21.15.120:6823/27470","cluster_addr":"172.21.15.120:6827/27470","heartbeat_back_addr":"172.21.15.120:6831/27470","heartbeat_front_addr":"172.21.15.120:6829/27470","state":["exists","up"]},{"osd":2,"uuid":"6e228a2b-6103-4301-a8b5-ee81dbb1f920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":27471},{"type":"v1","addr":"172.21.15.120:6817","nonce":27471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":27471},{"type":"v1","addr":"172.21.15.120:6819","nonce":27471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":27471},{"type":"v1","addr":"172.21.15.120:6826","nonce":27471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":27471},{"type":"v1","addr":"172.21.15.120:6822","nonce":27471}]},"public_addr":"172.21.15.120:6817/27471","cluster_addr":"172.21.15.120:6819/27471","heartbeat_back_addr":"172.21.15.120:6826/27471","heartbeat_front_addr":"172.21.15.120:6822/27471","state":["exists","up"]},{"osd":3,"uuid":"7a5cabd7-d898-4e32-a03c-25b46e790134","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":27469},{"type":"v1","addr":"172.21.15.120:6809","nonce":27469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":27469},{"type":"v1","addr":"172.21.15.120:6811","nonce":27469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":27469},{"type":"v1","addr":"172.21.15.120:6815","nonce":27469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":27469},{"type":"v1","addr":"172.21.15.120:6813","nonce":27469}]},"public_addr":"172.21.15.120:6809/27469","cluster_addr":"172.21.15.120:6811/27469","heartbeat_back_addr":"172.21.15.120:6815/27469","heartbeat_front_addr":"172.21.15.120:6813/27469","state":["exists","up"]},{"osd":4,"uuid":"8e9f530f-6bab-4b23-a1a3-a71362fefcc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":28102},{"type":"v1","addr":"172.21.15.132:6825","nonce":28102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":28102},{"type":"v1","addr":"172.21.15.132:6827","nonce":28102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":28102},{"type":"v1","addr":"172.21.15.132:6831","nonce":28102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":28102},{"type":"v1","addr":"172.21.15.132:6829","nonce":28102}]},"public_addr":"172.21.15.132:6825/28102","cluster_addr":"172.21.15.132:6827/28102","heartbeat_back_addr":"172.21.15.132:6831/28102","heartbeat_front_addr":"172.21.15.132:6829/28102","state":["exists","up"]},{"osd":5,"uuid":"2243fabe-cc81-40cf-91bc-f106fe275a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":28104},{"type":"v1","addr":"172.21.15.132:6809","nonce":28104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":28104},{"type":"v1","addr":"172.21.15.132:6811","nonce":28104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":28104},{"type":"v1","addr":"172.21.15.132:6815","nonce":28104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":28104},{"type":"v1","addr":"172.21.15.132:6813","nonce":28104}]},"public_addr":"172.21.15.132:6809/28104","cluster_addr":"172.21.15.132:6811/28104","heartbeat_back_addr":"172.21.15.132:6815/28104","heartbeat_front_addr":"172.21.15.132:6813/28104","state":["exists","up"]},{"osd":6,"uuid":"c093a5ed-25c8-41a7-a20d-606a1a1661e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":28103},{"type":"v1","addr":"172.21.15.132:6801","nonce":28103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":28103},{"type":"v1","addr":"172.21.15.132:6803","nonce":28103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":28103},{"type":"v1","addr":"172.21.15.132:6807","nonce":28103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":28103},{"type":"v1","addr":"172.21.15.132:6805","nonce":28103}]},"public_addr":"172.21.15.132:6801/28103","cluster_addr":"172.21.15.132:6803/28103","heartbeat_back_addr":"172.21.15.132:6807/28103","heartbeat_front_addr":"172.21.15.132:6805/28103","state":["exists","up"]},{"osd":7,"uuid":"c37426b7-1080-4434-9f3e-a3afbbdc0fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":28129},{"type":"v1","addr":"172.21.15.132:6817","nonce":28129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":28129},{"type":"v1","addr":"172.21.15.132:6819","nonce":28129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":28129},{"type":"v1","addr":"172.21.15.132:6823","nonce":28129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":28129},{"type":"v1","addr":"172.21.15.132:6821","nonce":28129}]},"public_addr":"172.21.15.132:6817/28129","cluster_addr":"172.21.15.132:6819/28129","heartbeat_back_addr":"172.21.15.132:6823/28129","heartbeat_front_addr":"172.21.15.132:6821/28129","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.053825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.289753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.274645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.146361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.943883+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.701955+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.851076+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.800782+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T04:44:59.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.637+0000 7f9590400640 1 -- 172.21.15.120:0/3931291081 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9568066690 msgr2=0x7f9568068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:59.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.637+0000 7f9590400640 1 --2- 172.21.15.120:0/3931291081 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9568066690 0x7f9568068b50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9588071a00 tx=0x7f9574009040 comp rx=0 tx=0).stop 2024-04-18T04:44:59.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.637+0000 7f9590400640 1 -- 172.21.15.120:0/3931291081 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95880c8850 msgr2=0x7f958814abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:59.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.637+0000 7f9590400640 1 --2- 172.21.15.120:0/3931291081 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95880c8850 0x7f958814abc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f957c00c530 tx=0x7f957c00c9f0 comp rx=0 tx=0).stop 2024-04-18T04:44:59.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.637+0000 7f9590400640 1 -- 172.21.15.120:0/3931291081 shutdown_connections 2024-04-18T04:44:59.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.637+0000 7f9590400640 1 --2- 172.21.15.120:0/3931291081 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9568066690 0x7f9568068b50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:59.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.637+0000 7f9590400640 1 --2- 172.21.15.120:0/3931291081 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f958815d7a0 0x7f9588146d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:59.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.637+0000 7f9590400640 1 --2- 172.21.15.120:0/3931291081 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9588153830 0x7f9588146830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:59.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.637+0000 7f9590400640 1 --2- 172.21.15.120:0/3931291081 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95880c8850 0x7f958814abc0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:59.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.637+0000 7f9590400640 1 -- 172.21.15.120:0/3931291081 >> 172.21.15.120:0/3931291081 conn(0x7f958806e0f0 msgr2=0x7f958815c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:59.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.637+0000 7f9590400640 1 -- 172.21.15.120:0/3931291081 shutdown_connections 2024-04-18T04:44:59.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.637+0000 7f9590400640 1 -- 172.21.15.120:0/3931291081 wait complete. 2024-04-18T04:44:59.656 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-18T04:44:59.657 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T04:44:59.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.793+0000 7f1c28e00640 1 Processor -- start 2024-04-18T04:44:59.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.793+0000 7f1c28e00640 1 -- start start 2024-04-18T04:44:59.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.793+0000 7f1c28e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c241503e0 0x7f1c240c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:59.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.793+0000 7f1c28e00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1c240c67d0 0x7f1c240c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:59.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.793+0000 7f1c28e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1c24159d10 0x7f1c2415a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:59.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.793+0000 7f1c28e00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c24071280 con 0x7f1c24159d10 2024-04-18T04:44:59.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.793+0000 7f1c28e00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c2415a6c0 con 0x7f1c240c67d0 2024-04-18T04:44:59.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.793+0000 7f1c28e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c240c65b0 con 0x7f1c241503e0 2024-04-18T04:44:59.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.793+0000 7f1c23e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1c24159d10 0x7f1c2415a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:59.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.793+0000 7f1c23e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1c24159d10 0x7f1c2415a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46016/0 (socket says 172.21.15.120:46016) 2024-04-18T04:44:59.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.793+0000 7f1c23e00640 1 -- 172.21.15.120:0/3544522389 learned_addr learned my addr 172.21.15.120:0/3544522389 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:59.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.793+0000 7f1c23400640 1 --2- 172.21.15.120:0/3544522389 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c241503e0 0x7f1c240c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:59.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.793+0000 7f1c22a00640 1 --2- 172.21.15.120:0/3544522389 >> v2:172.21.15.132:3300/0 conn(0x7f1c240c67d0 0x7f1c240c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:59.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.793+0000 7f1c23e00640 1 -- 172.21.15.120:0/3544522389 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c241503e0 msgr2=0x7f1c240c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:59.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.793+0000 7f1c23e00640 1 --2- 172.21.15.120:0/3544522389 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c241503e0 0x7f1c240c8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:59.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.793+0000 7f1c23e00640 1 -- 172.21.15.120:0/3544522389 >> v2:172.21.15.132:3300/0 conn(0x7f1c240c67d0 msgr2=0x7f1c240c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:44:59.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.793+0000 7f1c23e00640 1 --2- 172.21.15.120:0/3544522389 >> v2:172.21.15.132:3300/0 conn(0x7f1c240c67d0 0x7f1c240c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:59.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.793+0000 7f1c23e00640 1 -- 172.21.15.120:0/3544522389 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c240ca3f0 con 0x7f1c24159d10 2024-04-18T04:44:59.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.793+0000 7f1c23400640 1 --2- 172.21.15.120:0/3544522389 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c241503e0 0x7f1c240c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:44:59.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.797+0000 7f1c23e00640 1 --2- 172.21.15.120:0/3544522389 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c24159d10 0x7f1c2415a180 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1c240c9640 tx=0x7f1c1c01f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f907166f9c8b9df4 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:59.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.797+0000 7f1c22000640 1 -- 172.21.15.120:0/3544522389 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c0af400 con 0x7f1c24159d10 2024-04-18T04:44:59.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.797+0000 7f1c22000640 1 -- 172.21.15.120:0/3544522389 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c1c0ab050 con 0x7f1c24159d10 2024-04-18T04:44:59.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.797+0000 7f1c22000640 1 -- 172.21.15.120:0/3544522389 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c0af780 con 0x7f1c24159d10 2024-04-18T04:44:59.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.797+0000 7f1c28e00640 1 -- 172.21.15.120:0/3544522389 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c24159d10 msgr2=0x7f1c2415a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:59.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.797+0000 7f1c28e00640 1 --2- 172.21.15.120:0/3544522389 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c24159d10 0x7f1c2415a180 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1c240c9640 tx=0x7f1c1c01f1e0 comp rx=0 tx=0).stop 2024-04-18T04:44:59.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.797+0000 7f1c28e00640 1 -- 172.21.15.120:0/3544522389 shutdown_connections 2024-04-18T04:44:59.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.797+0000 7f1c28e00640 1 --2- 172.21.15.120:0/3544522389 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c24159d10 0x7f1c2415a180 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:59.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.797+0000 7f1c28e00640 1 --2- 172.21.15.120:0/3544522389 >> v2:172.21.15.132:3300/0 conn(0x7f1c240c67d0 0x7f1c240c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:59.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.797+0000 7f1c28e00640 1 --2- 172.21.15.120:0/3544522389 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c241503e0 0x7f1c240c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:59.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.797+0000 7f1c28e00640 1 -- 172.21.15.120:0/3544522389 >> 172.21.15.120:0/3544522389 conn(0x7f1c2406e700 msgr2=0x7f1c2406eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:59.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.797+0000 7f1c28e00640 1 -- 172.21.15.120:0/3544522389 shutdown_connections 2024-04-18T04:44:59.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.797+0000 7f1c28e00640 1 -- 172.21.15.120:0/3544522389 wait complete. 2024-04-18T04:44:59.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.801+0000 7f1c28e00640 1 Processor -- start 2024-04-18T04:44:59.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.801+0000 7f1c28e00640 1 -- start start 2024-04-18T04:44:59.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.801+0000 7f1c28e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c240c67d0 0x7f1c241ec860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:59.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.801+0000 7f1c28e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c241503e0 0x7f1c241e0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:59.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.801+0000 7f1c28e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c24159d10 0x7f1c24153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:59.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.801+0000 7f1c28e00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c24152a10 con 0x7f1c241503e0 2024-04-18T04:44:59.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.801+0000 7f1c28e00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c24151b80 con 0x7f1c24159d10 2024-04-18T04:44:59.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.801+0000 7f1c28e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c241df7f0 con 0x7f1c240c67d0 2024-04-18T04:44:59.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.801+0000 7f1c22a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c241503e0 0x7f1c241e0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:59.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.801+0000 7f1c22a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c241503e0 0x7f1c241e0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46018/0 (socket says 172.21.15.120:46018) 2024-04-18T04:44:59.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.801+0000 7f1c22a00640 1 -- 172.21.15.120:0/1870403128 learned_addr learned my addr 172.21.15.120:0/1870403128 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:44:59.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.801+0000 7f1c23400640 1 --2- 172.21.15.120:0/1870403128 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c240c67d0 0x7f1c241ec860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:59.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.801+0000 7f1c23e00640 1 --2- 172.21.15.120:0/1870403128 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c24159d10 0x7f1c24153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:59.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.801+0000 7f1c22a00640 1 -- 172.21.15.120:0/1870403128 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c240c67d0 msgr2=0x7f1c241ec860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:59.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.801+0000 7f1c22a00640 1 --2- 172.21.15.120:0/1870403128 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c240c67d0 0x7f1c241ec860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:59.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.801+0000 7f1c22a00640 1 -- 172.21.15.120:0/1870403128 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c24159d10 msgr2=0x7f1c24153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:59.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.801+0000 7f1c22a00640 1 --2- 172.21.15.120:0/1870403128 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c24159d10 0x7f1c24153fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:59.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.801+0000 7f1c22a00640 1 -- 172.21.15.120:0/1870403128 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c1c009b30 con 0x7f1c241503e0 2024-04-18T04:44:59.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.801+0000 7f1c23e00640 1 --2- 172.21.15.120:0/1870403128 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c24159d10 0x7f1c24153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:44:59.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.801+0000 7f1c22a00640 1 --2- 172.21.15.120:0/1870403128 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c241503e0 0x7f1c241e0190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1c1000d800 tx=0x7f1c1000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:59.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.801+0000 7f1c1b400640 1 -- 172.21.15.120:0/1870403128 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c10009640 con 0x7f1c241503e0 2024-04-18T04:44:59.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.801+0000 7f1c1b400640 1 -- 172.21.15.120:0/1870403128 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c100097a0 con 0x7f1c241503e0 2024-04-18T04:44:59.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.801+0000 7f1c1b400640 1 -- 172.21.15.120:0/1870403128 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c10009b10 con 0x7f1c241503e0 2024-04-18T04:44:59.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.801+0000 7f1c28e00640 1 -- 172.21.15.120:0/1870403128 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c24151db0 con 0x7f1c241503e0 2024-04-18T04:44:59.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.801+0000 7f1c28e00640 1 -- 172.21.15.120:0/1870403128 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c24152350 con 0x7f1c241503e0 2024-04-18T04:44:59.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.801+0000 7f1c28e00640 1 -- 172.21.15.120:0/1870403128 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c24152c80 con 0x7f1c241503e0 2024-04-18T04:44:59.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.805+0000 7f1c1b400640 1 -- 172.21.15.120:0/1870403128 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1c10009c70 con 0x7f1c241503e0 2024-04-18T04:44:59.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.805+0000 7f1c1b400640 1 --2- 172.21.15.120:0/1870403128 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1c04066690 0x7f1c04068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:44:59.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.805+0000 7f1c1b400640 1 -- 172.21.15.120:0/1870403128 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1c10084c60 con 0x7f1c241503e0 2024-04-18T04:44:59.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.805+0000 7f1c23400640 1 --2- 172.21.15.120:0/1870403128 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1c04066690 0x7f1c04068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:44:59.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.805+0000 7f1c23400640 1 --2- 172.21.15.120:0/1870403128 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1c04066690 0x7f1c04068b50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1c1400c900 tx=0x7f1c14008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:44:59.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.809+0000 7f1c1b400640 1 -- 172.21.15.120:0/1870403128 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f1c10051c50 con 0x7f1c241503e0 2024-04-18T04:44:59.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.961+0000 7f1c28e00640 1 -- 172.21.15.120:0/1870403128 --> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1c241597f0 con 0x7f1c04066690 2024-04-18T04:44:59.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.989+0000 7f1c1b400640 1 -- 172.21.15.120:0/1870403128 <== mgr.4113 v2:172.21.15.132:6832/27788 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345330 (secure 0 0 0) 0x7f1c1400c590 con 0x7f1c04066690 2024-04-18T04:44:59.991 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:44:59.993 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-04-18T04:44:59.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.993+0000 7f1c28e00640 1 -- 172.21.15.120:0/1870403128 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1c04066690 msgr2=0x7f1c04068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:59.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.993+0000 7f1c28e00640 1 --2- 172.21.15.120:0/1870403128 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1c04066690 0x7f1c04068b50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1c1400c900 tx=0x7f1c14008040 comp rx=0 tx=0).stop 2024-04-18T04:44:59.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.993+0000 7f1c28e00640 1 -- 172.21.15.120:0/1870403128 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c241503e0 msgr2=0x7f1c241e0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:44:59.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.993+0000 7f1c28e00640 1 --2- 172.21.15.120:0/1870403128 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c241503e0 0x7f1c241e0190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1c1000d800 tx=0x7f1c1000dcc0 comp rx=0 tx=0).stop 2024-04-18T04:44:59.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.993+0000 7f1c28e00640 1 -- 172.21.15.120:0/1870403128 shutdown_connections 2024-04-18T04:44:59.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.993+0000 7f1c28e00640 1 --2- 172.21.15.120:0/1870403128 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1c04066690 0x7f1c04068b50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:59.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.993+0000 7f1c28e00640 1 --2- 172.21.15.120:0/1870403128 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c24159d10 0x7f1c24153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:59.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.993+0000 7f1c28e00640 1 --2- 172.21.15.120:0/1870403128 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c241503e0 0x7f1c241e0190 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:59.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.993+0000 7f1c28e00640 1 --2- 172.21.15.120:0/1870403128 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c240c67d0 0x7f1c241ec860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:44:59.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.993+0000 7f1c28e00640 1 -- 172.21.15.120:0/1870403128 >> 172.21.15.120:0/1870403128 conn(0x7f1c2406e700 msgr2=0x7f1c2414d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:44:59.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.993+0000 7f1c28e00640 1 -- 172.21.15.120:0/1870403128 shutdown_connections 2024-04-18T04:44:59.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:44:59.993+0000 7f1c28e00640 1 -- 172.21.15.120:0/1870403128 wait complete. 2024-04-18T04:45:00.012 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-04-18T04:44:58.799144+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594962,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218396,"kb_used_data":2208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756324,"statfs":{"total":773094113280,"available":772870475776,"internally_reserved":0,"allocated":2260992,"data_stored":2008860,"data_compressed":66624,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004930"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.271916+0000","last_change":"2024-04-18T04:44:29.891079+0000","last_active":"2024-04-18T04:44:35.271916+0000","last_peered":"2024-04-18T04:44:35.271916+0000","last_clean":"2024-04-18T04:44:35.271916+0000","last_became_active":"2024-04-18T04:44:29.890853+0000","last_became_peered":"2024-04-18T04:44:29.890853+0000","last_unstale":"2024-04-18T04:44:35.271916+0000","last_undegraded":"2024-04-18T04:44:35.271916+0000","last_fullsized":"2024-04-18T04:44:35.271916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:12:22.299583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.293054+0000","last_change":"2024-04-18T04:44:30.296344+0000","last_active":"2024-04-18T04:44:34.293054+0000","last_peered":"2024-04-18T04:44:34.293054+0000","last_clean":"2024-04-18T04:44:34.293054+0000","last_became_active":"2024-04-18T04:44:30.296064+0000","last_became_peered":"2024-04-18T04:44:30.296064+0000","last_unstale":"2024-04-18T04:44:34.293054+0000","last_undegraded":"2024-04-18T04:44:34.293054+0000","last_fullsized":"2024-04-18T04:44:34.293054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:53:32.250308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.680854+0000","last_change":"2024-04-18T04:44:34.306605+0000","last_active":"2024-04-18T04:44:34.680854+0000","last_peered":"2024-04-18T04:44:34.680854+0000","last_clean":"2024-04-18T04:44:34.680854+0000","last_became_active":"2024-04-18T04:44:34.306224+0000","last_became_peered":"2024-04-18T04:44:34.306224+0000","last_unstale":"2024-04-18T04:44:34.680854+0000","last_undegraded":"2024-04-18T04:44:34.680854+0000","last_fullsized":"2024-04-18T04:44:34.680854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:13:15.107711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.681517+0000","last_change":"2024-04-18T04:44:29.881521+0000","last_active":"2024-04-18T04:44:34.681517+0000","last_peered":"2024-04-18T04:44:34.681517+0000","last_clean":"2024-04-18T04:44:34.681517+0000","last_became_active":"2024-04-18T04:44:29.881258+0000","last_became_peered":"2024-04-18T04:44:29.881258+0000","last_unstale":"2024-04-18T04:44:34.681517+0000","last_undegraded":"2024-04-18T04:44:34.681517+0000","last_fullsized":"2024-04-18T04:44:34.681517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:28:40.075960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287377+0000","last_change":"2024-04-18T04:44:30.314205+0000","last_active":"2024-04-18T04:44:34.287377+0000","last_peered":"2024-04-18T04:44:34.287377+0000","last_clean":"2024-04-18T04:44:34.287377+0000","last_became_active":"2024-04-18T04:44:30.313987+0000","last_became_peered":"2024-04-18T04:44:30.313987+0000","last_unstale":"2024-04-18T04:44:34.287377+0000","last_undegraded":"2024-04-18T04:44:34.287377+0000","last_fullsized":"2024-04-18T04:44:34.287377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:55:31.107861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.684278+0000","last_change":"2024-04-18T04:44:34.339646+0000","last_active":"2024-04-18T04:44:34.684278+0000","last_peered":"2024-04-18T04:44:34.684278+0000","last_clean":"2024-04-18T04:44:34.684278+0000","last_became_active":"2024-04-18T04:44:34.338485+0000","last_became_peered":"2024-04-18T04:44:34.338485+0000","last_unstale":"2024-04-18T04:44:34.684278+0000","last_undegraded":"2024-04-18T04:44:34.684278+0000","last_fullsized":"2024-04-18T04:44:34.684278+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:47:01.277301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.272149+0000","last_change":"2024-04-18T04:44:29.897785+0000","last_active":"2024-04-18T04:44:35.272149+0000","last_peered":"2024-04-18T04:44:35.272149+0000","last_clean":"2024-04-18T04:44:35.272149+0000","last_became_active":"2024-04-18T04:44:29.896520+0000","last_became_peered":"2024-04-18T04:44:29.896520+0000","last_unstale":"2024-04-18T04:44:35.272149+0000","last_undegraded":"2024-04-18T04:44:35.272149+0000","last_fullsized":"2024-04-18T04:44:35.272149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:25:52.871139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.307466+0000","last_change":"2024-04-18T04:44:30.300588+0000","last_active":"2024-04-18T04:44:34.307466+0000","last_peered":"2024-04-18T04:44:34.307466+0000","last_clean":"2024-04-18T04:44:34.307466+0000","last_became_active":"2024-04-18T04:44:30.299939+0000","last_became_peered":"2024-04-18T04:44:30.299939+0000","last_unstale":"2024-04-18T04:44:34.307466+0000","last_undegraded":"2024-04-18T04:44:34.307466+0000","last_fullsized":"2024-04-18T04:44:34.307466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:57:07.547985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.685732+0000","last_change":"2024-04-18T04:44:34.338794+0000","last_active":"2024-04-18T04:44:34.685732+0000","last_peered":"2024-04-18T04:44:34.685732+0000","last_clean":"2024-04-18T04:44:34.685732+0000","last_became_active":"2024-04-18T04:44:34.337938+0000","last_became_peered":"2024-04-18T04:44:34.337938+0000","last_unstale":"2024-04-18T04:44:34.685732+0000","last_undegraded":"2024-04-18T04:44:34.685732+0000","last_fullsized":"2024-04-18T04:44:34.685732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:48.827970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.271558+0000","last_change":"2024-04-18T04:44:29.903118+0000","last_active":"2024-04-18T04:44:35.271558+0000","last_peered":"2024-04-18T04:44:35.271558+0000","last_clean":"2024-04-18T04:44:35.271558+0000","last_became_active":"2024-04-18T04:44:29.902611+0000","last_became_peered":"2024-04-18T04:44:29.902611+0000","last_unstale":"2024-04-18T04:44:35.271558+0000","last_undegraded":"2024-04-18T04:44:35.271558+0000","last_fullsized":"2024-04-18T04:44:35.271558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:38:42.595095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.307515+0000","last_change":"2024-04-18T04:44:30.301328+0000","last_active":"2024-04-18T04:44:34.307515+0000","last_peered":"2024-04-18T04:44:34.307515+0000","last_clean":"2024-04-18T04:44:34.307515+0000","last_became_active":"2024-04-18T04:44:30.300303+0000","last_became_peered":"2024-04-18T04:44:30.300303+0000","last_unstale":"2024-04-18T04:44:34.307515+0000","last_undegraded":"2024-04-18T04:44:34.307515+0000","last_fullsized":"2024-04-18T04:44:34.307515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:24:11.941483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.685077+0000","last_change":"2024-04-18T04:44:34.327044+0000","last_active":"2024-04-18T04:44:34.685077+0000","last_peered":"2024-04-18T04:44:34.685077+0000","last_clean":"2024-04-18T04:44:34.685077+0000","last_became_active":"2024-04-18T04:44:34.326161+0000","last_became_peered":"2024-04-18T04:44:34.326161+0000","last_unstale":"2024-04-18T04:44:34.685077+0000","last_undegraded":"2024-04-18T04:44:34.685077+0000","last_fullsized":"2024-04-18T04:44:34.685077+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:47:41.413530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.288881+0000","last_change":"2024-04-18T04:44:30.296493+0000","last_active":"2024-04-18T04:44:34.288881+0000","last_peered":"2024-04-18T04:44:34.288881+0000","last_clean":"2024-04-18T04:44:34.288881+0000","last_became_active":"2024-04-18T04:44:30.295657+0000","last_became_peered":"2024-04-18T04:44:30.295657+0000","last_unstale":"2024-04-18T04:44:34.288881+0000","last_undegraded":"2024-04-18T04:44:34.288881+0000","last_fullsized":"2024-04-18T04:44:34.288881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:39:40.270643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.271728+0000","last_change":"2024-04-18T04:44:29.900036+0000","last_active":"2024-04-18T04:44:35.271728+0000","last_peered":"2024-04-18T04:44:35.271728+0000","last_clean":"2024-04-18T04:44:35.271728+0000","last_became_active":"2024-04-18T04:44:29.899402+0000","last_became_peered":"2024-04-18T04:44:29.899402+0000","last_unstale":"2024-04-18T04:44:35.271728+0000","last_undegraded":"2024-04-18T04:44:35.271728+0000","last_fullsized":"2024-04-18T04:44:35.271728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:45:51.681317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.686484+0000","last_change":"2024-04-18T04:44:34.320846+0000","last_active":"2024-04-18T04:44:34.686484+0000","last_peered":"2024-04-18T04:44:34.686484+0000","last_clean":"2024-04-18T04:44:34.686484+0000","last_became_active":"2024-04-18T04:44:34.319868+0000","last_became_peered":"2024-04-18T04:44:34.319868+0000","last_unstale":"2024-04-18T04:44:34.686484+0000","last_undegraded":"2024-04-18T04:44:34.686484+0000","last_fullsized":"2024-04-18T04:44:34.686484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:08:30.863140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.289171+0000","last_change":"2024-04-18T04:44:30.271756+0000","last_active":"2024-04-18T04:44:34.289171+0000","last_peered":"2024-04-18T04:44:34.289171+0000","last_clean":"2024-04-18T04:44:34.289171+0000","last_became_active":"2024-04-18T04:44:30.271420+0000","last_became_peered":"2024-04-18T04:44:30.271420+0000","last_unstale":"2024-04-18T04:44:34.289171+0000","last_undegraded":"2024-04-18T04:44:34.289171+0000","last_fullsized":"2024-04-18T04:44:34.289171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:27:18.559327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.296649+0000","last_change":"2024-04-18T04:44:29.878416+0000","last_active":"2024-04-18T04:44:34.296649+0000","last_peered":"2024-04-18T04:44:34.296649+0000","last_clean":"2024-04-18T04:44:34.296649+0000","last_became_active":"2024-04-18T04:44:29.878139+0000","last_became_peered":"2024-04-18T04:44:29.878139+0000","last_unstale":"2024-04-18T04:44:34.296649+0000","last_undegraded":"2024-04-18T04:44:34.296649+0000","last_fullsized":"2024-04-18T04:44:34.296649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:19:00.769888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.685503+0000","last_change":"2024-04-18T04:44:34.346123+0000","last_active":"2024-04-18T04:44:34.685503+0000","last_peered":"2024-04-18T04:44:34.685503+0000","last_clean":"2024-04-18T04:44:34.685503+0000","last_became_active":"2024-04-18T04:44:34.345267+0000","last_became_peered":"2024-04-18T04:44:34.345267+0000","last_unstale":"2024-04-18T04:44:34.685503+0000","last_undegraded":"2024-04-18T04:44:34.685503+0000","last_fullsized":"2024-04-18T04:44:34.685503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:14:08.078650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.289001+0000","last_change":"2024-04-18T04:44:30.274049+0000","last_active":"2024-04-18T04:44:34.289001+0000","last_peered":"2024-04-18T04:44:34.289001+0000","last_clean":"2024-04-18T04:44:34.289001+0000","last_became_active":"2024-04-18T04:44:30.273752+0000","last_became_peered":"2024-04-18T04:44:30.273752+0000","last_unstale":"2024-04-18T04:44:34.289001+0000","last_undegraded":"2024-04-18T04:44:34.289001+0000","last_fullsized":"2024-04-18T04:44:34.289001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:48:20.479069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.297586+0000","last_change":"2024-04-18T04:44:29.890569+0000","last_active":"2024-04-18T04:44:34.297586+0000","last_peered":"2024-04-18T04:44:34.297586+0000","last_clean":"2024-04-18T04:44:34.297586+0000","last_became_active":"2024-04-18T04:44:29.889684+0000","last_became_peered":"2024-04-18T04:44:29.889684+0000","last_unstale":"2024-04-18T04:44:34.297586+0000","last_undegraded":"2024-04-18T04:44:34.297586+0000","last_fullsized":"2024-04-18T04:44:34.297586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:53:00.230580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.202946+0000","last_change":"2024-04-18T04:44:34.313634+0000","last_active":"2024-04-18T04:44:35.202946+0000","last_peered":"2024-04-18T04:44:35.202946+0000","last_clean":"2024-04-18T04:44:35.202946+0000","last_became_active":"2024-04-18T04:44:34.313161+0000","last_became_peered":"2024-04-18T04:44:34.313161+0000","last_unstale":"2024-04-18T04:44:35.202946+0000","last_undegraded":"2024-04-18T04:44:35.202946+0000","last_fullsized":"2024-04-18T04:44:35.202946+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:01:07.805128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.302215+0000","last_change":"2024-04-18T04:44:30.284805+0000","last_active":"2024-04-18T04:44:34.302215+0000","last_peered":"2024-04-18T04:44:34.302215+0000","last_clean":"2024-04-18T04:44:34.302215+0000","last_became_active":"2024-04-18T04:44:30.279238+0000","last_became_peered":"2024-04-18T04:44:30.279238+0000","last_unstale":"2024-04-18T04:44:34.302215+0000","last_undegraded":"2024-04-18T04:44:34.302215+0000","last_fullsized":"2024-04-18T04:44:34.302215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:59:24.067420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287232+0000","last_change":"2024-04-18T04:44:29.890816+0000","last_active":"2024-04-18T04:44:34.287232+0000","last_peered":"2024-04-18T04:44:34.287232+0000","last_clean":"2024-04-18T04:44:34.287232+0000","last_became_active":"2024-04-18T04:44:29.890272+0000","last_became_peered":"2024-04-18T04:44:29.890272+0000","last_unstale":"2024-04-18T04:44:34.287232+0000","last_undegraded":"2024-04-18T04:44:34.287232+0000","last_fullsized":"2024-04-18T04:44:34.287232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:30:22.614083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.686347+0000","last_change":"2024-04-18T04:44:34.344973+0000","last_active":"2024-04-18T04:44:34.686347+0000","last_peered":"2024-04-18T04:44:34.686347+0000","last_clean":"2024-04-18T04:44:34.686347+0000","last_became_active":"2024-04-18T04:44:34.344007+0000","last_became_peered":"2024-04-18T04:44:34.344007+0000","last_unstale":"2024-04-18T04:44:34.686347+0000","last_undegraded":"2024-04-18T04:44:34.686347+0000","last_fullsized":"2024-04-18T04:44:34.686347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:56:43.476132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.288547+0000","last_change":"2024-04-18T04:44:30.278193+0000","last_active":"2024-04-18T04:44:34.288547+0000","last_peered":"2024-04-18T04:44:34.288547+0000","last_clean":"2024-04-18T04:44:34.288547+0000","last_became_active":"2024-04-18T04:44:30.277916+0000","last_became_peered":"2024-04-18T04:44:30.277916+0000","last_unstale":"2024-04-18T04:44:34.288547+0000","last_undegraded":"2024-04-18T04:44:34.288547+0000","last_fullsized":"2024-04-18T04:44:34.288547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:57:19.783436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.272431+0000","last_change":"2024-04-18T04:44:29.896901+0000","last_active":"2024-04-18T04:44:35.272431+0000","last_peered":"2024-04-18T04:44:35.272431+0000","last_clean":"2024-04-18T04:44:35.272431+0000","last_became_active":"2024-04-18T04:44:29.896392+0000","last_became_peered":"2024-04-18T04:44:29.896392+0000","last_unstale":"2024-04-18T04:44:35.272431+0000","last_undegraded":"2024-04-18T04:44:35.272431+0000","last_fullsized":"2024-04-18T04:44:35.272431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:46:08.869450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.684375+0000","last_change":"2024-04-18T04:44:34.339233+0000","last_active":"2024-04-18T04:44:34.684375+0000","last_peered":"2024-04-18T04:44:34.684375+0000","last_clean":"2024-04-18T04:44:34.684375+0000","last_became_active":"2024-04-18T04:44:34.338294+0000","last_became_peered":"2024-04-18T04:44:34.338294+0000","last_unstale":"2024-04-18T04:44:34.684375+0000","last_undegraded":"2024-04-18T04:44:34.684375+0000","last_fullsized":"2024-04-18T04:44:34.684375+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:20:35.738410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.291990+0000","last_change":"2024-04-18T04:44:30.305051+0000","last_active":"2024-04-18T04:44:34.291990+0000","last_peered":"2024-04-18T04:44:34.291990+0000","last_clean":"2024-04-18T04:44:34.291990+0000","last_became_active":"2024-04-18T04:44:30.304741+0000","last_became_peered":"2024-04-18T04:44:30.304741+0000","last_unstale":"2024-04-18T04:44:34.291990+0000","last_undegraded":"2024-04-18T04:44:34.291990+0000","last_fullsized":"2024-04-18T04:44:34.291990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:38:03.346015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.203014+0000","last_change":"2024-04-18T04:44:29.894503+0000","last_active":"2024-04-18T04:44:35.203014+0000","last_peered":"2024-04-18T04:44:35.203014+0000","last_clean":"2024-04-18T04:44:35.203014+0000","last_became_active":"2024-04-18T04:44:29.894210+0000","last_became_peered":"2024-04-18T04:44:29.894210+0000","last_unstale":"2024-04-18T04:44:35.203014+0000","last_undegraded":"2024-04-18T04:44:35.203014+0000","last_fullsized":"2024-04-18T04:44:35.203014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:14:56.979204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.680679+0000","last_change":"2024-04-18T04:44:34.305652+0000","last_active":"2024-04-18T04:44:34.680679+0000","last_peered":"2024-04-18T04:44:34.680679+0000","last_clean":"2024-04-18T04:44:34.680679+0000","last_became_active":"2024-04-18T04:44:34.305180+0000","last_became_peered":"2024-04-18T04:44:34.305180+0000","last_unstale":"2024-04-18T04:44:34.680679+0000","last_undegraded":"2024-04-18T04:44:34.680679+0000","last_fullsized":"2024-04-18T04:44:34.680679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:03:10.781821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.296680+0000","last_change":"2024-04-18T04:44:30.267158+0000","last_active":"2024-04-18T04:44:34.296680+0000","last_peered":"2024-04-18T04:44:34.296680+0000","last_clean":"2024-04-18T04:44:34.296680+0000","last_became_active":"2024-04-18T04:44:30.266814+0000","last_became_peered":"2024-04-18T04:44:30.266814+0000","last_unstale":"2024-04-18T04:44:34.296680+0000","last_undegraded":"2024-04-18T04:44:34.296680+0000","last_fullsized":"2024-04-18T04:44:34.296680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:16:02.152817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.296678+0000","last_change":"2024-04-18T04:44:29.898812+0000","last_active":"2024-04-18T04:44:34.296678+0000","last_peered":"2024-04-18T04:44:34.296678+0000","last_clean":"2024-04-18T04:44:34.296678+0000","last_became_active":"2024-04-18T04:44:29.897156+0000","last_became_peered":"2024-04-18T04:44:29.897156+0000","last_unstale":"2024-04-18T04:44:34.296678+0000","last_undegraded":"2024-04-18T04:44:34.296678+0000","last_fullsized":"2024-04-18T04:44:34.296678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:09:47.746394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.188051+0000","last_change":"2024-04-18T04:44:34.324721+0000","last_active":"2024-04-18T04:44:35.188051+0000","last_peered":"2024-04-18T04:44:35.188051+0000","last_clean":"2024-04-18T04:44:35.188051+0000","last_became_active":"2024-04-18T04:44:34.322925+0000","last_became_peered":"2024-04-18T04:44:34.322925+0000","last_unstale":"2024-04-18T04:44:35.188051+0000","last_undegraded":"2024-04-18T04:44:35.188051+0000","last_fullsized":"2024-04-18T04:44:35.188051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:11:59.682230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.311311+0000","last_change":"2024-04-18T04:44:30.281640+0000","last_active":"2024-04-18T04:44:34.311311+0000","last_peered":"2024-04-18T04:44:34.311311+0000","last_clean":"2024-04-18T04:44:34.311311+0000","last_became_active":"2024-04-18T04:44:30.280968+0000","last_became_peered":"2024-04-18T04:44:30.280968+0000","last_unstale":"2024-04-18T04:44:34.311311+0000","last_undegraded":"2024-04-18T04:44:34.311311+0000","last_fullsized":"2024-04-18T04:44:34.311311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:35:20.755711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.296757+0000","last_change":"2024-04-18T04:44:29.882715+0000","last_active":"2024-04-18T04:44:34.296757+0000","last_peered":"2024-04-18T04:44:34.296757+0000","last_clean":"2024-04-18T04:44:34.296757+0000","last_became_active":"2024-04-18T04:44:29.882335+0000","last_became_peered":"2024-04-18T04:44:29.882335+0000","last_unstale":"2024-04-18T04:44:34.296757+0000","last_undegraded":"2024-04-18T04:44:34.296757+0000","last_fullsized":"2024-04-18T04:44:34.296757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:32:59.709151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.202122+0000","last_change":"2024-04-18T04:44:34.325029+0000","last_active":"2024-04-18T04:44:35.202122+0000","last_peered":"2024-04-18T04:44:35.202122+0000","last_clean":"2024-04-18T04:44:35.202122+0000","last_became_active":"2024-04-18T04:44:34.324082+0000","last_became_peered":"2024-04-18T04:44:34.324082+0000","last_unstale":"2024-04-18T04:44:35.202122+0000","last_undegraded":"2024-04-18T04:44:35.202122+0000","last_fullsized":"2024-04-18T04:44:35.202122+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:28:10.378037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.311743+0000","last_change":"2024-04-18T04:44:30.276174+0000","last_active":"2024-04-18T04:44:34.311743+0000","last_peered":"2024-04-18T04:44:34.311743+0000","last_clean":"2024-04-18T04:44:34.311743+0000","last_became_active":"2024-04-18T04:44:30.270878+0000","last_became_peered":"2024-04-18T04:44:30.270878+0000","last_unstale":"2024-04-18T04:44:34.311743+0000","last_undegraded":"2024-04-18T04:44:34.311743+0000","last_fullsized":"2024-04-18T04:44:34.311743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:35:12.296277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.309548+0000","last_change":"2024-04-18T04:44:29.896745+0000","last_active":"2024-04-18T04:44:34.309548+0000","last_peered":"2024-04-18T04:44:34.309548+0000","last_clean":"2024-04-18T04:44:34.309548+0000","last_became_active":"2024-04-18T04:44:29.896199+0000","last_became_peered":"2024-04-18T04:44:29.896199+0000","last_unstale":"2024-04-18T04:44:34.309548+0000","last_undegraded":"2024-04-18T04:44:34.309548+0000","last_fullsized":"2024-04-18T04:44:34.309548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:25:05.424668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.202607+0000","last_change":"2024-04-18T04:44:34.337429+0000","last_active":"2024-04-18T04:44:35.202607+0000","last_peered":"2024-04-18T04:44:35.202607+0000","last_clean":"2024-04-18T04:44:35.202607+0000","last_became_active":"2024-04-18T04:44:34.337089+0000","last_became_peered":"2024-04-18T04:44:34.337089+0000","last_unstale":"2024-04-18T04:44:35.202607+0000","last_undegraded":"2024-04-18T04:44:35.202607+0000","last_fullsized":"2024-04-18T04:44:35.202607+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:00:56.976431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.297789+0000","last_change":"2024-04-18T04:44:30.270874+0000","last_active":"2024-04-18T04:44:34.297789+0000","last_peered":"2024-04-18T04:44:34.297789+0000","last_clean":"2024-04-18T04:44:34.297789+0000","last_became_active":"2024-04-18T04:44:30.270636+0000","last_became_peered":"2024-04-18T04:44:30.270636+0000","last_unstale":"2024-04-18T04:44:34.297789+0000","last_undegraded":"2024-04-18T04:44:34.297789+0000","last_fullsized":"2024-04-18T04:44:34.297789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:25:49.889554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.285207+0000","last_change":"2024-04-18T04:44:29.878607+0000","last_active":"2024-04-18T04:44:34.285207+0000","last_peered":"2024-04-18T04:44:34.285207+0000","last_clean":"2024-04-18T04:44:34.285207+0000","last_became_active":"2024-04-18T04:44:29.878330+0000","last_became_peered":"2024-04-18T04:44:29.878330+0000","last_unstale":"2024-04-18T04:44:34.285207+0000","last_undegraded":"2024-04-18T04:44:34.285207+0000","last_fullsized":"2024-04-18T04:44:34.285207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:09:18.088701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.202964+0000","last_change":"2024-04-18T04:44:34.323315+0000","last_active":"2024-04-18T04:44:35.202964+0000","last_peered":"2024-04-18T04:44:35.202964+0000","last_clean":"2024-04-18T04:44:35.202964+0000","last_became_active":"2024-04-18T04:44:34.322983+0000","last_became_peered":"2024-04-18T04:44:34.322983+0000","last_unstale":"2024-04-18T04:44:35.202964+0000","last_undegraded":"2024-04-18T04:44:35.202964+0000","last_fullsized":"2024-04-18T04:44:35.202964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:48:12.803273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287313+0000","last_change":"2024-04-18T04:44:30.285533+0000","last_active":"2024-04-18T04:44:34.287313+0000","last_peered":"2024-04-18T04:44:34.287313+0000","last_clean":"2024-04-18T04:44:34.287313+0000","last_became_active":"2024-04-18T04:44:30.285113+0000","last_became_peered":"2024-04-18T04:44:30.285113+0000","last_unstale":"2024-04-18T04:44:34.287313+0000","last_undegraded":"2024-04-18T04:44:34.287313+0000","last_fullsized":"2024-04-18T04:44:34.287313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:37:20.367349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287255+0000","last_change":"2024-04-18T04:44:29.890701+0000","last_active":"2024-04-18T04:44:34.287255+0000","last_peered":"2024-04-18T04:44:34.287255+0000","last_clean":"2024-04-18T04:44:34.287255+0000","last_became_active":"2024-04-18T04:44:29.890207+0000","last_became_peered":"2024-04-18T04:44:29.890207+0000","last_unstale":"2024-04-18T04:44:34.287255+0000","last_undegraded":"2024-04-18T04:44:34.287255+0000","last_fullsized":"2024-04-18T04:44:34.287255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:06:58.470725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.188159+0000","last_change":"2024-04-18T04:44:34.306858+0000","last_active":"2024-04-18T04:44:35.188159+0000","last_peered":"2024-04-18T04:44:35.188159+0000","last_clean":"2024-04-18T04:44:35.188159+0000","last_became_active":"2024-04-18T04:44:34.306123+0000","last_became_peered":"2024-04-18T04:44:34.306123+0000","last_unstale":"2024-04-18T04:44:35.188159+0000","last_undegraded":"2024-04-18T04:44:35.188159+0000","last_fullsized":"2024-04-18T04:44:35.188159+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:13:26.389394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.289157+0000","last_change":"2024-04-18T04:44:30.306826+0000","last_active":"2024-04-18T04:44:34.289157+0000","last_peered":"2024-04-18T04:44:34.289157+0000","last_clean":"2024-04-18T04:44:34.289157+0000","last_became_active":"2024-04-18T04:44:30.306320+0000","last_became_peered":"2024-04-18T04:44:30.306320+0000","last_unstale":"2024-04-18T04:44:34.289157+0000","last_undegraded":"2024-04-18T04:44:34.289157+0000","last_fullsized":"2024-04-18T04:44:34.289157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:47:38.564197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.309565+0000","last_change":"2024-04-18T04:44:29.888023+0000","last_active":"2024-04-18T04:44:34.309565+0000","last_peered":"2024-04-18T04:44:34.309565+0000","last_clean":"2024-04-18T04:44:34.309565+0000","last_became_active":"2024-04-18T04:44:29.887440+0000","last_became_peered":"2024-04-18T04:44:29.887440+0000","last_unstale":"2024-04-18T04:44:34.309565+0000","last_undegraded":"2024-04-18T04:44:34.309565+0000","last_fullsized":"2024-04-18T04:44:34.309565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:07:01.067445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287497+0000","last_change":"2024-04-18T04:44:18.629794+0000","last_active":"2024-04-18T04:44:34.287497+0000","last_peered":"2024-04-18T04:44:34.287497+0000","last_clean":"2024-04-18T04:44:34.287497+0000","last_became_active":"2024-04-18T04:44:18.627792+0000","last_became_peered":"2024-04-18T04:44:18.627792+0000","last_unstale":"2024-04-18T04:44:34.287497+0000","last_undegraded":"2024-04-18T04:44:34.287497+0000","last_fullsized":"2024-04-18T04:44:34.287497+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:17.410146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:17.410146+0000","last_clean_scrub_stamp":"2024-04-18T04:44:17.410146+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:30:49.101656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.203752+0000","last_change":"2024-04-18T04:44:34.333286+0000","last_active":"2024-04-18T04:44:35.203752+0000","last_peered":"2024-04-18T04:44:35.203752+0000","last_clean":"2024-04-18T04:44:35.203752+0000","last_became_active":"2024-04-18T04:44:34.332520+0000","last_became_peered":"2024-04-18T04:44:34.332520+0000","last_unstale":"2024-04-18T04:44:35.203752+0000","last_undegraded":"2024-04-18T04:44:35.203752+0000","last_fullsized":"2024-04-18T04:44:35.203752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:58:48.264040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.295974+0000","last_change":"2024-04-18T04:44:30.303602+0000","last_active":"2024-04-18T04:44:34.295974+0000","last_peered":"2024-04-18T04:44:34.295974+0000","last_clean":"2024-04-18T04:44:34.295974+0000","last_became_active":"2024-04-18T04:44:30.302157+0000","last_became_peered":"2024-04-18T04:44:30.302157+0000","last_unstale":"2024-04-18T04:44:34.295974+0000","last_undegraded":"2024-04-18T04:44:34.295974+0000","last_fullsized":"2024-04-18T04:44:34.295974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:09:57.582065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.285561+0000","last_change":"2024-04-18T04:44:29.890428+0000","last_active":"2024-04-18T04:44:34.285561+0000","last_peered":"2024-04-18T04:44:34.285561+0000","last_clean":"2024-04-18T04:44:34.285561+0000","last_became_active":"2024-04-18T04:44:29.890166+0000","last_became_peered":"2024-04-18T04:44:29.890166+0000","last_unstale":"2024-04-18T04:44:34.285561+0000","last_undegraded":"2024-04-18T04:44:34.285561+0000","last_fullsized":"2024-04-18T04:44:34.285561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:21:16.823377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.202663+0000","last_change":"2024-04-18T04:44:34.334071+0000","last_active":"2024-04-18T04:44:35.202663+0000","last_peered":"2024-04-18T04:44:35.202663+0000","last_clean":"2024-04-18T04:44:35.202663+0000","last_became_active":"2024-04-18T04:44:34.332695+0000","last_became_peered":"2024-04-18T04:44:34.332695+0000","last_unstale":"2024-04-18T04:44:35.202663+0000","last_undegraded":"2024-04-18T04:44:35.202663+0000","last_fullsized":"2024-04-18T04:44:35.202663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:22:52.371921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.309847+0000","last_change":"2024-04-18T04:44:30.287908+0000","last_active":"2024-04-18T04:44:34.309847+0000","last_peered":"2024-04-18T04:44:34.309847+0000","last_clean":"2024-04-18T04:44:34.309847+0000","last_became_active":"2024-04-18T04:44:30.287217+0000","last_became_peered":"2024-04-18T04:44:30.287217+0000","last_unstale":"2024-04-18T04:44:34.309847+0000","last_undegraded":"2024-04-18T04:44:34.309847+0000","last_fullsized":"2024-04-18T04:44:34.309847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:47:14.962330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.202737+0000","last_change":"2024-04-18T04:44:29.886376+0000","last_active":"2024-04-18T04:44:35.202737+0000","last_peered":"2024-04-18T04:44:35.202737+0000","last_clean":"2024-04-18T04:44:35.202737+0000","last_became_active":"2024-04-18T04:44:29.886058+0000","last_became_peered":"2024-04-18T04:44:29.886058+0000","last_unstale":"2024-04-18T04:44:35.202737+0000","last_undegraded":"2024-04-18T04:44:35.202737+0000","last_fullsized":"2024-04-18T04:44:35.202737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:29:59.678071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.188072+0000","last_change":"2024-04-18T04:44:34.323046+0000","last_active":"2024-04-18T04:44:35.188072+0000","last_peered":"2024-04-18T04:44:35.188072+0000","last_clean":"2024-04-18T04:44:35.188072+0000","last_became_active":"2024-04-18T04:44:34.322785+0000","last_became_peered":"2024-04-18T04:44:34.322785+0000","last_unstale":"2024-04-18T04:44:35.188072+0000","last_undegraded":"2024-04-18T04:44:35.188072+0000","last_fullsized":"2024-04-18T04:44:35.188072+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:53:47.315572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.293500+0000","last_change":"2024-04-18T04:44:30.289872+0000","last_active":"2024-04-18T04:44:34.293500+0000","last_peered":"2024-04-18T04:44:34.293500+0000","last_clean":"2024-04-18T04:44:34.293500+0000","last_became_active":"2024-04-18T04:44:30.288606+0000","last_became_peered":"2024-04-18T04:44:30.288606+0000","last_unstale":"2024-04-18T04:44:34.293500+0000","last_undegraded":"2024-04-18T04:44:34.293500+0000","last_fullsized":"2024-04-18T04:44:34.293500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:00:57.740649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.267690+0000","last_change":"2024-04-18T04:44:29.878650+0000","last_active":"2024-04-18T04:44:35.267690+0000","last_peered":"2024-04-18T04:44:35.267690+0000","last_clean":"2024-04-18T04:44:35.267690+0000","last_became_active":"2024-04-18T04:44:29.878361+0000","last_became_peered":"2024-04-18T04:44:29.878361+0000","last_unstale":"2024-04-18T04:44:35.267690+0000","last_undegraded":"2024-04-18T04:44:35.267690+0000","last_fullsized":"2024-04-18T04:44:35.267690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:57:41.162118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.202529+0000","last_change":"2024-04-18T04:44:34.339023+0000","last_active":"2024-04-18T04:44:35.202529+0000","last_peered":"2024-04-18T04:44:35.202529+0000","last_clean":"2024-04-18T04:44:35.202529+0000","last_became_active":"2024-04-18T04:44:34.338042+0000","last_became_peered":"2024-04-18T04:44:34.338042+0000","last_unstale":"2024-04-18T04:44:35.202529+0000","last_undegraded":"2024-04-18T04:44:35.202529+0000","last_fullsized":"2024-04-18T04:44:35.202529+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:48:58.174635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.290165+0000","last_change":"2024-04-18T04:44:30.291740+0000","last_active":"2024-04-18T04:44:34.290165+0000","last_peered":"2024-04-18T04:44:34.290165+0000","last_clean":"2024-04-18T04:44:34.290165+0000","last_became_active":"2024-04-18T04:44:30.290379+0000","last_became_peered":"2024-04-18T04:44:30.290379+0000","last_unstale":"2024-04-18T04:44:34.290165+0000","last_undegraded":"2024-04-18T04:44:34.290165+0000","last_fullsized":"2024-04-18T04:44:34.290165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:44:25.111858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.686910+0000","last_change":"2024-04-18T04:44:29.882833+0000","last_active":"2024-04-18T04:44:34.686910+0000","last_peered":"2024-04-18T04:44:34.686910+0000","last_clean":"2024-04-18T04:44:34.686910+0000","last_became_active":"2024-04-18T04:44:29.881671+0000","last_became_peered":"2024-04-18T04:44:29.881671+0000","last_unstale":"2024-04-18T04:44:34.686910+0000","last_undegraded":"2024-04-18T04:44:34.686910+0000","last_fullsized":"2024-04-18T04:44:34.686910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:29:22.037641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.684253+0000","last_change":"2024-04-18T04:44:34.342465+0000","last_active":"2024-04-18T04:44:34.684253+0000","last_peered":"2024-04-18T04:44:34.684253+0000","last_clean":"2024-04-18T04:44:34.684253+0000","last_became_active":"2024-04-18T04:44:34.340327+0000","last_became_peered":"2024-04-18T04:44:34.340327+0000","last_unstale":"2024-04-18T04:44:34.684253+0000","last_undegraded":"2024-04-18T04:44:34.684253+0000","last_fullsized":"2024-04-18T04:44:34.684253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:31:44.168899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287509+0000","last_change":"2024-04-18T04:44:30.299403+0000","last_active":"2024-04-18T04:44:34.287509+0000","last_peered":"2024-04-18T04:44:34.287509+0000","last_clean":"2024-04-18T04:44:34.287509+0000","last_became_active":"2024-04-18T04:44:30.298417+0000","last_became_peered":"2024-04-18T04:44:30.298417+0000","last_unstale":"2024-04-18T04:44:34.287509+0000","last_undegraded":"2024-04-18T04:44:34.287509+0000","last_fullsized":"2024-04-18T04:44:34.287509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:43:24.120294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.271251+0000","last_change":"2024-04-18T04:44:29.875345+0000","last_active":"2024-04-18T04:44:35.271251+0000","last_peered":"2024-04-18T04:44:35.271251+0000","last_clean":"2024-04-18T04:44:35.271251+0000","last_became_active":"2024-04-18T04:44:29.875059+0000","last_became_peered":"2024-04-18T04:44:29.875059+0000","last_unstale":"2024-04-18T04:44:35.271251+0000","last_undegraded":"2024-04-18T04:44:35.271251+0000","last_fullsized":"2024-04-18T04:44:35.271251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:06:54.218096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.188129+0000","last_change":"2024-04-18T04:44:34.334498+0000","last_active":"2024-04-18T04:44:35.188129+0000","last_peered":"2024-04-18T04:44:35.188129+0000","last_clean":"2024-04-18T04:44:35.188129+0000","last_became_active":"2024-04-18T04:44:34.334192+0000","last_became_peered":"2024-04-18T04:44:34.334192+0000","last_unstale":"2024-04-18T04:44:35.188129+0000","last_undegraded":"2024-04-18T04:44:35.188129+0000","last_fullsized":"2024-04-18T04:44:35.188129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:15:49.669556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287990+0000","last_change":"2024-04-18T04:44:30.298289+0000","last_active":"2024-04-18T04:44:34.287990+0000","last_peered":"2024-04-18T04:44:34.287990+0000","last_clean":"2024-04-18T04:44:34.287990+0000","last_became_active":"2024-04-18T04:44:30.295404+0000","last_became_peered":"2024-04-18T04:44:30.295404+0000","last_unstale":"2024-04-18T04:44:34.287990+0000","last_undegraded":"2024-04-18T04:44:34.287990+0000","last_fullsized":"2024-04-18T04:44:34.287990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:10:32.465032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.288381+0000","last_change":"2024-04-18T04:44:29.894196+0000","last_active":"2024-04-18T04:44:34.288381+0000","last_peered":"2024-04-18T04:44:34.288381+0000","last_clean":"2024-04-18T04:44:34.288381+0000","last_became_active":"2024-04-18T04:44:29.893668+0000","last_became_peered":"2024-04-18T04:44:29.893668+0000","last_unstale":"2024-04-18T04:44:34.288381+0000","last_undegraded":"2024-04-18T04:44:34.288381+0000","last_fullsized":"2024-04-18T04:44:34.288381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:39:03.812043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.681603+0000","last_change":"2024-04-18T04:44:34.339050+0000","last_active":"2024-04-18T04:44:34.681603+0000","last_peered":"2024-04-18T04:44:34.681603+0000","last_clean":"2024-04-18T04:44:34.681603+0000","last_became_active":"2024-04-18T04:44:34.338877+0000","last_became_peered":"2024-04-18T04:44:34.338877+0000","last_unstale":"2024-04-18T04:44:34.681603+0000","last_undegraded":"2024-04-18T04:44:34.681603+0000","last_fullsized":"2024-04-18T04:44:34.681603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:09:17.919847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.288247+0000","last_change":"2024-04-18T04:44:30.289122+0000","last_active":"2024-04-18T04:44:34.288247+0000","last_peered":"2024-04-18T04:44:34.288247+0000","last_clean":"2024-04-18T04:44:34.288247+0000","last_became_active":"2024-04-18T04:44:30.288364+0000","last_became_peered":"2024-04-18T04:44:30.288364+0000","last_unstale":"2024-04-18T04:44:34.288247+0000","last_undegraded":"2024-04-18T04:44:34.288247+0000","last_fullsized":"2024-04-18T04:44:34.288247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:04:02.162723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.307535+0000","last_change":"2024-04-18T04:44:29.894521+0000","last_active":"2024-04-18T04:44:34.307535+0000","last_peered":"2024-04-18T04:44:34.307535+0000","last_clean":"2024-04-18T04:44:34.307535+0000","last_became_active":"2024-04-18T04:44:29.889150+0000","last_became_peered":"2024-04-18T04:44:29.889150+0000","last_unstale":"2024-04-18T04:44:34.307535+0000","last_undegraded":"2024-04-18T04:44:34.307535+0000","last_fullsized":"2024-04-18T04:44:34.307535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:39:13.323434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.681213+0000","last_change":"2024-04-18T04:44:34.305657+0000","last_active":"2024-04-18T04:44:34.681213+0000","last_peered":"2024-04-18T04:44:34.681213+0000","last_clean":"2024-04-18T04:44:34.681213+0000","last_became_active":"2024-04-18T04:44:34.305341+0000","last_became_peered":"2024-04-18T04:44:34.305341+0000","last_unstale":"2024-04-18T04:44:34.681213+0000","last_undegraded":"2024-04-18T04:44:34.681213+0000","last_fullsized":"2024-04-18T04:44:34.681213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:32:39.937173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287291+0000","last_change":"2024-04-18T04:44:30.307042+0000","last_active":"2024-04-18T04:44:34.287291+0000","last_peered":"2024-04-18T04:44:34.287291+0000","last_clean":"2024-04-18T04:44:34.287291+0000","last_became_active":"2024-04-18T04:44:30.306726+0000","last_became_peered":"2024-04-18T04:44:30.306726+0000","last_unstale":"2024-04-18T04:44:34.287291+0000","last_undegraded":"2024-04-18T04:44:34.287291+0000","last_fullsized":"2024-04-18T04:44:34.287291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:55:33.543142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.273530+0000","last_change":"2024-04-18T04:44:29.887498+0000","last_active":"2024-04-18T04:44:35.273530+0000","last_peered":"2024-04-18T04:44:35.273530+0000","last_clean":"2024-04-18T04:44:35.273530+0000","last_became_active":"2024-04-18T04:44:29.887095+0000","last_became_peered":"2024-04-18T04:44:29.887095+0000","last_unstale":"2024-04-18T04:44:35.273530+0000","last_undegraded":"2024-04-18T04:44:35.273530+0000","last_fullsized":"2024-04-18T04:44:35.273530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:54:34.700562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.203621+0000","last_change":"2024-04-18T04:44:34.322042+0000","last_active":"2024-04-18T04:44:35.203621+0000","last_peered":"2024-04-18T04:44:35.203621+0000","last_clean":"2024-04-18T04:44:35.203621+0000","last_became_active":"2024-04-18T04:44:34.320776+0000","last_became_peered":"2024-04-18T04:44:34.320776+0000","last_unstale":"2024-04-18T04:44:35.203621+0000","last_undegraded":"2024-04-18T04:44:35.203621+0000","last_fullsized":"2024-04-18T04:44:35.203621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:53:47.399337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.295755+0000","last_change":"2024-04-18T04:44:30.299413+0000","last_active":"2024-04-18T04:44:34.295755+0000","last_peered":"2024-04-18T04:44:34.295755+0000","last_clean":"2024-04-18T04:44:34.295755+0000","last_became_active":"2024-04-18T04:44:30.293185+0000","last_became_peered":"2024-04-18T04:44:30.293185+0000","last_unstale":"2024-04-18T04:44:34.295755+0000","last_undegraded":"2024-04-18T04:44:34.295755+0000","last_fullsized":"2024-04-18T04:44:34.295755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:43:53.831429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:44.310346+0000","last_change":"2024-04-18T04:44:29.893351+0000","last_active":"2024-04-18T04:44:44.310346+0000","last_peered":"2024-04-18T04:44:44.310346+0000","last_clean":"2024-04-18T04:44:44.310346+0000","last_became_active":"2024-04-18T04:44:29.892647+0000","last_became_peered":"2024-04-18T04:44:29.892647+0000","last_unstale":"2024-04-18T04:44:44.310346+0000","last_undegraded":"2024-04-18T04:44:44.310346+0000","last_fullsized":"2024-04-18T04:44:44.310346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:16:59.759149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.202231+0000","last_change":"2024-04-18T04:44:34.337866+0000","last_active":"2024-04-18T04:44:35.202231+0000","last_peered":"2024-04-18T04:44:35.202231+0000","last_clean":"2024-04-18T04:44:35.202231+0000","last_became_active":"2024-04-18T04:44:34.337486+0000","last_became_peered":"2024-04-18T04:44:34.337486+0000","last_unstale":"2024-04-18T04:44:35.202231+0000","last_undegraded":"2024-04-18T04:44:35.202231+0000","last_fullsized":"2024-04-18T04:44:35.202231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:42:13.751926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.304604+0000","last_change":"2024-04-18T04:44:30.308477+0000","last_active":"2024-04-18T04:44:34.304604+0000","last_peered":"2024-04-18T04:44:34.304604+0000","last_clean":"2024-04-18T04:44:34.304604+0000","last_became_active":"2024-04-18T04:44:30.307237+0000","last_became_peered":"2024-04-18T04:44:30.307237+0000","last_unstale":"2024-04-18T04:44:34.304604+0000","last_undegraded":"2024-04-18T04:44:34.304604+0000","last_fullsized":"2024-04-18T04:44:34.304604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:33:58.300542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.271124+0000","last_change":"2024-04-18T04:44:29.898488+0000","last_active":"2024-04-18T04:44:35.271124+0000","last_peered":"2024-04-18T04:44:35.271124+0000","last_clean":"2024-04-18T04:44:35.271124+0000","last_became_active":"2024-04-18T04:44:29.898113+0000","last_became_peered":"2024-04-18T04:44:29.898113+0000","last_unstale":"2024-04-18T04:44:35.271124+0000","last_undegraded":"2024-04-18T04:44:35.271124+0000","last_fullsized":"2024-04-18T04:44:35.271124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:11:14.585142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.685293+0000","last_change":"2024-04-18T04:44:34.344769+0000","last_active":"2024-04-18T04:44:34.685293+0000","last_peered":"2024-04-18T04:44:34.685293+0000","last_clean":"2024-04-18T04:44:34.685293+0000","last_became_active":"2024-04-18T04:44:34.343636+0000","last_became_peered":"2024-04-18T04:44:34.343636+0000","last_unstale":"2024-04-18T04:44:34.685293+0000","last_undegraded":"2024-04-18T04:44:34.685293+0000","last_fullsized":"2024-04-18T04:44:34.685293+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:45:09.481681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287417+0000","last_change":"2024-04-18T04:44:30.290494+0000","last_active":"2024-04-18T04:44:34.287417+0000","last_peered":"2024-04-18T04:44:34.287417+0000","last_clean":"2024-04-18T04:44:34.287417+0000","last_became_active":"2024-04-18T04:44:30.290127+0000","last_became_peered":"2024-04-18T04:44:30.290127+0000","last_unstale":"2024-04-18T04:44:34.287417+0000","last_undegraded":"2024-04-18T04:44:34.287417+0000","last_fullsized":"2024-04-18T04:44:34.287417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:34:21.239813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.309224+0000","last_change":"2024-04-18T04:44:29.895686+0000","last_active":"2024-04-18T04:44:34.309224+0000","last_peered":"2024-04-18T04:44:34.309224+0000","last_clean":"2024-04-18T04:44:34.309224+0000","last_became_active":"2024-04-18T04:44:29.895083+0000","last_became_peered":"2024-04-18T04:44:29.895083+0000","last_unstale":"2024-04-18T04:44:34.309224+0000","last_undegraded":"2024-04-18T04:44:34.309224+0000","last_fullsized":"2024-04-18T04:44:34.309224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:27:17.897401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.680895+0000","last_change":"2024-04-18T04:44:34.338412+0000","last_active":"2024-04-18T04:44:34.680895+0000","last_peered":"2024-04-18T04:44:34.680895+0000","last_clean":"2024-04-18T04:44:34.680895+0000","last_became_active":"2024-04-18T04:44:34.338062+0000","last_became_peered":"2024-04-18T04:44:34.338062+0000","last_unstale":"2024-04-18T04:44:34.680895+0000","last_undegraded":"2024-04-18T04:44:34.680895+0000","last_fullsized":"2024-04-18T04:44:34.680895+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:49:28.342905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.307374+0000","last_change":"2024-04-18T04:44:30.307946+0000","last_active":"2024-04-18T04:44:34.307374+0000","last_peered":"2024-04-18T04:44:34.307374+0000","last_clean":"2024-04-18T04:44:34.307374+0000","last_became_active":"2024-04-18T04:44:30.307168+0000","last_became_peered":"2024-04-18T04:44:30.307168+0000","last_unstale":"2024-04-18T04:44:34.307374+0000","last_undegraded":"2024-04-18T04:44:34.307374+0000","last_fullsized":"2024-04-18T04:44:34.307374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:43:56.218333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.294423+0000","last_change":"2024-04-18T04:44:29.903183+0000","last_active":"2024-04-18T04:44:34.294423+0000","last_peered":"2024-04-18T04:44:34.294423+0000","last_clean":"2024-04-18T04:44:34.294423+0000","last_became_active":"2024-04-18T04:44:29.902647+0000","last_became_peered":"2024-04-18T04:44:29.902647+0000","last_unstale":"2024-04-18T04:44:34.294423+0000","last_undegraded":"2024-04-18T04:44:34.294423+0000","last_fullsized":"2024-04-18T04:44:34.294423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:45:13.009571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.680985+0000","last_change":"2024-04-18T04:44:34.338653+0000","last_active":"2024-04-18T04:44:34.680985+0000","last_peered":"2024-04-18T04:44:34.680985+0000","last_clean":"2024-04-18T04:44:34.680985+0000","last_became_active":"2024-04-18T04:44:34.338288+0000","last_became_peered":"2024-04-18T04:44:34.338288+0000","last_unstale":"2024-04-18T04:44:34.680985+0000","last_undegraded":"2024-04-18T04:44:34.680985+0000","last_fullsized":"2024-04-18T04:44:34.680985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:58:27.654288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.188114+0000","last_change":"2024-04-18T04:44:34.306999+0000","last_active":"2024-04-18T04:44:35.188114+0000","last_peered":"2024-04-18T04:44:35.188114+0000","last_clean":"2024-04-18T04:44:35.188114+0000","last_became_active":"2024-04-18T04:44:34.306657+0000","last_became_peered":"2024-04-18T04:44:34.306657+0000","last_unstale":"2024-04-18T04:44:35.188114+0000","last_undegraded":"2024-04-18T04:44:35.188114+0000","last_fullsized":"2024-04-18T04:44:35.188114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:52:58.512928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.297434+0000","last_change":"2024-04-18T04:44:30.271947+0000","last_active":"2024-04-18T04:44:34.297434+0000","last_peered":"2024-04-18T04:44:34.297434+0000","last_clean":"2024-04-18T04:44:34.297434+0000","last_became_active":"2024-04-18T04:44:30.271619+0000","last_became_peered":"2024-04-18T04:44:30.271619+0000","last_unstale":"2024-04-18T04:44:34.297434+0000","last_undegraded":"2024-04-18T04:44:34.297434+0000","last_fullsized":"2024-04-18T04:44:34.297434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:32:11.612016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.307211+0000","last_change":"2024-04-18T04:44:29.897616+0000","last_active":"2024-04-18T04:44:34.307211+0000","last_peered":"2024-04-18T04:44:34.307211+0000","last_clean":"2024-04-18T04:44:34.307211+0000","last_became_active":"2024-04-18T04:44:29.889922+0000","last_became_peered":"2024-04-18T04:44:29.889922+0000","last_unstale":"2024-04-18T04:44:34.307211+0000","last_undegraded":"2024-04-18T04:44:34.307211+0000","last_fullsized":"2024-04-18T04:44:34.307211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:11:52.717768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.204973+0000","last_change":"2024-04-18T04:44:34.333403+0000","last_active":"2024-04-18T04:44:35.204973+0000","last_peered":"2024-04-18T04:44:35.204973+0000","last_clean":"2024-04-18T04:44:35.204973+0000","last_became_active":"2024-04-18T04:44:34.332551+0000","last_became_peered":"2024-04-18T04:44:34.332551+0000","last_unstale":"2024-04-18T04:44:35.204973+0000","last_undegraded":"2024-04-18T04:44:35.204973+0000","last_fullsized":"2024-04-18T04:44:35.204973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:33:28.594002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.288936+0000","last_change":"2024-04-18T04:44:30.271099+0000","last_active":"2024-04-18T04:44:34.288936+0000","last_peered":"2024-04-18T04:44:34.288936+0000","last_clean":"2024-04-18T04:44:34.288936+0000","last_became_active":"2024-04-18T04:44:30.270804+0000","last_became_peered":"2024-04-18T04:44:30.270804+0000","last_unstale":"2024-04-18T04:44:34.288936+0000","last_undegraded":"2024-04-18T04:44:34.288936+0000","last_fullsized":"2024-04-18T04:44:34.288936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:18:27.955171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.289697+0000","last_change":"2024-04-18T04:44:29.895084+0000","last_active":"2024-04-18T04:44:34.289697+0000","last_peered":"2024-04-18T04:44:34.289697+0000","last_clean":"2024-04-18T04:44:34.289697+0000","last_became_active":"2024-04-18T04:44:29.894829+0000","last_became_peered":"2024-04-18T04:44:29.894829+0000","last_unstale":"2024-04-18T04:44:34.289697+0000","last_undegraded":"2024-04-18T04:44:34.289697+0000","last_fullsized":"2024-04-18T04:44:34.289697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:54.812428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.203324+0000","last_change":"2024-04-18T04:44:29.892826+0000","last_active":"2024-04-18T04:44:35.203324+0000","last_peered":"2024-04-18T04:44:35.203324+0000","last_clean":"2024-04-18T04:44:35.203324+0000","last_became_active":"2024-04-18T04:44:29.892282+0000","last_became_peered":"2024-04-18T04:44:29.892282+0000","last_unstale":"2024-04-18T04:44:35.203324+0000","last_undegraded":"2024-04-18T04:44:35.203324+0000","last_fullsized":"2024-04-18T04:44:35.203324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:02.844116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.288503+0000","last_change":"2024-04-18T04:44:30.285312+0000","last_active":"2024-04-18T04:44:34.288503+0000","last_peered":"2024-04-18T04:44:34.288503+0000","last_clean":"2024-04-18T04:44:34.288503+0000","last_became_active":"2024-04-18T04:44:30.285055+0000","last_became_peered":"2024-04-18T04:44:30.285055+0000","last_unstale":"2024-04-18T04:44:34.288503+0000","last_undegraded":"2024-04-18T04:44:34.288503+0000","last_fullsized":"2024-04-18T04:44:34.288503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:50:00.641018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.790995+0000","last_change":"2024-04-18T04:44:34.323352+0000","last_active":"2024-04-18T04:44:34.790995+0000","last_peered":"2024-04-18T04:44:34.790995+0000","last_clean":"2024-04-18T04:44:34.790995+0000","last_became_active":"2024-04-18T04:44:34.321645+0000","last_became_peered":"2024-04-18T04:44:34.321645+0000","last_unstale":"2024-04-18T04:44:34.790995+0000","last_undegraded":"2024-04-18T04:44:34.790995+0000","last_fullsized":"2024-04-18T04:44:34.790995+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:33:27.387013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.681203+0000","last_change":"2024-04-18T04:44:29.891865+0000","last_active":"2024-04-18T04:44:34.681203+0000","last_peered":"2024-04-18T04:44:34.681203+0000","last_clean":"2024-04-18T04:44:34.681203+0000","last_became_active":"2024-04-18T04:44:29.891610+0000","last_became_peered":"2024-04-18T04:44:29.891610+0000","last_unstale":"2024-04-18T04:44:34.681203+0000","last_undegraded":"2024-04-18T04:44:34.681203+0000","last_fullsized":"2024-04-18T04:44:34.681203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:36:42.266497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.310919+0000","last_change":"2024-04-18T04:44:30.279080+0000","last_active":"2024-04-18T04:44:34.310919+0000","last_peered":"2024-04-18T04:44:34.310919+0000","last_clean":"2024-04-18T04:44:34.310919+0000","last_became_active":"2024-04-18T04:44:30.278275+0000","last_became_peered":"2024-04-18T04:44:30.278275+0000","last_unstale":"2024-04-18T04:44:34.310919+0000","last_undegraded":"2024-04-18T04:44:34.310919+0000","last_fullsized":"2024-04-18T04:44:34.310919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:51:48.272703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.681364+0000","last_change":"2024-04-18T04:44:34.313835+0000","last_active":"2024-04-18T04:44:34.681364+0000","last_peered":"2024-04-18T04:44:34.681364+0000","last_clean":"2024-04-18T04:44:34.681364+0000","last_became_active":"2024-04-18T04:44:34.313416+0000","last_became_peered":"2024-04-18T04:44:34.313416+0000","last_unstale":"2024-04-18T04:44:34.681364+0000","last_undegraded":"2024-04-18T04:44:34.681364+0000","last_fullsized":"2024-04-18T04:44:34.681364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:57:47.245809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287790+0000","last_change":"2024-04-18T04:44:30.297229+0000","last_active":"2024-04-18T04:44:34.287790+0000","last_peered":"2024-04-18T04:44:34.287790+0000","last_clean":"2024-04-18T04:44:34.287790+0000","last_became_active":"2024-04-18T04:44:30.296354+0000","last_became_peered":"2024-04-18T04:44:30.296354+0000","last_unstale":"2024-04-18T04:44:34.287790+0000","last_undegraded":"2024-04-18T04:44:34.287790+0000","last_fullsized":"2024-04-18T04:44:34.287790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:30:35.845106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.285182+0000","last_change":"2024-04-18T04:44:30.281213+0000","last_active":"2024-04-18T04:44:34.285182+0000","last_peered":"2024-04-18T04:44:34.285182+0000","last_clean":"2024-04-18T04:44:34.285182+0000","last_became_active":"2024-04-18T04:44:30.280941+0000","last_became_peered":"2024-04-18T04:44:30.280941+0000","last_unstale":"2024-04-18T04:44:34.285182+0000","last_undegraded":"2024-04-18T04:44:34.285182+0000","last_fullsized":"2024-04-18T04:44:34.285182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:15:37.795670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.307313+0000","last_change":"2024-04-18T04:44:30.288507+0000","last_active":"2024-04-18T04:44:34.307313+0000","last_peered":"2024-04-18T04:44:34.307313+0000","last_clean":"2024-04-18T04:44:34.307313+0000","last_became_active":"2024-04-18T04:44:30.287820+0000","last_became_peered":"2024-04-18T04:44:30.287820+0000","last_unstale":"2024-04-18T04:44:34.307313+0000","last_undegraded":"2024-04-18T04:44:34.307313+0000","last_fullsized":"2024-04-18T04:44:34.307313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:25:29.500586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.288460+0000","last_change":"2024-04-18T04:44:30.273278+0000","last_active":"2024-04-18T04:44:34.288460+0000","last_peered":"2024-04-18T04:44:34.288460+0000","last_clean":"2024-04-18T04:44:34.288460+0000","last_became_active":"2024-04-18T04:44:30.272973+0000","last_became_peered":"2024-04-18T04:44:30.272973+0000","last_unstale":"2024-04-18T04:44:34.288460+0000","last_undegraded":"2024-04-18T04:44:34.288460+0000","last_fullsized":"2024-04-18T04:44:34.288460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:37:02.421925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.292341+0000","last_change":"2024-04-18T04:44:30.298936+0000","last_active":"2024-04-18T04:44:34.292341+0000","last_peered":"2024-04-18T04:44:34.292341+0000","last_clean":"2024-04-18T04:44:34.292341+0000","last_became_active":"2024-04-18T04:44:30.298637+0000","last_became_peered":"2024-04-18T04:44:30.298637+0000","last_unstale":"2024-04-18T04:44:34.292341+0000","last_undegraded":"2024-04-18T04:44:34.292341+0000","last_fullsized":"2024-04-18T04:44:34.292341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:04:33.188772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.296348+0000","last_change":"2024-04-18T04:44:30.274613+0000","last_active":"2024-04-18T04:44:34.296348+0000","last_peered":"2024-04-18T04:44:34.296348+0000","last_clean":"2024-04-18T04:44:34.296348+0000","last_became_active":"2024-04-18T04:44:30.274328+0000","last_became_peered":"2024-04-18T04:44:30.274328+0000","last_unstale":"2024-04-18T04:44:34.296348+0000","last_undegraded":"2024-04-18T04:44:34.296348+0000","last_fullsized":"2024-04-18T04:44:34.296348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:55:41.700955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.290317+0000","last_change":"2024-04-18T04:44:30.309403+0000","last_active":"2024-04-18T04:44:34.290317+0000","last_peered":"2024-04-18T04:44:34.290317+0000","last_clean":"2024-04-18T04:44:34.290317+0000","last_became_active":"2024-04-18T04:44:30.308415+0000","last_became_peered":"2024-04-18T04:44:30.308415+0000","last_unstale":"2024-04-18T04:44:34.290317+0000","last_undegraded":"2024-04-18T04:44:34.290317+0000","last_fullsized":"2024-04-18T04:44:34.290317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:51:58.935503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.291911+0000","last_change":"2024-04-18T04:44:30.293996+0000","last_active":"2024-04-18T04:44:34.291911+0000","last_peered":"2024-04-18T04:44:34.291911+0000","last_clean":"2024-04-18T04:44:34.291911+0000","last_became_active":"2024-04-18T04:44:30.293748+0000","last_became_peered":"2024-04-18T04:44:30.293748+0000","last_unstale":"2024-04-18T04:44:34.291911+0000","last_undegraded":"2024-04-18T04:44:34.291911+0000","last_fullsized":"2024-04-18T04:44:34.291911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:18:32.116499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.306956+0000","last_change":"2024-04-18T04:44:30.312850+0000","last_active":"2024-04-18T04:44:34.306956+0000","last_peered":"2024-04-18T04:44:34.306956+0000","last_clean":"2024-04-18T04:44:34.306956+0000","last_became_active":"2024-04-18T04:44:30.304701+0000","last_became_peered":"2024-04-18T04:44:30.304701+0000","last_unstale":"2024-04-18T04:44:34.306956+0000","last_undegraded":"2024-04-18T04:44:34.306956+0000","last_fullsized":"2024-04-18T04:44:34.306956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:01:39.253277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.289625+0000","last_change":"2024-04-18T04:44:30.285836+0000","last_active":"2024-04-18T04:44:34.289625+0000","last_peered":"2024-04-18T04:44:34.289625+0000","last_clean":"2024-04-18T04:44:34.289625+0000","last_became_active":"2024-04-18T04:44:30.285602+0000","last_became_peered":"2024-04-18T04:44:30.285602+0000","last_unstale":"2024-04-18T04:44:34.289625+0000","last_undegraded":"2024-04-18T04:44:34.289625+0000","last_fullsized":"2024-04-18T04:44:34.289625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:34:39.594780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.306887+0000","last_change":"2024-04-18T04:44:30.307940+0000","last_active":"2024-04-18T04:44:34.306887+0000","last_peered":"2024-04-18T04:44:34.306887+0000","last_clean":"2024-04-18T04:44:34.306887+0000","last_became_active":"2024-04-18T04:44:30.307224+0000","last_became_peered":"2024-04-18T04:44:30.307224+0000","last_unstale":"2024-04-18T04:44:34.306887+0000","last_undegraded":"2024-04-18T04:44:34.306887+0000","last_fullsized":"2024-04-18T04:44:34.306887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:30:52.000855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.288405+0000","last_change":"2024-04-18T04:44:30.310229+0000","last_active":"2024-04-18T04:44:34.288405+0000","last_peered":"2024-04-18T04:44:34.288405+0000","last_clean":"2024-04-18T04:44:34.288405+0000","last_became_active":"2024-04-18T04:44:30.310045+0000","last_became_peered":"2024-04-18T04:44:30.310045+0000","last_unstale":"2024-04-18T04:44:34.288405+0000","last_undegraded":"2024-04-18T04:44:34.288405+0000","last_fullsized":"2024-04-18T04:44:34.288405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:22:55.588300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.289109+0000","last_change":"2024-04-18T04:44:30.305644+0000","last_active":"2024-04-18T04:44:34.289109+0000","last_peered":"2024-04-18T04:44:34.289109+0000","last_clean":"2024-04-18T04:44:34.289109+0000","last_became_active":"2024-04-18T04:44:30.304921+0000","last_became_peered":"2024-04-18T04:44:30.304921+0000","last_unstale":"2024-04-18T04:44:34.289109+0000","last_undegraded":"2024-04-18T04:44:34.289109+0000","last_fullsized":"2024-04-18T04:44:34.289109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:17:37.235711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.296403+0000","last_change":"2024-04-18T04:44:30.294105+0000","last_active":"2024-04-18T04:44:34.296403+0000","last_peered":"2024-04-18T04:44:34.296403+0000","last_clean":"2024-04-18T04:44:34.296403+0000","last_became_active":"2024-04-18T04:44:30.291742+0000","last_became_peered":"2024-04-18T04:44:30.291742+0000","last_unstale":"2024-04-18T04:44:34.296403+0000","last_undegraded":"2024-04-18T04:44:34.296403+0000","last_fullsized":"2024-04-18T04:44:34.296403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:43:26.428261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.284984+0000","last_change":"2024-04-18T04:44:30.296496+0000","last_active":"2024-04-18T04:44:34.284984+0000","last_peered":"2024-04-18T04:44:34.284984+0000","last_clean":"2024-04-18T04:44:34.284984+0000","last_became_active":"2024-04-18T04:44:30.296177+0000","last_became_peered":"2024-04-18T04:44:30.296177+0000","last_unstale":"2024-04-18T04:44:34.284984+0000","last_undegraded":"2024-04-18T04:44:34.284984+0000","last_fullsized":"2024-04-18T04:44:34.284984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:46:44.829326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.310435+0000","last_change":"2024-04-18T04:44:30.306568+0000","last_active":"2024-04-18T04:44:34.310435+0000","last_peered":"2024-04-18T04:44:34.310435+0000","last_clean":"2024-04-18T04:44:34.310435+0000","last_became_active":"2024-04-18T04:44:30.305674+0000","last_became_peered":"2024-04-18T04:44:30.305674+0000","last_unstale":"2024-04-18T04:44:34.310435+0000","last_undegraded":"2024-04-18T04:44:34.310435+0000","last_fullsized":"2024-04-18T04:44:34.310435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:58:10.740164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.306735+0000","last_change":"2024-04-18T04:44:30.307297+0000","last_active":"2024-04-18T04:44:34.306735+0000","last_peered":"2024-04-18T04:44:34.306735+0000","last_clean":"2024-04-18T04:44:34.306735+0000","last_became_active":"2024-04-18T04:44:30.305470+0000","last_became_peered":"2024-04-18T04:44:30.305470+0000","last_unstale":"2024-04-18T04:44:34.306735+0000","last_undegraded":"2024-04-18T04:44:34.306735+0000","last_fullsized":"2024-04-18T04:44:34.306735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:01:00.587115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.297511+0000","last_change":"2024-04-18T04:44:30.280849+0000","last_active":"2024-04-18T04:44:34.297511+0000","last_peered":"2024-04-18T04:44:34.297511+0000","last_clean":"2024-04-18T04:44:34.297511+0000","last_became_active":"2024-04-18T04:44:30.280535+0000","last_became_peered":"2024-04-18T04:44:30.280535+0000","last_unstale":"2024-04-18T04:44:34.297511+0000","last_undegraded":"2024-04-18T04:44:34.297511+0000","last_fullsized":"2024-04-18T04:44:34.297511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:01:06.241941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287205+0000","last_change":"2024-04-18T04:44:30.278849+0000","last_active":"2024-04-18T04:44:34.287205+0000","last_peered":"2024-04-18T04:44:34.287205+0000","last_clean":"2024-04-18T04:44:34.287205+0000","last_became_active":"2024-04-18T04:44:30.278624+0000","last_became_peered":"2024-04-18T04:44:30.278624+0000","last_unstale":"2024-04-18T04:44:34.287205+0000","last_undegraded":"2024-04-18T04:44:34.287205+0000","last_fullsized":"2024-04-18T04:44:34.287205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:31:30.791150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.289094+0000","last_change":"2024-04-18T04:44:30.296148+0000","last_active":"2024-04-18T04:44:34.289094+0000","last_peered":"2024-04-18T04:44:34.289094+0000","last_clean":"2024-04-18T04:44:34.289094+0000","last_became_active":"2024-04-18T04:44:30.295754+0000","last_became_peered":"2024-04-18T04:44:30.295754+0000","last_unstale":"2024-04-18T04:44:34.289094+0000","last_undegraded":"2024-04-18T04:44:34.289094+0000","last_fullsized":"2024-04-18T04:44:34.289094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:39:53.809075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.304251+0000","last_change":"2024-04-18T04:44:30.298061+0000","last_active":"2024-04-18T04:44:34.304251+0000","last_peered":"2024-04-18T04:44:34.304251+0000","last_clean":"2024-04-18T04:44:34.304251+0000","last_became_active":"2024-04-18T04:44:30.297416+0000","last_became_peered":"2024-04-18T04:44:30.297416+0000","last_unstale":"2024-04-18T04:44:34.304251+0000","last_undegraded":"2024-04-18T04:44:34.304251+0000","last_fullsized":"2024-04-18T04:44:34.304251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:35:48.612670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.290793+0000","last_change":"2024-04-18T04:44:30.292802+0000","last_active":"2024-04-18T04:44:34.290793+0000","last_peered":"2024-04-18T04:44:34.290793+0000","last_clean":"2024-04-18T04:44:34.290793+0000","last_became_active":"2024-04-18T04:44:30.291939+0000","last_became_peered":"2024-04-18T04:44:30.291939+0000","last_unstale":"2024-04-18T04:44:34.290793+0000","last_undegraded":"2024-04-18T04:44:34.290793+0000","last_fullsized":"2024-04-18T04:44:34.290793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:33:04.689561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.290104+0000","last_change":"2024-04-18T04:44:30.309020+0000","last_active":"2024-04-18T04:44:34.290104+0000","last_peered":"2024-04-18T04:44:34.290104+0000","last_clean":"2024-04-18T04:44:34.290104+0000","last_became_active":"2024-04-18T04:44:30.307604+0000","last_became_peered":"2024-04-18T04:44:30.307604+0000","last_unstale":"2024-04-18T04:44:34.290104+0000","last_undegraded":"2024-04-18T04:44:34.290104+0000","last_fullsized":"2024-04-18T04:44:34.290104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:44:54.764284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.293307+0000","last_change":"2024-04-18T04:44:30.314533+0000","last_active":"2024-04-18T04:44:34.293307+0000","last_peered":"2024-04-18T04:44:34.293307+0000","last_clean":"2024-04-18T04:44:34.293307+0000","last_became_active":"2024-04-18T04:44:30.313985+0000","last_became_peered":"2024-04-18T04:44:30.313985+0000","last_unstale":"2024-04-18T04:44:34.293307+0000","last_undegraded":"2024-04-18T04:44:34.293307+0000","last_fullsized":"2024-04-18T04:44:34.293307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:02:03.941709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.288844+0000","last_change":"2024-04-18T04:44:30.309273+0000","last_active":"2024-04-18T04:44:34.288844+0000","last_peered":"2024-04-18T04:44:34.288844+0000","last_clean":"2024-04-18T04:44:34.288844+0000","last_became_active":"2024-04-18T04:44:30.309002+0000","last_became_peered":"2024-04-18T04:44:30.309002+0000","last_unstale":"2024-04-18T04:44:34.288844+0000","last_undegraded":"2024-04-18T04:44:34.288844+0000","last_fullsized":"2024-04-18T04:44:34.288844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:49:10.005359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287466+0000","last_change":"2024-04-18T04:44:30.292371+0000","last_active":"2024-04-18T04:44:34.287466+0000","last_peered":"2024-04-18T04:44:34.287466+0000","last_clean":"2024-04-18T04:44:34.287466+0000","last_became_active":"2024-04-18T04:44:30.290504+0000","last_became_peered":"2024-04-18T04:44:30.290504+0000","last_unstale":"2024-04-18T04:44:34.287466+0000","last_undegraded":"2024-04-18T04:44:34.287466+0000","last_fullsized":"2024-04-18T04:44:34.287466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:11.998355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.306657+0000","last_change":"2024-04-18T04:44:30.299935+0000","last_active":"2024-04-18T04:44:34.306657+0000","last_peered":"2024-04-18T04:44:34.306657+0000","last_clean":"2024-04-18T04:44:34.306657+0000","last_became_active":"2024-04-18T04:44:30.290175+0000","last_became_peered":"2024-04-18T04:44:30.290175+0000","last_unstale":"2024-04-18T04:44:34.306657+0000","last_undegraded":"2024-04-18T04:44:34.306657+0000","last_fullsized":"2024-04-18T04:44:34.306657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:15:13.703423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.288026+0000","last_change":"2024-04-18T04:44:30.288940+0000","last_active":"2024-04-18T04:44:34.288026+0000","last_peered":"2024-04-18T04:44:34.288026+0000","last_clean":"2024-04-18T04:44:34.288026+0000","last_became_active":"2024-04-18T04:44:30.288131+0000","last_became_peered":"2024-04-18T04:44:30.288131+0000","last_unstale":"2024-04-18T04:44:34.288026+0000","last_undegraded":"2024-04-18T04:44:34.288026+0000","last_fullsized":"2024-04-18T04:44:34.288026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:31:08.895305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.307235+0000","last_change":"2024-04-18T04:44:30.288066+0000","last_active":"2024-04-18T04:44:34.307235+0000","last_peered":"2024-04-18T04:44:34.307235+0000","last_clean":"2024-04-18T04:44:34.307235+0000","last_became_active":"2024-04-18T04:44:30.287325+0000","last_became_peered":"2024-04-18T04:44:30.287325+0000","last_unstale":"2024-04-18T04:44:34.307235+0000","last_undegraded":"2024-04-18T04:44:34.307235+0000","last_fullsized":"2024-04-18T04:44:34.307235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:58:04.111225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287906+0000","last_change":"2024-04-18T04:44:30.275485+0000","last_active":"2024-04-18T04:44:34.287906+0000","last_peered":"2024-04-18T04:44:34.287906+0000","last_clean":"2024-04-18T04:44:34.287906+0000","last_became_active":"2024-04-18T04:44:30.275118+0000","last_became_peered":"2024-04-18T04:44:30.275118+0000","last_unstale":"2024-04-18T04:44:34.287906+0000","last_undegraded":"2024-04-18T04:44:34.287906+0000","last_fullsized":"2024-04-18T04:44:34.287906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:25:09.625660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.296349+0000","last_change":"2024-04-18T04:44:30.277119+0000","last_active":"2024-04-18T04:44:34.296349+0000","last_peered":"2024-04-18T04:44:34.296349+0000","last_clean":"2024-04-18T04:44:34.296349+0000","last_became_active":"2024-04-18T04:44:30.276654+0000","last_became_peered":"2024-04-18T04:44:30.276654+0000","last_unstale":"2024-04-18T04:44:34.296349+0000","last_undegraded":"2024-04-18T04:44:34.296349+0000","last_fullsized":"2024-04-18T04:44:34.296349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:52.420199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.293115+0000","last_change":"2024-04-18T04:44:30.302905+0000","last_active":"2024-04-18T04:44:34.293115+0000","last_peered":"2024-04-18T04:44:34.293115+0000","last_clean":"2024-04-18T04:44:34.293115+0000","last_became_active":"2024-04-18T04:44:30.302180+0000","last_became_peered":"2024-04-18T04:44:30.302180+0000","last_unstale":"2024-04-18T04:44:34.293115+0000","last_undegraded":"2024-04-18T04:44:34.293115+0000","last_fullsized":"2024-04-18T04:44:34.293115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:41:53.211956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4594,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66624,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509451,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":106163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]}]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":102367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]}]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":102527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]}]},{"osd":7,"up_from":14,"seq":60129542155,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":693317,"data_compressed":33312,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2689999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]}]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":106163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.179}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.401}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2569999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":262144,"data_stored":102457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1040000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":102493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":335872,"data_stored":693373,"data_compressed":33312,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33312,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33312,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T04:45:00.019 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T04:45:00.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.193+0000 7f841b200640 1 Processor -- start 2024-04-18T04:45:00.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.193+0000 7f841b200640 1 -- start start 2024-04-18T04:45:00.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.197+0000 7f841b200640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8414150340 0x7f8414156430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:00.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.197+0000 7f841b200640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8414156970 0x7f84140c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:00.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.197+0000 7f841b200640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f841406f9b0 con 0x7f84140c7480 2024-04-18T04:45:00.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.197+0000 7f841b200640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84140c0520 con 0x7f8414150340 2024-04-18T04:45:00.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.197+0000 7f841b200640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84140c0800 con 0x7f8414156970 2024-04-18T04:45:00.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.197+0000 7f8413e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8414150340 0x7f8414156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:00.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.197+0000 7f8413e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8414150340 0x7f8414156430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46022/0 (socket says 172.21.15.120:46022) 2024-04-18T04:45:00.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.197+0000 7f8413e00640 1 -- 172.21.15.120:0/3210033277 learned_addr learned my addr 172.21.15.120:0/3210033277 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:00.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.197+0000 7f840b400640 1 --2- 172.21.15.120:0/3210033277 >> v2:172.21.15.132:3300/0 conn(0x7f8414156970 0x7f84140c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:00.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.197+0000 7f8413e00640 1 -- 172.21.15.120:0/3210033277 >> v2:172.21.15.132:3300/0 conn(0x7f8414156970 msgr2=0x7f84140c68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:00.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.197+0000 7f8413e00640 1 --2- 172.21.15.120:0/3210033277 >> v2:172.21.15.132:3300/0 conn(0x7f8414156970 0x7f84140c68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:00.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.197+0000 7f8413e00640 1 -- 172.21.15.120:0/3210033277 >> v1:172.21.15.132:6789/0 conn(0x7f84140c7480 legacy=0x7f8414159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:00.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.197+0000 7f8413e00640 1 -- 172.21.15.120:0/3210033277 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f841406fc20 con 0x7f8414150340 2024-04-18T04:45:00.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.197+0000 7f840b400640 1 --2- 172.21.15.120:0/3210033277 >> v2:172.21.15.132:3300/0 conn(0x7f8414156970 0x7f84140c68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:00.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.197+0000 7f8413e00640 1 --2- 172.21.15.120:0/3210033277 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8414150340 0x7f8414156430 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f841406e4a0 tx=0x7f840401ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7df9b7073314000 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:00.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.201+0000 7f8413400640 1 -- 172.21.15.120:0/3210033277 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84040a89d0 con 0x7f8414150340 2024-04-18T04:45:00.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.201+0000 7f8413400640 1 -- 172.21.15.120:0/3210033277 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84040a8b30 con 0x7f8414150340 2024-04-18T04:45:00.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.201+0000 7f8413400640 1 -- 172.21.15.120:0/3210033277 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84040b0440 con 0x7f8414150340 2024-04-18T04:45:00.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.201+0000 7f841b200640 1 -- 172.21.15.120:0/3210033277 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8414150340 msgr2=0x7f8414156430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:00.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.201+0000 7f841b200640 1 --2- 172.21.15.120:0/3210033277 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8414150340 0x7f8414156430 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f841406e4a0 tx=0x7f840401ecd0 comp rx=0 tx=0).stop 2024-04-18T04:45:00.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.201+0000 7f841b200640 1 -- 172.21.15.120:0/3210033277 shutdown_connections 2024-04-18T04:45:00.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.201+0000 7f841b200640 1 --2- 172.21.15.120:0/3210033277 >> v2:172.21.15.132:3300/0 conn(0x7f8414156970 0x7f84140c68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:00.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.201+0000 7f841b200640 1 --2- 172.21.15.120:0/3210033277 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8414150340 0x7f8414156430 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:00.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.201+0000 7f841b200640 1 -- 172.21.15.120:0/3210033277 >> 172.21.15.120:0/3210033277 conn(0x7f84140c78c0 msgr2=0x7f84140c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:00.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.201+0000 7f841b200640 1 -- 172.21.15.120:0/3210033277 shutdown_connections 2024-04-18T04:45:00.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.201+0000 7f841b200640 1 -- 172.21.15.120:0/3210033277 wait complete. 2024-04-18T04:45:00.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.201+0000 7f841b200640 1 Processor -- start 2024-04-18T04:45:00.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.201+0000 7f841b200640 1 -- start start 2024-04-18T04:45:00.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.201+0000 7f841b200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84140c7480 0x7f8414149230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:00.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.201+0000 7f841b200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8414150340 0x7f84141f6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:00.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.201+0000 7f841b200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84141f2f10 0x7f8414155d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:00.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.201+0000 7f841b200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84140c6ae0 con 0x7f84140c7480 2024-04-18T04:45:00.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.201+0000 7f841b200640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8414154720 con 0x7f8414150340 2024-04-18T04:45:00.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.201+0000 7f841b200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f841414bfb0 con 0x7f84141f2f10 2024-04-18T04:45:00.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.201+0000 7f8413e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84140c7480 0x7f8414149230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:00.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.201+0000 7f8413e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84140c7480 0x7f8414149230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46036/0 (socket says 172.21.15.120:46036) 2024-04-18T04:45:00.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.201+0000 7f8413e00640 1 -- 172.21.15.120:0/1700418661 learned_addr learned my addr 172.21.15.120:0/1700418661 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:00.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.201+0000 7f840b400640 1 --2- 172.21.15.120:0/1700418661 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8414150340 0x7f84141f6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:00.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.201+0000 7f8419200640 1 --2- 172.21.15.120:0/1700418661 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84141f2f10 0x7f8414155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:00.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.201+0000 7f8413e00640 1 -- 172.21.15.120:0/1700418661 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84141f2f10 msgr2=0x7f8414155d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:00.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.201+0000 7f8413e00640 1 --2- 172.21.15.120:0/1700418661 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84141f2f10 0x7f8414155d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:00.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.201+0000 7f8413e00640 1 -- 172.21.15.120:0/1700418661 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8414150340 msgr2=0x7f84141f6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:00.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.201+0000 7f8413e00640 1 --2- 172.21.15.120:0/1700418661 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8414150340 0x7f84141f6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:00.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.201+0000 7f8413e00640 1 -- 172.21.15.120:0/1700418661 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84040094d0 con 0x7f84140c7480 2024-04-18T04:45:00.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.205+0000 7f8413e00640 1 --2- 172.21.15.120:0/1700418661 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84140c7480 0x7f8414149230 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f84040b3040 tx=0x7f840401ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:00.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.205+0000 7f8410c00640 1 -- 172.21.15.120:0/1700418661 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84040b0e80 con 0x7f84140c7480 2024-04-18T04:45:00.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.205+0000 7f8410c00640 1 -- 172.21.15.120:0/1700418661 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84040bb480 con 0x7f84140c7480 2024-04-18T04:45:00.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.205+0000 7f8410c00640 1 -- 172.21.15.120:0/1700418661 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84040bb810 con 0x7f84140c7480 2024-04-18T04:45:00.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.205+0000 7f841b200640 1 -- 172.21.15.120:0/1700418661 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f841414c290 con 0x7f84140c7480 2024-04-18T04:45:00.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.205+0000 7f841b200640 1 -- 172.21.15.120:0/1700418661 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84141f6800 con 0x7f84140c7480 2024-04-18T04:45:00.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.205+0000 7f841b200640 1 -- 172.21.15.120:0/1700418661 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84140726d0 con 0x7f84140c7480 2024-04-18T04:45:00.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.205+0000 7f8410c00640 1 -- 172.21.15.120:0/1700418661 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f84040bb970 con 0x7f84140c7480 2024-04-18T04:45:00.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.205+0000 7f8410c00640 1 --2- 172.21.15.120:0/1700418661 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f83f0066690 0x7f83f0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:00.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.205+0000 7f8410c00640 1 -- 172.21.15.120:0/1700418661 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8404122ba0 con 0x7f84140c7480 2024-04-18T04:45:00.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.205+0000 7f840b400640 1 --2- 172.21.15.120:0/1700418661 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f83f0066690 0x7f83f0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:00.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.209+0000 7f840b400640 1 --2- 172.21.15.120:0/1700418661 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f83f0066690 0x7f83f0068b50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8414153fd0 tx=0x7f83fc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:00.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.209+0000 7f8410c00640 1 -- 172.21.15.120:0/1700418661 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f84040efb90 con 0x7f84140c7480 2024-04-18T04:45:00.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.361+0000 7f841b200640 1 -- 172.21.15.120:0/1700418661 --> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f84140c83e0 con 0x7f83f0066690 2024-04-18T04:45:00.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.385+0000 7f8410c00640 1 -- 172.21.15.120:0/1700418661 <== mgr.4113 v2:172.21.15.132:6832/27788 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345330 (secure 0 0 0) 0x7f83fc00b6b0 con 0x7f83f0066690 2024-04-18T04:45:00.389 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:45:00.391 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-04-18T04:45:00.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.389+0000 7f841b200640 1 -- 172.21.15.120:0/1700418661 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f83f0066690 msgr2=0x7f83f0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:00.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.389+0000 7f841b200640 1 --2- 172.21.15.120:0/1700418661 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f83f0066690 0x7f83f0068b50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8414153fd0 tx=0x7f83fc008040 comp rx=0 tx=0).stop 2024-04-18T04:45:00.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.389+0000 7f841b200640 1 -- 172.21.15.120:0/1700418661 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84140c7480 msgr2=0x7f8414149230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:00.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.389+0000 7f841b200640 1 --2- 172.21.15.120:0/1700418661 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84140c7480 0x7f8414149230 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f84040b3040 tx=0x7f840401ba70 comp rx=0 tx=0).stop 2024-04-18T04:45:00.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.389+0000 7f841b200640 1 -- 172.21.15.120:0/1700418661 shutdown_connections 2024-04-18T04:45:00.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.389+0000 7f841b200640 1 --2- 172.21.15.120:0/1700418661 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f83f0066690 0x7f83f0068b50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:00.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.389+0000 7f841b200640 1 --2- 172.21.15.120:0/1700418661 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84141f2f10 0x7f8414155d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:00.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.389+0000 7f841b200640 1 --2- 172.21.15.120:0/1700418661 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8414150340 0x7f84141f6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:00.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.389+0000 7f841b200640 1 --2- 172.21.15.120:0/1700418661 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84140c7480 0x7f8414149230 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:00.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.389+0000 7f841b200640 1 -- 172.21.15.120:0/1700418661 >> 172.21.15.120:0/1700418661 conn(0x7f84140c78c0 msgr2=0x7f84140c5e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:00.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.389+0000 7f841b200640 1 -- 172.21.15.120:0/1700418661 shutdown_connections 2024-04-18T04:45:00.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.389+0000 7f841b200640 1 -- 172.21.15.120:0/1700418661 wait complete. 2024-04-18T04:45:00.409 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-04-18T04:44:58.799144+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594962,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218396,"kb_used_data":2208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756324,"statfs":{"total":773094113280,"available":772870475776,"internally_reserved":0,"allocated":2260992,"data_stored":2008860,"data_compressed":66624,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004930"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.271916+0000","last_change":"2024-04-18T04:44:29.891079+0000","last_active":"2024-04-18T04:44:35.271916+0000","last_peered":"2024-04-18T04:44:35.271916+0000","last_clean":"2024-04-18T04:44:35.271916+0000","last_became_active":"2024-04-18T04:44:29.890853+0000","last_became_peered":"2024-04-18T04:44:29.890853+0000","last_unstale":"2024-04-18T04:44:35.271916+0000","last_undegraded":"2024-04-18T04:44:35.271916+0000","last_fullsized":"2024-04-18T04:44:35.271916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:12:22.299583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.293054+0000","last_change":"2024-04-18T04:44:30.296344+0000","last_active":"2024-04-18T04:44:34.293054+0000","last_peered":"2024-04-18T04:44:34.293054+0000","last_clean":"2024-04-18T04:44:34.293054+0000","last_became_active":"2024-04-18T04:44:30.296064+0000","last_became_peered":"2024-04-18T04:44:30.296064+0000","last_unstale":"2024-04-18T04:44:34.293054+0000","last_undegraded":"2024-04-18T04:44:34.293054+0000","last_fullsized":"2024-04-18T04:44:34.293054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:53:32.250308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.680854+0000","last_change":"2024-04-18T04:44:34.306605+0000","last_active":"2024-04-18T04:44:34.680854+0000","last_peered":"2024-04-18T04:44:34.680854+0000","last_clean":"2024-04-18T04:44:34.680854+0000","last_became_active":"2024-04-18T04:44:34.306224+0000","last_became_peered":"2024-04-18T04:44:34.306224+0000","last_unstale":"2024-04-18T04:44:34.680854+0000","last_undegraded":"2024-04-18T04:44:34.680854+0000","last_fullsized":"2024-04-18T04:44:34.680854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:13:15.107711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.681517+0000","last_change":"2024-04-18T04:44:29.881521+0000","last_active":"2024-04-18T04:44:34.681517+0000","last_peered":"2024-04-18T04:44:34.681517+0000","last_clean":"2024-04-18T04:44:34.681517+0000","last_became_active":"2024-04-18T04:44:29.881258+0000","last_became_peered":"2024-04-18T04:44:29.881258+0000","last_unstale":"2024-04-18T04:44:34.681517+0000","last_undegraded":"2024-04-18T04:44:34.681517+0000","last_fullsized":"2024-04-18T04:44:34.681517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:28:40.075960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287377+0000","last_change":"2024-04-18T04:44:30.314205+0000","last_active":"2024-04-18T04:44:34.287377+0000","last_peered":"2024-04-18T04:44:34.287377+0000","last_clean":"2024-04-18T04:44:34.287377+0000","last_became_active":"2024-04-18T04:44:30.313987+0000","last_became_peered":"2024-04-18T04:44:30.313987+0000","last_unstale":"2024-04-18T04:44:34.287377+0000","last_undegraded":"2024-04-18T04:44:34.287377+0000","last_fullsized":"2024-04-18T04:44:34.287377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:55:31.107861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.684278+0000","last_change":"2024-04-18T04:44:34.339646+0000","last_active":"2024-04-18T04:44:34.684278+0000","last_peered":"2024-04-18T04:44:34.684278+0000","last_clean":"2024-04-18T04:44:34.684278+0000","last_became_active":"2024-04-18T04:44:34.338485+0000","last_became_peered":"2024-04-18T04:44:34.338485+0000","last_unstale":"2024-04-18T04:44:34.684278+0000","last_undegraded":"2024-04-18T04:44:34.684278+0000","last_fullsized":"2024-04-18T04:44:34.684278+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:47:01.277301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.272149+0000","last_change":"2024-04-18T04:44:29.897785+0000","last_active":"2024-04-18T04:44:35.272149+0000","last_peered":"2024-04-18T04:44:35.272149+0000","last_clean":"2024-04-18T04:44:35.272149+0000","last_became_active":"2024-04-18T04:44:29.896520+0000","last_became_peered":"2024-04-18T04:44:29.896520+0000","last_unstale":"2024-04-18T04:44:35.272149+0000","last_undegraded":"2024-04-18T04:44:35.272149+0000","last_fullsized":"2024-04-18T04:44:35.272149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:25:52.871139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.307466+0000","last_change":"2024-04-18T04:44:30.300588+0000","last_active":"2024-04-18T04:44:34.307466+0000","last_peered":"2024-04-18T04:44:34.307466+0000","last_clean":"2024-04-18T04:44:34.307466+0000","last_became_active":"2024-04-18T04:44:30.299939+0000","last_became_peered":"2024-04-18T04:44:30.299939+0000","last_unstale":"2024-04-18T04:44:34.307466+0000","last_undegraded":"2024-04-18T04:44:34.307466+0000","last_fullsized":"2024-04-18T04:44:34.307466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:57:07.547985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.685732+0000","last_change":"2024-04-18T04:44:34.338794+0000","last_active":"2024-04-18T04:44:34.685732+0000","last_peered":"2024-04-18T04:44:34.685732+0000","last_clean":"2024-04-18T04:44:34.685732+0000","last_became_active":"2024-04-18T04:44:34.337938+0000","last_became_peered":"2024-04-18T04:44:34.337938+0000","last_unstale":"2024-04-18T04:44:34.685732+0000","last_undegraded":"2024-04-18T04:44:34.685732+0000","last_fullsized":"2024-04-18T04:44:34.685732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:48.827970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.271558+0000","last_change":"2024-04-18T04:44:29.903118+0000","last_active":"2024-04-18T04:44:35.271558+0000","last_peered":"2024-04-18T04:44:35.271558+0000","last_clean":"2024-04-18T04:44:35.271558+0000","last_became_active":"2024-04-18T04:44:29.902611+0000","last_became_peered":"2024-04-18T04:44:29.902611+0000","last_unstale":"2024-04-18T04:44:35.271558+0000","last_undegraded":"2024-04-18T04:44:35.271558+0000","last_fullsized":"2024-04-18T04:44:35.271558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:38:42.595095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.307515+0000","last_change":"2024-04-18T04:44:30.301328+0000","last_active":"2024-04-18T04:44:34.307515+0000","last_peered":"2024-04-18T04:44:34.307515+0000","last_clean":"2024-04-18T04:44:34.307515+0000","last_became_active":"2024-04-18T04:44:30.300303+0000","last_became_peered":"2024-04-18T04:44:30.300303+0000","last_unstale":"2024-04-18T04:44:34.307515+0000","last_undegraded":"2024-04-18T04:44:34.307515+0000","last_fullsized":"2024-04-18T04:44:34.307515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:24:11.941483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.685077+0000","last_change":"2024-04-18T04:44:34.327044+0000","last_active":"2024-04-18T04:44:34.685077+0000","last_peered":"2024-04-18T04:44:34.685077+0000","last_clean":"2024-04-18T04:44:34.685077+0000","last_became_active":"2024-04-18T04:44:34.326161+0000","last_became_peered":"2024-04-18T04:44:34.326161+0000","last_unstale":"2024-04-18T04:44:34.685077+0000","last_undegraded":"2024-04-18T04:44:34.685077+0000","last_fullsized":"2024-04-18T04:44:34.685077+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:47:41.413530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.288881+0000","last_change":"2024-04-18T04:44:30.296493+0000","last_active":"2024-04-18T04:44:34.288881+0000","last_peered":"2024-04-18T04:44:34.288881+0000","last_clean":"2024-04-18T04:44:34.288881+0000","last_became_active":"2024-04-18T04:44:30.295657+0000","last_became_peered":"2024-04-18T04:44:30.295657+0000","last_unstale":"2024-04-18T04:44:34.288881+0000","last_undegraded":"2024-04-18T04:44:34.288881+0000","last_fullsized":"2024-04-18T04:44:34.288881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:39:40.270643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.271728+0000","last_change":"2024-04-18T04:44:29.900036+0000","last_active":"2024-04-18T04:44:35.271728+0000","last_peered":"2024-04-18T04:44:35.271728+0000","last_clean":"2024-04-18T04:44:35.271728+0000","last_became_active":"2024-04-18T04:44:29.899402+0000","last_became_peered":"2024-04-18T04:44:29.899402+0000","last_unstale":"2024-04-18T04:44:35.271728+0000","last_undegraded":"2024-04-18T04:44:35.271728+0000","last_fullsized":"2024-04-18T04:44:35.271728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:45:51.681317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.686484+0000","last_change":"2024-04-18T04:44:34.320846+0000","last_active":"2024-04-18T04:44:34.686484+0000","last_peered":"2024-04-18T04:44:34.686484+0000","last_clean":"2024-04-18T04:44:34.686484+0000","last_became_active":"2024-04-18T04:44:34.319868+0000","last_became_peered":"2024-04-18T04:44:34.319868+0000","last_unstale":"2024-04-18T04:44:34.686484+0000","last_undegraded":"2024-04-18T04:44:34.686484+0000","last_fullsized":"2024-04-18T04:44:34.686484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:08:30.863140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.289171+0000","last_change":"2024-04-18T04:44:30.271756+0000","last_active":"2024-04-18T04:44:34.289171+0000","last_peered":"2024-04-18T04:44:34.289171+0000","last_clean":"2024-04-18T04:44:34.289171+0000","last_became_active":"2024-04-18T04:44:30.271420+0000","last_became_peered":"2024-04-18T04:44:30.271420+0000","last_unstale":"2024-04-18T04:44:34.289171+0000","last_undegraded":"2024-04-18T04:44:34.289171+0000","last_fullsized":"2024-04-18T04:44:34.289171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:27:18.559327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.296649+0000","last_change":"2024-04-18T04:44:29.878416+0000","last_active":"2024-04-18T04:44:34.296649+0000","last_peered":"2024-04-18T04:44:34.296649+0000","last_clean":"2024-04-18T04:44:34.296649+0000","last_became_active":"2024-04-18T04:44:29.878139+0000","last_became_peered":"2024-04-18T04:44:29.878139+0000","last_unstale":"2024-04-18T04:44:34.296649+0000","last_undegraded":"2024-04-18T04:44:34.296649+0000","last_fullsized":"2024-04-18T04:44:34.296649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:19:00.769888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.685503+0000","last_change":"2024-04-18T04:44:34.346123+0000","last_active":"2024-04-18T04:44:34.685503+0000","last_peered":"2024-04-18T04:44:34.685503+0000","last_clean":"2024-04-18T04:44:34.685503+0000","last_became_active":"2024-04-18T04:44:34.345267+0000","last_became_peered":"2024-04-18T04:44:34.345267+0000","last_unstale":"2024-04-18T04:44:34.685503+0000","last_undegraded":"2024-04-18T04:44:34.685503+0000","last_fullsized":"2024-04-18T04:44:34.685503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:14:08.078650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.289001+0000","last_change":"2024-04-18T04:44:30.274049+0000","last_active":"2024-04-18T04:44:34.289001+0000","last_peered":"2024-04-18T04:44:34.289001+0000","last_clean":"2024-04-18T04:44:34.289001+0000","last_became_active":"2024-04-18T04:44:30.273752+0000","last_became_peered":"2024-04-18T04:44:30.273752+0000","last_unstale":"2024-04-18T04:44:34.289001+0000","last_undegraded":"2024-04-18T04:44:34.289001+0000","last_fullsized":"2024-04-18T04:44:34.289001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:48:20.479069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.297586+0000","last_change":"2024-04-18T04:44:29.890569+0000","last_active":"2024-04-18T04:44:34.297586+0000","last_peered":"2024-04-18T04:44:34.297586+0000","last_clean":"2024-04-18T04:44:34.297586+0000","last_became_active":"2024-04-18T04:44:29.889684+0000","last_became_peered":"2024-04-18T04:44:29.889684+0000","last_unstale":"2024-04-18T04:44:34.297586+0000","last_undegraded":"2024-04-18T04:44:34.297586+0000","last_fullsized":"2024-04-18T04:44:34.297586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:53:00.230580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.202946+0000","last_change":"2024-04-18T04:44:34.313634+0000","last_active":"2024-04-18T04:44:35.202946+0000","last_peered":"2024-04-18T04:44:35.202946+0000","last_clean":"2024-04-18T04:44:35.202946+0000","last_became_active":"2024-04-18T04:44:34.313161+0000","last_became_peered":"2024-04-18T04:44:34.313161+0000","last_unstale":"2024-04-18T04:44:35.202946+0000","last_undegraded":"2024-04-18T04:44:35.202946+0000","last_fullsized":"2024-04-18T04:44:35.202946+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:01:07.805128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.302215+0000","last_change":"2024-04-18T04:44:30.284805+0000","last_active":"2024-04-18T04:44:34.302215+0000","last_peered":"2024-04-18T04:44:34.302215+0000","last_clean":"2024-04-18T04:44:34.302215+0000","last_became_active":"2024-04-18T04:44:30.279238+0000","last_became_peered":"2024-04-18T04:44:30.279238+0000","last_unstale":"2024-04-18T04:44:34.302215+0000","last_undegraded":"2024-04-18T04:44:34.302215+0000","last_fullsized":"2024-04-18T04:44:34.302215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:59:24.067420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287232+0000","last_change":"2024-04-18T04:44:29.890816+0000","last_active":"2024-04-18T04:44:34.287232+0000","last_peered":"2024-04-18T04:44:34.287232+0000","last_clean":"2024-04-18T04:44:34.287232+0000","last_became_active":"2024-04-18T04:44:29.890272+0000","last_became_peered":"2024-04-18T04:44:29.890272+0000","last_unstale":"2024-04-18T04:44:34.287232+0000","last_undegraded":"2024-04-18T04:44:34.287232+0000","last_fullsized":"2024-04-18T04:44:34.287232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:30:22.614083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.686347+0000","last_change":"2024-04-18T04:44:34.344973+0000","last_active":"2024-04-18T04:44:34.686347+0000","last_peered":"2024-04-18T04:44:34.686347+0000","last_clean":"2024-04-18T04:44:34.686347+0000","last_became_active":"2024-04-18T04:44:34.344007+0000","last_became_peered":"2024-04-18T04:44:34.344007+0000","last_unstale":"2024-04-18T04:44:34.686347+0000","last_undegraded":"2024-04-18T04:44:34.686347+0000","last_fullsized":"2024-04-18T04:44:34.686347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:56:43.476132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.288547+0000","last_change":"2024-04-18T04:44:30.278193+0000","last_active":"2024-04-18T04:44:34.288547+0000","last_peered":"2024-04-18T04:44:34.288547+0000","last_clean":"2024-04-18T04:44:34.288547+0000","last_became_active":"2024-04-18T04:44:30.277916+0000","last_became_peered":"2024-04-18T04:44:30.277916+0000","last_unstale":"2024-04-18T04:44:34.288547+0000","last_undegraded":"2024-04-18T04:44:34.288547+0000","last_fullsized":"2024-04-18T04:44:34.288547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:57:19.783436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.272431+0000","last_change":"2024-04-18T04:44:29.896901+0000","last_active":"2024-04-18T04:44:35.272431+0000","last_peered":"2024-04-18T04:44:35.272431+0000","last_clean":"2024-04-18T04:44:35.272431+0000","last_became_active":"2024-04-18T04:44:29.896392+0000","last_became_peered":"2024-04-18T04:44:29.896392+0000","last_unstale":"2024-04-18T04:44:35.272431+0000","last_undegraded":"2024-04-18T04:44:35.272431+0000","last_fullsized":"2024-04-18T04:44:35.272431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:46:08.869450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.684375+0000","last_change":"2024-04-18T04:44:34.339233+0000","last_active":"2024-04-18T04:44:34.684375+0000","last_peered":"2024-04-18T04:44:34.684375+0000","last_clean":"2024-04-18T04:44:34.684375+0000","last_became_active":"2024-04-18T04:44:34.338294+0000","last_became_peered":"2024-04-18T04:44:34.338294+0000","last_unstale":"2024-04-18T04:44:34.684375+0000","last_undegraded":"2024-04-18T04:44:34.684375+0000","last_fullsized":"2024-04-18T04:44:34.684375+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:20:35.738410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.291990+0000","last_change":"2024-04-18T04:44:30.305051+0000","last_active":"2024-04-18T04:44:34.291990+0000","last_peered":"2024-04-18T04:44:34.291990+0000","last_clean":"2024-04-18T04:44:34.291990+0000","last_became_active":"2024-04-18T04:44:30.304741+0000","last_became_peered":"2024-04-18T04:44:30.304741+0000","last_unstale":"2024-04-18T04:44:34.291990+0000","last_undegraded":"2024-04-18T04:44:34.291990+0000","last_fullsized":"2024-04-18T04:44:34.291990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:38:03.346015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.203014+0000","last_change":"2024-04-18T04:44:29.894503+0000","last_active":"2024-04-18T04:44:35.203014+0000","last_peered":"2024-04-18T04:44:35.203014+0000","last_clean":"2024-04-18T04:44:35.203014+0000","last_became_active":"2024-04-18T04:44:29.894210+0000","last_became_peered":"2024-04-18T04:44:29.894210+0000","last_unstale":"2024-04-18T04:44:35.203014+0000","last_undegraded":"2024-04-18T04:44:35.203014+0000","last_fullsized":"2024-04-18T04:44:35.203014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:14:56.979204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.680679+0000","last_change":"2024-04-18T04:44:34.305652+0000","last_active":"2024-04-18T04:44:34.680679+0000","last_peered":"2024-04-18T04:44:34.680679+0000","last_clean":"2024-04-18T04:44:34.680679+0000","last_became_active":"2024-04-18T04:44:34.305180+0000","last_became_peered":"2024-04-18T04:44:34.305180+0000","last_unstale":"2024-04-18T04:44:34.680679+0000","last_undegraded":"2024-04-18T04:44:34.680679+0000","last_fullsized":"2024-04-18T04:44:34.680679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:03:10.781821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.296680+0000","last_change":"2024-04-18T04:44:30.267158+0000","last_active":"2024-04-18T04:44:34.296680+0000","last_peered":"2024-04-18T04:44:34.296680+0000","last_clean":"2024-04-18T04:44:34.296680+0000","last_became_active":"2024-04-18T04:44:30.266814+0000","last_became_peered":"2024-04-18T04:44:30.266814+0000","last_unstale":"2024-04-18T04:44:34.296680+0000","last_undegraded":"2024-04-18T04:44:34.296680+0000","last_fullsized":"2024-04-18T04:44:34.296680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:16:02.152817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.296678+0000","last_change":"2024-04-18T04:44:29.898812+0000","last_active":"2024-04-18T04:44:34.296678+0000","last_peered":"2024-04-18T04:44:34.296678+0000","last_clean":"2024-04-18T04:44:34.296678+0000","last_became_active":"2024-04-18T04:44:29.897156+0000","last_became_peered":"2024-04-18T04:44:29.897156+0000","last_unstale":"2024-04-18T04:44:34.296678+0000","last_undegraded":"2024-04-18T04:44:34.296678+0000","last_fullsized":"2024-04-18T04:44:34.296678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:09:47.746394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.188051+0000","last_change":"2024-04-18T04:44:34.324721+0000","last_active":"2024-04-18T04:44:35.188051+0000","last_peered":"2024-04-18T04:44:35.188051+0000","last_clean":"2024-04-18T04:44:35.188051+0000","last_became_active":"2024-04-18T04:44:34.322925+0000","last_became_peered":"2024-04-18T04:44:34.322925+0000","last_unstale":"2024-04-18T04:44:35.188051+0000","last_undegraded":"2024-04-18T04:44:35.188051+0000","last_fullsized":"2024-04-18T04:44:35.188051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:11:59.682230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.311311+0000","last_change":"2024-04-18T04:44:30.281640+0000","last_active":"2024-04-18T04:44:34.311311+0000","last_peered":"2024-04-18T04:44:34.311311+0000","last_clean":"2024-04-18T04:44:34.311311+0000","last_became_active":"2024-04-18T04:44:30.280968+0000","last_became_peered":"2024-04-18T04:44:30.280968+0000","last_unstale":"2024-04-18T04:44:34.311311+0000","last_undegraded":"2024-04-18T04:44:34.311311+0000","last_fullsized":"2024-04-18T04:44:34.311311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:35:20.755711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.296757+0000","last_change":"2024-04-18T04:44:29.882715+0000","last_active":"2024-04-18T04:44:34.296757+0000","last_peered":"2024-04-18T04:44:34.296757+0000","last_clean":"2024-04-18T04:44:34.296757+0000","last_became_active":"2024-04-18T04:44:29.882335+0000","last_became_peered":"2024-04-18T04:44:29.882335+0000","last_unstale":"2024-04-18T04:44:34.296757+0000","last_undegraded":"2024-04-18T04:44:34.296757+0000","last_fullsized":"2024-04-18T04:44:34.296757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:32:59.709151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.202122+0000","last_change":"2024-04-18T04:44:34.325029+0000","last_active":"2024-04-18T04:44:35.202122+0000","last_peered":"2024-04-18T04:44:35.202122+0000","last_clean":"2024-04-18T04:44:35.202122+0000","last_became_active":"2024-04-18T04:44:34.324082+0000","last_became_peered":"2024-04-18T04:44:34.324082+0000","last_unstale":"2024-04-18T04:44:35.202122+0000","last_undegraded":"2024-04-18T04:44:35.202122+0000","last_fullsized":"2024-04-18T04:44:35.202122+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:28:10.378037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.311743+0000","last_change":"2024-04-18T04:44:30.276174+0000","last_active":"2024-04-18T04:44:34.311743+0000","last_peered":"2024-04-18T04:44:34.311743+0000","last_clean":"2024-04-18T04:44:34.311743+0000","last_became_active":"2024-04-18T04:44:30.270878+0000","last_became_peered":"2024-04-18T04:44:30.270878+0000","last_unstale":"2024-04-18T04:44:34.311743+0000","last_undegraded":"2024-04-18T04:44:34.311743+0000","last_fullsized":"2024-04-18T04:44:34.311743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:35:12.296277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.309548+0000","last_change":"2024-04-18T04:44:29.896745+0000","last_active":"2024-04-18T04:44:34.309548+0000","last_peered":"2024-04-18T04:44:34.309548+0000","last_clean":"2024-04-18T04:44:34.309548+0000","last_became_active":"2024-04-18T04:44:29.896199+0000","last_became_peered":"2024-04-18T04:44:29.896199+0000","last_unstale":"2024-04-18T04:44:34.309548+0000","last_undegraded":"2024-04-18T04:44:34.309548+0000","last_fullsized":"2024-04-18T04:44:34.309548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:25:05.424668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.202607+0000","last_change":"2024-04-18T04:44:34.337429+0000","last_active":"2024-04-18T04:44:35.202607+0000","last_peered":"2024-04-18T04:44:35.202607+0000","last_clean":"2024-04-18T04:44:35.202607+0000","last_became_active":"2024-04-18T04:44:34.337089+0000","last_became_peered":"2024-04-18T04:44:34.337089+0000","last_unstale":"2024-04-18T04:44:35.202607+0000","last_undegraded":"2024-04-18T04:44:35.202607+0000","last_fullsized":"2024-04-18T04:44:35.202607+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:00:56.976431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.297789+0000","last_change":"2024-04-18T04:44:30.270874+0000","last_active":"2024-04-18T04:44:34.297789+0000","last_peered":"2024-04-18T04:44:34.297789+0000","last_clean":"2024-04-18T04:44:34.297789+0000","last_became_active":"2024-04-18T04:44:30.270636+0000","last_became_peered":"2024-04-18T04:44:30.270636+0000","last_unstale":"2024-04-18T04:44:34.297789+0000","last_undegraded":"2024-04-18T04:44:34.297789+0000","last_fullsized":"2024-04-18T04:44:34.297789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:25:49.889554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.285207+0000","last_change":"2024-04-18T04:44:29.878607+0000","last_active":"2024-04-18T04:44:34.285207+0000","last_peered":"2024-04-18T04:44:34.285207+0000","last_clean":"2024-04-18T04:44:34.285207+0000","last_became_active":"2024-04-18T04:44:29.878330+0000","last_became_peered":"2024-04-18T04:44:29.878330+0000","last_unstale":"2024-04-18T04:44:34.285207+0000","last_undegraded":"2024-04-18T04:44:34.285207+0000","last_fullsized":"2024-04-18T04:44:34.285207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:09:18.088701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.202964+0000","last_change":"2024-04-18T04:44:34.323315+0000","last_active":"2024-04-18T04:44:35.202964+0000","last_peered":"2024-04-18T04:44:35.202964+0000","last_clean":"2024-04-18T04:44:35.202964+0000","last_became_active":"2024-04-18T04:44:34.322983+0000","last_became_peered":"2024-04-18T04:44:34.322983+0000","last_unstale":"2024-04-18T04:44:35.202964+0000","last_undegraded":"2024-04-18T04:44:35.202964+0000","last_fullsized":"2024-04-18T04:44:35.202964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:48:12.803273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287313+0000","last_change":"2024-04-18T04:44:30.285533+0000","last_active":"2024-04-18T04:44:34.287313+0000","last_peered":"2024-04-18T04:44:34.287313+0000","last_clean":"2024-04-18T04:44:34.287313+0000","last_became_active":"2024-04-18T04:44:30.285113+0000","last_became_peered":"2024-04-18T04:44:30.285113+0000","last_unstale":"2024-04-18T04:44:34.287313+0000","last_undegraded":"2024-04-18T04:44:34.287313+0000","last_fullsized":"2024-04-18T04:44:34.287313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:37:20.367349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287255+0000","last_change":"2024-04-18T04:44:29.890701+0000","last_active":"2024-04-18T04:44:34.287255+0000","last_peered":"2024-04-18T04:44:34.287255+0000","last_clean":"2024-04-18T04:44:34.287255+0000","last_became_active":"2024-04-18T04:44:29.890207+0000","last_became_peered":"2024-04-18T04:44:29.890207+0000","last_unstale":"2024-04-18T04:44:34.287255+0000","last_undegraded":"2024-04-18T04:44:34.287255+0000","last_fullsized":"2024-04-18T04:44:34.287255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:06:58.470725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.188159+0000","last_change":"2024-04-18T04:44:34.306858+0000","last_active":"2024-04-18T04:44:35.188159+0000","last_peered":"2024-04-18T04:44:35.188159+0000","last_clean":"2024-04-18T04:44:35.188159+0000","last_became_active":"2024-04-18T04:44:34.306123+0000","last_became_peered":"2024-04-18T04:44:34.306123+0000","last_unstale":"2024-04-18T04:44:35.188159+0000","last_undegraded":"2024-04-18T04:44:35.188159+0000","last_fullsized":"2024-04-18T04:44:35.188159+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:13:26.389394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.289157+0000","last_change":"2024-04-18T04:44:30.306826+0000","last_active":"2024-04-18T04:44:34.289157+0000","last_peered":"2024-04-18T04:44:34.289157+0000","last_clean":"2024-04-18T04:44:34.289157+0000","last_became_active":"2024-04-18T04:44:30.306320+0000","last_became_peered":"2024-04-18T04:44:30.306320+0000","last_unstale":"2024-04-18T04:44:34.289157+0000","last_undegraded":"2024-04-18T04:44:34.289157+0000","last_fullsized":"2024-04-18T04:44:34.289157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:47:38.564197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.309565+0000","last_change":"2024-04-18T04:44:29.888023+0000","last_active":"2024-04-18T04:44:34.309565+0000","last_peered":"2024-04-18T04:44:34.309565+0000","last_clean":"2024-04-18T04:44:34.309565+0000","last_became_active":"2024-04-18T04:44:29.887440+0000","last_became_peered":"2024-04-18T04:44:29.887440+0000","last_unstale":"2024-04-18T04:44:34.309565+0000","last_undegraded":"2024-04-18T04:44:34.309565+0000","last_fullsized":"2024-04-18T04:44:34.309565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:07:01.067445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287497+0000","last_change":"2024-04-18T04:44:18.629794+0000","last_active":"2024-04-18T04:44:34.287497+0000","last_peered":"2024-04-18T04:44:34.287497+0000","last_clean":"2024-04-18T04:44:34.287497+0000","last_became_active":"2024-04-18T04:44:18.627792+0000","last_became_peered":"2024-04-18T04:44:18.627792+0000","last_unstale":"2024-04-18T04:44:34.287497+0000","last_undegraded":"2024-04-18T04:44:34.287497+0000","last_fullsized":"2024-04-18T04:44:34.287497+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:17.410146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:17.410146+0000","last_clean_scrub_stamp":"2024-04-18T04:44:17.410146+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:30:49.101656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.203752+0000","last_change":"2024-04-18T04:44:34.333286+0000","last_active":"2024-04-18T04:44:35.203752+0000","last_peered":"2024-04-18T04:44:35.203752+0000","last_clean":"2024-04-18T04:44:35.203752+0000","last_became_active":"2024-04-18T04:44:34.332520+0000","last_became_peered":"2024-04-18T04:44:34.332520+0000","last_unstale":"2024-04-18T04:44:35.203752+0000","last_undegraded":"2024-04-18T04:44:35.203752+0000","last_fullsized":"2024-04-18T04:44:35.203752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:58:48.264040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.295974+0000","last_change":"2024-04-18T04:44:30.303602+0000","last_active":"2024-04-18T04:44:34.295974+0000","last_peered":"2024-04-18T04:44:34.295974+0000","last_clean":"2024-04-18T04:44:34.295974+0000","last_became_active":"2024-04-18T04:44:30.302157+0000","last_became_peered":"2024-04-18T04:44:30.302157+0000","last_unstale":"2024-04-18T04:44:34.295974+0000","last_undegraded":"2024-04-18T04:44:34.295974+0000","last_fullsized":"2024-04-18T04:44:34.295974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:09:57.582065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.285561+0000","last_change":"2024-04-18T04:44:29.890428+0000","last_active":"2024-04-18T04:44:34.285561+0000","last_peered":"2024-04-18T04:44:34.285561+0000","last_clean":"2024-04-18T04:44:34.285561+0000","last_became_active":"2024-04-18T04:44:29.890166+0000","last_became_peered":"2024-04-18T04:44:29.890166+0000","last_unstale":"2024-04-18T04:44:34.285561+0000","last_undegraded":"2024-04-18T04:44:34.285561+0000","last_fullsized":"2024-04-18T04:44:34.285561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:21:16.823377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.202663+0000","last_change":"2024-04-18T04:44:34.334071+0000","last_active":"2024-04-18T04:44:35.202663+0000","last_peered":"2024-04-18T04:44:35.202663+0000","last_clean":"2024-04-18T04:44:35.202663+0000","last_became_active":"2024-04-18T04:44:34.332695+0000","last_became_peered":"2024-04-18T04:44:34.332695+0000","last_unstale":"2024-04-18T04:44:35.202663+0000","last_undegraded":"2024-04-18T04:44:35.202663+0000","last_fullsized":"2024-04-18T04:44:35.202663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:22:52.371921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.309847+0000","last_change":"2024-04-18T04:44:30.287908+0000","last_active":"2024-04-18T04:44:34.309847+0000","last_peered":"2024-04-18T04:44:34.309847+0000","last_clean":"2024-04-18T04:44:34.309847+0000","last_became_active":"2024-04-18T04:44:30.287217+0000","last_became_peered":"2024-04-18T04:44:30.287217+0000","last_unstale":"2024-04-18T04:44:34.309847+0000","last_undegraded":"2024-04-18T04:44:34.309847+0000","last_fullsized":"2024-04-18T04:44:34.309847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:47:14.962330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.202737+0000","last_change":"2024-04-18T04:44:29.886376+0000","last_active":"2024-04-18T04:44:35.202737+0000","last_peered":"2024-04-18T04:44:35.202737+0000","last_clean":"2024-04-18T04:44:35.202737+0000","last_became_active":"2024-04-18T04:44:29.886058+0000","last_became_peered":"2024-04-18T04:44:29.886058+0000","last_unstale":"2024-04-18T04:44:35.202737+0000","last_undegraded":"2024-04-18T04:44:35.202737+0000","last_fullsized":"2024-04-18T04:44:35.202737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:29:59.678071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.188072+0000","last_change":"2024-04-18T04:44:34.323046+0000","last_active":"2024-04-18T04:44:35.188072+0000","last_peered":"2024-04-18T04:44:35.188072+0000","last_clean":"2024-04-18T04:44:35.188072+0000","last_became_active":"2024-04-18T04:44:34.322785+0000","last_became_peered":"2024-04-18T04:44:34.322785+0000","last_unstale":"2024-04-18T04:44:35.188072+0000","last_undegraded":"2024-04-18T04:44:35.188072+0000","last_fullsized":"2024-04-18T04:44:35.188072+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:53:47.315572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.293500+0000","last_change":"2024-04-18T04:44:30.289872+0000","last_active":"2024-04-18T04:44:34.293500+0000","last_peered":"2024-04-18T04:44:34.293500+0000","last_clean":"2024-04-18T04:44:34.293500+0000","last_became_active":"2024-04-18T04:44:30.288606+0000","last_became_peered":"2024-04-18T04:44:30.288606+0000","last_unstale":"2024-04-18T04:44:34.293500+0000","last_undegraded":"2024-04-18T04:44:34.293500+0000","last_fullsized":"2024-04-18T04:44:34.293500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:00:57.740649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.267690+0000","last_change":"2024-04-18T04:44:29.878650+0000","last_active":"2024-04-18T04:44:35.267690+0000","last_peered":"2024-04-18T04:44:35.267690+0000","last_clean":"2024-04-18T04:44:35.267690+0000","last_became_active":"2024-04-18T04:44:29.878361+0000","last_became_peered":"2024-04-18T04:44:29.878361+0000","last_unstale":"2024-04-18T04:44:35.267690+0000","last_undegraded":"2024-04-18T04:44:35.267690+0000","last_fullsized":"2024-04-18T04:44:35.267690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:57:41.162118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.202529+0000","last_change":"2024-04-18T04:44:34.339023+0000","last_active":"2024-04-18T04:44:35.202529+0000","last_peered":"2024-04-18T04:44:35.202529+0000","last_clean":"2024-04-18T04:44:35.202529+0000","last_became_active":"2024-04-18T04:44:34.338042+0000","last_became_peered":"2024-04-18T04:44:34.338042+0000","last_unstale":"2024-04-18T04:44:35.202529+0000","last_undegraded":"2024-04-18T04:44:35.202529+0000","last_fullsized":"2024-04-18T04:44:35.202529+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:48:58.174635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.290165+0000","last_change":"2024-04-18T04:44:30.291740+0000","last_active":"2024-04-18T04:44:34.290165+0000","last_peered":"2024-04-18T04:44:34.290165+0000","last_clean":"2024-04-18T04:44:34.290165+0000","last_became_active":"2024-04-18T04:44:30.290379+0000","last_became_peered":"2024-04-18T04:44:30.290379+0000","last_unstale":"2024-04-18T04:44:34.290165+0000","last_undegraded":"2024-04-18T04:44:34.290165+0000","last_fullsized":"2024-04-18T04:44:34.290165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:44:25.111858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.686910+0000","last_change":"2024-04-18T04:44:29.882833+0000","last_active":"2024-04-18T04:44:34.686910+0000","last_peered":"2024-04-18T04:44:34.686910+0000","last_clean":"2024-04-18T04:44:34.686910+0000","last_became_active":"2024-04-18T04:44:29.881671+0000","last_became_peered":"2024-04-18T04:44:29.881671+0000","last_unstale":"2024-04-18T04:44:34.686910+0000","last_undegraded":"2024-04-18T04:44:34.686910+0000","last_fullsized":"2024-04-18T04:44:34.686910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:29:22.037641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.684253+0000","last_change":"2024-04-18T04:44:34.342465+0000","last_active":"2024-04-18T04:44:34.684253+0000","last_peered":"2024-04-18T04:44:34.684253+0000","last_clean":"2024-04-18T04:44:34.684253+0000","last_became_active":"2024-04-18T04:44:34.340327+0000","last_became_peered":"2024-04-18T04:44:34.340327+0000","last_unstale":"2024-04-18T04:44:34.684253+0000","last_undegraded":"2024-04-18T04:44:34.684253+0000","last_fullsized":"2024-04-18T04:44:34.684253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:31:44.168899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287509+0000","last_change":"2024-04-18T04:44:30.299403+0000","last_active":"2024-04-18T04:44:34.287509+0000","last_peered":"2024-04-18T04:44:34.287509+0000","last_clean":"2024-04-18T04:44:34.287509+0000","last_became_active":"2024-04-18T04:44:30.298417+0000","last_became_peered":"2024-04-18T04:44:30.298417+0000","last_unstale":"2024-04-18T04:44:34.287509+0000","last_undegraded":"2024-04-18T04:44:34.287509+0000","last_fullsized":"2024-04-18T04:44:34.287509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:43:24.120294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.271251+0000","last_change":"2024-04-18T04:44:29.875345+0000","last_active":"2024-04-18T04:44:35.271251+0000","last_peered":"2024-04-18T04:44:35.271251+0000","last_clean":"2024-04-18T04:44:35.271251+0000","last_became_active":"2024-04-18T04:44:29.875059+0000","last_became_peered":"2024-04-18T04:44:29.875059+0000","last_unstale":"2024-04-18T04:44:35.271251+0000","last_undegraded":"2024-04-18T04:44:35.271251+0000","last_fullsized":"2024-04-18T04:44:35.271251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:06:54.218096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.188129+0000","last_change":"2024-04-18T04:44:34.334498+0000","last_active":"2024-04-18T04:44:35.188129+0000","last_peered":"2024-04-18T04:44:35.188129+0000","last_clean":"2024-04-18T04:44:35.188129+0000","last_became_active":"2024-04-18T04:44:34.334192+0000","last_became_peered":"2024-04-18T04:44:34.334192+0000","last_unstale":"2024-04-18T04:44:35.188129+0000","last_undegraded":"2024-04-18T04:44:35.188129+0000","last_fullsized":"2024-04-18T04:44:35.188129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:15:49.669556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287990+0000","last_change":"2024-04-18T04:44:30.298289+0000","last_active":"2024-04-18T04:44:34.287990+0000","last_peered":"2024-04-18T04:44:34.287990+0000","last_clean":"2024-04-18T04:44:34.287990+0000","last_became_active":"2024-04-18T04:44:30.295404+0000","last_became_peered":"2024-04-18T04:44:30.295404+0000","last_unstale":"2024-04-18T04:44:34.287990+0000","last_undegraded":"2024-04-18T04:44:34.287990+0000","last_fullsized":"2024-04-18T04:44:34.287990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:10:32.465032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.288381+0000","last_change":"2024-04-18T04:44:29.894196+0000","last_active":"2024-04-18T04:44:34.288381+0000","last_peered":"2024-04-18T04:44:34.288381+0000","last_clean":"2024-04-18T04:44:34.288381+0000","last_became_active":"2024-04-18T04:44:29.893668+0000","last_became_peered":"2024-04-18T04:44:29.893668+0000","last_unstale":"2024-04-18T04:44:34.288381+0000","last_undegraded":"2024-04-18T04:44:34.288381+0000","last_fullsized":"2024-04-18T04:44:34.288381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:39:03.812043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.681603+0000","last_change":"2024-04-18T04:44:34.339050+0000","last_active":"2024-04-18T04:44:34.681603+0000","last_peered":"2024-04-18T04:44:34.681603+0000","last_clean":"2024-04-18T04:44:34.681603+0000","last_became_active":"2024-04-18T04:44:34.338877+0000","last_became_peered":"2024-04-18T04:44:34.338877+0000","last_unstale":"2024-04-18T04:44:34.681603+0000","last_undegraded":"2024-04-18T04:44:34.681603+0000","last_fullsized":"2024-04-18T04:44:34.681603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:09:17.919847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.288247+0000","last_change":"2024-04-18T04:44:30.289122+0000","last_active":"2024-04-18T04:44:34.288247+0000","last_peered":"2024-04-18T04:44:34.288247+0000","last_clean":"2024-04-18T04:44:34.288247+0000","last_became_active":"2024-04-18T04:44:30.288364+0000","last_became_peered":"2024-04-18T04:44:30.288364+0000","last_unstale":"2024-04-18T04:44:34.288247+0000","last_undegraded":"2024-04-18T04:44:34.288247+0000","last_fullsized":"2024-04-18T04:44:34.288247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:04:02.162723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.307535+0000","last_change":"2024-04-18T04:44:29.894521+0000","last_active":"2024-04-18T04:44:34.307535+0000","last_peered":"2024-04-18T04:44:34.307535+0000","last_clean":"2024-04-18T04:44:34.307535+0000","last_became_active":"2024-04-18T04:44:29.889150+0000","last_became_peered":"2024-04-18T04:44:29.889150+0000","last_unstale":"2024-04-18T04:44:34.307535+0000","last_undegraded":"2024-04-18T04:44:34.307535+0000","last_fullsized":"2024-04-18T04:44:34.307535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:39:13.323434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.681213+0000","last_change":"2024-04-18T04:44:34.305657+0000","last_active":"2024-04-18T04:44:34.681213+0000","last_peered":"2024-04-18T04:44:34.681213+0000","last_clean":"2024-04-18T04:44:34.681213+0000","last_became_active":"2024-04-18T04:44:34.305341+0000","last_became_peered":"2024-04-18T04:44:34.305341+0000","last_unstale":"2024-04-18T04:44:34.681213+0000","last_undegraded":"2024-04-18T04:44:34.681213+0000","last_fullsized":"2024-04-18T04:44:34.681213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:32:39.937173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287291+0000","last_change":"2024-04-18T04:44:30.307042+0000","last_active":"2024-04-18T04:44:34.287291+0000","last_peered":"2024-04-18T04:44:34.287291+0000","last_clean":"2024-04-18T04:44:34.287291+0000","last_became_active":"2024-04-18T04:44:30.306726+0000","last_became_peered":"2024-04-18T04:44:30.306726+0000","last_unstale":"2024-04-18T04:44:34.287291+0000","last_undegraded":"2024-04-18T04:44:34.287291+0000","last_fullsized":"2024-04-18T04:44:34.287291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:55:33.543142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.273530+0000","last_change":"2024-04-18T04:44:29.887498+0000","last_active":"2024-04-18T04:44:35.273530+0000","last_peered":"2024-04-18T04:44:35.273530+0000","last_clean":"2024-04-18T04:44:35.273530+0000","last_became_active":"2024-04-18T04:44:29.887095+0000","last_became_peered":"2024-04-18T04:44:29.887095+0000","last_unstale":"2024-04-18T04:44:35.273530+0000","last_undegraded":"2024-04-18T04:44:35.273530+0000","last_fullsized":"2024-04-18T04:44:35.273530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:54:34.700562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.203621+0000","last_change":"2024-04-18T04:44:34.322042+0000","last_active":"2024-04-18T04:44:35.203621+0000","last_peered":"2024-04-18T04:44:35.203621+0000","last_clean":"2024-04-18T04:44:35.203621+0000","last_became_active":"2024-04-18T04:44:34.320776+0000","last_became_peered":"2024-04-18T04:44:34.320776+0000","last_unstale":"2024-04-18T04:44:35.203621+0000","last_undegraded":"2024-04-18T04:44:35.203621+0000","last_fullsized":"2024-04-18T04:44:35.203621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:53:47.399337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.295755+0000","last_change":"2024-04-18T04:44:30.299413+0000","last_active":"2024-04-18T04:44:34.295755+0000","last_peered":"2024-04-18T04:44:34.295755+0000","last_clean":"2024-04-18T04:44:34.295755+0000","last_became_active":"2024-04-18T04:44:30.293185+0000","last_became_peered":"2024-04-18T04:44:30.293185+0000","last_unstale":"2024-04-18T04:44:34.295755+0000","last_undegraded":"2024-04-18T04:44:34.295755+0000","last_fullsized":"2024-04-18T04:44:34.295755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:43:53.831429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:44.310346+0000","last_change":"2024-04-18T04:44:29.893351+0000","last_active":"2024-04-18T04:44:44.310346+0000","last_peered":"2024-04-18T04:44:44.310346+0000","last_clean":"2024-04-18T04:44:44.310346+0000","last_became_active":"2024-04-18T04:44:29.892647+0000","last_became_peered":"2024-04-18T04:44:29.892647+0000","last_unstale":"2024-04-18T04:44:44.310346+0000","last_undegraded":"2024-04-18T04:44:44.310346+0000","last_fullsized":"2024-04-18T04:44:44.310346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:16:59.759149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.202231+0000","last_change":"2024-04-18T04:44:34.337866+0000","last_active":"2024-04-18T04:44:35.202231+0000","last_peered":"2024-04-18T04:44:35.202231+0000","last_clean":"2024-04-18T04:44:35.202231+0000","last_became_active":"2024-04-18T04:44:34.337486+0000","last_became_peered":"2024-04-18T04:44:34.337486+0000","last_unstale":"2024-04-18T04:44:35.202231+0000","last_undegraded":"2024-04-18T04:44:35.202231+0000","last_fullsized":"2024-04-18T04:44:35.202231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:42:13.751926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.304604+0000","last_change":"2024-04-18T04:44:30.308477+0000","last_active":"2024-04-18T04:44:34.304604+0000","last_peered":"2024-04-18T04:44:34.304604+0000","last_clean":"2024-04-18T04:44:34.304604+0000","last_became_active":"2024-04-18T04:44:30.307237+0000","last_became_peered":"2024-04-18T04:44:30.307237+0000","last_unstale":"2024-04-18T04:44:34.304604+0000","last_undegraded":"2024-04-18T04:44:34.304604+0000","last_fullsized":"2024-04-18T04:44:34.304604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:33:58.300542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.271124+0000","last_change":"2024-04-18T04:44:29.898488+0000","last_active":"2024-04-18T04:44:35.271124+0000","last_peered":"2024-04-18T04:44:35.271124+0000","last_clean":"2024-04-18T04:44:35.271124+0000","last_became_active":"2024-04-18T04:44:29.898113+0000","last_became_peered":"2024-04-18T04:44:29.898113+0000","last_unstale":"2024-04-18T04:44:35.271124+0000","last_undegraded":"2024-04-18T04:44:35.271124+0000","last_fullsized":"2024-04-18T04:44:35.271124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:11:14.585142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.685293+0000","last_change":"2024-04-18T04:44:34.344769+0000","last_active":"2024-04-18T04:44:34.685293+0000","last_peered":"2024-04-18T04:44:34.685293+0000","last_clean":"2024-04-18T04:44:34.685293+0000","last_became_active":"2024-04-18T04:44:34.343636+0000","last_became_peered":"2024-04-18T04:44:34.343636+0000","last_unstale":"2024-04-18T04:44:34.685293+0000","last_undegraded":"2024-04-18T04:44:34.685293+0000","last_fullsized":"2024-04-18T04:44:34.685293+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:45:09.481681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287417+0000","last_change":"2024-04-18T04:44:30.290494+0000","last_active":"2024-04-18T04:44:34.287417+0000","last_peered":"2024-04-18T04:44:34.287417+0000","last_clean":"2024-04-18T04:44:34.287417+0000","last_became_active":"2024-04-18T04:44:30.290127+0000","last_became_peered":"2024-04-18T04:44:30.290127+0000","last_unstale":"2024-04-18T04:44:34.287417+0000","last_undegraded":"2024-04-18T04:44:34.287417+0000","last_fullsized":"2024-04-18T04:44:34.287417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:34:21.239813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.309224+0000","last_change":"2024-04-18T04:44:29.895686+0000","last_active":"2024-04-18T04:44:34.309224+0000","last_peered":"2024-04-18T04:44:34.309224+0000","last_clean":"2024-04-18T04:44:34.309224+0000","last_became_active":"2024-04-18T04:44:29.895083+0000","last_became_peered":"2024-04-18T04:44:29.895083+0000","last_unstale":"2024-04-18T04:44:34.309224+0000","last_undegraded":"2024-04-18T04:44:34.309224+0000","last_fullsized":"2024-04-18T04:44:34.309224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:27:17.897401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.680895+0000","last_change":"2024-04-18T04:44:34.338412+0000","last_active":"2024-04-18T04:44:34.680895+0000","last_peered":"2024-04-18T04:44:34.680895+0000","last_clean":"2024-04-18T04:44:34.680895+0000","last_became_active":"2024-04-18T04:44:34.338062+0000","last_became_peered":"2024-04-18T04:44:34.338062+0000","last_unstale":"2024-04-18T04:44:34.680895+0000","last_undegraded":"2024-04-18T04:44:34.680895+0000","last_fullsized":"2024-04-18T04:44:34.680895+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:49:28.342905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.307374+0000","last_change":"2024-04-18T04:44:30.307946+0000","last_active":"2024-04-18T04:44:34.307374+0000","last_peered":"2024-04-18T04:44:34.307374+0000","last_clean":"2024-04-18T04:44:34.307374+0000","last_became_active":"2024-04-18T04:44:30.307168+0000","last_became_peered":"2024-04-18T04:44:30.307168+0000","last_unstale":"2024-04-18T04:44:34.307374+0000","last_undegraded":"2024-04-18T04:44:34.307374+0000","last_fullsized":"2024-04-18T04:44:34.307374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:43:56.218333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.294423+0000","last_change":"2024-04-18T04:44:29.903183+0000","last_active":"2024-04-18T04:44:34.294423+0000","last_peered":"2024-04-18T04:44:34.294423+0000","last_clean":"2024-04-18T04:44:34.294423+0000","last_became_active":"2024-04-18T04:44:29.902647+0000","last_became_peered":"2024-04-18T04:44:29.902647+0000","last_unstale":"2024-04-18T04:44:34.294423+0000","last_undegraded":"2024-04-18T04:44:34.294423+0000","last_fullsized":"2024-04-18T04:44:34.294423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:45:13.009571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.680985+0000","last_change":"2024-04-18T04:44:34.338653+0000","last_active":"2024-04-18T04:44:34.680985+0000","last_peered":"2024-04-18T04:44:34.680985+0000","last_clean":"2024-04-18T04:44:34.680985+0000","last_became_active":"2024-04-18T04:44:34.338288+0000","last_became_peered":"2024-04-18T04:44:34.338288+0000","last_unstale":"2024-04-18T04:44:34.680985+0000","last_undegraded":"2024-04-18T04:44:34.680985+0000","last_fullsized":"2024-04-18T04:44:34.680985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:58:27.654288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.188114+0000","last_change":"2024-04-18T04:44:34.306999+0000","last_active":"2024-04-18T04:44:35.188114+0000","last_peered":"2024-04-18T04:44:35.188114+0000","last_clean":"2024-04-18T04:44:35.188114+0000","last_became_active":"2024-04-18T04:44:34.306657+0000","last_became_peered":"2024-04-18T04:44:34.306657+0000","last_unstale":"2024-04-18T04:44:35.188114+0000","last_undegraded":"2024-04-18T04:44:35.188114+0000","last_fullsized":"2024-04-18T04:44:35.188114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:52:58.512928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.297434+0000","last_change":"2024-04-18T04:44:30.271947+0000","last_active":"2024-04-18T04:44:34.297434+0000","last_peered":"2024-04-18T04:44:34.297434+0000","last_clean":"2024-04-18T04:44:34.297434+0000","last_became_active":"2024-04-18T04:44:30.271619+0000","last_became_peered":"2024-04-18T04:44:30.271619+0000","last_unstale":"2024-04-18T04:44:34.297434+0000","last_undegraded":"2024-04-18T04:44:34.297434+0000","last_fullsized":"2024-04-18T04:44:34.297434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:32:11.612016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.307211+0000","last_change":"2024-04-18T04:44:29.897616+0000","last_active":"2024-04-18T04:44:34.307211+0000","last_peered":"2024-04-18T04:44:34.307211+0000","last_clean":"2024-04-18T04:44:34.307211+0000","last_became_active":"2024-04-18T04:44:29.889922+0000","last_became_peered":"2024-04-18T04:44:29.889922+0000","last_unstale":"2024-04-18T04:44:34.307211+0000","last_undegraded":"2024-04-18T04:44:34.307211+0000","last_fullsized":"2024-04-18T04:44:34.307211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:11:52.717768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.204973+0000","last_change":"2024-04-18T04:44:34.333403+0000","last_active":"2024-04-18T04:44:35.204973+0000","last_peered":"2024-04-18T04:44:35.204973+0000","last_clean":"2024-04-18T04:44:35.204973+0000","last_became_active":"2024-04-18T04:44:34.332551+0000","last_became_peered":"2024-04-18T04:44:34.332551+0000","last_unstale":"2024-04-18T04:44:35.204973+0000","last_undegraded":"2024-04-18T04:44:35.204973+0000","last_fullsized":"2024-04-18T04:44:35.204973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:33:28.594002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.288936+0000","last_change":"2024-04-18T04:44:30.271099+0000","last_active":"2024-04-18T04:44:34.288936+0000","last_peered":"2024-04-18T04:44:34.288936+0000","last_clean":"2024-04-18T04:44:34.288936+0000","last_became_active":"2024-04-18T04:44:30.270804+0000","last_became_peered":"2024-04-18T04:44:30.270804+0000","last_unstale":"2024-04-18T04:44:34.288936+0000","last_undegraded":"2024-04-18T04:44:34.288936+0000","last_fullsized":"2024-04-18T04:44:34.288936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:18:27.955171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.289697+0000","last_change":"2024-04-18T04:44:29.895084+0000","last_active":"2024-04-18T04:44:34.289697+0000","last_peered":"2024-04-18T04:44:34.289697+0000","last_clean":"2024-04-18T04:44:34.289697+0000","last_became_active":"2024-04-18T04:44:29.894829+0000","last_became_peered":"2024-04-18T04:44:29.894829+0000","last_unstale":"2024-04-18T04:44:34.289697+0000","last_undegraded":"2024-04-18T04:44:34.289697+0000","last_fullsized":"2024-04-18T04:44:34.289697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:54.812428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.203324+0000","last_change":"2024-04-18T04:44:29.892826+0000","last_active":"2024-04-18T04:44:35.203324+0000","last_peered":"2024-04-18T04:44:35.203324+0000","last_clean":"2024-04-18T04:44:35.203324+0000","last_became_active":"2024-04-18T04:44:29.892282+0000","last_became_peered":"2024-04-18T04:44:29.892282+0000","last_unstale":"2024-04-18T04:44:35.203324+0000","last_undegraded":"2024-04-18T04:44:35.203324+0000","last_fullsized":"2024-04-18T04:44:35.203324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:02.844116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.288503+0000","last_change":"2024-04-18T04:44:30.285312+0000","last_active":"2024-04-18T04:44:34.288503+0000","last_peered":"2024-04-18T04:44:34.288503+0000","last_clean":"2024-04-18T04:44:34.288503+0000","last_became_active":"2024-04-18T04:44:30.285055+0000","last_became_peered":"2024-04-18T04:44:30.285055+0000","last_unstale":"2024-04-18T04:44:34.288503+0000","last_undegraded":"2024-04-18T04:44:34.288503+0000","last_fullsized":"2024-04-18T04:44:34.288503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:50:00.641018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.790995+0000","last_change":"2024-04-18T04:44:34.323352+0000","last_active":"2024-04-18T04:44:34.790995+0000","last_peered":"2024-04-18T04:44:34.790995+0000","last_clean":"2024-04-18T04:44:34.790995+0000","last_became_active":"2024-04-18T04:44:34.321645+0000","last_became_peered":"2024-04-18T04:44:34.321645+0000","last_unstale":"2024-04-18T04:44:34.790995+0000","last_undegraded":"2024-04-18T04:44:34.790995+0000","last_fullsized":"2024-04-18T04:44:34.790995+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:33:27.387013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.681203+0000","last_change":"2024-04-18T04:44:29.891865+0000","last_active":"2024-04-18T04:44:34.681203+0000","last_peered":"2024-04-18T04:44:34.681203+0000","last_clean":"2024-04-18T04:44:34.681203+0000","last_became_active":"2024-04-18T04:44:29.891610+0000","last_became_peered":"2024-04-18T04:44:29.891610+0000","last_unstale":"2024-04-18T04:44:34.681203+0000","last_undegraded":"2024-04-18T04:44:34.681203+0000","last_fullsized":"2024-04-18T04:44:34.681203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:36:42.266497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.310919+0000","last_change":"2024-04-18T04:44:30.279080+0000","last_active":"2024-04-18T04:44:34.310919+0000","last_peered":"2024-04-18T04:44:34.310919+0000","last_clean":"2024-04-18T04:44:34.310919+0000","last_became_active":"2024-04-18T04:44:30.278275+0000","last_became_peered":"2024-04-18T04:44:30.278275+0000","last_unstale":"2024-04-18T04:44:34.310919+0000","last_undegraded":"2024-04-18T04:44:34.310919+0000","last_fullsized":"2024-04-18T04:44:34.310919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:51:48.272703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.681364+0000","last_change":"2024-04-18T04:44:34.313835+0000","last_active":"2024-04-18T04:44:34.681364+0000","last_peered":"2024-04-18T04:44:34.681364+0000","last_clean":"2024-04-18T04:44:34.681364+0000","last_became_active":"2024-04-18T04:44:34.313416+0000","last_became_peered":"2024-04-18T04:44:34.313416+0000","last_unstale":"2024-04-18T04:44:34.681364+0000","last_undegraded":"2024-04-18T04:44:34.681364+0000","last_fullsized":"2024-04-18T04:44:34.681364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:57:47.245809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287790+0000","last_change":"2024-04-18T04:44:30.297229+0000","last_active":"2024-04-18T04:44:34.287790+0000","last_peered":"2024-04-18T04:44:34.287790+0000","last_clean":"2024-04-18T04:44:34.287790+0000","last_became_active":"2024-04-18T04:44:30.296354+0000","last_became_peered":"2024-04-18T04:44:30.296354+0000","last_unstale":"2024-04-18T04:44:34.287790+0000","last_undegraded":"2024-04-18T04:44:34.287790+0000","last_fullsized":"2024-04-18T04:44:34.287790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:30:35.845106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.285182+0000","last_change":"2024-04-18T04:44:30.281213+0000","last_active":"2024-04-18T04:44:34.285182+0000","last_peered":"2024-04-18T04:44:34.285182+0000","last_clean":"2024-04-18T04:44:34.285182+0000","last_became_active":"2024-04-18T04:44:30.280941+0000","last_became_peered":"2024-04-18T04:44:30.280941+0000","last_unstale":"2024-04-18T04:44:34.285182+0000","last_undegraded":"2024-04-18T04:44:34.285182+0000","last_fullsized":"2024-04-18T04:44:34.285182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:15:37.795670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.307313+0000","last_change":"2024-04-18T04:44:30.288507+0000","last_active":"2024-04-18T04:44:34.307313+0000","last_peered":"2024-04-18T04:44:34.307313+0000","last_clean":"2024-04-18T04:44:34.307313+0000","last_became_active":"2024-04-18T04:44:30.287820+0000","last_became_peered":"2024-04-18T04:44:30.287820+0000","last_unstale":"2024-04-18T04:44:34.307313+0000","last_undegraded":"2024-04-18T04:44:34.307313+0000","last_fullsized":"2024-04-18T04:44:34.307313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:25:29.500586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.288460+0000","last_change":"2024-04-18T04:44:30.273278+0000","last_active":"2024-04-18T04:44:34.288460+0000","last_peered":"2024-04-18T04:44:34.288460+0000","last_clean":"2024-04-18T04:44:34.288460+0000","last_became_active":"2024-04-18T04:44:30.272973+0000","last_became_peered":"2024-04-18T04:44:30.272973+0000","last_unstale":"2024-04-18T04:44:34.288460+0000","last_undegraded":"2024-04-18T04:44:34.288460+0000","last_fullsized":"2024-04-18T04:44:34.288460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:37:02.421925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.292341+0000","last_change":"2024-04-18T04:44:30.298936+0000","last_active":"2024-04-18T04:44:34.292341+0000","last_peered":"2024-04-18T04:44:34.292341+0000","last_clean":"2024-04-18T04:44:34.292341+0000","last_became_active":"2024-04-18T04:44:30.298637+0000","last_became_peered":"2024-04-18T04:44:30.298637+0000","last_unstale":"2024-04-18T04:44:34.292341+0000","last_undegraded":"2024-04-18T04:44:34.292341+0000","last_fullsized":"2024-04-18T04:44:34.292341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:04:33.188772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.296348+0000","last_change":"2024-04-18T04:44:30.274613+0000","last_active":"2024-04-18T04:44:34.296348+0000","last_peered":"2024-04-18T04:44:34.296348+0000","last_clean":"2024-04-18T04:44:34.296348+0000","last_became_active":"2024-04-18T04:44:30.274328+0000","last_became_peered":"2024-04-18T04:44:30.274328+0000","last_unstale":"2024-04-18T04:44:34.296348+0000","last_undegraded":"2024-04-18T04:44:34.296348+0000","last_fullsized":"2024-04-18T04:44:34.296348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:55:41.700955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.290317+0000","last_change":"2024-04-18T04:44:30.309403+0000","last_active":"2024-04-18T04:44:34.290317+0000","last_peered":"2024-04-18T04:44:34.290317+0000","last_clean":"2024-04-18T04:44:34.290317+0000","last_became_active":"2024-04-18T04:44:30.308415+0000","last_became_peered":"2024-04-18T04:44:30.308415+0000","last_unstale":"2024-04-18T04:44:34.290317+0000","last_undegraded":"2024-04-18T04:44:34.290317+0000","last_fullsized":"2024-04-18T04:44:34.290317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:51:58.935503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.291911+0000","last_change":"2024-04-18T04:44:30.293996+0000","last_active":"2024-04-18T04:44:34.291911+0000","last_peered":"2024-04-18T04:44:34.291911+0000","last_clean":"2024-04-18T04:44:34.291911+0000","last_became_active":"2024-04-18T04:44:30.293748+0000","last_became_peered":"2024-04-18T04:44:30.293748+0000","last_unstale":"2024-04-18T04:44:34.291911+0000","last_undegraded":"2024-04-18T04:44:34.291911+0000","last_fullsized":"2024-04-18T04:44:34.291911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:18:32.116499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.306956+0000","last_change":"2024-04-18T04:44:30.312850+0000","last_active":"2024-04-18T04:44:34.306956+0000","last_peered":"2024-04-18T04:44:34.306956+0000","last_clean":"2024-04-18T04:44:34.306956+0000","last_became_active":"2024-04-18T04:44:30.304701+0000","last_became_peered":"2024-04-18T04:44:30.304701+0000","last_unstale":"2024-04-18T04:44:34.306956+0000","last_undegraded":"2024-04-18T04:44:34.306956+0000","last_fullsized":"2024-04-18T04:44:34.306956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:01:39.253277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.289625+0000","last_change":"2024-04-18T04:44:30.285836+0000","last_active":"2024-04-18T04:44:34.289625+0000","last_peered":"2024-04-18T04:44:34.289625+0000","last_clean":"2024-04-18T04:44:34.289625+0000","last_became_active":"2024-04-18T04:44:30.285602+0000","last_became_peered":"2024-04-18T04:44:30.285602+0000","last_unstale":"2024-04-18T04:44:34.289625+0000","last_undegraded":"2024-04-18T04:44:34.289625+0000","last_fullsized":"2024-04-18T04:44:34.289625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:34:39.594780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.306887+0000","last_change":"2024-04-18T04:44:30.307940+0000","last_active":"2024-04-18T04:44:34.306887+0000","last_peered":"2024-04-18T04:44:34.306887+0000","last_clean":"2024-04-18T04:44:34.306887+0000","last_became_active":"2024-04-18T04:44:30.307224+0000","last_became_peered":"2024-04-18T04:44:30.307224+0000","last_unstale":"2024-04-18T04:44:34.306887+0000","last_undegraded":"2024-04-18T04:44:34.306887+0000","last_fullsized":"2024-04-18T04:44:34.306887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:30:52.000855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.288405+0000","last_change":"2024-04-18T04:44:30.310229+0000","last_active":"2024-04-18T04:44:34.288405+0000","last_peered":"2024-04-18T04:44:34.288405+0000","last_clean":"2024-04-18T04:44:34.288405+0000","last_became_active":"2024-04-18T04:44:30.310045+0000","last_became_peered":"2024-04-18T04:44:30.310045+0000","last_unstale":"2024-04-18T04:44:34.288405+0000","last_undegraded":"2024-04-18T04:44:34.288405+0000","last_fullsized":"2024-04-18T04:44:34.288405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:22:55.588300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.289109+0000","last_change":"2024-04-18T04:44:30.305644+0000","last_active":"2024-04-18T04:44:34.289109+0000","last_peered":"2024-04-18T04:44:34.289109+0000","last_clean":"2024-04-18T04:44:34.289109+0000","last_became_active":"2024-04-18T04:44:30.304921+0000","last_became_peered":"2024-04-18T04:44:30.304921+0000","last_unstale":"2024-04-18T04:44:34.289109+0000","last_undegraded":"2024-04-18T04:44:34.289109+0000","last_fullsized":"2024-04-18T04:44:34.289109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:17:37.235711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.296403+0000","last_change":"2024-04-18T04:44:30.294105+0000","last_active":"2024-04-18T04:44:34.296403+0000","last_peered":"2024-04-18T04:44:34.296403+0000","last_clean":"2024-04-18T04:44:34.296403+0000","last_became_active":"2024-04-18T04:44:30.291742+0000","last_became_peered":"2024-04-18T04:44:30.291742+0000","last_unstale":"2024-04-18T04:44:34.296403+0000","last_undegraded":"2024-04-18T04:44:34.296403+0000","last_fullsized":"2024-04-18T04:44:34.296403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:43:26.428261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.284984+0000","last_change":"2024-04-18T04:44:30.296496+0000","last_active":"2024-04-18T04:44:34.284984+0000","last_peered":"2024-04-18T04:44:34.284984+0000","last_clean":"2024-04-18T04:44:34.284984+0000","last_became_active":"2024-04-18T04:44:30.296177+0000","last_became_peered":"2024-04-18T04:44:30.296177+0000","last_unstale":"2024-04-18T04:44:34.284984+0000","last_undegraded":"2024-04-18T04:44:34.284984+0000","last_fullsized":"2024-04-18T04:44:34.284984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:46:44.829326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.310435+0000","last_change":"2024-04-18T04:44:30.306568+0000","last_active":"2024-04-18T04:44:34.310435+0000","last_peered":"2024-04-18T04:44:34.310435+0000","last_clean":"2024-04-18T04:44:34.310435+0000","last_became_active":"2024-04-18T04:44:30.305674+0000","last_became_peered":"2024-04-18T04:44:30.305674+0000","last_unstale":"2024-04-18T04:44:34.310435+0000","last_undegraded":"2024-04-18T04:44:34.310435+0000","last_fullsized":"2024-04-18T04:44:34.310435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:58:10.740164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.306735+0000","last_change":"2024-04-18T04:44:30.307297+0000","last_active":"2024-04-18T04:44:34.306735+0000","last_peered":"2024-04-18T04:44:34.306735+0000","last_clean":"2024-04-18T04:44:34.306735+0000","last_became_active":"2024-04-18T04:44:30.305470+0000","last_became_peered":"2024-04-18T04:44:30.305470+0000","last_unstale":"2024-04-18T04:44:34.306735+0000","last_undegraded":"2024-04-18T04:44:34.306735+0000","last_fullsized":"2024-04-18T04:44:34.306735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:01:00.587115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.297511+0000","last_change":"2024-04-18T04:44:30.280849+0000","last_active":"2024-04-18T04:44:34.297511+0000","last_peered":"2024-04-18T04:44:34.297511+0000","last_clean":"2024-04-18T04:44:34.297511+0000","last_became_active":"2024-04-18T04:44:30.280535+0000","last_became_peered":"2024-04-18T04:44:30.280535+0000","last_unstale":"2024-04-18T04:44:34.297511+0000","last_undegraded":"2024-04-18T04:44:34.297511+0000","last_fullsized":"2024-04-18T04:44:34.297511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:01:06.241941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287205+0000","last_change":"2024-04-18T04:44:30.278849+0000","last_active":"2024-04-18T04:44:34.287205+0000","last_peered":"2024-04-18T04:44:34.287205+0000","last_clean":"2024-04-18T04:44:34.287205+0000","last_became_active":"2024-04-18T04:44:30.278624+0000","last_became_peered":"2024-04-18T04:44:30.278624+0000","last_unstale":"2024-04-18T04:44:34.287205+0000","last_undegraded":"2024-04-18T04:44:34.287205+0000","last_fullsized":"2024-04-18T04:44:34.287205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:31:30.791150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.289094+0000","last_change":"2024-04-18T04:44:30.296148+0000","last_active":"2024-04-18T04:44:34.289094+0000","last_peered":"2024-04-18T04:44:34.289094+0000","last_clean":"2024-04-18T04:44:34.289094+0000","last_became_active":"2024-04-18T04:44:30.295754+0000","last_became_peered":"2024-04-18T04:44:30.295754+0000","last_unstale":"2024-04-18T04:44:34.289094+0000","last_undegraded":"2024-04-18T04:44:34.289094+0000","last_fullsized":"2024-04-18T04:44:34.289094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:39:53.809075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.304251+0000","last_change":"2024-04-18T04:44:30.298061+0000","last_active":"2024-04-18T04:44:34.304251+0000","last_peered":"2024-04-18T04:44:34.304251+0000","last_clean":"2024-04-18T04:44:34.304251+0000","last_became_active":"2024-04-18T04:44:30.297416+0000","last_became_peered":"2024-04-18T04:44:30.297416+0000","last_unstale":"2024-04-18T04:44:34.304251+0000","last_undegraded":"2024-04-18T04:44:34.304251+0000","last_fullsized":"2024-04-18T04:44:34.304251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:35:48.612670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.290793+0000","last_change":"2024-04-18T04:44:30.292802+0000","last_active":"2024-04-18T04:44:34.290793+0000","last_peered":"2024-04-18T04:44:34.290793+0000","last_clean":"2024-04-18T04:44:34.290793+0000","last_became_active":"2024-04-18T04:44:30.291939+0000","last_became_peered":"2024-04-18T04:44:30.291939+0000","last_unstale":"2024-04-18T04:44:34.290793+0000","last_undegraded":"2024-04-18T04:44:34.290793+0000","last_fullsized":"2024-04-18T04:44:34.290793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:33:04.689561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.290104+0000","last_change":"2024-04-18T04:44:30.309020+0000","last_active":"2024-04-18T04:44:34.290104+0000","last_peered":"2024-04-18T04:44:34.290104+0000","last_clean":"2024-04-18T04:44:34.290104+0000","last_became_active":"2024-04-18T04:44:30.307604+0000","last_became_peered":"2024-04-18T04:44:30.307604+0000","last_unstale":"2024-04-18T04:44:34.290104+0000","last_undegraded":"2024-04-18T04:44:34.290104+0000","last_fullsized":"2024-04-18T04:44:34.290104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:44:54.764284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.293307+0000","last_change":"2024-04-18T04:44:30.314533+0000","last_active":"2024-04-18T04:44:34.293307+0000","last_peered":"2024-04-18T04:44:34.293307+0000","last_clean":"2024-04-18T04:44:34.293307+0000","last_became_active":"2024-04-18T04:44:30.313985+0000","last_became_peered":"2024-04-18T04:44:30.313985+0000","last_unstale":"2024-04-18T04:44:34.293307+0000","last_undegraded":"2024-04-18T04:44:34.293307+0000","last_fullsized":"2024-04-18T04:44:34.293307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:02:03.941709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.288844+0000","last_change":"2024-04-18T04:44:30.309273+0000","last_active":"2024-04-18T04:44:34.288844+0000","last_peered":"2024-04-18T04:44:34.288844+0000","last_clean":"2024-04-18T04:44:34.288844+0000","last_became_active":"2024-04-18T04:44:30.309002+0000","last_became_peered":"2024-04-18T04:44:30.309002+0000","last_unstale":"2024-04-18T04:44:34.288844+0000","last_undegraded":"2024-04-18T04:44:34.288844+0000","last_fullsized":"2024-04-18T04:44:34.288844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:49:10.005359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287466+0000","last_change":"2024-04-18T04:44:30.292371+0000","last_active":"2024-04-18T04:44:34.287466+0000","last_peered":"2024-04-18T04:44:34.287466+0000","last_clean":"2024-04-18T04:44:34.287466+0000","last_became_active":"2024-04-18T04:44:30.290504+0000","last_became_peered":"2024-04-18T04:44:30.290504+0000","last_unstale":"2024-04-18T04:44:34.287466+0000","last_undegraded":"2024-04-18T04:44:34.287466+0000","last_fullsized":"2024-04-18T04:44:34.287466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:11.998355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.306657+0000","last_change":"2024-04-18T04:44:30.299935+0000","last_active":"2024-04-18T04:44:34.306657+0000","last_peered":"2024-04-18T04:44:34.306657+0000","last_clean":"2024-04-18T04:44:34.306657+0000","last_became_active":"2024-04-18T04:44:30.290175+0000","last_became_peered":"2024-04-18T04:44:30.290175+0000","last_unstale":"2024-04-18T04:44:34.306657+0000","last_undegraded":"2024-04-18T04:44:34.306657+0000","last_fullsized":"2024-04-18T04:44:34.306657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:15:13.703423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.288026+0000","last_change":"2024-04-18T04:44:30.288940+0000","last_active":"2024-04-18T04:44:34.288026+0000","last_peered":"2024-04-18T04:44:34.288026+0000","last_clean":"2024-04-18T04:44:34.288026+0000","last_became_active":"2024-04-18T04:44:30.288131+0000","last_became_peered":"2024-04-18T04:44:30.288131+0000","last_unstale":"2024-04-18T04:44:34.288026+0000","last_undegraded":"2024-04-18T04:44:34.288026+0000","last_fullsized":"2024-04-18T04:44:34.288026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:31:08.895305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.307235+0000","last_change":"2024-04-18T04:44:30.288066+0000","last_active":"2024-04-18T04:44:34.307235+0000","last_peered":"2024-04-18T04:44:34.307235+0000","last_clean":"2024-04-18T04:44:34.307235+0000","last_became_active":"2024-04-18T04:44:30.287325+0000","last_became_peered":"2024-04-18T04:44:30.287325+0000","last_unstale":"2024-04-18T04:44:34.307235+0000","last_undegraded":"2024-04-18T04:44:34.307235+0000","last_fullsized":"2024-04-18T04:44:34.307235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:58:04.111225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287906+0000","last_change":"2024-04-18T04:44:30.275485+0000","last_active":"2024-04-18T04:44:34.287906+0000","last_peered":"2024-04-18T04:44:34.287906+0000","last_clean":"2024-04-18T04:44:34.287906+0000","last_became_active":"2024-04-18T04:44:30.275118+0000","last_became_peered":"2024-04-18T04:44:30.275118+0000","last_unstale":"2024-04-18T04:44:34.287906+0000","last_undegraded":"2024-04-18T04:44:34.287906+0000","last_fullsized":"2024-04-18T04:44:34.287906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:25:09.625660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.296349+0000","last_change":"2024-04-18T04:44:30.277119+0000","last_active":"2024-04-18T04:44:34.296349+0000","last_peered":"2024-04-18T04:44:34.296349+0000","last_clean":"2024-04-18T04:44:34.296349+0000","last_became_active":"2024-04-18T04:44:30.276654+0000","last_became_peered":"2024-04-18T04:44:30.276654+0000","last_unstale":"2024-04-18T04:44:34.296349+0000","last_undegraded":"2024-04-18T04:44:34.296349+0000","last_fullsized":"2024-04-18T04:44:34.296349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:52.420199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.293115+0000","last_change":"2024-04-18T04:44:30.302905+0000","last_active":"2024-04-18T04:44:34.293115+0000","last_peered":"2024-04-18T04:44:34.293115+0000","last_clean":"2024-04-18T04:44:34.293115+0000","last_became_active":"2024-04-18T04:44:30.302180+0000","last_became_peered":"2024-04-18T04:44:30.302180+0000","last_unstale":"2024-04-18T04:44:34.293115+0000","last_undegraded":"2024-04-18T04:44:34.293115+0000","last_fullsized":"2024-04-18T04:44:34.293115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:41:53.211956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4594,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66624,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509451,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":106163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]}]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":102367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]}]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":102527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]}]},{"osd":7,"up_from":14,"seq":60129542155,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":693317,"data_compressed":33312,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2689999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]}]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":106163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.179}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.401}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2569999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":262144,"data_stored":102457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1040000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":102493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":335872,"data_stored":693373,"data_compressed":33312,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33312,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33312,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T04:45:00.414 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-18T04:45:00.414 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-18T04:45:00.415 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-18T04:45:00.415 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-18T04:45:00.415 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-18T04:45:00.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.585+0000 7f1e5c800640 1 Processor -- start 2024-04-18T04:45:00.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.585+0000 7f1e5c800640 1 -- start start 2024-04-18T04:45:00.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.585+0000 7f1e5c800640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1e5415d3a0 0x7f1e5415d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:00.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.585+0000 7f1e5c800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1e540c1290 0x7f1e540c1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:00.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.585+0000 7f1e5c800640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e5406b660 con 0x7f1e5415cfc0 2024-04-18T04:45:00.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.585+0000 7f1e5c800640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e54070060 con 0x7f1e5415d3a0 2024-04-18T04:45:00.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.585+0000 7f1e5c800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e540c7740 con 0x7f1e540c1290 2024-04-18T04:45:00.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.585+0000 7f1e59400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1e5415d3a0 0x7f1e5415d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:00.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.585+0000 7f1e59400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1e5415d3a0 0x7f1e5415d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46050/0 (socket says 172.21.15.120:46050) 2024-04-18T04:45:00.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.585+0000 7f1e59400640 1 -- 172.21.15.120:0/2692716283 learned_addr learned my addr 172.21.15.120:0/2692716283 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:00.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.585+0000 7f1e5a800640 1 --2- 172.21.15.120:0/2692716283 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1e540c1290 0x7f1e540c1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:00.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.585+0000 7f1e59400640 1 -- 172.21.15.120:0/2692716283 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1e540c1290 msgr2=0x7f1e540c1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:00.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.585+0000 7f1e59400640 1 --2- 172.21.15.120:0/2692716283 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1e540c1290 0x7f1e540c1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:00.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.585+0000 7f1e59400640 1 -- 172.21.15.120:0/2692716283 >> v1:172.21.15.132:6789/0 conn(0x7f1e5415cfc0 legacy=0x7f1e5415a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:00.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.585+0000 7f1e59400640 1 -- 172.21.15.120:0/2692716283 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e540c0e00 con 0x7f1e5415d3a0 2024-04-18T04:45:00.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.589+0000 7f1e59400640 1 --2- 172.21.15.120:0/2692716283 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1e5415d3a0 0x7f1e5415d860 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1e440098a0 tx=0x7f1e4401ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff08b8beaf12fbf3 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:00.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.589+0000 7f1e58a00640 1 -- 172.21.15.120:0/2692716283 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e440a8a30 con 0x7f1e5415d3a0 2024-04-18T04:45:00.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.589+0000 7f1e58a00640 1 -- 172.21.15.120:0/2692716283 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e440a8b90 con 0x7f1e5415d3a0 2024-04-18T04:45:00.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.589+0000 7f1e58a00640 1 -- 172.21.15.120:0/2692716283 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e440b0440 con 0x7f1e5415d3a0 2024-04-18T04:45:00.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.589+0000 7f1e5c800640 1 -- 172.21.15.120:0/2692716283 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1e5415d3a0 msgr2=0x7f1e5415d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:00.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.589+0000 7f1e5c800640 1 --2- 172.21.15.120:0/2692716283 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1e5415d3a0 0x7f1e5415d860 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1e440098a0 tx=0x7f1e4401ed30 comp rx=0 tx=0).stop 2024-04-18T04:45:00.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.589+0000 7f1e5c800640 1 -- 172.21.15.120:0/2692716283 shutdown_connections 2024-04-18T04:45:00.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.589+0000 7f1e5c800640 1 --2- 172.21.15.120:0/2692716283 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1e540c1290 0x7f1e540c1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:00.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.589+0000 7f1e5c800640 1 --2- 172.21.15.120:0/2692716283 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1e5415d3a0 0x7f1e5415d860 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:00.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.589+0000 7f1e5c800640 1 -- 172.21.15.120:0/2692716283 >> 172.21.15.120:0/2692716283 conn(0x7f1e540c78c0 msgr2=0x7f1e540c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:00.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.589+0000 7f1e5c800640 1 -- 172.21.15.120:0/2692716283 shutdown_connections 2024-04-18T04:45:00.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.589+0000 7f1e5c800640 1 -- 172.21.15.120:0/2692716283 wait complete. 2024-04-18T04:45:00.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.593+0000 7f1e5c800640 1 Processor -- start 2024-04-18T04:45:00.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.593+0000 7f1e5c800640 1 -- start start 2024-04-18T04:45:00.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.593+0000 7f1e5c800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1e540c1290 0x7f1e54071740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:00.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.593+0000 7f1e5c800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e5415cfc0 0x7f1e541ef0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:00.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.593+0000 7f1e5c800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1e5415d3a0 0x7f1e541ef610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:00.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.593+0000 7f1e5c800640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e541f31d0 con 0x7f1e5415d3a0 2024-04-18T04:45:00.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.593+0000 7f1e5c800640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e541f25c0 con 0x7f1e5415cfc0 2024-04-18T04:45:00.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.593+0000 7f1e5c800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e541f28a0 con 0x7f1e540c1290 2024-04-18T04:45:00.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.593+0000 7f1e5a800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1e5415d3a0 0x7f1e541ef610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:00.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.593+0000 7f1e5a800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1e5415d3a0 0x7f1e541ef610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46062/0 (socket says 172.21.15.120:46062) 2024-04-18T04:45:00.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.593+0000 7f1e5a800640 1 -- 172.21.15.120:0/658826546 learned_addr learned my addr 172.21.15.120:0/658826546 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:00.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.593+0000 7f1e59e00640 1 --2- 172.21.15.120:0/658826546 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1e540c1290 0x7f1e54071740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:00.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.593+0000 7f1e59400640 1 --2- 172.21.15.120:0/658826546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e5415cfc0 0x7f1e541ef0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:00.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.593+0000 7f1e5a800640 1 -- 172.21.15.120:0/658826546 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1e540c1290 msgr2=0x7f1e54071740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:00.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.593+0000 7f1e5a800640 1 --2- 172.21.15.120:0/658826546 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1e540c1290 0x7f1e54071740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:00.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.593+0000 7f1e5a800640 1 -- 172.21.15.120:0/658826546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e5415cfc0 msgr2=0x7f1e541ef0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:00.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.593+0000 7f1e5a800640 1 --2- 172.21.15.120:0/658826546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e5415cfc0 0x7f1e541ef0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:00.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.593+0000 7f1e5a800640 1 -- 172.21.15.120:0/658826546 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e440094d0 con 0x7f1e5415d3a0 2024-04-18T04:45:00.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.593+0000 7f1e5a800640 1 --2- 172.21.15.120:0/658826546 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1e5415d3a0 0x7f1e541ef610 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1e50007d90 tx=0x7f1e5000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:00.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.593+0000 7f1e4e000640 1 -- 172.21.15.120:0/658826546 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e50014420 con 0x7f1e5415d3a0 2024-04-18T04:45:00.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.593+0000 7f1e4e000640 1 -- 172.21.15.120:0/658826546 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e500145a0 con 0x7f1e5415d3a0 2024-04-18T04:45:00.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.593+0000 7f1e4e000640 1 -- 172.21.15.120:0/658826546 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e50014950 con 0x7f1e5415d3a0 2024-04-18T04:45:00.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.593+0000 7f1e5c800640 1 -- 172.21.15.120:0/658826546 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e541f2b80 con 0x7f1e5415d3a0 2024-04-18T04:45:00.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.593+0000 7f1e5c800640 1 -- 172.21.15.120:0/658826546 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e54153b20 con 0x7f1e5415d3a0 2024-04-18T04:45:00.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.597+0000 7f1e5c800640 1 -- 172.21.15.120:0/658826546 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e54072a70 con 0x7f1e5415d3a0 2024-04-18T04:45:00.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.597+0000 7f1e4e000640 1 -- 172.21.15.120:0/658826546 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1e50014ab0 con 0x7f1e5415d3a0 2024-04-18T04:45:00.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.597+0000 7f1e4e000640 1 --2- 172.21.15.120:0/658826546 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1e38066690 0x7f1e38068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:00.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.597+0000 7f1e4e000640 1 -- 172.21.15.120:0/658826546 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1e50084ce0 con 0x7f1e5415d3a0 2024-04-18T04:45:00.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.597+0000 7f1e59e00640 1 --2- 172.21.15.120:0/658826546 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1e38066690 0x7f1e38068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:00.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.597+0000 7f1e59e00640 1 --2- 172.21.15.120:0/658826546 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1e38066690 0x7f1e38068b50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1e48007fd0 tx=0x7f1e48009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:00.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.601+0000 7f1e4e000640 1 -- 172.21.15.120:0/658826546 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f1e50051d70 con 0x7f1e5415d3a0 2024-04-18T04:45:00.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.789+0000 7f1e5c800640 1 -- 172.21.15.120:0/658826546 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f1e541f3310 con 0x7f1e5415d3a0 2024-04-18T04:45:00.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.793+0000 7f1e4e000640 1 -- 172.21.15.120:0/658826546 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164892 (secure 0 0 0) 0x7f1e541f3310 con 0x7f1e5415d3a0 2024-04-18T04:45:00.794 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:45:00.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.797+0000 7f1e5c800640 1 -- 172.21.15.120:0/658826546 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1e38066690 msgr2=0x7f1e38068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:00.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.797+0000 7f1e5c800640 1 --2- 172.21.15.120:0/658826546 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1e38066690 0x7f1e38068b50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1e48007fd0 tx=0x7f1e48009040 comp rx=0 tx=0).stop 2024-04-18T04:45:00.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.797+0000 7f1e5c800640 1 -- 172.21.15.120:0/658826546 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1e5415d3a0 msgr2=0x7f1e541ef610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:00.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.797+0000 7f1e5c800640 1 --2- 172.21.15.120:0/658826546 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1e5415d3a0 0x7f1e541ef610 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1e50007d90 tx=0x7f1e5000e4b0 comp rx=0 tx=0).stop 2024-04-18T04:45:00.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.797+0000 7f1e5c800640 1 -- 172.21.15.120:0/658826546 shutdown_connections 2024-04-18T04:45:00.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.797+0000 7f1e5c800640 1 --2- 172.21.15.120:0/658826546 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1e38066690 0x7f1e38068b50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:00.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.797+0000 7f1e5c800640 1 --2- 172.21.15.120:0/658826546 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1e5415d3a0 0x7f1e541ef610 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:00.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.797+0000 7f1e5c800640 1 --2- 172.21.15.120:0/658826546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e5415cfc0 0x7f1e541ef0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:00.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.797+0000 7f1e5c800640 1 --2- 172.21.15.120:0/658826546 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1e540c1290 0x7f1e54071740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:00.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.797+0000 7f1e5c800640 1 -- 172.21.15.120:0/658826546 >> 172.21.15.120:0/658826546 conn(0x7f1e540c78c0 msgr2=0x7f1e540c9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:00.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.797+0000 7f1e5c800640 1 -- 172.21.15.120:0/658826546 shutdown_connections 2024-04-18T04:45:00.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.797+0000 7f1e5c800640 1 -- 172.21.15.120:0/658826546 wait complete. 2024-04-18T04:45:00.815 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":5,"flags":0,"active_gid":4113,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":27788},{"type":"v1","addr":"172.21.15.132:6833","nonce":27788}]},"active_addr":"172.21.15.132:6833/27788","active_change":"2024-04-18T04:44:10.774534+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.132:0","nonce":2066675544}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.132:0","nonce":1976001434}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.132:0","nonce":3786504745}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.132:0","nonce":2868556423}]}]} 2024-04-18T04:45:00.819 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-18T04:45:00.820 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-18T04:45:00.820 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T04:45:00.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.957+0000 7ff4dd000640 1 Processor -- start 2024-04-18T04:45:00.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.957+0000 7ff4dd000640 1 -- start start 2024-04-18T04:45:00.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.957+0000 7ff4dd000640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff4d80c7200 0x7ff4d8151440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:00.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.957+0000 7ff4dd000640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4d81576f0 con 0x7ff4d8151980 2024-04-18T04:45:00.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.961+0000 7ff4dd000640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4d8157990 con 0x7ff4d806b8c0 2024-04-18T04:45:00.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.961+0000 7ff4dd000640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4d8158610 con 0x7ff4d80c7200 2024-04-18T04:45:00.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.961+0000 7ff4d5400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff4d80c7200 0x7ff4d8151440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:00.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.961+0000 7ff4d6800640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7ff4d8151980 0x7ff4d8070750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:59114/0 (socket says 172.21.15.120:59114) 2024-04-18T04:45:00.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.961+0000 7ff4d6800640 1 -- 172.21.15.120:0/2450737582 learned_addr learned my addr 172.21.15.120:0/2450737582 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:45:00.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.961+0000 7ff4d5400640 1 -- 172.21.15.120:0/2450737582 >> v1:172.21.15.132:6789/0 conn(0x7ff4d806b8c0 legacy=0x7ff4d806bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:00.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.961+0000 7ff4d5400640 1 -- 172.21.15.120:0/2450737582 >> v1:172.21.15.120:6789/0 conn(0x7ff4d8151980 legacy=0x7ff4d8070750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:00.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.961+0000 7ff4d5400640 1 -- 172.21.15.120:0/2450737582 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d8157c70 con 0x7ff4d80c7200 2024-04-18T04:45:00.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.961+0000 7ff4d4a00640 1 -- 172.21.15.120:0/2450737582 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3215014952 0 0) 0x7ff4d81576f0 con 0x7ff4d8151980 2024-04-18T04:45:00.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.961+0000 7ff4d5400640 1 --2- 172.21.15.120:0/2450737582 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4d80c7200 0x7ff4d8151440 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff4c80097c0 tx=0x7ff4c801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a76f33374d5cabd5 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:00.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.961+0000 7ff4d4a00640 1 -- 172.21.15.120:0/2450737582 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c80a8990 con 0x7ff4d80c7200 2024-04-18T04:45:00.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.961+0000 7ff4d4a00640 1 -- 172.21.15.120:0/2450737582 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c80a8af0 con 0x7ff4d80c7200 2024-04-18T04:45:00.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.961+0000 7ff4d4a00640 1 -- 172.21.15.120:0/2450737582 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c80a8e80 con 0x7ff4d80c7200 2024-04-18T04:45:00.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.965+0000 7ff4dd000640 1 -- 172.21.15.120:0/2450737582 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4d80c7200 msgr2=0x7ff4d8151440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:00.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.965+0000 7ff4dd000640 1 --2- 172.21.15.120:0/2450737582 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4d80c7200 0x7ff4d8151440 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff4c80097c0 tx=0x7ff4c801ec90 comp rx=0 tx=0).stop 2024-04-18T04:45:00.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.965+0000 7ff4dd000640 1 -- 172.21.15.120:0/2450737582 shutdown_connections 2024-04-18T04:45:00.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.965+0000 7ff4dd000640 1 --2- 172.21.15.120:0/2450737582 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4d80c7200 0x7ff4d8151440 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:00.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.965+0000 7ff4dd000640 1 -- 172.21.15.120:0/2450737582 >> 172.21.15.120:0/2450737582 conn(0x7ff4d80c78c0 msgr2=0x7ff4d80c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:00.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.965+0000 7ff4dd000640 1 -- 172.21.15.120:0/2450737582 shutdown_connections 2024-04-18T04:45:00.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.965+0000 7ff4dd000640 1 -- 172.21.15.120:0/2450737582 wait complete. 2024-04-18T04:45:00.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.965+0000 7ff4dd000640 1 Processor -- start 2024-04-18T04:45:00.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.965+0000 7ff4dd000640 1 -- start start 2024-04-18T04:45:00.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.965+0000 7ff4dd000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4d806b8c0 0x7ff4d81ef6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:00.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.965+0000 7ff4dd000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4d80c7200 0x7ff4d814f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:00.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.965+0000 7ff4dd000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4d8151980 0x7ff4d80c0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:00.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.965+0000 7ff4dd000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d81efc20 con 0x7ff4d806b8c0 2024-04-18T04:45:00.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.965+0000 7ff4dd000640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d8152d10 con 0x7ff4d80c7200 2024-04-18T04:45:00.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.965+0000 7ff4dd000640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d80bfe70 con 0x7ff4d8151980 2024-04-18T04:45:00.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.965+0000 7ff4d5e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4d806b8c0 0x7ff4d81ef6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:00.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.965+0000 7ff4d5e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4d806b8c0 0x7ff4d81ef6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:33642/0 (socket says 172.21.15.120:33642) 2024-04-18T04:45:00.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.965+0000 7ff4d5e00640 1 -- 172.21.15.120:0/1469119668 learned_addr learned my addr 172.21.15.120:0/1469119668 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:00.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.965+0000 7ff4d5400640 1 --2- 172.21.15.120:0/1469119668 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4d80c7200 0x7ff4d814f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:00.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.965+0000 7ff4d6800640 1 --2- 172.21.15.120:0/1469119668 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4d8151980 0x7ff4d80c0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:00.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.965+0000 7ff4d5e00640 1 -- 172.21.15.120:0/1469119668 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4d8151980 msgr2=0x7ff4d80c0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:00.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.965+0000 7ff4d5e00640 1 --2- 172.21.15.120:0/1469119668 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4d8151980 0x7ff4d80c0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:00.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.965+0000 7ff4d5e00640 1 -- 172.21.15.120:0/1469119668 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4d80c7200 msgr2=0x7ff4d814f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:00.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.965+0000 7ff4d5e00640 1 --2- 172.21.15.120:0/1469119668 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4d80c7200 0x7ff4d814f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:00.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.965+0000 7ff4d5e00640 1 -- 172.21.15.120:0/1469119668 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c8009420 con 0x7ff4d806b8c0 2024-04-18T04:45:00.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.965+0000 7ff4d6800640 1 --2- 172.21.15.120:0/1469119668 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4d8151980 0x7ff4d80c0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:45:00.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.965+0000 7ff4d5400640 1 --2- 172.21.15.120:0/1469119668 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4d80c7200 0x7ff4d814f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:00.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.969+0000 7ff4d5e00640 1 --2- 172.21.15.120:0/1469119668 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4d806b8c0 0x7ff4d81ef6e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff4c000c3c0 tx=0x7ff4c000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:00.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.969+0000 7ff4ce000640 1 -- 172.21.15.120:0/1469119668 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c00052d0 con 0x7ff4d806b8c0 2024-04-18T04:45:00.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.969+0000 7ff4ce000640 1 -- 172.21.15.120:0/1469119668 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c0005430 con 0x7ff4d806b8c0 2024-04-18T04:45:00.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.969+0000 7ff4ce000640 1 -- 172.21.15.120:0/1469119668 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c0003840 con 0x7ff4d806b8c0 2024-04-18T04:45:00.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.969+0000 7ff4dd000640 1 -- 172.21.15.120:0/1469119668 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4d80c1840 con 0x7ff4d806b8c0 2024-04-18T04:45:00.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.969+0000 7ff4dd000640 1 -- 172.21.15.120:0/1469119668 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4d80c0130 con 0x7ff4d806b8c0 2024-04-18T04:45:00.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.969+0000 7ff4dd000640 1 -- 172.21.15.120:0/1469119668 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4d8072a70 con 0x7ff4d806b8c0 2024-04-18T04:45:00.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.969+0000 7ff4ce000640 1 -- 172.21.15.120:0/1469119668 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff4c00039a0 con 0x7ff4d806b8c0 2024-04-18T04:45:00.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.969+0000 7ff4ce000640 1 --2- 172.21.15.120:0/1469119668 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff4b40666c0 0x7ff4b4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:00.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.969+0000 7ff4ce000640 1 -- 172.21.15.120:0/1469119668 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff4c0083a20 con 0x7ff4d806b8c0 2024-04-18T04:45:00.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.969+0000 7ff4d5400640 1 --2- 172.21.15.120:0/1469119668 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff4b40666c0 0x7ff4b4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:00.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.973+0000 7ff4d5400640 1 --2- 172.21.15.120:0/1469119668 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff4b40666c0 0x7ff4b4068b80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff4c80b2000 tx=0x7ff4c80aa070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:00.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:00.973+0000 7ff4ce000640 1 -- 172.21.15.120:0/1469119668 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7ff4c0050a00 con 0x7ff4d806b8c0 2024-04-18T04:45:01.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.129+0000 7ff4dd000640 1 -- 172.21.15.120:0/1469119668 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4d80ca880 con 0x7ff4d806b8c0 2024-04-18T04:45:01.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.133+0000 7ff4ce000640 1 -- 172.21.15.120:0/1469119668 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7ff4c0054020 con 0x7ff4d806b8c0 2024-04-18T04:45:01.132 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:45:01.132 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":25,"fsid":"8e73592f-08e2-4957-a98f-9d044cec4ba5","created":"2024-04-18T04:44:06.139983+0000","modified":"2024-04-18T04:44:34.676253+0000","last_up_change":"2024-04-18T04:44:17.410146+0000","last_in_change":"2024-04-18T04:44:08.470250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T04:44:16.864728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T04:44:28.825773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T04:44:29.245857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-18T04:44:32.314302+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a80903bd-d9be-4fb9-af99-6125cb26bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":27468},{"type":"v1","addr":"172.21.15.120:6801","nonce":27468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":27468},{"type":"v1","addr":"172.21.15.120:6803","nonce":27468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":27468},{"type":"v1","addr":"172.21.15.120:6807","nonce":27468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":27468},{"type":"v1","addr":"172.21.15.120:6805","nonce":27468}]},"public_addr":"172.21.15.120:6801/27468","cluster_addr":"172.21.15.120:6803/27468","heartbeat_back_addr":"172.21.15.120:6807/27468","heartbeat_front_addr":"172.21.15.120:6805/27468","state":["exists","up"]},{"osd":1,"uuid":"8f5f004b-6870-4c78-8d50-9622e631ec25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":27470},{"type":"v1","addr":"172.21.15.120:6823","nonce":27470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":27470},{"type":"v1","addr":"172.21.15.120:6827","nonce":27470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":27470},{"type":"v1","addr":"172.21.15.120:6831","nonce":27470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":27470},{"type":"v1","addr":"172.21.15.120:6829","nonce":27470}]},"public_addr":"172.21.15.120:6823/27470","cluster_addr":"172.21.15.120:6827/27470","heartbeat_back_addr":"172.21.15.120:6831/27470","heartbeat_front_addr":"172.21.15.120:6829/27470","state":["exists","up"]},{"osd":2,"uuid":"6e228a2b-6103-4301-a8b5-ee81dbb1f920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":27471},{"type":"v1","addr":"172.21.15.120:6817","nonce":27471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":27471},{"type":"v1","addr":"172.21.15.120:6819","nonce":27471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":27471},{"type":"v1","addr":"172.21.15.120:6826","nonce":27471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":27471},{"type":"v1","addr":"172.21.15.120:6822","nonce":27471}]},"public_addr":"172.21.15.120:6817/27471","cluster_addr":"172.21.15.120:6819/27471","heartbeat_back_addr":"172.21.15.120:6826/27471","heartbeat_front_addr":"172.21.15.120:6822/27471","state":["exists","up"]},{"osd":3,"uuid":"7a5cabd7-d898-4e32-a03c-25b46e790134","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":27469},{"type":"v1","addr":"172.21.15.120:6809","nonce":27469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":27469},{"type":"v1","addr":"172.21.15.120:6811","nonce":27469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":27469},{"type":"v1","addr":"172.21.15.120:6815","nonce":27469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":27469},{"type":"v1","addr":"172.21.15.120:6813","nonce":27469}]},"public_addr":"172.21.15.120:6809/27469","cluster_addr":"172.21.15.120:6811/27469","heartbeat_back_addr":"172.21.15.120:6815/27469","heartbeat_front_addr":"172.21.15.120:6813/27469","state":["exists","up"]},{"osd":4,"uuid":"8e9f530f-6bab-4b23-a1a3-a71362fefcc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":28102},{"type":"v1","addr":"172.21.15.132:6825","nonce":28102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":28102},{"type":"v1","addr":"172.21.15.132:6827","nonce":28102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":28102},{"type":"v1","addr":"172.21.15.132:6831","nonce":28102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":28102},{"type":"v1","addr":"172.21.15.132:6829","nonce":28102}]},"public_addr":"172.21.15.132:6825/28102","cluster_addr":"172.21.15.132:6827/28102","heartbeat_back_addr":"172.21.15.132:6831/28102","heartbeat_front_addr":"172.21.15.132:6829/28102","state":["exists","up"]},{"osd":5,"uuid":"2243fabe-cc81-40cf-91bc-f106fe275a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":28104},{"type":"v1","addr":"172.21.15.132:6809","nonce":28104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":28104},{"type":"v1","addr":"172.21.15.132:6811","nonce":28104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":28104},{"type":"v1","addr":"172.21.15.132:6815","nonce":28104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":28104},{"type":"v1","addr":"172.21.15.132:6813","nonce":28104}]},"public_addr":"172.21.15.132:6809/28104","cluster_addr":"172.21.15.132:6811/28104","heartbeat_back_addr":"172.21.15.132:6815/28104","heartbeat_front_addr":"172.21.15.132:6813/28104","state":["exists","up"]},{"osd":6,"uuid":"c093a5ed-25c8-41a7-a20d-606a1a1661e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":28103},{"type":"v1","addr":"172.21.15.132:6801","nonce":28103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":28103},{"type":"v1","addr":"172.21.15.132:6803","nonce":28103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":28103},{"type":"v1","addr":"172.21.15.132:6807","nonce":28103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":28103},{"type":"v1","addr":"172.21.15.132:6805","nonce":28103}]},"public_addr":"172.21.15.132:6801/28103","cluster_addr":"172.21.15.132:6803/28103","heartbeat_back_addr":"172.21.15.132:6807/28103","heartbeat_front_addr":"172.21.15.132:6805/28103","state":["exists","up"]},{"osd":7,"uuid":"c37426b7-1080-4434-9f3e-a3afbbdc0fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":28129},{"type":"v1","addr":"172.21.15.132:6817","nonce":28129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":28129},{"type":"v1","addr":"172.21.15.132:6819","nonce":28129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":28129},{"type":"v1","addr":"172.21.15.132:6823","nonce":28129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":28129},{"type":"v1","addr":"172.21.15.132:6821","nonce":28129}]},"public_addr":"172.21.15.132:6817/28129","cluster_addr":"172.21.15.132:6819/28129","heartbeat_back_addr":"172.21.15.132:6823/28129","heartbeat_front_addr":"172.21.15.132:6821/28129","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.053825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.289753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.274645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.146361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.943883+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.701955+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.851076+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.800782+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T04:45:01.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.133+0000 7ff4dd000640 1 -- 172.21.15.120:0/1469119668 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff4b40666c0 msgr2=0x7ff4b4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.133+0000 7ff4dd000640 1 --2- 172.21.15.120:0/1469119668 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff4b40666c0 0x7ff4b4068b80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff4c80b2000 tx=0x7ff4c80aa070 comp rx=0 tx=0).stop 2024-04-18T04:45:01.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.133+0000 7ff4dd000640 1 -- 172.21.15.120:0/1469119668 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4d806b8c0 msgr2=0x7ff4d81ef6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.133+0000 7ff4dd000640 1 --2- 172.21.15.120:0/1469119668 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4d806b8c0 0x7ff4d81ef6e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff4c000c3c0 tx=0x7ff4c000c880 comp rx=0 tx=0).stop 2024-04-18T04:45:01.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.133+0000 7ff4dd000640 1 -- 172.21.15.120:0/1469119668 shutdown_connections 2024-04-18T04:45:01.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.133+0000 7ff4dd000640 1 --2- 172.21.15.120:0/1469119668 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff4b40666c0 0x7ff4b4068b80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.133+0000 7ff4dd000640 1 --2- 172.21.15.120:0/1469119668 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4d8151980 0x7ff4d80c0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.133+0000 7ff4dd000640 1 --2- 172.21.15.120:0/1469119668 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4d80c7200 0x7ff4d814f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.133+0000 7ff4dd000640 1 --2- 172.21.15.120:0/1469119668 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4d806b8c0 0x7ff4d81ef6e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.133+0000 7ff4dd000640 1 -- 172.21.15.120:0/1469119668 >> 172.21.15.120:0/1469119668 conn(0x7ff4d80c78c0 msgr2=0x7ff4d80c8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:01.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.133+0000 7ff4dd000640 1 -- 172.21.15.120:0/1469119668 shutdown_connections 2024-04-18T04:45:01.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.133+0000 7ff4dd000640 1 -- 172.21.15.120:0/1469119668 wait complete. 2024-04-18T04:45:01.153 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-18T04:45:01.153 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T04:45:01.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.289+0000 7fd567200640 1 Processor -- start 2024-04-18T04:45:01.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.289+0000 7fd567200640 1 -- start start 2024-04-18T04:45:01.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.289+0000 7fd567200640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd56006b8c0 0x7fd5600c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.289+0000 7fd567200640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd56006bca0 0x7fd56006c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.289+0000 7fd567200640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5601576f0 con 0x7fd560151440 2024-04-18T04:45:01.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.289+0000 7fd567200640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd560158610 con 0x7fd56006b8c0 2024-04-18T04:45:01.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.289+0000 7fd567200640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5600c7740 con 0x7fd56006bca0 2024-04-18T04:45:01.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.293+0000 7fd565200640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fd560151440 0x7fd560070750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:59124/0 (socket says 172.21.15.120:59124) 2024-04-18T04:45:01.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.293+0000 7fd565200640 1 -- 172.21.15.120:0/2454150585 learned_addr learned my addr 172.21.15.120:0/2454150585 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:45:01.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.293+0000 7fd55fe00640 1 --2- 172.21.15.120:0/2454150585 >> v2:172.21.15.120:3300/0 conn(0x7fd56006b8c0 0x7fd5600c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.293+0000 7fd55f400640 1 --2- 172.21.15.120:0/2454150585 >> v2:172.21.15.132:3300/0 conn(0x7fd56006bca0 0x7fd56006c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.293+0000 7fd55ea00640 1 -- 172.21.15.120:0/2454150585 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1364434151 0 0) 0x7fd5601576f0 con 0x7fd560151440 2024-04-18T04:45:01.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.293+0000 7fd55ea00640 1 -- 172.21.15.120:0/2454150585 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd544003530 con 0x7fd560151440 2024-04-18T04:45:01.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.293+0000 7fd55fe00640 1 -- 172.21.15.120:0/2454150585 >> v2:172.21.15.132:3300/0 conn(0x7fd56006bca0 msgr2=0x7fd56006c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:01.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.293+0000 7fd55fe00640 1 --2- 172.21.15.120:0/2454150585 >> v2:172.21.15.132:3300/0 conn(0x7fd56006bca0 0x7fd56006c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.293+0000 7fd55fe00640 1 -- 172.21.15.120:0/2454150585 >> v1:172.21.15.120:6789/0 conn(0x7fd560151440 legacy=0x7fd560070750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.293+0000 7fd55fe00640 1 -- 172.21.15.120:0/2454150585 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd560157990 con 0x7fd56006b8c0 2024-04-18T04:45:01.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.293+0000 7fd55fe00640 1 --2- 172.21.15.120:0/2454150585 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd56006b8c0 0x7fd5600c7200 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd5600c8700 tx=0x7fd55001f120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e51f818ada690eb1 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:01.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.293+0000 7fd55ea00640 1 -- 172.21.15.120:0/2454150585 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5500af600 con 0x7fd56006b8c0 2024-04-18T04:45:01.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.293+0000 7fd55ea00640 1 -- 172.21.15.120:0/2454150585 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5500ab050 con 0x7fd56006b8c0 2024-04-18T04:45:01.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.293+0000 7fd55ea00640 1 -- 172.21.15.120:0/2454150585 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5500af980 con 0x7fd56006b8c0 2024-04-18T04:45:01.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.297+0000 7fd567200640 1 -- 172.21.15.120:0/2454150585 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd56006b8c0 msgr2=0x7fd5600c7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.297+0000 7fd567200640 1 --2- 172.21.15.120:0/2454150585 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd56006b8c0 0x7fd5600c7200 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd5600c8700 tx=0x7fd55001f120 comp rx=0 tx=0).stop 2024-04-18T04:45:01.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.297+0000 7fd567200640 1 -- 172.21.15.120:0/2454150585 shutdown_connections 2024-04-18T04:45:01.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.297+0000 7fd567200640 1 --2- 172.21.15.120:0/2454150585 >> v2:172.21.15.132:3300/0 conn(0x7fd56006bca0 0x7fd56006c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.297+0000 7fd567200640 1 --2- 172.21.15.120:0/2454150585 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd56006b8c0 0x7fd5600c7200 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.297+0000 7fd567200640 1 -- 172.21.15.120:0/2454150585 >> 172.21.15.120:0/2454150585 conn(0x7fd5600c78c0 msgr2=0x7fd5600c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:01.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.297+0000 7fd567200640 1 -- 172.21.15.120:0/2454150585 shutdown_connections 2024-04-18T04:45:01.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.297+0000 7fd567200640 1 -- 172.21.15.120:0/2454150585 wait complete. 2024-04-18T04:45:01.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.297+0000 7fd567200640 1 Processor -- start 2024-04-18T04:45:01.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.297+0000 7fd567200640 1 -- start start 2024-04-18T04:45:01.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.297+0000 7fd567200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd56006b8c0 0x7fd56015af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.297+0000 7fd567200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd56006bca0 0x7fd56014c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.297+0000 7fd567200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd560151440 0x7fd5600c4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.297+0000 7fd567200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5601587a0 con 0x7fd56006bca0 2024-04-18T04:45:01.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.297+0000 7fd567200640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd560154ad0 con 0x7fd56006b8c0 2024-04-18T04:45:01.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.297+0000 7fd567200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd56015b5c0 con 0x7fd560151440 2024-04-18T04:45:01.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.297+0000 7fd55f400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd56006bca0 0x7fd56014c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.297+0000 7fd55f400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd56006bca0 0x7fd56014c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:33654/0 (socket says 172.21.15.120:33654) 2024-04-18T04:45:01.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.297+0000 7fd55f400640 1 -- 172.21.15.120:0/343542509 learned_addr learned my addr 172.21.15.120:0/343542509 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:01.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.297+0000 7fd55fe00640 1 --2- 172.21.15.120:0/343542509 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd56006b8c0 0x7fd56015af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.297+0000 7fd565200640 1 --2- 172.21.15.120:0/343542509 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd560151440 0x7fd5600c4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.297+0000 7fd55f400640 1 -- 172.21.15.120:0/343542509 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd560151440 msgr2=0x7fd5600c4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.297+0000 7fd55f400640 1 --2- 172.21.15.120:0/343542509 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd560151440 0x7fd5600c4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.297+0000 7fd55f400640 1 -- 172.21.15.120:0/343542509 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd56006b8c0 msgr2=0x7fd56015af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.297+0000 7fd55f400640 1 --2- 172.21.15.120:0/343542509 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd56006b8c0 0x7fd56015af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.297+0000 7fd55f400640 1 -- 172.21.15.120:0/343542509 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd550009a70 con 0x7fd56006bca0 2024-04-18T04:45:01.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.297+0000 7fd565200640 1 --2- 172.21.15.120:0/343542509 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd560151440 0x7fd5600c4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:01.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.297+0000 7fd55f400640 1 --2- 172.21.15.120:0/343542509 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd56006bca0 0x7fd56014c110 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd54c00e870 tx=0x7fd54c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:01.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.301+0000 7fd557e00640 1 -- 172.21.15.120:0/343542509 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c009510 con 0x7fd56006bca0 2024-04-18T04:45:01.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.301+0000 7fd557e00640 1 -- 172.21.15.120:0/343542509 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54c00eec0 con 0x7fd56006bca0 2024-04-18T04:45:01.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.301+0000 7fd557e00640 1 -- 172.21.15.120:0/343542509 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c00cb40 con 0x7fd56006bca0 2024-04-18T04:45:01.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.301+0000 7fd567200640 1 -- 172.21.15.120:0/343542509 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd56015b8a0 con 0x7fd56006bca0 2024-04-18T04:45:01.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.301+0000 7fd567200640 1 -- 172.21.15.120:0/343542509 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd560158cd0 con 0x7fd56006bca0 2024-04-18T04:45:01.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.301+0000 7fd567200640 1 -- 172.21.15.120:0/343542509 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd560072a70 con 0x7fd56006bca0 2024-04-18T04:45:01.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.301+0000 7fd557e00640 1 -- 172.21.15.120:0/343542509 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd54c00ccc0 con 0x7fd56006bca0 2024-04-18T04:45:01.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.301+0000 7fd557e00640 1 --2- 172.21.15.120:0/343542509 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd540066690 0x7fd540068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.301+0000 7fd557e00640 1 -- 172.21.15.120:0/343542509 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd54c084530 con 0x7fd56006bca0 2024-04-18T04:45:01.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.301+0000 7fd55fe00640 1 --2- 172.21.15.120:0/343542509 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd540066690 0x7fd540068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.305+0000 7fd55fe00640 1 --2- 172.21.15.120:0/343542509 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd540066690 0x7fd540068b50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd5500b1000 tx=0x7fd5500aa000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:01.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.305+0000 7fd557e00640 1 -- 172.21.15.120:0/343542509 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fd54c0515c0 con 0x7fd56006bca0 2024-04-18T04:45:01.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.461+0000 7fd567200640 1 -- 172.21.15.120:0/343542509 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd560155000 con 0x7fd56006bca0 2024-04-18T04:45:01.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.461+0000 7fd557e00640 1 -- 172.21.15.120:0/343542509 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7fd54c054be0 con 0x7fd56006bca0 2024-04-18T04:45:01.463 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:45:01.463 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":25,"fsid":"8e73592f-08e2-4957-a98f-9d044cec4ba5","created":"2024-04-18T04:44:06.139983+0000","modified":"2024-04-18T04:44:34.676253+0000","last_up_change":"2024-04-18T04:44:17.410146+0000","last_in_change":"2024-04-18T04:44:08.470250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T04:44:16.864728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T04:44:28.825773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T04:44:29.245857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-18T04:44:32.314302+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a80903bd-d9be-4fb9-af99-6125cb26bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":27468},{"type":"v1","addr":"172.21.15.120:6801","nonce":27468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":27468},{"type":"v1","addr":"172.21.15.120:6803","nonce":27468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":27468},{"type":"v1","addr":"172.21.15.120:6807","nonce":27468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":27468},{"type":"v1","addr":"172.21.15.120:6805","nonce":27468}]},"public_addr":"172.21.15.120:6801/27468","cluster_addr":"172.21.15.120:6803/27468","heartbeat_back_addr":"172.21.15.120:6807/27468","heartbeat_front_addr":"172.21.15.120:6805/27468","state":["exists","up"]},{"osd":1,"uuid":"8f5f004b-6870-4c78-8d50-9622e631ec25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":27470},{"type":"v1","addr":"172.21.15.120:6823","nonce":27470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":27470},{"type":"v1","addr":"172.21.15.120:6827","nonce":27470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":27470},{"type":"v1","addr":"172.21.15.120:6831","nonce":27470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":27470},{"type":"v1","addr":"172.21.15.120:6829","nonce":27470}]},"public_addr":"172.21.15.120:6823/27470","cluster_addr":"172.21.15.120:6827/27470","heartbeat_back_addr":"172.21.15.120:6831/27470","heartbeat_front_addr":"172.21.15.120:6829/27470","state":["exists","up"]},{"osd":2,"uuid":"6e228a2b-6103-4301-a8b5-ee81dbb1f920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":27471},{"type":"v1","addr":"172.21.15.120:6817","nonce":27471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":27471},{"type":"v1","addr":"172.21.15.120:6819","nonce":27471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":27471},{"type":"v1","addr":"172.21.15.120:6826","nonce":27471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":27471},{"type":"v1","addr":"172.21.15.120:6822","nonce":27471}]},"public_addr":"172.21.15.120:6817/27471","cluster_addr":"172.21.15.120:6819/27471","heartbeat_back_addr":"172.21.15.120:6826/27471","heartbeat_front_addr":"172.21.15.120:6822/27471","state":["exists","up"]},{"osd":3,"uuid":"7a5cabd7-d898-4e32-a03c-25b46e790134","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":27469},{"type":"v1","addr":"172.21.15.120:6809","nonce":27469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":27469},{"type":"v1","addr":"172.21.15.120:6811","nonce":27469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":27469},{"type":"v1","addr":"172.21.15.120:6815","nonce":27469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":27469},{"type":"v1","addr":"172.21.15.120:6813","nonce":27469}]},"public_addr":"172.21.15.120:6809/27469","cluster_addr":"172.21.15.120:6811/27469","heartbeat_back_addr":"172.21.15.120:6815/27469","heartbeat_front_addr":"172.21.15.120:6813/27469","state":["exists","up"]},{"osd":4,"uuid":"8e9f530f-6bab-4b23-a1a3-a71362fefcc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":28102},{"type":"v1","addr":"172.21.15.132:6825","nonce":28102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":28102},{"type":"v1","addr":"172.21.15.132:6827","nonce":28102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":28102},{"type":"v1","addr":"172.21.15.132:6831","nonce":28102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":28102},{"type":"v1","addr":"172.21.15.132:6829","nonce":28102}]},"public_addr":"172.21.15.132:6825/28102","cluster_addr":"172.21.15.132:6827/28102","heartbeat_back_addr":"172.21.15.132:6831/28102","heartbeat_front_addr":"172.21.15.132:6829/28102","state":["exists","up"]},{"osd":5,"uuid":"2243fabe-cc81-40cf-91bc-f106fe275a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":28104},{"type":"v1","addr":"172.21.15.132:6809","nonce":28104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":28104},{"type":"v1","addr":"172.21.15.132:6811","nonce":28104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":28104},{"type":"v1","addr":"172.21.15.132:6815","nonce":28104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":28104},{"type":"v1","addr":"172.21.15.132:6813","nonce":28104}]},"public_addr":"172.21.15.132:6809/28104","cluster_addr":"172.21.15.132:6811/28104","heartbeat_back_addr":"172.21.15.132:6815/28104","heartbeat_front_addr":"172.21.15.132:6813/28104","state":["exists","up"]},{"osd":6,"uuid":"c093a5ed-25c8-41a7-a20d-606a1a1661e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":28103},{"type":"v1","addr":"172.21.15.132:6801","nonce":28103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":28103},{"type":"v1","addr":"172.21.15.132:6803","nonce":28103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":28103},{"type":"v1","addr":"172.21.15.132:6807","nonce":28103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":28103},{"type":"v1","addr":"172.21.15.132:6805","nonce":28103}]},"public_addr":"172.21.15.132:6801/28103","cluster_addr":"172.21.15.132:6803/28103","heartbeat_back_addr":"172.21.15.132:6807/28103","heartbeat_front_addr":"172.21.15.132:6805/28103","state":["exists","up"]},{"osd":7,"uuid":"c37426b7-1080-4434-9f3e-a3afbbdc0fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":28129},{"type":"v1","addr":"172.21.15.132:6817","nonce":28129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":28129},{"type":"v1","addr":"172.21.15.132:6819","nonce":28129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":28129},{"type":"v1","addr":"172.21.15.132:6823","nonce":28129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":28129},{"type":"v1","addr":"172.21.15.132:6821","nonce":28129}]},"public_addr":"172.21.15.132:6817/28129","cluster_addr":"172.21.15.132:6819/28129","heartbeat_back_addr":"172.21.15.132:6823/28129","heartbeat_front_addr":"172.21.15.132:6821/28129","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.053825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.289753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.274645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.146361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.943883+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.701955+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.851076+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.800782+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T04:45:01.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.465+0000 7fd567200640 1 -- 172.21.15.120:0/343542509 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd540066690 msgr2=0x7fd540068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.465+0000 7fd567200640 1 --2- 172.21.15.120:0/343542509 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd540066690 0x7fd540068b50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd5500b1000 tx=0x7fd5500aa000 comp rx=0 tx=0).stop 2024-04-18T04:45:01.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.465+0000 7fd567200640 1 -- 172.21.15.120:0/343542509 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd56006bca0 msgr2=0x7fd56014c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.465+0000 7fd567200640 1 --2- 172.21.15.120:0/343542509 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd56006bca0 0x7fd56014c110 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd54c00e870 tx=0x7fd54c00ec70 comp rx=0 tx=0).stop 2024-04-18T04:45:01.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.465+0000 7fd567200640 1 -- 172.21.15.120:0/343542509 shutdown_connections 2024-04-18T04:45:01.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.465+0000 7fd567200640 1 --2- 172.21.15.120:0/343542509 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd540066690 0x7fd540068b50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.465+0000 7fd567200640 1 --2- 172.21.15.120:0/343542509 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd560151440 0x7fd5600c4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.465+0000 7fd567200640 1 --2- 172.21.15.120:0/343542509 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd56006bca0 0x7fd56014c110 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.465+0000 7fd567200640 1 --2- 172.21.15.120:0/343542509 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd56006b8c0 0x7fd56015af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.465+0000 7fd567200640 1 -- 172.21.15.120:0/343542509 >> 172.21.15.120:0/343542509 conn(0x7fd5600c78c0 msgr2=0x7fd5600c5490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:01.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.465+0000 7fd567200640 1 -- 172.21.15.120:0/343542509 shutdown_connections 2024-04-18T04:45:01.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.465+0000 7fd567200640 1 -- 172.21.15.120:0/343542509 wait complete. 2024-04-18T04:45:01.484 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-18T04:45:01.485 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-18T04:45:01.485 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-18T04:45:01.485 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-18T04:45:01.486 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-18T04:45:01.486 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-18T04:45:01.487 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-18T04:45:01.487 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-18T04:45:01.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.721+0000 7f6e98e00640 1 Processor -- start 2024-04-18T04:45:01.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.721+0000 7f6e98e00640 1 -- start start 2024-04-18T04:45:01.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.721+0000 7f6e98e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6e940c7730 0x7f6e94156490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.721+0000 7f6e98e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6e9406df50 0x7f6e9414fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.721+0000 7f6e98e00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e940705b0 con 0x7f6e94065bc0 2024-04-18T04:45:01.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.721+0000 7f6e98e00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e940c2d70 con 0x7f6e940c7730 2024-04-18T04:45:01.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.721+0000 7f6e98e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e940c6140 con 0x7f6e9406df50 2024-04-18T04:45:01.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.725+0000 7f6e93e00640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f6e94065bc0 0x7f6e940c5a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:41638/0 (socket says 172.21.15.120:41638) 2024-04-18T04:45:01.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.725+0000 7f6e93e00640 1 -- 172.21.15.120:0/2963204799 learned_addr learned my addr 172.21.15.120:0/2963204799 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:45:01.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.725+0000 7f6e93400640 1 --2- 172.21.15.120:0/2963204799 >> v2:172.21.15.120:3300/0 conn(0x7f6e940c7730 0x7f6e94156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.725+0000 7f6e92a00640 1 --2- 172.21.15.120:0/2963204799 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6e9406df50 0x7f6e9414fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.725+0000 7f6e92000640 1 -- 172.21.15.120:0/2963204799 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 965997883 0 0) 0x7f6e940705b0 con 0x7f6e94065bc0 2024-04-18T04:45:01.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.725+0000 7f6e92a00640 1 -- 172.21.15.120:0/2963204799 >> v2:172.21.15.120:3300/0 conn(0x7f6e940c7730 msgr2=0x7f6e94156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:01.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.725+0000 7f6e92a00640 1 --2- 172.21.15.120:0/2963204799 >> v2:172.21.15.120:3300/0 conn(0x7f6e940c7730 0x7f6e94156490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.725+0000 7f6e92a00640 1 -- 172.21.15.120:0/2963204799 >> v1:172.21.15.132:6789/0 conn(0x7f6e94065bc0 legacy=0x7f6e940c5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.725+0000 7f6e92a00640 1 -- 172.21.15.120:0/2963204799 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e9406e800 con 0x7f6e9406df50 2024-04-18T04:45:01.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.729+0000 7f1e84e00640 1 Processor -- start 2024-04-18T04:45:01.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.729+0000 7f6e92a00640 1 --2- 172.21.15.120:0/2963204799 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6e9406df50 0x7f6e9414fdb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6e800097c0 tx=0x7f6e8001c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c803f5ea57ff314b server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:01.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.729+0000 7f6e92000640 1 -- 172.21.15.120:0/2963204799 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e800aa610 con 0x7f6e9406df50 2024-04-18T04:45:01.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.729+0000 7f6e92000640 1 -- 172.21.15.120:0/2963204799 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e800a6040 con 0x7f6e9406df50 2024-04-18T04:45:01.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.729+0000 7f6e92000640 1 -- 172.21.15.120:0/2963204799 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e800aa990 con 0x7f6e9406df50 2024-04-18T04:45:01.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.729+0000 7f6e98e00640 1 -- 172.21.15.120:0/2963204799 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6e9406df50 msgr2=0x7f6e9414fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.729+0000 7f6e98e00640 1 --2- 172.21.15.120:0/2963204799 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6e9406df50 0x7f6e9414fdb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6e800097c0 tx=0x7f6e8001c4b0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.729+0000 7f6e98e00640 1 -- 172.21.15.120:0/2963204799 shutdown_connections 2024-04-18T04:45:01.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.729+0000 7f6e98e00640 1 --2- 172.21.15.120:0/2963204799 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6e9406df50 0x7f6e9414fdb0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.729+0000 7f6e98e00640 1 --2- 172.21.15.120:0/2963204799 >> v2:172.21.15.120:3300/0 conn(0x7f6e940c7730 0x7f6e94156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.729+0000 7f6e98e00640 1 -- 172.21.15.120:0/2963204799 >> 172.21.15.120:0/2963204799 conn(0x7f6e94069ec0 msgr2=0x7f6e9406a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:01.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.733+0000 7f6e98e00640 1 -- 172.21.15.120:0/2963204799 shutdown_connections 2024-04-18T04:45:01.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.733+0000 7f6e98e00640 1 -- 172.21.15.120:0/2963204799 wait complete. 2024-04-18T04:45:01.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.729+0000 7f1e84e00640 1 -- start start 2024-04-18T04:45:01.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.733+0000 7f1e84e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1e800b3260 0x7f1e800cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.733+0000 7f1e84e00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e801622c0 con 0x7f1e8015b7e0 2024-04-18T04:45:01.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.733+0000 7f1e84e00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e800b4780 con 0x7f1e8015b400 2024-04-18T04:45:01.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.733+0000 7f1e84e00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e80161fe0 con 0x7f1e800b3260 2024-04-18T04:45:01.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.733+0000 7f1e7fe00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1e800b3260 0x7f1e800cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.733+0000 7f1e7fe00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1e800b3260 0x7f1e800cf610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:33664/0 (socket says 172.21.15.120:33664) 2024-04-18T04:45:01.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.733+0000 7f1e7fe00640 1 -- 172.21.15.120:0/295242844 learned_addr learned my addr 172.21.15.120:0/295242844 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:01.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.733+0000 7fbbc6000640 1 Processor -- start 2024-04-18T04:45:01.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.733+0000 7fbbc6000640 1 -- start start 2024-04-18T04:45:01.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.733+0000 7fbbc6000640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbbc015d9e0 0x7fbbc00c04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.733+0000 7fbbc6000640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fbbc006dd90 0x7fbbc00c0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.733+0000 7f6e98e00640 1 Processor -- start 2024-04-18T04:45:01.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.733+0000 7f1e7fe00640 1 -- 172.21.15.120:0/295242844 >> v1:172.21.15.132:6789/0 conn(0x7f1e8015b400 legacy=0x7f1e801613d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:01.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.733+0000 7f1e7fe00640 1 -- 172.21.15.120:0/295242844 >> v1:172.21.15.120:6789/0 conn(0x7f1e8015b7e0 legacy=0x7f1e801666f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:01.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.733+0000 7f6e98e00640 1 -- start start 2024-04-18T04:45:01.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.733+0000 7f1e7fe00640 1 -- 172.21.15.120:0/295242844 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e800b2040 con 0x7f1e800b3260 2024-04-18T04:45:01.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.733+0000 7fbbbea00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbbc015d9e0 0x7fbbc00c04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.733+0000 7fbbbea00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbbc015d9e0 0x7fbbc00c04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:60172/0 (socket says 172.21.15.120:60172) 2024-04-18T04:45:01.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.733+0000 7fbbbf400640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fbbc0157c40 0x7fbbc00cb3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:59134/0 (socket says 172.21.15.120:59134) 2024-04-18T04:45:01.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.737+0000 7f6e98e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e94065bc0 0x7f6e940c3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.737+0000 7fbbbea00640 1 -- 172.21.15.120:0/3806528804 learned_addr learned my addr 172.21.15.120:0/3806528804 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:01.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.737+0000 7fbbc6000640 1 -- 172.21.15.120:0/3806528804 --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbc015e9f0 con 0x7fbbc0157c40 2024-04-18T04:45:01.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.737+0000 7fbbc6000640 1 -- 172.21.15.120:0/3806528804 --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbc00c0030 con 0x7fbbc006dd90 2024-04-18T04:45:01.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.737+0000 7fbbc6000640 1 -- 172.21.15.120:0/3806528804 --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbc015de70 con 0x7fbbc015d9e0 2024-04-18T04:45:01.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.737+0000 7f6e98e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e9406df50 0x7f6e94155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.737+0000 7f4c6c400640 1 Processor -- start 2024-04-18T04:45:01.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.737+0000 7f6e98e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6e940c7730 0x7f6e940c9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.737+0000 7f6e98e00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e940ca870 con 0x7f6e94065bc0 2024-04-18T04:45:01.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.737+0000 7f6e98e00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e94154ba0 con 0x7f6e9406df50 2024-04-18T04:45:01.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.737+0000 7f6e98e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e941478a0 con 0x7f6e940c7730 2024-04-18T04:45:01.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.737+0000 7fbbbfe00640 1 --2- 172.21.15.120:0/3806528804 >> v2:172.21.15.120:3300/0 conn(0x7fbbc006dd90 0x7fbbc00c0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.737+0000 7f6e93e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6e940c7730 0x7f6e940c9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.737+0000 7f6e93e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6e940c7730 0x7f6e940c9570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:41928/0 (socket says 172.21.15.120:41928) 2024-04-18T04:45:01.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.737+0000 7f6e93e00640 1 -- 172.21.15.120:0/1313073961 learned_addr learned my addr 172.21.15.120:0/1313073961 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:01.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.737+0000 7f6e92a00640 1 --2- 172.21.15.120:0/1313073961 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e9406df50 0x7f6e94155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.737+0000 7f6e93e00640 1 -- 172.21.15.120:0/1313073961 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e9406df50 msgr2=0x7f6e94155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.737+0000 7f6e93e00640 1 --2- 172.21.15.120:0/1313073961 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e9406df50 0x7f6e94155030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.737+0000 7f6e93e00640 1 -- 172.21.15.120:0/1313073961 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e94065bc0 msgr2=0x7f6e940c3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.737+0000 7f6e93e00640 1 --2- 172.21.15.120:0/1313073961 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e94065bc0 0x7f6e940c3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.737+0000 7f6e93e00640 1 -- 172.21.15.120:0/1313073961 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e80009420 con 0x7f6e940c7730 2024-04-18T04:45:01.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.737+0000 7f4c6c400640 1 -- start start 2024-04-18T04:45:01.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.737+0000 7f6e92a00640 1 --2- 172.21.15.120:0/1313073961 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e9406df50 0x7f6e94155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:45:01.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.737+0000 7f6e93e00640 1 --2- 172.21.15.120:0/1313073961 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6e940c7730 0x7f6e940c9570 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c00c780 tx=0x7f6e8c00cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:01.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.737+0000 7fbbbe000640 1 -- 172.21.15.120:0/3806528804 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4163014042 0 0) 0x7fbbc015e9f0 con 0x7fbbc0157c40 2024-04-18T04:45:01.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.737+0000 7fbbbe000640 1 -- 172.21.15.120:0/3806528804 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbba4003530 con 0x7fbbc0157c40 2024-04-18T04:45:01.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.741+0000 7fbbbe000640 1 -- 172.21.15.120:0/3806528804 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2614882497 0 0) 0x7fbba4003530 con 0x7fbbc0157c40 2024-04-18T04:45:01.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.741+0000 7fbbbe000640 1 -- 172.21.15.120:0/3806528804 >> v2:172.21.15.132:3300/0 conn(0x7fbbc015d9e0 msgr2=0x7fbbc00c04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:01.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.741+0000 7fbbbe000640 1 --2- 172.21.15.120:0/3806528804 >> v2:172.21.15.132:3300/0 conn(0x7fbbc015d9e0 0x7fbbc00c04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.741+0000 7fbbbe000640 1 -- 172.21.15.120:0/3806528804 >> v2:172.21.15.120:3300/0 conn(0x7fbbc006dd90 msgr2=0x7fbbc00c0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:01.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.741+0000 7f6e8b400640 1 -- 172.21.15.120:0/1313073961 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c00ce90 con 0x7f6e940c7730 2024-04-18T04:45:01.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.741+0000 7fbbbe000640 1 --2- 172.21.15.120:0/3806528804 >> v2:172.21.15.120:3300/0 conn(0x7fbbc006dd90 0x7fbbc00c0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.741+0000 7fbbbe000640 1 -- 172.21.15.120:0/3806528804 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc015e150 con 0x7fbbc0157c40 2024-04-18T04:45:01.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.741+0000 7fbbbe000640 1 -- 172.21.15.120:0/3806528804 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7fbbb0001680 con 0x7fbbc0157c40 2024-04-18T04:45:01.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.741+0000 7fbbbe000640 1 -- 172.21.15.120:0/3806528804 >> v1:172.21.15.120:6789/0 conn(0x7fbbc0157c40 legacy=0x7fbbc00cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.741+0000 7f6e98e00640 1 -- 172.21.15.120:0/1313073961 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e94153a20 con 0x7f6e940c7730 2024-04-18T04:45:01.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.741+0000 7f6e98e00640 1 -- 172.21.15.120:0/1313073961 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e940caa80 con 0x7f6e940c7730 2024-04-18T04:45:01.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.741+0000 7fbbbe000640 1 --2- 172.21.15.120:0/3806528804 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbba4003980 0x7fbba4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.741+0000 7fbbbe000640 1 --2- 172.21.15.120:0/3806528804 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbba40047d0 0x7fbba4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.741+0000 7fbbbe000640 1 --2- 172.21.15.120:0/3806528804 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbba4005190 0x7fbba400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.741+0000 7f6e8b400640 1 -- 172.21.15.120:0/1313073961 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e8c00ce90 con 0x7f6e940c7730 2024-04-18T04:45:01.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.741+0000 7f4c6c400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4c6406b640 0x7f4c640c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.741+0000 7f4c6c400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4c64153440 0x7f4c64153860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.741+0000 7fbbbe000640 1 -- 172.21.15.120:0/3806528804 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc00c0030 con 0x7fbba4003980 2024-04-18T04:45:01.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.741+0000 7fbbbe000640 1 -- 172.21.15.120:0/3806528804 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc015de70 con 0x7fbba4005190 2024-04-18T04:45:01.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.741+0000 7fbbbe000640 1 -- 172.21.15.120:0/3806528804 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba400c060 con 0x7fbba40047d0 2024-04-18T04:45:01.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.741+0000 7fbbbea00640 1 --2- 172.21.15.120:0/3806528804 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbba40047d0 0x7fbba4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.741+0000 7f6e8b400640 1 -- 172.21.15.120:0/1313073961 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c00a640 con 0x7f6e940c7730 2024-04-18T04:45:01.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.741+0000 7f6e98e00640 1 -- 172.21.15.120:0/1313073961 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6e6c000fd0 con 0x7f6e940c7730 2024-04-18T04:45:01.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.741+0000 7f4c69a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4c6406b640 0x7f4c640c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.741+0000 7f4c69a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4c6406b640 0x7f4c640c57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:41950/0 (socket says 172.21.15.120:41950) 2024-04-18T04:45:01.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.741+0000 7f4c69a00640 1 -- 172.21.15.120:0/4150434428 learned_addr learned my addr 172.21.15.120:0/4150434428 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:01.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.741+0000 7f4c6c400640 1 --2- 172.21.15.120:0/4150434428 >> v2:172.21.15.132:3300/0 conn(0x7f4c6415cb30 0x7f4c6415cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.741+0000 7fca52200640 1 Processor -- start 2024-04-18T04:45:01.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.741+0000 7f4c69000640 1 --2- 172.21.15.120:0/4150434428 >> v2:172.21.15.120:3300/0 conn(0x7f4c64153440 0x7f4c64153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.741+0000 7fbbbf400640 1 --2- 172.21.15.120:0/3806528804 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbba4003980 0x7fbba4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.741+0000 7fbbbfe00640 1 --2- 172.21.15.120:0/3806528804 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbba4005190 0x7fbba400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.741+0000 7f4c6c400640 1 -- 172.21.15.120:0/4150434428 --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c64153da0 con 0x7f4c64153440 2024-04-18T04:45:01.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.741+0000 7f4c6c400640 1 -- 172.21.15.120:0/4150434428 --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c640c13a0 con 0x7f4c6415cb30 2024-04-18T04:45:01.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.741+0000 7f4c6a400640 1 --2- 172.21.15.120:0/4150434428 >> v2:172.21.15.132:3300/0 conn(0x7f4c6415cb30 0x7f4c6415cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.741+0000 7f69d9c00640 1 Processor -- start 2024-04-18T04:45:01.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.741+0000 7f69d9c00640 1 -- start start 2024-04-18T04:45:01.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.741+0000 7f4c6c400640 1 -- 172.21.15.120:0/4150434428 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6415a520 con 0x7f4c6406b640 2024-04-18T04:45:01.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7f4c6a400640 1 -- 172.21.15.120:0/4150434428 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4c6406b640 msgr2=0x7f4c640c57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:01.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7f4c6a400640 1 --2- 172.21.15.120:0/4150434428 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4c6406b640 0x7f4c640c57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7f4c6a400640 1 -- 172.21.15.120:0/4150434428 >> v2:172.21.15.120:3300/0 conn(0x7f4c64153440 msgr2=0x7f4c64153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:01.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7f4c6a400640 1 --2- 172.21.15.120:0/4150434428 >> v2:172.21.15.120:3300/0 conn(0x7f4c64153440 0x7f4c64153860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7f4c6a400640 1 -- 172.21.15.120:0/4150434428 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c640c04b0 con 0x7f4c6415cb30 2024-04-18T04:45:01.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.741+0000 7fca52200640 1 -- start start 2024-04-18T04:45:01.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7fca52200640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fca4c153900 0x7fca4c0c3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7fca52200640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fca4c0caea0 0x7fca4c0cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7fca52200640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca4c153ce0 con 0x7fca4c0c9d10 2024-04-18T04:45:01.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7fca52200640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca4c15a170 con 0x7fca4c153900 2024-04-18T04:45:01.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7fca52200640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca4c15a450 con 0x7fca4c0caea0 2024-04-18T04:45:01.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7fca4be00640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fca4c0c9d10 0x7fca4c159590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:41668/0 (socket says 172.21.15.120:41668) 2024-04-18T04:45:01.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7fca4aa00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fca4c0caea0 0x7fca4c0cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7fca4aa00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fca4c0caea0 0x7fca4c0cc3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:60208/0 (socket says 172.21.15.120:60208) 2024-04-18T04:45:01.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7fca4aa00640 1 -- 172.21.15.120:0/3854405923 learned_addr learned my addr 172.21.15.120:0/3854405923 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:01.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7fca4b400640 1 --2- 172.21.15.120:0/3854405923 >> v2:172.21.15.120:3300/0 conn(0x7fca4c153900 0x7fca4c0c3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.741+0000 7f1e7fe00640 1 --2- 172.21.15.120:0/295242844 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1e800b3260 0x7f1e800cf610 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1e78009e50 tx=0x7f1e7801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1c70f8da083a121 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:01.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7f1e7e000640 1 -- 172.21.15.120:0/295242844 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e780a56f0 con 0x7f1e800b3260 2024-04-18T04:45:01.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7f1e7e000640 1 -- 172.21.15.120:0/295242844 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e780a5850 con 0x7f1e800b3260 2024-04-18T04:45:01.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7f1e7e000640 1 -- 172.21.15.120:0/295242844 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e780a5be0 con 0x7f1e800b3260 2024-04-18T04:45:01.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7f6e8b400640 1 -- 172.21.15.120:0/1313073961 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6e8c00a7a0 con 0x7f6e940c7730 2024-04-18T04:45:01.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7f1e84e00640 1 -- 172.21.15.120:0/295242844 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1e800b3260 msgr2=0x7f1e800cf610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7f1e84e00640 1 --2- 172.21.15.120:0/295242844 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1e800b3260 0x7f1e800cf610 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1e78009e50 tx=0x7f1e7801c920 comp rx=0 tx=0).stop 2024-04-18T04:45:01.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7f1e84e00640 1 -- 172.21.15.120:0/295242844 shutdown_connections 2024-04-18T04:45:01.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7f1e84e00640 1 --2- 172.21.15.120:0/295242844 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1e800b3260 0x7f1e800cf610 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7f1e84e00640 1 -- 172.21.15.120:0/295242844 >> 172.21.15.120:0/295242844 conn(0x7f1e800661c0 msgr2=0x7f1e800cef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:01.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7fbbbf400640 1 -- 172.21.15.120:0/3806528804 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbba40047d0 msgr2=0x7fbba4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:01.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7fbbbf400640 1 --2- 172.21.15.120:0/3806528804 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbba40047d0 0x7fbba4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7fbbbf400640 1 -- 172.21.15.120:0/3806528804 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbba4005190 msgr2=0x7fbba400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:01.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7fbbbf400640 1 --2- 172.21.15.120:0/3806528804 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbba4005190 0x7fbba400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7fbbbf400640 1 -- 172.21.15.120:0/3806528804 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc015e150 con 0x7fbba4003980 2024-04-18T04:45:01.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7fbbbfe00640 1 --2- 172.21.15.120:0/3806528804 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbba4005190 0x7fbba400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:01.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7fbbbfe00640 1 -- 172.21.15.120:0/3806528804 reap_dead start 2024-04-18T04:45:01.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7fca4a000640 1 -- 172.21.15.120:0/3854405923 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3677569177 0 0) 0x7fca440014a0 con 0x7fca4c0c9d10 2024-04-18T04:45:01.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7fca4a000640 1 -- 172.21.15.120:0/3854405923 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca30003530 con 0x7fca4c0c9d10 2024-04-18T04:45:01.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7fca4aa00640 1 -- 172.21.15.120:0/3854405923 >> v2:172.21.15.120:3300/0 conn(0x7fca4c153900 msgr2=0x7fca4c0c3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:01.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7fca4aa00640 1 --2- 172.21.15.120:0/3854405923 >> v2:172.21.15.120:3300/0 conn(0x7fca4c153900 0x7fca4c0c3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7fca4aa00640 1 -- 172.21.15.120:0/3854405923 >> v1:172.21.15.132:6789/0 conn(0x7fca4c0c9d10 legacy=0x7fca4c159590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7fca4aa00640 1 -- 172.21.15.120:0/3854405923 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca4c0cb600 con 0x7fca4c0caea0 2024-04-18T04:45:01.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7f1e84e00640 1 -- 172.21.15.120:0/295242844 shutdown_connections 2024-04-18T04:45:01.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7f69d9c00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f69d40cb850 0x7f69d415d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7f69d9c00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69d40723f0 con 0x7f69d415d0a0 2024-04-18T04:45:01.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7f69d9c00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69d406dbe0 con 0x7f69d415d9c0 2024-04-18T04:45:01.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7f69d9c00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69d40c6770 con 0x7f69d40cb850 2024-04-18T04:45:01.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7f69ca000640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f69d40cb850 0x7f69d415d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7f69d3400640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f69d415d9c0 0x7f69d40c7c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:41674/0 (socket says 172.21.15.120:41674) 2024-04-18T04:45:01.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7f69d2a00640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f69d415d0a0 0x7f69d40bfe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:59148/0 (socket says 172.21.15.120:59148) 2024-04-18T04:45:01.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7f69d3400640 1 -- 172.21.15.120:0/464443762 learned_addr learned my addr 172.21.15.120:0/464443762 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:45:01.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7f1e84e00640 1 -- 172.21.15.120:0/295242844 wait complete. 2024-04-18T04:45:01.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7f69d2000640 1 -- 172.21.15.120:0/464443762 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 665598080 0 0) 0x7f69d406dbe0 con 0x7f69d415d9c0 2024-04-18T04:45:01.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7f69d2000640 1 -- 172.21.15.120:0/464443762 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69b4003530 con 0x7f69d415d9c0 2024-04-18T04:45:01.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.745+0000 7f6e8b400640 1 --2- 172.21.15.120:0/1313073961 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6e740666f0 0x7f6e74068bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.749+0000 7f6e8b400640 1 -- 172.21.15.120:0/1313073961 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6e8c083dc0 con 0x7f6e940c7730 2024-04-18T04:45:01.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.749+0000 7f6e8b400640 1 --2- 172.21.15.120:0/1313073961 >> [v2:172.21.15.120:6800/27468,v1:172.21.15.120:6801/27468] conn(0x7f6e7406fd30 0x7f6e74072170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.749+0000 7f6e8b400640 1 -- 172.21.15.120:0/1313073961 --> [v2:172.21.15.120:6800/27468,v1:172.21.15.120:6801/27468] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6e74072840 con 0x7f6e7406fd30 2024-04-18T04:45:01.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.749+0000 7f6e8b400640 1 -- 172.21.15.120:0/1313073961 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e8c084170 con 0x7f6e940c7730 2024-04-18T04:45:01.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.749+0000 7f69ca000640 1 -- 172.21.15.120:0/464443762 >> v1:172.21.15.132:6789/0 conn(0x7f69d415d9c0 legacy=0x7f69d40c7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.749+0000 7f69ca000640 1 -- 172.21.15.120:0/464443762 >> v1:172.21.15.120:6789/0 conn(0x7f69d415d0a0 legacy=0x7f69d40bfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.749+0000 7f69ca000640 1 -- 172.21.15.120:0/464443762 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d40cbcc0 con 0x7f69d40cb850 2024-04-18T04:45:01.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.749+0000 7f1e84e00640 1 Processor -- start 2024-04-18T04:45:01.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.749+0000 7f6e93400640 1 --2- 172.21.15.120:0/1313073961 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6e740666f0 0x7f6e74068bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.749+0000 7f6e92a00640 1 --2- 172.21.15.120:0/1313073961 >> [v2:172.21.15.120:6800/27468,v1:172.21.15.120:6801/27468] conn(0x7f6e7406fd30 0x7f6e74072170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.749+0000 7f1e84e00640 1 -- start start 2024-04-18T04:45:01.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.749+0000 7f4c6a400640 1 --2- 172.21.15.120:0/4150434428 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c6415cb30 0x7f4c6415cfc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4c6415dbf0 tx=0x7f4c5801ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b128baa68d4bea8a server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:01.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.749+0000 7f3637000640 1 Processor -- start 2024-04-18T04:45:01.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.749+0000 7f4c63e00640 1 -- 172.21.15.120:0/4150434428 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c580a8930 con 0x7f4c6415cb30 2024-04-18T04:45:01.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.749+0000 7f4c63e00640 1 -- 172.21.15.120:0/4150434428 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c580a8a90 con 0x7f4c6415cb30 2024-04-18T04:45:01.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.749+0000 7f4c63e00640 1 -- 172.21.15.120:0/4150434428 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c580a8e20 con 0x7f4c6415cb30 2024-04-18T04:45:01.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.749+0000 7f3637000640 1 -- start start 2024-04-18T04:45:01.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.749+0000 7f584f800640 1 Processor -- start 2024-04-18T04:45:01.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.749+0000 7f584f800640 1 -- start start 2024-04-18T04:45:01.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.749+0000 7fbbbf400640 1 --2- 172.21.15.120:0/3806528804 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbba4003980 0x7fbba4003da0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbbb000c160 tx=0x7fbbb001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc9c2a166eda496 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:01.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.749+0000 7f1e84e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e800b3260 0x7f1e801fa7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.749+0000 7f1e84e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1e8015b400 0x7f1e8015fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.749+0000 7f1e84e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1e8015b7e0 0x7f1e801f70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.749+0000 7f1e84e00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8006d4c0 con 0x7f1e8015b400 2024-04-18T04:45:01.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.749+0000 7f1e84e00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e800c68d0 con 0x7f1e800b3260 2024-04-18T04:45:01.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.749+0000 7f1e84e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e801fad30 con 0x7f1e8015b7e0 2024-04-18T04:45:01.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.749+0000 7f4c6c400640 1 -- 172.21.15.120:0/4150434428 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c6415cb30 msgr2=0x7f4c6415cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.749+0000 7f4c6c400640 1 --2- 172.21.15.120:0/4150434428 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c6415cb30 0x7f4c6415cfc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4c6415dbf0 tx=0x7f4c5801ec90 comp rx=0 tx=0).stop 2024-04-18T04:45:01.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.749+0000 7f1e7f400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e800b3260 0x7f1e801fa7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.749+0000 7f1e7ea00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1e8015b400 0x7f1e8015fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.749+0000 7f1e7f400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e800b3260 0x7f1e801fa7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:60218/0 (socket says 172.21.15.120:60218) 2024-04-18T04:45:01.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.749+0000 7f1e7fe00640 1 --2- 172.21.15.120:0/1000620081 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1e8015b7e0 0x7f1e801f70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.749+0000 7f1e7f400640 1 -- 172.21.15.120:0/1000620081 learned_addr learned my addr 172.21.15.120:0/1000620081 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:01.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.749+0000 7f6e93400640 1 --2- 172.21.15.120:0/1313073961 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6e740666f0 0x7f6e74068bb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6e84006aa0 tx=0x7f6e84006a30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:01.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.749+0000 7fbbbe000640 1 -- 172.21.15.120:0/3806528804 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb00070d0 con 0x7fbba4003980 2024-04-18T04:45:01.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.749+0000 7fbbbe000640 1 -- 172.21.15.120:0/3806528804 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb0007230 con 0x7fbba4003980 2024-04-18T04:45:01.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.749+0000 7f6e92a00640 1 --2- 172.21.15.120:0/1313073961 >> [v2:172.21.15.120:6800/27468,v1:172.21.15.120:6801/27468] conn(0x7f6e7406fd30 0x7f6e74072170 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:01.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.749+0000 7f4c6c400640 1 -- 172.21.15.120:0/4150434428 shutdown_connections 2024-04-18T04:45:01.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.749+0000 7f4c6c400640 1 --2- 172.21.15.120:0/4150434428 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c6415cb30 0x7f4c6415cfc0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.749+0000 7f4c6c400640 1 --2- 172.21.15.120:0/4150434428 >> v2:172.21.15.120:3300/0 conn(0x7f4c64153440 0x7f4c64153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f4c6c400640 1 --2- 172.21.15.120:0/4150434428 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4c6406b640 0x7f4c640c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f4c6c400640 1 -- 172.21.15.120:0/4150434428 >> 172.21.15.120:0/4150434428 conn(0x7f4c640c78c0 msgr2=0x7f4c640c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:01.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f1e7f400640 1 -- 172.21.15.120:0/1000620081 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1e8015b7e0 msgr2=0x7f1e801f70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f1e7f400640 1 --2- 172.21.15.120:0/1000620081 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1e8015b7e0 0x7f1e801f70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f1e7f400640 1 -- 172.21.15.120:0/1000620081 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1e8015b400 msgr2=0x7f1e8015fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f1e7f400640 1 --2- 172.21.15.120:0/1000620081 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1e8015b400 0x7f1e8015fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f1e7f400640 1 -- 172.21.15.120:0/1000620081 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e78009b30 con 0x7f1e800b3260 2024-04-18T04:45:01.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f1e7fe00640 1 --2- 172.21.15.120:0/1000620081 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1e8015b7e0 0x7f1e801f70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:01.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7fbbc6000640 1 -- 172.21.15.120:0/3806528804 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbba4003980 msgr2=0x7fbba4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7fbbc6000640 1 --2- 172.21.15.120:0/3806528804 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbba4003980 0x7fbba4003da0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbbb000c160 tx=0x7fbbb001c8c0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7fbbc6000640 1 -- 172.21.15.120:0/3806528804 shutdown_connections 2024-04-18T04:45:01.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7fbbc6000640 1 --2- 172.21.15.120:0/3806528804 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbba4003980 0x7fbba4003da0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f584f800640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f58480c7310 0x7f58480c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f584f800640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f584806d320 con 0x7f584815d8e0 2024-04-18T04:45:01.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f584f800640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f584815d450 con 0x7f58480af5e0 2024-04-18T04:45:01.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f584f800640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58480c7150 con 0x7f58480c7310 2024-04-18T04:45:01.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7fbbc6000640 1 -- 172.21.15.120:0/3806528804 >> 172.21.15.120:0/3806528804 conn(0x7fbbc006b780 msgr2=0x7fbbc006bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:01.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f1e7f400640 1 --2- 172.21.15.120:0/1000620081 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e800b3260 0x7f1e801fa7f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c00c480 tx=0x7f1e6c00c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:01.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7fbbc6000640 1 -- 172.21.15.120:0/3806528804 shutdown_connections 2024-04-18T04:45:01.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7fbbc6000640 1 -- 172.21.15.120:0/3806528804 wait complete. 2024-04-18T04:45:01.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f584ce00640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f58480af5e0 0x7f58481596f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:41678/0 (socket says 172.21.15.120:41678) 2024-04-18T04:45:01.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f584ce00640 1 -- 172.21.15.120:0/380137275 learned_addr learned my addr 172.21.15.120:0/380137275 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:45:01.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f69ca000640 1 --2- 172.21.15.120:0/464443762 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69d40cb850 0x7f69d415d480 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f69bc0097c0 tx=0x7f69bc01ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b962c74ea28dd530 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:01.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f4c6c400640 1 -- 172.21.15.120:0/4150434428 shutdown_connections 2024-04-18T04:45:01.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f4c6c400640 1 -- 172.21.15.120:0/4150434428 wait complete. 2024-04-18T04:45:01.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7fca4aa00640 1 --2- 172.21.15.120:0/3854405923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca4c0caea0 0x7fca4c0cc3c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fca4c0b1800 tx=0x7fca3801c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a17029c50fce94bb server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:01.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f6e8b400640 1 -- 172.21.15.120:0/1313073961 <== osd.0 v2:172.21.15.120:6800/27468 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f6e74072840 con 0x7f6e7406fd30 2024-04-18T04:45:01.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f1e77400640 1 -- 172.21.15.120:0/1000620081 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c012830 con 0x7f1e800b3260 2024-04-18T04:45:01.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f3637000640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f36300cadc0 0x7f363014fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f3637000640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f36300c66d0 0x7f36300c7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f3637000640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36300c0330 con 0x7f36300cb570 2024-04-18T04:45:01.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f3637000640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36300bfe70 con 0x7f36300c66d0 2024-04-18T04:45:01.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f3637000640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3630159430 con 0x7f36300cadc0 2024-04-18T04:45:01.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f362fe00640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f36300cb570 0x7f3630158d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:41680/0 (socket says 172.21.15.120:41680) 2024-04-18T04:45:01.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f362fe00640 1 -- 172.21.15.120:0/1366720965 learned_addr learned my addr 172.21.15.120:0/1366720965 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:45:01.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f362f400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f36300cadc0 0x7f363014fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f1e77400640 1 -- 172.21.15.120:0/1000620081 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6c0129b0 con 0x7f1e800b3260 2024-04-18T04:45:01.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f1e84e00640 1 -- 172.21.15.120:0/1000620081 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e801f6c50 con 0x7f1e800b3260 2024-04-18T04:45:01.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7fca4a000640 1 -- 172.21.15.120:0/3854405923 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca380aa610 con 0x7fca4c0caea0 2024-04-18T04:45:01.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f69d2000640 1 -- 172.21.15.120:0/464443762 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69bc0a8990 con 0x7f69d40cb850 2024-04-18T04:45:01.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f584d800640 1 --2- 172.21.15.120:0/380137275 >> v2:172.21.15.120:3300/0 conn(0x7f58480c7310 0x7f58480c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f5847400640 1 -- 172.21.15.120:0/380137275 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4233986810 0 0) 0x7f584815d450 con 0x7f58480af5e0 2024-04-18T04:45:01.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f5847400640 1 -- 172.21.15.120:0/380137275 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5830003530 con 0x7f58480af5e0 2024-04-18T04:45:01.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f1e77400640 1 -- 172.21.15.120:0/1000620081 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c012d60 con 0x7f1e800b3260 2024-04-18T04:45:01.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f362f400640 1 -- 172.21.15.120:0/1366720965 >> v2:172.21.15.120:3300/0 conn(0x7f36300c66d0 msgr2=0x7f36300c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:01.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f362f400640 1 --2- 172.21.15.120:0/1366720965 >> v2:172.21.15.120:3300/0 conn(0x7f36300c66d0 0x7f36300c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f362f400640 1 -- 172.21.15.120:0/1366720965 >> v1:172.21.15.132:6789/0 conn(0x7f36300cb570 legacy=0x7f3630158d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f362f400640 1 -- 172.21.15.120:0/1366720965 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36300c5a60 con 0x7f36300cadc0 2024-04-18T04:45:01.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f1e84e00640 1 -- 172.21.15.120:0/1000620081 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e800c6dc0 con 0x7f1e800b3260 2024-04-18T04:45:01.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7fca4a000640 1 -- 172.21.15.120:0/3854405923 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca380a6040 con 0x7fca4c0caea0 2024-04-18T04:45:01.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7fca4a000640 1 -- 172.21.15.120:0/3854405923 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca380aa970 con 0x7fca4c0caea0 2024-04-18T04:45:01.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f5847400640 1 -- 172.21.15.120:0/380137275 <== mon.1 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3436551237 0 0) 0x7f5830003530 con 0x7f58480af5e0 2024-04-18T04:45:01.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f5847400640 1 -- 172.21.15.120:0/380137275 >> v2:172.21.15.120:3300/0 conn(0x7f58480c7310 msgr2=0x7f58480c61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:01.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f5847400640 1 --2- 172.21.15.120:0/380137275 >> v2:172.21.15.120:3300/0 conn(0x7f58480c7310 0x7f58480c61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f5847400640 1 -- 172.21.15.120:0/380137275 >> v1:172.21.15.120:6789/0 conn(0x7f584815d8e0 legacy=0x7f58480caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:01.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f5847400640 1 -- 172.21.15.120:0/380137275 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58480c6bd0 con 0x7f58480af5e0 2024-04-18T04:45:01.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f5847400640 1 -- 172.21.15.120:0/380137275 <== mon.1 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7f583c001680 con 0x7f58480af5e0 2024-04-18T04:45:01.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f5847400640 1 -- 172.21.15.120:0/380137275 >> v1:172.21.15.132:6789/0 conn(0x7f58480af5e0 legacy=0x7f58481596f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f5847400640 1 --2- 172.21.15.120:0/380137275 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5830003980 0x7f5830003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f5847400640 1 --2- 172.21.15.120:0/380137275 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58300047d0 0x7f5830004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f5847400640 1 --2- 172.21.15.120:0/380137275 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5830005190 0x7f583000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f5847400640 1 -- 172.21.15.120:0/380137275 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58480c7150 con 0x7f5830003980 2024-04-18T04:45:01.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f5847400640 1 -- 172.21.15.120:0/380137275 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583000c0a0 con 0x7f58300047d0 2024-04-18T04:45:01.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f5847400640 1 -- 172.21.15.120:0/380137275 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f583000c260 con 0x7f5830005190 2024-04-18T04:45:01.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7f4c6c400640 1 Processor -- start 2024-04-18T04:45:01.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.753+0000 7fbbc6000640 1 Processor -- start 2024-04-18T04:45:01.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7f4c6c400640 1 -- start start 2024-04-18T04:45:01.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7fca52200640 1 -- 172.21.15.120:0/3854405923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca4c0caea0 msgr2=0x7fca4c0cc3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7f5847e00640 1 --2- 172.21.15.120:0/380137275 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58300047d0 0x7f5830004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7f584d800640 1 --2- 172.21.15.120:0/380137275 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5830005190 0x7f583000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7fca52200640 1 --2- 172.21.15.120:0/3854405923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca4c0caea0 0x7fca4c0cc3c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fca4c0b1800 tx=0x7fca3801c4b0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7f69d2000640 1 -- 172.21.15.120:0/464443762 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69bc0a8af0 con 0x7f69d40cb850 2024-04-18T04:45:01.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7f69d2000640 1 -- 172.21.15.120:0/464443762 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69bc0a8e60 con 0x7f69d40cb850 2024-04-18T04:45:01.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7f584ce00640 1 --2- 172.21.15.120:0/380137275 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5830003980 0x7f5830003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7f584d800640 1 -- 172.21.15.120:0/380137275 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58300047d0 msgr2=0x7f5830004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:01.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7f584d800640 1 --2- 172.21.15.120:0/380137275 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58300047d0 0x7f5830004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7f584d800640 1 -- 172.21.15.120:0/380137275 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5830003980 msgr2=0x7f5830003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:01.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7f584d800640 1 --2- 172.21.15.120:0/380137275 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5830003980 0x7f5830003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7f584d800640 1 -- 172.21.15.120:0/380137275 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58480c6bd0 con 0x7f5830005190 2024-04-18T04:45:01.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7f69d9c00640 1 -- 172.21.15.120:0/464443762 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69d40cb850 msgr2=0x7f69d415d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7f69d9c00640 1 --2- 172.21.15.120:0/464443762 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69d40cb850 0x7f69d415d480 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f69bc0097c0 tx=0x7f69bc01ecb0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7f4c6c400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c6406b640 0x7f4c64071410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7f4c6c400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4c64153440 0x7f4c64071950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7f4c6c400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c6415cb30 0x7f4c6415b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7f4c6c400640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6415ac40 con 0x7f4c6415cb30 2024-04-18T04:45:01.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7f4c6c400640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c641576e0 con 0x7f4c6406b640 2024-04-18T04:45:01.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7f4c6c400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c64155470 con 0x7f4c64153440 2024-04-18T04:45:01.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7f1e84e00640 1 -- 172.21.15.120:0/1000620081 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1e800cb630 con 0x7f1e800b3260 2024-04-18T04:45:01.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7f4c69a00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c6406b640 0x7f4c64071410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7fca52200640 1 -- 172.21.15.120:0/3854405923 shutdown_connections 2024-04-18T04:45:01.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7fca52200640 1 --2- 172.21.15.120:0/3854405923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca4c0caea0 0x7fca4c0cc3c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7fca52200640 1 --2- 172.21.15.120:0/3854405923 >> v2:172.21.15.120:3300/0 conn(0x7fca4c153900 0x7fca4c0c3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7fca52200640 1 -- 172.21.15.120:0/3854405923 >> 172.21.15.120:0/3854405923 conn(0x7fca4c06c1d0 msgr2=0x7fca4c06c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:01.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7f69d9c00640 1 -- 172.21.15.120:0/464443762 shutdown_connections 2024-04-18T04:45:01.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7f69d9c00640 1 --2- 172.21.15.120:0/464443762 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69d40cb850 0x7f69d415d480 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7f69d9c00640 1 -- 172.21.15.120:0/464443762 >> 172.21.15.120:0/464443762 conn(0x7f69d406b780 msgr2=0x7f69d406bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:01.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7f4c6a400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c6415cb30 0x7f4c6415b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7f4c69000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4c64153440 0x7f4c64071950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7f4c6a400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c6415cb30 0x7f4c6415b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:33748/0 (socket says 172.21.15.120:33748) 2024-04-18T04:45:01.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7f4c6a400640 1 -- 172.21.15.120:0/1946994345 learned_addr learned my addr 172.21.15.120:0/1946994345 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:01.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7f69d9c00640 1 -- 172.21.15.120:0/464443762 shutdown_connections 2024-04-18T04:45:01.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7fca52200640 1 -- 172.21.15.120:0/3854405923 shutdown_connections 2024-04-18T04:45:01.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7f69d9c00640 1 -- 172.21.15.120:0/464443762 wait complete. 2024-04-18T04:45:01.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7f1e77400640 1 -- 172.21.15.120:0/1000620081 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1e6c01c460 con 0x7f1e800b3260 2024-04-18T04:45:01.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7f4c6a400640 1 -- 172.21.15.120:0/1946994345 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4c64153440 msgr2=0x7f4c64071950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7f4c6a400640 1 --2- 172.21.15.120:0/1946994345 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4c64153440 0x7f4c64071950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7f4c6a400640 1 -- 172.21.15.120:0/1946994345 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c6406b640 msgr2=0x7f4c64071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7f4c6a400640 1 --2- 172.21.15.120:0/1946994345 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c6406b640 0x7f4c64071410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7f4c6a400640 1 -- 172.21.15.120:0/1946994345 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c58009420 con 0x7f4c6415cb30 2024-04-18T04:45:01.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7fca52200640 1 -- 172.21.15.120:0/3854405923 wait complete. 2024-04-18T04:45:01.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7f4c6a400640 1 --2- 172.21.15.120:0/1946994345 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c6415cb30 0x7f4c6415b0d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4c5801f530 tx=0x7f4c5801ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:01.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7f584d800640 1 -- 172.21.15.120:0/380137275 reap_dead start 2024-04-18T04:45:01.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7f4c61600640 1 -- 172.21.15.120:0/1946994345 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c580b0ca0 con 0x7f4c6415cb30 2024-04-18T04:45:01.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7f4c61600640 1 -- 172.21.15.120:0/1946994345 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c580b0e00 con 0x7f4c6415cb30 2024-04-18T04:45:01.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7f4c61600640 1 -- 172.21.15.120:0/1946994345 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c580bb660 con 0x7f4c6415cb30 2024-04-18T04:45:01.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.757+0000 7fbbc6000640 1 -- start start 2024-04-18T04:45:01.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7f1e77400640 1 --2- 172.21.15.120:0/1000620081 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1e60066690 0x7f1e60068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7f4c6c400640 1 -- 172.21.15.120:0/1946994345 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c64155750 con 0x7f4c6415cb30 2024-04-18T04:45:01.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7f4c6c400640 1 -- 172.21.15.120:0/1946994345 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c64155d10 con 0x7f4c6415cb30 2024-04-18T04:45:01.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7f1e77400640 1 -- 172.21.15.120:0/1000620081 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1e6c084390 con 0x7f1e800b3260 2024-04-18T04:45:01.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7f69d9c00640 1 Processor -- start 2024-04-18T04:45:01.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7f1e7ea00640 1 --2- 172.21.15.120:0/1000620081 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1e60066690 0x7f1e60068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7f69d9c00640 1 -- start start 2024-04-18T04:45:01.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7f362f400640 1 --2- 172.21.15.120:0/1366720965 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36300cadc0 0x7f363014fb00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f363006af20 tx=0x7f362001ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c69381dce235a88 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:01.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7f584d800640 1 --2- 172.21.15.120:0/380137275 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5830005190 0x7f583000b990 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5840007360 tx=0x7f5840025690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=428ddc8f54e03933 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:01.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7fbbc6000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbc00c4a20 0x7fbbc0153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7fbbc6000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbbc0154460 0x7fbbc00c7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7fbbc6000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbc00c4e00 0x7fbbc00c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7fbbc6000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc015a310 con 0x7fbbc00c4a20 2024-04-18T04:45:01.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7fbbc6000640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc015ad60 con 0x7fbbc00c4e00 2024-04-18T04:45:01.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7fbbc6000640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc01f6cd0 con 0x7fbbc0154460 2024-04-18T04:45:01.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7fbbbfe00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbc00c4e00 0x7fbbc00c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7fbbbfe00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbc00c4e00 0x7fbbc00c7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:60248/0 (socket says 172.21.15.120:60248) 2024-04-18T04:45:01.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7fbbbfe00640 1 -- 172.21.15.120:0/1382381849 learned_addr learned my addr 172.21.15.120:0/1382381849 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:01.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7fbbbea00640 1 --2- 172.21.15.120:0/1382381849 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbbc0154460 0x7fbbc00c7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7f1e77400640 1 --2- 172.21.15.120:0/1000620081 >> [v2:172.21.15.120:6821/27470,v1:172.21.15.120:6823/27470] conn(0x7f1e6006fcd0 0x7f1e60072110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7fca52200640 1 Processor -- start 2024-04-18T04:45:01.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7f1e77400640 1 -- 172.21.15.120:0/1000620081 --> [v2:172.21.15.120:6821/27470,v1:172.21.15.120:6823/27470] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1e600727e0 con 0x7f1e6006fcd0 2024-04-18T04:45:01.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7f1e77400640 1 -- 172.21.15.120:0/1000620081 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1e6c0869b0 con 0x7f1e800b3260 2024-04-18T04:45:01.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7fbbbf400640 1 --2- 172.21.15.120:0/1382381849 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbc00c4a20 0x7fbbc0153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7fbbbfe00640 1 -- 172.21.15.120:0/1382381849 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbbc0154460 msgr2=0x7fbbc00c7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7fbbbfe00640 1 --2- 172.21.15.120:0/1382381849 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbbc0154460 0x7fbbc00c7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7fbbbfe00640 1 -- 172.21.15.120:0/1382381849 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbc00c4a20 msgr2=0x7fbbc0153f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7fbbbfe00640 1 --2- 172.21.15.120:0/1382381849 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbc00c4a20 0x7fbbc0153f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7fbbbfe00640 1 -- 172.21.15.120:0/1382381849 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc01581a0 con 0x7fbbc00c4e00 2024-04-18T04:45:01.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7f4c6c400640 1 -- 172.21.15.120:0/1946994345 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4c640c0d50 con 0x7f4c6415cb30 2024-04-18T04:45:01.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7fca52200640 1 -- start start 2024-04-18T04:45:01.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7f5847400640 1 -- 172.21.15.120:0/380137275 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58400039a0 con 0x7f5830005190 2024-04-18T04:45:01.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7f5847400640 1 -- 172.21.15.120:0/380137275 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5840003b40 con 0x7f5830005190 2024-04-18T04:45:01.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7f362ea00640 1 -- 172.21.15.120:0/1366720965 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36200a8970 con 0x7f36300cadc0 2024-04-18T04:45:01.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7f1e7fe00640 1 --2- 172.21.15.120:0/1000620081 >> [v2:172.21.15.120:6821/27470,v1:172.21.15.120:6823/27470] conn(0x7f1e6006fcd0 0x7f1e60072110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7f1e7ea00640 1 --2- 172.21.15.120:0/1000620081 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1e60066690 0x7f1e60068b50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1e800b4750 tx=0x7f1e70008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:01.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7fbbbf400640 1 --2- 172.21.15.120:0/1382381849 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbc00c4a20 0x7fbbc0153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:45:01.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7fbbbfe00640 1 --2- 172.21.15.120:0/1382381849 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbc00c4e00 0x7fbbc00c7bd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbbc006dd00 tx=0x7fbbac011920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:01.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7f362ea00640 1 -- 172.21.15.120:0/1366720965 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36200a8ad0 con 0x7f36300cadc0 2024-04-18T04:45:01.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7f362ea00640 1 -- 172.21.15.120:0/1366720965 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36200a8970 con 0x7f36300cadc0 2024-04-18T04:45:01.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7fbbb7400640 1 -- 172.21.15.120:0/1382381849 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac004500 con 0x7fbbc00c4e00 2024-04-18T04:45:01.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7f69d9c00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69d40cb850 0x7f69d41f6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7f69d9c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69d415d0a0 0x7f69d4070380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7f69d9c00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69d415d9c0 0x7f69d415be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7f5847400640 1 -- 172.21.15.120:0/380137275 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5840004020 con 0x7f5830005190 2024-04-18T04:45:01.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7f584f800640 1 -- 172.21.15.120:0/380137275 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5830005190 msgr2=0x7f583000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7f584f800640 1 --2- 172.21.15.120:0/380137275 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5830005190 0x7f583000b990 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5840007360 tx=0x7f5840025690 comp rx=0 tx=0).stop 2024-04-18T04:45:01.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7f584f800640 1 -- 172.21.15.120:0/380137275 shutdown_connections 2024-04-18T04:45:01.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7fca52200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca4c0c9d10 0x7fca4c1f66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7f69d9c00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d4157fb0 con 0x7f69d415d0a0 2024-04-18T04:45:01.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7f69d9c00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d406f930 con 0x7f69d415d9c0 2024-04-18T04:45:01.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7f69d9c00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69d41f6a50 con 0x7f69d40cb850 2024-04-18T04:45:01.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7fbbc6000640 1 -- 172.21.15.120:0/1382381849 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbc01f6150 con 0x7fbbc00c4e00 2024-04-18T04:45:01.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7fbbc6000640 1 -- 172.21.15.120:0/1382381849 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbc01f6710 con 0x7fbbc00c4e00 2024-04-18T04:45:01.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7fbbb7400640 1 -- 172.21.15.120:0/1382381849 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbac003620 con 0x7fbbc00c4e00 2024-04-18T04:45:01.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7fbbb7400640 1 -- 172.21.15.120:0/1382381849 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac0039b0 con 0x7fbbc00c4e00 2024-04-18T04:45:01.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7f4c61600640 1 -- 172.21.15.120:0/1946994345 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4c580b7040 con 0x7f4c6415cb30 2024-04-18T04:45:01.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7fca52200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca4c0caea0 0x7fca4c14eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7fca52200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fca4c153900 0x7fca4c14f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7fca52200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4c1f6c00 con 0x7fca4c0caea0 2024-04-18T04:45:01.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7fca52200640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4c13d710 con 0x7fca4c0c9d10 2024-04-18T04:45:01.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7fca52200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca4c13e290 con 0x7fca4c153900 2024-04-18T04:45:01.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7f69d2a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69d40cb850 0x7f69d41f6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7f69d2a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69d40cb850 0x7f69d41f6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:41990/0 (socket says 172.21.15.120:41990) 2024-04-18T04:45:01.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7f69d2a00640 1 -- 172.21.15.120:0/752089220 learned_addr learned my addr 172.21.15.120:0/752089220 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:01.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7f69ca000640 1 --2- 172.21.15.120:0/752089220 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69d415d0a0 0x7f69d4070380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7f69d3400640 1 --2- 172.21.15.120:0/752089220 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69d415d9c0 0x7f69d415be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7f584f800640 1 --2- 172.21.15.120:0/380137275 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5830005190 0x7f583000b990 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7f584f800640 1 -- 172.21.15.120:0/380137275 >> 172.21.15.120:0/380137275 conn(0x7f584806b780 msgr2=0x7f584806bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:01.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7f3637000640 1 -- 172.21.15.120:0/1366720965 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36300cadc0 msgr2=0x7f363014fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.761+0000 7f3637000640 1 --2- 172.21.15.120:0/1366720965 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36300cadc0 0x7f363014fb00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f363006af20 tx=0x7f362001ec70 comp rx=0 tx=0).stop 2024-04-18T04:45:01.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7f3637000640 1 -- 172.21.15.120:0/1366720965 shutdown_connections 2024-04-18T04:45:01.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7f3637000640 1 --2- 172.21.15.120:0/1366720965 >> v2:172.21.15.120:3300/0 conn(0x7f36300c66d0 0x7f36300c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7f3637000640 1 --2- 172.21.15.120:0/1366720965 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36300cadc0 0x7f363014fb00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7f3637000640 1 -- 172.21.15.120:0/1366720965 >> 172.21.15.120:0/1366720965 conn(0x7f363006b780 msgr2=0x7f363006bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:01.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7f3637000640 1 -- 172.21.15.120:0/1366720965 shutdown_connections 2024-04-18T04:45:01.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7f3637000640 1 -- 172.21.15.120:0/1366720965 wait complete. 2024-04-18T04:45:01.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7fca4be00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fca4c153900 0x7fca4c14f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7fca4be00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fca4c153900 0x7fca4c14f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:42000/0 (socket says 172.21.15.120:42000) 2024-04-18T04:45:01.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7fca4be00640 1 -- 172.21.15.120:0/540297364 learned_addr learned my addr 172.21.15.120:0/540297364 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:01.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7f69d2a00640 1 -- 172.21.15.120:0/752089220 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69d415d9c0 msgr2=0x7f69d415be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7f69d2a00640 1 --2- 172.21.15.120:0/752089220 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69d415d9c0 0x7f69d415be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7f69d2a00640 1 -- 172.21.15.120:0/752089220 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69d415d0a0 msgr2=0x7f69d4070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7f69d2a00640 1 --2- 172.21.15.120:0/752089220 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69d415d0a0 0x7f69d4070380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7f69d2a00640 1 -- 172.21.15.120:0/752089220 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69bc009420 con 0x7f69d40cb850 2024-04-18T04:45:01.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7fca4aa00640 1 --2- 172.21.15.120:0/540297364 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca4c0caea0 0x7fca4c14eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7fca4b400640 1 --2- 172.21.15.120:0/540297364 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca4c0c9d10 0x7fca4c1f66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7f584f800640 1 -- 172.21.15.120:0/380137275 shutdown_connections 2024-04-18T04:45:01.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7fbbc6000640 1 -- 172.21.15.120:0/1382381849 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbb98000fd0 con 0x7fbbc00c4e00 2024-04-18T04:45:01.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7f69d2a00640 1 --2- 172.21.15.120:0/752089220 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69d40cb850 0x7f69d41f6510 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f69c400c7c0 tx=0x7f69c400cc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:01.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7f584f800640 1 -- 172.21.15.120:0/380137275 wait complete. 2024-04-18T04:45:01.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7fca4be00640 1 -- 172.21.15.120:0/540297364 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca4c0c9d10 msgr2=0x7fca4c1f66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7fca4be00640 1 --2- 172.21.15.120:0/540297364 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca4c0c9d10 0x7fca4c1f66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7fca4be00640 1 -- 172.21.15.120:0/540297364 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca4c0caea0 msgr2=0x7fca4c14eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7fca4be00640 1 --2- 172.21.15.120:0/540297364 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca4c0caea0 0x7fca4c14eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7fca4be00640 1 -- 172.21.15.120:0/540297364 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca380094d0 con 0x7fca4c153900 2024-04-18T04:45:01.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7fca4be00640 1 --2- 172.21.15.120:0/540297364 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fca4c153900 0x7fca4c14f530 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fca4400c7e0 tx=0x7fca4400cca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:01.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7f1e7fe00640 1 --2- 172.21.15.120:0/1000620081 >> [v2:172.21.15.120:6821/27470,v1:172.21.15.120:6823/27470] conn(0x7f1e6006fcd0 0x7f1e60072110 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:01.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7f4c61600640 1 --2- 172.21.15.120:0/1946994345 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4c44066690 0x7f4c44068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7f4c61600640 1 -- 172.21.15.120:0/1946994345 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4c58122d00 con 0x7f4c6415cb30 2024-04-18T04:45:01.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7f4c61600640 1 --2- 172.21.15.120:0/1946994345 >> [v2:172.21.15.120:6808/27469,v1:172.21.15.120:6809/27469] conn(0x7f4c4406fcd0 0x7f4c44072110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7f4c61600640 1 -- 172.21.15.120:0/1946994345 --> [v2:172.21.15.120:6808/27469,v1:172.21.15.120:6809/27469] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4c440727e0 con 0x7f4c4406fcd0 2024-04-18T04:45:01.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7f4c61600640 1 -- 172.21.15.120:0/1946994345 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c58122ff0 con 0x7f4c6415cb30 2024-04-18T04:45:01.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7f69cb400640 1 -- 172.21.15.120:0/752089220 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c400a640 con 0x7f69d40cb850 2024-04-18T04:45:01.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7f69d9c00640 1 -- 172.21.15.120:0/752089220 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69d41f6ce0 con 0x7f69d40cb850 2024-04-18T04:45:01.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7f69d9c00640 1 -- 172.21.15.120:0/752089220 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69d41f72a0 con 0x7f69d40cb850 2024-04-18T04:45:01.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7f4c69a00640 1 --2- 172.21.15.120:0/1946994345 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4c44066690 0x7f4c44068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7f69cb400640 1 -- 172.21.15.120:0/752089220 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69c400a7a0 con 0x7f69d40cb850 2024-04-18T04:45:01.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7f69cb400640 1 -- 172.21.15.120:0/752089220 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c400a640 con 0x7f69d40cb850 2024-04-18T04:45:01.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7fca43400640 1 -- 172.21.15.120:0/540297364 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4400a640 con 0x7fca4c153900 2024-04-18T04:45:01.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7fca43400640 1 -- 172.21.15.120:0/540297364 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4400a7a0 con 0x7fca4c153900 2024-04-18T04:45:01.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7fca43400640 1 -- 172.21.15.120:0/540297364 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4400ab50 con 0x7fca4c153900 2024-04-18T04:45:01.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7f584f800640 1 Processor -- start 2024-04-18T04:45:01.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7f69d9c00640 1 -- 172.21.15.120:0/752089220 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f69a8000fd0 con 0x7f69d40cb850 2024-04-18T04:45:01.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.765+0000 7f4c69000640 1 --2- 172.21.15.120:0/1946994345 >> [v2:172.21.15.120:6808/27469,v1:172.21.15.120:6809/27469] conn(0x7f4c4406fcd0 0x7f4c44072110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7f4c69a00640 1 --2- 172.21.15.120:0/1946994345 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4c44066690 0x7f4c44068b50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c011360 tx=0x7f4c5c00d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:01.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7fca52200640 1 -- 172.21.15.120:0/540297364 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca4c142f00 con 0x7fca4c153900 2024-04-18T04:45:01.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7fca52200640 1 -- 172.21.15.120:0/540297364 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca4c13d960 con 0x7fca4c153900 2024-04-18T04:45:01.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7f584f800640 1 -- start start 2024-04-18T04:45:01.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7f3637000640 1 Processor -- start 2024-04-18T04:45:01.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7fbbb7400640 1 -- 172.21.15.120:0/1382381849 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbbac003b10 con 0x7fbbc00c4e00 2024-04-18T04:45:01.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7f1e77400640 1 -- 172.21.15.120:0/1000620081 <== osd.1 v2:172.21.15.120:6821/27470 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f1e600727e0 con 0x7f1e6006fcd0 2024-04-18T04:45:01.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7f3637000640 1 -- start start 2024-04-18T04:45:01.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7fca52200640 1 -- 172.21.15.120:0/540297364 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fca4c0ca530 con 0x7fca4c153900 2024-04-18T04:45:01.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7f584f800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5830005190 0x7f58481ecea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7f584f800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f584815bbe0 0x7f58480c9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7f584f800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f58480c4170 0x7f58480c9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7f584f800640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58481ee900 con 0x7f584815bbe0 2024-04-18T04:45:01.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7f584f800640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58481edd80 con 0x7f5830005190 2024-04-18T04:45:01.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7f584f800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58481ee060 con 0x7f58480c4170 2024-04-18T04:45:01.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7f584ce00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5830005190 0x7f58481ecea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7f584ce00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5830005190 0x7f58481ecea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:60280/0 (socket says 172.21.15.120:60280) 2024-04-18T04:45:01.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7f584ce00640 1 -- 172.21.15.120:0/3529402924 learned_addr learned my addr 172.21.15.120:0/3529402924 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:01.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7f5847e00640 1 --2- 172.21.15.120:0/3529402924 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f584815bbe0 0x7f58480c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7f584d800640 1 --2- 172.21.15.120:0/3529402924 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f58480c4170 0x7f58480c9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7f3637000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36300c66d0 0x7f3630151240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7f3637000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36300cadc0 0x7f36300c3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7f69cb400640 1 -- 172.21.15.120:0/752089220 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f69c400a910 con 0x7f69d40cb850 2024-04-18T04:45:01.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7fbbb7400640 1 --2- 172.21.15.120:0/1382381849 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fbba0066710 0x7fbba0068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7fbbb7400640 1 -- 172.21.15.120:0/1382381849 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbbac084c60 con 0x7fbbc00c4e00 2024-04-18T04:45:01.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7fbbb7400640 1 --2- 172.21.15.120:0/1382381849 >> [v2:172.21.15.120:6816/27471,v1:172.21.15.120:6817/27471] conn(0x7fbba006fd50 0x7fbba0072190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7fbbb7400640 1 -- 172.21.15.120:0/1382381849 --> [v2:172.21.15.120:6816/27471,v1:172.21.15.120:6817/27471] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbba0072860 con 0x7fbba006fd50 2024-04-18T04:45:01.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7fbbb7400640 1 -- 172.21.15.120:0/1382381849 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbbac084fd0 con 0x7fbbc00c4e00 2024-04-18T04:45:01.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7f362fe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36300c66d0 0x7f3630151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7f3637000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36300cb570 0x7f36300c4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7f5847e00640 1 -- 172.21.15.120:0/3529402924 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f58480c4170 msgr2=0x7f58480c9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7f5847e00640 1 --2- 172.21.15.120:0/3529402924 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f58480c4170 0x7f58480c9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7f5847e00640 1 -- 172.21.15.120:0/3529402924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5830005190 msgr2=0x7f58481ecea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7f5847e00640 1 --2- 172.21.15.120:0/3529402924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5830005190 0x7f58481ecea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7f5847e00640 1 -- 172.21.15.120:0/3529402924 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58481ee340 con 0x7f584815bbe0 2024-04-18T04:45:01.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7f362f400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36300cadc0 0x7f36300c3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7f362f400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36300cadc0 0x7f36300c3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:60290/0 (socket says 172.21.15.120:60290) 2024-04-18T04:45:01.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7f362f400640 1 -- 172.21.15.120:0/1236735408 learned_addr learned my addr 172.21.15.120:0/1236735408 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:01.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7fbbbf400640 1 --2- 172.21.15.120:0/1382381849 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fbba0066710 0x7fbba0068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7f3635000640 1 --2- 172.21.15.120:0/1236735408 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36300cb570 0x7f36300c4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7f3637000640 1 -- 172.21.15.120:0/1236735408 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3630153030 con 0x7f36300c66d0 2024-04-18T04:45:01.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7f3637000640 1 -- 172.21.15.120:0/1236735408 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36300c3880 con 0x7f36300cadc0 2024-04-18T04:45:01.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7f3637000640 1 -- 172.21.15.120:0/1236735408 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3630152d50 con 0x7f36300cb570 2024-04-18T04:45:01.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.769+0000 7fbbbea00640 1 --2- 172.21.15.120:0/1382381849 >> [v2:172.21.15.120:6816/27471,v1:172.21.15.120:6817/27471] conn(0x7fbba006fd50 0x7fbba0072190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.773+0000 7f4c69000640 1 --2- 172.21.15.120:0/1946994345 >> [v2:172.21.15.120:6808/27469,v1:172.21.15.120:6809/27469] conn(0x7f4c4406fcd0 0x7f4c44072110 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:01.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.773+0000 7f69cb400640 1 --2- 172.21.15.120:0/752089220 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f69b00666f0 0x7f69b0068bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.773+0000 7fca43400640 1 -- 172.21.15.120:0/540297364 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fca4400acb0 con 0x7fca4c153900 2024-04-18T04:45:01.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.773+0000 7f3635000640 1 -- 172.21.15.120:0/1236735408 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36300cadc0 msgr2=0x7f36300c3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.773+0000 7f3635000640 1 --2- 172.21.15.120:0/1236735408 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36300cadc0 0x7f36300c3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.773+0000 7f3635000640 1 -- 172.21.15.120:0/1236735408 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36300c66d0 msgr2=0x7f3630151240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.773+0000 7f3635000640 1 --2- 172.21.15.120:0/1236735408 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36300c66d0 0x7f3630151240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.773+0000 7f69cb400640 1 -- 172.21.15.120:0/752089220 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f69c4084190 con 0x7f69d40cb850 2024-04-18T04:45:01.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.773+0000 7f5847e00640 1 --2- 172.21.15.120:0/3529402924 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f584815bbe0 0x7f58480c9560 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f583400f4d0 tx=0x7f583400f990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:01.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.773+0000 7f69cb400640 1 --2- 172.21.15.120:0/752089220 >> [v2:172.21.15.132:6808/28104,v1:172.21.15.132:6809/28104] conn(0x7f69b006fd30 0x7f69b0072170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.773+0000 7f3635000640 1 -- 172.21.15.120:0/1236735408 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3620009420 con 0x7f36300cb570 2024-04-18T04:45:01.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.773+0000 7f69cb400640 1 -- 172.21.15.120:0/752089220 --> [v2:172.21.15.132:6808/28104,v1:172.21.15.132:6809/28104] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f69b0072840 con 0x7f69b006fd30 2024-04-18T04:45:01.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.773+0000 7f5844c00640 1 -- 172.21.15.120:0/3529402924 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5834005320 con 0x7f584815bbe0 2024-04-18T04:45:01.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.773+0000 7f5844c00640 1 -- 172.21.15.120:0/3529402924 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5834005480 con 0x7f584815bbe0 2024-04-18T04:45:01.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.773+0000 7f5844c00640 1 -- 172.21.15.120:0/3529402924 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5834007290 con 0x7f584815bbe0 2024-04-18T04:45:01.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.773+0000 7f69ca000640 1 --2- 172.21.15.120:0/752089220 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f69b00666f0 0x7f69b0068bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.773+0000 7f3635000640 1 --2- 172.21.15.120:0/1236735408 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36300cb570 0x7f36300c4270 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f362800be20 tx=0x7f362800bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:01.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.773+0000 7fbbbf400640 1 --2- 172.21.15.120:0/1382381849 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fbba0066710 0x7fbba0068bd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbbb00aa000 tx=0x7fbbb0001940 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:01.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.773+0000 7fca43400640 1 --2- 172.21.15.120:0/540297364 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fca2c066760 0x7fca2c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.773+0000 7f4c61600640 1 -- 172.21.15.120:0/1946994345 <== osd.3 v2:172.21.15.120:6808/27469 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f4c440727e0 con 0x7f4c4406fcd0 2024-04-18T04:45:01.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.773+0000 7fca43400640 1 -- 172.21.15.120:0/540297364 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fca44084460 con 0x7fca4c153900 2024-04-18T04:45:01.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.773+0000 7f69d3400640 1 --2- 172.21.15.120:0/752089220 >> [v2:172.21.15.132:6808/28104,v1:172.21.15.132:6809/28104] conn(0x7f69b006fd30 0x7f69b0072170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.773+0000 7f69cb400640 1 -- 172.21.15.120:0/752089220 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f69c4084540 con 0x7f69d40cb850 2024-04-18T04:45:01.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.773+0000 7fca43400640 1 --2- 172.21.15.120:0/540297364 >> [v2:172.21.15.132:6824/28102,v1:172.21.15.132:6825/28102] conn(0x7fca2c06fda0 0x7fca2c0721e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.773+0000 7fca43400640 1 -- 172.21.15.120:0/540297364 --> [v2:172.21.15.132:6824/28102,v1:172.21.15.132:6825/28102] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fca2c0728b0 con 0x7fca2c06fda0 2024-04-18T04:45:01.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.773+0000 7fca43400640 1 -- 172.21.15.120:0/540297364 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca44084810 con 0x7fca4c153900 2024-04-18T04:45:01.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.773+0000 7f3627e00640 1 -- 172.21.15.120:0/1236735408 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362800ce70 con 0x7f36300cb570 2024-04-18T04:45:01.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.773+0000 7fca4b400640 1 --2- 172.21.15.120:0/540297364 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fca2c066760 0x7fca2c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.773+0000 7fca4aa00640 1 --2- 172.21.15.120:0/540297364 >> [v2:172.21.15.132:6824/28102,v1:172.21.15.132:6825/28102] conn(0x7fca2c06fda0 0x7fca2c0721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.773+0000 7f69ca000640 1 --2- 172.21.15.120:0/752089220 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f69b00666f0 0x7f69b0068bb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f69bc0b2000 tx=0x7f69bc0aa070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:01.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.773+0000 7f69d3400640 1 --2- 172.21.15.120:0/752089220 >> [v2:172.21.15.132:6808/28104,v1:172.21.15.132:6809/28104] conn(0x7f69b006fd30 0x7f69b0072170 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:01.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.773+0000 7f584f800640 1 -- 172.21.15.120:0/3529402924 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58481ee620 con 0x7f584815bbe0 2024-04-18T04:45:01.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.773+0000 7f584f800640 1 -- 172.21.15.120:0/3529402924 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58481ed960 con 0x7f584815bbe0 2024-04-18T04:45:01.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.773+0000 7f3627e00640 1 -- 172.21.15.120:0/1236735408 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3628014440 con 0x7f36300cb570 2024-04-18T04:45:01.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.773+0000 7f3627e00640 1 -- 172.21.15.120:0/1236735408 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362800ce70 con 0x7f36300cb570 2024-04-18T04:45:01.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.773+0000 7f3637000640 1 -- 172.21.15.120:0/1236735408 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3630150200 con 0x7f36300cb570 2024-04-18T04:45:01.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.773+0000 7f3637000640 1 -- 172.21.15.120:0/1236735408 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36300c21c0 con 0x7f36300cb570 2024-04-18T04:45:01.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.773+0000 7fbbbea00640 1 --2- 172.21.15.120:0/1382381849 >> [v2:172.21.15.120:6816/27471,v1:172.21.15.120:6817/27471] conn(0x7fbba006fd50 0x7fbba0072190 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:01.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.773+0000 7f584f800640 1 -- 172.21.15.120:0/3529402924 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f584815d0e0 con 0x7f584815bbe0 2024-04-18T04:45:01.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.773+0000 7fca4aa00640 1 --2- 172.21.15.120:0/540297364 >> [v2:172.21.15.132:6824/28102,v1:172.21.15.132:6825/28102] conn(0x7fca2c06fda0 0x7fca2c0721e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:01.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.777+0000 7fca4b400640 1 --2- 172.21.15.120:0/540297364 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fca2c066760 0x7fca2c068c20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fca3c009a50 tx=0x7fca3c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:01.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.777+0000 7fbbb7400640 1 -- 172.21.15.120:0/1382381849 <== osd.2 v2:172.21.15.120:6816/27471 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fbba0072860 con 0x7fbba006fd50 2024-04-18T04:45:01.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.777+0000 7f3637000640 1 -- 172.21.15.120:0/1236735408 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f36300725e0 con 0x7f36300cb570 2024-04-18T04:45:01.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.777+0000 7f69cb400640 1 -- 172.21.15.120:0/752089220 <== osd.5 v2:172.21.15.132:6808/28104 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f69b0072840 con 0x7f69b006fd30 2024-04-18T04:45:01.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.777+0000 7fca43400640 1 -- 172.21.15.120:0/540297364 <== osd.4 v2:172.21.15.132:6824/28102 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fca2c0728b0 con 0x7fca2c06fda0 2024-04-18T04:45:01.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.777+0000 7f5844c00640 1 -- 172.21.15.120:0/3529402924 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f58340073f0 con 0x7f584815bbe0 2024-04-18T04:45:01.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.777+0000 7f5844c00640 1 --2- 172.21.15.120:0/3529402924 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f5828066790 0x7f5828068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.777+0000 7f3627e00640 1 -- 172.21.15.120:0/1236735408 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f362801d3b0 con 0x7f36300cb570 2024-04-18T04:45:01.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.777+0000 7f5844c00640 1 -- 172.21.15.120:0/3529402924 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5834083cf0 con 0x7f584815bbe0 2024-04-18T04:45:01.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.777+0000 7f584ce00640 1 --2- 172.21.15.120:0/3529402924 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f5828066790 0x7f5828068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.777+0000 7f5844c00640 1 --2- 172.21.15.120:0/3529402924 >> [v2:172.21.15.132:6800/28103,v1:172.21.15.132:6801/28103] conn(0x7f582806fdd0 0x7f5828072210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.781+0000 7f5844c00640 1 -- 172.21.15.120:0/3529402924 --> [v2:172.21.15.132:6800/28103,v1:172.21.15.132:6801/28103] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f58280728e0 con 0x7f582806fdd0 2024-04-18T04:45:01.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.781+0000 7f5844c00640 1 -- 172.21.15.120:0/3529402924 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5834086310 con 0x7f584815bbe0 2024-04-18T04:45:01.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.781+0000 7f584ce00640 1 --2- 172.21.15.120:0/3529402924 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f5828066790 0x7f5828068c50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f583c000fe0 tx=0x7f583c0050c0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:01.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.781+0000 7f3627e00640 1 --2- 172.21.15.120:0/1236735408 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f360c066720 0x7f360c068be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.781+0000 7f3627e00640 1 -- 172.21.15.120:0/1236735408 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3628084350 con 0x7f36300cb570 2024-04-18T04:45:01.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.781+0000 7f584d800640 1 --2- 172.21.15.120:0/3529402924 >> [v2:172.21.15.132:6800/28103,v1:172.21.15.132:6801/28103] conn(0x7f582806fdd0 0x7f5828072210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.781+0000 7f362fe00640 1 --2- 172.21.15.120:0/1236735408 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f360c066720 0x7f360c068be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.781+0000 7f3627e00640 1 --2- 172.21.15.120:0/1236735408 >> [v2:172.21.15.132:6816/28129,v1:172.21.15.132:6817/28129] conn(0x7f360c06fce0 0x7f360c072120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:01.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.781+0000 7f3627e00640 1 -- 172.21.15.120:0/1236735408 --> [v2:172.21.15.132:6816/28129,v1:172.21.15.132:6817/28129] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f360c0727f0 con 0x7f360c06fce0 2024-04-18T04:45:01.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.781+0000 7f3627e00640 1 -- 172.21.15.120:0/1236735408 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3628086970 con 0x7f36300cb570 2024-04-18T04:45:01.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.781+0000 7f362f400640 1 --2- 172.21.15.120:0/1236735408 >> [v2:172.21.15.132:6816/28129,v1:172.21.15.132:6817/28129] conn(0x7f360c06fce0 0x7f360c072120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:01.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.781+0000 7f362fe00640 1 --2- 172.21.15.120:0/1236735408 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f360c066720 0x7f360c068be0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3618005890 tx=0x7f3618009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:01.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.781+0000 7f584d800640 1 --2- 172.21.15.120:0/3529402924 >> [v2:172.21.15.132:6800/28103,v1:172.21.15.132:6801/28103] conn(0x7f582806fdd0 0x7f5828072210 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:01.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.781+0000 7f362f400640 1 --2- 172.21.15.120:0/1236735408 >> [v2:172.21.15.132:6816/28129,v1:172.21.15.132:6817/28129] conn(0x7f360c06fce0 0x7f360c072120 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:01.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.785+0000 7f6e98e00640 1 -- 172.21.15.120:0/1313073961 --> [v2:172.21.15.120:6800/27468,v1:172.21.15.120:6801/27468] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6e6c002cc0 con 0x7f6e7406fd30 2024-04-18T04:45:01.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.785+0000 7f5844c00640 1 -- 172.21.15.120:0/3529402924 <== osd.6 v2:172.21.15.132:6800/28103 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f58280728e0 con 0x7f582806fdd0 2024-04-18T04:45:01.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.785+0000 7f3627e00640 1 -- 172.21.15.120:0/1236735408 <== osd.7 v2:172.21.15.132:6816/28129 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f360c0727f0 con 0x7f360c06fce0 2024-04-18T04:45:01.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.785+0000 7f6e8b400640 1 -- 172.21.15.120:0/1313073961 <== osd.0 v2:172.21.15.120:6800/27468 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6e6c002cc0 con 0x7f6e7406fd30 2024-04-18T04:45:01.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.785+0000 7f6e98e00640 1 -- 172.21.15.120:0/1313073961 >> [v2:172.21.15.120:6800/27468,v1:172.21.15.120:6801/27468] conn(0x7f6e7406fd30 msgr2=0x7f6e74072170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.785+0000 7f6e98e00640 1 --2- 172.21.15.120:0/1313073961 >> [v2:172.21.15.120:6800/27468,v1:172.21.15.120:6801/27468] conn(0x7f6e7406fd30 0x7f6e74072170 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.785+0000 7f6e98e00640 1 -- 172.21.15.120:0/1313073961 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6e740666f0 msgr2=0x7f6e74068bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.785+0000 7f6e98e00640 1 --2- 172.21.15.120:0/1313073961 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6e740666f0 0x7f6e74068bb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6e84006aa0 tx=0x7f6e84006a30 comp rx=0 tx=0).stop 2024-04-18T04:45:01.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.785+0000 7f6e98e00640 1 -- 172.21.15.120:0/1313073961 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6e940c7730 msgr2=0x7f6e940c9570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.785+0000 7f6e98e00640 1 --2- 172.21.15.120:0/1313073961 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6e940c7730 0x7f6e940c9570 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c00c780 tx=0x7f6e8c00cc40 comp rx=0 tx=0).stop 2024-04-18T04:45:01.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.789+0000 7f6e93e00640 1 -- 172.21.15.120:0/1313073961 reap_dead start 2024-04-18T04:45:01.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.789+0000 7f6e98e00640 1 -- 172.21.15.120:0/1313073961 shutdown_connections 2024-04-18T04:45:01.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.789+0000 7f6e98e00640 1 -- 172.21.15.120:0/1313073961 >> 172.21.15.120:0/1313073961 conn(0x7f6e94069ec0 msgr2=0x7f6e9406a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:01.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.789+0000 7f6e98e00640 1 -- 172.21.15.120:0/1313073961 shutdown_connections 2024-04-18T04:45:01.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.789+0000 7f6e98e00640 1 -- 172.21.15.120:0/1313073961 wait complete. 2024-04-18T04:45:01.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.793+0000 7f1e84e00640 1 -- 172.21.15.120:0/1000620081 --> [v2:172.21.15.120:6821/27470,v1:172.21.15.120:6823/27470] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1e80067070 con 0x7f1e6006fcd0 2024-04-18T04:45:01.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.793+0000 7f1e77400640 1 -- 172.21.15.120:0/1000620081 <== osd.1 v2:172.21.15.120:6821/27470 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1e80067070 con 0x7f1e6006fcd0 2024-04-18T04:45:01.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.793+0000 7f1e74c00640 1 -- 172.21.15.120:0/1000620081 >> [v2:172.21.15.120:6821/27470,v1:172.21.15.120:6823/27470] conn(0x7f1e6006fcd0 msgr2=0x7f1e60072110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.793+0000 7f1e74c00640 1 --2- 172.21.15.120:0/1000620081 >> [v2:172.21.15.120:6821/27470,v1:172.21.15.120:6823/27470] conn(0x7f1e6006fcd0 0x7f1e60072110 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.797+0000 7f1e74c00640 1 -- 172.21.15.120:0/1000620081 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1e60066690 msgr2=0x7f1e60068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.797+0000 7f1e74c00640 1 --2- 172.21.15.120:0/1000620081 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1e60066690 0x7f1e60068b50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1e800b4750 tx=0x7f1e70008040 comp rx=0 tx=0).stop 2024-04-18T04:45:01.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.797+0000 7f1e74c00640 1 -- 172.21.15.120:0/1000620081 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e800b3260 msgr2=0x7f1e801fa7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.797+0000 7f1e74c00640 1 --2- 172.21.15.120:0/1000620081 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e800b3260 0x7f1e801fa7f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c00c480 tx=0x7f1e6c00c940 comp rx=0 tx=0).stop 2024-04-18T04:45:01.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.797+0000 7f1e7fe00640 1 -- 172.21.15.120:0/1000620081 reap_dead start 2024-04-18T04:45:01.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.797+0000 7f1e74c00640 1 -- 172.21.15.120:0/1000620081 shutdown_connections 2024-04-18T04:45:01.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.797+0000 7f1e74c00640 1 -- 172.21.15.120:0/1000620081 >> 172.21.15.120:0/1000620081 conn(0x7f1e800661c0 msgr2=0x7f1e800caac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:01.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.797+0000 7f1e74c00640 1 -- 172.21.15.120:0/1000620081 shutdown_connections 2024-04-18T04:45:01.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.797+0000 7f1e74c00640 1 -- 172.21.15.120:0/1000620081 wait complete. 2024-04-18T04:45:01.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.805+0000 7f4c6c400640 1 -- 172.21.15.120:0/1946994345 --> [v2:172.21.15.120:6808/27469,v1:172.21.15.120:6809/27469] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4c640c0a70 con 0x7f4c4406fcd0 2024-04-18T04:45:01.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.805+0000 7fbbc6000640 1 -- 172.21.15.120:0/1382381849 --> [v2:172.21.15.120:6816/27471,v1:172.21.15.120:6817/27471] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbb98002cc0 con 0x7fbba006fd50 2024-04-18T04:45:01.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.805+0000 7f4c61600640 1 -- 172.21.15.120:0/1946994345 <== osd.3 v2:172.21.15.120:6808/27469 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4c50009890 con 0x7f4c4406fcd0 2024-04-18T04:45:01.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.805+0000 7fbbb7400640 1 -- 172.21.15.120:0/1382381849 <== osd.2 v2:172.21.15.120:6816/27471 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbb98002cc0 con 0x7fbba006fd50 2024-04-18T04:45:01.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.805+0000 7fca52200640 1 -- 172.21.15.120:0/540297364 --> [v2:172.21.15.132:6824/28102,v1:172.21.15.132:6825/28102] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fca4c153ce0 con 0x7fca2c06fda0 2024-04-18T04:45:01.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.805+0000 7fbbc6000640 1 -- 172.21.15.120:0/1382381849 >> [v2:172.21.15.120:6816/27471,v1:172.21.15.120:6817/27471] conn(0x7fbba006fd50 msgr2=0x7fbba0072190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.805+0000 7fbbc6000640 1 --2- 172.21.15.120:0/1382381849 >> [v2:172.21.15.120:6816/27471,v1:172.21.15.120:6817/27471] conn(0x7fbba006fd50 0x7fbba0072190 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.805+0000 7f4c56a00640 1 -- 172.21.15.120:0/1946994345 >> [v2:172.21.15.120:6808/27469,v1:172.21.15.120:6809/27469] conn(0x7f4c4406fcd0 msgr2=0x7f4c44072110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.805+0000 7f4c56a00640 1 --2- 172.21.15.120:0/1946994345 >> [v2:172.21.15.120:6808/27469,v1:172.21.15.120:6809/27469] conn(0x7f4c4406fcd0 0x7f4c44072110 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.805+0000 7fbbc6000640 1 -- 172.21.15.120:0/1382381849 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fbba0066710 msgr2=0x7fbba0068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.805+0000 7fbbc6000640 1 --2- 172.21.15.120:0/1382381849 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fbba0066710 0x7fbba0068bd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbbb00aa000 tx=0x7fbbb0001940 comp rx=0 tx=0).stop 2024-04-18T04:45:01.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.805+0000 7fbbc6000640 1 -- 172.21.15.120:0/1382381849 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbc00c4e00 msgr2=0x7fbbc00c7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.805+0000 7fbbc6000640 1 --2- 172.21.15.120:0/1382381849 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbc00c4e00 0x7fbbc00c7bd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbbc006dd00 tx=0x7fbbac011920 comp rx=0 tx=0).stop 2024-04-18T04:45:01.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.805+0000 7f69d9c00640 1 -- 172.21.15.120:0/752089220 --> [v2:172.21.15.132:6808/28104,v1:172.21.15.132:6809/28104] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f69a8002cc0 con 0x7f69b006fd30 2024-04-18T04:45:01.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.805+0000 7fbbbfe00640 1 -- 172.21.15.120:0/1382381849 reap_dead start 2024-04-18T04:45:01.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.805+0000 7f4c56a00640 1 -- 172.21.15.120:0/1946994345 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4c44066690 msgr2=0x7f4c44068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.805+0000 7f4c56a00640 1 --2- 172.21.15.120:0/1946994345 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4c44066690 0x7f4c44068b50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c011360 tx=0x7f4c5c00d040 comp rx=0 tx=0).stop 2024-04-18T04:45:01.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.805+0000 7f4c56a00640 1 -- 172.21.15.120:0/1946994345 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c6415cb30 msgr2=0x7f4c6415b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.805+0000 7f4c56a00640 1 --2- 172.21.15.120:0/1946994345 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c6415cb30 0x7f4c6415b0d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4c5801f530 tx=0x7f4c5801ba30 comp rx=0 tx=0).stop 2024-04-18T04:45:01.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.805+0000 7f4c6a400640 1 -- 172.21.15.120:0/1946994345 reap_dead start 2024-04-18T04:45:01.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.805+0000 7fbbc6000640 1 -- 172.21.15.120:0/1382381849 shutdown_connections 2024-04-18T04:45:01.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.805+0000 7fbbc6000640 1 -- 172.21.15.120:0/1382381849 >> 172.21.15.120:0/1382381849 conn(0x7fbbc006b780 msgr2=0x7fbbc00c5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:01.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.805+0000 7fca43400640 1 -- 172.21.15.120:0/540297364 <== osd.4 v2:172.21.15.132:6824/28102 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fca4c153ce0 con 0x7fca2c06fda0 2024-04-18T04:45:01.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.805+0000 7f69cb400640 1 -- 172.21.15.120:0/752089220 <== osd.5 v2:172.21.15.132:6808/28104 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f69a8002cc0 con 0x7f69b006fd30 2024-04-18T04:45:01.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.805+0000 7fca40c00640 1 -- 172.21.15.120:0/540297364 >> [v2:172.21.15.132:6824/28102,v1:172.21.15.132:6825/28102] conn(0x7fca2c06fda0 msgr2=0x7fca2c0721e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.805+0000 7fca40c00640 1 --2- 172.21.15.120:0/540297364 >> [v2:172.21.15.132:6824/28102,v1:172.21.15.132:6825/28102] conn(0x7fca2c06fda0 0x7fca2c0721e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.809+0000 7fca40c00640 1 -- 172.21.15.120:0/540297364 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fca2c066760 msgr2=0x7fca2c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.809+0000 7fca40c00640 1 --2- 172.21.15.120:0/540297364 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fca2c066760 0x7fca2c068c20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fca3c009a50 tx=0x7fca3c008040 comp rx=0 tx=0).stop 2024-04-18T04:45:01.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.809+0000 7fca40c00640 1 -- 172.21.15.120:0/540297364 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fca4c153900 msgr2=0x7fca4c14f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.809+0000 7fca40c00640 1 --2- 172.21.15.120:0/540297364 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fca4c153900 0x7fca4c14f530 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fca4400c7e0 tx=0x7fca4400cca0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.809+0000 7fca4be00640 1 -- 172.21.15.120:0/540297364 reap_dead start 2024-04-18T04:45:01.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.809+0000 7f4c56a00640 1 -- 172.21.15.120:0/1946994345 shutdown_connections 2024-04-18T04:45:01.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.809+0000 7f4c56a00640 1 -- 172.21.15.120:0/1946994345 >> 172.21.15.120:0/1946994345 conn(0x7f4c640c78c0 msgr2=0x7f4c6414e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:01.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.809+0000 7fca40c00640 1 -- 172.21.15.120:0/540297364 shutdown_connections 2024-04-18T04:45:01.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.809+0000 7fca40c00640 1 -- 172.21.15.120:0/540297364 >> 172.21.15.120:0/540297364 conn(0x7fca4c06c1d0 msgr2=0x7fca4c1526e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:01.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.809+0000 7f69d9c00640 1 -- 172.21.15.120:0/752089220 >> [v2:172.21.15.132:6808/28104,v1:172.21.15.132:6809/28104] conn(0x7f69b006fd30 msgr2=0x7f69b0072170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.809+0000 7f69d9c00640 1 --2- 172.21.15.120:0/752089220 >> [v2:172.21.15.132:6808/28104,v1:172.21.15.132:6809/28104] conn(0x7f69b006fd30 0x7f69b0072170 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.809+0000 7fca40c00640 1 -- 172.21.15.120:0/540297364 shutdown_connections 2024-04-18T04:45:01.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.809+0000 7fca40c00640 1 -- 172.21.15.120:0/540297364 wait complete. 2024-04-18T04:45:01.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.809+0000 7f69d9c00640 1 -- 172.21.15.120:0/752089220 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f69b00666f0 msgr2=0x7f69b0068bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.809+0000 7f69d9c00640 1 --2- 172.21.15.120:0/752089220 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f69b00666f0 0x7f69b0068bb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f69bc0b2000 tx=0x7f69bc0aa070 comp rx=0 tx=0).stop 2024-04-18T04:45:01.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.809+0000 7f69d9c00640 1 -- 172.21.15.120:0/752089220 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69d40cb850 msgr2=0x7f69d41f6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.809+0000 7f69d9c00640 1 --2- 172.21.15.120:0/752089220 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69d40cb850 0x7f69d41f6510 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f69c400c7c0 tx=0x7f69c400cc80 comp rx=0 tx=0).stop 2024-04-18T04:45:01.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.809+0000 7f69d3400640 1 -- 172.21.15.120:0/752089220 reap_dead start 2024-04-18T04:45:01.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.809+0000 7f69d9c00640 1 -- 172.21.15.120:0/752089220 shutdown_connections 2024-04-18T04:45:01.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.809+0000 7f69d9c00640 1 -- 172.21.15.120:0/752089220 >> 172.21.15.120:0/752089220 conn(0x7f69d406b780 msgr2=0x7f69d406bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:01.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.805+0000 7fbbc6000640 1 -- 172.21.15.120:0/1382381849 shutdown_connections 2024-04-18T04:45:01.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.805+0000 7fbbc6000640 1 -- 172.21.15.120:0/1382381849 wait complete. 2024-04-18T04:45:01.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.809+0000 7f69d9c00640 1 -- 172.21.15.120:0/752089220 shutdown_connections 2024-04-18T04:45:01.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.809+0000 7f69d9c00640 1 -- 172.21.15.120:0/752089220 wait complete. 2024-04-18T04:45:01.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.809+0000 7f4c56a00640 1 -- 172.21.15.120:0/1946994345 shutdown_connections 2024-04-18T04:45:01.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.809+0000 7f4c56a00640 1 -- 172.21.15.120:0/1946994345 wait complete. 2024-04-18T04:45:01.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.813+0000 7f584f800640 1 -- 172.21.15.120:0/3529402924 --> [v2:172.21.15.132:6800/28103,v1:172.21.15.132:6801/28103] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f58480af9c0 con 0x7f582806fdd0 2024-04-18T04:45:01.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.813+0000 7f3637000640 1 -- 172.21.15.120:0/1236735408 --> [v2:172.21.15.132:6816/28129,v1:172.21.15.132:6817/28129] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f36300c6ee0 con 0x7f360c06fce0 2024-04-18T04:45:01.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.813+0000 7f5844c00640 1 -- 172.21.15.120:0/3529402924 <== osd.6 v2:172.21.15.132:6800/28103 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f58280728e0 con 0x7f582806fdd0 2024-04-18T04:45:01.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.813+0000 7f3627e00640 1 -- 172.21.15.120:0/1236735408 <== osd.7 v2:172.21.15.132:6816/28129 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f36200a88b0 con 0x7f360c06fce0 2024-04-18T04:45:01.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.813+0000 7f584f800640 1 -- 172.21.15.120:0/3529402924 >> [v2:172.21.15.132:6800/28103,v1:172.21.15.132:6801/28103] conn(0x7f582806fdd0 msgr2=0x7f5828072210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.817+0000 7f584f800640 1 --2- 172.21.15.120:0/3529402924 >> [v2:172.21.15.132:6800/28103,v1:172.21.15.132:6801/28103] conn(0x7f582806fdd0 0x7f5828072210 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.817+0000 7f584f800640 1 -- 172.21.15.120:0/3529402924 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f5828066790 msgr2=0x7f5828068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.817+0000 7f584f800640 1 --2- 172.21.15.120:0/3529402924 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f5828066790 0x7f5828068c50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f583c000fe0 tx=0x7f583c0050c0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.817+0000 7f584f800640 1 -- 172.21.15.120:0/3529402924 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f584815bbe0 msgr2=0x7f58480c9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.817+0000 7f584f800640 1 --2- 172.21.15.120:0/3529402924 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f584815bbe0 0x7f58480c9560 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f583400f4d0 tx=0x7f583400f990 comp rx=0 tx=0).stop 2024-04-18T04:45:01.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.817+0000 7f584d800640 1 -- 172.21.15.120:0/3529402924 reap_dead start 2024-04-18T04:45:01.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.817+0000 7f584f800640 1 -- 172.21.15.120:0/3529402924 shutdown_connections 2024-04-18T04:45:01.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.817+0000 7f584f800640 1 -- 172.21.15.120:0/3529402924 >> 172.21.15.120:0/3529402924 conn(0x7f584806b780 msgr2=0x7f58480afd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:01.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.817+0000 7f584f800640 1 -- 172.21.15.120:0/3529402924 shutdown_connections 2024-04-18T04:45:01.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.817+0000 7f584f800640 1 -- 172.21.15.120:0/3529402924 wait complete. 2024-04-18T04:45:01.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.817+0000 7f3637000640 1 -- 172.21.15.120:0/1236735408 >> [v2:172.21.15.132:6816/28129,v1:172.21.15.132:6817/28129] conn(0x7f360c06fce0 msgr2=0x7f360c072120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.817+0000 7f3637000640 1 --2- 172.21.15.120:0/1236735408 >> [v2:172.21.15.132:6816/28129,v1:172.21.15.132:6817/28129] conn(0x7f360c06fce0 0x7f360c072120 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:01.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.817+0000 7f3637000640 1 -- 172.21.15.120:0/1236735408 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f360c066720 msgr2=0x7f360c068be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.817+0000 7f3637000640 1 --2- 172.21.15.120:0/1236735408 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f360c066720 0x7f360c068be0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3618005890 tx=0x7f3618009040 comp rx=0 tx=0).stop 2024-04-18T04:45:01.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.817+0000 7f3637000640 1 -- 172.21.15.120:0/1236735408 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36300cb570 msgr2=0x7f36300c4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:01.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.817+0000 7f3637000640 1 --2- 172.21.15.120:0/1236735408 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36300cb570 0x7f36300c4270 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f362800be20 tx=0x7f362800bf10 comp rx=0 tx=0).stop 2024-04-18T04:45:01.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.817+0000 7f3635000640 1 -- 172.21.15.120:0/1236735408 reap_dead start 2024-04-18T04:45:01.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.817+0000 7f3637000640 1 -- 172.21.15.120:0/1236735408 shutdown_connections 2024-04-18T04:45:01.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.817+0000 7f3637000640 1 -- 172.21.15.120:0/1236735408 >> 172.21.15.120:0/1236735408 conn(0x7f363006b780 msgr2=0x7f36300c0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:01.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.817+0000 7f3637000640 1 -- 172.21.15.120:0/1236735408 shutdown_connections 2024-04-18T04:45:01.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:01.817+0000 7f3637000640 1 -- 172.21.15.120:0/1236735408 wait complete. 2024-04-18T04:45:01.852 INFO:teuthology.orchestra.run.smithi120.stdout:55834574859 2024-04-18T04:45:01.852 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-18T04:45:01.853 INFO:teuthology.orchestra.run.smithi120.stdout:64424509451 2024-04-18T04:45:01.853 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-18T04:45:01.854 INFO:teuthology.orchestra.run.smithi120.stdout:64424509452 2024-04-18T04:45:01.854 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-18T04:45:01.855 INFO:teuthology.orchestra.run.smithi120.stdout:64424509450 2024-04-18T04:45:01.855 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-18T04:45:01.856 INFO:teuthology.orchestra.run.smithi120.stdout:60129542156 2024-04-18T04:45:01.856 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-18T04:45:01.857 INFO:teuthology.orchestra.run.smithi120.stdout:60129542156 2024-04-18T04:45:01.857 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-18T04:45:01.858 INFO:teuthology.orchestra.run.smithi120.stdout:60129542154 2024-04-18T04:45:01.859 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-18T04:45:01.859 INFO:teuthology.orchestra.run.smithi120.stdout:60129542156 2024-04-18T04:45:01.860 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-18T04:45:02.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.145+0000 7f7a69000640 1 Processor -- start 2024-04-18T04:45:02.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.145+0000 7f7a69000640 1 -- start start 2024-04-18T04:45:02.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.149+0000 7f7a69000640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7a6406b3e0 0x7f7a64166d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.149+0000 7f7a69000640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a64167280 con 0x7f7a640b0b20 2024-04-18T04:45:02.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.149+0000 7f7a69000640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a640c6190 con 0x7f7a6406c1e0 2024-04-18T04:45:02.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.149+0000 7f7a69000640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a6406ba00 con 0x7f7a6406b3e0 2024-04-18T04:45:02.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.149+0000 7f7a61400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7a6406b3e0 0x7f7a64166d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:02.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.149+0000 7f7a61400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7a6406b3e0 0x7f7a64166d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:60304/0 (socket says 172.21.15.120:60304) 2024-04-18T04:45:02.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.149+0000 7f7a61400640 1 -- 172.21.15.120:0/2692576695 learned_addr learned my addr 172.21.15.120:0/2692576695 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:02.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.149+0000 7f7a61400640 1 -- 172.21.15.120:0/2692576695 >> v1:172.21.15.132:6789/0 conn(0x7f7a6406c1e0 legacy=0x7f7a64170b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:02.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.149+0000 7f7a61400640 1 -- 172.21.15.120:0/2692576695 >> v1:172.21.15.120:6789/0 conn(0x7f7a640b0b20 legacy=0x7f7a640c6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:02.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.149+0000 7f7a61400640 1 -- 172.21.15.120:0/2692576695 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a6406bce0 con 0x7f7a6406b3e0 2024-04-18T04:45:02.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.149+0000 7f0cd9600640 1 Processor -- start 2024-04-18T04:45:02.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.153+0000 7f0cd9600640 1 -- start start 2024-04-18T04:45:02.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.153+0000 7f0cd9600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0ccc04b2d0 0x7f0ccc005e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.153+0000 7f0cd9600640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0ccc04b6b0 0x7f0ccc0d4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.153+0000 7f0cd9600640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ccc0dbd20 con 0x7f0ccc046d50 2024-04-18T04:45:02.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.153+0000 7f0cd9600640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ccc0468c0 con 0x7f0ccc04b6b0 2024-04-18T04:45:02.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.153+0000 7f930f800640 1 Processor -- start 2024-04-18T04:45:02.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.153+0000 7f930f800640 1 -- start start 2024-04-18T04:45:02.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.153+0000 7f0cd9600640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ccc0dba80 con 0x7f0ccc04b2d0 2024-04-18T04:45:02.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.153+0000 7f0cd3400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0ccc04b6b0 0x7f0ccc0d4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:02.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.153+0000 7f0cd3400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0ccc04b6b0 0x7f0ccc0d4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:33820/0 (socket says 172.21.15.120:33820) 2024-04-18T04:45:02.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.153+0000 7f0cd3400640 1 -- 172.21.15.120:0/3837705528 learned_addr learned my addr 172.21.15.120:0/3837705528 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:02.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.153+0000 7f0cd3e00640 1 --2- 172.21.15.120:0/3837705528 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0ccc04b2d0 0x7f0ccc005e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:02.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.153+0000 7f0cd3400640 1 -- 172.21.15.120:0/3837705528 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0ccc04b2d0 msgr2=0x7f0ccc005e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:02.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.153+0000 7f0cd3400640 1 --2- 172.21.15.120:0/3837705528 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0ccc04b2d0 0x7f0ccc005e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.153+0000 7f0cd3400640 1 -- 172.21.15.120:0/3837705528 >> v1:172.21.15.132:6789/0 conn(0x7f0ccc046d50 legacy=0x7f0ccc0dad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:02.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.153+0000 7f0cd3400640 1 -- 172.21.15.120:0/3837705528 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ccc045f90 con 0x7f0ccc04b6b0 2024-04-18T04:45:02.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.157+0000 7f7a61400640 1 --2- 172.21.15.120:0/2692576695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a6406b3e0 0x7f7a64166d40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7a50008870 tx=0x7f7a500211e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0da7bc72c82033e server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:02.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.157+0000 7f7a60a00640 1 -- 172.21.15.120:0/2692576695 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a500b3410 con 0x7f7a6406b3e0 2024-04-18T04:45:02.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.157+0000 7f7a60a00640 1 -- 172.21.15.120:0/2692576695 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a500ad030 con 0x7f7a6406b3e0 2024-04-18T04:45:02.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.157+0000 7f7a60a00640 1 -- 172.21.15.120:0/2692576695 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a500b3790 con 0x7f7a6406b3e0 2024-04-18T04:45:02.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.157+0000 7f930f800640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f93080c78d0 0x7f9308072220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.157+0000 7f930ce00640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f93080c74f0 0x7f93080c1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:41710/0 (socket says 172.21.15.120:41710) 2024-04-18T04:45:02.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.157+0000 7f930ce00640 1 -- 172.21.15.120:0/110953645 learned_addr learned my addr 172.21.15.120:0/110953645 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:45:02.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.157+0000 7f930f800640 1 --2- 172.21.15.120:0/110953645 >> v2:172.21.15.120:3300/0 conn(0x7f93080c95a0 0x7f9308150300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.157+0000 7f9307e00640 1 --2- 172.21.15.120:0/110953645 >> v2:172.21.15.132:3300/0 conn(0x7f93080c78d0 0x7f9308072220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:02.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.157+0000 7f930f800640 1 -- 172.21.15.120:0/110953645 --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f930815a970 con 0x7f93080c74f0 2024-04-18T04:45:02.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.157+0000 7f930d800640 1 --2- 172.21.15.120:0/110953645 >> v2:172.21.15.120:3300/0 conn(0x7f93080c95a0 0x7f9308150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:02.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.157+0000 7f930f800640 1 -- 172.21.15.120:0/110953645 --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93080c68d0 con 0x7f93080c95a0 2024-04-18T04:45:02.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.157+0000 7f9723e00640 1 Processor -- start 2024-04-18T04:45:02.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.157+0000 7f9307400640 1 -- 172.21.15.120:0/110953645 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1734508889 0 0) 0x7f930815a970 con 0x7f93080c74f0 2024-04-18T04:45:02.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.157+0000 7f7a69000640 1 -- 172.21.15.120:0/2692576695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a6406b3e0 msgr2=0x7f7a64166d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:02.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.157+0000 7f7a69000640 1 --2- 172.21.15.120:0/2692576695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a6406b3e0 0x7f7a64166d40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7a50008870 tx=0x7f7a500211e0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.157+0000 7f930f800640 1 -- 172.21.15.120:0/110953645 --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93080c6ac0 con 0x7f93080c78d0 2024-04-18T04:45:02.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.157+0000 7f7a69000640 1 -- 172.21.15.120:0/2692576695 shutdown_connections 2024-04-18T04:45:02.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.157+0000 7f7a69000640 1 --2- 172.21.15.120:0/2692576695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a6406b3e0 0x7f7a64166d40 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7a50008870 tx=0x7f7a500211e0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.157+0000 7f7a69000640 1 -- 172.21.15.120:0/2692576695 >> 172.21.15.120:0/2692576695 conn(0x7f7a640c78c0 msgr2=0x7f7a640c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:02.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.161+0000 7f0cd3400640 1 --2- 172.21.15.120:0/3837705528 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ccc04b6b0 0x7f0ccc0d4b20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4074c20 tx=0x7f0cd4097030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad7e81b362f3178a server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:02.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.157+0000 7f9723e00640 1 -- start start 2024-04-18T04:45:02.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.161+0000 7f9307400640 1 -- 172.21.15.120:0/110953645 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92ec003530 con 0x7f93080c74f0 2024-04-18T04:45:02.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.161+0000 7f0cd2a00640 1 -- 172.21.15.120:0/3837705528 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd4127440 con 0x7f0ccc04b6b0 2024-04-18T04:45:02.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.161+0000 7f0cd2a00640 1 -- 172.21.15.120:0/3837705528 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd41275a0 con 0x7f0ccc04b6b0 2024-04-18T04:45:02.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.161+0000 7f0cd2a00640 1 -- 172.21.15.120:0/3837705528 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd41279f0 con 0x7f0ccc04b6b0 2024-04-18T04:45:02.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.161+0000 7f9307e00640 1 -- 172.21.15.120:0/110953645 >> v2:172.21.15.120:3300/0 conn(0x7f93080c95a0 msgr2=0x7f9308150300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:02.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.161+0000 7f9307e00640 1 --2- 172.21.15.120:0/110953645 >> v2:172.21.15.120:3300/0 conn(0x7f93080c95a0 0x7f9308150300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.161+0000 7f437b800640 1 Processor -- start 2024-04-18T04:45:02.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.161+0000 7f9307e00640 1 -- 172.21.15.120:0/110953645 >> v1:172.21.15.132:6789/0 conn(0x7f93080c74f0 legacy=0x7f93080c1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:02.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.161+0000 7f9307e00640 1 -- 172.21.15.120:0/110953645 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9308159bb0 con 0x7f93080c78d0 2024-04-18T04:45:02.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.161+0000 7f7a69000640 1 -- 172.21.15.120:0/2692576695 shutdown_connections 2024-04-18T04:45:02.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.161+0000 7f7a69000640 1 -- 172.21.15.120:0/2692576695 wait complete. 2024-04-18T04:45:02.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.161+0000 7f9723e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f971c157cb0 0x7f971c15e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.161+0000 7f9723e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f971c0c9890 0x7f971c0cf390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.161+0000 7f9723e00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f971c0cf8d0 0x7f971c0c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.161+0000 7f9723e00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f971c0cfce0 con 0x7f971c157cb0 2024-04-18T04:45:02.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.161+0000 7f9723e00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f971c160ef0 con 0x7f971c0cf8d0 2024-04-18T04:45:02.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.161+0000 7f9723e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971c15e8c0 con 0x7f971c0c9890 2024-04-18T04:45:02.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.161+0000 7f9721e00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f971c0cf8d0 0x7f971c0c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:02.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.161+0000 7f9721e00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f971c0cf8d0 0x7f971c0c42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:60326/0 (socket says 172.21.15.120:60326) 2024-04-18T04:45:02.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.161+0000 7f9721e00640 1 -- 172.21.15.120:0/259133371 learned_addr learned my addr 172.21.15.120:0/259133371 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:02.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.161+0000 7f437b800640 1 -- start start 2024-04-18T04:45:02.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.161+0000 7f0cd9600640 1 -- 172.21.15.120:0/3837705528 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ccc04b6b0 msgr2=0x7f0ccc0d4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:02.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.161+0000 7f0cd9600640 1 --2- 172.21.15.120:0/3837705528 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ccc04b6b0 0x7f0ccc0d4b20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4074c20 tx=0x7f0cd4097030 comp rx=0 tx=0).stop 2024-04-18T04:45:02.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.161+0000 7f0cd9600640 1 -- 172.21.15.120:0/3837705528 shutdown_connections 2024-04-18T04:45:02.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.161+0000 7f0cd9600640 1 --2- 172.21.15.120:0/3837705528 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ccc04b6b0 0x7f0ccc0d4b20 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.161+0000 7f0cd9600640 1 --2- 172.21.15.120:0/3837705528 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0ccc04b2d0 0x7f0ccc005e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.161+0000 7f0cd9600640 1 -- 172.21.15.120:0/3837705528 >> 172.21.15.120:0/3837705528 conn(0x7f0ccc050160 msgr2=0x7f0ccc050570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:02.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.161+0000 7f0cd9600640 1 -- 172.21.15.120:0/3837705528 shutdown_connections 2024-04-18T04:45:02.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.161+0000 7f437b800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f43740cb570 0x7f4374158d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.161+0000 7f9721e00640 1 -- 172.21.15.120:0/259133371 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f971c0c9890 msgr2=0x7f971c0cf390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-18T04:45:02.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.161+0000 7f9721e00640 1 --2- 172.21.15.120:0/259133371 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f971c0c9890 0x7f971c0cf390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.161+0000 7f9721e00640 1 -- 172.21.15.120:0/259133371 >> v2:172.21.15.120:3300/0 conn(0x7f971c157cb0 msgr2=0x7f971c15e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:02.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.161+0000 7f9721e00640 1 --2- 172.21.15.120:0/259133371 >> v2:172.21.15.120:3300/0 conn(0x7f971c157cb0 0x7f971c15e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.161+0000 7f9721e00640 1 -- 172.21.15.120:0/259133371 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f971c0c3e30 con 0x7f971c0cf8d0 2024-04-18T04:45:02.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.161+0000 7f437b800640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f43740cadc0 0x7f43740c7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.161+0000 7f437b800640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43740c57c0 con 0x7f43740c66d0 2024-04-18T04:45:02.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.161+0000 7f437b800640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43740bfe70 con 0x7f43740cadc0 2024-04-18T04:45:02.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.161+0000 7f437b800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43740c0330 con 0x7f43740cb570 2024-04-18T04:45:02.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.165+0000 7f0cd9600640 1 -- 172.21.15.120:0/3837705528 wait complete. 2024-04-18T04:45:02.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.165+0000 7f7a69000640 1 Processor -- start 2024-04-18T04:45:02.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.161+0000 7f930d800640 1 --2- 172.21.15.120:0/110953645 >> v2:172.21.15.120:3300/0 conn(0x7f93080c95a0 0x7f9308150300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:45:02.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.165+0000 7f4378e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f43740cb570 0x7f4374158d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:02.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.165+0000 7f4378e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f43740cb570 0x7f4374158d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:42048/0 (socket says 172.21.15.120:42048) 2024-04-18T04:45:02.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.165+0000 7f4378e00640 1 -- 172.21.15.120:0/3942042945 learned_addr learned my addr 172.21.15.120:0/3942042945 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:02.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.165+0000 7f7a69000640 1 -- start start 2024-04-18T04:45:02.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.165+0000 7f4378e00640 1 -- 172.21.15.120:0/3942042945 >> v2:172.21.15.120:3300/0 conn(0x7f43740cadc0 msgr2=0x7f43740c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:02.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.165+0000 7f4378e00640 1 --2- 172.21.15.120:0/3942042945 >> v2:172.21.15.120:3300/0 conn(0x7f43740cadc0 0x7f43740c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.165+0000 7f4378e00640 1 -- 172.21.15.120:0/3942042945 >> v1:172.21.15.120:6789/0 conn(0x7f43740c66d0 legacy=0x7f437406d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:02.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.165+0000 7f4378e00640 1 -- 172.21.15.120:0/3942042945 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43740c5a60 con 0x7f43740cb570 2024-04-18T04:45:02.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.165+0000 7f9307e00640 1 --2- 172.21.15.120:0/110953645 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93080c78d0 0x7f9308072220 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f93080682c0 tx=0x7f92f801f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cde49f6981c2c42 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:02.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.165+0000 7f7a69000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a6406c1e0 0x7f7a6420e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.165+0000 7f9307400640 1 -- 172.21.15.120:0/110953645 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f80af600 con 0x7f93080c78d0 2024-04-18T04:45:02.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.165+0000 7f9307400640 1 -- 172.21.15.120:0/110953645 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f80ab050 con 0x7f93080c78d0 2024-04-18T04:45:02.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.165+0000 7f9307400640 1 -- 172.21.15.120:0/110953645 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f80af980 con 0x7f93080c78d0 2024-04-18T04:45:02.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.165+0000 7f7a69000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a640b0b20 0x7f7a6420e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.165+0000 7f7a69000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7a64167c10 0x7f7a640c0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.165+0000 7f7a69000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a642008b0 con 0x7f7a6406c1e0 2024-04-18T04:45:02.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.165+0000 7f7a69000640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a641ffde0 con 0x7f7a640b0b20 2024-04-18T04:45:02.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.165+0000 7f7a69000640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6420db70 con 0x7f7a64167c10 2024-04-18T04:45:02.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.165+0000 7f7a61e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a6406c1e0 0x7f7a6420e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:02.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.165+0000 7f7a62800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7a64167c10 0x7f7a640c0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:02.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.165+0000 7f7a62800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7a64167c10 0x7f7a640c0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:42062/0 (socket says 172.21.15.120:42062) 2024-04-18T04:45:02.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.165+0000 7f7a62800640 1 -- 172.21.15.120:0/151671534 learned_addr learned my addr 172.21.15.120:0/151671534 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:02.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.165+0000 7f7a61400640 1 --2- 172.21.15.120:0/151671534 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a640b0b20 0x7f7a6420e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:02.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.165+0000 7f930f800640 1 -- 172.21.15.120:0/110953645 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93080c78d0 msgr2=0x7f9308072220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:02.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.165+0000 7f930f800640 1 --2- 172.21.15.120:0/110953645 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93080c78d0 0x7f9308072220 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f93080682c0 tx=0x7f92f801f130 comp rx=0 tx=0).stop 2024-04-18T04:45:02.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.165+0000 7f0cd9600640 1 Processor -- start 2024-04-18T04:45:02.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.165+0000 7f8e4e400640 1 Processor -- start 2024-04-18T04:45:02.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f930f800640 1 -- 172.21.15.120:0/110953645 shutdown_connections 2024-04-18T04:45:02.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f7a61e00640 1 -- 172.21.15.120:0/151671534 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7a64167c10 msgr2=0x7f7a640c0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:02.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f8e4e400640 1 -- start start 2024-04-18T04:45:02.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f9721e00640 1 --2- 172.21.15.120:0/259133371 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f971c0cf8d0 0x7f971c0c42c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f971c0ccd80 tx=0x7f970c01ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83fead587a54b805 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:02.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f7a61e00640 1 --2- 172.21.15.120:0/151671534 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7a64167c10 0x7f7a640c0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f7a61e00640 1 -- 172.21.15.120:0/151671534 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a640b0b20 msgr2=0x7f7a6420e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:02.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f7a61e00640 1 --2- 172.21.15.120:0/151671534 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a640b0b20 0x7f7a6420e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f7a61e00640 1 -- 172.21.15.120:0/151671534 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a50008550 con 0x7f7a6406c1e0 2024-04-18T04:45:02.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f930f800640 1 --2- 172.21.15.120:0/110953645 >> v2:172.21.15.120:3300/0 conn(0x7f93080c95a0 0x7f9308150300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f930f800640 1 --2- 172.21.15.120:0/110953645 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93080c78d0 0x7f9308072220 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f930f800640 1 -- 172.21.15.120:0/110953645 >> 172.21.15.120:0/110953645 conn(0x7f93080c89d0 msgr2=0x7f93080c8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:02.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f930f800640 1 -- 172.21.15.120:0/110953645 shutdown_connections 2024-04-18T04:45:02.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f0cd9600640 1 -- start start 2024-04-18T04:45:02.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f7a61400640 1 --2- 172.21.15.120:0/151671534 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a640b0b20 0x7f7a6420e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:45:02.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f7a62800640 1 --2- 172.21.15.120:0/151671534 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7a64167c10 0x7f7a640c0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:45:02.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f7a61e00640 1 --2- 172.21.15.120:0/151671534 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a6406c1e0 0x7f7a6420e000 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7a5400b440 tx=0x7f7a5400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:02.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f971be00640 1 -- 172.21.15.120:0/259133371 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970c0a5740 con 0x7f971c0cf8d0 2024-04-18T04:45:02.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f7a5a000640 1 -- 172.21.15.120:0/151671534 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a54011830 con 0x7f7a6406c1e0 2024-04-18T04:45:02.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f7a5a000640 1 -- 172.21.15.120:0/151671534 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a540119b0 con 0x7f7a6406c1e0 2024-04-18T04:45:02.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f7a5a000640 1 -- 172.21.15.120:0/151671534 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a54011d60 con 0x7f7a6406c1e0 2024-04-18T04:45:02.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f930f800640 1 -- 172.21.15.120:0/110953645 wait complete. 2024-04-18T04:45:02.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f971be00640 1 -- 172.21.15.120:0/259133371 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f970c0a58a0 con 0x7f971c0cf8d0 2024-04-18T04:45:02.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f971be00640 1 -- 172.21.15.120:0/259133371 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970c0a5c30 con 0x7f971c0cf8d0 2024-04-18T04:45:02.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f8e4e400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e480cb570 0x7f8e4814fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f8e4e400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8e480c66d0 0x7f8e480c7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f0cd9600640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ccc046d50 0x7f0ccc0d7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f0cd9600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ccc04b2d0 0x7f0ccc0c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f0cd9600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0ccc04b6b0 0x7f0ccc0c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f4378e00640 1 --2- 172.21.15.120:0/3942042945 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f43740cb570 0x7f4374158d20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4368009870 tx=0x7f436801ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23288ec9eacb0a1b server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:02.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f0cd9600640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ccc0d67f0 con 0x7f0ccc04b2d0 2024-04-18T04:45:02.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f0cd9600640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ccc0d5940 con 0x7f0ccc046d50 2024-04-18T04:45:02.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f0cd9600640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ccc0d5be0 con 0x7f0ccc04b6b0 2024-04-18T04:45:02.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f0cd8c00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0ccc04b6b0 0x7f0ccc0c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:02.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f0cd8c00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0ccc04b6b0 0x7f0ccc0c9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:42064/0 (socket says 172.21.15.120:42064) 2024-04-18T04:45:02.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f0cd8c00640 1 -- 172.21.15.120:0/4062679014 learned_addr learned my addr 172.21.15.120:0/4062679014 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:02.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f8e4e400640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e480c0330 con 0x7f8e480cadc0 2024-04-18T04:45:02.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f8e4e400640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e480bfe70 con 0x7f8e480c66d0 2024-04-18T04:45:02.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f8e4e400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e48159430 con 0x7f8e480cb570 2024-04-18T04:45:02.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f8e3fe00640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f8e480cadc0 0x7f8e48158d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:41722/0 (socket says 172.21.15.120:41722) 2024-04-18T04:45:02.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f8e3fe00640 1 -- 172.21.15.120:0/3800911345 learned_addr learned my addr 172.21.15.120:0/3800911345 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:45:02.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f8e47e00640 1 --2- 172.21.15.120:0/3800911345 >> v2:172.21.15.132:3300/0 conn(0x7f8e480c66d0 0x7f8e480c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:02.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7ff48d600640 1 Processor -- start 2024-04-18T04:45:02.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f9723e00640 1 -- 172.21.15.120:0/259133371 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f971c0cf8d0 msgr2=0x7f971c0c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:02.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f9723e00640 1 --2- 172.21.15.120:0/259133371 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f971c0cf8d0 0x7f971c0c42c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f971c0ccd80 tx=0x7f970c01ca30 comp rx=0 tx=0).stop 2024-04-18T04:45:02.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f930f800640 1 Processor -- start 2024-04-18T04:45:02.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f930f800640 1 -- start start 2024-04-18T04:45:02.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f7a69000640 1 -- 172.21.15.120:0/151671534 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a64200010 con 0x7f7a6406c1e0 2024-04-18T04:45:02.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f9723e00640 1 -- 172.21.15.120:0/259133371 shutdown_connections 2024-04-18T04:45:02.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f9723e00640 1 --2- 172.21.15.120:0/259133371 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f971c0cf8d0 0x7f971c0c42c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f9723e00640 1 --2- 172.21.15.120:0/259133371 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f971c0c9890 0x7f971c0cf390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f9723e00640 1 --2- 172.21.15.120:0/259133371 >> v2:172.21.15.120:3300/0 conn(0x7f971c157cb0 0x7f971c15e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f9723e00640 1 -- 172.21.15.120:0/259133371 >> 172.21.15.120:0/259133371 conn(0x7f971c065fc0 msgr2=0x7f971c0663d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:02.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f8e47400640 1 --2- 172.21.15.120:0/3800911345 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e480cb570 0x7f8e4814fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:02.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f8e46a00640 1 -- 172.21.15.120:0/3800911345 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1649254743 0 0) 0x7f8e480c0330 con 0x7f8e480cadc0 2024-04-18T04:45:02.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f7a69000640 1 -- 172.21.15.120:0/151671534 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a642005d0 con 0x7f7a6406c1e0 2024-04-18T04:45:02.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f4373400640 1 -- 172.21.15.120:0/3942042945 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43680a89d0 con 0x7f43740cb570 2024-04-18T04:45:02.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7f4373400640 1 -- 172.21.15.120:0/3942042945 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43680a8b30 con 0x7f43740cb570 2024-04-18T04:45:02.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f8e46a00640 1 -- 172.21.15.120:0/3800911345 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e2c003530 con 0x7f8e480cadc0 2024-04-18T04:45:02.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7f8e46a00640 1 -- 172.21.15.120:0/3800911345 <== mon.1 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1903901225 0 0) 0x7f8e2c003530 con 0x7f8e480cadc0 2024-04-18T04:45:02.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f9723e00640 1 -- 172.21.15.120:0/259133371 shutdown_connections 2024-04-18T04:45:02.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f9723e00640 1 -- 172.21.15.120:0/259133371 wait complete. 2024-04-18T04:45:02.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7f8e47e00640 1 -- 172.21.15.120:0/3800911345 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e480cb570 msgr2=0x7f8e4814fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:02.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7f8e47e00640 1 --2- 172.21.15.120:0/3800911345 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e480cb570 0x7f8e4814fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7f8e47e00640 1 -- 172.21.15.120:0/3800911345 >> v1:172.21.15.132:6789/0 conn(0x7f8e480cadc0 legacy=0x7f8e48158d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:02.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7f8e47e00640 1 -- 172.21.15.120:0/3800911345 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e480c5a60 con 0x7f8e480c66d0 2024-04-18T04:45:02.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7f437b800640 1 -- 172.21.15.120:0/3942042945 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f43740cb570 msgr2=0x7f4374158d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:02.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7ff48d600640 1 -- start start 2024-04-18T04:45:02.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7f930f800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93080c74f0 0x7f93081494a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7f930f800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f93080c78d0 0x7f930806e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7f930f800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93080c95a0 0x7f930814a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f0cd3400640 1 --2- 172.21.15.120:0/4062679014 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ccc04b2d0 0x7f0ccc0c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:02.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.169+0000 7f0cd3e00640 1 --2- 172.21.15.120:0/4062679014 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ccc046d50 0x7f0ccc0d7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:02.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7f0cd8c00640 1 -- 172.21.15.120:0/4062679014 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ccc046d50 msgr2=0x7f0ccc0d7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:02.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7f0cd8c00640 1 --2- 172.21.15.120:0/4062679014 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ccc046d50 0x7f0ccc0d7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7f0cd8c00640 1 -- 172.21.15.120:0/4062679014 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ccc04b2d0 msgr2=0x7f0ccc0c9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:02.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7f0cd8c00640 1 --2- 172.21.15.120:0/4062679014 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ccc04b2d0 0x7f0ccc0c9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7f0cd8c00640 1 -- 172.21.15.120:0/4062679014 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd4072040 con 0x7f0ccc04b6b0 2024-04-18T04:45:02.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7f930f800640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93081499e0 con 0x7f93080c95a0 2024-04-18T04:45:02.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7f930f800640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930814dbb0 con 0x7f93080c74f0 2024-04-18T04:45:02.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7f930f800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f930814de70 con 0x7f93080c78d0 2024-04-18T04:45:02.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7ff48d600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff488154650 0x7ff4880c02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7ff48d600640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff4880c6b70 0x7ff48806c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7f4373400640 1 -- 172.21.15.120:0/3942042945 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43680a89d0 con 0x7f43740cb570 2024-04-18T04:45:02.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7ff48d600640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4880c5860 con 0x7ff48806c570 2024-04-18T04:45:02.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7ff48d600640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4880c75a0 con 0x7ff4880c6b70 2024-04-18T04:45:02.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7ff48d600640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4880c5ad0 con 0x7ff488154650 2024-04-18T04:45:02.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7f930ce00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93080c74f0 0x7f93081494a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:02.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7f9307e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f93080c78d0 0x7f930806e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:02.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7f930d800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93080c95a0 0x7f930814a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:02.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7f930d800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93080c95a0 0x7f930814a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:33862/0 (socket says 172.21.15.120:33862) 2024-04-18T04:45:02.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7f930d800640 1 -- 172.21.15.120:0/215744434 learned_addr learned my addr 172.21.15.120:0/215744434 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:02.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7f9723e00640 1 Processor -- start 2024-04-18T04:45:02.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7f0cd8c00640 1 --2- 172.21.15.120:0/4062679014 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0ccc04b6b0 0x7f0ccc0c9fd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0009fa0 tx=0x7f0cc000b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:02.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7ff487e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff488154650 0x7ff4880c02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:02.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7ff487400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff4880c6b70 0x7ff48806c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:02.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7ff487400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff4880c6b70 0x7ff48806c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:60366/0 (socket says 172.21.15.120:60366) 2024-04-18T04:45:02.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7ff487400640 1 -- 172.21.15.120:0/1761609889 learned_addr learned my addr 172.21.15.120:0/1761609889 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:02.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7f437b800640 1 --2- 172.21.15.120:0/3942042945 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f43740cb570 0x7f4374158d20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4368009870 tx=0x7f436801ed10 comp rx=0 tx=0).stop 2024-04-18T04:45:02.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7f0cc7e00640 1 -- 172.21.15.120:0/4062679014 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc0014e30 con 0x7f0ccc04b6b0 2024-04-18T04:45:02.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7f0cc7e00640 1 -- 172.21.15.120:0/4062679014 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cc001c440 con 0x7f0ccc04b6b0 2024-04-18T04:45:02.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7f0cc7e00640 1 -- 172.21.15.120:0/4062679014 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc001c7f0 con 0x7f0ccc04b6b0 2024-04-18T04:45:02.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7f0cd9600640 1 -- 172.21.15.120:0/4062679014 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ccc0e7eb0 con 0x7f0ccc04b6b0 2024-04-18T04:45:02.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7f9723e00640 1 -- start start 2024-04-18T04:45:02.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7f9307e00640 1 -- 172.21.15.120:0/215744434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93080c74f0 msgr2=0x7f93081494a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:02.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7f9307e00640 1 --2- 172.21.15.120:0/215744434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93080c74f0 0x7f93081494a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7f9307e00640 1 -- 172.21.15.120:0/215744434 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93080c95a0 msgr2=0x7f930814a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:02.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7f9307e00640 1 --2- 172.21.15.120:0/215744434 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93080c95a0 0x7f930814a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7f9307e00640 1 -- 172.21.15.120:0/215744434 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9300009420 con 0x7f93080c78d0 2024-04-18T04:45:02.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7f930d800640 1 --2- 172.21.15.120:0/215744434 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93080c95a0 0x7f930814a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:45:02.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7f930ce00640 1 --2- 172.21.15.120:0/215744434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93080c74f0 0x7f93081494a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:45:02.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7f7a69000640 1 -- 172.21.15.120:0/151671534 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a640728f0 con 0x7f7a6406c1e0 2024-04-18T04:45:02.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7f0cd9600640 1 -- 172.21.15.120:0/4062679014 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ccc0d5470 con 0x7f0ccc04b6b0 2024-04-18T04:45:02.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.177+0000 7f437b800640 1 -- 172.21.15.120:0/3942042945 shutdown_connections 2024-04-18T04:45:02.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.177+0000 7f437b800640 1 --2- 172.21.15.120:0/3942042945 >> v2:172.21.15.120:3300/0 conn(0x7f43740cadc0 0x7f43740c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.177+0000 7f437b800640 1 --2- 172.21.15.120:0/3942042945 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f43740cb570 0x7f4374158d20 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.177+0000 7f7a5a000640 1 -- 172.21.15.120:0/151671534 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7a5401a400 con 0x7f7a6406c1e0 2024-04-18T04:45:02.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.177+0000 7f437b800640 1 -- 172.21.15.120:0/3942042945 >> 172.21.15.120:0/3942042945 conn(0x7f437406b780 msgr2=0x7f437406bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:02.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.177+0000 7f923a400640 1 Processor -- start 2024-04-18T04:45:02.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.177+0000 7f437b800640 1 -- 172.21.15.120:0/3942042945 shutdown_connections 2024-04-18T04:45:02.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.177+0000 7f9307e00640 1 --2- 172.21.15.120:0/215744434 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f93080c78d0 0x7f930806e4e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f92f80af000 tx=0x7f92f801bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:02.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.177+0000 7f923a400640 1 -- start start 2024-04-18T04:45:02.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.177+0000 7f7a5a000640 1 --2- 172.21.15.120:0/151671534 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7a440666c0 0x7f7a44068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.177+0000 7f7a5a000640 1 -- 172.21.15.120:0/151671534 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7a54084b70 con 0x7f7a6406c1e0 2024-04-18T04:45:02.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.177+0000 7f437b800640 1 -- 172.21.15.120:0/3942042945 wait complete. 2024-04-18T04:45:02.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.177+0000 7f7a61400640 1 --2- 172.21.15.120:0/151671534 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7a440666c0 0x7f7a44068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:02.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.177+0000 7f8e47e00640 1 --2- 172.21.15.120:0/3800911345 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e480c66d0 0x7f8e480c7850 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8e40009dc0 tx=0x7f8e4001f080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af666491991247aa server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:02.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.177+0000 7f9304c00640 1 -- 172.21.15.120:0/215744434 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f80afcd0 con 0x7f93080c78d0 2024-04-18T04:45:02.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.177+0000 7f9304c00640 1 -- 172.21.15.120:0/215744434 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f80afe30 con 0x7f93080c78d0 2024-04-18T04:45:02.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.177+0000 7f9304c00640 1 -- 172.21.15.120:0/215744434 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f80ba660 con 0x7f93080c78d0 2024-04-18T04:45:02.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7ff487400640 1 -- 172.21.15.120:0/1761609889 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff488154650 msgr2=0x7ff4880c02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:02.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7ff487400640 1 --2- 172.21.15.120:0/1761609889 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff488154650 0x7ff4880c02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7ff487400640 1 -- 172.21.15.120:0/1761609889 >> v1:172.21.15.120:6789/0 conn(0x7ff48806c570 legacy=0x7ff488160ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:02.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.173+0000 7ff487400640 1 -- 172.21.15.120:0/1761609889 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4880c5db0 con 0x7ff4880c6b70 2024-04-18T04:45:02.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.177+0000 7f923a400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9234070900 0x7f92340c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.177+0000 7f9723e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f971c0c9890 0x7f971c0c6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.177+0000 7f9723e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f971c0cf8d0 0x7f971c15ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.177+0000 7f9723e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f971c157cb0 0x7f971c0c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.177+0000 7f9723e00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971c1f6a90 con 0x7f971c157cb0 2024-04-18T04:45:02.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.177+0000 7f9723e00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971c0c8da0 con 0x7f971c0c9890 2024-04-18T04:45:02.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.177+0000 7f9723e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971c0c7bf0 con 0x7f971c0cf8d0 2024-04-18T04:45:02.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.177+0000 7f9233400640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f9234150790 0x7f9234156bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:41730/0 (socket says 172.21.15.120:41730) 2024-04-18T04:45:02.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f9232a00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9234070900 0x7f92340c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:02.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.177+0000 7f930f800640 1 -- 172.21.15.120:0/215744434 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92f8009a70 con 0x7f93080c78d0 2024-04-18T04:45:02.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.177+0000 7f0cc7e00640 1 -- 172.21.15.120:0/4062679014 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0cc00253b0 con 0x7f0ccc04b6b0 2024-04-18T04:45:02.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.177+0000 7f0cd9600640 1 -- 172.21.15.120:0/4062679014 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ccc008910 con 0x7f0ccc04b6b0 2024-04-18T04:45:02.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f8e46a00640 1 -- 172.21.15.120:0/3800911345 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e30001680 con 0x7f8e480c66d0 2024-04-18T04:45:02.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f8e46a00640 1 -- 172.21.15.120:0/3800911345 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e400a8bf0 con 0x7f8e480c66d0 2024-04-18T04:45:02.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f8e46a00640 1 -- 172.21.15.120:0/3800911345 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e400b0440 con 0x7f8e480c66d0 2024-04-18T04:45:02.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f9721400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f971c0c9890 0x7f971c0c6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:02.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f9721400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f971c0c9890 0x7f971c0c6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:60368/0 (socket says 172.21.15.120:60368) 2024-04-18T04:45:02.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f9721400640 1 -- 172.21.15.120:0/3238219517 learned_addr learned my addr 172.21.15.120:0/3238219517 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:02.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f437b800640 1 Processor -- start 2024-04-18T04:45:02.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f930f800640 1 -- 172.21.15.120:0/215744434 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f930814cc80 con 0x7f93080c78d0 2024-04-18T04:45:02.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f0cc7e00640 1 --2- 172.21.15.120:0/4062679014 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0cb40666e0 0x7f0cb4068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f9232a00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9234070900 0x7f92340c68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:33868/0 (socket says 172.21.15.120:33868) 2024-04-18T04:45:02.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f7a61400640 1 --2- 172.21.15.120:0/151671534 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7a440666c0 0x7f7a44068b80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7a500b5000 tx=0x7f7a5000b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:02.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f437b800640 1 -- start start 2024-04-18T04:45:02.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f0cc7e00640 1 -- 172.21.15.120:0/4062679014 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0cc008c2c0 con 0x7f0ccc04b6b0 2024-04-18T04:45:02.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f9721400640 1 -- 172.21.15.120:0/3238219517 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f971c0cf8d0 msgr2=0x7f971c15ff80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-18T04:45:02.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f9721400640 1 --2- 172.21.15.120:0/3238219517 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f971c0cf8d0 0x7f971c15ff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f9721400640 1 -- 172.21.15.120:0/3238219517 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f971c157cb0 msgr2=0x7f971c0c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:02.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f9721400640 1 --2- 172.21.15.120:0/3238219517 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f971c157cb0 0x7f971c0c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f9721400640 1 -- 172.21.15.120:0/3238219517 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f970c009b30 con 0x7f971c0c9890 2024-04-18T04:45:02.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f0cd3e00640 1 --2- 172.21.15.120:0/4062679014 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0cb40666e0 0x7f0cb4068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:02.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f8e4e400640 1 -- 172.21.15.120:0/3800911345 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e480c66d0 msgr2=0x7f8e480c7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:02.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f8e4e400640 1 --2- 172.21.15.120:0/3800911345 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e480c66d0 0x7f8e480c7850 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8e40009dc0 tx=0x7f8e4001f080 comp rx=0 tx=0).stop 2024-04-18T04:45:02.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f8e4e400640 1 -- 172.21.15.120:0/3800911345 shutdown_connections 2024-04-18T04:45:02.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f8e4e400640 1 --2- 172.21.15.120:0/3800911345 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e480c66d0 0x7f8e480c7850 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f8e4e400640 1 --2- 172.21.15.120:0/3800911345 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e480cb570 0x7f8e4814fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f8e4e400640 1 -- 172.21.15.120:0/3800911345 >> 172.21.15.120:0/3800911345 conn(0x7f8e4806b780 msgr2=0x7f8e4806bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:02.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f923a400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f92340cc230 0x7f92340cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f9233400640 1 -- 172.21.15.120:0/2030536644 learned_addr learned my addr 172.21.15.120:0/2030536644 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:45:02.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f9233e00640 1 --2- 172.21.15.120:0/2030536644 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f92340cc230 0x7f92340cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:02.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f923a400640 1 -- 172.21.15.120:0/2030536644 --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9234159a40 con 0x7f9234150790 2024-04-18T04:45:02.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f923a400640 1 -- 172.21.15.120:0/2030536644 --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f923415aa30 con 0x7f9234070900 2024-04-18T04:45:02.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f923a400640 1 -- 172.21.15.120:0/2030536644 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f923406f270 con 0x7f92340cc230 2024-04-18T04:45:02.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f9232000640 1 -- 172.21.15.120:0/2030536644 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 326469959 0 0) 0x7f9234159a40 con 0x7f9234150790 2024-04-18T04:45:02.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f9232000640 1 -- 172.21.15.120:0/2030536644 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9218003530 con 0x7f9234150790 2024-04-18T04:45:02.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f9721400640 1 --2- 172.21.15.120:0/3238219517 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f971c0c9890 0x7f971c0c6210 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f971400b410 tx=0x7f971400b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:02.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f9233e00640 1 -- 172.21.15.120:0/2030536644 >> v2:172.21.15.120:3300/0 conn(0x7f9234070900 msgr2=0x7f92340c68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:02.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f9233e00640 1 --2- 172.21.15.120:0/2030536644 >> v2:172.21.15.120:3300/0 conn(0x7f9234070900 0x7f92340c68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f9233e00640 1 -- 172.21.15.120:0/2030536644 >> v1:172.21.15.132:6789/0 conn(0x7f9234150790 legacy=0x7f9234156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:02.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f9233e00640 1 -- 172.21.15.120:0/2030536644 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9234150b70 con 0x7f92340cc230 2024-04-18T04:45:02.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f9232a00640 1 --2- 172.21.15.120:0/2030536644 >> v2:172.21.15.120:3300/0 conn(0x7f9234070900 0x7f92340c68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:45:02.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f8e4e400640 1 -- 172.21.15.120:0/3800911345 shutdown_connections 2024-04-18T04:45:02.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f0cd3e00640 1 --2- 172.21.15.120:0/4062679014 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0cb40666e0 0x7f0cb4068ba0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0cc800b9d0 tx=0x7f0cc8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:02.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f8e4e400640 1 -- 172.21.15.120:0/3800911345 wait complete. 2024-04-18T04:45:02.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f437b800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f43740c66d0 0x7f4374142000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f437b800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f43740cadc0 0x7f4374140480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f437b800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43740cb570 0x7f4374132330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f437b800640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4374133ce0 con 0x7f43740cb570 2024-04-18T04:45:02.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f437b800640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4374138850 con 0x7f43740c66d0 2024-04-18T04:45:02.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f437b800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4374142e90 con 0x7f43740cadc0 2024-04-18T04:45:02.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f930f800640 1 -- 172.21.15.120:0/215744434 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9308067590 con 0x7f93080c78d0 2024-04-18T04:45:02.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f9719600640 1 -- 172.21.15.120:0/3238219517 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9714011830 con 0x7f971c0c9890 2024-04-18T04:45:02.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f9719600640 1 -- 172.21.15.120:0/3238219517 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97140119b0 con 0x7f971c0c9890 2024-04-18T04:45:02.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f9719600640 1 -- 172.21.15.120:0/3238219517 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9714011d60 con 0x7f971c0c9890 2024-04-18T04:45:02.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f4373e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f43740cadc0 0x7f4374140480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:02.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f4373e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f43740cadc0 0x7f4374140480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:42102/0 (socket says 172.21.15.120:42102) 2024-04-18T04:45:02.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f4373e00640 1 -- 172.21.15.120:0/492424054 learned_addr learned my addr 172.21.15.120:0/492424054 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:02.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f4378e00640 1 --2- 172.21.15.120:0/492424054 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f43740c66d0 0x7f4374142000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:02.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f4379800640 1 --2- 172.21.15.120:0/492424054 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43740cb570 0x7f4374132330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:02.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7ff487400640 1 --2- 172.21.15.120:0/1761609889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4880c6b70 0x7ff48806c030 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff478009870 tx=0x7ff47801c550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e97474f21385658e server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:02.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f9723e00640 1 -- 172.21.15.120:0/3238219517 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f971c153800 con 0x7f971c0c9890 2024-04-18T04:45:02.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f9723e00640 1 -- 172.21.15.120:0/3238219517 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f971c160a00 con 0x7f971c0c9890 2024-04-18T04:45:02.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f4373e00640 1 -- 172.21.15.120:0/492424054 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f43740c66d0 msgr2=0x7f4374142000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:02.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f4373e00640 1 --2- 172.21.15.120:0/492424054 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f43740c66d0 0x7f4374142000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f4373e00640 1 -- 172.21.15.120:0/492424054 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43740cb570 msgr2=0x7f4374132330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:02.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.181+0000 7f4373e00640 1 --2- 172.21.15.120:0/492424054 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43740cb570 0x7f4374132330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.185+0000 7f4373e00640 1 -- 172.21.15.120:0/492424054 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43680094d0 con 0x7f43740cadc0 2024-04-18T04:45:02.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.185+0000 7ff486a00640 1 -- 172.21.15.120:0/1761609889 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4780aa650 con 0x7ff4880c6b70 2024-04-18T04:45:02.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.185+0000 7f7a5a000640 1 -- 172.21.15.120:0/151671534 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f7a54051b70 con 0x7f7a6406c1e0 2024-04-18T04:45:02.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.185+0000 7ff486a00640 1 -- 172.21.15.120:0/1761609889 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4780aa7b0 con 0x7ff4880c6b70 2024-04-18T04:45:02.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.185+0000 7ff486a00640 1 -- 172.21.15.120:0/1761609889 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4780aab40 con 0x7ff4880c6b70 2024-04-18T04:45:02.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.185+0000 7f4373e00640 1 --2- 172.21.15.120:0/492424054 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f43740cadc0 0x7f4374140480 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f436000b5b0 tx=0x7f436000ba70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:02.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.185+0000 7f9723e00640 1 -- 172.21.15.120:0/3238219517 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f971c067550 con 0x7f971c0c9890 2024-04-18T04:45:02.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.185+0000 7f8e4e400640 1 Processor -- start 2024-04-18T04:45:02.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.185+0000 7f8e4e400640 1 -- start start 2024-04-18T04:45:02.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.185+0000 7ff48d600640 1 -- 172.21.15.120:0/1761609889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4880c6b70 msgr2=0x7ff48806c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:02.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.185+0000 7ff48d600640 1 --2- 172.21.15.120:0/1761609889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4880c6b70 0x7ff48806c030 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff478009870 tx=0x7ff47801c550 comp rx=0 tx=0).stop 2024-04-18T04:45:02.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.185+0000 7f9233e00640 1 --2- 172.21.15.120:0/2030536644 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f92340cc230 0x7f92340cc660 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f922c009d90 tx=0x7f922c01eaf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10e9856de2c82ecc server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:02.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.185+0000 7f8e4e400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e480c66d0 0x7f8e48150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.185+0000 7f8e4e400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e480cadc0 0x7f8e481513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.185+0000 7f8e4e400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e480cb570 0x7f8e481f6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.185+0000 7f8e4e400640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e48151920 con 0x7f8e480cb570 2024-04-18T04:45:02.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.185+0000 7f8e4e400640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e48154320 con 0x7f8e480c66d0 2024-04-18T04:45:02.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.185+0000 7f8e4e400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e48154bc0 con 0x7f8e480cadc0 2024-04-18T04:45:02.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.185+0000 7ff48d600640 1 -- 172.21.15.120:0/1761609889 shutdown_connections 2024-04-18T04:45:02.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.185+0000 7ff48d600640 1 --2- 172.21.15.120:0/1761609889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4880c6b70 0x7ff48806c030 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.185+0000 7ff48d600640 1 --2- 172.21.15.120:0/1761609889 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff488154650 0x7ff4880c02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.185+0000 7ff48d600640 1 -- 172.21.15.120:0/1761609889 >> 172.21.15.120:0/1761609889 conn(0x7ff48806d000 msgr2=0x7ff48806d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:02.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.185+0000 7ff48d600640 1 -- 172.21.15.120:0/1761609889 shutdown_connections 2024-04-18T04:45:02.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.185+0000 7f8e3fe00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e480cadc0 0x7f8e481513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:02.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.185+0000 7ff48d600640 1 -- 172.21.15.120:0/1761609889 wait complete. 2024-04-18T04:45:02.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.185+0000 7f8e3fe00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e480cadc0 0x7f8e481513e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:42116/0 (socket says 172.21.15.120:42116) 2024-04-18T04:45:02.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.185+0000 7f8e3fe00640 1 -- 172.21.15.120:0/920496370 learned_addr learned my addr 172.21.15.120:0/920496370 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:02.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.185+0000 7f8e47400640 1 --2- 172.21.15.120:0/920496370 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e480c66d0 0x7f8e48150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:02.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.185+0000 7f8e47e00640 1 --2- 172.21.15.120:0/920496370 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e480cb570 0x7f8e481f6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:02.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.185+0000 7f8e47e00640 1 -- 172.21.15.120:0/920496370 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e480cadc0 msgr2=0x7f8e481513e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:02.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.185+0000 7f8e47e00640 1 --2- 172.21.15.120:0/920496370 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e480cadc0 0x7f8e481513e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.185+0000 7f8e47e00640 1 -- 172.21.15.120:0/920496370 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e480c66d0 msgr2=0x7f8e48150ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:02.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.185+0000 7f8e47e00640 1 --2- 172.21.15.120:0/920496370 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e480c66d0 0x7f8e48150ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.185+0000 7f8e47e00640 1 -- 172.21.15.120:0/920496370 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e40009a70 con 0x7f8e480cb570 2024-04-18T04:45:02.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.185+0000 7f8e3fe00640 1 --2- 172.21.15.120:0/920496370 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e480cadc0 0x7f8e481513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:45:02.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.185+0000 7f8e47e00640 1 --2- 172.21.15.120:0/920496370 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e480cb570 0x7f8e481f6b70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8e400af000 tx=0x7f8e4001be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:02.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.185+0000 7f9719600640 1 -- 172.21.15.120:0/3238219517 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f971401a400 con 0x7f971c0c9890 2024-04-18T04:45:02.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.189+0000 7f8e3f400640 1 -- 172.21.15.120:0/920496370 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e40009450 con 0x7f8e480cb570 2024-04-18T04:45:02.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.189+0000 7f8e3f400640 1 -- 172.21.15.120:0/920496370 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e400bc450 con 0x7f8e480cb570 2024-04-18T04:45:02.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.189+0000 7f8e4e400640 1 -- 172.21.15.120:0/920496370 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e48070300 con 0x7f8e480cb570 2024-04-18T04:45:02.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.189+0000 7f8e3f400640 1 -- 172.21.15.120:0/920496370 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e400bc800 con 0x7f8e480cb570 2024-04-18T04:45:02.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.189+0000 7f8e4e400640 1 -- 172.21.15.120:0/920496370 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e48154570 con 0x7f8e480cb570 2024-04-18T04:45:02.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.189+0000 7f9719600640 1 --2- 172.21.15.120:0/3238219517 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f96fc066710 0x7f96fc068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.189+0000 7f9719600640 1 -- 172.21.15.120:0/3238219517 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9714084ac0 con 0x7f971c0c9890 2024-04-18T04:45:02.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.189+0000 7f8e4e400640 1 -- 172.21.15.120:0/920496370 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e48072a70 con 0x7f8e480cb570 2024-04-18T04:45:02.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.189+0000 7ff48d600640 1 Processor -- start 2024-04-18T04:45:02.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.189+0000 7ff48d600640 1 -- start start 2024-04-18T04:45:02.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.189+0000 7ff48d600640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff48806c570 0x7ff4881f5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.189+0000 7ff48d600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff488154650 0x7ff4881f5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.189+0000 7ff48d600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff48815f8b0 0x7ff48814e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.189+0000 7ff48d600640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff488160930 con 0x7ff488154650 2024-04-18T04:45:02.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.189+0000 7ff48d600640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48815ebb0 con 0x7ff48806c570 2024-04-18T04:45:02.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.189+0000 7ff48d600640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff48815e590 con 0x7ff48815f8b0 2024-04-18T04:45:02.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.189+0000 7ff487400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff488154650 0x7ff4881f5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:02.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.189+0000 7ff487e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff48806c570 0x7ff4881f5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:02.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.189+0000 7ff487400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff488154650 0x7ff4881f5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:33916/0 (socket says 172.21.15.120:33916) 2024-04-18T04:45:02.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.189+0000 7ff487400640 1 -- 172.21.15.120:0/115017674 learned_addr learned my addr 172.21.15.120:0/115017674 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:02.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.189+0000 7f9720a00640 1 --2- 172.21.15.120:0/3238219517 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f96fc066710 0x7f96fc068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:02.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.189+0000 7ff48cc00640 1 --2- 172.21.15.120:0/115017674 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff48815f8b0 0x7ff48814e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:02.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.189+0000 7ff487400640 1 -- 172.21.15.120:0/115017674 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff48815f8b0 msgr2=0x7ff48814e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:02.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.189+0000 7ff487400640 1 --2- 172.21.15.120:0/115017674 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff48815f8b0 0x7ff48814e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.189+0000 7ff487400640 1 -- 172.21.15.120:0/115017674 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff48806c570 msgr2=0x7ff4881f5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:02.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.189+0000 7ff487400640 1 --2- 172.21.15.120:0/115017674 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff48806c570 0x7ff4881f5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.189+0000 7ff487400640 1 -- 172.21.15.120:0/115017674 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4780094d0 con 0x7ff488154650 2024-04-18T04:45:02.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.189+0000 7ff48cc00640 1 --2- 172.21.15.120:0/115017674 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff48815f8b0 0x7ff48814e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:02.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.189+0000 7ff487400640 1 --2- 172.21.15.120:0/115017674 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff488154650 0x7ff4881f5b70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff47801cdf0 tx=0x7ff47801ad90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:02.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.189+0000 7f8e3f400640 1 -- 172.21.15.120:0/920496370 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8e400bc960 con 0x7f8e480cb570 2024-04-18T04:45:02.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.189+0000 7f9720a00640 1 --2- 172.21.15.120:0/3238219517 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f96fc066710 0x7f96fc068bd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9708006fd0 tx=0x7f9708006b40 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:02.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.193+0000 7f8e3f400640 1 --2- 172.21.15.120:0/920496370 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8e24066690 0x7f8e24068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.193+0000 7f8e3f400640 1 -- 172.21.15.120:0/920496370 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8e40123760 con 0x7f8e480cb570 2024-04-18T04:45:02.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.193+0000 7f8e47400640 1 --2- 172.21.15.120:0/920496370 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8e24066690 0x7f8e24068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:02.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.193+0000 7f8e47400640 1 --2- 172.21.15.120:0/920496370 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8e24066690 0x7f8e24068b50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8e38009b60 tx=0x7f8e38009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:02.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.193+0000 7ff47fe00640 1 -- 172.21.15.120:0/115017674 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4780b3800 con 0x7ff488154650 2024-04-18T04:45:02.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.193+0000 7ff47fe00640 1 -- 172.21.15.120:0/115017674 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4780b3980 con 0x7ff488154650 2024-04-18T04:45:02.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.193+0000 7ff47fe00640 1 -- 172.21.15.120:0/115017674 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4780b3d30 con 0x7ff488154650 2024-04-18T04:45:02.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.193+0000 7f8e3f400640 1 -- 172.21.15.120:0/920496370 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f8e400f07e0 con 0x7f8e480cb570 2024-04-18T04:45:02.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.193+0000 7ff48d600640 1 -- 172.21.15.120:0/115017674 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff48815ff90 con 0x7ff488154650 2024-04-18T04:45:02.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.197+0000 7f0cc7e00640 1 -- 172.21.15.120:0/4062679014 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f0ccc008910 con 0x7f0ccc04b6b0 2024-04-18T04:45:02.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.197+0000 7f4370c00640 1 -- 172.21.15.120:0/492424054 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4360010890 con 0x7f43740cadc0 2024-04-18T04:45:02.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.197+0000 7f437b800640 1 -- 172.21.15.120:0/492424054 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43741428d0 con 0x7f43740cadc0 2024-04-18T04:45:02.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.197+0000 7f4370c00640 1 -- 172.21.15.120:0/492424054 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4360010a10 con 0x7f43740cadc0 2024-04-18T04:45:02.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.197+0000 7f4370c00640 1 -- 172.21.15.120:0/492424054 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4360010dc0 con 0x7f43740cadc0 2024-04-18T04:45:02.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.197+0000 7f437b800640 1 -- 172.21.15.120:0/492424054 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43741410a0 con 0x7f43740cadc0 2024-04-18T04:45:02.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.197+0000 7ff48d600640 1 -- 172.21.15.120:0/115017674 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff488160550 con 0x7ff488154650 2024-04-18T04:45:02.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.197+0000 7ff48d600640 1 -- 172.21.15.120:0/115017674 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4880728f0 con 0x7ff488154650 2024-04-18T04:45:02.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.197+0000 7f9232000640 1 -- 172.21.15.120:0/2030536644 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922c0a79d0 con 0x7f92340cc230 2024-04-18T04:45:02.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.197+0000 7f9232000640 1 -- 172.21.15.120:0/2030536644 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f922c0a7b30 con 0x7f92340cc230 2024-04-18T04:45:02.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.197+0000 7f9232000640 1 -- 172.21.15.120:0/2030536644 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922c0a7ea0 con 0x7f92340cc230 2024-04-18T04:45:02.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.197+0000 7f437b800640 1 -- 172.21.15.120:0/492424054 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4350005260 con 0x7f43740cadc0 2024-04-18T04:45:02.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.197+0000 7f923a400640 1 -- 172.21.15.120:0/2030536644 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f92340cc230 msgr2=0x7f92340cc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:02.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.197+0000 7f923a400640 1 --2- 172.21.15.120:0/2030536644 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f92340cc230 0x7f92340cc660 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f922c009d90 tx=0x7f922c01eaf0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.197+0000 7f923a400640 1 -- 172.21.15.120:0/2030536644 shutdown_connections 2024-04-18T04:45:02.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.197+0000 7f923a400640 1 --2- 172.21.15.120:0/2030536644 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f92340cc230 0x7f92340cc660 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.197+0000 7f923a400640 1 --2- 172.21.15.120:0/2030536644 >> v2:172.21.15.120:3300/0 conn(0x7f9234070900 0x7f92340c68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.197+0000 7f923a400640 1 -- 172.21.15.120:0/2030536644 >> 172.21.15.120:0/2030536644 conn(0x7f923406b1a0 msgr2=0x7f923406b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:02.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.197+0000 7f923a400640 1 -- 172.21.15.120:0/2030536644 shutdown_connections 2024-04-18T04:45:02.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.197+0000 7f9304c00640 1 -- 172.21.15.120:0/215744434 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f92f80ba7c0 con 0x7f93080c78d0 2024-04-18T04:45:02.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.197+0000 7f923a400640 1 -- 172.21.15.120:0/2030536644 wait complete. 2024-04-18T04:45:02.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.201+0000 7f9304c00640 1 --2- 172.21.15.120:0/215744434 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f92e4066710 0x7f92e4068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.201+0000 7f9304c00640 1 -- 172.21.15.120:0/215744434 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f92f8123200 con 0x7f93080c78d0 2024-04-18T04:45:02.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.201+0000 7ff47fe00640 1 -- 172.21.15.120:0/115017674 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff4780c6390 con 0x7ff488154650 2024-04-18T04:45:02.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.201+0000 7ff47fe00640 1 --2- 172.21.15.120:0/115017674 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff468066790 0x7ff468068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.201+0000 7ff47fe00640 1 -- 172.21.15.120:0/115017674 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff47811f030 con 0x7ff488154650 2024-04-18T04:45:02.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.201+0000 7f923a400640 1 Processor -- start 2024-04-18T04:45:02.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.201+0000 7f930ce00640 1 --2- 172.21.15.120:0/215744434 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f92e4066710 0x7f92e4068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:02.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.201+0000 7f923a400640 1 -- start start 2024-04-18T04:45:02.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.201+0000 7ff487e00640 1 --2- 172.21.15.120:0/115017674 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff468066790 0x7ff468068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:02.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.201+0000 7ff487e00640 1 --2- 172.21.15.120:0/115017674 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff468066790 0x7ff468068c50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff474006fd0 tx=0x7ff474008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:02.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.201+0000 7f930ce00640 1 --2- 172.21.15.120:0/215744434 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f92e4066710 0x7f92e4068bd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f92f00011f0 tx=0x7f92f0007d40 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:02.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.201+0000 7f9719600640 1 -- 172.21.15.120:0/3238219517 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f9714051c20 con 0x7f971c0c9890 2024-04-18T04:45:02.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.201+0000 7f923a400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9234070900 0x7f923414aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.205+0000 7f923a400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92340cc230 0x7f92341eeee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.205+0000 7f923a400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9234150790 0x7f92341ef420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.205+0000 7f923a400640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92341f0fe0 con 0x7f9234150790 2024-04-18T04:45:02.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.205+0000 7f923a400640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9234159a30 con 0x7f92340cc230 2024-04-18T04:45:02.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.205+0000 7f923a400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92341f1280 con 0x7f9234070900 2024-04-18T04:45:02.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.205+0000 7f9233400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9234070900 0x7f923414aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:02.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.205+0000 7f9233e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9234150790 0x7f92341ef420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:02.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.205+0000 7f9233e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9234150790 0x7f92341ef420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:33932/0 (socket says 172.21.15.120:33932) 2024-04-18T04:45:02.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.205+0000 7f9233e00640 1 -- 172.21.15.120:0/3403352599 learned_addr learned my addr 172.21.15.120:0/3403352599 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:02.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.205+0000 7f9233e00640 1 -- 172.21.15.120:0/3403352599 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9234070900 msgr2=0x7f923414aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:02.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.205+0000 7f9233e00640 1 --2- 172.21.15.120:0/3403352599 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9234070900 0x7f923414aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.205+0000 7f9233e00640 1 -- 172.21.15.120:0/3403352599 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92340cc230 msgr2=0x7f92341eeee0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-18T04:45:02.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.205+0000 7f9232a00640 1 --2- 172.21.15.120:0/3403352599 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92340cc230 0x7f92341eeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:02.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.205+0000 7f9233e00640 1 --2- 172.21.15.120:0/3403352599 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92340cc230 0x7f92341eeee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.205+0000 7f9233e00640 1 -- 172.21.15.120:0/3403352599 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9224009420 con 0x7f9234150790 2024-04-18T04:45:02.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.205+0000 7f9233e00640 1 --2- 172.21.15.120:0/3403352599 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9234150790 0x7f92341ef420 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f922c0b2040 tx=0x7f922c01b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:02.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.209+0000 7f922b400640 1 -- 172.21.15.120:0/3403352599 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922c004240 con 0x7f9234150790 2024-04-18T04:45:02.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.209+0000 7f923a400640 1 -- 172.21.15.120:0/3403352599 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f922c009a70 con 0x7f9234150790 2024-04-18T04:45:02.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.209+0000 7f923a400640 1 -- 172.21.15.120:0/3403352599 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92341f1840 con 0x7f9234150790 2024-04-18T04:45:02.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.209+0000 7ff47fe00640 1 -- 172.21.15.120:0/115017674 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7ff4780ec140 con 0x7ff488154650 2024-04-18T04:45:02.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.209+0000 7f922b400640 1 -- 172.21.15.120:0/3403352599 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f922c0043a0 con 0x7f9234150790 2024-04-18T04:45:02.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.209+0000 7f922b400640 1 -- 172.21.15.120:0/3403352599 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922c004240 con 0x7f9234150790 2024-04-18T04:45:02.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.209+0000 7f9304c00640 1 -- 172.21.15.120:0/215744434 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f92f80f0280 con 0x7f93080c78d0 2024-04-18T04:45:02.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.209+0000 7f923a400640 1 -- 172.21.15.120:0/3403352599 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f920c005260 con 0x7f9234150790 2024-04-18T04:45:02.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.213+0000 7f4370c00640 1 -- 172.21.15.120:0/492424054 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4360023480 con 0x7f43740cadc0 2024-04-18T04:45:02.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.213+0000 7f4370c00640 1 --2- 172.21.15.120:0/492424054 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4354066690 0x7f4354068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.213+0000 7f922b400640 1 -- 172.21.15.120:0/3403352599 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f922c0b6070 con 0x7f9234150790 2024-04-18T04:45:02.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.213+0000 7f4370c00640 1 -- 172.21.15.120:0/492424054 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4360084850 con 0x7f43740cadc0 2024-04-18T04:45:02.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.217+0000 7f4378e00640 1 --2- 172.21.15.120:0/492424054 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4354066690 0x7f4354068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:02.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.217+0000 7f922b400640 1 --2- 172.21.15.120:0/3403352599 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9214066720 0x7f9214068be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:02.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.217+0000 7f922b400640 1 -- 172.21.15.120:0/3403352599 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f922c11eff0 con 0x7f9234150790 2024-04-18T04:45:02.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.221+0000 7f9233400640 1 --2- 172.21.15.120:0/3403352599 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9214066720 0x7f9214068be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:02.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.221+0000 7f4378e00640 1 --2- 172.21.15.120:0/492424054 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4354066690 0x7f4354068b50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f43680b2000 tx=0x7f43680aa070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:02.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.221+0000 7f9233400640 1 --2- 172.21.15.120:0/3403352599 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9214066720 0x7f9214068be0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f92200011f0 tx=0x7f9220016040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:02.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.225+0000 7f4370c00640 1 -- 172.21.15.120:0/492424054 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f43600519f0 con 0x7f43740cadc0 2024-04-18T04:45:02.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.225+0000 7f922b400640 1 -- 172.21.15.120:0/3403352599 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f922c0ec070 con 0x7f9234150790 2024-04-18T04:45:02.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.517+0000 7f7a69000640 1 -- 172.21.15.120:0/151671534 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7a6420d940 con 0x7f7a6406c1e0 2024-04-18T04:45:02.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.517+0000 7f7a5a000640 1 -- 172.21.15.120:0/151671534 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7a54015020 con 0x7f7a6406c1e0 2024-04-18T04:45:02.517 INFO:teuthology.orchestra.run.smithi120.stdout:64424509450 2024-04-18T04:45:02.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.521+0000 7f7a69000640 1 -- 172.21.15.120:0/151671534 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7a440666c0 msgr2=0x7f7a44068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:02.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.521+0000 7f7a69000640 1 --2- 172.21.15.120:0/151671534 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7a440666c0 0x7f7a44068b80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7a500b5000 tx=0x7f7a5000b040 comp rx=0 tx=0).stop 2024-04-18T04:45:02.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.521+0000 7f7a69000640 1 -- 172.21.15.120:0/151671534 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a6406c1e0 msgr2=0x7f7a6420e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:02.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.521+0000 7f7a69000640 1 --2- 172.21.15.120:0/151671534 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a6406c1e0 0x7f7a6420e000 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7a5400b440 tx=0x7f7a5400b900 comp rx=0 tx=0).stop 2024-04-18T04:45:02.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.521+0000 7f7a69000640 1 -- 172.21.15.120:0/151671534 shutdown_connections 2024-04-18T04:45:02.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.521+0000 7f7a69000640 1 --2- 172.21.15.120:0/151671534 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7a440666c0 0x7f7a44068b80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.521+0000 7f7a69000640 1 --2- 172.21.15.120:0/151671534 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7a64167c10 0x7f7a640c0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.521+0000 7f7a69000640 1 --2- 172.21.15.120:0/151671534 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a640b0b20 0x7f7a6420e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.521+0000 7f7a69000640 1 --2- 172.21.15.120:0/151671534 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a6406c1e0 0x7f7a6420e000 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.521+0000 7f7a69000640 1 -- 172.21.15.120:0/151671534 >> 172.21.15.120:0/151671534 conn(0x7f7a640c78c0 msgr2=0x7f7a640bfe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:02.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.525+0000 7f7a69000640 1 -- 172.21.15.120:0/151671534 shutdown_connections 2024-04-18T04:45:02.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.525+0000 7f7a69000640 1 -- 172.21.15.120:0/151671534 wait complete. 2024-04-18T04:45:02.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.525+0000 7f8e4e400640 1 -- 172.21.15.120:0/920496370 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f8e48154d00 con 0x7f8e480cb570 2024-04-18T04:45:02.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.529+0000 7f8e3f400640 1 -- 172.21.15.120:0/920496370 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8e400b5090 con 0x7f8e480cb570 2024-04-18T04:45:02.530 INFO:teuthology.orchestra.run.smithi120.stdout:60129542155 2024-04-18T04:45:02.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.533+0000 7f0cd9600640 1 -- 172.21.15.120:0/4062679014 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0ccc008910 con 0x7f0ccc04b6b0 2024-04-18T04:45:02.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.533+0000 7f0cc7e00640 1 -- 172.21.15.120:0/4062679014 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0ccc008910 con 0x7f0ccc04b6b0 2024-04-18T04:45:02.534 INFO:teuthology.orchestra.run.smithi120.stdout:64424509451 2024-04-18T04:45:02.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.537+0000 7f8e3cc00640 1 -- 172.21.15.120:0/920496370 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8e24066690 msgr2=0x7f8e24068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:02.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.537+0000 7f8e3cc00640 1 --2- 172.21.15.120:0/920496370 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8e24066690 0x7f8e24068b50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8e38009b60 tx=0x7f8e38009190 comp rx=0 tx=0).stop 2024-04-18T04:45:02.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.537+0000 7f8e3cc00640 1 -- 172.21.15.120:0/920496370 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e480cb570 msgr2=0x7f8e481f6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:02.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.537+0000 7f8e3cc00640 1 --2- 172.21.15.120:0/920496370 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e480cb570 0x7f8e481f6b70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8e400af000 tx=0x7f8e4001be20 comp rx=0 tx=0).stop 2024-04-18T04:45:02.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.537+0000 7f8e3cc00640 1 -- 172.21.15.120:0/920496370 shutdown_connections 2024-04-18T04:45:02.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.537+0000 7f8e3cc00640 1 --2- 172.21.15.120:0/920496370 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8e24066690 0x7f8e24068b50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.537+0000 7f8e3cc00640 1 --2- 172.21.15.120:0/920496370 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e480cb570 0x7f8e481f6b70 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.537+0000 7f8e3cc00640 1 --2- 172.21.15.120:0/920496370 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e480cadc0 0x7f8e481513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.537+0000 7f8e3cc00640 1 --2- 172.21.15.120:0/920496370 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e480c66d0 0x7f8e48150ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.537+0000 7f8e3cc00640 1 -- 172.21.15.120:0/920496370 >> 172.21.15.120:0/920496370 conn(0x7f8e4806b780 msgr2=0x7f8e48070ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:02.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.537+0000 7f8e3cc00640 1 -- 172.21.15.120:0/920496370 shutdown_connections 2024-04-18T04:45:02.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.537+0000 7f930f800640 1 -- 172.21.15.120:0/215744434 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f930806dbe0 con 0x7f93080c78d0 2024-04-18T04:45:02.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.537+0000 7f0cd9600640 1 -- 172.21.15.120:0/4062679014 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0cb40666e0 msgr2=0x7f0cb4068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:02.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.537+0000 7f0cd9600640 1 --2- 172.21.15.120:0/4062679014 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0cb40666e0 0x7f0cb4068ba0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0cc800b9d0 tx=0x7f0cc8008040 comp rx=0 tx=0).stop 2024-04-18T04:45:02.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.537+0000 7f0cd9600640 1 -- 172.21.15.120:0/4062679014 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0ccc04b6b0 msgr2=0x7f0ccc0c9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:02.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.537+0000 7f0cd9600640 1 --2- 172.21.15.120:0/4062679014 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0ccc04b6b0 0x7f0ccc0c9fd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0009fa0 tx=0x7f0cc000b8a0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.537+0000 7f8e3cc00640 1 -- 172.21.15.120:0/920496370 wait complete. 2024-04-18T04:45:02.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.537+0000 7f0cd9600640 1 -- 172.21.15.120:0/4062679014 shutdown_connections 2024-04-18T04:45:02.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.537+0000 7f0cd9600640 1 --2- 172.21.15.120:0/4062679014 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0cb40666e0 0x7f0cb4068ba0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.537+0000 7f0cd9600640 1 --2- 172.21.15.120:0/4062679014 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0ccc04b6b0 0x7f0ccc0c9fd0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.537+0000 7f0cd9600640 1 --2- 172.21.15.120:0/4062679014 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ccc04b2d0 0x7f0ccc0c9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.537+0000 7f0cd9600640 1 --2- 172.21.15.120:0/4062679014 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ccc046d50 0x7f0ccc0d7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.537+0000 7f0cd9600640 1 -- 172.21.15.120:0/4062679014 >> 172.21.15.120:0/4062679014 conn(0x7f0ccc050160 msgr2=0x7f0ccc0cf760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:02.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.537+0000 7f0cd9600640 1 -- 172.21.15.120:0/4062679014 shutdown_connections 2024-04-18T04:45:02.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.537+0000 7f0cd9600640 1 -- 172.21.15.120:0/4062679014 wait complete. 2024-04-18T04:45:02.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.537+0000 7f9304c00640 1 -- 172.21.15.120:0/215744434 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f92f80b4090 con 0x7f93080c78d0 2024-04-18T04:45:02.540 INFO:teuthology.orchestra.run.smithi120.stdout:55834574858 2024-04-18T04:45:02.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.541+0000 7f9723e00640 1 -- 172.21.15.120:0/3238219517 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f971c072a70 con 0x7f971c0c9890 2024-04-18T04:45:02.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.541+0000 7f9719600640 1 -- 172.21.15.120:0/3238219517 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9714055240 con 0x7f971c0c9890 2024-04-18T04:45:02.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.541+0000 7f930f800640 1 -- 172.21.15.120:0/215744434 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f92e4066710 msgr2=0x7f92e4068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:02.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.541+0000 7f930f800640 1 --2- 172.21.15.120:0/215744434 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f92e4066710 0x7f92e4068bd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f92f00011f0 tx=0x7f92f0007d40 comp rx=0 tx=0).stop 2024-04-18T04:45:02.542 INFO:teuthology.orchestra.run.smithi120.stdout:64424509449 2024-04-18T04:45:02.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.541+0000 7f930f800640 1 -- 172.21.15.120:0/215744434 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f93080c78d0 msgr2=0x7f930806e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:02.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.541+0000 7f930f800640 1 --2- 172.21.15.120:0/215744434 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f93080c78d0 0x7f930806e4e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f92f80af000 tx=0x7f92f801bed0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.541+0000 7ff48d600640 1 -- 172.21.15.120:0/115017674 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7ff48806c010 con 0x7ff488154650 2024-04-18T04:45:02.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.545+0000 7ff47fe00640 1 -- 172.21.15.120:0/115017674 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff4780ef760 con 0x7ff488154650 2024-04-18T04:45:02.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.545+0000 7f930f800640 1 -- 172.21.15.120:0/215744434 shutdown_connections 2024-04-18T04:45:02.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.545+0000 7f930f800640 1 --2- 172.21.15.120:0/215744434 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f92e4066710 0x7f92e4068bd0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.545+0000 7f930f800640 1 --2- 172.21.15.120:0/215744434 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93080c95a0 0x7f930814a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.545+0000 7f930f800640 1 --2- 172.21.15.120:0/215744434 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f93080c78d0 0x7f930806e4e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.545+0000 7f930f800640 1 --2- 172.21.15.120:0/215744434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93080c74f0 0x7f93081494a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.545+0000 7f930f800640 1 -- 172.21.15.120:0/215744434 >> 172.21.15.120:0/215744434 conn(0x7f93080c89d0 msgr2=0x7f93080ca480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:02.545 INFO:teuthology.orchestra.run.smithi120.stdout:60129542155 2024-04-18T04:45:02.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.545+0000 7f930f800640 1 -- 172.21.15.120:0/215744434 shutdown_connections 2024-04-18T04:45:02.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.545+0000 7f930f800640 1 -- 172.21.15.120:0/215744434 wait complete. 2024-04-18T04:45:02.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.545+0000 7f9723e00640 1 -- 172.21.15.120:0/3238219517 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f96fc066710 msgr2=0x7f96fc068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:02.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.545+0000 7f9723e00640 1 --2- 172.21.15.120:0/3238219517 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f96fc066710 0x7f96fc068bd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9708006fd0 tx=0x7f9708006b40 comp rx=0 tx=0).stop 2024-04-18T04:45:02.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.545+0000 7f9723e00640 1 -- 172.21.15.120:0/3238219517 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f971c0c9890 msgr2=0x7f971c0c6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:02.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.545+0000 7f9723e00640 1 --2- 172.21.15.120:0/3238219517 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f971c0c9890 0x7f971c0c6210 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f971400b410 tx=0x7f971400b8d0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.545+0000 7f9723e00640 1 -- 172.21.15.120:0/3238219517 shutdown_connections 2024-04-18T04:45:02.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.545+0000 7f9723e00640 1 --2- 172.21.15.120:0/3238219517 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f96fc066710 0x7f96fc068bd0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.545+0000 7f9723e00640 1 --2- 172.21.15.120:0/3238219517 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f971c157cb0 0x7f971c0c6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.545+0000 7f9723e00640 1 --2- 172.21.15.120:0/3238219517 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f971c0cf8d0 0x7f971c15ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.545+0000 7f9723e00640 1 --2- 172.21.15.120:0/3238219517 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f971c0c9890 0x7f971c0c6210 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.545+0000 7f9723e00640 1 -- 172.21.15.120:0/3238219517 >> 172.21.15.120:0/3238219517 conn(0x7f971c065fc0 msgr2=0x7f971c14ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:02.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.545+0000 7f9723e00640 1 -- 172.21.15.120:0/3238219517 shutdown_connections 2024-04-18T04:45:02.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.549+0000 7f9723e00640 1 -- 172.21.15.120:0/3238219517 wait complete. 2024-04-18T04:45:02.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.549+0000 7ff48d600640 1 -- 172.21.15.120:0/115017674 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff468066790 msgr2=0x7ff468068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:02.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.549+0000 7ff48d600640 1 --2- 172.21.15.120:0/115017674 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff468066790 0x7ff468068c50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff474006fd0 tx=0x7ff474008040 comp rx=0 tx=0).stop 2024-04-18T04:45:02.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.549+0000 7ff48d600640 1 -- 172.21.15.120:0/115017674 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff488154650 msgr2=0x7ff4881f5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:02.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.549+0000 7ff48d600640 1 --2- 172.21.15.120:0/115017674 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff488154650 0x7ff4881f5b70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff47801cdf0 tx=0x7ff47801ad90 comp rx=0 tx=0).stop 2024-04-18T04:45:02.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.549+0000 7ff48d600640 1 -- 172.21.15.120:0/115017674 shutdown_connections 2024-04-18T04:45:02.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.549+0000 7ff48d600640 1 --2- 172.21.15.120:0/115017674 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff468066790 0x7ff468068c50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.549+0000 7ff48d600640 1 --2- 172.21.15.120:0/115017674 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff48815f8b0 0x7ff48814e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.549+0000 7ff48d600640 1 --2- 172.21.15.120:0/115017674 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff488154650 0x7ff4881f5b70 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.549+0000 7ff48d600640 1 --2- 172.21.15.120:0/115017674 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff48806c570 0x7ff4881f5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.549+0000 7ff48d600640 1 -- 172.21.15.120:0/115017674 >> 172.21.15.120:0/115017674 conn(0x7ff48806d000 msgr2=0x7ff488152600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:02.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.549+0000 7ff48d600640 1 -- 172.21.15.120:0/115017674 shutdown_connections 2024-04-18T04:45:02.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.549+0000 7ff48d600640 1 -- 172.21.15.120:0/115017674 wait complete. 2024-04-18T04:45:02.556 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.1 2024-04-18T04:45:02.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.561+0000 7f437b800640 1 -- 172.21.15.120:0/492424054 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f43500050d0 con 0x7f43740cadc0 2024-04-18T04:45:02.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.561+0000 7f4370c00640 1 -- 172.21.15.120:0/492424054 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4360055010 con 0x7f43740cadc0 2024-04-18T04:45:02.562 INFO:teuthology.orchestra.run.smithi120.stdout:60129542155 2024-04-18T04:45:02.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.565+0000 7f437b800640 1 -- 172.21.15.120:0/492424054 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4354066690 msgr2=0x7f4354068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:02.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.565+0000 7f437b800640 1 --2- 172.21.15.120:0/492424054 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4354066690 0x7f4354068b50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f43680b2000 tx=0x7f43680aa070 comp rx=0 tx=0).stop 2024-04-18T04:45:02.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.565+0000 7f437b800640 1 -- 172.21.15.120:0/492424054 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f43740cadc0 msgr2=0x7f4374140480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:02.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.565+0000 7f437b800640 1 --2- 172.21.15.120:0/492424054 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f43740cadc0 0x7f4374140480 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f436000b5b0 tx=0x7f436000ba70 comp rx=0 tx=0).stop 2024-04-18T04:45:02.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.565+0000 7f437b800640 1 -- 172.21.15.120:0/492424054 shutdown_connections 2024-04-18T04:45:02.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.565+0000 7f437b800640 1 --2- 172.21.15.120:0/492424054 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4354066690 0x7f4354068b50 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.565+0000 7f437b800640 1 --2- 172.21.15.120:0/492424054 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43740cb570 0x7f4374132330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.565+0000 7f437b800640 1 --2- 172.21.15.120:0/492424054 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f43740cadc0 0x7f4374140480 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.565+0000 7f437b800640 1 --2- 172.21.15.120:0/492424054 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f43740c66d0 0x7f4374142000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.565+0000 7f437b800640 1 -- 172.21.15.120:0/492424054 >> 172.21.15.120:0/492424054 conn(0x7f437406b780 msgr2=0x7f43740c8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:02.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.565+0000 7f437b800640 1 -- 172.21.15.120:0/492424054 shutdown_connections 2024-04-18T04:45:02.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.565+0000 7f437b800640 1 -- 172.21.15.120:0/492424054 wait complete. 2024-04-18T04:45:02.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.569+0000 7f923a400640 1 -- 172.21.15.120:0/3403352599 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f920c0057e0 con 0x7f9234150790 2024-04-18T04:45:02.571 INFO:teuthology.orchestra.run.smithi120.stdout:60129542153 2024-04-18T04:45:02.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.569+0000 7f922b400640 1 -- 172.21.15.120:0/3403352599 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f922c0bc090 con 0x7f9234150790 2024-04-18T04:45:02.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.577+0000 7f923a400640 1 -- 172.21.15.120:0/3403352599 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9214066720 msgr2=0x7f9214068be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:02.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.577+0000 7f923a400640 1 --2- 172.21.15.120:0/3403352599 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9214066720 0x7f9214068be0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f92200011f0 tx=0x7f9220016040 comp rx=0 tx=0).stop 2024-04-18T04:45:02.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.577+0000 7f923a400640 1 -- 172.21.15.120:0/3403352599 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9234150790 msgr2=0x7f92341ef420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:02.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.577+0000 7f923a400640 1 --2- 172.21.15.120:0/3403352599 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9234150790 0x7f92341ef420 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f922c0b2040 tx=0x7f922c01b890 comp rx=0 tx=0).stop 2024-04-18T04:45:02.576 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542155 for osd.4 2024-04-18T04:45:02.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.577+0000 7f923a400640 1 -- 172.21.15.120:0/3403352599 shutdown_connections 2024-04-18T04:45:02.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.577+0000 7f923a400640 1 --2- 172.21.15.120:0/3403352599 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9214066720 0x7f9214068be0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.577+0000 7f923a400640 1 --2- 172.21.15.120:0/3403352599 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9234150790 0x7f92341ef420 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.577+0000 7f923a400640 1 --2- 172.21.15.120:0/3403352599 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92340cc230 0x7f92341eeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.577+0000 7f923a400640 1 --2- 172.21.15.120:0/3403352599 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9234070900 0x7f923414aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:02.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.577+0000 7f923a400640 1 -- 172.21.15.120:0/3403352599 >> 172.21.15.120:0/3403352599 conn(0x7f923406b1a0 msgr2=0x7f923414bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:02.578 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509451 for osd.3 2024-04-18T04:45:02.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.577+0000 7f923a400640 1 -- 172.21.15.120:0/3403352599 shutdown_connections 2024-04-18T04:45:02.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:02.577+0000 7f923a400640 1 -- 172.21.15.120:0/3403352599 wait complete. 2024-04-18T04:45:02.584 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.0 2024-04-18T04:45:02.589 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.2 2024-04-18T04:45:02.590 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542155 for osd.7 2024-04-18T04:45:02.599 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542155 for osd.5 2024-04-18T04:45:02.601 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.6 2024-04-18T04:45:03.558 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-18T04:45:03.577 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-18T04:45:03.579 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-18T04:45:03.585 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-18T04:45:03.590 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-18T04:45:03.591 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-18T04:45:03.601 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-18T04:45:03.601 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-18T04:45:03.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.777+0000 7fbb5f800640 1 Processor -- start 2024-04-18T04:45:03.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.777+0000 7fbb5f800640 1 -- start start 2024-04-18T04:45:03.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.781+0000 7fbb5f800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb500d4fd0 0x7fbb5004c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.781+0000 7fbb5f800640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fbb500db410 0x7fbb500e5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.781+0000 7fbb5f800640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb5004c7f0 con 0x7fbb50034770 2024-04-18T04:45:03.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.781+0000 7fbb5f800640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb5004bf20 con 0x7fbb500db410 2024-04-18T04:45:03.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.781+0000 7fbb5f800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5004b960 con 0x7fbb500d4fd0 2024-04-18T04:45:03.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.781+0000 7fbb5ce00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb500d4fd0 0x7fbb5004c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.781+0000 7fbb5ce00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb500d4fd0 0x7fbb5004c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:42142/0 (socket says 172.21.15.120:42142) 2024-04-18T04:45:03.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.785+0000 7fbb5ce00640 1 -- 172.21.15.120:0/1895031831 learned_addr learned my addr 172.21.15.120:0/1895031831 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:03.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.785+0000 7fbb5d800640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fbb500db410 0x7fbb500e5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.785+0000 7fbb5ce00640 1 -- 172.21.15.120:0/1895031831 >> v2:172.21.15.120:3300/0 conn(0x7fbb500db410 msgr2=0x7fbb500e5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:03.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.785+0000 7fbb5ce00640 1 --2- 172.21.15.120:0/1895031831 >> v2:172.21.15.120:3300/0 conn(0x7fbb500db410 0x7fbb500e5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.785+0000 7fbb5ce00640 1 -- 172.21.15.120:0/1895031831 >> v1:172.21.15.120:6789/0 conn(0x7fbb50034770 legacy=0x7fbb500dad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:03.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.785+0000 7fbb5ce00640 1 -- 172.21.15.120:0/1895031831 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb5004bc40 con 0x7fbb500d4fd0 2024-04-18T04:45:03.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.789+0000 7fbb5ce00640 1 --2- 172.21.15.120:0/1895031831 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb500d4fd0 0x7fbb5004c2b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c008870 tx=0x7fbb4c021220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adf46e87dd3a4af0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:03.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.789+0000 7fbb57400640 1 -- 172.21.15.120:0/1895031831 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c0b3410 con 0x7fbb500d4fd0 2024-04-18T04:45:03.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.789+0000 7fbb57400640 1 -- 172.21.15.120:0/1895031831 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb4c0ad030 con 0x7fbb500d4fd0 2024-04-18T04:45:03.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.789+0000 7fbb57400640 1 -- 172.21.15.120:0/1895031831 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c0b3790 con 0x7fbb500d4fd0 2024-04-18T04:45:03.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.793+0000 7fbb5f800640 1 -- 172.21.15.120:0/1895031831 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb500d4fd0 msgr2=0x7fbb5004c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:03.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.793+0000 7fbb5f800640 1 --2- 172.21.15.120:0/1895031831 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb500d4fd0 0x7fbb5004c2b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c008870 tx=0x7fbb4c021220 comp rx=0 tx=0).stop 2024-04-18T04:45:03.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.793+0000 7fbb5f800640 1 -- 172.21.15.120:0/1895031831 shutdown_connections 2024-04-18T04:45:03.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.793+0000 7fbb5f800640 1 --2- 172.21.15.120:0/1895031831 >> v2:172.21.15.120:3300/0 conn(0x7fbb500db410 0x7fbb500e5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.793+0000 7fbb5f800640 1 --2- 172.21.15.120:0/1895031831 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb500d4fd0 0x7fbb5004c2b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.793+0000 7fbb5f800640 1 -- 172.21.15.120:0/1895031831 >> 172.21.15.120:0/1895031831 conn(0x7fbb50050160 msgr2=0x7fbb50050570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:03.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.797+0000 7fbb5f800640 1 -- 172.21.15.120:0/1895031831 shutdown_connections 2024-04-18T04:45:03.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.797+0000 7fbb5f800640 1 -- 172.21.15.120:0/1895031831 wait complete. 2024-04-18T04:45:03.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.797+0000 7fbb5f800640 1 Processor -- start 2024-04-18T04:45:03.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.797+0000 7fbb5f800640 1 -- start start 2024-04-18T04:45:03.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.801+0000 7fbb5f800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb50034770 0x7fbb500d7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.801+0000 7fbb5f800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb500d4fd0 0x7fbb500d1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.801+0000 7fbb5f800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbb500db410 0x7fbb5017a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.801+0000 7fbb5d800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbb500db410 0x7fbb5017a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.801+0000 7fbb57e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb500d4fd0 0x7fbb500d1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.801+0000 7fbb5f800640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb500d84b0 con 0x7fbb500db410 2024-04-18T04:45:03.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.801+0000 7fbb5f800640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb500d8690 con 0x7fbb500d4fd0 2024-04-18T04:45:03.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.801+0000 7fbb5ce00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb50034770 0x7fbb500d7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.801+0000 7fbb5f800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb500dcd10 con 0x7fbb50034770 2024-04-18T04:45:03.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.801+0000 7fbb5ce00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb50034770 0x7fbb500d7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:42144/0 (socket says 172.21.15.120:42144) 2024-04-18T04:45:03.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.801+0000 7fbb5ce00640 1 -- 172.21.15.120:0/4173337053 learned_addr learned my addr 172.21.15.120:0/4173337053 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:03.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.801+0000 7fbb5d800640 1 -- 172.21.15.120:0/4173337053 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb50034770 msgr2=0x7fbb500d7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:03.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.801+0000 7fbb5d800640 1 --2- 172.21.15.120:0/4173337053 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb50034770 0x7fbb500d7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.801+0000 7fbb5d800640 1 -- 172.21.15.120:0/4173337053 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb500d4fd0 msgr2=0x7fbb500d1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:03.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.801+0000 7fbb5d800640 1 --2- 172.21.15.120:0/4173337053 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb500d4fd0 0x7fbb500d1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.801+0000 7fbb5d800640 1 -- 172.21.15.120:0/4173337053 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb4c008550 con 0x7fbb500db410 2024-04-18T04:45:03.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.801+0000 7fbb5d800640 1 --2- 172.21.15.120:0/4173337053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbb500db410 0x7fbb5017a2e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbb4400d4b0 tx=0x7fbb4400d970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:03.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.801+0000 7fbb54c00640 1 -- 172.21.15.120:0/4173337053 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb44018070 con 0x7fbb500db410 2024-04-18T04:45:03.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.801+0000 7fbb54c00640 1 -- 172.21.15.120:0/4173337053 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb44004020 con 0x7fbb500db410 2024-04-18T04:45:03.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.805+0000 7fbb54c00640 1 -- 172.21.15.120:0/4173337053 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb440041d0 con 0x7fbb500db410 2024-04-18T04:45:03.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.805+0000 7fbb5f800640 1 -- 172.21.15.120:0/4173337053 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb500defa0 con 0x7fbb500db410 2024-04-18T04:45:03.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.805+0000 7fbb5f800640 1 -- 172.21.15.120:0/4173337053 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb500decc0 con 0x7fbb500db410 2024-04-18T04:45:03.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.809+0000 7fbb5f800640 1 -- 172.21.15.120:0/4173337053 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb500dce80 con 0x7fbb500db410 2024-04-18T04:45:03.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.809+0000 7fbb54c00640 1 -- 172.21.15.120:0/4173337053 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbb44004330 con 0x7fbb500db410 2024-04-18T04:45:03.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.809+0000 7fbb54c00640 1 --2- 172.21.15.120:0/4173337053 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fbb38066710 0x7fbb38068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.809+0000 7fbb54c00640 1 -- 172.21.15.120:0/4173337053 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbb44083fd0 con 0x7fbb500db410 2024-04-18T04:45:03.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.813+0000 7fbb5ce00640 1 --2- 172.21.15.120:0/4173337053 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fbb38066710 0x7fbb38068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.813+0000 7fbb5ce00640 1 --2- 172.21.15.120:0/4173337053 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fbb38066710 0x7fbb38068bd0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c01f8d0 tx=0x7fbb4c0ac000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:03.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.817+0000 7fbb54c00640 1 -- 172.21.15.120:0/4173337053 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fbb44051130 con 0x7fbb500db410 2024-04-18T04:45:03.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.845+0000 7fedf9a00640 1 Processor -- start 2024-04-18T04:45:03.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.845+0000 7fedf9a00640 1 -- start start 2024-04-18T04:45:03.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.849+0000 7fedf9a00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fedf406c460 0x7fedf415e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.849+0000 7fedf9a00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fedf406c840 0x7fedf406b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.849+0000 7fedf2a00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fedf406c460 0x7fedf415e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.849+0000 7fedf2a00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fedf406c460 0x7fedf415e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:33960/0 (socket says 172.21.15.120:33960) 2024-04-18T04:45:03.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.849+0000 7fedf2a00640 1 -- 172.21.15.120:0/4065515859 learned_addr learned my addr 172.21.15.120:0/4065515859 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:03.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.849+0000 7fedf9a00640 1 -- 172.21.15.120:0/4065515859 --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedf40c6570 con 0x7fedf40c6a00 2024-04-18T04:45:03.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.849+0000 7fedf3400640 1 --2- 172.21.15.120:0/4065515859 >> v2:172.21.15.132:3300/0 conn(0x7fedf406c840 0x7fedf406b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.849+0000 7fedf9a00640 1 -- 172.21.15.120:0/4065515859 --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedf415e910 con 0x7fedf406c460 2024-04-18T04:45:03.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.849+0000 7fedf9a00640 1 -- 172.21.15.120:0/4065515859 --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedf40c5960 con 0x7fedf406c840 2024-04-18T04:45:03.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.849+0000 7fedf1600640 1 -- 172.21.15.120:0/4065515859 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2314828743 0 0) 0x7fedf40c6570 con 0x7fedf40c6a00 2024-04-18T04:45:03.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.849+0000 7fedf1600640 1 -- 172.21.15.120:0/4065515859 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedd8003530 con 0x7fedf40c6a00 2024-04-18T04:45:03.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.853+0000 7fedf3400640 1 -- 172.21.15.120:0/4065515859 >> v2:172.21.15.120:3300/0 conn(0x7fedf406c460 msgr2=0x7fedf415e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:03.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.853+0000 7fedf1600640 1 -- 172.21.15.120:0/4065515859 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4068806078 0 0) 0x7fedd8003530 con 0x7fedf40c6a00 2024-04-18T04:45:03.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.853+0000 7fedf3400640 1 --2- 172.21.15.120:0/4065515859 >> v2:172.21.15.120:3300/0 conn(0x7fedf406c460 0x7fedf415e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.853+0000 7fedf3400640 1 -- 172.21.15.120:0/4065515859 >> v1:172.21.15.120:6789/0 conn(0x7fedf40c6a00 legacy=0x7fedf40c0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:03.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.853+0000 7fedf3400640 1 -- 172.21.15.120:0/4065515859 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf40c5c40 con 0x7fedf406c840 2024-04-18T04:45:03.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.857+0000 7fedf3400640 1 --2- 172.21.15.120:0/4065515859 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fedf406c840 0x7fedf406b3e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fedf406f780 tx=0x7fedec01f060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0cc220e7071b42c server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:03.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.857+0000 7fedf1600640 1 -- 172.21.15.120:0/4065515859 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc001680 con 0x7fedf406c840 2024-04-18T04:45:03.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.857+0000 7fedf1600640 1 -- 172.21.15.120:0/4065515859 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedec0a8bd0 con 0x7fedf406c840 2024-04-18T04:45:03.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.857+0000 7f9bfdc00640 1 Processor -- start 2024-04-18T04:45:03.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.857+0000 7f9bfdc00640 1 -- start start 2024-04-18T04:45:03.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.857+0000 7f8b4e800640 1 Processor -- start 2024-04-18T04:45:03.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.857+0000 7fedf1600640 1 -- 172.21.15.120:0/4065515859 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc001680 con 0x7fedf406c840 2024-04-18T04:45:03.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.857+0000 7fedf9a00640 1 -- 172.21.15.120:0/4065515859 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fedf406c840 msgr2=0x7fedf406b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:03.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.857+0000 7fedf9a00640 1 --2- 172.21.15.120:0/4065515859 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fedf406c840 0x7fedf406b3e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fedf406f780 tx=0x7fedec01f060 comp rx=0 tx=0).stop 2024-04-18T04:45:03.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.857+0000 7fedf9a00640 1 -- 172.21.15.120:0/4065515859 shutdown_connections 2024-04-18T04:45:03.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.857+0000 7fedf9a00640 1 --2- 172.21.15.120:0/4065515859 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fedf406c840 0x7fedf406b3e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.857+0000 7fedf9a00640 1 --2- 172.21.15.120:0/4065515859 >> v2:172.21.15.120:3300/0 conn(0x7fedf406c460 0x7fedf415e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.857+0000 7fedf9a00640 1 -- 172.21.15.120:0/4065515859 >> 172.21.15.120:0/4065515859 conn(0x7fedf40c78c0 msgr2=0x7fedf40c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:03.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.857+0000 7f8b4e800640 1 -- start start 2024-04-18T04:45:03.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.857+0000 7fedf9a00640 1 -- 172.21.15.120:0/4065515859 shutdown_connections 2024-04-18T04:45:03.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.857+0000 7fedf9a00640 1 -- 172.21.15.120:0/4065515859 wait complete. 2024-04-18T04:45:03.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.861+0000 7f9bfdc00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9bf00e22c0 0x7f9bf0045100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.861+0000 7f9bfdc00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9bf00457a0 0x7f9bf00e26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.861+0000 7f9bfdc00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bf0045cf0 con 0x7f9bf0046d00 2024-04-18T04:45:03.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.861+0000 7f9bfdc00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bf00e3090 con 0x7f9bf00457a0 2024-04-18T04:45:03.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.861+0000 7f9bfdc00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf0050da0 con 0x7f9bf00e22c0 2024-04-18T04:45:03.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.861+0000 7f8b4e800640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8b480cb570 0x7f8b4814fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.861+0000 7f8b4e800640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b480c0330 con 0x7f8b480cadc0 2024-04-18T04:45:03.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.861+0000 7f8b4e800640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b480c5a60 con 0x7f8b480c66d0 2024-04-18T04:45:03.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.861+0000 7f8b4e800640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b480bfe70 con 0x7f8b480cb570 2024-04-18T04:45:03.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.861+0000 7fedf9a00640 1 Processor -- start 2024-04-18T04:45:03.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.861+0000 7f9bf7400640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f9bf0046d00 0x7f9bf0005e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:41742/0 (socket says 172.21.15.120:41742) 2024-04-18T04:45:03.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.861+0000 7f9bf7400640 1 -- 172.21.15.120:0/3878979724 learned_addr learned my addr 172.21.15.120:0/3878979724 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:45:03.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.861+0000 7f9bfd200640 1 --2- 172.21.15.120:0/3878979724 >> v2:172.21.15.132:3300/0 conn(0x7f9bf00457a0 0x7f9bf00e26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.861+0000 7f1c83000640 1 Processor -- start 2024-04-18T04:45:03.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.861+0000 7f1c83000640 1 -- start start 2024-04-18T04:45:03.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.861+0000 7fedf9a00640 1 -- start start 2024-04-18T04:45:03.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.861+0000 7f9bf7e00640 1 --2- 172.21.15.120:0/3878979724 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9bf00e22c0 0x7f9bf0045100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.861+0000 7f7458a00640 1 Processor -- start 2024-04-18T04:45:03.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.861+0000 7f7458a00640 1 -- start start 2024-04-18T04:45:03.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.861+0000 7f9bf6a00640 1 -- 172.21.15.120:0/3878979724 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3723930150 0 0) 0x7f9bf0045cf0 con 0x7f9bf0046d00 2024-04-18T04:45:03.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.861+0000 7f9bf6a00640 1 -- 172.21.15.120:0/3878979724 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9be0003530 con 0x7f9bf0046d00 2024-04-18T04:45:03.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.861+0000 7f8b47e00640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f8b480c66d0 0x7f8b480c7850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:41750/0 (socket says 172.21.15.120:41750) 2024-04-18T04:45:03.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.861+0000 7f8b47e00640 1 -- 172.21.15.120:0/1009609589 learned_addr learned my addr 172.21.15.120:0/1009609589 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:45:03.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.861+0000 7fedf9a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fedf406c460 0x7fedf41f6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.861+0000 7fedf9a00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fedf406c840 0x7fedf406da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.861+0000 7fedf9a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fedf4154790 0x7fedf41f3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.861+0000 7fedf9a00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf415a860 con 0x7fedf406c460 2024-04-18T04:45:03.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.861+0000 7fedf9a00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf4159d90 con 0x7fedf406c840 2024-04-18T04:45:03.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.861+0000 7f9bfd200640 1 -- 172.21.15.120:0/3878979724 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9bf00e22c0 msgr2=0x7f9bf0045100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:03.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.861+0000 7f9bfd200640 1 --2- 172.21.15.120:0/3878979724 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9bf00e22c0 0x7f9bf0045100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.861+0000 7f9bfd200640 1 -- 172.21.15.120:0/3878979724 >> v1:172.21.15.132:6789/0 conn(0x7f9bf0046d00 legacy=0x7f9bf0005e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:03.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.861+0000 7f9bfd200640 1 -- 172.21.15.120:0/3878979724 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf0045f40 con 0x7f9bf00457a0 2024-04-18T04:45:03.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.861+0000 7f8b47400640 1 --2- 172.21.15.120:0/1009609589 >> v2:172.21.15.120:3300/0 conn(0x7f8b480cb570 0x7f8b4814fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.861+0000 7fedf9a00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf41f6da0 con 0x7fedf4154790 2024-04-18T04:45:03.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7f1c83000640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1c7c153900 0x7f1c7c0c3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7fedf2000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fedf406c840 0x7fedf406da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7fedf2000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fedf406c840 0x7fedf406da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:60464/0 (socket says 172.21.15.120:60464) 2024-04-18T04:45:03.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7fedf2000640 1 -- 172.21.15.120:0/466119346 learned_addr learned my addr 172.21.15.120:0/466119346 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:03.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7fedf3400640 1 --2- 172.21.15.120:0/466119346 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fedf4154790 0x7fedf41f3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7f1c83000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c7c0caea0 0x7f1c7c0cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7f1c83000640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c7c153ce0 con 0x7f1c7c0c9d10 2024-04-18T04:45:03.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7f1c83000640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c7c15a170 con 0x7f1c7c153900 2024-04-18T04:45:03.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7f1c83000640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c15a450 con 0x7f1c7c0caea0 2024-04-18T04:45:03.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7f1c7b400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c7c0caea0 0x7f1c7c0cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7f1c7be00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1c7c153900 0x7f1c7c0c3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7f1c7be00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1c7c153900 0x7f1c7c0c3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:33990/0 (socket says 172.21.15.120:33990) 2024-04-18T04:45:03.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7f1c7be00640 1 -- 172.21.15.120:0/1211709292 learned_addr learned my addr 172.21.15.120:0/1211709292 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:03.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7f1c7b400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c7c0caea0 0x7f1c7c0cc3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:42172/0 (socket says 172.21.15.120:42172) 2024-04-18T04:45:03.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7f8b46000640 1 -- 172.21.15.120:0/1009609589 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 359145569 0 0) 0x7f8b480c5a60 con 0x7f8b480c66d0 2024-04-18T04:45:03.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7f7458a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74541516b0 0x7f74540b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7f7458a00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f74540c5c20 0x7f74540c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7fedf2a00640 1 --2- 172.21.15.120:0/466119346 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fedf406c460 0x7fedf41f6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7fedf2000640 1 -- 172.21.15.120:0/466119346 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fedf4154790 msgr2=0x7fedf41f3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:03.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7fedf2000640 1 --2- 172.21.15.120:0/466119346 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fedf4154790 0x7fedf41f3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7fedf2000640 1 -- 172.21.15.120:0/466119346 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fedf406c460 msgr2=0x7fedf41f6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:03.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7fedf2000640 1 --2- 172.21.15.120:0/466119346 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fedf406c460 0x7fedf41f6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7fedf2000640 1 -- 172.21.15.120:0/466119346 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedec009a70 con 0x7fedf406c840 2024-04-18T04:45:03.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7fedf3400640 1 --2- 172.21.15.120:0/466119346 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fedf4154790 0x7fedf41f3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:45:03.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7fedf2a00640 1 --2- 172.21.15.120:0/466119346 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fedf406c460 0x7fedf41f6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:45:03.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7f8b46000640 1 -- 172.21.15.120:0/1009609589 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b2c003530 con 0x7f8b480c66d0 2024-04-18T04:45:03.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7f8b46000640 1 -- 172.21.15.120:0/1009609589 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2403073648 0 0) 0x7f8b480c0330 con 0x7f8b480cadc0 2024-04-18T04:45:03.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7f8b46000640 1 -- 172.21.15.120:0/1009609589 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b480c5a60 con 0x7f8b480cadc0 2024-04-18T04:45:03.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7f7458a00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74540ae000 con 0x7f74540c7580 2024-04-18T04:45:03.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7f7458a00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74540c86f0 con 0x7f74540c5c20 2024-04-18T04:45:03.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7f7458a00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74540ada80 con 0x7f74541516b0 2024-04-18T04:45:03.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7f1c7be00640 1 -- 172.21.15.120:0/1211709292 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c7c0caea0 msgr2=0x7f1c7c0cc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:03.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7f1c7be00640 1 --2- 172.21.15.120:0/1211709292 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c7c0caea0 0x7f1c7c0cc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7f1c7be00640 1 -- 172.21.15.120:0/1211709292 >> v1:172.21.15.132:6789/0 conn(0x7f1c7c0c9d10 legacy=0x7f1c7c159590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:03.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7f1c7be00640 1 -- 172.21.15.120:0/1211709292 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c7c0cb600 con 0x7f1c7c153900 2024-04-18T04:45:03.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7f1c7b400640 1 --2- 172.21.15.120:0/1211709292 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c7c0caea0 0x7f1c7c0cc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:45:03.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7f7453200640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f74540c5c20 0x7f74540c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7f7453200640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f74540c5c20 0x7f74540c66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:60466/0 (socket says 172.21.15.120:60466) 2024-04-18T04:45:03.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7fedf2000640 1 --2- 172.21.15.120:0/466119346 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fedf406c840 0x7fedf406da50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7feddc00c700 tx=0x7feddc00cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:03.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7f7453200640 1 -- 172.21.15.120:0/1968080213 learned_addr learned my addr 172.21.15.120:0/1968080213 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:03.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7fedeaa00640 1 -- 172.21.15.120:0/466119346 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc00a7e0 con 0x7fedf406c840 2024-04-18T04:45:03.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7fedeaa00640 1 -- 172.21.15.120:0/466119346 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feddc00a960 con 0x7fedf406c840 2024-04-18T04:45:03.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.869+0000 7fedeaa00640 1 -- 172.21.15.120:0/466119346 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc00ad10 con 0x7fedf406c840 2024-04-18T04:45:03.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7f8b46000640 1 -- 172.21.15.120:0/1009609589 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3989061402 0 0) 0x7f8b480c5a60 con 0x7f8b480cadc0 2024-04-18T04:45:03.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7f8b46000640 1 -- 172.21.15.120:0/1009609589 >> v2:172.21.15.120:3300/0 conn(0x7f8b480cb570 msgr2=0x7f8b4814fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:03.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7f8b46000640 1 --2- 172.21.15.120:0/1009609589 >> v2:172.21.15.120:3300/0 conn(0x7f8b480cb570 0x7f8b4814fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7f8b46000640 1 -- 172.21.15.120:0/1009609589 >> v1:172.21.15.132:6789/0 conn(0x7f8b480c66d0 legacy=0x7f8b480c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:03.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7f8b46000640 1 -- 172.21.15.120:0/1009609589 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b480c0050 con 0x7f8b480cadc0 2024-04-18T04:45:03.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7f8b46000640 1 -- 172.21.15.120:0/1009609589 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7f8b38001680 con 0x7f8b480cadc0 2024-04-18T04:45:03.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7f8b46000640 1 -- 172.21.15.120:0/1009609589 >> v1:172.21.15.120:6789/0 conn(0x7f8b480cadc0 legacy=0x7f8b48158d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:03.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7f8b46000640 1 --2- 172.21.15.120:0/1009609589 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8b2c004b70 0x7f8b2c004f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7f8b46000640 1 --2- 172.21.15.120:0/1009609589 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b2c003770 0x7f8b2c003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7f8b46000640 1 --2- 172.21.15.120:0/1009609589 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b2c004130 0x7f8b2c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7f8b46000640 1 -- 172.21.15.120:0/1009609589 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b480bfe70 con 0x7f8b2c003770 2024-04-18T04:45:03.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7f8b46000640 1 -- 172.21.15.120:0/1009609589 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2c00bf00 con 0x7f8b2c004130 2024-04-18T04:45:03.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.865+0000 7f8b46000640 1 -- 172.21.15.120:0/1009609589 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2c00c0c0 con 0x7f8b2c004b70 2024-04-18T04:45:03.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.869+0000 7f7453200640 1 -- 172.21.15.120:0/1968080213 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74541516b0 msgr2=0x7f74540b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:03.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.869+0000 7f7452800640 1 --2- 172.21.15.120:0/1968080213 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74541516b0 0x7f74540b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.869+0000 7f7451400640 1 -- 172.21.15.120:0/1968080213 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 503315811 0 0) 0x7f74540ae000 con 0x7f74540c7580 2024-04-18T04:45:03.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.869+0000 7f8b47400640 1 --2- 172.21.15.120:0/1009609589 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8b2c004b70 0x7f8b2c004f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.869+0000 7fedf9a00640 1 -- 172.21.15.120:0/466119346 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf415ac80 con 0x7fedf406c840 2024-04-18T04:45:03.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.869+0000 7f8b46a00640 1 --2- 172.21.15.120:0/1009609589 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b2c003770 0x7f8b2c003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.869+0000 7fedf9a00640 1 -- 172.21.15.120:0/466119346 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf415a2a0 con 0x7fedf406c840 2024-04-18T04:45:03.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.869+0000 7f8b47e00640 1 --2- 172.21.15.120:0/1009609589 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b2c004130 0x7f8b2c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.869+0000 7fc91d800640 1 Processor -- start 2024-04-18T04:45:03.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.869+0000 7fc91d800640 1 -- start start 2024-04-18T04:45:03.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.869+0000 7f9bfd200640 1 --2- 172.21.15.120:0/3878979724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9bf00457a0 0x7f9bf00e26a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9bf802c920 tx=0x7f9bf8097110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97844d4c7fcee493 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:03.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.869+0000 7f9bf6a00640 1 -- 172.21.15.120:0/3878979724 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf811fe70 con 0x7f9bf00457a0 2024-04-18T04:45:03.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.869+0000 7f9bf6a00640 1 -- 172.21.15.120:0/3878979724 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf8127440 con 0x7f9bf00457a0 2024-04-18T04:45:03.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.869+0000 7f9bf6a00640 1 -- 172.21.15.120:0/3878979724 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf81278b0 con 0x7f9bf00457a0 2024-04-18T04:45:03.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.869+0000 7f7453200640 1 --2- 172.21.15.120:0/1968080213 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74541516b0 0x7f74540b03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.869+0000 7f7453200640 1 -- 172.21.15.120:0/1968080213 >> v1:172.21.15.120:6789/0 conn(0x7f74540c7580 legacy=0x7f7454069ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:03.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.869+0000 7f7453200640 1 -- 172.21.15.120:0/1968080213 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74540add20 con 0x7f74540c5c20 2024-04-18T04:45:03.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.869+0000 7fede3e00640 1 -- 172.21.15.120:0/466119346 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedf415a640 con 0x7fedf406c840 2024-04-18T04:45:03.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.869+0000 7f8b47400640 1 -- 172.21.15.120:0/1009609589 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b2c004130 msgr2=0x7f8b2c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:03.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.869+0000 7f8b47400640 1 --2- 172.21.15.120:0/1009609589 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b2c004130 0x7f8b2c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.869+0000 7f8b47400640 1 -- 172.21.15.120:0/1009609589 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b2c003770 msgr2=0x7f8b2c003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:03.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.869+0000 7f8b47400640 1 --2- 172.21.15.120:0/1009609589 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b2c003770 0x7f8b2c003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.869+0000 7f8b47400640 1 -- 172.21.15.120:0/1009609589 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b480c5a60 con 0x7f8b2c004b70 2024-04-18T04:45:03.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.869+0000 7f8b46a00640 1 --2- 172.21.15.120:0/1009609589 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b2c003770 0x7f8b2c003bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:03.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.869+0000 7f8b47e00640 1 -- 172.21.15.120:0/1009609589 reap_dead start 2024-04-18T04:45:03.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7f1c7be00640 1 --2- 172.21.15.120:0/1211709292 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c7c153900 0x7f1c7c0c3e30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c009870 tx=0x7f1c6c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4763d25eb7827aa4 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:03.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7f9bfdc00640 1 -- 172.21.15.120:0/3878979724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9bf00457a0 msgr2=0x7f9bf00e26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:03.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7f9bfdc00640 1 --2- 172.21.15.120:0/3878979724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9bf00457a0 0x7f9bf00e26a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9bf802c920 tx=0x7f9bf8097110 comp rx=0 tx=0).stop 2024-04-18T04:45:03.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7f74e3400640 1 Processor -- start 2024-04-18T04:45:03.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7fc91d800640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc91814fcd0 0x7fc91806c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7f1c7aa00640 1 -- 172.21.15.120:0/1211709292 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6c0ac640 con 0x7f1c7c153900 2024-04-18T04:45:03.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7fc91d800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc9180c0bb0 0x7fc91806a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7f1c7aa00640 1 -- 172.21.15.120:0/1211709292 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c6c0ac7a0 con 0x7f1c7c153900 2024-04-18T04:45:03.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7f1c7aa00640 1 -- 172.21.15.120:0/1211709292 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6c0acb30 con 0x7f1c7c153900 2024-04-18T04:45:03.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7fc91d800640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc91806ac90 0x7fc918155d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7fc916a00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc91814fcd0 0x7fc91806c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7fc916a00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc91814fcd0 0x7fc91806c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:60484/0 (socket says 172.21.15.120:60484) 2024-04-18T04:45:03.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7fc916a00640 1 -- 172.21.15.120:0/1724381507 learned_addr learned my addr 172.21.15.120:0/1724381507 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:03.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7fc91d800640 1 -- 172.21.15.120:0/1724381507 --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9181500b0 con 0x7fc91806ac90 2024-04-18T04:45:03.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7fc91d800640 1 -- 172.21.15.120:0/1724381507 --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9180c74f0 con 0x7fc91814fcd0 2024-04-18T04:45:03.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7fc91d800640 1 -- 172.21.15.120:0/1724381507 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9180c09c0 con 0x7fc9180c0bb0 2024-04-18T04:45:03.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7f74e3400640 1 -- start start 2024-04-18T04:45:03.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7fc917400640 1 --2- 172.21.15.120:0/1724381507 >> v2:172.21.15.120:3300/0 conn(0x7fc91806ac90 0x7fc918155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7f1c83000640 1 -- 172.21.15.120:0/1211709292 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c7c153900 msgr2=0x7f1c7c0c3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:03.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7f1c83000640 1 --2- 172.21.15.120:0/1211709292 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c7c153900 0x7f1c7c0c3e30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c009870 tx=0x7f1c6c01c480 comp rx=0 tx=0).stop 2024-04-18T04:45:03.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7fedeaa00640 1 -- 172.21.15.120:0/466119346 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7feddc012420 con 0x7fedf406c840 2024-04-18T04:45:03.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7f9bfdc00640 1 -- 172.21.15.120:0/3878979724 shutdown_connections 2024-04-18T04:45:03.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7f9bfdc00640 1 --2- 172.21.15.120:0/3878979724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9bf00457a0 0x7f9bf00e26a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7f9bfdc00640 1 --2- 172.21.15.120:0/3878979724 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9bf00e22c0 0x7f9bf0045100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7f9bfdc00640 1 -- 172.21.15.120:0/3878979724 >> 172.21.15.120:0/3878979724 conn(0x7f9bf0050160 msgr2=0x7f9bf0050570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:03.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7f1c83000640 1 -- 172.21.15.120:0/1211709292 shutdown_connections 2024-04-18T04:45:03.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7f1c83000640 1 --2- 172.21.15.120:0/1211709292 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c7c0caea0 0x7f1c7c0cc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7f1c83000640 1 --2- 172.21.15.120:0/1211709292 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c7c153900 0x7f1c7c0c3e30 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7f1c83000640 1 -- 172.21.15.120:0/1211709292 >> 172.21.15.120:0/1211709292 conn(0x7f1c7c06c1d0 msgr2=0x7f1c7c06c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:03.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7f7453200640 1 --2- 172.21.15.120:0/1968080213 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74540c5c20 0x7f74540c66b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f744c009e50 tx=0x7f744c01c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=273513eafe89ae72 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:03.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7fc916000640 1 --2- 172.21.15.120:0/1724381507 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc9180c0bb0 0x7fc91806a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7f1c83000640 1 -- 172.21.15.120:0/1211709292 shutdown_connections 2024-04-18T04:45:03.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7f1c83000640 1 -- 172.21.15.120:0/1211709292 wait complete. 2024-04-18T04:45:03.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7fc917400640 1 -- 172.21.15.120:0/1724381507 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc9180c0bb0 msgr2=0x7fc91806a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:03.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7fc917400640 1 --2- 172.21.15.120:0/1724381507 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc9180c0bb0 0x7fc91806a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7fc917400640 1 -- 172.21.15.120:0/1724381507 >> v2:172.21.15.132:3300/0 conn(0x7fc91814fcd0 msgr2=0x7fc91806c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:03.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7fc917400640 1 --2- 172.21.15.120:0/1724381507 >> v2:172.21.15.132:3300/0 conn(0x7fc91814fcd0 0x7fc91806c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7fc917400640 1 -- 172.21.15.120:0/1724381507 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc918159ae0 con 0x7fc91806ac90 2024-04-18T04:45:03.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7fc916a00640 1 --2- 172.21.15.120:0/1724381507 >> v2:172.21.15.132:3300/0 conn(0x7fc91814fcd0 0x7fc91806c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:03.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7f9bfdc00640 1 -- 172.21.15.120:0/3878979724 shutdown_connections 2024-04-18T04:45:03.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7f9bfdc00640 1 -- 172.21.15.120:0/3878979724 wait complete. 2024-04-18T04:45:03.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7f74e3400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f74dc0c7850 0x7f74dc0c7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7f74e3400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f74dc0c66d0 0x7f74dc1600b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7f74e3400640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74dc0c57c0 con 0x7f74dc0cb570 2024-04-18T04:45:03.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.873+0000 7f74e3400640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74dc0bfe70 con 0x7f74dc0c66d0 2024-04-18T04:45:03.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.877+0000 7f74e3400640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74dc0c8170 con 0x7f74dc0c7850 2024-04-18T04:45:03.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.877+0000 7f74e0a00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f74dc0c7850 0x7f74dc0c7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.877+0000 7f74e0a00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f74dc0c7850 0x7f74dc0c7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:60500/0 (socket says 172.21.15.120:60500) 2024-04-18T04:45:03.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.877+0000 7f74e0a00640 1 -- 172.21.15.120:0/411972745 learned_addr learned my addr 172.21.15.120:0/411972745 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:03.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.877+0000 7fedeaa00640 1 --2- 172.21.15.120:0/466119346 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fedd0066760 0x7fedd0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.877+0000 7f74e1400640 1 --2- 172.21.15.120:0/411972745 >> v2:172.21.15.120:3300/0 conn(0x7f74dc0c66d0 0x7f74dc1600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.877+0000 7f74e0a00640 1 -- 172.21.15.120:0/411972745 >> v2:172.21.15.120:3300/0 conn(0x7f74dc0c66d0 msgr2=0x7f74dc1600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:03.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.877+0000 7f74e0a00640 1 --2- 172.21.15.120:0/411972745 >> v2:172.21.15.120:3300/0 conn(0x7f74dc0c66d0 0x7f74dc1600b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.877+0000 7f74e0a00640 1 -- 172.21.15.120:0/411972745 >> v1:172.21.15.120:6789/0 conn(0x7f74dc0cb570 legacy=0x7f74dc158d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:03.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.877+0000 7f74e0a00640 1 -- 172.21.15.120:0/411972745 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74dc0c0330 con 0x7f74dc0c7850 2024-04-18T04:45:03.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.877+0000 7f1c83000640 1 Processor -- start 2024-04-18T04:45:03.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.877+0000 7fedeaa00640 1 -- 172.21.15.120:0/466119346 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7feddc0847f0 con 0x7fedf406c840 2024-04-18T04:45:03.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.877+0000 7f1c83000640 1 -- start start 2024-04-18T04:45:03.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.877+0000 7f9bfdc00640 1 Processor -- start 2024-04-18T04:45:03.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.877+0000 7fedf2a00640 1 --2- 172.21.15.120:0/466119346 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fedd0066760 0x7fedd0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.877+0000 7f9bfdc00640 1 -- start start 2024-04-18T04:45:03.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.877+0000 7f8b47400640 1 --2- 172.21.15.120:0/1009609589 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8b2c004b70 0x7f8b2c004f50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8b34009ab0 tx=0x7f8b3401ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c644f1381760be0d server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:03.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.877+0000 7f8b46000640 1 -- 172.21.15.120:0/1009609589 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b340a6410 con 0x7f8b2c004b70 2024-04-18T04:45:03.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.877+0000 7fc917400640 1 --2- 172.21.15.120:0/1724381507 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc91806ac90 0x7fc918155d40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc91806f260 tx=0x7fc9040209e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca2999cfb9f3130 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:03.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.877+0000 7f8b46000640 1 -- 172.21.15.120:0/1009609589 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b340a6570 con 0x7f8b2c004b70 2024-04-18T04:45:03.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.877+0000 7fc915600640 1 -- 172.21.15.120:0/1724381507 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc904005c80 con 0x7fc91806ac90 2024-04-18T04:45:03.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.877+0000 7fc915600640 1 -- 172.21.15.120:0/1724381507 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc904005de0 con 0x7fc91806ac90 2024-04-18T04:45:03.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.877+0000 7fc915600640 1 -- 172.21.15.120:0/1724381507 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9040a9a10 con 0x7fc91806ac90 2024-04-18T04:45:03.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.877+0000 7f1c83000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c7c0c9d10 0x7f1c7c0b4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.877+0000 7f1c83000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c7c0caea0 0x7f1c7c1f6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.877+0000 7f1c83000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c7c153900 0x7f1c7c1f6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.877+0000 7f9bfdc00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9bf00457a0 0x7f9bf017b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.877+0000 7f9bfdc00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9bf0046d00 0x7f9bf0006f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.877+0000 7f9bfdc00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9bf00e22c0 0x7f9bf00d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f9bf7e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9bf00457a0 0x7f9bf017b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f1c7be00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c7c0c9d10 0x7f1c7c0b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f9bf7e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9bf00457a0 0x7f9bf017b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34032/0 (socket says 172.21.15.120:34032) 2024-04-18T04:45:03.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f8b4e800640 1 -- 172.21.15.120:0/1009609589 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8b2c004b70 msgr2=0x7f8b2c004f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:03.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f8b4e800640 1 --2- 172.21.15.120:0/1009609589 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8b2c004b70 0x7f8b2c004f50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8b34009ab0 tx=0x7f8b3401ca30 comp rx=0 tx=0).stop 2024-04-18T04:45:03.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f8b46000640 1 -- 172.21.15.120:0/1009609589 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b340a6920 con 0x7f8b2c004b70 2024-04-18T04:45:03.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f1c83000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c1569f0 con 0x7f1c7c0caea0 2024-04-18T04:45:03.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f1c83000640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c156560 con 0x7f1c7c0c9d10 2024-04-18T04:45:03.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f1c83000640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c155950 con 0x7f1c7c153900 2024-04-18T04:45:03.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7fedf2a00640 1 --2- 172.21.15.120:0/466119346 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fedd0066760 0x7fedd0068c20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fede4009ad0 tx=0x7fede4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:03.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f9bf7400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9bf0046d00 0x7f9bf0006f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f9bfdc00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf00c7900 con 0x7f9bf00457a0 2024-04-18T04:45:03.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f9bfdc00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf0006b90 con 0x7f9bf0046d00 2024-04-18T04:45:03.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f9bfdc00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf017bd60 con 0x7f9bf00e22c0 2024-04-18T04:45:03.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f9bf7e00640 1 -- 172.21.15.120:0/1829191802 learned_addr learned my addr 172.21.15.120:0/1829191802 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:03.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f1c7be00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c7c0c9d10 0x7f1c7c0b4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:60504/0 (socket says 172.21.15.120:60504) 2024-04-18T04:45:03.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f1c7be00640 1 -- 172.21.15.120:0/1501388159 learned_addr learned my addr 172.21.15.120:0/1501388159 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:03.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f1c81000640 1 --2- 172.21.15.120:0/1501388159 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c7c153900 0x7f1c7c1f6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f1c7b400640 1 --2- 172.21.15.120:0/1501388159 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c7c0caea0 0x7f1c7c1f6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7fc91d800640 1 -- 172.21.15.120:0/1724381507 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc91806ac90 msgr2=0x7fc918155d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:03.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7fc91d800640 1 --2- 172.21.15.120:0/1724381507 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc91806ac90 0x7fc918155d40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc91806f260 tx=0x7fc9040209e0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f9bfd200640 1 --2- 172.21.15.120:0/1829191802 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9bf00e22c0 0x7f9bf00d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f8b4e800640 1 -- 172.21.15.120:0/1009609589 shutdown_connections 2024-04-18T04:45:03.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f8b4e800640 1 --2- 172.21.15.120:0/1009609589 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8b2c004b70 0x7f8b2c004f50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f8b4e800640 1 -- 172.21.15.120:0/1009609589 >> 172.21.15.120:0/1009609589 conn(0x7f8b4806b780 msgr2=0x7f8b4806bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:03.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7fc91d800640 1 -- 172.21.15.120:0/1724381507 shutdown_connections 2024-04-18T04:45:03.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7fc91d800640 1 --2- 172.21.15.120:0/1724381507 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc91806ac90 0x7fc918155d40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7fc91d800640 1 --2- 172.21.15.120:0/1724381507 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc9180c0bb0 0x7fc91806a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7fc91d800640 1 --2- 172.21.15.120:0/1724381507 >> v2:172.21.15.132:3300/0 conn(0x7fc91814fcd0 0x7fc91806c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7fc91d800640 1 -- 172.21.15.120:0/1724381507 >> 172.21.15.120:0/1724381507 conn(0x7fc91806b860 msgr2=0x7fc91806bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:03.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f9bf7e00640 1 -- 172.21.15.120:0/1829191802 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9bf00e22c0 msgr2=0x7f9bf00d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:03.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f9bf7e00640 1 --2- 172.21.15.120:0/1829191802 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9bf00e22c0 0x7f9bf00d0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f9bf7e00640 1 -- 172.21.15.120:0/1829191802 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9bf0046d00 msgr2=0x7f9bf0006f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:03.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f9bf7e00640 1 --2- 172.21.15.120:0/1829191802 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9bf0046d00 0x7f9bf0006f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f9bf7e00640 1 -- 172.21.15.120:0/1829191802 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf8072040 con 0x7f9bf00457a0 2024-04-18T04:45:03.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f9bf7400640 1 --2- 172.21.15.120:0/1829191802 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9bf0046d00 0x7f9bf0006f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:03.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f9bfd200640 1 --2- 172.21.15.120:0/1829191802 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9bf00e22c0 0x7f9bf00d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:03.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f8b4e800640 1 -- 172.21.15.120:0/1009609589 shutdown_connections 2024-04-18T04:45:03.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f8b4e800640 1 -- 172.21.15.120:0/1009609589 wait complete. 2024-04-18T04:45:03.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f1c7b400640 1 -- 172.21.15.120:0/1501388159 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c7c153900 msgr2=0x7f1c7c1f6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:03.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f1c7b400640 1 --2- 172.21.15.120:0/1501388159 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c7c153900 0x7f1c7c1f6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f1c7b400640 1 -- 172.21.15.120:0/1501388159 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c7c0c9d10 msgr2=0x7f1c7c0b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:03.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f1c7b400640 1 --2- 172.21.15.120:0/1501388159 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c7c0c9d10 0x7f1c7c0b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f1c7b400640 1 -- 172.21.15.120:0/1501388159 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6c0094d0 con 0x7f1c7c0caea0 2024-04-18T04:45:03.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f1c7be00640 1 --2- 172.21.15.120:0/1501388159 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c7c0c9d10 0x7f1c7c0b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:45:03.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f9bf7e00640 1 --2- 172.21.15.120:0/1829191802 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9bf00457a0 0x7f9bf017b820 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9be800e930 tx=0x7f9be800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:03.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7fc91d800640 1 -- 172.21.15.120:0/1724381507 shutdown_connections 2024-04-18T04:45:03.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7fc91d800640 1 -- 172.21.15.120:0/1724381507 wait complete. 2024-04-18T04:45:03.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f74e0a00640 1 --2- 172.21.15.120:0/411972745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74dc0c7850 0x7f74dc0c7c30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f74dc06e420 tx=0x7f74d401f1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf2f419112398bec server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:03.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f9be7e00640 1 -- 172.21.15.120:0/1829191802 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be8009690 con 0x7f9bf00457a0 2024-04-18T04:45:03.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f9be7e00640 1 -- 172.21.15.120:0/1829191802 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be800c9a0 con 0x7f9bf00457a0 2024-04-18T04:45:03.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f9be7e00640 1 -- 172.21.15.120:0/1829191802 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be800cd10 con 0x7f9bf00457a0 2024-04-18T04:45:03.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f9bfdc00640 1 -- 172.21.15.120:0/1829191802 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bf00d0a30 con 0x7f9bf00457a0 2024-04-18T04:45:03.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f1c7b400640 1 --2- 172.21.15.120:0/1501388159 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c7c0caea0 0x7f1c7c1f6570 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1c6800c7f0 tx=0x7f1c6800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:03.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f9bfdc00640 1 -- 172.21.15.120:0/1829191802 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bf00e14a0 con 0x7f9bf00457a0 2024-04-18T04:45:03.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f1c73e00640 1 -- 172.21.15.120:0/1501388159 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c68004220 con 0x7f1c7c0caea0 2024-04-18T04:45:03.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f1c73e00640 1 -- 172.21.15.120:0/1501388159 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c68004380 con 0x7f1c7c0caea0 2024-04-18T04:45:03.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f1c83000640 1 -- 172.21.15.120:0/1501388159 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c7c155c30 con 0x7f1c7c0caea0 2024-04-18T04:45:03.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f1c73e00640 1 -- 172.21.15.120:0/1501388159 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c68003840 con 0x7f1c7c0caea0 2024-04-18T04:45:03.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f1c83000640 1 -- 172.21.15.120:0/1501388159 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c7c1561f0 con 0x7f1c7c0caea0 2024-04-18T04:45:03.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f8b4e800640 1 Processor -- start 2024-04-18T04:45:03.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f9bfdc00640 1 -- 172.21.15.120:0/1829191802 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bf00dc6f0 con 0x7f9bf00457a0 2024-04-18T04:45:03.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.881+0000 7f8b4e800640 1 -- start start 2024-04-18T04:45:03.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.885+0000 7fc91d800640 1 Processor -- start 2024-04-18T04:45:03.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.885+0000 7fc91d800640 1 -- start start 2024-04-18T04:45:03.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.885+0000 7f1c83000640 1 -- 172.21.15.120:0/1501388159 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c54005260 con 0x7f1c7c0caea0 2024-04-18T04:45:03.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.885+0000 7f8b4e800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8b2c004b70 0x7f8b480c2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.885+0000 7f8b4e800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b4814ca20 0x7f8b48151110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.885+0000 7f8b4e800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b48156810 0x7f8b48151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.885+0000 7f8b47400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8b2c004b70 0x7f8b480c2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.885+0000 7f8b47400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8b2c004b70 0x7f8b480c2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:42212/0 (socket says 172.21.15.120:42212) 2024-04-18T04:45:03.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.885+0000 7f8b4e800640 1 -- 172.21.15.120:0/2644597883 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b480712e0 con 0x7f8b4814ca20 2024-04-18T04:45:03.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.885+0000 7f8b47400640 1 -- 172.21.15.120:0/2644597883 learned_addr learned my addr 172.21.15.120:0/2644597883 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:03.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.885+0000 7f8b4e800640 1 -- 172.21.15.120:0/2644597883 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b48150100 con 0x7f8b48156810 2024-04-18T04:45:03.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.885+0000 7f8b4e800640 1 -- 172.21.15.120:0/2644597883 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b48150c80 con 0x7f8b2c004b70 2024-04-18T04:45:03.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.885+0000 7fc91d800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc91806ac90 0x7fc9181440f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.885+0000 7fc91d800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc9180c0bb0 0x7fc9181f9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.885+0000 7fc91d800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc91814fcd0 0x7fc9181f9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.885+0000 7fc91d800640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc918147750 con 0x7fc91814fcd0 2024-04-18T04:45:03.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.885+0000 7fc91d800640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9180c9e40 con 0x7fc9180c0bb0 2024-04-18T04:45:03.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.885+0000 7fc91d800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9180ca9c0 con 0x7fc91806ac90 2024-04-18T04:45:03.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.885+0000 7f8b47e00640 1 --2- 172.21.15.120:0/2644597883 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b48156810 0x7f8b48151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.885+0000 7f8b46a00640 1 --2- 172.21.15.120:0/2644597883 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b4814ca20 0x7f8b48151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.885+0000 7fc916000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc9180c0bb0 0x7fc9181f9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.885+0000 7fc916000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc9180c0bb0 0x7fc9181f9780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:60534/0 (socket says 172.21.15.120:60534) 2024-04-18T04:45:03.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.885+0000 7fc916000640 1 -- 172.21.15.120:0/1396422746 learned_addr learned my addr 172.21.15.120:0/1396422746 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:03.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.885+0000 7f9be7e00640 1 -- 172.21.15.120:0/1829191802 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9be8013470 con 0x7f9bf00457a0 2024-04-18T04:45:03.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.885+0000 7f8b47400640 1 -- 172.21.15.120:0/2644597883 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b48156810 msgr2=0x7f8b48151650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:03.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.885+0000 7f8b47400640 1 --2- 172.21.15.120:0/2644597883 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b48156810 0x7f8b48151650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.885+0000 7f8b47400640 1 -- 172.21.15.120:0/2644597883 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b4814ca20 msgr2=0x7f8b48151110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:03.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.885+0000 7f8b47400640 1 --2- 172.21.15.120:0/2644597883 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b4814ca20 0x7f8b48151110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.885+0000 7f8b47400640 1 -- 172.21.15.120:0/2644597883 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b480c7580 con 0x7f8b2c004b70 2024-04-18T04:45:03.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.885+0000 7f8b47400640 1 --2- 172.21.15.120:0/2644597883 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8b2c004b70 0x7f8b480c2420 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8b34009ab0 tx=0x7f8b340197d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:03.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.885+0000 7fc917400640 1 --2- 172.21.15.120:0/1396422746 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc91814fcd0 0x7fc9181f9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.885+0000 7fc916a00640 1 --2- 172.21.15.120:0/1396422746 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc91806ac90 0x7fc9181440f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.885+0000 7fc917400640 1 -- 172.21.15.120:0/1396422746 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc91806ac90 msgr2=0x7fc9181440f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:03.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.885+0000 7fc917400640 1 --2- 172.21.15.120:0/1396422746 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc91806ac90 0x7fc9181440f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.885+0000 7fc917400640 1 -- 172.21.15.120:0/1396422746 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc9180c0bb0 msgr2=0x7fc9181f9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:03.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.885+0000 7fc917400640 1 --2- 172.21.15.120:0/1396422746 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc9180c0bb0 0x7fc9181f9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.885+0000 7fc917400640 1 -- 172.21.15.120:0/1396422746 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90400dca0 con 0x7fc91814fcd0 2024-04-18T04:45:03.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.885+0000 7f1c73e00640 1 -- 172.21.15.120:0/1501388159 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1c68003bb0 con 0x7f1c7c0caea0 2024-04-18T04:45:03.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.889+0000 7f8b3f400640 1 -- 172.21.15.120:0/2644597883 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b340b9410 con 0x7f8b2c004b70 2024-04-18T04:45:03.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.889+0000 7f8b3f400640 1 -- 172.21.15.120:0/2644597883 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b340b9570 con 0x7f8b2c004b70 2024-04-18T04:45:03.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.889+0000 7f8b3f400640 1 -- 172.21.15.120:0/2644597883 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b340b98e0 con 0x7f8b2c004b70 2024-04-18T04:45:03.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.889+0000 7f74db400640 1 -- 172.21.15.120:0/411972745 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d40af400 con 0x7f74dc0c7850 2024-04-18T04:45:03.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.889+0000 7f8b4e800640 1 -- 172.21.15.120:0/2644597883 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b48150350 con 0x7f8b2c004b70 2024-04-18T04:45:03.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.889+0000 7f8b4e800640 1 -- 172.21.15.120:0/2644597883 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b48150910 con 0x7f8b2c004b70 2024-04-18T04:45:03.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.889+0000 7fedeaa00640 1 -- 172.21.15.120:0/466119346 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7feddc051900 con 0x7fedf406c840 2024-04-18T04:45:03.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.889+0000 7f74db400640 1 -- 172.21.15.120:0/411972745 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d40ab050 con 0x7f74dc0c7850 2024-04-18T04:45:03.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.889+0000 7f74db400640 1 -- 172.21.15.120:0/411972745 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d40af780 con 0x7f74dc0c7850 2024-04-18T04:45:03.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.889+0000 7f74e3400640 1 -- 172.21.15.120:0/411972745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74dc0c7850 msgr2=0x7f74dc0c7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:03.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.889+0000 7f74e3400640 1 --2- 172.21.15.120:0/411972745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74dc0c7850 0x7f74dc0c7c30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f74dc06e420 tx=0x7f74d401f1e0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.889+0000 7fc917400640 1 --2- 172.21.15.120:0/1396422746 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc91814fcd0 0x7fc9181f9cc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc9040af000 tx=0x7fc90401d780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:03.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.889+0000 7f7451400640 1 -- 172.21.15.120:0/1968080213 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c0a56e0 con 0x7f74540c5c20 2024-04-18T04:45:03.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.889+0000 7f9be7e00640 1 --2- 172.21.15.120:0/1829191802 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9bdc0666e0 0x7f9bdc068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.889+0000 7f9be7e00640 1 -- 172.21.15.120:0/1829191802 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9be8084f50 con 0x7f9bf00457a0 2024-04-18T04:45:03.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.889+0000 7f7451400640 1 -- 172.21.15.120:0/1968080213 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744c0a5840 con 0x7f74540c5c20 2024-04-18T04:45:03.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.889+0000 7f7451400640 1 -- 172.21.15.120:0/1968080213 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c0a5bd0 con 0x7f74540c5c20 2024-04-18T04:45:03.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.889+0000 7f1c73e00640 1 --2- 172.21.15.120:0/1501388159 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1c5c066690 0x7f1c5c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.889+0000 7f74e3400640 1 -- 172.21.15.120:0/411972745 shutdown_connections 2024-04-18T04:45:03.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.889+0000 7f74e3400640 1 --2- 172.21.15.120:0/411972745 >> v2:172.21.15.120:3300/0 conn(0x7f74dc0c66d0 0x7f74dc1600b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.889+0000 7f74e3400640 1 --2- 172.21.15.120:0/411972745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74dc0c7850 0x7f74dc0c7c30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.889+0000 7f8b4e800640 1 -- 172.21.15.120:0/2644597883 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b48072a70 con 0x7f8b2c004b70 2024-04-18T04:45:03.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.889+0000 7f9bf7400640 1 --2- 172.21.15.120:0/1829191802 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9bdc0666e0 0x7f9bdc068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.889+0000 7f1c7be00640 1 --2- 172.21.15.120:0/1501388159 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1c5c066690 0x7f1c5c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.889+0000 7f74e3400640 1 -- 172.21.15.120:0/411972745 >> 172.21.15.120:0/411972745 conn(0x7f74dc06b780 msgr2=0x7f74dc06bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:03.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.889+0000 7f9bf7400640 1 --2- 172.21.15.120:0/1829191802 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9bdc0666e0 0x7f9bdc068ba0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9bf00cbad0 tx=0x7f9bec009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:03.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.889+0000 7f74e3400640 1 -- 172.21.15.120:0/411972745 shutdown_connections 2024-04-18T04:45:03.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.889+0000 7f8b3f400640 1 -- 172.21.15.120:0/2644597883 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8b340b9a40 con 0x7f8b2c004b70 2024-04-18T04:45:03.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.889+0000 7f74e3400640 1 -- 172.21.15.120:0/411972745 wait complete. 2024-04-18T04:45:03.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.889+0000 7f7458a00640 1 -- 172.21.15.120:0/1968080213 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74540c5c20 msgr2=0x7f74540c66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:03.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.889+0000 7f7458a00640 1 --2- 172.21.15.120:0/1968080213 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74540c5c20 0x7f74540c66b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f744c009e50 tx=0x7f744c01c910 comp rx=0 tx=0).stop 2024-04-18T04:45:03.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.889+0000 7f7458a00640 1 -- 172.21.15.120:0/1968080213 shutdown_connections 2024-04-18T04:45:03.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.889+0000 7f7458a00640 1 --2- 172.21.15.120:0/1968080213 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74540c5c20 0x7f74540c66b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.889+0000 7f7458a00640 1 --2- 172.21.15.120:0/1968080213 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74541516b0 0x7f74540b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.889+0000 7f7458a00640 1 -- 172.21.15.120:0/1968080213 >> 172.21.15.120:0/1968080213 conn(0x7f745406c1c0 msgr2=0x7f745406c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:03.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.889+0000 7f7458a00640 1 -- 172.21.15.120:0/1968080213 shutdown_connections 2024-04-18T04:45:03.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.889+0000 7f7458a00640 1 -- 172.21.15.120:0/1968080213 wait complete. 2024-04-18T04:45:03.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.893+0000 7f1c7be00640 1 --2- 172.21.15.120:0/1501388159 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1c5c066690 0x7f1c5c068b50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c009870 tx=0x7f1c6c0a7000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:03.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.893+0000 7f8b3f400640 1 --2- 172.21.15.120:0/2644597883 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8b28066760 0x7f8b28068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.893+0000 7f8b3f400640 1 -- 172.21.15.120:0/2644597883 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8b3411ed70 con 0x7f8b2c004b70 2024-04-18T04:45:03.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.893+0000 7f8b46a00640 1 --2- 172.21.15.120:0/2644597883 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8b28066760 0x7f8b28068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.893+0000 7f9be7e00640 1 -- 172.21.15.120:0/1829191802 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f9be8051fe0 con 0x7f9bf00457a0 2024-04-18T04:45:03.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.893+0000 7f7458a00640 1 Processor -- start 2024-04-18T04:45:03.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.893+0000 7f8b46a00640 1 --2- 172.21.15.120:0/2644597883 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8b28066760 0x7f8b28068c20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8b48073ae0 tx=0x7f8b38009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:03.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.893+0000 7f74e3400640 1 Processor -- start 2024-04-18T04:45:03.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.893+0000 7f7458a00640 1 -- start start 2024-04-18T04:45:03.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.893+0000 7f74e3400640 1 -- start start 2024-04-18T04:45:03.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.893+0000 7f1c73e00640 1 -- 172.21.15.120:0/1501388159 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1c68003e60 con 0x7f1c7c0caea0 2024-04-18T04:45:03.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.893+0000 7fc90ea00640 1 -- 172.21.15.120:0/1396422746 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90400d450 con 0x7fc91814fcd0 2024-04-18T04:45:03.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.897+0000 7f74e3400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74dc0c66d0 0x7f74dc0ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.897+0000 7fc91d800640 1 -- 172.21.15.120:0/1396422746 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc918147940 con 0x7fc91814fcd0 2024-04-18T04:45:03.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.897+0000 7fc91d800640 1 -- 172.21.15.120:0/1396422746 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9180ca370 con 0x7fc91814fcd0 2024-04-18T04:45:03.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.897+0000 7f7458a00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74540c5c20 0x7f74541f9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.897+0000 7f7458a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74540c7580 0x7f74540ca570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.897+0000 7f7458a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74541516b0 0x7f745414b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.897+0000 7f74e3400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74dc0c7850 0x7f74dc1f3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.897+0000 7f74e3400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74dc0cb570 0x7f74dc1f4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.897+0000 7f74e3400640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc14ef20 con 0x7f74dc0cb570 2024-04-18T04:45:03.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.897+0000 7f74e3400640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc13f360 con 0x7f74dc0c66d0 2024-04-18T04:45:03.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.897+0000 7f74e3400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc1f6c10 con 0x7f74dc0c7850 2024-04-18T04:45:03.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.897+0000 7f74e0a00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74dc0c66d0 0x7f74dc0ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.897+0000 7f7458a00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f745414def0 con 0x7f74540c7580 2024-04-18T04:45:03.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.897+0000 7f7458a00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74541f6e40 con 0x7f74540c5c20 2024-04-18T04:45:03.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.897+0000 7f74e1400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74dc0cb570 0x7f74dc1f4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.897+0000 7f7458a00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74541fa340 con 0x7f74541516b0 2024-04-18T04:45:03.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.897+0000 7f74e1400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74dc0cb570 0x7f74dc1f4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34076/0 (socket says 172.21.15.120:34076) 2024-04-18T04:45:03.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.897+0000 7f74e0a00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74dc0c66d0 0x7f74dc0ca0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:60544/0 (socket says 172.21.15.120:60544) 2024-04-18T04:45:03.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.897+0000 7f74e0a00640 1 -- 172.21.15.120:0/1929359606 learned_addr learned my addr 172.21.15.120:0/1929359606 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:03.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.897+0000 7f74dbe00640 1 --2- 172.21.15.120:0/1929359606 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74dc0c7850 0x7f74dc1f3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.897+0000 7f7451e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74540c7580 0x7f74540ca570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.897+0000 7f7452800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74540c5c20 0x7f74541f9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.897+0000 7f7451e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74540c7580 0x7f74540ca570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34078/0 (socket says 172.21.15.120:34078) 2024-04-18T04:45:03.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.897+0000 7f7451e00640 1 -- 172.21.15.120:0/4018070996 learned_addr learned my addr 172.21.15.120:0/4018070996 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:03.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.897+0000 7f7453200640 1 --2- 172.21.15.120:0/4018070996 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74541516b0 0x7f745414b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.897+0000 7f74dbe00640 1 -- 172.21.15.120:0/1929359606 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74dc0c66d0 msgr2=0x7f74dc0ca0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:03.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.897+0000 7f74dbe00640 1 --2- 172.21.15.120:0/1929359606 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74dc0c66d0 0x7f74dc0ca0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.897+0000 7f74dbe00640 1 -- 172.21.15.120:0/1929359606 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74dc0cb570 msgr2=0x7f74dc1f4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:03.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.897+0000 7f74dbe00640 1 --2- 172.21.15.120:0/1929359606 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74dc0cb570 0x7f74dc1f4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.897+0000 7f74dbe00640 1 -- 172.21.15.120:0/1929359606 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d4009b30 con 0x7f74dc0c7850 2024-04-18T04:45:03.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.897+0000 7fc91d800640 1 -- 172.21.15.120:0/1396422746 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9180728f0 con 0x7fc91814fcd0 2024-04-18T04:45:03.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.897+0000 7f74e0a00640 1 --2- 172.21.15.120:0/1929359606 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74dc0c66d0 0x7f74dc0ca0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:45:03.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.897+0000 7f74dbe00640 1 --2- 172.21.15.120:0/1929359606 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74dc0c7850 0x7f74dc1f3cd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f74c8000f70 tx=0x7f74c800c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:03.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.897+0000 7f7451e00640 1 -- 172.21.15.120:0/4018070996 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74541516b0 msgr2=0x7f745414b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:03.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.897+0000 7f7451e00640 1 --2- 172.21.15.120:0/4018070996 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74541516b0 0x7f745414b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.897+0000 7f7451e00640 1 -- 172.21.15.120:0/4018070996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74540c5c20 msgr2=0x7f74541f9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:03.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.897+0000 7f7451e00640 1 --2- 172.21.15.120:0/4018070996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74540c5c20 0x7f74541f9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:03.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.897+0000 7f7451e00640 1 -- 172.21.15.120:0/4018070996 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744c009b30 con 0x7f74540c7580 2024-04-18T04:45:03.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.897+0000 7f7451e00640 1 --2- 172.21.15.120:0/4018070996 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74540c7580 0x7f74540ca570 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f744000c450 tx=0x7f744000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:03.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.905+0000 7fc90ea00640 1 -- 172.21.15.120:0/1396422746 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90400d5b0 con 0x7fc91814fcd0 2024-04-18T04:45:03.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.905+0000 7fc90ea00640 1 -- 172.21.15.120:0/1396422746 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc904007db0 con 0x7fc91814fcd0 2024-04-18T04:45:03.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.905+0000 7f1c73e00640 1 -- 172.21.15.120:0/1501388159 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f1c680518a0 con 0x7f1c7c0caea0 2024-04-18T04:45:03.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.905+0000 7f74d8c00640 1 -- 172.21.15.120:0/1929359606 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c80052d0 con 0x7f74dc0c7850 2024-04-18T04:45:03.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.905+0000 7f74d8c00640 1 -- 172.21.15.120:0/1929359606 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c8005430 con 0x7f74dc0c7850 2024-04-18T04:45:03.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.905+0000 7f74d8c00640 1 -- 172.21.15.120:0/1929359606 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c8003840 con 0x7f74dc0c7850 2024-04-18T04:45:03.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.905+0000 7f744aa00640 1 -- 172.21.15.120:0/4018070996 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74400054e0 con 0x7f74540c7580 2024-04-18T04:45:03.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.905+0000 7f74e3400640 1 -- 172.21.15.120:0/1929359606 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74dc1f6eb0 con 0x7f74dc0c7850 2024-04-18T04:45:03.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.905+0000 7f8b3f400640 1 -- 172.21.15.120:0/2644597883 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f8b340ebe80 con 0x7f8b2c004b70 2024-04-18T04:45:03.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.905+0000 7f74e3400640 1 -- 172.21.15.120:0/1929359606 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74dc1f7470 con 0x7f74dc0c7850 2024-04-18T04:45:03.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.905+0000 7f7458a00640 1 -- 172.21.15.120:0/4018070996 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74541f5f90 con 0x7f74540c7580 2024-04-18T04:45:03.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.905+0000 7f74e3400640 1 -- 172.21.15.120:0/1929359606 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74dc072a70 con 0x7f74dc0c7850 2024-04-18T04:45:03.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.905+0000 7f7458a00640 1 -- 172.21.15.120:0/4018070996 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74541f6510 con 0x7f74540c7580 2024-04-18T04:45:03.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.909+0000 7f7458a00640 1 -- 172.21.15.120:0/4018070996 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f745414c290 con 0x7f74540c7580 2024-04-18T04:45:03.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.909+0000 7f744aa00640 1 -- 172.21.15.120:0/4018070996 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7440003600 con 0x7f74540c7580 2024-04-18T04:45:03.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.909+0000 7f744aa00640 1 -- 172.21.15.120:0/4018070996 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7440003970 con 0x7f74540c7580 2024-04-18T04:45:03.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.909+0000 7fc90ea00640 1 -- 172.21.15.120:0/1396422746 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc9040bb410 con 0x7fc91814fcd0 2024-04-18T04:45:03.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.909+0000 7fc90ea00640 1 --2- 172.21.15.120:0/1396422746 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc8f80666c0 0x7fc8f8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.909+0000 7fc90ea00640 1 -- 172.21.15.120:0/1396422746 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc9040f0000 con 0x7fc91814fcd0 2024-04-18T04:45:03.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.909+0000 7fc916a00640 1 --2- 172.21.15.120:0/1396422746 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc8f80666c0 0x7fc8f8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.909+0000 7f74d8c00640 1 -- 172.21.15.120:0/1929359606 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f74c80039a0 con 0x7f74dc0c7850 2024-04-18T04:45:03.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.909+0000 7fc916a00640 1 --2- 172.21.15.120:0/1396422746 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc8f80666c0 0x7fc8f8068b80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc91000ab70 tx=0x7fc91000c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:03.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.913+0000 7f74d8c00640 1 --2- 172.21.15.120:0/1929359606 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f74bc066790 0x7f74bc068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.913+0000 7f74d8c00640 1 -- 172.21.15.120:0/1929359606 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f74c8083d80 con 0x7f74dc0c7850 2024-04-18T04:45:03.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.913+0000 7f74e0a00640 1 --2- 172.21.15.120:0/1929359606 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f74bc066790 0x7f74bc068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.913+0000 7f74e0a00640 1 --2- 172.21.15.120:0/1929359606 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f74bc066790 0x7f74bc068c50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f74d4000f90 tx=0x7f74d40aa000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:03.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.913+0000 7fc90ea00640 1 -- 172.21.15.120:0/1396422746 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fc9040ebc40 con 0x7fc91814fcd0 2024-04-18T04:45:03.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.917+0000 7f744aa00640 1 -- 172.21.15.120:0/4018070996 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7440003ad0 con 0x7f74540c7580 2024-04-18T04:45:03.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.917+0000 7f744aa00640 1 --2- 172.21.15.120:0/4018070996 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f74340666c0 0x7f7434068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:03.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.917+0000 7f744aa00640 1 -- 172.21.15.120:0/4018070996 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7440054a50 con 0x7f74540c7580 2024-04-18T04:45:03.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.917+0000 7f7452800640 1 --2- 172.21.15.120:0/4018070996 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f74340666c0 0x7f7434068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:03.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.921+0000 7f7452800640 1 --2- 172.21.15.120:0/4018070996 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f74340666c0 0x7f7434068b80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f744400a970 tx=0x7f7444008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:03.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.921+0000 7f74d8c00640 1 -- 172.21.15.120:0/1929359606 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f74c8050e90 con 0x7f74dc0c7850 2024-04-18T04:45:03.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:03.925+0000 7f744aa00640 1 -- 172.21.15.120:0/4018070996 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f7440050d90 con 0x7f74540c7580 2024-04-18T04:45:04.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.145+0000 7fbb5f800640 1 -- 172.21.15.120:0/4173337053 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbb50005370 con 0x7fbb500db410 2024-04-18T04:45:04.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.145+0000 7fbb54c00640 1 -- 172.21.15.120:0/4173337053 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbb44054750 con 0x7fbb500db410 2024-04-18T04:45:04.143 INFO:teuthology.orchestra.run.smithi120.stdout:64424509451 2024-04-18T04:45:04.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.145+0000 7fbb5f800640 1 -- 172.21.15.120:0/4173337053 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fbb38066710 msgr2=0x7fbb38068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:04.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.145+0000 7fbb5f800640 1 --2- 172.21.15.120:0/4173337053 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fbb38066710 0x7fbb38068bd0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c01f8d0 tx=0x7fbb4c0ac000 comp rx=0 tx=0).stop 2024-04-18T04:45:04.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.145+0000 7fbb5f800640 1 -- 172.21.15.120:0/4173337053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbb500db410 msgr2=0x7fbb5017a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:04.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.145+0000 7fbb5f800640 1 --2- 172.21.15.120:0/4173337053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbb500db410 0x7fbb5017a2e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbb4400d4b0 tx=0x7fbb4400d970 comp rx=0 tx=0).stop 2024-04-18T04:45:04.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.149+0000 7fbb5f800640 1 -- 172.21.15.120:0/4173337053 shutdown_connections 2024-04-18T04:45:04.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.149+0000 7fbb5f800640 1 --2- 172.21.15.120:0/4173337053 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fbb38066710 0x7fbb38068bd0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.149+0000 7fbb5f800640 1 --2- 172.21.15.120:0/4173337053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbb500db410 0x7fbb5017a2e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.149+0000 7fbb5f800640 1 --2- 172.21.15.120:0/4173337053 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb500d4fd0 0x7fbb500d1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.149+0000 7fbb5f800640 1 --2- 172.21.15.120:0/4173337053 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb50034770 0x7fbb500d7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.149+0000 7fbb5f800640 1 -- 172.21.15.120:0/4173337053 >> 172.21.15.120:0/4173337053 conn(0x7fbb50050160 msgr2=0x7fbb500dab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:04.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.149+0000 7fbb5f800640 1 -- 172.21.15.120:0/4173337053 shutdown_connections 2024-04-18T04:45:04.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.149+0000 7fbb5f800640 1 -- 172.21.15.120:0/4173337053 wait complete. 2024-04-18T04:45:04.180 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.1 2024-04-18T04:45:04.180 DEBUG:teuthology.parallel:result is None 2024-04-18T04:45:04.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.217+0000 7f7458a00640 1 -- 172.21.15.120:0/4018070996 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f745414c290 con 0x7f74540c7580 2024-04-18T04:45:04.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.217+0000 7f744aa00640 1 -- 172.21.15.120:0/4018070996 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f745414c290 con 0x7f74540c7580 2024-04-18T04:45:04.218 INFO:teuthology.orchestra.run.smithi120.stdout:64424509450 2024-04-18T04:45:04.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.221+0000 7f7458a00640 1 -- 172.21.15.120:0/4018070996 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f74340666c0 msgr2=0x7f7434068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:04.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.221+0000 7f7458a00640 1 --2- 172.21.15.120:0/4018070996 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f74340666c0 0x7f7434068b80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f744400a970 tx=0x7f7444008040 comp rx=0 tx=0).stop 2024-04-18T04:45:04.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.221+0000 7f7458a00640 1 -- 172.21.15.120:0/4018070996 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74540c7580 msgr2=0x7f74540ca570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:04.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.221+0000 7f7458a00640 1 --2- 172.21.15.120:0/4018070996 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74540c7580 0x7f74540ca570 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f744000c450 tx=0x7f744000c910 comp rx=0 tx=0).stop 2024-04-18T04:45:04.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.221+0000 7f7458a00640 1 -- 172.21.15.120:0/4018070996 shutdown_connections 2024-04-18T04:45:04.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.221+0000 7f7458a00640 1 --2- 172.21.15.120:0/4018070996 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f74340666c0 0x7f7434068b80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.221+0000 7f7458a00640 1 --2- 172.21.15.120:0/4018070996 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74541516b0 0x7f745414b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.221+0000 7f7458a00640 1 --2- 172.21.15.120:0/4018070996 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74540c7580 0x7f74540ca570 secure :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f744000c450 tx=0x7f744000c910 comp rx=0 tx=0).stop 2024-04-18T04:45:04.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.221+0000 7f7458a00640 1 --2- 172.21.15.120:0/4018070996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74540c5c20 0x7f74541f9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.221+0000 7f7458a00640 1 -- 172.21.15.120:0/4018070996 >> 172.21.15.120:0/4018070996 conn(0x7f745406c1c0 msgr2=0x7f745406c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:04.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.221+0000 7f7458a00640 1 -- 172.21.15.120:0/4018070996 shutdown_connections 2024-04-18T04:45:04.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.221+0000 7f7458a00640 1 -- 172.21.15.120:0/4018070996 wait complete. 2024-04-18T04:45:04.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.225+0000 7fede3e00640 1 -- 172.21.15.120:0/466119346 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fedf415a9a0 con 0x7fedf406c840 2024-04-18T04:45:04.225 INFO:teuthology.orchestra.run.smithi120.stdout:60129542157 2024-04-18T04:45:04.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.225+0000 7fedeaa00640 1 -- 172.21.15.120:0/466119346 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fedf415a9a0 con 0x7fedf406c840 2024-04-18T04:45:04.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.229+0000 7fede3e00640 1 -- 172.21.15.120:0/466119346 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fedd0066760 msgr2=0x7fedd0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:04.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.229+0000 7fede3e00640 1 --2- 172.21.15.120:0/466119346 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fedd0066760 0x7fedd0068c20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fede4009ad0 tx=0x7fede4008040 comp rx=0 tx=0).stop 2024-04-18T04:45:04.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.229+0000 7fede3e00640 1 -- 172.21.15.120:0/466119346 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fedf406c840 msgr2=0x7fedf406da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:04.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.229+0000 7fede3e00640 1 --2- 172.21.15.120:0/466119346 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fedf406c840 0x7fedf406da50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7feddc00c700 tx=0x7feddc00cbc0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.229+0000 7fede3e00640 1 -- 172.21.15.120:0/466119346 shutdown_connections 2024-04-18T04:45:04.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.229+0000 7fede3e00640 1 --2- 172.21.15.120:0/466119346 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fedd0066760 0x7fedd0068c20 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.229+0000 7fede3e00640 1 --2- 172.21.15.120:0/466119346 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fedf4154790 0x7fedf41f3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.229+0000 7fede3e00640 1 --2- 172.21.15.120:0/466119346 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fedf406c840 0x7fedf406da50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.229+0000 7fede3e00640 1 --2- 172.21.15.120:0/466119346 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fedf406c460 0x7fedf41f6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.229+0000 7fede3e00640 1 -- 172.21.15.120:0/466119346 >> 172.21.15.120:0/466119346 conn(0x7fedf40c78c0 msgr2=0x7fedf4071180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:04.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.229+0000 7fede3e00640 1 -- 172.21.15.120:0/466119346 shutdown_connections 2024-04-18T04:45:04.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.229+0000 7fede3e00640 1 -- 172.21.15.120:0/466119346 wait complete. 2024-04-18T04:45:04.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.241+0000 7f9bfdc00640 1 -- 172.21.15.120:0/1829191802 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9bf004bc40 con 0x7f9bf00457a0 2024-04-18T04:45:04.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.241+0000 7f1c83000640 1 -- 172.21.15.120:0/1501388159 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f1c540050d0 con 0x7f1c7c0caea0 2024-04-18T04:45:04.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.241+0000 7f8b4e800640 1 -- 172.21.15.120:0/2644597883 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8b480c60e0 con 0x7f8b2c004b70 2024-04-18T04:45:04.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.241+0000 7f9be7e00640 1 -- 172.21.15.120:0/1829191802 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9be8021020 con 0x7f9bf00457a0 2024-04-18T04:45:04.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.241+0000 7f1c73e00640 1 -- 172.21.15.120:0/1501388159 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1c6801e020 con 0x7f1c7c0caea0 2024-04-18T04:45:04.241 INFO:teuthology.orchestra.run.smithi120.stdout:64424509452 2024-04-18T04:45:04.241 INFO:teuthology.orchestra.run.smithi120.stdout:60129542157 2024-04-18T04:45:04.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.241+0000 7f8b3f400640 1 -- 172.21.15.120:0/2644597883 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8b340c8020 con 0x7f8b2c004b70 2024-04-18T04:45:04.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.245+0000 7f9bfdc00640 1 -- 172.21.15.120:0/1829191802 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9bdc0666e0 msgr2=0x7f9bdc068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:04.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.245+0000 7f9bfdc00640 1 --2- 172.21.15.120:0/1829191802 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9bdc0666e0 0x7f9bdc068ba0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9bf00cbad0 tx=0x7f9bec009040 comp rx=0 tx=0).stop 2024-04-18T04:45:04.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.245+0000 7f9bfdc00640 1 -- 172.21.15.120:0/1829191802 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9bf00457a0 msgr2=0x7f9bf017b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:04.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.245+0000 7f9bfdc00640 1 --2- 172.21.15.120:0/1829191802 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9bf00457a0 0x7f9bf017b820 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9be800e930 tx=0x7f9be800edf0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.245 INFO:teuthology.orchestra.run.smithi120.stdout:55834574859 2024-04-18T04:45:04.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.245+0000 7f1c83000640 1 -- 172.21.15.120:0/1501388159 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1c5c066690 msgr2=0x7f1c5c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:04.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.245+0000 7f1c83000640 1 --2- 172.21.15.120:0/1501388159 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1c5c066690 0x7f1c5c068b50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c009870 tx=0x7f1c6c0a7000 comp rx=0 tx=0).stop 2024-04-18T04:45:04.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.245+0000 7f1c83000640 1 -- 172.21.15.120:0/1501388159 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c7c0caea0 msgr2=0x7f1c7c1f6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:04.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.245+0000 7f1c83000640 1 --2- 172.21.15.120:0/1501388159 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c7c0caea0 0x7f1c7c1f6570 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1c6800c7f0 tx=0x7f1c6800ccb0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.245+0000 7f1c83000640 1 -- 172.21.15.120:0/1501388159 shutdown_connections 2024-04-18T04:45:04.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.245+0000 7f1c83000640 1 --2- 172.21.15.120:0/1501388159 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1c5c066690 0x7f1c5c068b50 secure :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c009870 tx=0x7f1c6c0a7000 comp rx=0 tx=0).stop 2024-04-18T04:45:04.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.245+0000 7f1c83000640 1 --2- 172.21.15.120:0/1501388159 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c7c153900 0x7f1c7c1f6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.245+0000 7f1c83000640 1 --2- 172.21.15.120:0/1501388159 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c7c0caea0 0x7f1c7c1f6570 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.245+0000 7f1c83000640 1 --2- 172.21.15.120:0/1501388159 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c7c0c9d10 0x7f1c7c0b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.245+0000 7f1c83000640 1 -- 172.21.15.120:0/1501388159 >> 172.21.15.120:0/1501388159 conn(0x7f1c7c06c1d0 msgr2=0x7f1c7c14e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:04.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.245+0000 7fc91d800640 1 -- 172.21.15.120:0/1396422746 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fc918067f80 con 0x7fc91814fcd0 2024-04-18T04:45:04.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.245+0000 7fc90ea00640 1 -- 172.21.15.120:0/1396422746 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc918067f80 con 0x7fc91814fcd0 2024-04-18T04:45:04.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.245+0000 7f9bfdc00640 1 -- 172.21.15.120:0/1829191802 shutdown_connections 2024-04-18T04:45:04.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.245+0000 7f9bfdc00640 1 --2- 172.21.15.120:0/1829191802 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9bdc0666e0 0x7f9bdc068ba0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.245+0000 7f9bfdc00640 1 --2- 172.21.15.120:0/1829191802 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9bf00e22c0 0x7f9bf00d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.245+0000 7f9bfdc00640 1 --2- 172.21.15.120:0/1829191802 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9bf0046d00 0x7f9bf0006f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.245+0000 7f9bfdc00640 1 --2- 172.21.15.120:0/1829191802 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9bf00457a0 0x7f9bf017b820 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.245+0000 7f9bfdc00640 1 -- 172.21.15.120:0/1829191802 >> 172.21.15.120:0/1829191802 conn(0x7f9bf0050160 msgr2=0x7f9bf00d8250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:04.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.245+0000 7f1c83000640 1 -- 172.21.15.120:0/1501388159 shutdown_connections 2024-04-18T04:45:04.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.245+0000 7f1c83000640 1 -- 172.21.15.120:0/1501388159 wait complete. 2024-04-18T04:45:04.247 INFO:teuthology.orchestra.run.smithi120.stdout:60129542155 2024-04-18T04:45:04.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.245+0000 7f9bfdc00640 1 -- 172.21.15.120:0/1829191802 shutdown_connections 2024-04-18T04:45:04.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.245+0000 7f9bfdc00640 1 -- 172.21.15.120:0/1829191802 wait complete. 2024-04-18T04:45:04.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.245+0000 7f8b4e800640 1 -- 172.21.15.120:0/2644597883 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8b28066760 msgr2=0x7f8b28068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:04.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.245+0000 7f8b4e800640 1 --2- 172.21.15.120:0/2644597883 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8b28066760 0x7f8b28068c20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8b48073ae0 tx=0x7f8b38009040 comp rx=0 tx=0).stop 2024-04-18T04:45:04.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.245+0000 7f8b4e800640 1 -- 172.21.15.120:0/2644597883 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8b2c004b70 msgr2=0x7f8b480c2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:04.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.245+0000 7f8b4e800640 1 --2- 172.21.15.120:0/2644597883 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8b2c004b70 0x7f8b480c2420 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8b34009ab0 tx=0x7f8b340197d0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.245+0000 7f8b4e800640 1 -- 172.21.15.120:0/2644597883 shutdown_connections 2024-04-18T04:45:04.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.245+0000 7f8b4e800640 1 --2- 172.21.15.120:0/2644597883 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8b28066760 0x7f8b28068c20 secure :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8b48073ae0 tx=0x7f8b38009040 comp rx=0 tx=0).stop 2024-04-18T04:45:04.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.245+0000 7f8b4e800640 1 --2- 172.21.15.120:0/2644597883 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b48156810 0x7f8b48151650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.245+0000 7f8b4e800640 1 --2- 172.21.15.120:0/2644597883 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b4814ca20 0x7f8b48151110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.245+0000 7f8b4e800640 1 --2- 172.21.15.120:0/2644597883 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8b2c004b70 0x7f8b480c2420 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.245+0000 7f8b4e800640 1 -- 172.21.15.120:0/2644597883 >> 172.21.15.120:0/2644597883 conn(0x7f8b4806b780 msgr2=0x7f8b480c09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:04.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.245+0000 7f8b4e800640 1 -- 172.21.15.120:0/2644597883 shutdown_connections 2024-04-18T04:45:04.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.245+0000 7f8b4e800640 1 -- 172.21.15.120:0/2644597883 wait complete. 2024-04-18T04:45:04.250 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.2 2024-04-18T04:45:04.251 DEBUG:teuthology.parallel:result is None 2024-04-18T04:45:04.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.249+0000 7fc91d800640 1 -- 172.21.15.120:0/1396422746 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc8f80666c0 msgr2=0x7fc8f8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:04.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.249+0000 7fc91d800640 1 --2- 172.21.15.120:0/1396422746 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc8f80666c0 0x7fc8f8068b80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc91000ab70 tx=0x7fc91000c040 comp rx=0 tx=0).stop 2024-04-18T04:45:04.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.249+0000 7fc91d800640 1 -- 172.21.15.120:0/1396422746 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc91814fcd0 msgr2=0x7fc9181f9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:04.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.249+0000 7fc91d800640 1 --2- 172.21.15.120:0/1396422746 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc91814fcd0 0x7fc9181f9cc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc9040af000 tx=0x7fc90401d780 comp rx=0 tx=0).stop 2024-04-18T04:45:04.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.249+0000 7fc91d800640 1 -- 172.21.15.120:0/1396422746 shutdown_connections 2024-04-18T04:45:04.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.249+0000 7fc91d800640 1 --2- 172.21.15.120:0/1396422746 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc8f80666c0 0x7fc8f8068b80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.249+0000 7fc91d800640 1 --2- 172.21.15.120:0/1396422746 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc91814fcd0 0x7fc9181f9cc0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.249+0000 7fc91d800640 1 --2- 172.21.15.120:0/1396422746 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc9180c0bb0 0x7fc9181f9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.249+0000 7fc91d800640 1 --2- 172.21.15.120:0/1396422746 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc91806ac90 0x7fc9181440f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.249+0000 7fc91d800640 1 -- 172.21.15.120:0/1396422746 >> 172.21.15.120:0/1396422746 conn(0x7fc91806b860 msgr2=0x7fc9180c10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:04.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.253+0000 7fc91d800640 1 -- 172.21.15.120:0/1396422746 shutdown_connections 2024-04-18T04:45:04.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.253+0000 7fc91d800640 1 -- 172.21.15.120:0/1396422746 wait complete. 2024-04-18T04:45:04.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.253+0000 7f74e3400640 1 -- 172.21.15.120:0/1929359606 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f74dc0c60e0 con 0x7f74dc0c7850 2024-04-18T04:45:04.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.253+0000 7f74d8c00640 1 -- 172.21.15.120:0/1929359606 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f74c8017090 con 0x7f74dc0c7850 2024-04-18T04:45:04.254 INFO:teuthology.orchestra.run.smithi120.stdout:60129542157 2024-04-18T04:45:04.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.257+0000 7f74e3400640 1 -- 172.21.15.120:0/1929359606 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f74bc066790 msgr2=0x7f74bc068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:04.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.257+0000 7f74e3400640 1 --2- 172.21.15.120:0/1929359606 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f74bc066790 0x7f74bc068c50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f74d4000f90 tx=0x7f74d40aa000 comp rx=0 tx=0).stop 2024-04-18T04:45:04.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.257+0000 7f74e3400640 1 -- 172.21.15.120:0/1929359606 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74dc0c7850 msgr2=0x7f74dc1f3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:04.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.257+0000 7f74e3400640 1 --2- 172.21.15.120:0/1929359606 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74dc0c7850 0x7f74dc1f3cd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f74c8000f70 tx=0x7f74c800c7d0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.257+0000 7f74e3400640 1 -- 172.21.15.120:0/1929359606 shutdown_connections 2024-04-18T04:45:04.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.257+0000 7f74e3400640 1 --2- 172.21.15.120:0/1929359606 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f74bc066790 0x7f74bc068c50 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.257+0000 7f74e3400640 1 --2- 172.21.15.120:0/1929359606 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74dc0cb570 0x7f74dc1f4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.257+0000 7f74e3400640 1 --2- 172.21.15.120:0/1929359606 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74dc0c7850 0x7f74dc1f3cd0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.257+0000 7f74e3400640 1 --2- 172.21.15.120:0/1929359606 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74dc0c66d0 0x7f74dc0ca0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.257+0000 7f74e3400640 1 -- 172.21.15.120:0/1929359606 >> 172.21.15.120:0/1929359606 conn(0x7f74dc06b780 msgr2=0x7f74dc06bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:04.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.257+0000 7f74e3400640 1 -- 172.21.15.120:0/1929359606 shutdown_connections 2024-04-18T04:45:04.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.257+0000 7f74e3400640 1 -- 172.21.15.120:0/1929359606 wait complete. 2024-04-18T04:45:04.261 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542157 for osd.4 2024-04-18T04:45:04.261 DEBUG:teuthology.parallel:result is None 2024-04-18T04:45:04.283 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509452 for osd.3 2024-04-18T04:45:04.283 DEBUG:teuthology.parallel:result is None 2024-04-18T04:45:04.284 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542157 for osd.5 2024-04-18T04:45:04.284 DEBUG:teuthology.parallel:result is None 2024-04-18T04:45:04.287 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542155 for osd.6 2024-04-18T04:45:04.288 DEBUG:teuthology.parallel:result is None 2024-04-18T04:45:04.288 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.0 2024-04-18T04:45:04.289 DEBUG:teuthology.parallel:result is None 2024-04-18T04:45:04.289 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542157 for osd.7 2024-04-18T04:45:04.289 DEBUG:teuthology.parallel:result is None 2024-04-18T04:45:04.289 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-18T04:45:04.289 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T04:45:04.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.469+0000 7f914a200640 1 Processor -- start 2024-04-18T04:45:04.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.469+0000 7f914a200640 1 -- start start 2024-04-18T04:45:04.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.469+0000 7f914a200640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f91441595c0 0x7f91440c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:04.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.469+0000 7f914a200640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91440701f0 con 0x7f9144153820 2024-04-18T04:45:04.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.469+0000 7f914a200640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9144159c00 con 0x7f914406e7d0 2024-04-18T04:45:04.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.469+0000 7f914a200640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9144071b10 con 0x7f91441595c0 2024-04-18T04:45:04.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.469+0000 7f9143400640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f9144153820 0x7f91440c8790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:59262/0 (socket says 172.21.15.120:59262) 2024-04-18T04:45:04.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.469+0000 7f9143400640 1 -- 172.21.15.120:0/2803704371 learned_addr learned my addr 172.21.15.120:0/2803704371 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:45:04.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.469+0000 7f9143e00640 1 --2- 172.21.15.120:0/2803704371 >> v2:172.21.15.120:3300/0 conn(0x7f91441595c0 0x7f91440c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:04.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.469+0000 7f9142a00640 1 -- 172.21.15.120:0/2803704371 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1434702964 0 0) 0x7f91440701f0 con 0x7f9144153820 2024-04-18T04:45:04.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.469+0000 7f9142a00640 1 -- 172.21.15.120:0/2803704371 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9128003530 con 0x7f9144153820 2024-04-18T04:45:04.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.473+0000 7f9143e00640 1 -- 172.21.15.120:0/2803704371 >> v1:172.21.15.132:6789/0 conn(0x7f914406e7d0 legacy=0x7f91440cb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:04.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.473+0000 7f9143e00640 1 -- 172.21.15.120:0/2803704371 >> v1:172.21.15.120:6789/0 conn(0x7f9144153820 legacy=0x7f91440c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:04.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.473+0000 7f9143e00640 1 -- 172.21.15.120:0/2803704371 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9144159ee0 con 0x7f91441595c0 2024-04-18T04:45:04.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.473+0000 7f9143e00640 1 --2- 172.21.15.120:0/2803704371 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91441595c0 0x7f91440c78b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f913c009d90 tx=0x7f913c01f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acd2ad3cc38ec773 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:04.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.473+0000 7f9142a00640 1 -- 172.21.15.120:0/2803704371 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c0af600 con 0x7f91441595c0 2024-04-18T04:45:04.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.473+0000 7f9142a00640 1 -- 172.21.15.120:0/2803704371 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913c0ab050 con 0x7f91441595c0 2024-04-18T04:45:04.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.473+0000 7f9142a00640 1 -- 172.21.15.120:0/2803704371 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c0af980 con 0x7f91441595c0 2024-04-18T04:45:04.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.473+0000 7f914a200640 1 -- 172.21.15.120:0/2803704371 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91441595c0 msgr2=0x7f91440c78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:04.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.473+0000 7f914a200640 1 --2- 172.21.15.120:0/2803704371 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91441595c0 0x7f91440c78b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f913c009d90 tx=0x7f913c01f150 comp rx=0 tx=0).stop 2024-04-18T04:45:04.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.473+0000 7f914a200640 1 -- 172.21.15.120:0/2803704371 shutdown_connections 2024-04-18T04:45:04.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.473+0000 7f914a200640 1 --2- 172.21.15.120:0/2803704371 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91441595c0 0x7f91440c78b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.473+0000 7f914a200640 1 -- 172.21.15.120:0/2803704371 >> 172.21.15.120:0/2803704371 conn(0x7f9144066450 msgr2=0x7f914406dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:04.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.473+0000 7f914a200640 1 -- 172.21.15.120:0/2803704371 shutdown_connections 2024-04-18T04:45:04.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.473+0000 7f914a200640 1 -- 172.21.15.120:0/2803704371 wait complete. 2024-04-18T04:45:04.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.477+0000 7f914a200640 1 Processor -- start 2024-04-18T04:45:04.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.477+0000 7f914a200640 1 -- start start 2024-04-18T04:45:04.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.477+0000 7f914a200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f914406e7d0 0x7f914414d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:04.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.477+0000 7f914a200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9144153820 0x7f914414c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:04.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.477+0000 7f914a200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f91441595c0 0x7f914415b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:04.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.477+0000 7f914a200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9144158fa0 con 0x7f9144153820 2024-04-18T04:45:04.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.477+0000 7f914a200640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914414d5c0 con 0x7f91441595c0 2024-04-18T04:45:04.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.477+0000 7f914a200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91441f1c30 con 0x7f914406e7d0 2024-04-18T04:45:04.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.477+0000 7f913be00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9144153820 0x7f914414c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:04.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.477+0000 7f913be00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9144153820 0x7f914414c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34106/0 (socket says 172.21.15.120:34106) 2024-04-18T04:45:04.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.477+0000 7f913be00640 1 -- 172.21.15.120:0/2791386697 learned_addr learned my addr 172.21.15.120:0/2791386697 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:04.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.477+0000 7f9143e00640 1 --2- 172.21.15.120:0/2791386697 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f91441595c0 0x7f914415b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:04.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.477+0000 7f9143400640 1 --2- 172.21.15.120:0/2791386697 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f914406e7d0 0x7f914414d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:04.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.477+0000 7f913be00640 1 -- 172.21.15.120:0/2791386697 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f914406e7d0 msgr2=0x7f914414d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:04.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.477+0000 7f913be00640 1 --2- 172.21.15.120:0/2791386697 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f914406e7d0 0x7f914414d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.477+0000 7f913be00640 1 -- 172.21.15.120:0/2791386697 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f91441595c0 msgr2=0x7f914415b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:04.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.477+0000 7f913be00640 1 --2- 172.21.15.120:0/2791386697 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f91441595c0 0x7f914415b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.477+0000 7f913be00640 1 -- 172.21.15.120:0/2791386697 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f913c009a70 con 0x7f9144153820 2024-04-18T04:45:04.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.477+0000 7f913be00640 1 --2- 172.21.15.120:0/2791386697 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9144153820 0x7f914414c260 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f912c00c4d0 tx=0x7f912c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:04.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.477+0000 7f913b400640 1 -- 172.21.15.120:0/2791386697 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912c0052d0 con 0x7f9144153820 2024-04-18T04:45:04.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.477+0000 7f913b400640 1 -- 172.21.15.120:0/2791386697 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f912c005430 con 0x7f9144153820 2024-04-18T04:45:04.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.477+0000 7f913b400640 1 -- 172.21.15.120:0/2791386697 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912c012830 con 0x7f9144153820 2024-04-18T04:45:04.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.477+0000 7f914a200640 1 -- 172.21.15.120:0/2791386697 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f914415d4c0 con 0x7f9144153820 2024-04-18T04:45:04.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.477+0000 7f914a200640 1 -- 172.21.15.120:0/2791386697 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91441f1e40 con 0x7f9144153820 2024-04-18T04:45:04.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.481+0000 7f914a200640 1 -- 172.21.15.120:0/2791386697 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9144072a70 con 0x7f9144153820 2024-04-18T04:45:04.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.481+0000 7f913b400640 1 -- 172.21.15.120:0/2791386697 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f912c012990 con 0x7f9144153820 2024-04-18T04:45:04.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.481+0000 7f913b400640 1 --2- 172.21.15.120:0/2791386697 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9120066690 0x7f9120068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:04.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.481+0000 7f913b400640 1 -- 172.21.15.120:0/2791386697 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f912c083f50 con 0x7f9144153820 2024-04-18T04:45:04.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.481+0000 7f9143400640 1 --2- 172.21.15.120:0/2791386697 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9120066690 0x7f9120068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:04.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.481+0000 7f9143400640 1 --2- 172.21.15.120:0/2791386697 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9120066690 0x7f9120068b50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f91340011f0 tx=0x7f9134009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:04.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.485+0000 7f913b400640 1 -- 172.21.15.120:0/2791386697 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f912c050ea0 con 0x7f9144153820 2024-04-18T04:45:04.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.633+0000 7f914a200640 1 -- 172.21.15.120:0/2791386697 --> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f91440c7f90 con 0x7f9120066690 2024-04-18T04:45:04.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.661+0000 7f913b400640 1 -- 172.21.15.120:0/2791386697 <== mgr.4113 v2:172.21.15.132:6832/27788 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345379 (secure 0 0 0) 0x7f9134001cf0 con 0x7f9120066690 2024-04-18T04:45:04.664 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:45:04.666 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-04-18T04:45:04.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.665+0000 7f914a200640 1 -- 172.21.15.120:0/2791386697 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9120066690 msgr2=0x7f9120068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:04.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.665+0000 7f914a200640 1 --2- 172.21.15.120:0/2791386697 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9120066690 0x7f9120068b50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f91340011f0 tx=0x7f9134009040 comp rx=0 tx=0).stop 2024-04-18T04:45:04.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.665+0000 7f914a200640 1 -- 172.21.15.120:0/2791386697 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9144153820 msgr2=0x7f914414c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:04.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.665+0000 7f914a200640 1 --2- 172.21.15.120:0/2791386697 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9144153820 0x7f914414c260 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f912c00c4d0 tx=0x7f912c00c990 comp rx=0 tx=0).stop 2024-04-18T04:45:04.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.665+0000 7f914a200640 1 -- 172.21.15.120:0/2791386697 shutdown_connections 2024-04-18T04:45:04.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.665+0000 7f914a200640 1 --2- 172.21.15.120:0/2791386697 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9120066690 0x7f9120068b50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.665+0000 7f914a200640 1 --2- 172.21.15.120:0/2791386697 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f91441595c0 0x7f914415b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.665+0000 7f914a200640 1 --2- 172.21.15.120:0/2791386697 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9144153820 0x7f914414c260 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.665+0000 7f914a200640 1 --2- 172.21.15.120:0/2791386697 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f914406e7d0 0x7f914414d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.665+0000 7f914a200640 1 -- 172.21.15.120:0/2791386697 >> 172.21.15.120:0/2791386697 conn(0x7f9144066450 msgr2=0x7f91440cb8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:04.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.665+0000 7f914a200640 1 -- 172.21.15.120:0/2791386697 shutdown_connections 2024-04-18T04:45:04.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.665+0000 7f914a200640 1 -- 172.21.15.120:0/2791386697 wait complete. 2024-04-18T04:45:04.683 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-04-18T04:45:02.800960+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595074,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":233,"num_write_kb":2442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":180,"ondisk_log_size":180,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218388,"kb_used_data":2212,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756332,"statfs":{"total":773094113280,"available":772870483968,"internally_reserved":0,"allocated":2265088,"data_stored":2008950,"data_compressed":66624,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":253,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004931"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.271916+0000","last_change":"2024-04-18T04:44:29.891079+0000","last_active":"2024-04-18T04:44:35.271916+0000","last_peered":"2024-04-18T04:44:35.271916+0000","last_clean":"2024-04-18T04:44:35.271916+0000","last_became_active":"2024-04-18T04:44:29.890853+0000","last_became_peered":"2024-04-18T04:44:29.890853+0000","last_unstale":"2024-04-18T04:44:35.271916+0000","last_undegraded":"2024-04-18T04:44:35.271916+0000","last_fullsized":"2024-04-18T04:44:35.271916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:12:22.299583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.293054+0000","last_change":"2024-04-18T04:44:30.296344+0000","last_active":"2024-04-18T04:44:34.293054+0000","last_peered":"2024-04-18T04:44:34.293054+0000","last_clean":"2024-04-18T04:44:34.293054+0000","last_became_active":"2024-04-18T04:44:30.296064+0000","last_became_peered":"2024-04-18T04:44:30.296064+0000","last_unstale":"2024-04-18T04:44:34.293054+0000","last_undegraded":"2024-04-18T04:44:34.293054+0000","last_fullsized":"2024-04-18T04:44:34.293054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:53:32.250308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.680854+0000","last_change":"2024-04-18T04:44:34.306605+0000","last_active":"2024-04-18T04:44:34.680854+0000","last_peered":"2024-04-18T04:44:34.680854+0000","last_clean":"2024-04-18T04:44:34.680854+0000","last_became_active":"2024-04-18T04:44:34.306224+0000","last_became_peered":"2024-04-18T04:44:34.306224+0000","last_unstale":"2024-04-18T04:44:34.680854+0000","last_undegraded":"2024-04-18T04:44:34.680854+0000","last_fullsized":"2024-04-18T04:44:34.680854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:13:15.107711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.681517+0000","last_change":"2024-04-18T04:44:29.881521+0000","last_active":"2024-04-18T04:44:34.681517+0000","last_peered":"2024-04-18T04:44:34.681517+0000","last_clean":"2024-04-18T04:44:34.681517+0000","last_became_active":"2024-04-18T04:44:29.881258+0000","last_became_peered":"2024-04-18T04:44:29.881258+0000","last_unstale":"2024-04-18T04:44:34.681517+0000","last_undegraded":"2024-04-18T04:44:34.681517+0000","last_fullsized":"2024-04-18T04:44:34.681517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:28:40.075960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287377+0000","last_change":"2024-04-18T04:44:30.314205+0000","last_active":"2024-04-18T04:44:34.287377+0000","last_peered":"2024-04-18T04:44:34.287377+0000","last_clean":"2024-04-18T04:44:34.287377+0000","last_became_active":"2024-04-18T04:44:30.313987+0000","last_became_peered":"2024-04-18T04:44:30.313987+0000","last_unstale":"2024-04-18T04:44:34.287377+0000","last_undegraded":"2024-04-18T04:44:34.287377+0000","last_fullsized":"2024-04-18T04:44:34.287377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:55:31.107861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.684278+0000","last_change":"2024-04-18T04:44:34.339646+0000","last_active":"2024-04-18T04:44:34.684278+0000","last_peered":"2024-04-18T04:44:34.684278+0000","last_clean":"2024-04-18T04:44:34.684278+0000","last_became_active":"2024-04-18T04:44:34.338485+0000","last_became_peered":"2024-04-18T04:44:34.338485+0000","last_unstale":"2024-04-18T04:44:34.684278+0000","last_undegraded":"2024-04-18T04:44:34.684278+0000","last_fullsized":"2024-04-18T04:44:34.684278+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:47:01.277301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.272149+0000","last_change":"2024-04-18T04:44:29.897785+0000","last_active":"2024-04-18T04:44:35.272149+0000","last_peered":"2024-04-18T04:44:35.272149+0000","last_clean":"2024-04-18T04:44:35.272149+0000","last_became_active":"2024-04-18T04:44:29.896520+0000","last_became_peered":"2024-04-18T04:44:29.896520+0000","last_unstale":"2024-04-18T04:44:35.272149+0000","last_undegraded":"2024-04-18T04:44:35.272149+0000","last_fullsized":"2024-04-18T04:44:35.272149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:25:52.871139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.307466+0000","last_change":"2024-04-18T04:44:30.300588+0000","last_active":"2024-04-18T04:44:34.307466+0000","last_peered":"2024-04-18T04:44:34.307466+0000","last_clean":"2024-04-18T04:44:34.307466+0000","last_became_active":"2024-04-18T04:44:30.299939+0000","last_became_peered":"2024-04-18T04:44:30.299939+0000","last_unstale":"2024-04-18T04:44:34.307466+0000","last_undegraded":"2024-04-18T04:44:34.307466+0000","last_fullsized":"2024-04-18T04:44:34.307466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:57:07.547985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.685732+0000","last_change":"2024-04-18T04:44:34.338794+0000","last_active":"2024-04-18T04:44:34.685732+0000","last_peered":"2024-04-18T04:44:34.685732+0000","last_clean":"2024-04-18T04:44:34.685732+0000","last_became_active":"2024-04-18T04:44:34.337938+0000","last_became_peered":"2024-04-18T04:44:34.337938+0000","last_unstale":"2024-04-18T04:44:34.685732+0000","last_undegraded":"2024-04-18T04:44:34.685732+0000","last_fullsized":"2024-04-18T04:44:34.685732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:48.827970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.271558+0000","last_change":"2024-04-18T04:44:29.903118+0000","last_active":"2024-04-18T04:44:35.271558+0000","last_peered":"2024-04-18T04:44:35.271558+0000","last_clean":"2024-04-18T04:44:35.271558+0000","last_became_active":"2024-04-18T04:44:29.902611+0000","last_became_peered":"2024-04-18T04:44:29.902611+0000","last_unstale":"2024-04-18T04:44:35.271558+0000","last_undegraded":"2024-04-18T04:44:35.271558+0000","last_fullsized":"2024-04-18T04:44:35.271558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:38:42.595095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.307515+0000","last_change":"2024-04-18T04:44:30.301328+0000","last_active":"2024-04-18T04:44:34.307515+0000","last_peered":"2024-04-18T04:44:34.307515+0000","last_clean":"2024-04-18T04:44:34.307515+0000","last_became_active":"2024-04-18T04:44:30.300303+0000","last_became_peered":"2024-04-18T04:44:30.300303+0000","last_unstale":"2024-04-18T04:44:34.307515+0000","last_undegraded":"2024-04-18T04:44:34.307515+0000","last_fullsized":"2024-04-18T04:44:34.307515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:24:11.941483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.685077+0000","last_change":"2024-04-18T04:44:34.327044+0000","last_active":"2024-04-18T04:44:34.685077+0000","last_peered":"2024-04-18T04:44:34.685077+0000","last_clean":"2024-04-18T04:44:34.685077+0000","last_became_active":"2024-04-18T04:44:34.326161+0000","last_became_peered":"2024-04-18T04:44:34.326161+0000","last_unstale":"2024-04-18T04:44:34.685077+0000","last_undegraded":"2024-04-18T04:44:34.685077+0000","last_fullsized":"2024-04-18T04:44:34.685077+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:47:41.413530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.288881+0000","last_change":"2024-04-18T04:44:30.296493+0000","last_active":"2024-04-18T04:44:34.288881+0000","last_peered":"2024-04-18T04:44:34.288881+0000","last_clean":"2024-04-18T04:44:34.288881+0000","last_became_active":"2024-04-18T04:44:30.295657+0000","last_became_peered":"2024-04-18T04:44:30.295657+0000","last_unstale":"2024-04-18T04:44:34.288881+0000","last_undegraded":"2024-04-18T04:44:34.288881+0000","last_fullsized":"2024-04-18T04:44:34.288881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:39:40.270643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:45:01.954923+0000","last_change":"2024-04-18T04:44:29.900036+0000","last_active":"2024-04-18T04:45:01.954923+0000","last_peered":"2024-04-18T04:45:01.954923+0000","last_clean":"2024-04-18T04:45:01.954923+0000","last_became_active":"2024-04-18T04:44:29.899402+0000","last_became_peered":"2024-04-18T04:44:29.899402+0000","last_unstale":"2024-04-18T04:45:01.954923+0000","last_undegraded":"2024-04-18T04:45:01.954923+0000","last_fullsized":"2024-04-18T04:45:01.954923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:45:51.681317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.686484+0000","last_change":"2024-04-18T04:44:34.320846+0000","last_active":"2024-04-18T04:44:34.686484+0000","last_peered":"2024-04-18T04:44:34.686484+0000","last_clean":"2024-04-18T04:44:34.686484+0000","last_became_active":"2024-04-18T04:44:34.319868+0000","last_became_peered":"2024-04-18T04:44:34.319868+0000","last_unstale":"2024-04-18T04:44:34.686484+0000","last_undegraded":"2024-04-18T04:44:34.686484+0000","last_fullsized":"2024-04-18T04:44:34.686484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:08:30.863140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.289171+0000","last_change":"2024-04-18T04:44:30.271756+0000","last_active":"2024-04-18T04:44:34.289171+0000","last_peered":"2024-04-18T04:44:34.289171+0000","last_clean":"2024-04-18T04:44:34.289171+0000","last_became_active":"2024-04-18T04:44:30.271420+0000","last_became_peered":"2024-04-18T04:44:30.271420+0000","last_unstale":"2024-04-18T04:44:34.289171+0000","last_undegraded":"2024-04-18T04:44:34.289171+0000","last_fullsized":"2024-04-18T04:44:34.289171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:27:18.559327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.296649+0000","last_change":"2024-04-18T04:44:29.878416+0000","last_active":"2024-04-18T04:44:34.296649+0000","last_peered":"2024-04-18T04:44:34.296649+0000","last_clean":"2024-04-18T04:44:34.296649+0000","last_became_active":"2024-04-18T04:44:29.878139+0000","last_became_peered":"2024-04-18T04:44:29.878139+0000","last_unstale":"2024-04-18T04:44:34.296649+0000","last_undegraded":"2024-04-18T04:44:34.296649+0000","last_fullsized":"2024-04-18T04:44:34.296649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:19:00.769888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.685503+0000","last_change":"2024-04-18T04:44:34.346123+0000","last_active":"2024-04-18T04:44:34.685503+0000","last_peered":"2024-04-18T04:44:34.685503+0000","last_clean":"2024-04-18T04:44:34.685503+0000","last_became_active":"2024-04-18T04:44:34.345267+0000","last_became_peered":"2024-04-18T04:44:34.345267+0000","last_unstale":"2024-04-18T04:44:34.685503+0000","last_undegraded":"2024-04-18T04:44:34.685503+0000","last_fullsized":"2024-04-18T04:44:34.685503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:14:08.078650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.289001+0000","last_change":"2024-04-18T04:44:30.274049+0000","last_active":"2024-04-18T04:44:34.289001+0000","last_peered":"2024-04-18T04:44:34.289001+0000","last_clean":"2024-04-18T04:44:34.289001+0000","last_became_active":"2024-04-18T04:44:30.273752+0000","last_became_peered":"2024-04-18T04:44:30.273752+0000","last_unstale":"2024-04-18T04:44:34.289001+0000","last_undegraded":"2024-04-18T04:44:34.289001+0000","last_fullsized":"2024-04-18T04:44:34.289001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:48:20.479069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.297586+0000","last_change":"2024-04-18T04:44:29.890569+0000","last_active":"2024-04-18T04:44:34.297586+0000","last_peered":"2024-04-18T04:44:34.297586+0000","last_clean":"2024-04-18T04:44:34.297586+0000","last_became_active":"2024-04-18T04:44:29.889684+0000","last_became_peered":"2024-04-18T04:44:29.889684+0000","last_unstale":"2024-04-18T04:44:34.297586+0000","last_undegraded":"2024-04-18T04:44:34.297586+0000","last_fullsized":"2024-04-18T04:44:34.297586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:53:00.230580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.202946+0000","last_change":"2024-04-18T04:44:34.313634+0000","last_active":"2024-04-18T04:44:35.202946+0000","last_peered":"2024-04-18T04:44:35.202946+0000","last_clean":"2024-04-18T04:44:35.202946+0000","last_became_active":"2024-04-18T04:44:34.313161+0000","last_became_peered":"2024-04-18T04:44:34.313161+0000","last_unstale":"2024-04-18T04:44:35.202946+0000","last_undegraded":"2024-04-18T04:44:35.202946+0000","last_fullsized":"2024-04-18T04:44:35.202946+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:01:07.805128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.302215+0000","last_change":"2024-04-18T04:44:30.284805+0000","last_active":"2024-04-18T04:44:34.302215+0000","last_peered":"2024-04-18T04:44:34.302215+0000","last_clean":"2024-04-18T04:44:34.302215+0000","last_became_active":"2024-04-18T04:44:30.279238+0000","last_became_peered":"2024-04-18T04:44:30.279238+0000","last_unstale":"2024-04-18T04:44:34.302215+0000","last_undegraded":"2024-04-18T04:44:34.302215+0000","last_fullsized":"2024-04-18T04:44:34.302215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:59:24.067420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:45:01.956448+0000","last_change":"2024-04-18T04:44:29.890816+0000","last_active":"2024-04-18T04:45:01.956448+0000","last_peered":"2024-04-18T04:45:01.956448+0000","last_clean":"2024-04-18T04:45:01.956448+0000","last_became_active":"2024-04-18T04:44:29.890272+0000","last_became_peered":"2024-04-18T04:44:29.890272+0000","last_unstale":"2024-04-18T04:45:01.956448+0000","last_undegraded":"2024-04-18T04:45:01.956448+0000","last_fullsized":"2024-04-18T04:45:01.956448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:30:22.614083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.686347+0000","last_change":"2024-04-18T04:44:34.344973+0000","last_active":"2024-04-18T04:44:34.686347+0000","last_peered":"2024-04-18T04:44:34.686347+0000","last_clean":"2024-04-18T04:44:34.686347+0000","last_became_active":"2024-04-18T04:44:34.344007+0000","last_became_peered":"2024-04-18T04:44:34.344007+0000","last_unstale":"2024-04-18T04:44:34.686347+0000","last_undegraded":"2024-04-18T04:44:34.686347+0000","last_fullsized":"2024-04-18T04:44:34.686347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:56:43.476132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.288547+0000","last_change":"2024-04-18T04:44:30.278193+0000","last_active":"2024-04-18T04:44:34.288547+0000","last_peered":"2024-04-18T04:44:34.288547+0000","last_clean":"2024-04-18T04:44:34.288547+0000","last_became_active":"2024-04-18T04:44:30.277916+0000","last_became_peered":"2024-04-18T04:44:30.277916+0000","last_unstale":"2024-04-18T04:44:34.288547+0000","last_undegraded":"2024-04-18T04:44:34.288547+0000","last_fullsized":"2024-04-18T04:44:34.288547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:57:19.783436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:45:01.957250+0000","last_change":"2024-04-18T04:44:29.896901+0000","last_active":"2024-04-18T04:45:01.957250+0000","last_peered":"2024-04-18T04:45:01.957250+0000","last_clean":"2024-04-18T04:45:01.957250+0000","last_became_active":"2024-04-18T04:44:29.896392+0000","last_became_peered":"2024-04-18T04:44:29.896392+0000","last_unstale":"2024-04-18T04:45:01.957250+0000","last_undegraded":"2024-04-18T04:45:01.957250+0000","last_fullsized":"2024-04-18T04:45:01.957250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:46:08.869450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.684375+0000","last_change":"2024-04-18T04:44:34.339233+0000","last_active":"2024-04-18T04:44:34.684375+0000","last_peered":"2024-04-18T04:44:34.684375+0000","last_clean":"2024-04-18T04:44:34.684375+0000","last_became_active":"2024-04-18T04:44:34.338294+0000","last_became_peered":"2024-04-18T04:44:34.338294+0000","last_unstale":"2024-04-18T04:44:34.684375+0000","last_undegraded":"2024-04-18T04:44:34.684375+0000","last_fullsized":"2024-04-18T04:44:34.684375+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:20:35.738410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.291990+0000","last_change":"2024-04-18T04:44:30.305051+0000","last_active":"2024-04-18T04:44:34.291990+0000","last_peered":"2024-04-18T04:44:34.291990+0000","last_clean":"2024-04-18T04:44:34.291990+0000","last_became_active":"2024-04-18T04:44:30.304741+0000","last_became_peered":"2024-04-18T04:44:30.304741+0000","last_unstale":"2024-04-18T04:44:34.291990+0000","last_undegraded":"2024-04-18T04:44:34.291990+0000","last_fullsized":"2024-04-18T04:44:34.291990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:38:03.346015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.203014+0000","last_change":"2024-04-18T04:44:29.894503+0000","last_active":"2024-04-18T04:44:35.203014+0000","last_peered":"2024-04-18T04:44:35.203014+0000","last_clean":"2024-04-18T04:44:35.203014+0000","last_became_active":"2024-04-18T04:44:29.894210+0000","last_became_peered":"2024-04-18T04:44:29.894210+0000","last_unstale":"2024-04-18T04:44:35.203014+0000","last_undegraded":"2024-04-18T04:44:35.203014+0000","last_fullsized":"2024-04-18T04:44:35.203014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:14:56.979204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.680679+0000","last_change":"2024-04-18T04:44:34.305652+0000","last_active":"2024-04-18T04:44:34.680679+0000","last_peered":"2024-04-18T04:44:34.680679+0000","last_clean":"2024-04-18T04:44:34.680679+0000","last_became_active":"2024-04-18T04:44:34.305180+0000","last_became_peered":"2024-04-18T04:44:34.305180+0000","last_unstale":"2024-04-18T04:44:34.680679+0000","last_undegraded":"2024-04-18T04:44:34.680679+0000","last_fullsized":"2024-04-18T04:44:34.680679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:03:10.781821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.296680+0000","last_change":"2024-04-18T04:44:30.267158+0000","last_active":"2024-04-18T04:44:34.296680+0000","last_peered":"2024-04-18T04:44:34.296680+0000","last_clean":"2024-04-18T04:44:34.296680+0000","last_became_active":"2024-04-18T04:44:30.266814+0000","last_became_peered":"2024-04-18T04:44:30.266814+0000","last_unstale":"2024-04-18T04:44:34.296680+0000","last_undegraded":"2024-04-18T04:44:34.296680+0000","last_fullsized":"2024-04-18T04:44:34.296680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:16:02.152817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.687771+0000","last_change":"2024-04-18T04:44:29.898812+0000","last_active":"2024-04-18T04:44:34.687771+0000","last_peered":"2024-04-18T04:44:34.687771+0000","last_clean":"2024-04-18T04:44:34.687771+0000","last_became_active":"2024-04-18T04:44:29.897156+0000","last_became_peered":"2024-04-18T04:44:29.897156+0000","last_unstale":"2024-04-18T04:44:34.687771+0000","last_undegraded":"2024-04-18T04:44:34.687771+0000","last_fullsized":"2024-04-18T04:44:34.687771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:09:47.746394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.188051+0000","last_change":"2024-04-18T04:44:34.324721+0000","last_active":"2024-04-18T04:44:35.188051+0000","last_peered":"2024-04-18T04:44:35.188051+0000","last_clean":"2024-04-18T04:44:35.188051+0000","last_became_active":"2024-04-18T04:44:34.322925+0000","last_became_peered":"2024-04-18T04:44:34.322925+0000","last_unstale":"2024-04-18T04:44:35.188051+0000","last_undegraded":"2024-04-18T04:44:35.188051+0000","last_fullsized":"2024-04-18T04:44:35.188051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:11:59.682230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.311311+0000","last_change":"2024-04-18T04:44:30.281640+0000","last_active":"2024-04-18T04:44:34.311311+0000","last_peered":"2024-04-18T04:44:34.311311+0000","last_clean":"2024-04-18T04:44:34.311311+0000","last_became_active":"2024-04-18T04:44:30.280968+0000","last_became_peered":"2024-04-18T04:44:30.280968+0000","last_unstale":"2024-04-18T04:44:34.311311+0000","last_undegraded":"2024-04-18T04:44:34.311311+0000","last_fullsized":"2024-04-18T04:44:34.311311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:35:20.755711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.296757+0000","last_change":"2024-04-18T04:44:29.882715+0000","last_active":"2024-04-18T04:44:34.296757+0000","last_peered":"2024-04-18T04:44:34.296757+0000","last_clean":"2024-04-18T04:44:34.296757+0000","last_became_active":"2024-04-18T04:44:29.882335+0000","last_became_peered":"2024-04-18T04:44:29.882335+0000","last_unstale":"2024-04-18T04:44:34.296757+0000","last_undegraded":"2024-04-18T04:44:34.296757+0000","last_fullsized":"2024-04-18T04:44:34.296757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:32:59.709151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.202122+0000","last_change":"2024-04-18T04:44:34.325029+0000","last_active":"2024-04-18T04:44:35.202122+0000","last_peered":"2024-04-18T04:44:35.202122+0000","last_clean":"2024-04-18T04:44:35.202122+0000","last_became_active":"2024-04-18T04:44:34.324082+0000","last_became_peered":"2024-04-18T04:44:34.324082+0000","last_unstale":"2024-04-18T04:44:35.202122+0000","last_undegraded":"2024-04-18T04:44:35.202122+0000","last_fullsized":"2024-04-18T04:44:35.202122+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:28:10.378037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.311743+0000","last_change":"2024-04-18T04:44:30.276174+0000","last_active":"2024-04-18T04:44:34.311743+0000","last_peered":"2024-04-18T04:44:34.311743+0000","last_clean":"2024-04-18T04:44:34.311743+0000","last_became_active":"2024-04-18T04:44:30.270878+0000","last_became_peered":"2024-04-18T04:44:30.270878+0000","last_unstale":"2024-04-18T04:44:34.311743+0000","last_undegraded":"2024-04-18T04:44:34.311743+0000","last_fullsized":"2024-04-18T04:44:34.311743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:35:12.296277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.309548+0000","last_change":"2024-04-18T04:44:29.896745+0000","last_active":"2024-04-18T04:44:34.309548+0000","last_peered":"2024-04-18T04:44:34.309548+0000","last_clean":"2024-04-18T04:44:34.309548+0000","last_became_active":"2024-04-18T04:44:29.896199+0000","last_became_peered":"2024-04-18T04:44:29.896199+0000","last_unstale":"2024-04-18T04:44:34.309548+0000","last_undegraded":"2024-04-18T04:44:34.309548+0000","last_fullsized":"2024-04-18T04:44:34.309548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:25:05.424668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.202607+0000","last_change":"2024-04-18T04:44:34.337429+0000","last_active":"2024-04-18T04:44:35.202607+0000","last_peered":"2024-04-18T04:44:35.202607+0000","last_clean":"2024-04-18T04:44:35.202607+0000","last_became_active":"2024-04-18T04:44:34.337089+0000","last_became_peered":"2024-04-18T04:44:34.337089+0000","last_unstale":"2024-04-18T04:44:35.202607+0000","last_undegraded":"2024-04-18T04:44:35.202607+0000","last_fullsized":"2024-04-18T04:44:35.202607+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:00:56.976431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.297789+0000","last_change":"2024-04-18T04:44:30.270874+0000","last_active":"2024-04-18T04:44:34.297789+0000","last_peered":"2024-04-18T04:44:34.297789+0000","last_clean":"2024-04-18T04:44:34.297789+0000","last_became_active":"2024-04-18T04:44:30.270636+0000","last_became_peered":"2024-04-18T04:44:30.270636+0000","last_unstale":"2024-04-18T04:44:34.297789+0000","last_undegraded":"2024-04-18T04:44:34.297789+0000","last_fullsized":"2024-04-18T04:44:34.297789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:25:49.889554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.285207+0000","last_change":"2024-04-18T04:44:29.878607+0000","last_active":"2024-04-18T04:44:34.285207+0000","last_peered":"2024-04-18T04:44:34.285207+0000","last_clean":"2024-04-18T04:44:34.285207+0000","last_became_active":"2024-04-18T04:44:29.878330+0000","last_became_peered":"2024-04-18T04:44:29.878330+0000","last_unstale":"2024-04-18T04:44:34.285207+0000","last_undegraded":"2024-04-18T04:44:34.285207+0000","last_fullsized":"2024-04-18T04:44:34.285207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:09:18.088701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.202964+0000","last_change":"2024-04-18T04:44:34.323315+0000","last_active":"2024-04-18T04:44:35.202964+0000","last_peered":"2024-04-18T04:44:35.202964+0000","last_clean":"2024-04-18T04:44:35.202964+0000","last_became_active":"2024-04-18T04:44:34.322983+0000","last_became_peered":"2024-04-18T04:44:34.322983+0000","last_unstale":"2024-04-18T04:44:35.202964+0000","last_undegraded":"2024-04-18T04:44:35.202964+0000","last_fullsized":"2024-04-18T04:44:35.202964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:48:12.803273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287313+0000","last_change":"2024-04-18T04:44:30.285533+0000","last_active":"2024-04-18T04:44:34.287313+0000","last_peered":"2024-04-18T04:44:34.287313+0000","last_clean":"2024-04-18T04:44:34.287313+0000","last_became_active":"2024-04-18T04:44:30.285113+0000","last_became_peered":"2024-04-18T04:44:30.285113+0000","last_unstale":"2024-04-18T04:44:34.287313+0000","last_undegraded":"2024-04-18T04:44:34.287313+0000","last_fullsized":"2024-04-18T04:44:34.287313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:37:20.367349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.683785+0000","last_change":"2024-04-18T04:44:29.890701+0000","last_active":"2024-04-18T04:44:34.683785+0000","last_peered":"2024-04-18T04:44:34.683785+0000","last_clean":"2024-04-18T04:44:34.683785+0000","last_became_active":"2024-04-18T04:44:29.890207+0000","last_became_peered":"2024-04-18T04:44:29.890207+0000","last_unstale":"2024-04-18T04:44:34.683785+0000","last_undegraded":"2024-04-18T04:44:34.683785+0000","last_fullsized":"2024-04-18T04:44:34.683785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:06:58.470725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.188159+0000","last_change":"2024-04-18T04:44:34.306858+0000","last_active":"2024-04-18T04:44:35.188159+0000","last_peered":"2024-04-18T04:44:35.188159+0000","last_clean":"2024-04-18T04:44:35.188159+0000","last_became_active":"2024-04-18T04:44:34.306123+0000","last_became_peered":"2024-04-18T04:44:34.306123+0000","last_unstale":"2024-04-18T04:44:35.188159+0000","last_undegraded":"2024-04-18T04:44:35.188159+0000","last_fullsized":"2024-04-18T04:44:35.188159+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:13:26.389394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.289157+0000","last_change":"2024-04-18T04:44:30.306826+0000","last_active":"2024-04-18T04:44:34.289157+0000","last_peered":"2024-04-18T04:44:34.289157+0000","last_clean":"2024-04-18T04:44:34.289157+0000","last_became_active":"2024-04-18T04:44:30.306320+0000","last_became_peered":"2024-04-18T04:44:30.306320+0000","last_unstale":"2024-04-18T04:44:34.289157+0000","last_undegraded":"2024-04-18T04:44:34.289157+0000","last_fullsized":"2024-04-18T04:44:34.289157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:47:38.564197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:45:01.959725+0000","last_change":"2024-04-18T04:44:29.888023+0000","last_active":"2024-04-18T04:45:01.959725+0000","last_peered":"2024-04-18T04:45:01.959725+0000","last_clean":"2024-04-18T04:45:01.959725+0000","last_became_active":"2024-04-18T04:44:29.887440+0000","last_became_peered":"2024-04-18T04:44:29.887440+0000","last_unstale":"2024-04-18T04:45:01.959725+0000","last_undegraded":"2024-04-18T04:45:01.959725+0000","last_fullsized":"2024-04-18T04:45:01.959725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:07:01.067445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287497+0000","last_change":"2024-04-18T04:44:18.629794+0000","last_active":"2024-04-18T04:44:34.287497+0000","last_peered":"2024-04-18T04:44:34.287497+0000","last_clean":"2024-04-18T04:44:34.287497+0000","last_became_active":"2024-04-18T04:44:18.627792+0000","last_became_peered":"2024-04-18T04:44:18.627792+0000","last_unstale":"2024-04-18T04:44:34.287497+0000","last_undegraded":"2024-04-18T04:44:34.287497+0000","last_fullsized":"2024-04-18T04:44:34.287497+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:17.410146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:17.410146+0000","last_clean_scrub_stamp":"2024-04-18T04:44:17.410146+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:30:49.101656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.203752+0000","last_change":"2024-04-18T04:44:34.333286+0000","last_active":"2024-04-18T04:44:35.203752+0000","last_peered":"2024-04-18T04:44:35.203752+0000","last_clean":"2024-04-18T04:44:35.203752+0000","last_became_active":"2024-04-18T04:44:34.332520+0000","last_became_peered":"2024-04-18T04:44:34.332520+0000","last_unstale":"2024-04-18T04:44:35.203752+0000","last_undegraded":"2024-04-18T04:44:35.203752+0000","last_fullsized":"2024-04-18T04:44:35.203752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:58:48.264040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.295974+0000","last_change":"2024-04-18T04:44:30.303602+0000","last_active":"2024-04-18T04:44:34.295974+0000","last_peered":"2024-04-18T04:44:34.295974+0000","last_clean":"2024-04-18T04:44:34.295974+0000","last_became_active":"2024-04-18T04:44:30.302157+0000","last_became_peered":"2024-04-18T04:44:30.302157+0000","last_unstale":"2024-04-18T04:44:34.295974+0000","last_undegraded":"2024-04-18T04:44:34.295974+0000","last_fullsized":"2024-04-18T04:44:34.295974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:09:57.582065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.285561+0000","last_change":"2024-04-18T04:44:29.890428+0000","last_active":"2024-04-18T04:44:34.285561+0000","last_peered":"2024-04-18T04:44:34.285561+0000","last_clean":"2024-04-18T04:44:34.285561+0000","last_became_active":"2024-04-18T04:44:29.890166+0000","last_became_peered":"2024-04-18T04:44:29.890166+0000","last_unstale":"2024-04-18T04:44:34.285561+0000","last_undegraded":"2024-04-18T04:44:34.285561+0000","last_fullsized":"2024-04-18T04:44:34.285561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:21:16.823377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.202663+0000","last_change":"2024-04-18T04:44:34.334071+0000","last_active":"2024-04-18T04:44:35.202663+0000","last_peered":"2024-04-18T04:44:35.202663+0000","last_clean":"2024-04-18T04:44:35.202663+0000","last_became_active":"2024-04-18T04:44:34.332695+0000","last_became_peered":"2024-04-18T04:44:34.332695+0000","last_unstale":"2024-04-18T04:44:35.202663+0000","last_undegraded":"2024-04-18T04:44:35.202663+0000","last_fullsized":"2024-04-18T04:44:35.202663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:22:52.371921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.309847+0000","last_change":"2024-04-18T04:44:30.287908+0000","last_active":"2024-04-18T04:44:34.309847+0000","last_peered":"2024-04-18T04:44:34.309847+0000","last_clean":"2024-04-18T04:44:34.309847+0000","last_became_active":"2024-04-18T04:44:30.287217+0000","last_became_peered":"2024-04-18T04:44:30.287217+0000","last_unstale":"2024-04-18T04:44:34.309847+0000","last_undegraded":"2024-04-18T04:44:34.309847+0000","last_fullsized":"2024-04-18T04:44:34.309847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:47:14.962330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.202737+0000","last_change":"2024-04-18T04:44:29.886376+0000","last_active":"2024-04-18T04:44:35.202737+0000","last_peered":"2024-04-18T04:44:35.202737+0000","last_clean":"2024-04-18T04:44:35.202737+0000","last_became_active":"2024-04-18T04:44:29.886058+0000","last_became_peered":"2024-04-18T04:44:29.886058+0000","last_unstale":"2024-04-18T04:44:35.202737+0000","last_undegraded":"2024-04-18T04:44:35.202737+0000","last_fullsized":"2024-04-18T04:44:35.202737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:29:59.678071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.188072+0000","last_change":"2024-04-18T04:44:34.323046+0000","last_active":"2024-04-18T04:44:35.188072+0000","last_peered":"2024-04-18T04:44:35.188072+0000","last_clean":"2024-04-18T04:44:35.188072+0000","last_became_active":"2024-04-18T04:44:34.322785+0000","last_became_peered":"2024-04-18T04:44:34.322785+0000","last_unstale":"2024-04-18T04:44:35.188072+0000","last_undegraded":"2024-04-18T04:44:35.188072+0000","last_fullsized":"2024-04-18T04:44:35.188072+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:53:47.315572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.293500+0000","last_change":"2024-04-18T04:44:30.289872+0000","last_active":"2024-04-18T04:44:34.293500+0000","last_peered":"2024-04-18T04:44:34.293500+0000","last_clean":"2024-04-18T04:44:34.293500+0000","last_became_active":"2024-04-18T04:44:30.288606+0000","last_became_peered":"2024-04-18T04:44:30.288606+0000","last_unstale":"2024-04-18T04:44:34.293500+0000","last_undegraded":"2024-04-18T04:44:34.293500+0000","last_fullsized":"2024-04-18T04:44:34.293500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:00:57.740649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.267690+0000","last_change":"2024-04-18T04:44:29.878650+0000","last_active":"2024-04-18T04:44:35.267690+0000","last_peered":"2024-04-18T04:44:35.267690+0000","last_clean":"2024-04-18T04:44:35.267690+0000","last_became_active":"2024-04-18T04:44:29.878361+0000","last_became_peered":"2024-04-18T04:44:29.878361+0000","last_unstale":"2024-04-18T04:44:35.267690+0000","last_undegraded":"2024-04-18T04:44:35.267690+0000","last_fullsized":"2024-04-18T04:44:35.267690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:57:41.162118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.202529+0000","last_change":"2024-04-18T04:44:34.339023+0000","last_active":"2024-04-18T04:44:35.202529+0000","last_peered":"2024-04-18T04:44:35.202529+0000","last_clean":"2024-04-18T04:44:35.202529+0000","last_became_active":"2024-04-18T04:44:34.338042+0000","last_became_peered":"2024-04-18T04:44:34.338042+0000","last_unstale":"2024-04-18T04:44:35.202529+0000","last_undegraded":"2024-04-18T04:44:35.202529+0000","last_fullsized":"2024-04-18T04:44:35.202529+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:48:58.174635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.290165+0000","last_change":"2024-04-18T04:44:30.291740+0000","last_active":"2024-04-18T04:44:34.290165+0000","last_peered":"2024-04-18T04:44:34.290165+0000","last_clean":"2024-04-18T04:44:34.290165+0000","last_became_active":"2024-04-18T04:44:30.290379+0000","last_became_peered":"2024-04-18T04:44:30.290379+0000","last_unstale":"2024-04-18T04:44:34.290165+0000","last_undegraded":"2024-04-18T04:44:34.290165+0000","last_fullsized":"2024-04-18T04:44:34.290165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:44:25.111858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.686910+0000","last_change":"2024-04-18T04:44:29.882833+0000","last_active":"2024-04-18T04:44:34.686910+0000","last_peered":"2024-04-18T04:44:34.686910+0000","last_clean":"2024-04-18T04:44:34.686910+0000","last_became_active":"2024-04-18T04:44:29.881671+0000","last_became_peered":"2024-04-18T04:44:29.881671+0000","last_unstale":"2024-04-18T04:44:34.686910+0000","last_undegraded":"2024-04-18T04:44:34.686910+0000","last_fullsized":"2024-04-18T04:44:34.686910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:29:22.037641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.684253+0000","last_change":"2024-04-18T04:44:34.342465+0000","last_active":"2024-04-18T04:44:34.684253+0000","last_peered":"2024-04-18T04:44:34.684253+0000","last_clean":"2024-04-18T04:44:34.684253+0000","last_became_active":"2024-04-18T04:44:34.340327+0000","last_became_peered":"2024-04-18T04:44:34.340327+0000","last_unstale":"2024-04-18T04:44:34.684253+0000","last_undegraded":"2024-04-18T04:44:34.684253+0000","last_fullsized":"2024-04-18T04:44:34.684253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:31:44.168899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287509+0000","last_change":"2024-04-18T04:44:30.299403+0000","last_active":"2024-04-18T04:44:34.287509+0000","last_peered":"2024-04-18T04:44:34.287509+0000","last_clean":"2024-04-18T04:44:34.287509+0000","last_became_active":"2024-04-18T04:44:30.298417+0000","last_became_peered":"2024-04-18T04:44:30.298417+0000","last_unstale":"2024-04-18T04:44:34.287509+0000","last_undegraded":"2024-04-18T04:44:34.287509+0000","last_fullsized":"2024-04-18T04:44:34.287509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:43:24.120294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.271251+0000","last_change":"2024-04-18T04:44:29.875345+0000","last_active":"2024-04-18T04:44:35.271251+0000","last_peered":"2024-04-18T04:44:35.271251+0000","last_clean":"2024-04-18T04:44:35.271251+0000","last_became_active":"2024-04-18T04:44:29.875059+0000","last_became_peered":"2024-04-18T04:44:29.875059+0000","last_unstale":"2024-04-18T04:44:35.271251+0000","last_undegraded":"2024-04-18T04:44:35.271251+0000","last_fullsized":"2024-04-18T04:44:35.271251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:06:54.218096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.188129+0000","last_change":"2024-04-18T04:44:34.334498+0000","last_active":"2024-04-18T04:44:35.188129+0000","last_peered":"2024-04-18T04:44:35.188129+0000","last_clean":"2024-04-18T04:44:35.188129+0000","last_became_active":"2024-04-18T04:44:34.334192+0000","last_became_peered":"2024-04-18T04:44:34.334192+0000","last_unstale":"2024-04-18T04:44:35.188129+0000","last_undegraded":"2024-04-18T04:44:35.188129+0000","last_fullsized":"2024-04-18T04:44:35.188129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:15:49.669556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287990+0000","last_change":"2024-04-18T04:44:30.298289+0000","last_active":"2024-04-18T04:44:34.287990+0000","last_peered":"2024-04-18T04:44:34.287990+0000","last_clean":"2024-04-18T04:44:34.287990+0000","last_became_active":"2024-04-18T04:44:30.295404+0000","last_became_peered":"2024-04-18T04:44:30.295404+0000","last_unstale":"2024-04-18T04:44:34.287990+0000","last_undegraded":"2024-04-18T04:44:34.287990+0000","last_fullsized":"2024-04-18T04:44:34.287990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:10:32.465032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.288381+0000","last_change":"2024-04-18T04:44:29.894196+0000","last_active":"2024-04-18T04:44:34.288381+0000","last_peered":"2024-04-18T04:44:34.288381+0000","last_clean":"2024-04-18T04:44:34.288381+0000","last_became_active":"2024-04-18T04:44:29.893668+0000","last_became_peered":"2024-04-18T04:44:29.893668+0000","last_unstale":"2024-04-18T04:44:34.288381+0000","last_undegraded":"2024-04-18T04:44:34.288381+0000","last_fullsized":"2024-04-18T04:44:34.288381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:39:03.812043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.681603+0000","last_change":"2024-04-18T04:44:34.339050+0000","last_active":"2024-04-18T04:44:34.681603+0000","last_peered":"2024-04-18T04:44:34.681603+0000","last_clean":"2024-04-18T04:44:34.681603+0000","last_became_active":"2024-04-18T04:44:34.338877+0000","last_became_peered":"2024-04-18T04:44:34.338877+0000","last_unstale":"2024-04-18T04:44:34.681603+0000","last_undegraded":"2024-04-18T04:44:34.681603+0000","last_fullsized":"2024-04-18T04:44:34.681603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:09:17.919847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.288247+0000","last_change":"2024-04-18T04:44:30.289122+0000","last_active":"2024-04-18T04:44:34.288247+0000","last_peered":"2024-04-18T04:44:34.288247+0000","last_clean":"2024-04-18T04:44:34.288247+0000","last_became_active":"2024-04-18T04:44:30.288364+0000","last_became_peered":"2024-04-18T04:44:30.288364+0000","last_unstale":"2024-04-18T04:44:34.288247+0000","last_undegraded":"2024-04-18T04:44:34.288247+0000","last_fullsized":"2024-04-18T04:44:34.288247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:04:02.162723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:45:01.959067+0000","last_change":"2024-04-18T04:44:29.894521+0000","last_active":"2024-04-18T04:45:01.959067+0000","last_peered":"2024-04-18T04:45:01.959067+0000","last_clean":"2024-04-18T04:45:01.959067+0000","last_became_active":"2024-04-18T04:44:29.889150+0000","last_became_peered":"2024-04-18T04:44:29.889150+0000","last_unstale":"2024-04-18T04:45:01.959067+0000","last_undegraded":"2024-04-18T04:45:01.959067+0000","last_fullsized":"2024-04-18T04:45:01.959067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:39:13.323434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.681213+0000","last_change":"2024-04-18T04:44:34.305657+0000","last_active":"2024-04-18T04:44:34.681213+0000","last_peered":"2024-04-18T04:44:34.681213+0000","last_clean":"2024-04-18T04:44:34.681213+0000","last_became_active":"2024-04-18T04:44:34.305341+0000","last_became_peered":"2024-04-18T04:44:34.305341+0000","last_unstale":"2024-04-18T04:44:34.681213+0000","last_undegraded":"2024-04-18T04:44:34.681213+0000","last_fullsized":"2024-04-18T04:44:34.681213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:32:39.937173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287291+0000","last_change":"2024-04-18T04:44:30.307042+0000","last_active":"2024-04-18T04:44:34.287291+0000","last_peered":"2024-04-18T04:44:34.287291+0000","last_clean":"2024-04-18T04:44:34.287291+0000","last_became_active":"2024-04-18T04:44:30.306726+0000","last_became_peered":"2024-04-18T04:44:30.306726+0000","last_unstale":"2024-04-18T04:44:34.287291+0000","last_undegraded":"2024-04-18T04:44:34.287291+0000","last_fullsized":"2024-04-18T04:44:34.287291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:55:33.543142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.273530+0000","last_change":"2024-04-18T04:44:29.887498+0000","last_active":"2024-04-18T04:44:35.273530+0000","last_peered":"2024-04-18T04:44:35.273530+0000","last_clean":"2024-04-18T04:44:35.273530+0000","last_became_active":"2024-04-18T04:44:29.887095+0000","last_became_peered":"2024-04-18T04:44:29.887095+0000","last_unstale":"2024-04-18T04:44:35.273530+0000","last_undegraded":"2024-04-18T04:44:35.273530+0000","last_fullsized":"2024-04-18T04:44:35.273530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:54:34.700562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.203621+0000","last_change":"2024-04-18T04:44:34.322042+0000","last_active":"2024-04-18T04:44:35.203621+0000","last_peered":"2024-04-18T04:44:35.203621+0000","last_clean":"2024-04-18T04:44:35.203621+0000","last_became_active":"2024-04-18T04:44:34.320776+0000","last_became_peered":"2024-04-18T04:44:34.320776+0000","last_unstale":"2024-04-18T04:44:35.203621+0000","last_undegraded":"2024-04-18T04:44:35.203621+0000","last_fullsized":"2024-04-18T04:44:35.203621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:53:47.399337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.295755+0000","last_change":"2024-04-18T04:44:30.299413+0000","last_active":"2024-04-18T04:44:34.295755+0000","last_peered":"2024-04-18T04:44:34.295755+0000","last_clean":"2024-04-18T04:44:34.295755+0000","last_became_active":"2024-04-18T04:44:30.293185+0000","last_became_peered":"2024-04-18T04:44:30.293185+0000","last_unstale":"2024-04-18T04:44:34.295755+0000","last_undegraded":"2024-04-18T04:44:34.295755+0000","last_fullsized":"2024-04-18T04:44:34.295755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:43:53.831429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'11","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:45:01.958466+0000","last_change":"2024-04-18T04:44:29.893351+0000","last_active":"2024-04-18T04:45:01.958466+0000","last_peered":"2024-04-18T04:45:01.958466+0000","last_clean":"2024-04-18T04:45:01.958466+0000","last_became_active":"2024-04-18T04:44:29.892647+0000","last_became_peered":"2024-04-18T04:44:29.892647+0000","last_unstale":"2024-04-18T04:45:01.958466+0000","last_undegraded":"2024-04-18T04:45:01.958466+0000","last_fullsized":"2024-04-18T04:45:01.958466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:16:59.759149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3796,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.202231+0000","last_change":"2024-04-18T04:44:34.337866+0000","last_active":"2024-04-18T04:44:35.202231+0000","last_peered":"2024-04-18T04:44:35.202231+0000","last_clean":"2024-04-18T04:44:35.202231+0000","last_became_active":"2024-04-18T04:44:34.337486+0000","last_became_peered":"2024-04-18T04:44:34.337486+0000","last_unstale":"2024-04-18T04:44:35.202231+0000","last_undegraded":"2024-04-18T04:44:35.202231+0000","last_fullsized":"2024-04-18T04:44:35.202231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:42:13.751926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.304604+0000","last_change":"2024-04-18T04:44:30.308477+0000","last_active":"2024-04-18T04:44:34.304604+0000","last_peered":"2024-04-18T04:44:34.304604+0000","last_clean":"2024-04-18T04:44:34.304604+0000","last_became_active":"2024-04-18T04:44:30.307237+0000","last_became_peered":"2024-04-18T04:44:30.307237+0000","last_unstale":"2024-04-18T04:44:34.304604+0000","last_undegraded":"2024-04-18T04:44:34.304604+0000","last_fullsized":"2024-04-18T04:44:34.304604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:33:58.300542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.271124+0000","last_change":"2024-04-18T04:44:29.898488+0000","last_active":"2024-04-18T04:44:35.271124+0000","last_peered":"2024-04-18T04:44:35.271124+0000","last_clean":"2024-04-18T04:44:35.271124+0000","last_became_active":"2024-04-18T04:44:29.898113+0000","last_became_peered":"2024-04-18T04:44:29.898113+0000","last_unstale":"2024-04-18T04:44:35.271124+0000","last_undegraded":"2024-04-18T04:44:35.271124+0000","last_fullsized":"2024-04-18T04:44:35.271124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:11:14.585142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.685293+0000","last_change":"2024-04-18T04:44:34.344769+0000","last_active":"2024-04-18T04:44:34.685293+0000","last_peered":"2024-04-18T04:44:34.685293+0000","last_clean":"2024-04-18T04:44:34.685293+0000","last_became_active":"2024-04-18T04:44:34.343636+0000","last_became_peered":"2024-04-18T04:44:34.343636+0000","last_unstale":"2024-04-18T04:44:34.685293+0000","last_undegraded":"2024-04-18T04:44:34.685293+0000","last_fullsized":"2024-04-18T04:44:34.685293+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:45:09.481681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287417+0000","last_change":"2024-04-18T04:44:30.290494+0000","last_active":"2024-04-18T04:44:34.287417+0000","last_peered":"2024-04-18T04:44:34.287417+0000","last_clean":"2024-04-18T04:44:34.287417+0000","last_became_active":"2024-04-18T04:44:30.290127+0000","last_became_peered":"2024-04-18T04:44:30.290127+0000","last_unstale":"2024-04-18T04:44:34.287417+0000","last_undegraded":"2024-04-18T04:44:34.287417+0000","last_fullsized":"2024-04-18T04:44:34.287417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:34:21.239813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:45:01.957145+0000","last_change":"2024-04-18T04:44:29.895686+0000","last_active":"2024-04-18T04:45:01.957145+0000","last_peered":"2024-04-18T04:45:01.957145+0000","last_clean":"2024-04-18T04:45:01.957145+0000","last_became_active":"2024-04-18T04:44:29.895083+0000","last_became_peered":"2024-04-18T04:44:29.895083+0000","last_unstale":"2024-04-18T04:45:01.957145+0000","last_undegraded":"2024-04-18T04:45:01.957145+0000","last_fullsized":"2024-04-18T04:45:01.957145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:27:17.897401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.680895+0000","last_change":"2024-04-18T04:44:34.338412+0000","last_active":"2024-04-18T04:44:34.680895+0000","last_peered":"2024-04-18T04:44:34.680895+0000","last_clean":"2024-04-18T04:44:34.680895+0000","last_became_active":"2024-04-18T04:44:34.338062+0000","last_became_peered":"2024-04-18T04:44:34.338062+0000","last_unstale":"2024-04-18T04:44:34.680895+0000","last_undegraded":"2024-04-18T04:44:34.680895+0000","last_fullsized":"2024-04-18T04:44:34.680895+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:49:28.342905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.307374+0000","last_change":"2024-04-18T04:44:30.307946+0000","last_active":"2024-04-18T04:44:34.307374+0000","last_peered":"2024-04-18T04:44:34.307374+0000","last_clean":"2024-04-18T04:44:34.307374+0000","last_became_active":"2024-04-18T04:44:30.307168+0000","last_became_peered":"2024-04-18T04:44:30.307168+0000","last_unstale":"2024-04-18T04:44:34.307374+0000","last_undegraded":"2024-04-18T04:44:34.307374+0000","last_fullsized":"2024-04-18T04:44:34.307374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:43:56.218333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"25'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:45:01.958267+0000","last_change":"2024-04-18T04:44:29.903183+0000","last_active":"2024-04-18T04:45:01.958267+0000","last_peered":"2024-04-18T04:45:01.958267+0000","last_clean":"2024-04-18T04:45:01.958267+0000","last_became_active":"2024-04-18T04:44:29.902647+0000","last_became_peered":"2024-04-18T04:44:29.902647+0000","last_unstale":"2024-04-18T04:45:01.958267+0000","last_undegraded":"2024-04-18T04:45:01.958267+0000","last_fullsized":"2024-04-18T04:45:01.958267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:45:13.009571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.680985+0000","last_change":"2024-04-18T04:44:34.338653+0000","last_active":"2024-04-18T04:44:34.680985+0000","last_peered":"2024-04-18T04:44:34.680985+0000","last_clean":"2024-04-18T04:44:34.680985+0000","last_became_active":"2024-04-18T04:44:34.338288+0000","last_became_peered":"2024-04-18T04:44:34.338288+0000","last_unstale":"2024-04-18T04:44:34.680985+0000","last_undegraded":"2024-04-18T04:44:34.680985+0000","last_fullsized":"2024-04-18T04:44:34.680985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:58:27.654288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.188114+0000","last_change":"2024-04-18T04:44:34.306999+0000","last_active":"2024-04-18T04:44:35.188114+0000","last_peered":"2024-04-18T04:44:35.188114+0000","last_clean":"2024-04-18T04:44:35.188114+0000","last_became_active":"2024-04-18T04:44:34.306657+0000","last_became_peered":"2024-04-18T04:44:34.306657+0000","last_unstale":"2024-04-18T04:44:35.188114+0000","last_undegraded":"2024-04-18T04:44:35.188114+0000","last_fullsized":"2024-04-18T04:44:35.188114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:52:58.512928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.297434+0000","last_change":"2024-04-18T04:44:30.271947+0000","last_active":"2024-04-18T04:44:34.297434+0000","last_peered":"2024-04-18T04:44:34.297434+0000","last_clean":"2024-04-18T04:44:34.297434+0000","last_became_active":"2024-04-18T04:44:30.271619+0000","last_became_peered":"2024-04-18T04:44:30.271619+0000","last_unstale":"2024-04-18T04:44:34.297434+0000","last_undegraded":"2024-04-18T04:44:34.297434+0000","last_fullsized":"2024-04-18T04:44:34.297434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:32:11.612016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.203226+0000","last_change":"2024-04-18T04:44:29.897616+0000","last_active":"2024-04-18T04:44:35.203226+0000","last_peered":"2024-04-18T04:44:35.203226+0000","last_clean":"2024-04-18T04:44:35.203226+0000","last_became_active":"2024-04-18T04:44:29.889922+0000","last_became_peered":"2024-04-18T04:44:29.889922+0000","last_unstale":"2024-04-18T04:44:35.203226+0000","last_undegraded":"2024-04-18T04:44:35.203226+0000","last_fullsized":"2024-04-18T04:44:35.203226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:11:52.717768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.204973+0000","last_change":"2024-04-18T04:44:34.333403+0000","last_active":"2024-04-18T04:44:35.204973+0000","last_peered":"2024-04-18T04:44:35.204973+0000","last_clean":"2024-04-18T04:44:35.204973+0000","last_became_active":"2024-04-18T04:44:34.332551+0000","last_became_peered":"2024-04-18T04:44:34.332551+0000","last_unstale":"2024-04-18T04:44:35.204973+0000","last_undegraded":"2024-04-18T04:44:35.204973+0000","last_fullsized":"2024-04-18T04:44:35.204973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:33:28.594002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.288936+0000","last_change":"2024-04-18T04:44:30.271099+0000","last_active":"2024-04-18T04:44:34.288936+0000","last_peered":"2024-04-18T04:44:34.288936+0000","last_clean":"2024-04-18T04:44:34.288936+0000","last_became_active":"2024-04-18T04:44:30.270804+0000","last_became_peered":"2024-04-18T04:44:30.270804+0000","last_unstale":"2024-04-18T04:44:34.288936+0000","last_undegraded":"2024-04-18T04:44:34.288936+0000","last_fullsized":"2024-04-18T04:44:34.288936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:18:27.955171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.289697+0000","last_change":"2024-04-18T04:44:29.895084+0000","last_active":"2024-04-18T04:44:34.289697+0000","last_peered":"2024-04-18T04:44:34.289697+0000","last_clean":"2024-04-18T04:44:34.289697+0000","last_became_active":"2024-04-18T04:44:29.894829+0000","last_became_peered":"2024-04-18T04:44:29.894829+0000","last_unstale":"2024-04-18T04:44:34.289697+0000","last_undegraded":"2024-04-18T04:44:34.289697+0000","last_fullsized":"2024-04-18T04:44:34.289697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:54.812428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.203324+0000","last_change":"2024-04-18T04:44:29.892826+0000","last_active":"2024-04-18T04:44:35.203324+0000","last_peered":"2024-04-18T04:44:35.203324+0000","last_clean":"2024-04-18T04:44:35.203324+0000","last_became_active":"2024-04-18T04:44:29.892282+0000","last_became_peered":"2024-04-18T04:44:29.892282+0000","last_unstale":"2024-04-18T04:44:35.203324+0000","last_undegraded":"2024-04-18T04:44:35.203324+0000","last_fullsized":"2024-04-18T04:44:35.203324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:02.844116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.288503+0000","last_change":"2024-04-18T04:44:30.285312+0000","last_active":"2024-04-18T04:44:34.288503+0000","last_peered":"2024-04-18T04:44:34.288503+0000","last_clean":"2024-04-18T04:44:34.288503+0000","last_became_active":"2024-04-18T04:44:30.285055+0000","last_became_peered":"2024-04-18T04:44:30.285055+0000","last_unstale":"2024-04-18T04:44:34.288503+0000","last_undegraded":"2024-04-18T04:44:34.288503+0000","last_fullsized":"2024-04-18T04:44:34.288503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:50:00.641018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.790995+0000","last_change":"2024-04-18T04:44:34.323352+0000","last_active":"2024-04-18T04:44:34.790995+0000","last_peered":"2024-04-18T04:44:34.790995+0000","last_clean":"2024-04-18T04:44:34.790995+0000","last_became_active":"2024-04-18T04:44:34.321645+0000","last_became_peered":"2024-04-18T04:44:34.321645+0000","last_unstale":"2024-04-18T04:44:34.790995+0000","last_undegraded":"2024-04-18T04:44:34.790995+0000","last_fullsized":"2024-04-18T04:44:34.790995+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:33:27.387013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.681203+0000","last_change":"2024-04-18T04:44:29.891865+0000","last_active":"2024-04-18T04:44:34.681203+0000","last_peered":"2024-04-18T04:44:34.681203+0000","last_clean":"2024-04-18T04:44:34.681203+0000","last_became_active":"2024-04-18T04:44:29.891610+0000","last_became_peered":"2024-04-18T04:44:29.891610+0000","last_unstale":"2024-04-18T04:44:34.681203+0000","last_undegraded":"2024-04-18T04:44:34.681203+0000","last_fullsized":"2024-04-18T04:44:34.681203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:36:42.266497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.310919+0000","last_change":"2024-04-18T04:44:30.279080+0000","last_active":"2024-04-18T04:44:34.310919+0000","last_peered":"2024-04-18T04:44:34.310919+0000","last_clean":"2024-04-18T04:44:34.310919+0000","last_became_active":"2024-04-18T04:44:30.278275+0000","last_became_peered":"2024-04-18T04:44:30.278275+0000","last_unstale":"2024-04-18T04:44:34.310919+0000","last_undegraded":"2024-04-18T04:44:34.310919+0000","last_fullsized":"2024-04-18T04:44:34.310919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:51:48.272703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.681364+0000","last_change":"2024-04-18T04:44:34.313835+0000","last_active":"2024-04-18T04:44:34.681364+0000","last_peered":"2024-04-18T04:44:34.681364+0000","last_clean":"2024-04-18T04:44:34.681364+0000","last_became_active":"2024-04-18T04:44:34.313416+0000","last_became_peered":"2024-04-18T04:44:34.313416+0000","last_unstale":"2024-04-18T04:44:34.681364+0000","last_undegraded":"2024-04-18T04:44:34.681364+0000","last_fullsized":"2024-04-18T04:44:34.681364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:57:47.245809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287790+0000","last_change":"2024-04-18T04:44:30.297229+0000","last_active":"2024-04-18T04:44:34.287790+0000","last_peered":"2024-04-18T04:44:34.287790+0000","last_clean":"2024-04-18T04:44:34.287790+0000","last_became_active":"2024-04-18T04:44:30.296354+0000","last_became_peered":"2024-04-18T04:44:30.296354+0000","last_unstale":"2024-04-18T04:44:34.287790+0000","last_undegraded":"2024-04-18T04:44:34.287790+0000","last_fullsized":"2024-04-18T04:44:34.287790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:30:35.845106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.285182+0000","last_change":"2024-04-18T04:44:30.281213+0000","last_active":"2024-04-18T04:44:34.285182+0000","last_peered":"2024-04-18T04:44:34.285182+0000","last_clean":"2024-04-18T04:44:34.285182+0000","last_became_active":"2024-04-18T04:44:30.280941+0000","last_became_peered":"2024-04-18T04:44:30.280941+0000","last_unstale":"2024-04-18T04:44:34.285182+0000","last_undegraded":"2024-04-18T04:44:34.285182+0000","last_fullsized":"2024-04-18T04:44:34.285182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:15:37.795670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.307313+0000","last_change":"2024-04-18T04:44:30.288507+0000","last_active":"2024-04-18T04:44:34.307313+0000","last_peered":"2024-04-18T04:44:34.307313+0000","last_clean":"2024-04-18T04:44:34.307313+0000","last_became_active":"2024-04-18T04:44:30.287820+0000","last_became_peered":"2024-04-18T04:44:30.287820+0000","last_unstale":"2024-04-18T04:44:34.307313+0000","last_undegraded":"2024-04-18T04:44:34.307313+0000","last_fullsized":"2024-04-18T04:44:34.307313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:25:29.500586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.288460+0000","last_change":"2024-04-18T04:44:30.273278+0000","last_active":"2024-04-18T04:44:34.288460+0000","last_peered":"2024-04-18T04:44:34.288460+0000","last_clean":"2024-04-18T04:44:34.288460+0000","last_became_active":"2024-04-18T04:44:30.272973+0000","last_became_peered":"2024-04-18T04:44:30.272973+0000","last_unstale":"2024-04-18T04:44:34.288460+0000","last_undegraded":"2024-04-18T04:44:34.288460+0000","last_fullsized":"2024-04-18T04:44:34.288460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:37:02.421925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.292341+0000","last_change":"2024-04-18T04:44:30.298936+0000","last_active":"2024-04-18T04:44:34.292341+0000","last_peered":"2024-04-18T04:44:34.292341+0000","last_clean":"2024-04-18T04:44:34.292341+0000","last_became_active":"2024-04-18T04:44:30.298637+0000","last_became_peered":"2024-04-18T04:44:30.298637+0000","last_unstale":"2024-04-18T04:44:34.292341+0000","last_undegraded":"2024-04-18T04:44:34.292341+0000","last_fullsized":"2024-04-18T04:44:34.292341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:04:33.188772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.296348+0000","last_change":"2024-04-18T04:44:30.274613+0000","last_active":"2024-04-18T04:44:34.296348+0000","last_peered":"2024-04-18T04:44:34.296348+0000","last_clean":"2024-04-18T04:44:34.296348+0000","last_became_active":"2024-04-18T04:44:30.274328+0000","last_became_peered":"2024-04-18T04:44:30.274328+0000","last_unstale":"2024-04-18T04:44:34.296348+0000","last_undegraded":"2024-04-18T04:44:34.296348+0000","last_fullsized":"2024-04-18T04:44:34.296348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:55:41.700955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.290317+0000","last_change":"2024-04-18T04:44:30.309403+0000","last_active":"2024-04-18T04:44:34.290317+0000","last_peered":"2024-04-18T04:44:34.290317+0000","last_clean":"2024-04-18T04:44:34.290317+0000","last_became_active":"2024-04-18T04:44:30.308415+0000","last_became_peered":"2024-04-18T04:44:30.308415+0000","last_unstale":"2024-04-18T04:44:34.290317+0000","last_undegraded":"2024-04-18T04:44:34.290317+0000","last_fullsized":"2024-04-18T04:44:34.290317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:51:58.935503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.291911+0000","last_change":"2024-04-18T04:44:30.293996+0000","last_active":"2024-04-18T04:44:34.291911+0000","last_peered":"2024-04-18T04:44:34.291911+0000","last_clean":"2024-04-18T04:44:34.291911+0000","last_became_active":"2024-04-18T04:44:30.293748+0000","last_became_peered":"2024-04-18T04:44:30.293748+0000","last_unstale":"2024-04-18T04:44:34.291911+0000","last_undegraded":"2024-04-18T04:44:34.291911+0000","last_fullsized":"2024-04-18T04:44:34.291911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:18:32.116499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.306956+0000","last_change":"2024-04-18T04:44:30.312850+0000","last_active":"2024-04-18T04:44:34.306956+0000","last_peered":"2024-04-18T04:44:34.306956+0000","last_clean":"2024-04-18T04:44:34.306956+0000","last_became_active":"2024-04-18T04:44:30.304701+0000","last_became_peered":"2024-04-18T04:44:30.304701+0000","last_unstale":"2024-04-18T04:44:34.306956+0000","last_undegraded":"2024-04-18T04:44:34.306956+0000","last_fullsized":"2024-04-18T04:44:34.306956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:01:39.253277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.289625+0000","last_change":"2024-04-18T04:44:30.285836+0000","last_active":"2024-04-18T04:44:34.289625+0000","last_peered":"2024-04-18T04:44:34.289625+0000","last_clean":"2024-04-18T04:44:34.289625+0000","last_became_active":"2024-04-18T04:44:30.285602+0000","last_became_peered":"2024-04-18T04:44:30.285602+0000","last_unstale":"2024-04-18T04:44:34.289625+0000","last_undegraded":"2024-04-18T04:44:34.289625+0000","last_fullsized":"2024-04-18T04:44:34.289625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:34:39.594780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.306887+0000","last_change":"2024-04-18T04:44:30.307940+0000","last_active":"2024-04-18T04:44:34.306887+0000","last_peered":"2024-04-18T04:44:34.306887+0000","last_clean":"2024-04-18T04:44:34.306887+0000","last_became_active":"2024-04-18T04:44:30.307224+0000","last_became_peered":"2024-04-18T04:44:30.307224+0000","last_unstale":"2024-04-18T04:44:34.306887+0000","last_undegraded":"2024-04-18T04:44:34.306887+0000","last_fullsized":"2024-04-18T04:44:34.306887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:30:52.000855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.288405+0000","last_change":"2024-04-18T04:44:30.310229+0000","last_active":"2024-04-18T04:44:34.288405+0000","last_peered":"2024-04-18T04:44:34.288405+0000","last_clean":"2024-04-18T04:44:34.288405+0000","last_became_active":"2024-04-18T04:44:30.310045+0000","last_became_peered":"2024-04-18T04:44:30.310045+0000","last_unstale":"2024-04-18T04:44:34.288405+0000","last_undegraded":"2024-04-18T04:44:34.288405+0000","last_fullsized":"2024-04-18T04:44:34.288405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:22:55.588300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.289109+0000","last_change":"2024-04-18T04:44:30.305644+0000","last_active":"2024-04-18T04:44:34.289109+0000","last_peered":"2024-04-18T04:44:34.289109+0000","last_clean":"2024-04-18T04:44:34.289109+0000","last_became_active":"2024-04-18T04:44:30.304921+0000","last_became_peered":"2024-04-18T04:44:30.304921+0000","last_unstale":"2024-04-18T04:44:34.289109+0000","last_undegraded":"2024-04-18T04:44:34.289109+0000","last_fullsized":"2024-04-18T04:44:34.289109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:17:37.235711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.296403+0000","last_change":"2024-04-18T04:44:30.294105+0000","last_active":"2024-04-18T04:44:34.296403+0000","last_peered":"2024-04-18T04:44:34.296403+0000","last_clean":"2024-04-18T04:44:34.296403+0000","last_became_active":"2024-04-18T04:44:30.291742+0000","last_became_peered":"2024-04-18T04:44:30.291742+0000","last_unstale":"2024-04-18T04:44:34.296403+0000","last_undegraded":"2024-04-18T04:44:34.296403+0000","last_fullsized":"2024-04-18T04:44:34.296403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:43:26.428261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.284984+0000","last_change":"2024-04-18T04:44:30.296496+0000","last_active":"2024-04-18T04:44:34.284984+0000","last_peered":"2024-04-18T04:44:34.284984+0000","last_clean":"2024-04-18T04:44:34.284984+0000","last_became_active":"2024-04-18T04:44:30.296177+0000","last_became_peered":"2024-04-18T04:44:30.296177+0000","last_unstale":"2024-04-18T04:44:34.284984+0000","last_undegraded":"2024-04-18T04:44:34.284984+0000","last_fullsized":"2024-04-18T04:44:34.284984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:46:44.829326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.310435+0000","last_change":"2024-04-18T04:44:30.306568+0000","last_active":"2024-04-18T04:44:34.310435+0000","last_peered":"2024-04-18T04:44:34.310435+0000","last_clean":"2024-04-18T04:44:34.310435+0000","last_became_active":"2024-04-18T04:44:30.305674+0000","last_became_peered":"2024-04-18T04:44:30.305674+0000","last_unstale":"2024-04-18T04:44:34.310435+0000","last_undegraded":"2024-04-18T04:44:34.310435+0000","last_fullsized":"2024-04-18T04:44:34.310435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:58:10.740164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.306735+0000","last_change":"2024-04-18T04:44:30.307297+0000","last_active":"2024-04-18T04:44:34.306735+0000","last_peered":"2024-04-18T04:44:34.306735+0000","last_clean":"2024-04-18T04:44:34.306735+0000","last_became_active":"2024-04-18T04:44:30.305470+0000","last_became_peered":"2024-04-18T04:44:30.305470+0000","last_unstale":"2024-04-18T04:44:34.306735+0000","last_undegraded":"2024-04-18T04:44:34.306735+0000","last_fullsized":"2024-04-18T04:44:34.306735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:01:00.587115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.297511+0000","last_change":"2024-04-18T04:44:30.280849+0000","last_active":"2024-04-18T04:44:34.297511+0000","last_peered":"2024-04-18T04:44:34.297511+0000","last_clean":"2024-04-18T04:44:34.297511+0000","last_became_active":"2024-04-18T04:44:30.280535+0000","last_became_peered":"2024-04-18T04:44:30.280535+0000","last_unstale":"2024-04-18T04:44:34.297511+0000","last_undegraded":"2024-04-18T04:44:34.297511+0000","last_fullsized":"2024-04-18T04:44:34.297511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:01:06.241941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287205+0000","last_change":"2024-04-18T04:44:30.278849+0000","last_active":"2024-04-18T04:44:34.287205+0000","last_peered":"2024-04-18T04:44:34.287205+0000","last_clean":"2024-04-18T04:44:34.287205+0000","last_became_active":"2024-04-18T04:44:30.278624+0000","last_became_peered":"2024-04-18T04:44:30.278624+0000","last_unstale":"2024-04-18T04:44:34.287205+0000","last_undegraded":"2024-04-18T04:44:34.287205+0000","last_fullsized":"2024-04-18T04:44:34.287205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:31:30.791150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.289094+0000","last_change":"2024-04-18T04:44:30.296148+0000","last_active":"2024-04-18T04:44:34.289094+0000","last_peered":"2024-04-18T04:44:34.289094+0000","last_clean":"2024-04-18T04:44:34.289094+0000","last_became_active":"2024-04-18T04:44:30.295754+0000","last_became_peered":"2024-04-18T04:44:30.295754+0000","last_unstale":"2024-04-18T04:44:34.289094+0000","last_undegraded":"2024-04-18T04:44:34.289094+0000","last_fullsized":"2024-04-18T04:44:34.289094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:39:53.809075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.304251+0000","last_change":"2024-04-18T04:44:30.298061+0000","last_active":"2024-04-18T04:44:34.304251+0000","last_peered":"2024-04-18T04:44:34.304251+0000","last_clean":"2024-04-18T04:44:34.304251+0000","last_became_active":"2024-04-18T04:44:30.297416+0000","last_became_peered":"2024-04-18T04:44:30.297416+0000","last_unstale":"2024-04-18T04:44:34.304251+0000","last_undegraded":"2024-04-18T04:44:34.304251+0000","last_fullsized":"2024-04-18T04:44:34.304251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:35:48.612670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.290793+0000","last_change":"2024-04-18T04:44:30.292802+0000","last_active":"2024-04-18T04:44:34.290793+0000","last_peered":"2024-04-18T04:44:34.290793+0000","last_clean":"2024-04-18T04:44:34.290793+0000","last_became_active":"2024-04-18T04:44:30.291939+0000","last_became_peered":"2024-04-18T04:44:30.291939+0000","last_unstale":"2024-04-18T04:44:34.290793+0000","last_undegraded":"2024-04-18T04:44:34.290793+0000","last_fullsized":"2024-04-18T04:44:34.290793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:33:04.689561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.290104+0000","last_change":"2024-04-18T04:44:30.309020+0000","last_active":"2024-04-18T04:44:34.290104+0000","last_peered":"2024-04-18T04:44:34.290104+0000","last_clean":"2024-04-18T04:44:34.290104+0000","last_became_active":"2024-04-18T04:44:30.307604+0000","last_became_peered":"2024-04-18T04:44:30.307604+0000","last_unstale":"2024-04-18T04:44:34.290104+0000","last_undegraded":"2024-04-18T04:44:34.290104+0000","last_fullsized":"2024-04-18T04:44:34.290104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:44:54.764284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.293307+0000","last_change":"2024-04-18T04:44:30.314533+0000","last_active":"2024-04-18T04:44:34.293307+0000","last_peered":"2024-04-18T04:44:34.293307+0000","last_clean":"2024-04-18T04:44:34.293307+0000","last_became_active":"2024-04-18T04:44:30.313985+0000","last_became_peered":"2024-04-18T04:44:30.313985+0000","last_unstale":"2024-04-18T04:44:34.293307+0000","last_undegraded":"2024-04-18T04:44:34.293307+0000","last_fullsized":"2024-04-18T04:44:34.293307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:02:03.941709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.288844+0000","last_change":"2024-04-18T04:44:30.309273+0000","last_active":"2024-04-18T04:44:34.288844+0000","last_peered":"2024-04-18T04:44:34.288844+0000","last_clean":"2024-04-18T04:44:34.288844+0000","last_became_active":"2024-04-18T04:44:30.309002+0000","last_became_peered":"2024-04-18T04:44:30.309002+0000","last_unstale":"2024-04-18T04:44:34.288844+0000","last_undegraded":"2024-04-18T04:44:34.288844+0000","last_fullsized":"2024-04-18T04:44:34.288844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:49:10.005359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287466+0000","last_change":"2024-04-18T04:44:30.292371+0000","last_active":"2024-04-18T04:44:34.287466+0000","last_peered":"2024-04-18T04:44:34.287466+0000","last_clean":"2024-04-18T04:44:34.287466+0000","last_became_active":"2024-04-18T04:44:30.290504+0000","last_became_peered":"2024-04-18T04:44:30.290504+0000","last_unstale":"2024-04-18T04:44:34.287466+0000","last_undegraded":"2024-04-18T04:44:34.287466+0000","last_fullsized":"2024-04-18T04:44:34.287466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:11.998355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.306657+0000","last_change":"2024-04-18T04:44:30.299935+0000","last_active":"2024-04-18T04:44:34.306657+0000","last_peered":"2024-04-18T04:44:34.306657+0000","last_clean":"2024-04-18T04:44:34.306657+0000","last_became_active":"2024-04-18T04:44:30.290175+0000","last_became_peered":"2024-04-18T04:44:30.290175+0000","last_unstale":"2024-04-18T04:44:34.306657+0000","last_undegraded":"2024-04-18T04:44:34.306657+0000","last_fullsized":"2024-04-18T04:44:34.306657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:15:13.703423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.288026+0000","last_change":"2024-04-18T04:44:30.288940+0000","last_active":"2024-04-18T04:44:34.288026+0000","last_peered":"2024-04-18T04:44:34.288026+0000","last_clean":"2024-04-18T04:44:34.288026+0000","last_became_active":"2024-04-18T04:44:30.288131+0000","last_became_peered":"2024-04-18T04:44:30.288131+0000","last_unstale":"2024-04-18T04:44:34.288026+0000","last_undegraded":"2024-04-18T04:44:34.288026+0000","last_fullsized":"2024-04-18T04:44:34.288026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:31:08.895305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.307235+0000","last_change":"2024-04-18T04:44:30.288066+0000","last_active":"2024-04-18T04:44:34.307235+0000","last_peered":"2024-04-18T04:44:34.307235+0000","last_clean":"2024-04-18T04:44:34.307235+0000","last_became_active":"2024-04-18T04:44:30.287325+0000","last_became_peered":"2024-04-18T04:44:30.287325+0000","last_unstale":"2024-04-18T04:44:34.307235+0000","last_undegraded":"2024-04-18T04:44:34.307235+0000","last_fullsized":"2024-04-18T04:44:34.307235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:58:04.111225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287906+0000","last_change":"2024-04-18T04:44:30.275485+0000","last_active":"2024-04-18T04:44:34.287906+0000","last_peered":"2024-04-18T04:44:34.287906+0000","last_clean":"2024-04-18T04:44:34.287906+0000","last_became_active":"2024-04-18T04:44:30.275118+0000","last_became_peered":"2024-04-18T04:44:30.275118+0000","last_unstale":"2024-04-18T04:44:34.287906+0000","last_undegraded":"2024-04-18T04:44:34.287906+0000","last_fullsized":"2024-04-18T04:44:34.287906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:25:09.625660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.296349+0000","last_change":"2024-04-18T04:44:30.277119+0000","last_active":"2024-04-18T04:44:34.296349+0000","last_peered":"2024-04-18T04:44:34.296349+0000","last_clean":"2024-04-18T04:44:34.296349+0000","last_became_active":"2024-04-18T04:44:30.276654+0000","last_became_peered":"2024-04-18T04:44:30.276654+0000","last_unstale":"2024-04-18T04:44:34.296349+0000","last_undegraded":"2024-04-18T04:44:34.296349+0000","last_fullsized":"2024-04-18T04:44:34.296349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:52.420199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.293115+0000","last_change":"2024-04-18T04:44:30.302905+0000","last_active":"2024-04-18T04:44:34.293115+0000","last_peered":"2024-04-18T04:44:34.293115+0000","last_clean":"2024-04-18T04:44:34.293115+0000","last_became_active":"2024-04-18T04:44:30.302180+0000","last_became_peered":"2024-04-18T04:44:30.302180+0000","last_unstale":"2024-04-18T04:44:34.293115+0000","last_undegraded":"2024-04-18T04:44:34.293115+0000","last_fullsized":"2024-04-18T04:44:34.293115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:41:53.211956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4706,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":10096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":63,"ondisk_log_size":63,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66624,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509452,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":106163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":102367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]}]},{"osd":1,"up_from":15,"seq":64424509451,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":102527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]}]},{"osd":7,"up_from":14,"seq":60129542157,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":693317,"data_compressed":33312,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542155,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":106253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]}]},{"osd":5,"up_from":14,"seq":60129542157,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":262144,"data_stored":102457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542157,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":102493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2230000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.165}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":335872,"data_stored":693373,"data_compressed":33312,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33312,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33312,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T04:45:04.688 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T04:45:04.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.861+0000 7f845be00640 1 Processor -- start 2024-04-18T04:45:04.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.861+0000 7f845be00640 1 -- start start 2024-04-18T04:45:04.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.861+0000 7f845be00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f84541573c0 0x7f845406fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:04.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.861+0000 7f845be00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84540ccee0 0x7f84540cd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:04.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.861+0000 7f845be00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84541577d0 con 0x7f84541515e0 2024-04-18T04:45:04.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.861+0000 7f845be00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84540c3120 con 0x7f84541573c0 2024-04-18T04:45:04.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.861+0000 7f845be00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84540ca990 con 0x7f84540ccee0 2024-04-18T04:45:04.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.861+0000 7f8459400640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f84541515e0 0x7f84540ca280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:59266/0 (socket says 172.21.15.120:59266) 2024-04-18T04:45:04.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.861+0000 7f8459400640 1 -- 172.21.15.120:0/1208608252 learned_addr learned my addr 172.21.15.120:0/1208608252 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:45:04.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.861+0000 7f8459e00640 1 --2- 172.21.15.120:0/1208608252 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84540ccee0 0x7f84540cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:04.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.865+0000 7f8458a00640 1 --2- 172.21.15.120:0/1208608252 >> v2:172.21.15.132:3300/0 conn(0x7f84541573c0 0x7f845406fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:04.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.865+0000 7f8453e00640 1 -- 172.21.15.120:0/1208608252 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2675173916 0 0) 0x7f84541577d0 con 0x7f84541515e0 2024-04-18T04:45:04.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.865+0000 7f8453e00640 1 -- 172.21.15.120:0/1208608252 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f843c003530 con 0x7f84541515e0 2024-04-18T04:45:04.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.865+0000 7f8453e00640 1 -- 172.21.15.120:0/1208608252 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2622809778 0 0) 0x7f843c003530 con 0x7f84541515e0 2024-04-18T04:45:04.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.865+0000 7f8453e00640 1 -- 172.21.15.120:0/1208608252 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84540ccee0 msgr2=0x7f84540cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:04.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.865+0000 7f8453e00640 1 --2- 172.21.15.120:0/1208608252 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84540ccee0 0x7f84540cd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.865+0000 7f8453e00640 1 -- 172.21.15.120:0/1208608252 >> v2:172.21.15.132:3300/0 conn(0x7f84541573c0 msgr2=0x7f845406fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:04.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.865+0000 7f8453e00640 1 --2- 172.21.15.120:0/1208608252 >> v2:172.21.15.132:3300/0 conn(0x7f84541573c0 0x7f845406fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.865+0000 7f8453e00640 1 -- 172.21.15.120:0/1208608252 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8454157a50 con 0x7f84541515e0 2024-04-18T04:45:04.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.865+0000 7f8453e00640 1 -- 172.21.15.120:0/1208608252 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7f8448001680 con 0x7f84541515e0 2024-04-18T04:45:04.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.865+0000 7f8453e00640 1 -- 172.21.15.120:0/1208608252 >> v1:172.21.15.120:6789/0 conn(0x7f84541515e0 legacy=0x7f84540ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:04.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.865+0000 7f8453e00640 1 --2- 172.21.15.120:0/1208608252 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f843c003980 0x7f843c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:04.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.865+0000 7f8453e00640 1 --2- 172.21.15.120:0/1208608252 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f843c0047d0 0x7f843c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:04.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.865+0000 7f8453e00640 1 --2- 172.21.15.120:0/1208608252 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84540ccee0 0x7f843c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:04.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.865+0000 7f8453e00640 1 -- 172.21.15.120:0/1208608252 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84540ca990 con 0x7f843c0047d0 2024-04-18T04:45:04.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.865+0000 7f8453e00640 1 -- 172.21.15.120:0/1208608252 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843c00b990 con 0x7f843c003980 2024-04-18T04:45:04.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.865+0000 7f8453e00640 1 -- 172.21.15.120:0/1208608252 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843c00bad0 con 0x7f84540ccee0 2024-04-18T04:45:04.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.865+0000 7f8458a00640 1 --2- 172.21.15.120:0/1208608252 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f843c0047d0 0x7f843c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:04.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.865+0000 7f8459400640 1 --2- 172.21.15.120:0/1208608252 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f843c003980 0x7f843c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:04.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.865+0000 7f8459e00640 1 --2- 172.21.15.120:0/1208608252 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84540ccee0 0x7f843c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:04.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.865+0000 7f8458a00640 1 -- 172.21.15.120:0/1208608252 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84540ccee0 msgr2=0x7f843c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:04.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.865+0000 7f8458a00640 1 --2- 172.21.15.120:0/1208608252 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84540ccee0 0x7f843c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.865+0000 7f8458a00640 1 -- 172.21.15.120:0/1208608252 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f843c003980 msgr2=0x7f843c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:04.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.865+0000 7f8458a00640 1 --2- 172.21.15.120:0/1208608252 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f843c003980 0x7f843c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.865+0000 7f8458a00640 1 -- 172.21.15.120:0/1208608252 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843c003530 con 0x7f843c0047d0 2024-04-18T04:45:04.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.869+0000 7f8458a00640 1 --2- 172.21.15.120:0/1208608252 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f843c0047d0 0x7f843c004c50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8440009ae0 tx=0x7f844001cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33a008c7d0c19a11 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:04.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.869+0000 7f8453e00640 1 -- 172.21.15.120:0/1208608252 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84400a55c0 con 0x7f843c0047d0 2024-04-18T04:45:04.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.869+0000 7f8453e00640 1 -- 172.21.15.120:0/1208608252 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84400a5720 con 0x7f843c0047d0 2024-04-18T04:45:04.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.869+0000 7f8453e00640 1 -- 172.21.15.120:0/1208608252 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84400a5ad0 con 0x7f843c0047d0 2024-04-18T04:45:04.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.869+0000 7f845be00640 1 -- 172.21.15.120:0/1208608252 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f843c0047d0 msgr2=0x7f843c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:04.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.869+0000 7f845be00640 1 --2- 172.21.15.120:0/1208608252 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f843c0047d0 0x7f843c004c50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8440009ae0 tx=0x7f844001cab0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.869+0000 7f8459e00640 1 -- 172.21.15.120:0/1208608252 reap_dead start 2024-04-18T04:45:04.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.869+0000 7f845be00640 1 -- 172.21.15.120:0/1208608252 shutdown_connections 2024-04-18T04:45:04.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.869+0000 7f845be00640 1 -- 172.21.15.120:0/1208608252 >> 172.21.15.120:0/1208608252 conn(0x7f845406e0f0 msgr2=0x7f8454071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:04.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.869+0000 7f845be00640 1 -- 172.21.15.120:0/1208608252 shutdown_connections 2024-04-18T04:45:04.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.869+0000 7f845be00640 1 -- 172.21.15.120:0/1208608252 wait complete. 2024-04-18T04:45:04.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.869+0000 7f845be00640 1 Processor -- start 2024-04-18T04:45:04.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.869+0000 7f845be00640 1 -- start start 2024-04-18T04:45:04.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.869+0000 7f845be00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f843c0047d0 0x7f84540b2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:04.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.869+0000 7f845be00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84541ecf70 0x7f84541eff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:04.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.869+0000 7f845be00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84541f04b0 0x7f845414b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:04.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.869+0000 7f845be00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8454154140 con 0x7f84541f04b0 2024-04-18T04:45:04.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.869+0000 7f845be00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84541efae0 con 0x7f843c0047d0 2024-04-18T04:45:04.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.869+0000 7f845be00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84541f0930 con 0x7f84541ecf70 2024-04-18T04:45:04.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.869+0000 7f8459e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84541f04b0 0x7f845414b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:04.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.869+0000 7f8459e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84541f04b0 0x7f845414b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34124/0 (socket says 172.21.15.120:34124) 2024-04-18T04:45:04.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.869+0000 7f8459e00640 1 -- 172.21.15.120:0/2895618363 learned_addr learned my addr 172.21.15.120:0/2895618363 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:04.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.873+0000 7f8459400640 1 --2- 172.21.15.120:0/2895618363 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f843c0047d0 0x7f84540b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:04.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.873+0000 7f8458a00640 1 --2- 172.21.15.120:0/2895618363 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84541ecf70 0x7f84541eff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:04.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.873+0000 7f8459e00640 1 -- 172.21.15.120:0/2895618363 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84541ecf70 msgr2=0x7f84541eff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:04.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.873+0000 7f8459e00640 1 --2- 172.21.15.120:0/2895618363 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84541ecf70 0x7f84541eff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.873+0000 7f8459e00640 1 -- 172.21.15.120:0/2895618363 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f843c0047d0 msgr2=0x7f84540b2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:04.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.873+0000 7f8459e00640 1 --2- 172.21.15.120:0/2895618363 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f843c0047d0 0x7f84540b2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:04.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.873+0000 7f8459e00640 1 -- 172.21.15.120:0/2895618363 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84540c5850 con 0x7f84541f04b0 2024-04-18T04:45:04.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.873+0000 7f8459e00640 1 --2- 172.21.15.120:0/2895618363 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84541f04b0 0x7f845414b770 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f844c007d10 tx=0x7f844c0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:04.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.873+0000 7f8451600640 1 -- 172.21.15.120:0/2895618363 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c00e070 con 0x7f84541f04b0 2024-04-18T04:45:04.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.873+0000 7f8451600640 1 -- 172.21.15.120:0/2895618363 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844c011de0 con 0x7f84541f04b0 2024-04-18T04:45:04.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.873+0000 7f8451600640 1 -- 172.21.15.120:0/2895618363 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c0039a0 con 0x7f84541f04b0 2024-04-18T04:45:04.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.873+0000 7f845be00640 1 -- 172.21.15.120:0/2895618363 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84540c5b30 con 0x7f84541f04b0 2024-04-18T04:45:04.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.873+0000 7f845be00640 1 -- 172.21.15.120:0/2895618363 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84540c60f0 con 0x7f84541f04b0 2024-04-18T04:45:04.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.873+0000 7f845be00640 1 -- 172.21.15.120:0/2895618363 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8454067590 con 0x7f84541f04b0 2024-04-18T04:45:04.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.873+0000 7f8451600640 1 -- 172.21.15.120:0/2895618363 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f844c003b00 con 0x7f84541f04b0 2024-04-18T04:45:04.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.873+0000 7f8451600640 1 --2- 172.21.15.120:0/2895618363 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8434066690 0x7f8434068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:04.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.873+0000 7f8451600640 1 -- 172.21.15.120:0/2895618363 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f844c084920 con 0x7f84541f04b0 2024-04-18T04:45:04.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.873+0000 7f8459400640 1 --2- 172.21.15.120:0/2895618363 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8434066690 0x7f8434068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:04.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.877+0000 7f8459400640 1 --2- 172.21.15.120:0/2895618363 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8434066690 0x7f8434068b50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8448001830 tx=0x7f8448007040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:04.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:04.877+0000 7f8451600640 1 -- 172.21.15.120:0/2895618363 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f844c051990 con 0x7f84541f04b0 2024-04-18T04:45:05.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.029+0000 7f845be00640 1 -- 172.21.15.120:0/2895618363 --> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f845406f500 con 0x7f8434066690 2024-04-18T04:45:05.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.057+0000 7f8451600640 1 -- 172.21.15.120:0/2895618363 <== mgr.4113 v2:172.21.15.132:6832/27788 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345430 (secure 0 0 0) 0x7f8448011a20 con 0x7f8434066690 2024-04-18T04:45:05.060 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:45:05.062 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-04-18T04:45:05.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.061+0000 7f845be00640 1 -- 172.21.15.120:0/2895618363 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8434066690 msgr2=0x7f8434068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:05.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.061+0000 7f845be00640 1 --2- 172.21.15.120:0/2895618363 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8434066690 0x7f8434068b50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8448001830 tx=0x7f8448007040 comp rx=0 tx=0).stop 2024-04-18T04:45:05.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.061+0000 7f845be00640 1 -- 172.21.15.120:0/2895618363 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84541f04b0 msgr2=0x7f845414b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:05.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.061+0000 7f845be00640 1 --2- 172.21.15.120:0/2895618363 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84541f04b0 0x7f845414b770 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f844c007d10 tx=0x7f844c0115a0 comp rx=0 tx=0).stop 2024-04-18T04:45:05.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.061+0000 7f845be00640 1 -- 172.21.15.120:0/2895618363 shutdown_connections 2024-04-18T04:45:05.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.061+0000 7f845be00640 1 --2- 172.21.15.120:0/2895618363 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8434066690 0x7f8434068b50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:05.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.061+0000 7f845be00640 1 --2- 172.21.15.120:0/2895618363 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84541f04b0 0x7f845414b770 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:05.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.061+0000 7f845be00640 1 --2- 172.21.15.120:0/2895618363 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84541ecf70 0x7f84541eff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:05.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.061+0000 7f845be00640 1 --2- 172.21.15.120:0/2895618363 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f843c0047d0 0x7f84540b2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:05.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.061+0000 7f845be00640 1 -- 172.21.15.120:0/2895618363 >> 172.21.15.120:0/2895618363 conn(0x7f845406e0f0 msgr2=0x7f845406fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:05.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.061+0000 7f845be00640 1 -- 172.21.15.120:0/2895618363 shutdown_connections 2024-04-18T04:45:05.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.061+0000 7f845be00640 1 -- 172.21.15.120:0/2895618363 wait complete. 2024-04-18T04:45:05.080 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":43,"stamp":"2024-04-18T04:45:04.802072+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596320,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":243,"num_write_kb":2446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":191,"ondisk_log_size":191,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218396,"kb_used_data":2228,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756324,"statfs":{"total":773094113280,"available":772870475776,"internally_reserved":0,"allocated":2281472,"data_stored":2010196,"data_compressed":66624,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1358,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005337"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.271916+0000","last_change":"2024-04-18T04:44:29.891079+0000","last_active":"2024-04-18T04:44:35.271916+0000","last_peered":"2024-04-18T04:44:35.271916+0000","last_clean":"2024-04-18T04:44:35.271916+0000","last_became_active":"2024-04-18T04:44:29.890853+0000","last_became_peered":"2024-04-18T04:44:29.890853+0000","last_unstale":"2024-04-18T04:44:35.271916+0000","last_undegraded":"2024-04-18T04:44:35.271916+0000","last_fullsized":"2024-04-18T04:44:35.271916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:12:22.299583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.293054+0000","last_change":"2024-04-18T04:44:30.296344+0000","last_active":"2024-04-18T04:44:34.293054+0000","last_peered":"2024-04-18T04:44:34.293054+0000","last_clean":"2024-04-18T04:44:34.293054+0000","last_became_active":"2024-04-18T04:44:30.296064+0000","last_became_peered":"2024-04-18T04:44:30.296064+0000","last_unstale":"2024-04-18T04:44:34.293054+0000","last_undegraded":"2024-04-18T04:44:34.293054+0000","last_fullsized":"2024-04-18T04:44:34.293054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:53:32.250308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.680854+0000","last_change":"2024-04-18T04:44:34.306605+0000","last_active":"2024-04-18T04:44:34.680854+0000","last_peered":"2024-04-18T04:44:34.680854+0000","last_clean":"2024-04-18T04:44:34.680854+0000","last_became_active":"2024-04-18T04:44:34.306224+0000","last_became_peered":"2024-04-18T04:44:34.306224+0000","last_unstale":"2024-04-18T04:44:34.680854+0000","last_undegraded":"2024-04-18T04:44:34.680854+0000","last_fullsized":"2024-04-18T04:44:34.680854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:13:15.107711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.681517+0000","last_change":"2024-04-18T04:44:29.881521+0000","last_active":"2024-04-18T04:44:34.681517+0000","last_peered":"2024-04-18T04:44:34.681517+0000","last_clean":"2024-04-18T04:44:34.681517+0000","last_became_active":"2024-04-18T04:44:29.881258+0000","last_became_peered":"2024-04-18T04:44:29.881258+0000","last_unstale":"2024-04-18T04:44:34.681517+0000","last_undegraded":"2024-04-18T04:44:34.681517+0000","last_fullsized":"2024-04-18T04:44:34.681517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:28:40.075960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287377+0000","last_change":"2024-04-18T04:44:30.314205+0000","last_active":"2024-04-18T04:44:34.287377+0000","last_peered":"2024-04-18T04:44:34.287377+0000","last_clean":"2024-04-18T04:44:34.287377+0000","last_became_active":"2024-04-18T04:44:30.313987+0000","last_became_peered":"2024-04-18T04:44:30.313987+0000","last_unstale":"2024-04-18T04:44:34.287377+0000","last_undegraded":"2024-04-18T04:44:34.287377+0000","last_fullsized":"2024-04-18T04:44:34.287377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:55:31.107861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.684278+0000","last_change":"2024-04-18T04:44:34.339646+0000","last_active":"2024-04-18T04:44:34.684278+0000","last_peered":"2024-04-18T04:44:34.684278+0000","last_clean":"2024-04-18T04:44:34.684278+0000","last_became_active":"2024-04-18T04:44:34.338485+0000","last_became_peered":"2024-04-18T04:44:34.338485+0000","last_unstale":"2024-04-18T04:44:34.684278+0000","last_undegraded":"2024-04-18T04:44:34.684278+0000","last_fullsized":"2024-04-18T04:44:34.684278+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:47:01.277301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.272149+0000","last_change":"2024-04-18T04:44:29.897785+0000","last_active":"2024-04-18T04:44:35.272149+0000","last_peered":"2024-04-18T04:44:35.272149+0000","last_clean":"2024-04-18T04:44:35.272149+0000","last_became_active":"2024-04-18T04:44:29.896520+0000","last_became_peered":"2024-04-18T04:44:29.896520+0000","last_unstale":"2024-04-18T04:44:35.272149+0000","last_undegraded":"2024-04-18T04:44:35.272149+0000","last_fullsized":"2024-04-18T04:44:35.272149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:25:52.871139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.307466+0000","last_change":"2024-04-18T04:44:30.300588+0000","last_active":"2024-04-18T04:44:34.307466+0000","last_peered":"2024-04-18T04:44:34.307466+0000","last_clean":"2024-04-18T04:44:34.307466+0000","last_became_active":"2024-04-18T04:44:30.299939+0000","last_became_peered":"2024-04-18T04:44:30.299939+0000","last_unstale":"2024-04-18T04:44:34.307466+0000","last_undegraded":"2024-04-18T04:44:34.307466+0000","last_fullsized":"2024-04-18T04:44:34.307466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:57:07.547985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.685732+0000","last_change":"2024-04-18T04:44:34.338794+0000","last_active":"2024-04-18T04:44:34.685732+0000","last_peered":"2024-04-18T04:44:34.685732+0000","last_clean":"2024-04-18T04:44:34.685732+0000","last_became_active":"2024-04-18T04:44:34.337938+0000","last_became_peered":"2024-04-18T04:44:34.337938+0000","last_unstale":"2024-04-18T04:44:34.685732+0000","last_undegraded":"2024-04-18T04:44:34.685732+0000","last_fullsized":"2024-04-18T04:44:34.685732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:48.827970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.271558+0000","last_change":"2024-04-18T04:44:29.903118+0000","last_active":"2024-04-18T04:44:35.271558+0000","last_peered":"2024-04-18T04:44:35.271558+0000","last_clean":"2024-04-18T04:44:35.271558+0000","last_became_active":"2024-04-18T04:44:29.902611+0000","last_became_peered":"2024-04-18T04:44:29.902611+0000","last_unstale":"2024-04-18T04:44:35.271558+0000","last_undegraded":"2024-04-18T04:44:35.271558+0000","last_fullsized":"2024-04-18T04:44:35.271558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:38:42.595095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.307515+0000","last_change":"2024-04-18T04:44:30.301328+0000","last_active":"2024-04-18T04:44:34.307515+0000","last_peered":"2024-04-18T04:44:34.307515+0000","last_clean":"2024-04-18T04:44:34.307515+0000","last_became_active":"2024-04-18T04:44:30.300303+0000","last_became_peered":"2024-04-18T04:44:30.300303+0000","last_unstale":"2024-04-18T04:44:34.307515+0000","last_undegraded":"2024-04-18T04:44:34.307515+0000","last_fullsized":"2024-04-18T04:44:34.307515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:24:11.941483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.685077+0000","last_change":"2024-04-18T04:44:34.327044+0000","last_active":"2024-04-18T04:44:34.685077+0000","last_peered":"2024-04-18T04:44:34.685077+0000","last_clean":"2024-04-18T04:44:34.685077+0000","last_became_active":"2024-04-18T04:44:34.326161+0000","last_became_peered":"2024-04-18T04:44:34.326161+0000","last_unstale":"2024-04-18T04:44:34.685077+0000","last_undegraded":"2024-04-18T04:44:34.685077+0000","last_fullsized":"2024-04-18T04:44:34.685077+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:47:41.413530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.288881+0000","last_change":"2024-04-18T04:44:30.296493+0000","last_active":"2024-04-18T04:44:34.288881+0000","last_peered":"2024-04-18T04:44:34.288881+0000","last_clean":"2024-04-18T04:44:34.288881+0000","last_became_active":"2024-04-18T04:44:30.295657+0000","last_became_peered":"2024-04-18T04:44:30.295657+0000","last_unstale":"2024-04-18T04:44:34.288881+0000","last_undegraded":"2024-04-18T04:44:34.288881+0000","last_fullsized":"2024-04-18T04:44:34.288881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:39:40.270643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:45:01.954923+0000","last_change":"2024-04-18T04:44:29.900036+0000","last_active":"2024-04-18T04:45:01.954923+0000","last_peered":"2024-04-18T04:45:01.954923+0000","last_clean":"2024-04-18T04:45:01.954923+0000","last_became_active":"2024-04-18T04:44:29.899402+0000","last_became_peered":"2024-04-18T04:44:29.899402+0000","last_unstale":"2024-04-18T04:45:01.954923+0000","last_undegraded":"2024-04-18T04:45:01.954923+0000","last_fullsized":"2024-04-18T04:45:01.954923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:45:51.681317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.686484+0000","last_change":"2024-04-18T04:44:34.320846+0000","last_active":"2024-04-18T04:44:34.686484+0000","last_peered":"2024-04-18T04:44:34.686484+0000","last_clean":"2024-04-18T04:44:34.686484+0000","last_became_active":"2024-04-18T04:44:34.319868+0000","last_became_peered":"2024-04-18T04:44:34.319868+0000","last_unstale":"2024-04-18T04:44:34.686484+0000","last_undegraded":"2024-04-18T04:44:34.686484+0000","last_fullsized":"2024-04-18T04:44:34.686484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:08:30.863140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.289171+0000","last_change":"2024-04-18T04:44:30.271756+0000","last_active":"2024-04-18T04:44:34.289171+0000","last_peered":"2024-04-18T04:44:34.289171+0000","last_clean":"2024-04-18T04:44:34.289171+0000","last_became_active":"2024-04-18T04:44:30.271420+0000","last_became_peered":"2024-04-18T04:44:30.271420+0000","last_unstale":"2024-04-18T04:44:34.289171+0000","last_undegraded":"2024-04-18T04:44:34.289171+0000","last_fullsized":"2024-04-18T04:44:34.289171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:27:18.559327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.296649+0000","last_change":"2024-04-18T04:44:29.878416+0000","last_active":"2024-04-18T04:44:34.296649+0000","last_peered":"2024-04-18T04:44:34.296649+0000","last_clean":"2024-04-18T04:44:34.296649+0000","last_became_active":"2024-04-18T04:44:29.878139+0000","last_became_peered":"2024-04-18T04:44:29.878139+0000","last_unstale":"2024-04-18T04:44:34.296649+0000","last_undegraded":"2024-04-18T04:44:34.296649+0000","last_fullsized":"2024-04-18T04:44:34.296649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:19:00.769888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.685503+0000","last_change":"2024-04-18T04:44:34.346123+0000","last_active":"2024-04-18T04:44:34.685503+0000","last_peered":"2024-04-18T04:44:34.685503+0000","last_clean":"2024-04-18T04:44:34.685503+0000","last_became_active":"2024-04-18T04:44:34.345267+0000","last_became_peered":"2024-04-18T04:44:34.345267+0000","last_unstale":"2024-04-18T04:44:34.685503+0000","last_undegraded":"2024-04-18T04:44:34.685503+0000","last_fullsized":"2024-04-18T04:44:34.685503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:14:08.078650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.289001+0000","last_change":"2024-04-18T04:44:30.274049+0000","last_active":"2024-04-18T04:44:34.289001+0000","last_peered":"2024-04-18T04:44:34.289001+0000","last_clean":"2024-04-18T04:44:34.289001+0000","last_became_active":"2024-04-18T04:44:30.273752+0000","last_became_peered":"2024-04-18T04:44:30.273752+0000","last_unstale":"2024-04-18T04:44:34.289001+0000","last_undegraded":"2024-04-18T04:44:34.289001+0000","last_fullsized":"2024-04-18T04:44:34.289001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:48:20.479069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:45:01.958124+0000","last_change":"2024-04-18T04:44:29.890569+0000","last_active":"2024-04-18T04:45:01.958124+0000","last_peered":"2024-04-18T04:45:01.958124+0000","last_clean":"2024-04-18T04:45:01.958124+0000","last_became_active":"2024-04-18T04:44:29.889684+0000","last_became_peered":"2024-04-18T04:44:29.889684+0000","last_unstale":"2024-04-18T04:45:01.958124+0000","last_undegraded":"2024-04-18T04:45:01.958124+0000","last_fullsized":"2024-04-18T04:45:01.958124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:53:00.230580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.202946+0000","last_change":"2024-04-18T04:44:34.313634+0000","last_active":"2024-04-18T04:44:35.202946+0000","last_peered":"2024-04-18T04:44:35.202946+0000","last_clean":"2024-04-18T04:44:35.202946+0000","last_became_active":"2024-04-18T04:44:34.313161+0000","last_became_peered":"2024-04-18T04:44:34.313161+0000","last_unstale":"2024-04-18T04:44:35.202946+0000","last_undegraded":"2024-04-18T04:44:35.202946+0000","last_fullsized":"2024-04-18T04:44:35.202946+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:01:07.805128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.302215+0000","last_change":"2024-04-18T04:44:30.284805+0000","last_active":"2024-04-18T04:44:34.302215+0000","last_peered":"2024-04-18T04:44:34.302215+0000","last_clean":"2024-04-18T04:44:34.302215+0000","last_became_active":"2024-04-18T04:44:30.279238+0000","last_became_peered":"2024-04-18T04:44:30.279238+0000","last_unstale":"2024-04-18T04:44:34.302215+0000","last_undegraded":"2024-04-18T04:44:34.302215+0000","last_fullsized":"2024-04-18T04:44:34.302215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:59:24.067420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:45:01.956448+0000","last_change":"2024-04-18T04:44:29.890816+0000","last_active":"2024-04-18T04:45:01.956448+0000","last_peered":"2024-04-18T04:45:01.956448+0000","last_clean":"2024-04-18T04:45:01.956448+0000","last_became_active":"2024-04-18T04:44:29.890272+0000","last_became_peered":"2024-04-18T04:44:29.890272+0000","last_unstale":"2024-04-18T04:45:01.956448+0000","last_undegraded":"2024-04-18T04:45:01.956448+0000","last_fullsized":"2024-04-18T04:45:01.956448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:30:22.614083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.686347+0000","last_change":"2024-04-18T04:44:34.344973+0000","last_active":"2024-04-18T04:44:34.686347+0000","last_peered":"2024-04-18T04:44:34.686347+0000","last_clean":"2024-04-18T04:44:34.686347+0000","last_became_active":"2024-04-18T04:44:34.344007+0000","last_became_peered":"2024-04-18T04:44:34.344007+0000","last_unstale":"2024-04-18T04:44:34.686347+0000","last_undegraded":"2024-04-18T04:44:34.686347+0000","last_fullsized":"2024-04-18T04:44:34.686347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:56:43.476132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.288547+0000","last_change":"2024-04-18T04:44:30.278193+0000","last_active":"2024-04-18T04:44:34.288547+0000","last_peered":"2024-04-18T04:44:34.288547+0000","last_clean":"2024-04-18T04:44:34.288547+0000","last_became_active":"2024-04-18T04:44:30.277916+0000","last_became_peered":"2024-04-18T04:44:30.277916+0000","last_unstale":"2024-04-18T04:44:34.288547+0000","last_undegraded":"2024-04-18T04:44:34.288547+0000","last_fullsized":"2024-04-18T04:44:34.288547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:57:19.783436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:45:01.957250+0000","last_change":"2024-04-18T04:44:29.896901+0000","last_active":"2024-04-18T04:45:01.957250+0000","last_peered":"2024-04-18T04:45:01.957250+0000","last_clean":"2024-04-18T04:45:01.957250+0000","last_became_active":"2024-04-18T04:44:29.896392+0000","last_became_peered":"2024-04-18T04:44:29.896392+0000","last_unstale":"2024-04-18T04:45:01.957250+0000","last_undegraded":"2024-04-18T04:45:01.957250+0000","last_fullsized":"2024-04-18T04:45:01.957250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:46:08.869450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.684375+0000","last_change":"2024-04-18T04:44:34.339233+0000","last_active":"2024-04-18T04:44:34.684375+0000","last_peered":"2024-04-18T04:44:34.684375+0000","last_clean":"2024-04-18T04:44:34.684375+0000","last_became_active":"2024-04-18T04:44:34.338294+0000","last_became_peered":"2024-04-18T04:44:34.338294+0000","last_unstale":"2024-04-18T04:44:34.684375+0000","last_undegraded":"2024-04-18T04:44:34.684375+0000","last_fullsized":"2024-04-18T04:44:34.684375+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:20:35.738410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.291990+0000","last_change":"2024-04-18T04:44:30.305051+0000","last_active":"2024-04-18T04:44:34.291990+0000","last_peered":"2024-04-18T04:44:34.291990+0000","last_clean":"2024-04-18T04:44:34.291990+0000","last_became_active":"2024-04-18T04:44:30.304741+0000","last_became_peered":"2024-04-18T04:44:30.304741+0000","last_unstale":"2024-04-18T04:44:34.291990+0000","last_undegraded":"2024-04-18T04:44:34.291990+0000","last_fullsized":"2024-04-18T04:44:34.291990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:38:03.346015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.203014+0000","last_change":"2024-04-18T04:44:29.894503+0000","last_active":"2024-04-18T04:44:35.203014+0000","last_peered":"2024-04-18T04:44:35.203014+0000","last_clean":"2024-04-18T04:44:35.203014+0000","last_became_active":"2024-04-18T04:44:29.894210+0000","last_became_peered":"2024-04-18T04:44:29.894210+0000","last_unstale":"2024-04-18T04:44:35.203014+0000","last_undegraded":"2024-04-18T04:44:35.203014+0000","last_fullsized":"2024-04-18T04:44:35.203014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:14:56.979204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.680679+0000","last_change":"2024-04-18T04:44:34.305652+0000","last_active":"2024-04-18T04:44:34.680679+0000","last_peered":"2024-04-18T04:44:34.680679+0000","last_clean":"2024-04-18T04:44:34.680679+0000","last_became_active":"2024-04-18T04:44:34.305180+0000","last_became_peered":"2024-04-18T04:44:34.305180+0000","last_unstale":"2024-04-18T04:44:34.680679+0000","last_undegraded":"2024-04-18T04:44:34.680679+0000","last_fullsized":"2024-04-18T04:44:34.680679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:03:10.781821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.296680+0000","last_change":"2024-04-18T04:44:30.267158+0000","last_active":"2024-04-18T04:44:34.296680+0000","last_peered":"2024-04-18T04:44:34.296680+0000","last_clean":"2024-04-18T04:44:34.296680+0000","last_became_active":"2024-04-18T04:44:30.266814+0000","last_became_peered":"2024-04-18T04:44:30.266814+0000","last_unstale":"2024-04-18T04:44:34.296680+0000","last_undegraded":"2024-04-18T04:44:34.296680+0000","last_fullsized":"2024-04-18T04:44:34.296680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:16:02.152817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.687771+0000","last_change":"2024-04-18T04:44:29.898812+0000","last_active":"2024-04-18T04:44:34.687771+0000","last_peered":"2024-04-18T04:44:34.687771+0000","last_clean":"2024-04-18T04:44:34.687771+0000","last_became_active":"2024-04-18T04:44:29.897156+0000","last_became_peered":"2024-04-18T04:44:29.897156+0000","last_unstale":"2024-04-18T04:44:34.687771+0000","last_undegraded":"2024-04-18T04:44:34.687771+0000","last_fullsized":"2024-04-18T04:44:34.687771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:09:47.746394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.188051+0000","last_change":"2024-04-18T04:44:34.324721+0000","last_active":"2024-04-18T04:44:35.188051+0000","last_peered":"2024-04-18T04:44:35.188051+0000","last_clean":"2024-04-18T04:44:35.188051+0000","last_became_active":"2024-04-18T04:44:34.322925+0000","last_became_peered":"2024-04-18T04:44:34.322925+0000","last_unstale":"2024-04-18T04:44:35.188051+0000","last_undegraded":"2024-04-18T04:44:35.188051+0000","last_fullsized":"2024-04-18T04:44:35.188051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:11:59.682230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.311311+0000","last_change":"2024-04-18T04:44:30.281640+0000","last_active":"2024-04-18T04:44:34.311311+0000","last_peered":"2024-04-18T04:44:34.311311+0000","last_clean":"2024-04-18T04:44:34.311311+0000","last_became_active":"2024-04-18T04:44:30.280968+0000","last_became_peered":"2024-04-18T04:44:30.280968+0000","last_unstale":"2024-04-18T04:44:34.311311+0000","last_undegraded":"2024-04-18T04:44:34.311311+0000","last_fullsized":"2024-04-18T04:44:34.311311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:35:20.755711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.296757+0000","last_change":"2024-04-18T04:44:29.882715+0000","last_active":"2024-04-18T04:44:34.296757+0000","last_peered":"2024-04-18T04:44:34.296757+0000","last_clean":"2024-04-18T04:44:34.296757+0000","last_became_active":"2024-04-18T04:44:29.882335+0000","last_became_peered":"2024-04-18T04:44:29.882335+0000","last_unstale":"2024-04-18T04:44:34.296757+0000","last_undegraded":"2024-04-18T04:44:34.296757+0000","last_fullsized":"2024-04-18T04:44:34.296757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:32:59.709151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.202122+0000","last_change":"2024-04-18T04:44:34.325029+0000","last_active":"2024-04-18T04:44:35.202122+0000","last_peered":"2024-04-18T04:44:35.202122+0000","last_clean":"2024-04-18T04:44:35.202122+0000","last_became_active":"2024-04-18T04:44:34.324082+0000","last_became_peered":"2024-04-18T04:44:34.324082+0000","last_unstale":"2024-04-18T04:44:35.202122+0000","last_undegraded":"2024-04-18T04:44:35.202122+0000","last_fullsized":"2024-04-18T04:44:35.202122+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:28:10.378037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.311743+0000","last_change":"2024-04-18T04:44:30.276174+0000","last_active":"2024-04-18T04:44:34.311743+0000","last_peered":"2024-04-18T04:44:34.311743+0000","last_clean":"2024-04-18T04:44:34.311743+0000","last_became_active":"2024-04-18T04:44:30.270878+0000","last_became_peered":"2024-04-18T04:44:30.270878+0000","last_unstale":"2024-04-18T04:44:34.311743+0000","last_undegraded":"2024-04-18T04:44:34.311743+0000","last_fullsized":"2024-04-18T04:44:34.311743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:35:12.296277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.309548+0000","last_change":"2024-04-18T04:44:29.896745+0000","last_active":"2024-04-18T04:44:34.309548+0000","last_peered":"2024-04-18T04:44:34.309548+0000","last_clean":"2024-04-18T04:44:34.309548+0000","last_became_active":"2024-04-18T04:44:29.896199+0000","last_became_peered":"2024-04-18T04:44:29.896199+0000","last_unstale":"2024-04-18T04:44:34.309548+0000","last_undegraded":"2024-04-18T04:44:34.309548+0000","last_fullsized":"2024-04-18T04:44:34.309548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:25:05.424668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.202607+0000","last_change":"2024-04-18T04:44:34.337429+0000","last_active":"2024-04-18T04:44:35.202607+0000","last_peered":"2024-04-18T04:44:35.202607+0000","last_clean":"2024-04-18T04:44:35.202607+0000","last_became_active":"2024-04-18T04:44:34.337089+0000","last_became_peered":"2024-04-18T04:44:34.337089+0000","last_unstale":"2024-04-18T04:44:35.202607+0000","last_undegraded":"2024-04-18T04:44:35.202607+0000","last_fullsized":"2024-04-18T04:44:35.202607+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:00:56.976431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.297789+0000","last_change":"2024-04-18T04:44:30.270874+0000","last_active":"2024-04-18T04:44:34.297789+0000","last_peered":"2024-04-18T04:44:34.297789+0000","last_clean":"2024-04-18T04:44:34.297789+0000","last_became_active":"2024-04-18T04:44:30.270636+0000","last_became_peered":"2024-04-18T04:44:30.270636+0000","last_unstale":"2024-04-18T04:44:34.297789+0000","last_undegraded":"2024-04-18T04:44:34.297789+0000","last_fullsized":"2024-04-18T04:44:34.297789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:25:49.889554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.790981+0000","last_change":"2024-04-18T04:44:29.878607+0000","last_active":"2024-04-18T04:44:34.790981+0000","last_peered":"2024-04-18T04:44:34.790981+0000","last_clean":"2024-04-18T04:44:34.790981+0000","last_became_active":"2024-04-18T04:44:29.878330+0000","last_became_peered":"2024-04-18T04:44:29.878330+0000","last_unstale":"2024-04-18T04:44:34.790981+0000","last_undegraded":"2024-04-18T04:44:34.790981+0000","last_fullsized":"2024-04-18T04:44:34.790981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:09:18.088701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.202964+0000","last_change":"2024-04-18T04:44:34.323315+0000","last_active":"2024-04-18T04:44:35.202964+0000","last_peered":"2024-04-18T04:44:35.202964+0000","last_clean":"2024-04-18T04:44:35.202964+0000","last_became_active":"2024-04-18T04:44:34.322983+0000","last_became_peered":"2024-04-18T04:44:34.322983+0000","last_unstale":"2024-04-18T04:44:35.202964+0000","last_undegraded":"2024-04-18T04:44:35.202964+0000","last_fullsized":"2024-04-18T04:44:35.202964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:48:12.803273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287313+0000","last_change":"2024-04-18T04:44:30.285533+0000","last_active":"2024-04-18T04:44:34.287313+0000","last_peered":"2024-04-18T04:44:34.287313+0000","last_clean":"2024-04-18T04:44:34.287313+0000","last_became_active":"2024-04-18T04:44:30.285113+0000","last_became_peered":"2024-04-18T04:44:30.285113+0000","last_unstale":"2024-04-18T04:44:34.287313+0000","last_undegraded":"2024-04-18T04:44:34.287313+0000","last_fullsized":"2024-04-18T04:44:34.287313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:37:20.367349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.683785+0000","last_change":"2024-04-18T04:44:29.890701+0000","last_active":"2024-04-18T04:44:34.683785+0000","last_peered":"2024-04-18T04:44:34.683785+0000","last_clean":"2024-04-18T04:44:34.683785+0000","last_became_active":"2024-04-18T04:44:29.890207+0000","last_became_peered":"2024-04-18T04:44:29.890207+0000","last_unstale":"2024-04-18T04:44:34.683785+0000","last_undegraded":"2024-04-18T04:44:34.683785+0000","last_fullsized":"2024-04-18T04:44:34.683785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:06:58.470725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.188159+0000","last_change":"2024-04-18T04:44:34.306858+0000","last_active":"2024-04-18T04:44:35.188159+0000","last_peered":"2024-04-18T04:44:35.188159+0000","last_clean":"2024-04-18T04:44:35.188159+0000","last_became_active":"2024-04-18T04:44:34.306123+0000","last_became_peered":"2024-04-18T04:44:34.306123+0000","last_unstale":"2024-04-18T04:44:35.188159+0000","last_undegraded":"2024-04-18T04:44:35.188159+0000","last_fullsized":"2024-04-18T04:44:35.188159+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:13:26.389394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.289157+0000","last_change":"2024-04-18T04:44:30.306826+0000","last_active":"2024-04-18T04:44:34.289157+0000","last_peered":"2024-04-18T04:44:34.289157+0000","last_clean":"2024-04-18T04:44:34.289157+0000","last_became_active":"2024-04-18T04:44:30.306320+0000","last_became_peered":"2024-04-18T04:44:30.306320+0000","last_unstale":"2024-04-18T04:44:34.289157+0000","last_undegraded":"2024-04-18T04:44:34.289157+0000","last_fullsized":"2024-04-18T04:44:34.289157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:47:38.564197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:45:01.959725+0000","last_change":"2024-04-18T04:44:29.888023+0000","last_active":"2024-04-18T04:45:01.959725+0000","last_peered":"2024-04-18T04:45:01.959725+0000","last_clean":"2024-04-18T04:45:01.959725+0000","last_became_active":"2024-04-18T04:44:29.887440+0000","last_became_peered":"2024-04-18T04:44:29.887440+0000","last_unstale":"2024-04-18T04:45:01.959725+0000","last_undegraded":"2024-04-18T04:45:01.959725+0000","last_fullsized":"2024-04-18T04:45:01.959725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:07:01.067445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287497+0000","last_change":"2024-04-18T04:44:18.629794+0000","last_active":"2024-04-18T04:44:34.287497+0000","last_peered":"2024-04-18T04:44:34.287497+0000","last_clean":"2024-04-18T04:44:34.287497+0000","last_became_active":"2024-04-18T04:44:18.627792+0000","last_became_peered":"2024-04-18T04:44:18.627792+0000","last_unstale":"2024-04-18T04:44:34.287497+0000","last_undegraded":"2024-04-18T04:44:34.287497+0000","last_fullsized":"2024-04-18T04:44:34.287497+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:17.410146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:17.410146+0000","last_clean_scrub_stamp":"2024-04-18T04:44:17.410146+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:30:49.101656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.203752+0000","last_change":"2024-04-18T04:44:34.333286+0000","last_active":"2024-04-18T04:44:35.203752+0000","last_peered":"2024-04-18T04:44:35.203752+0000","last_clean":"2024-04-18T04:44:35.203752+0000","last_became_active":"2024-04-18T04:44:34.332520+0000","last_became_peered":"2024-04-18T04:44:34.332520+0000","last_unstale":"2024-04-18T04:44:35.203752+0000","last_undegraded":"2024-04-18T04:44:35.203752+0000","last_fullsized":"2024-04-18T04:44:35.203752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:58:48.264040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.295974+0000","last_change":"2024-04-18T04:44:30.303602+0000","last_active":"2024-04-18T04:44:34.295974+0000","last_peered":"2024-04-18T04:44:34.295974+0000","last_clean":"2024-04-18T04:44:34.295974+0000","last_became_active":"2024-04-18T04:44:30.302157+0000","last_became_peered":"2024-04-18T04:44:30.302157+0000","last_unstale":"2024-04-18T04:44:34.295974+0000","last_undegraded":"2024-04-18T04:44:34.295974+0000","last_fullsized":"2024-04-18T04:44:34.295974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:09:57.582065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.285561+0000","last_change":"2024-04-18T04:44:29.890428+0000","last_active":"2024-04-18T04:44:34.285561+0000","last_peered":"2024-04-18T04:44:34.285561+0000","last_clean":"2024-04-18T04:44:34.285561+0000","last_became_active":"2024-04-18T04:44:29.890166+0000","last_became_peered":"2024-04-18T04:44:29.890166+0000","last_unstale":"2024-04-18T04:44:34.285561+0000","last_undegraded":"2024-04-18T04:44:34.285561+0000","last_fullsized":"2024-04-18T04:44:34.285561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:21:16.823377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.202663+0000","last_change":"2024-04-18T04:44:34.334071+0000","last_active":"2024-04-18T04:44:35.202663+0000","last_peered":"2024-04-18T04:44:35.202663+0000","last_clean":"2024-04-18T04:44:35.202663+0000","last_became_active":"2024-04-18T04:44:34.332695+0000","last_became_peered":"2024-04-18T04:44:34.332695+0000","last_unstale":"2024-04-18T04:44:35.202663+0000","last_undegraded":"2024-04-18T04:44:35.202663+0000","last_fullsized":"2024-04-18T04:44:35.202663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:22:52.371921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.309847+0000","last_change":"2024-04-18T04:44:30.287908+0000","last_active":"2024-04-18T04:44:34.309847+0000","last_peered":"2024-04-18T04:44:34.309847+0000","last_clean":"2024-04-18T04:44:34.309847+0000","last_became_active":"2024-04-18T04:44:30.287217+0000","last_became_peered":"2024-04-18T04:44:30.287217+0000","last_unstale":"2024-04-18T04:44:34.309847+0000","last_undegraded":"2024-04-18T04:44:34.309847+0000","last_fullsized":"2024-04-18T04:44:34.309847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:47:14.962330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.202737+0000","last_change":"2024-04-18T04:44:29.886376+0000","last_active":"2024-04-18T04:44:35.202737+0000","last_peered":"2024-04-18T04:44:35.202737+0000","last_clean":"2024-04-18T04:44:35.202737+0000","last_became_active":"2024-04-18T04:44:29.886058+0000","last_became_peered":"2024-04-18T04:44:29.886058+0000","last_unstale":"2024-04-18T04:44:35.202737+0000","last_undegraded":"2024-04-18T04:44:35.202737+0000","last_fullsized":"2024-04-18T04:44:35.202737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:29:59.678071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.188072+0000","last_change":"2024-04-18T04:44:34.323046+0000","last_active":"2024-04-18T04:44:35.188072+0000","last_peered":"2024-04-18T04:44:35.188072+0000","last_clean":"2024-04-18T04:44:35.188072+0000","last_became_active":"2024-04-18T04:44:34.322785+0000","last_became_peered":"2024-04-18T04:44:34.322785+0000","last_unstale":"2024-04-18T04:44:35.188072+0000","last_undegraded":"2024-04-18T04:44:35.188072+0000","last_fullsized":"2024-04-18T04:44:35.188072+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:53:47.315572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.293500+0000","last_change":"2024-04-18T04:44:30.289872+0000","last_active":"2024-04-18T04:44:34.293500+0000","last_peered":"2024-04-18T04:44:34.293500+0000","last_clean":"2024-04-18T04:44:34.293500+0000","last_became_active":"2024-04-18T04:44:30.288606+0000","last_became_peered":"2024-04-18T04:44:30.288606+0000","last_unstale":"2024-04-18T04:44:34.293500+0000","last_undegraded":"2024-04-18T04:44:34.293500+0000","last_fullsized":"2024-04-18T04:44:34.293500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:00:57.740649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.267690+0000","last_change":"2024-04-18T04:44:29.878650+0000","last_active":"2024-04-18T04:44:35.267690+0000","last_peered":"2024-04-18T04:44:35.267690+0000","last_clean":"2024-04-18T04:44:35.267690+0000","last_became_active":"2024-04-18T04:44:29.878361+0000","last_became_peered":"2024-04-18T04:44:29.878361+0000","last_unstale":"2024-04-18T04:44:35.267690+0000","last_undegraded":"2024-04-18T04:44:35.267690+0000","last_fullsized":"2024-04-18T04:44:35.267690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:57:41.162118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.202529+0000","last_change":"2024-04-18T04:44:34.339023+0000","last_active":"2024-04-18T04:44:35.202529+0000","last_peered":"2024-04-18T04:44:35.202529+0000","last_clean":"2024-04-18T04:44:35.202529+0000","last_became_active":"2024-04-18T04:44:34.338042+0000","last_became_peered":"2024-04-18T04:44:34.338042+0000","last_unstale":"2024-04-18T04:44:35.202529+0000","last_undegraded":"2024-04-18T04:44:35.202529+0000","last_fullsized":"2024-04-18T04:44:35.202529+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:48:58.174635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.290165+0000","last_change":"2024-04-18T04:44:30.291740+0000","last_active":"2024-04-18T04:44:34.290165+0000","last_peered":"2024-04-18T04:44:34.290165+0000","last_clean":"2024-04-18T04:44:34.290165+0000","last_became_active":"2024-04-18T04:44:30.290379+0000","last_became_peered":"2024-04-18T04:44:30.290379+0000","last_unstale":"2024-04-18T04:44:34.290165+0000","last_undegraded":"2024-04-18T04:44:34.290165+0000","last_fullsized":"2024-04-18T04:44:34.290165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:44:25.111858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.686910+0000","last_change":"2024-04-18T04:44:29.882833+0000","last_active":"2024-04-18T04:44:34.686910+0000","last_peered":"2024-04-18T04:44:34.686910+0000","last_clean":"2024-04-18T04:44:34.686910+0000","last_became_active":"2024-04-18T04:44:29.881671+0000","last_became_peered":"2024-04-18T04:44:29.881671+0000","last_unstale":"2024-04-18T04:44:34.686910+0000","last_undegraded":"2024-04-18T04:44:34.686910+0000","last_fullsized":"2024-04-18T04:44:34.686910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:29:22.037641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.684253+0000","last_change":"2024-04-18T04:44:34.342465+0000","last_active":"2024-04-18T04:44:34.684253+0000","last_peered":"2024-04-18T04:44:34.684253+0000","last_clean":"2024-04-18T04:44:34.684253+0000","last_became_active":"2024-04-18T04:44:34.340327+0000","last_became_peered":"2024-04-18T04:44:34.340327+0000","last_unstale":"2024-04-18T04:44:34.684253+0000","last_undegraded":"2024-04-18T04:44:34.684253+0000","last_fullsized":"2024-04-18T04:44:34.684253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:31:44.168899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287509+0000","last_change":"2024-04-18T04:44:30.299403+0000","last_active":"2024-04-18T04:44:34.287509+0000","last_peered":"2024-04-18T04:44:34.287509+0000","last_clean":"2024-04-18T04:44:34.287509+0000","last_became_active":"2024-04-18T04:44:30.298417+0000","last_became_peered":"2024-04-18T04:44:30.298417+0000","last_unstale":"2024-04-18T04:44:34.287509+0000","last_undegraded":"2024-04-18T04:44:34.287509+0000","last_fullsized":"2024-04-18T04:44:34.287509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:43:24.120294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'10","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:45:01.961956+0000","last_change":"2024-04-18T04:44:29.875345+0000","last_active":"2024-04-18T04:45:01.961956+0000","last_peered":"2024-04-18T04:45:01.961956+0000","last_clean":"2024-04-18T04:45:01.961956+0000","last_became_active":"2024-04-18T04:44:29.875059+0000","last_became_peered":"2024-04-18T04:44:29.875059+0000","last_unstale":"2024-04-18T04:45:01.961956+0000","last_undegraded":"2024-04-18T04:45:01.961956+0000","last_fullsized":"2024-04-18T04:45:01.961956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:06:54.218096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.188129+0000","last_change":"2024-04-18T04:44:34.334498+0000","last_active":"2024-04-18T04:44:35.188129+0000","last_peered":"2024-04-18T04:44:35.188129+0000","last_clean":"2024-04-18T04:44:35.188129+0000","last_became_active":"2024-04-18T04:44:34.334192+0000","last_became_peered":"2024-04-18T04:44:34.334192+0000","last_unstale":"2024-04-18T04:44:35.188129+0000","last_undegraded":"2024-04-18T04:44:35.188129+0000","last_fullsized":"2024-04-18T04:44:35.188129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:15:49.669556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287990+0000","last_change":"2024-04-18T04:44:30.298289+0000","last_active":"2024-04-18T04:44:34.287990+0000","last_peered":"2024-04-18T04:44:34.287990+0000","last_clean":"2024-04-18T04:44:34.287990+0000","last_became_active":"2024-04-18T04:44:30.295404+0000","last_became_peered":"2024-04-18T04:44:30.295404+0000","last_unstale":"2024-04-18T04:44:34.287990+0000","last_undegraded":"2024-04-18T04:44:34.287990+0000","last_fullsized":"2024-04-18T04:44:34.287990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:10:32.465032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.288381+0000","last_change":"2024-04-18T04:44:29.894196+0000","last_active":"2024-04-18T04:44:34.288381+0000","last_peered":"2024-04-18T04:44:34.288381+0000","last_clean":"2024-04-18T04:44:34.288381+0000","last_became_active":"2024-04-18T04:44:29.893668+0000","last_became_peered":"2024-04-18T04:44:29.893668+0000","last_unstale":"2024-04-18T04:44:34.288381+0000","last_undegraded":"2024-04-18T04:44:34.288381+0000","last_fullsized":"2024-04-18T04:44:34.288381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:39:03.812043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.681603+0000","last_change":"2024-04-18T04:44:34.339050+0000","last_active":"2024-04-18T04:44:34.681603+0000","last_peered":"2024-04-18T04:44:34.681603+0000","last_clean":"2024-04-18T04:44:34.681603+0000","last_became_active":"2024-04-18T04:44:34.338877+0000","last_became_peered":"2024-04-18T04:44:34.338877+0000","last_unstale":"2024-04-18T04:44:34.681603+0000","last_undegraded":"2024-04-18T04:44:34.681603+0000","last_fullsized":"2024-04-18T04:44:34.681603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:09:17.919847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.288247+0000","last_change":"2024-04-18T04:44:30.289122+0000","last_active":"2024-04-18T04:44:34.288247+0000","last_peered":"2024-04-18T04:44:34.288247+0000","last_clean":"2024-04-18T04:44:34.288247+0000","last_became_active":"2024-04-18T04:44:30.288364+0000","last_became_peered":"2024-04-18T04:44:30.288364+0000","last_unstale":"2024-04-18T04:44:34.288247+0000","last_undegraded":"2024-04-18T04:44:34.288247+0000","last_fullsized":"2024-04-18T04:44:34.288247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:04:02.162723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:45:01.959067+0000","last_change":"2024-04-18T04:44:29.894521+0000","last_active":"2024-04-18T04:45:01.959067+0000","last_peered":"2024-04-18T04:45:01.959067+0000","last_clean":"2024-04-18T04:45:01.959067+0000","last_became_active":"2024-04-18T04:44:29.889150+0000","last_became_peered":"2024-04-18T04:44:29.889150+0000","last_unstale":"2024-04-18T04:45:01.959067+0000","last_undegraded":"2024-04-18T04:45:01.959067+0000","last_fullsized":"2024-04-18T04:45:01.959067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:39:13.323434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.681213+0000","last_change":"2024-04-18T04:44:34.305657+0000","last_active":"2024-04-18T04:44:34.681213+0000","last_peered":"2024-04-18T04:44:34.681213+0000","last_clean":"2024-04-18T04:44:34.681213+0000","last_became_active":"2024-04-18T04:44:34.305341+0000","last_became_peered":"2024-04-18T04:44:34.305341+0000","last_unstale":"2024-04-18T04:44:34.681213+0000","last_undegraded":"2024-04-18T04:44:34.681213+0000","last_fullsized":"2024-04-18T04:44:34.681213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:32:39.937173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287291+0000","last_change":"2024-04-18T04:44:30.307042+0000","last_active":"2024-04-18T04:44:34.287291+0000","last_peered":"2024-04-18T04:44:34.287291+0000","last_clean":"2024-04-18T04:44:34.287291+0000","last_became_active":"2024-04-18T04:44:30.306726+0000","last_became_peered":"2024-04-18T04:44:30.306726+0000","last_unstale":"2024-04-18T04:44:34.287291+0000","last_undegraded":"2024-04-18T04:44:34.287291+0000","last_fullsized":"2024-04-18T04:44:34.287291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:55:33.543142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.273530+0000","last_change":"2024-04-18T04:44:29.887498+0000","last_active":"2024-04-18T04:44:35.273530+0000","last_peered":"2024-04-18T04:44:35.273530+0000","last_clean":"2024-04-18T04:44:35.273530+0000","last_became_active":"2024-04-18T04:44:29.887095+0000","last_became_peered":"2024-04-18T04:44:29.887095+0000","last_unstale":"2024-04-18T04:44:35.273530+0000","last_undegraded":"2024-04-18T04:44:35.273530+0000","last_fullsized":"2024-04-18T04:44:35.273530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:54:34.700562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.203621+0000","last_change":"2024-04-18T04:44:34.322042+0000","last_active":"2024-04-18T04:44:35.203621+0000","last_peered":"2024-04-18T04:44:35.203621+0000","last_clean":"2024-04-18T04:44:35.203621+0000","last_became_active":"2024-04-18T04:44:34.320776+0000","last_became_peered":"2024-04-18T04:44:34.320776+0000","last_unstale":"2024-04-18T04:44:35.203621+0000","last_undegraded":"2024-04-18T04:44:35.203621+0000","last_fullsized":"2024-04-18T04:44:35.203621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:53:47.399337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.295755+0000","last_change":"2024-04-18T04:44:30.299413+0000","last_active":"2024-04-18T04:44:34.295755+0000","last_peered":"2024-04-18T04:44:34.295755+0000","last_clean":"2024-04-18T04:44:34.295755+0000","last_became_active":"2024-04-18T04:44:30.293185+0000","last_became_peered":"2024-04-18T04:44:30.293185+0000","last_unstale":"2024-04-18T04:44:34.295755+0000","last_undegraded":"2024-04-18T04:44:34.295755+0000","last_fullsized":"2024-04-18T04:44:34.295755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:43:53.831429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'11","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:45:01.958466+0000","last_change":"2024-04-18T04:44:29.893351+0000","last_active":"2024-04-18T04:45:01.958466+0000","last_peered":"2024-04-18T04:45:01.958466+0000","last_clean":"2024-04-18T04:45:01.958466+0000","last_became_active":"2024-04-18T04:44:29.892647+0000","last_became_peered":"2024-04-18T04:44:29.892647+0000","last_unstale":"2024-04-18T04:45:01.958466+0000","last_undegraded":"2024-04-18T04:45:01.958466+0000","last_fullsized":"2024-04-18T04:45:01.958466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:16:59.759149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3796,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.202231+0000","last_change":"2024-04-18T04:44:34.337866+0000","last_active":"2024-04-18T04:44:35.202231+0000","last_peered":"2024-04-18T04:44:35.202231+0000","last_clean":"2024-04-18T04:44:35.202231+0000","last_became_active":"2024-04-18T04:44:34.337486+0000","last_became_peered":"2024-04-18T04:44:34.337486+0000","last_unstale":"2024-04-18T04:44:35.202231+0000","last_undegraded":"2024-04-18T04:44:35.202231+0000","last_fullsized":"2024-04-18T04:44:35.202231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:42:13.751926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.304604+0000","last_change":"2024-04-18T04:44:30.308477+0000","last_active":"2024-04-18T04:44:34.304604+0000","last_peered":"2024-04-18T04:44:34.304604+0000","last_clean":"2024-04-18T04:44:34.304604+0000","last_became_active":"2024-04-18T04:44:30.307237+0000","last_became_peered":"2024-04-18T04:44:30.307237+0000","last_unstale":"2024-04-18T04:44:34.304604+0000","last_undegraded":"2024-04-18T04:44:34.304604+0000","last_fullsized":"2024-04-18T04:44:34.304604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:33:58.300542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'4","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.271882+0000","last_change":"2024-04-18T04:44:29.898488+0000","last_active":"2024-04-18T04:44:35.271882+0000","last_peered":"2024-04-18T04:44:35.271882+0000","last_clean":"2024-04-18T04:44:35.271882+0000","last_became_active":"2024-04-18T04:44:29.898113+0000","last_became_peered":"2024-04-18T04:44:29.898113+0000","last_unstale":"2024-04-18T04:44:35.271882+0000","last_undegraded":"2024-04-18T04:44:35.271882+0000","last_fullsized":"2024-04-18T04:44:35.271882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:11:14.585142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.685293+0000","last_change":"2024-04-18T04:44:34.344769+0000","last_active":"2024-04-18T04:44:34.685293+0000","last_peered":"2024-04-18T04:44:34.685293+0000","last_clean":"2024-04-18T04:44:34.685293+0000","last_became_active":"2024-04-18T04:44:34.343636+0000","last_became_peered":"2024-04-18T04:44:34.343636+0000","last_unstale":"2024-04-18T04:44:34.685293+0000","last_undegraded":"2024-04-18T04:44:34.685293+0000","last_fullsized":"2024-04-18T04:44:34.685293+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:45:09.481681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287417+0000","last_change":"2024-04-18T04:44:30.290494+0000","last_active":"2024-04-18T04:44:34.287417+0000","last_peered":"2024-04-18T04:44:34.287417+0000","last_clean":"2024-04-18T04:44:34.287417+0000","last_became_active":"2024-04-18T04:44:30.290127+0000","last_became_peered":"2024-04-18T04:44:30.290127+0000","last_unstale":"2024-04-18T04:44:34.287417+0000","last_undegraded":"2024-04-18T04:44:34.287417+0000","last_fullsized":"2024-04-18T04:44:34.287417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:34:21.239813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:45:01.957145+0000","last_change":"2024-04-18T04:44:29.895686+0000","last_active":"2024-04-18T04:45:01.957145+0000","last_peered":"2024-04-18T04:45:01.957145+0000","last_clean":"2024-04-18T04:45:01.957145+0000","last_became_active":"2024-04-18T04:44:29.895083+0000","last_became_peered":"2024-04-18T04:44:29.895083+0000","last_unstale":"2024-04-18T04:45:01.957145+0000","last_undegraded":"2024-04-18T04:45:01.957145+0000","last_fullsized":"2024-04-18T04:45:01.957145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:27:17.897401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.680895+0000","last_change":"2024-04-18T04:44:34.338412+0000","last_active":"2024-04-18T04:44:34.680895+0000","last_peered":"2024-04-18T04:44:34.680895+0000","last_clean":"2024-04-18T04:44:34.680895+0000","last_became_active":"2024-04-18T04:44:34.338062+0000","last_became_peered":"2024-04-18T04:44:34.338062+0000","last_unstale":"2024-04-18T04:44:34.680895+0000","last_undegraded":"2024-04-18T04:44:34.680895+0000","last_fullsized":"2024-04-18T04:44:34.680895+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:49:28.342905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.307374+0000","last_change":"2024-04-18T04:44:30.307946+0000","last_active":"2024-04-18T04:44:34.307374+0000","last_peered":"2024-04-18T04:44:34.307374+0000","last_clean":"2024-04-18T04:44:34.307374+0000","last_became_active":"2024-04-18T04:44:30.307168+0000","last_became_peered":"2024-04-18T04:44:30.307168+0000","last_unstale":"2024-04-18T04:44:34.307374+0000","last_undegraded":"2024-04-18T04:44:34.307374+0000","last_fullsized":"2024-04-18T04:44:34.307374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:43:56.218333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"25'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:45:01.958267+0000","last_change":"2024-04-18T04:44:29.903183+0000","last_active":"2024-04-18T04:45:01.958267+0000","last_peered":"2024-04-18T04:45:01.958267+0000","last_clean":"2024-04-18T04:45:01.958267+0000","last_became_active":"2024-04-18T04:44:29.902647+0000","last_became_peered":"2024-04-18T04:44:29.902647+0000","last_unstale":"2024-04-18T04:45:01.958267+0000","last_undegraded":"2024-04-18T04:45:01.958267+0000","last_fullsized":"2024-04-18T04:45:01.958267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:45:13.009571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.680985+0000","last_change":"2024-04-18T04:44:34.338653+0000","last_active":"2024-04-18T04:44:34.680985+0000","last_peered":"2024-04-18T04:44:34.680985+0000","last_clean":"2024-04-18T04:44:34.680985+0000","last_became_active":"2024-04-18T04:44:34.338288+0000","last_became_peered":"2024-04-18T04:44:34.338288+0000","last_unstale":"2024-04-18T04:44:34.680985+0000","last_undegraded":"2024-04-18T04:44:34.680985+0000","last_fullsized":"2024-04-18T04:44:34.680985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:58:27.654288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.188114+0000","last_change":"2024-04-18T04:44:34.306999+0000","last_active":"2024-04-18T04:44:35.188114+0000","last_peered":"2024-04-18T04:44:35.188114+0000","last_clean":"2024-04-18T04:44:35.188114+0000","last_became_active":"2024-04-18T04:44:34.306657+0000","last_became_peered":"2024-04-18T04:44:34.306657+0000","last_unstale":"2024-04-18T04:44:35.188114+0000","last_undegraded":"2024-04-18T04:44:35.188114+0000","last_fullsized":"2024-04-18T04:44:35.188114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:52:58.512928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.297434+0000","last_change":"2024-04-18T04:44:30.271947+0000","last_active":"2024-04-18T04:44:34.297434+0000","last_peered":"2024-04-18T04:44:34.297434+0000","last_clean":"2024-04-18T04:44:34.297434+0000","last_became_active":"2024-04-18T04:44:30.271619+0000","last_became_peered":"2024-04-18T04:44:30.271619+0000","last_unstale":"2024-04-18T04:44:34.297434+0000","last_undegraded":"2024-04-18T04:44:34.297434+0000","last_fullsized":"2024-04-18T04:44:34.297434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:32:11.612016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.203226+0000","last_change":"2024-04-18T04:44:29.897616+0000","last_active":"2024-04-18T04:44:35.203226+0000","last_peered":"2024-04-18T04:44:35.203226+0000","last_clean":"2024-04-18T04:44:35.203226+0000","last_became_active":"2024-04-18T04:44:29.889922+0000","last_became_peered":"2024-04-18T04:44:29.889922+0000","last_unstale":"2024-04-18T04:44:35.203226+0000","last_undegraded":"2024-04-18T04:44:35.203226+0000","last_fullsized":"2024-04-18T04:44:35.203226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:11:52.717768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.204973+0000","last_change":"2024-04-18T04:44:34.333403+0000","last_active":"2024-04-18T04:44:35.204973+0000","last_peered":"2024-04-18T04:44:35.204973+0000","last_clean":"2024-04-18T04:44:35.204973+0000","last_became_active":"2024-04-18T04:44:34.332551+0000","last_became_peered":"2024-04-18T04:44:34.332551+0000","last_unstale":"2024-04-18T04:44:35.204973+0000","last_undegraded":"2024-04-18T04:44:35.204973+0000","last_fullsized":"2024-04-18T04:44:35.204973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:33:28.594002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.288936+0000","last_change":"2024-04-18T04:44:30.271099+0000","last_active":"2024-04-18T04:44:34.288936+0000","last_peered":"2024-04-18T04:44:34.288936+0000","last_clean":"2024-04-18T04:44:34.288936+0000","last_became_active":"2024-04-18T04:44:30.270804+0000","last_became_peered":"2024-04-18T04:44:30.270804+0000","last_unstale":"2024-04-18T04:44:34.288936+0000","last_undegraded":"2024-04-18T04:44:34.288936+0000","last_fullsized":"2024-04-18T04:44:34.288936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:18:27.955171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.289697+0000","last_change":"2024-04-18T04:44:29.895084+0000","last_active":"2024-04-18T04:44:34.289697+0000","last_peered":"2024-04-18T04:44:34.289697+0000","last_clean":"2024-04-18T04:44:34.289697+0000","last_became_active":"2024-04-18T04:44:29.894829+0000","last_became_peered":"2024-04-18T04:44:29.894829+0000","last_unstale":"2024-04-18T04:44:34.289697+0000","last_undegraded":"2024-04-18T04:44:34.289697+0000","last_fullsized":"2024-04-18T04:44:34.289697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:54.812428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:35.203324+0000","last_change":"2024-04-18T04:44:29.892826+0000","last_active":"2024-04-18T04:44:35.203324+0000","last_peered":"2024-04-18T04:44:35.203324+0000","last_clean":"2024-04-18T04:44:35.203324+0000","last_became_active":"2024-04-18T04:44:29.892282+0000","last_became_peered":"2024-04-18T04:44:29.892282+0000","last_unstale":"2024-04-18T04:44:35.203324+0000","last_undegraded":"2024-04-18T04:44:35.203324+0000","last_fullsized":"2024-04-18T04:44:35.203324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:02.844116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.288503+0000","last_change":"2024-04-18T04:44:30.285312+0000","last_active":"2024-04-18T04:44:34.288503+0000","last_peered":"2024-04-18T04:44:34.288503+0000","last_clean":"2024-04-18T04:44:34.288503+0000","last_became_active":"2024-04-18T04:44:30.285055+0000","last_became_peered":"2024-04-18T04:44:30.285055+0000","last_unstale":"2024-04-18T04:44:34.288503+0000","last_undegraded":"2024-04-18T04:44:34.288503+0000","last_fullsized":"2024-04-18T04:44:34.288503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:50:00.641018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.790995+0000","last_change":"2024-04-18T04:44:34.323352+0000","last_active":"2024-04-18T04:44:34.790995+0000","last_peered":"2024-04-18T04:44:34.790995+0000","last_clean":"2024-04-18T04:44:34.790995+0000","last_became_active":"2024-04-18T04:44:34.321645+0000","last_became_peered":"2024-04-18T04:44:34.321645+0000","last_unstale":"2024-04-18T04:44:34.790995+0000","last_undegraded":"2024-04-18T04:44:34.790995+0000","last_fullsized":"2024-04-18T04:44:34.790995+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:33:27.387013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:45:02.777101+0000","last_change":"2024-04-18T04:44:29.891865+0000","last_active":"2024-04-18T04:45:02.777101+0000","last_peered":"2024-04-18T04:45:02.777101+0000","last_clean":"2024-04-18T04:45:02.777101+0000","last_became_active":"2024-04-18T04:44:29.891610+0000","last_became_peered":"2024-04-18T04:44:29.891610+0000","last_unstale":"2024-04-18T04:45:02.777101+0000","last_undegraded":"2024-04-18T04:45:02.777101+0000","last_fullsized":"2024-04-18T04:45:02.777101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:36:42.266497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.310919+0000","last_change":"2024-04-18T04:44:30.279080+0000","last_active":"2024-04-18T04:44:34.310919+0000","last_peered":"2024-04-18T04:44:34.310919+0000","last_clean":"2024-04-18T04:44:34.310919+0000","last_became_active":"2024-04-18T04:44:30.278275+0000","last_became_peered":"2024-04-18T04:44:30.278275+0000","last_unstale":"2024-04-18T04:44:34.310919+0000","last_undegraded":"2024-04-18T04:44:34.310919+0000","last_fullsized":"2024-04-18T04:44:34.310919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:51:48.272703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.681364+0000","last_change":"2024-04-18T04:44:34.313835+0000","last_active":"2024-04-18T04:44:34.681364+0000","last_peered":"2024-04-18T04:44:34.681364+0000","last_clean":"2024-04-18T04:44:34.681364+0000","last_became_active":"2024-04-18T04:44:34.313416+0000","last_became_peered":"2024-04-18T04:44:34.313416+0000","last_unstale":"2024-04-18T04:44:34.681364+0000","last_undegraded":"2024-04-18T04:44:34.681364+0000","last_fullsized":"2024-04-18T04:44:34.681364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:57:47.245809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287790+0000","last_change":"2024-04-18T04:44:30.297229+0000","last_active":"2024-04-18T04:44:34.287790+0000","last_peered":"2024-04-18T04:44:34.287790+0000","last_clean":"2024-04-18T04:44:34.287790+0000","last_became_active":"2024-04-18T04:44:30.296354+0000","last_became_peered":"2024-04-18T04:44:30.296354+0000","last_unstale":"2024-04-18T04:44:34.287790+0000","last_undegraded":"2024-04-18T04:44:34.287790+0000","last_fullsized":"2024-04-18T04:44:34.287790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:30:35.845106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.285182+0000","last_change":"2024-04-18T04:44:30.281213+0000","last_active":"2024-04-18T04:44:34.285182+0000","last_peered":"2024-04-18T04:44:34.285182+0000","last_clean":"2024-04-18T04:44:34.285182+0000","last_became_active":"2024-04-18T04:44:30.280941+0000","last_became_peered":"2024-04-18T04:44:30.280941+0000","last_unstale":"2024-04-18T04:44:34.285182+0000","last_undegraded":"2024-04-18T04:44:34.285182+0000","last_fullsized":"2024-04-18T04:44:34.285182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:15:37.795670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.307313+0000","last_change":"2024-04-18T04:44:30.288507+0000","last_active":"2024-04-18T04:44:34.307313+0000","last_peered":"2024-04-18T04:44:34.307313+0000","last_clean":"2024-04-18T04:44:34.307313+0000","last_became_active":"2024-04-18T04:44:30.287820+0000","last_became_peered":"2024-04-18T04:44:30.287820+0000","last_unstale":"2024-04-18T04:44:34.307313+0000","last_undegraded":"2024-04-18T04:44:34.307313+0000","last_fullsized":"2024-04-18T04:44:34.307313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:25:29.500586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.288460+0000","last_change":"2024-04-18T04:44:30.273278+0000","last_active":"2024-04-18T04:44:34.288460+0000","last_peered":"2024-04-18T04:44:34.288460+0000","last_clean":"2024-04-18T04:44:34.288460+0000","last_became_active":"2024-04-18T04:44:30.272973+0000","last_became_peered":"2024-04-18T04:44:30.272973+0000","last_unstale":"2024-04-18T04:44:34.288460+0000","last_undegraded":"2024-04-18T04:44:34.288460+0000","last_fullsized":"2024-04-18T04:44:34.288460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:37:02.421925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.292341+0000","last_change":"2024-04-18T04:44:30.298936+0000","last_active":"2024-04-18T04:44:34.292341+0000","last_peered":"2024-04-18T04:44:34.292341+0000","last_clean":"2024-04-18T04:44:34.292341+0000","last_became_active":"2024-04-18T04:44:30.298637+0000","last_became_peered":"2024-04-18T04:44:30.298637+0000","last_unstale":"2024-04-18T04:44:34.292341+0000","last_undegraded":"2024-04-18T04:44:34.292341+0000","last_fullsized":"2024-04-18T04:44:34.292341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:04:33.188772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.296348+0000","last_change":"2024-04-18T04:44:30.274613+0000","last_active":"2024-04-18T04:44:34.296348+0000","last_peered":"2024-04-18T04:44:34.296348+0000","last_clean":"2024-04-18T04:44:34.296348+0000","last_became_active":"2024-04-18T04:44:30.274328+0000","last_became_peered":"2024-04-18T04:44:30.274328+0000","last_unstale":"2024-04-18T04:44:34.296348+0000","last_undegraded":"2024-04-18T04:44:34.296348+0000","last_fullsized":"2024-04-18T04:44:34.296348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:55:41.700955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.290317+0000","last_change":"2024-04-18T04:44:30.309403+0000","last_active":"2024-04-18T04:44:34.290317+0000","last_peered":"2024-04-18T04:44:34.290317+0000","last_clean":"2024-04-18T04:44:34.290317+0000","last_became_active":"2024-04-18T04:44:30.308415+0000","last_became_peered":"2024-04-18T04:44:30.308415+0000","last_unstale":"2024-04-18T04:44:34.290317+0000","last_undegraded":"2024-04-18T04:44:34.290317+0000","last_fullsized":"2024-04-18T04:44:34.290317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:51:58.935503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.291911+0000","last_change":"2024-04-18T04:44:30.293996+0000","last_active":"2024-04-18T04:44:34.291911+0000","last_peered":"2024-04-18T04:44:34.291911+0000","last_clean":"2024-04-18T04:44:34.291911+0000","last_became_active":"2024-04-18T04:44:30.293748+0000","last_became_peered":"2024-04-18T04:44:30.293748+0000","last_unstale":"2024-04-18T04:44:34.291911+0000","last_undegraded":"2024-04-18T04:44:34.291911+0000","last_fullsized":"2024-04-18T04:44:34.291911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:18:32.116499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.306956+0000","last_change":"2024-04-18T04:44:30.312850+0000","last_active":"2024-04-18T04:44:34.306956+0000","last_peered":"2024-04-18T04:44:34.306956+0000","last_clean":"2024-04-18T04:44:34.306956+0000","last_became_active":"2024-04-18T04:44:30.304701+0000","last_became_peered":"2024-04-18T04:44:30.304701+0000","last_unstale":"2024-04-18T04:44:34.306956+0000","last_undegraded":"2024-04-18T04:44:34.306956+0000","last_fullsized":"2024-04-18T04:44:34.306956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:01:39.253277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.289625+0000","last_change":"2024-04-18T04:44:30.285836+0000","last_active":"2024-04-18T04:44:34.289625+0000","last_peered":"2024-04-18T04:44:34.289625+0000","last_clean":"2024-04-18T04:44:34.289625+0000","last_became_active":"2024-04-18T04:44:30.285602+0000","last_became_peered":"2024-04-18T04:44:30.285602+0000","last_unstale":"2024-04-18T04:44:34.289625+0000","last_undegraded":"2024-04-18T04:44:34.289625+0000","last_fullsized":"2024-04-18T04:44:34.289625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:34:39.594780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.306887+0000","last_change":"2024-04-18T04:44:30.307940+0000","last_active":"2024-04-18T04:44:34.306887+0000","last_peered":"2024-04-18T04:44:34.306887+0000","last_clean":"2024-04-18T04:44:34.306887+0000","last_became_active":"2024-04-18T04:44:30.307224+0000","last_became_peered":"2024-04-18T04:44:30.307224+0000","last_unstale":"2024-04-18T04:44:34.306887+0000","last_undegraded":"2024-04-18T04:44:34.306887+0000","last_fullsized":"2024-04-18T04:44:34.306887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:30:52.000855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.288405+0000","last_change":"2024-04-18T04:44:30.310229+0000","last_active":"2024-04-18T04:44:34.288405+0000","last_peered":"2024-04-18T04:44:34.288405+0000","last_clean":"2024-04-18T04:44:34.288405+0000","last_became_active":"2024-04-18T04:44:30.310045+0000","last_became_peered":"2024-04-18T04:44:30.310045+0000","last_unstale":"2024-04-18T04:44:34.288405+0000","last_undegraded":"2024-04-18T04:44:34.288405+0000","last_fullsized":"2024-04-18T04:44:34.288405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:22:55.588300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.289109+0000","last_change":"2024-04-18T04:44:30.305644+0000","last_active":"2024-04-18T04:44:34.289109+0000","last_peered":"2024-04-18T04:44:34.289109+0000","last_clean":"2024-04-18T04:44:34.289109+0000","last_became_active":"2024-04-18T04:44:30.304921+0000","last_became_peered":"2024-04-18T04:44:30.304921+0000","last_unstale":"2024-04-18T04:44:34.289109+0000","last_undegraded":"2024-04-18T04:44:34.289109+0000","last_fullsized":"2024-04-18T04:44:34.289109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:17:37.235711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.296403+0000","last_change":"2024-04-18T04:44:30.294105+0000","last_active":"2024-04-18T04:44:34.296403+0000","last_peered":"2024-04-18T04:44:34.296403+0000","last_clean":"2024-04-18T04:44:34.296403+0000","last_became_active":"2024-04-18T04:44:30.291742+0000","last_became_peered":"2024-04-18T04:44:30.291742+0000","last_unstale":"2024-04-18T04:44:34.296403+0000","last_undegraded":"2024-04-18T04:44:34.296403+0000","last_fullsized":"2024-04-18T04:44:34.296403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:43:26.428261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.284984+0000","last_change":"2024-04-18T04:44:30.296496+0000","last_active":"2024-04-18T04:44:34.284984+0000","last_peered":"2024-04-18T04:44:34.284984+0000","last_clean":"2024-04-18T04:44:34.284984+0000","last_became_active":"2024-04-18T04:44:30.296177+0000","last_became_peered":"2024-04-18T04:44:30.296177+0000","last_unstale":"2024-04-18T04:44:34.284984+0000","last_undegraded":"2024-04-18T04:44:34.284984+0000","last_fullsized":"2024-04-18T04:44:34.284984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:46:44.829326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.310435+0000","last_change":"2024-04-18T04:44:30.306568+0000","last_active":"2024-04-18T04:44:34.310435+0000","last_peered":"2024-04-18T04:44:34.310435+0000","last_clean":"2024-04-18T04:44:34.310435+0000","last_became_active":"2024-04-18T04:44:30.305674+0000","last_became_peered":"2024-04-18T04:44:30.305674+0000","last_unstale":"2024-04-18T04:44:34.310435+0000","last_undegraded":"2024-04-18T04:44:34.310435+0000","last_fullsized":"2024-04-18T04:44:34.310435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:58:10.740164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.306735+0000","last_change":"2024-04-18T04:44:30.307297+0000","last_active":"2024-04-18T04:44:34.306735+0000","last_peered":"2024-04-18T04:44:34.306735+0000","last_clean":"2024-04-18T04:44:34.306735+0000","last_became_active":"2024-04-18T04:44:30.305470+0000","last_became_peered":"2024-04-18T04:44:30.305470+0000","last_unstale":"2024-04-18T04:44:34.306735+0000","last_undegraded":"2024-04-18T04:44:34.306735+0000","last_fullsized":"2024-04-18T04:44:34.306735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:01:00.587115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.297511+0000","last_change":"2024-04-18T04:44:30.280849+0000","last_active":"2024-04-18T04:44:34.297511+0000","last_peered":"2024-04-18T04:44:34.297511+0000","last_clean":"2024-04-18T04:44:34.297511+0000","last_became_active":"2024-04-18T04:44:30.280535+0000","last_became_peered":"2024-04-18T04:44:30.280535+0000","last_unstale":"2024-04-18T04:44:34.297511+0000","last_undegraded":"2024-04-18T04:44:34.297511+0000","last_fullsized":"2024-04-18T04:44:34.297511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:01:06.241941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287205+0000","last_change":"2024-04-18T04:44:30.278849+0000","last_active":"2024-04-18T04:44:34.287205+0000","last_peered":"2024-04-18T04:44:34.287205+0000","last_clean":"2024-04-18T04:44:34.287205+0000","last_became_active":"2024-04-18T04:44:30.278624+0000","last_became_peered":"2024-04-18T04:44:30.278624+0000","last_unstale":"2024-04-18T04:44:34.287205+0000","last_undegraded":"2024-04-18T04:44:34.287205+0000","last_fullsized":"2024-04-18T04:44:34.287205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:31:30.791150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.289094+0000","last_change":"2024-04-18T04:44:30.296148+0000","last_active":"2024-04-18T04:44:34.289094+0000","last_peered":"2024-04-18T04:44:34.289094+0000","last_clean":"2024-04-18T04:44:34.289094+0000","last_became_active":"2024-04-18T04:44:30.295754+0000","last_became_peered":"2024-04-18T04:44:30.295754+0000","last_unstale":"2024-04-18T04:44:34.289094+0000","last_undegraded":"2024-04-18T04:44:34.289094+0000","last_fullsized":"2024-04-18T04:44:34.289094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:39:53.809075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.304251+0000","last_change":"2024-04-18T04:44:30.298061+0000","last_active":"2024-04-18T04:44:34.304251+0000","last_peered":"2024-04-18T04:44:34.304251+0000","last_clean":"2024-04-18T04:44:34.304251+0000","last_became_active":"2024-04-18T04:44:30.297416+0000","last_became_peered":"2024-04-18T04:44:30.297416+0000","last_unstale":"2024-04-18T04:44:34.304251+0000","last_undegraded":"2024-04-18T04:44:34.304251+0000","last_fullsized":"2024-04-18T04:44:34.304251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:35:48.612670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.290793+0000","last_change":"2024-04-18T04:44:30.292802+0000","last_active":"2024-04-18T04:44:34.290793+0000","last_peered":"2024-04-18T04:44:34.290793+0000","last_clean":"2024-04-18T04:44:34.290793+0000","last_became_active":"2024-04-18T04:44:30.291939+0000","last_became_peered":"2024-04-18T04:44:30.291939+0000","last_unstale":"2024-04-18T04:44:34.290793+0000","last_undegraded":"2024-04-18T04:44:34.290793+0000","last_fullsized":"2024-04-18T04:44:34.290793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:33:04.689561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.290104+0000","last_change":"2024-04-18T04:44:30.309020+0000","last_active":"2024-04-18T04:44:34.290104+0000","last_peered":"2024-04-18T04:44:34.290104+0000","last_clean":"2024-04-18T04:44:34.290104+0000","last_became_active":"2024-04-18T04:44:30.307604+0000","last_became_peered":"2024-04-18T04:44:30.307604+0000","last_unstale":"2024-04-18T04:44:34.290104+0000","last_undegraded":"2024-04-18T04:44:34.290104+0000","last_fullsized":"2024-04-18T04:44:34.290104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:44:54.764284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.293307+0000","last_change":"2024-04-18T04:44:30.314533+0000","last_active":"2024-04-18T04:44:34.293307+0000","last_peered":"2024-04-18T04:44:34.293307+0000","last_clean":"2024-04-18T04:44:34.293307+0000","last_became_active":"2024-04-18T04:44:30.313985+0000","last_became_peered":"2024-04-18T04:44:30.313985+0000","last_unstale":"2024-04-18T04:44:34.293307+0000","last_undegraded":"2024-04-18T04:44:34.293307+0000","last_fullsized":"2024-04-18T04:44:34.293307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:02:03.941709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.288844+0000","last_change":"2024-04-18T04:44:30.309273+0000","last_active":"2024-04-18T04:44:34.288844+0000","last_peered":"2024-04-18T04:44:34.288844+0000","last_clean":"2024-04-18T04:44:34.288844+0000","last_became_active":"2024-04-18T04:44:30.309002+0000","last_became_peered":"2024-04-18T04:44:30.309002+0000","last_unstale":"2024-04-18T04:44:34.288844+0000","last_undegraded":"2024-04-18T04:44:34.288844+0000","last_fullsized":"2024-04-18T04:44:34.288844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:49:10.005359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287466+0000","last_change":"2024-04-18T04:44:30.292371+0000","last_active":"2024-04-18T04:44:34.287466+0000","last_peered":"2024-04-18T04:44:34.287466+0000","last_clean":"2024-04-18T04:44:34.287466+0000","last_became_active":"2024-04-18T04:44:30.290504+0000","last_became_peered":"2024-04-18T04:44:30.290504+0000","last_unstale":"2024-04-18T04:44:34.287466+0000","last_undegraded":"2024-04-18T04:44:34.287466+0000","last_fullsized":"2024-04-18T04:44:34.287466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:11.998355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.306657+0000","last_change":"2024-04-18T04:44:30.299935+0000","last_active":"2024-04-18T04:44:34.306657+0000","last_peered":"2024-04-18T04:44:34.306657+0000","last_clean":"2024-04-18T04:44:34.306657+0000","last_became_active":"2024-04-18T04:44:30.290175+0000","last_became_peered":"2024-04-18T04:44:30.290175+0000","last_unstale":"2024-04-18T04:44:34.306657+0000","last_undegraded":"2024-04-18T04:44:34.306657+0000","last_fullsized":"2024-04-18T04:44:34.306657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:15:13.703423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.288026+0000","last_change":"2024-04-18T04:44:30.288940+0000","last_active":"2024-04-18T04:44:34.288026+0000","last_peered":"2024-04-18T04:44:34.288026+0000","last_clean":"2024-04-18T04:44:34.288026+0000","last_became_active":"2024-04-18T04:44:30.288131+0000","last_became_peered":"2024-04-18T04:44:30.288131+0000","last_unstale":"2024-04-18T04:44:34.288026+0000","last_undegraded":"2024-04-18T04:44:34.288026+0000","last_fullsized":"2024-04-18T04:44:34.288026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:31:08.895305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.307235+0000","last_change":"2024-04-18T04:44:30.288066+0000","last_active":"2024-04-18T04:44:34.307235+0000","last_peered":"2024-04-18T04:44:34.307235+0000","last_clean":"2024-04-18T04:44:34.307235+0000","last_became_active":"2024-04-18T04:44:30.287325+0000","last_became_peered":"2024-04-18T04:44:30.287325+0000","last_unstale":"2024-04-18T04:44:34.307235+0000","last_undegraded":"2024-04-18T04:44:34.307235+0000","last_fullsized":"2024-04-18T04:44:34.307235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:58:04.111225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.287906+0000","last_change":"2024-04-18T04:44:30.275485+0000","last_active":"2024-04-18T04:44:34.287906+0000","last_peered":"2024-04-18T04:44:34.287906+0000","last_clean":"2024-04-18T04:44:34.287906+0000","last_became_active":"2024-04-18T04:44:30.275118+0000","last_became_peered":"2024-04-18T04:44:30.275118+0000","last_unstale":"2024-04-18T04:44:34.287906+0000","last_undegraded":"2024-04-18T04:44:34.287906+0000","last_fullsized":"2024-04-18T04:44:34.287906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:25:09.625660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.296349+0000","last_change":"2024-04-18T04:44:30.277119+0000","last_active":"2024-04-18T04:44:34.296349+0000","last_peered":"2024-04-18T04:44:34.296349+0000","last_clean":"2024-04-18T04:44:34.296349+0000","last_became_active":"2024-04-18T04:44:30.276654+0000","last_became_peered":"2024-04-18T04:44:30.276654+0000","last_unstale":"2024-04-18T04:44:34.296349+0000","last_undegraded":"2024-04-18T04:44:34.296349+0000","last_fullsized":"2024-04-18T04:44:34.296349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:52.420199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T04:44:34.293115+0000","last_change":"2024-04-18T04:44:30.302905+0000","last_active":"2024-04-18T04:44:34.293115+0000","last_peered":"2024-04-18T04:44:34.293115+0000","last_clean":"2024-04-18T04:44:34.293115+0000","last_became_active":"2024-04-18T04:44:30.302180+0000","last_became_peered":"2024-04-18T04:44:30.302180+0000","last_unstale":"2024-04-18T04:44:34.293115+0000","last_undegraded":"2024-04-18T04:44:34.293115+0000","last_fullsized":"2024-04-18T04:44:34.293115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:41:53.211956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5952,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":11342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66624,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":106737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":258048,"data_stored":102367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]}]},{"osd":1,"up_from":15,"seq":64424509452,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":103199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]}]},{"osd":7,"up_from":14,"seq":60129542157,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":693317,"data_compressed":33312,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542155,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":106253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]}]},{"osd":5,"up_from":14,"seq":60129542157,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":262144,"data_stored":102457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542157,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":102493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2230000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.165}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":335872,"data_stored":693373,"data_compressed":33312,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33312,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33312,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T04:45:05.085 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-18T04:45:05.085 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-18T04:45:05.085 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-18T04:45:05.085 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-18T04:45:05.173 INFO:tasks.ceph.mds.e.smithi120.stderr:2024-04-18T04:45:05.173+0000 7fbec2000640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-18T04:45:05.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.257+0000 7fb87b800640 1 Processor -- start 2024-04-18T04:45:05.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.257+0000 7fb87b800640 1 -- start start 2024-04-18T04:45:05.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.257+0000 7fb87b800640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb8741515e0 0x7fb8741573c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:05.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.257+0000 7fb87b800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb8740ca280 0x7fb87406fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:05.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.257+0000 7fb87b800640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb874157a50 con 0x7fb8740ca6b0 2024-04-18T04:45:05.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.257+0000 7fb87b800640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8740c3120 con 0x7fb8741515e0 2024-04-18T04:45:05.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.257+0000 7fb87b800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb874157d10 con 0x7fb8740ca280 2024-04-18T04:45:05.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.257+0000 7fb873e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb8740ca280 0x7fb87406fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:05.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.257+0000 7fb878e00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb8741515e0 0x7fb8741573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:05.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.257+0000 7fb873e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb8740ca280 0x7fb87406fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:42278/0 (socket says 172.21.15.120:42278) 2024-04-18T04:45:05.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.257+0000 7fb873e00640 1 -- 172.21.15.120:0/1396118674 learned_addr learned my addr 172.21.15.120:0/1396118674 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:05.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.257+0000 7fb873e00640 1 -- 172.21.15.120:0/1396118674 >> v2:172.21.15.132:3300/0 conn(0x7fb8741515e0 msgr2=0x7fb8741573c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:05.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.257+0000 7fb873e00640 1 --2- 172.21.15.120:0/1396118674 >> v2:172.21.15.132:3300/0 conn(0x7fb8741515e0 0x7fb8741573c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:05.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.257+0000 7fb873e00640 1 -- 172.21.15.120:0/1396118674 >> v1:172.21.15.132:6789/0 conn(0x7fb8740ca6b0 legacy=0x7fb8740ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:05.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.261+0000 7fb873e00640 1 -- 172.21.15.120:0/1396118674 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb874157ff0 con 0x7fb8740ca280 2024-04-18T04:45:05.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.261+0000 7fb878e00640 1 --2- 172.21.15.120:0/1396118674 >> v2:172.21.15.132:3300/0 conn(0x7fb8741515e0 0x7fb8741573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:45:05.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.261+0000 7fb873e00640 1 --2- 172.21.15.120:0/1396118674 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb8740ca280 0x7fb87406fd00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb860009870 tx=0x7fb86001ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40e015bcebe70721 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:05.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.261+0000 7fb873400640 1 -- 172.21.15.120:0/1396118674 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8600a8a50 con 0x7fb8740ca280 2024-04-18T04:45:05.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.261+0000 7fb873400640 1 -- 172.21.15.120:0/1396118674 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8600a8bb0 con 0x7fb8740ca280 2024-04-18T04:45:05.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.261+0000 7fb873400640 1 -- 172.21.15.120:0/1396118674 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8600b0440 con 0x7fb8740ca280 2024-04-18T04:45:05.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.261+0000 7fb87b800640 1 -- 172.21.15.120:0/1396118674 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb8740ca280 msgr2=0x7fb87406fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:05.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.261+0000 7fb87b800640 1 --2- 172.21.15.120:0/1396118674 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb8740ca280 0x7fb87406fd00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb860009870 tx=0x7fb86001ed50 comp rx=0 tx=0).stop 2024-04-18T04:45:05.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.261+0000 7fb87b800640 1 -- 172.21.15.120:0/1396118674 shutdown_connections 2024-04-18T04:45:05.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.261+0000 7fb87b800640 1 --2- 172.21.15.120:0/1396118674 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb8740ca280 0x7fb87406fd00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:05.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.261+0000 7fb87b800640 1 --2- 172.21.15.120:0/1396118674 >> v2:172.21.15.132:3300/0 conn(0x7fb8741515e0 0x7fb8741573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:05.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.261+0000 7fb87b800640 1 -- 172.21.15.120:0/1396118674 >> 172.21.15.120:0/1396118674 conn(0x7fb87406e0f0 msgr2=0x7fb874071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:05.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.265+0000 7fb87b800640 1 -- 172.21.15.120:0/1396118674 shutdown_connections 2024-04-18T04:45:05.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.265+0000 7fb87b800640 1 -- 172.21.15.120:0/1396118674 wait complete. 2024-04-18T04:45:05.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.265+0000 7fb87b800640 1 Processor -- start 2024-04-18T04:45:05.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.265+0000 7fb87b800640 1 -- start start 2024-04-18T04:45:05.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.265+0000 7fb87b800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb8740ca280 0x7fb8741f0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:05.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.265+0000 7fb87b800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb8740ca6b0 0x7fb874154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:05.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.265+0000 7fb87b800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8741515e0 0x7fb87414f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:05.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.265+0000 7fb87b800640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8741efc10 con 0x7fb8740ca6b0 2024-04-18T04:45:05.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.265+0000 7fb87b800640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8741f0b60 con 0x7fb8741515e0 2024-04-18T04:45:05.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.265+0000 7fb87b800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb874153830 con 0x7fb8740ca280 2024-04-18T04:45:05.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.265+0000 7fb873e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb8740ca6b0 0x7fb874154ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:05.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.265+0000 7fb873e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb8740ca6b0 0x7fb874154ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34126/0 (socket says 172.21.15.120:34126) 2024-04-18T04:45:05.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.265+0000 7fb873e00640 1 -- 172.21.15.120:0/4105555048 learned_addr learned my addr 172.21.15.120:0/4105555048 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:05.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.265+0000 7fb878e00640 1 --2- 172.21.15.120:0/4105555048 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb8740ca280 0x7fb8741f0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:05.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.265+0000 7fb879800640 1 --2- 172.21.15.120:0/4105555048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8741515e0 0x7fb87414f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:05.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.265+0000 7fb873e00640 1 -- 172.21.15.120:0/4105555048 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb8740ca280 msgr2=0x7fb8741f0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:05.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.265+0000 7fb873e00640 1 --2- 172.21.15.120:0/4105555048 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb8740ca280 0x7fb8741f0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:05.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.265+0000 7fb873e00640 1 -- 172.21.15.120:0/4105555048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8741515e0 msgr2=0x7fb87414f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:05.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.265+0000 7fb873e00640 1 --2- 172.21.15.120:0/4105555048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8741515e0 0x7fb87414f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:05.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.265+0000 7fb873e00640 1 -- 172.21.15.120:0/4105555048 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb864009420 con 0x7fb8740ca6b0 2024-04-18T04:45:05.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.265+0000 7fb879800640 1 --2- 172.21.15.120:0/4105555048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8741515e0 0x7fb87414f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:05.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.265+0000 7fb873e00640 1 --2- 172.21.15.120:0/4105555048 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb8740ca6b0 0x7fb874154ac0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb860000c10 tx=0x7fb86001baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:05.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.265+0000 7fb870c00640 1 -- 172.21.15.120:0/4105555048 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8600bf070 con 0x7fb8740ca6b0 2024-04-18T04:45:05.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.269+0000 7fb870c00640 1 -- 172.21.15.120:0/4105555048 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8600b1be0 con 0x7fb8740ca6b0 2024-04-18T04:45:05.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.269+0000 7fb870c00640 1 -- 172.21.15.120:0/4105555048 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8600b9410 con 0x7fb8740ca6b0 2024-04-18T04:45:05.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.269+0000 7fb87b800640 1 -- 172.21.15.120:0/4105555048 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8600094d0 con 0x7fb8740ca6b0 2024-04-18T04:45:05.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.269+0000 7fb87b800640 1 -- 172.21.15.120:0/4105555048 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb874153d60 con 0x7fb8740ca6b0 2024-04-18T04:45:05.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.269+0000 7fb87b800640 1 -- 172.21.15.120:0/4105555048 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb874072a70 con 0x7fb8740ca6b0 2024-04-18T04:45:05.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.269+0000 7fb870c00640 1 -- 172.21.15.120:0/4105555048 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb8600b7040 con 0x7fb8740ca6b0 2024-04-18T04:45:05.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.269+0000 7fb870c00640 1 --2- 172.21.15.120:0/4105555048 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb854066690 0x7fb854068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:05.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.269+0000 7fb870c00640 1 -- 172.21.15.120:0/4105555048 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb860121660 con 0x7fb8740ca6b0 2024-04-18T04:45:05.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.269+0000 7fb878e00640 1 --2- 172.21.15.120:0/4105555048 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb854066690 0x7fb854068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:05.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.273+0000 7fb878e00640 1 --2- 172.21.15.120:0/4105555048 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb854066690 0x7fb854068b50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb864009cf0 tx=0x7fb864009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:05.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.273+0000 7fb870c00640 1 -- 172.21.15.120:0/4105555048 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fb8600ee650 con 0x7fb8740ca6b0 2024-04-18T04:45:05.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.461+0000 7fb87b800640 1 -- 172.21.15.120:0/4105555048 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb874150340 con 0x7fb8740ca6b0 2024-04-18T04:45:05.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.461+0000 7fb870c00640 1 -- 172.21.15.120:0/4105555048 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fb8600b5040 con 0x7fb8740ca6b0 2024-04-18T04:45:05.461 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:45:05.461 INFO:teuthology.orchestra.run.smithi120.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-18T04:45:05.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.461+0000 7fb87b800640 1 -- 172.21.15.120:0/4105555048 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb854066690 msgr2=0x7fb854068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:05.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.461+0000 7fb87b800640 1 --2- 172.21.15.120:0/4105555048 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb854066690 0x7fb854068b50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb864009cf0 tx=0x7fb864009190 comp rx=0 tx=0).stop 2024-04-18T04:45:05.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.461+0000 7fb87b800640 1 -- 172.21.15.120:0/4105555048 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb8740ca6b0 msgr2=0x7fb874154ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:05.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.461+0000 7fb87b800640 1 --2- 172.21.15.120:0/4105555048 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb8740ca6b0 0x7fb874154ac0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb860000c10 tx=0x7fb86001baf0 comp rx=0 tx=0).stop 2024-04-18T04:45:05.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.465+0000 7fb87b800640 1 -- 172.21.15.120:0/4105555048 shutdown_connections 2024-04-18T04:45:05.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.465+0000 7fb87b800640 1 --2- 172.21.15.120:0/4105555048 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb854066690 0x7fb854068b50 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:05.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.465+0000 7fb87b800640 1 --2- 172.21.15.120:0/4105555048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8741515e0 0x7fb87414f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:05.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.465+0000 7fb87b800640 1 --2- 172.21.15.120:0/4105555048 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb8740ca6b0 0x7fb874154ac0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:05.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.465+0000 7fb87b800640 1 --2- 172.21.15.120:0/4105555048 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb8740ca280 0x7fb8741f0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:05.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.465+0000 7fb87b800640 1 -- 172.21.15.120:0/4105555048 >> 172.21.15.120:0/4105555048 conn(0x7fb87406e0f0 msgr2=0x7fb874157040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:05.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.465+0000 7fb87b800640 1 -- 172.21.15.120:0/4105555048 shutdown_connections 2024-04-18T04:45:05.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.465+0000 7fb87b800640 1 -- 172.21.15.120:0/4105555048 wait complete. 2024-04-18T04:45:05.481 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-18T04:45:05.482 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T04:45:05.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.617+0000 7eff3e000640 1 Processor -- start 2024-04-18T04:45:05.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.617+0000 7eff3e000640 1 -- start start 2024-04-18T04:45:05.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.617+0000 7eff3e000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff381515e0 0x7eff381573c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:05.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.617+0000 7eff3e000640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff38070410 con 0x7eff380ca280 2024-04-18T04:45:05.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.617+0000 7eff3e000640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff38157a50 con 0x7eff380ca680 2024-04-18T04:45:05.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.617+0000 7eff3e000640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff380c3120 con 0x7eff381515e0 2024-04-18T04:45:05.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.617+0000 7eff36a00640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7eff380ca280 0x7eff3806fd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:59270/0 (socket says 172.21.15.120:59270) 2024-04-18T04:45:05.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.617+0000 7eff36a00640 1 -- 172.21.15.120:0/2468974228 learned_addr learned my addr 172.21.15.120:0/2468974228 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:45:05.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.617+0000 7eff37400640 1 --2- 172.21.15.120:0/2468974228 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff381515e0 0x7eff381573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:05.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.617+0000 7eff36000640 1 -- 172.21.15.120:0/2468974228 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 646580577 0 0) 0x7eff38070410 con 0x7eff380ca280 2024-04-18T04:45:05.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.617+0000 7eff36000640 1 -- 172.21.15.120:0/2468974228 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff1c003530 con 0x7eff380ca280 2024-04-18T04:45:05.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.617+0000 7eff36000640 1 -- 172.21.15.120:0/2468974228 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3453757803 0 0) 0x7eff38157a50 con 0x7eff380ca680 2024-04-18T04:45:05.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.617+0000 7eff37400640 1 -- 172.21.15.120:0/2468974228 >> v1:172.21.15.132:6789/0 conn(0x7eff380ca680 legacy=0x7eff380ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:05.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.617+0000 7eff37400640 1 -- 172.21.15.120:0/2468974228 >> v1:172.21.15.120:6789/0 conn(0x7eff380ca280 legacy=0x7eff3806fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:05.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.617+0000 7eff37400640 1 -- 172.21.15.120:0/2468974228 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff38157d10 con 0x7eff381515e0 2024-04-18T04:45:05.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.621+0000 7eff37400640 1 --2- 172.21.15.120:0/2468974228 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff381515e0 0x7eff381573c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7eff28009dc0 tx=0x7eff2801f170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16aa0b2b90ded5f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:05.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.621+0000 7eff36000640 1 -- 172.21.15.120:0/2468974228 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff280af600 con 0x7eff381515e0 2024-04-18T04:45:05.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.621+0000 7eff36000640 1 -- 172.21.15.120:0/2468974228 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff280ab050 con 0x7eff381515e0 2024-04-18T04:45:05.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.621+0000 7eff36000640 1 -- 172.21.15.120:0/2468974228 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff280af960 con 0x7eff381515e0 2024-04-18T04:45:05.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.621+0000 7eff3e000640 1 -- 172.21.15.120:0/2468974228 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff381515e0 msgr2=0x7eff381573c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:05.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.621+0000 7eff3e000640 1 --2- 172.21.15.120:0/2468974228 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff381515e0 0x7eff381573c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7eff28009dc0 tx=0x7eff2801f170 comp rx=0 tx=0).stop 2024-04-18T04:45:05.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.621+0000 7eff3e000640 1 -- 172.21.15.120:0/2468974228 shutdown_connections 2024-04-18T04:45:05.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.621+0000 7eff3e000640 1 --2- 172.21.15.120:0/2468974228 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff381515e0 0x7eff381573c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:05.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.621+0000 7eff3e000640 1 -- 172.21.15.120:0/2468974228 >> 172.21.15.120:0/2468974228 conn(0x7eff3806e0f0 msgr2=0x7eff38071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:05.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.621+0000 7eff3e000640 1 -- 172.21.15.120:0/2468974228 shutdown_connections 2024-04-18T04:45:05.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.621+0000 7eff3e000640 1 -- 172.21.15.120:0/2468974228 wait complete. 2024-04-18T04:45:05.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.625+0000 7eff3e000640 1 Processor -- start 2024-04-18T04:45:05.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.625+0000 7eff3e000640 1 -- start start 2024-04-18T04:45:05.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.625+0000 7eff3e000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff380ca280 0x7eff3815a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:05.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.625+0000 7eff3e000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff380ca680 0x7eff381ee5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:05.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.625+0000 7eff3e000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff381515e0 0x7eff3815b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:05.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.625+0000 7eff3e000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff38152060 con 0x7eff381515e0 2024-04-18T04:45:05.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.625+0000 7eff3e000640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3815a4b0 con 0x7eff380ca680 2024-04-18T04:45:05.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.625+0000 7eff3e000640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff381550c0 con 0x7eff380ca280 2024-04-18T04:45:05.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.625+0000 7eff37e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff381515e0 0x7eff3815b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:05.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.625+0000 7eff37e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff381515e0 0x7eff3815b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34138/0 (socket says 172.21.15.120:34138) 2024-04-18T04:45:05.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.625+0000 7eff37e00640 1 -- 172.21.15.120:0/1037492751 learned_addr learned my addr 172.21.15.120:0/1037492751 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:05.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.625+0000 7eff37400640 1 --2- 172.21.15.120:0/1037492751 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff380ca280 0x7eff3815a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:05.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.625+0000 7eff36a00640 1 --2- 172.21.15.120:0/1037492751 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff380ca680 0x7eff381ee5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:05.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.625+0000 7eff37e00640 1 -- 172.21.15.120:0/1037492751 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff380ca280 msgr2=0x7eff3815a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:05.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.625+0000 7eff37e00640 1 --2- 172.21.15.120:0/1037492751 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff380ca280 0x7eff3815a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:05.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.625+0000 7eff37e00640 1 -- 172.21.15.120:0/1037492751 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff380ca680 msgr2=0x7eff381ee5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:05.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.625+0000 7eff37e00640 1 --2- 172.21.15.120:0/1037492751 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff380ca680 0x7eff381ee5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:05.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.625+0000 7eff37e00640 1 -- 172.21.15.120:0/1037492751 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff28009a70 con 0x7eff381515e0 2024-04-18T04:45:05.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.625+0000 7eff37e00640 1 --2- 172.21.15.120:0/1037492751 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff381515e0 0x7eff3815b140 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7eff3000c480 tx=0x7eff3000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:05.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.625+0000 7eff2f400640 1 -- 172.21.15.120:0/1037492751 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff30005480 con 0x7eff381515e0 2024-04-18T04:45:05.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.625+0000 7eff2f400640 1 -- 172.21.15.120:0/1037492751 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff30003600 con 0x7eff381515e0 2024-04-18T04:45:05.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.625+0000 7eff2f400640 1 -- 172.21.15.120:0/1037492751 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff300039b0 con 0x7eff381515e0 2024-04-18T04:45:05.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.625+0000 7eff3e000640 1 -- 172.21.15.120:0/1037492751 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff38154b00 con 0x7eff381515e0 2024-04-18T04:45:05.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.625+0000 7eff3e000640 1 -- 172.21.15.120:0/1037492751 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff3815a0d0 con 0x7eff381515e0 2024-04-18T04:45:05.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.629+0000 7eff3e000640 1 -- 172.21.15.120:0/1037492751 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff38067590 con 0x7eff381515e0 2024-04-18T04:45:05.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.629+0000 7eff2f400640 1 -- 172.21.15.120:0/1037492751 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7eff30003b10 con 0x7eff381515e0 2024-04-18T04:45:05.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.629+0000 7eff2f400640 1 --2- 172.21.15.120:0/1037492751 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7eff18066690 0x7eff18068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:05.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.629+0000 7eff2f400640 1 -- 172.21.15.120:0/1037492751 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7eff30083e60 con 0x7eff381515e0 2024-04-18T04:45:05.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.629+0000 7eff37400640 1 --2- 172.21.15.120:0/1037492751 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7eff18066690 0x7eff18068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:05.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.629+0000 7eff37400640 1 --2- 172.21.15.120:0/1037492751 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7eff18066690 0x7eff18068b50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7eff280b1000 tx=0x7eff280aa000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:05.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.633+0000 7eff2f400640 1 -- 172.21.15.120:0/1037492751 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7eff30051020 con 0x7eff381515e0 2024-04-18T04:45:05.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.785+0000 7eff3e000640 1 -- 172.21.15.120:0/1037492751 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff38159f30 con 0x7eff381515e0 2024-04-18T04:45:05.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.789+0000 7eff2f400640 1 -- 172.21.15.120:0/1037492751 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7eff38159f30 con 0x7eff381515e0 2024-04-18T04:45:05.788 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:45:05.788 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":25,"fsid":"8e73592f-08e2-4957-a98f-9d044cec4ba5","created":"2024-04-18T04:44:06.139983+0000","modified":"2024-04-18T04:44:34.676253+0000","last_up_change":"2024-04-18T04:44:17.410146+0000","last_in_change":"2024-04-18T04:44:08.470250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T04:44:16.864728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T04:44:28.825773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T04:44:29.245857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-18T04:44:32.314302+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a80903bd-d9be-4fb9-af99-6125cb26bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":27468},{"type":"v1","addr":"172.21.15.120:6801","nonce":27468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":27468},{"type":"v1","addr":"172.21.15.120:6803","nonce":27468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":27468},{"type":"v1","addr":"172.21.15.120:6807","nonce":27468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":27468},{"type":"v1","addr":"172.21.15.120:6805","nonce":27468}]},"public_addr":"172.21.15.120:6801/27468","cluster_addr":"172.21.15.120:6803/27468","heartbeat_back_addr":"172.21.15.120:6807/27468","heartbeat_front_addr":"172.21.15.120:6805/27468","state":["exists","up"]},{"osd":1,"uuid":"8f5f004b-6870-4c78-8d50-9622e631ec25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":27470},{"type":"v1","addr":"172.21.15.120:6823","nonce":27470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":27470},{"type":"v1","addr":"172.21.15.120:6827","nonce":27470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":27470},{"type":"v1","addr":"172.21.15.120:6831","nonce":27470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":27470},{"type":"v1","addr":"172.21.15.120:6829","nonce":27470}]},"public_addr":"172.21.15.120:6823/27470","cluster_addr":"172.21.15.120:6827/27470","heartbeat_back_addr":"172.21.15.120:6831/27470","heartbeat_front_addr":"172.21.15.120:6829/27470","state":["exists","up"]},{"osd":2,"uuid":"6e228a2b-6103-4301-a8b5-ee81dbb1f920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":27471},{"type":"v1","addr":"172.21.15.120:6817","nonce":27471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":27471},{"type":"v1","addr":"172.21.15.120:6819","nonce":27471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":27471},{"type":"v1","addr":"172.21.15.120:6826","nonce":27471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":27471},{"type":"v1","addr":"172.21.15.120:6822","nonce":27471}]},"public_addr":"172.21.15.120:6817/27471","cluster_addr":"172.21.15.120:6819/27471","heartbeat_back_addr":"172.21.15.120:6826/27471","heartbeat_front_addr":"172.21.15.120:6822/27471","state":["exists","up"]},{"osd":3,"uuid":"7a5cabd7-d898-4e32-a03c-25b46e790134","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":27469},{"type":"v1","addr":"172.21.15.120:6809","nonce":27469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":27469},{"type":"v1","addr":"172.21.15.120:6811","nonce":27469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":27469},{"type":"v1","addr":"172.21.15.120:6815","nonce":27469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":27469},{"type":"v1","addr":"172.21.15.120:6813","nonce":27469}]},"public_addr":"172.21.15.120:6809/27469","cluster_addr":"172.21.15.120:6811/27469","heartbeat_back_addr":"172.21.15.120:6815/27469","heartbeat_front_addr":"172.21.15.120:6813/27469","state":["exists","up"]},{"osd":4,"uuid":"8e9f530f-6bab-4b23-a1a3-a71362fefcc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":28102},{"type":"v1","addr":"172.21.15.132:6825","nonce":28102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":28102},{"type":"v1","addr":"172.21.15.132:6827","nonce":28102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":28102},{"type":"v1","addr":"172.21.15.132:6831","nonce":28102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":28102},{"type":"v1","addr":"172.21.15.132:6829","nonce":28102}]},"public_addr":"172.21.15.132:6825/28102","cluster_addr":"172.21.15.132:6827/28102","heartbeat_back_addr":"172.21.15.132:6831/28102","heartbeat_front_addr":"172.21.15.132:6829/28102","state":["exists","up"]},{"osd":5,"uuid":"2243fabe-cc81-40cf-91bc-f106fe275a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":28104},{"type":"v1","addr":"172.21.15.132:6809","nonce":28104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":28104},{"type":"v1","addr":"172.21.15.132:6811","nonce":28104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":28104},{"type":"v1","addr":"172.21.15.132:6815","nonce":28104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":28104},{"type":"v1","addr":"172.21.15.132:6813","nonce":28104}]},"public_addr":"172.21.15.132:6809/28104","cluster_addr":"172.21.15.132:6811/28104","heartbeat_back_addr":"172.21.15.132:6815/28104","heartbeat_front_addr":"172.21.15.132:6813/28104","state":["exists","up"]},{"osd":6,"uuid":"c093a5ed-25c8-41a7-a20d-606a1a1661e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":28103},{"type":"v1","addr":"172.21.15.132:6801","nonce":28103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":28103},{"type":"v1","addr":"172.21.15.132:6803","nonce":28103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":28103},{"type":"v1","addr":"172.21.15.132:6807","nonce":28103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":28103},{"type":"v1","addr":"172.21.15.132:6805","nonce":28103}]},"public_addr":"172.21.15.132:6801/28103","cluster_addr":"172.21.15.132:6803/28103","heartbeat_back_addr":"172.21.15.132:6807/28103","heartbeat_front_addr":"172.21.15.132:6805/28103","state":["exists","up"]},{"osd":7,"uuid":"c37426b7-1080-4434-9f3e-a3afbbdc0fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":28129},{"type":"v1","addr":"172.21.15.132:6817","nonce":28129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":28129},{"type":"v1","addr":"172.21.15.132:6819","nonce":28129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":28129},{"type":"v1","addr":"172.21.15.132:6823","nonce":28129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":28129},{"type":"v1","addr":"172.21.15.132:6821","nonce":28129}]},"public_addr":"172.21.15.132:6817/28129","cluster_addr":"172.21.15.132:6819/28129","heartbeat_back_addr":"172.21.15.132:6823/28129","heartbeat_front_addr":"172.21.15.132:6821/28129","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.053825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.289753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.274645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.146361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.943883+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.701955+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.851076+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.800782+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T04:45:05.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.789+0000 7eff3e000640 1 -- 172.21.15.120:0/1037492751 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7eff18066690 msgr2=0x7eff18068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:05.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.789+0000 7eff3e000640 1 --2- 172.21.15.120:0/1037492751 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7eff18066690 0x7eff18068b50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7eff280b1000 tx=0x7eff280aa000 comp rx=0 tx=0).stop 2024-04-18T04:45:05.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.789+0000 7eff3e000640 1 -- 172.21.15.120:0/1037492751 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff381515e0 msgr2=0x7eff3815b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:05.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.789+0000 7eff3e000640 1 --2- 172.21.15.120:0/1037492751 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff381515e0 0x7eff3815b140 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7eff3000c480 tx=0x7eff3000c940 comp rx=0 tx=0).stop 2024-04-18T04:45:05.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.789+0000 7eff3e000640 1 -- 172.21.15.120:0/1037492751 shutdown_connections 2024-04-18T04:45:05.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.789+0000 7eff3e000640 1 --2- 172.21.15.120:0/1037492751 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7eff18066690 0x7eff18068b50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:05.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.789+0000 7eff3e000640 1 --2- 172.21.15.120:0/1037492751 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff381515e0 0x7eff3815b140 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:05.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.789+0000 7eff3e000640 1 --2- 172.21.15.120:0/1037492751 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff380ca680 0x7eff381ee5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:05.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.789+0000 7eff3e000640 1 --2- 172.21.15.120:0/1037492751 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff380ca280 0x7eff3815a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:05.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.789+0000 7eff3e000640 1 -- 172.21.15.120:0/1037492751 >> 172.21.15.120:0/1037492751 conn(0x7eff3806e0f0 msgr2=0x7eff38156d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:05.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.789+0000 7eff3e000640 1 -- 172.21.15.120:0/1037492751 shutdown_connections 2024-04-18T04:45:05.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.789+0000 7eff3e000640 1 -- 172.21.15.120:0/1037492751 wait complete. 2024-04-18T04:45:05.808 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T04:44:16.864728+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T04:44:28.825773+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T04:44:29.245857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-18T04:44:32.314302+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-18T04:45:05.809 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T04:45:05.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.945+0000 7ff26ae00640 1 Processor -- start 2024-04-18T04:45:05.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.945+0000 7ff26ae00640 1 -- start start 2024-04-18T04:45:05.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.949+0000 7ff26ae00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff2641517f0 0x7ff2640c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:05.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.949+0000 7ff26ae00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff2640c7440 0x7ff26406bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:05.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.949+0000 7ff26ae00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2640c5a60 con 0x7ff26406c4f0 2024-04-18T04:45:05.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.949+0000 7ff26ae00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff264151bd0 con 0x7ff2641517f0 2024-04-18T04:45:05.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.949+0000 7ff26ae00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff26415acd0 con 0x7ff2640c7440 2024-04-18T04:45:05.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.949+0000 7ff268e00640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7ff26406c4f0 0x7ff2640c5ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:59280/0 (socket says 172.21.15.120:59280) 2024-04-18T04:45:05.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.949+0000 7ff268e00640 1 -- 172.21.15.120:0/988802974 learned_addr learned my addr 172.21.15.120:0/988802974 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:45:05.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.949+0000 7ff263e00640 1 --2- 172.21.15.120:0/988802974 >> v2:172.21.15.120:3300/0 conn(0x7ff2641517f0 0x7ff2640c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:05.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.949+0000 7ff263400640 1 --2- 172.21.15.120:0/988802974 >> v2:172.21.15.132:3300/0 conn(0x7ff2640c7440 0x7ff26406bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:05.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.949+0000 7ff263e00640 1 -- 172.21.15.120:0/988802974 >> v2:172.21.15.132:3300/0 conn(0x7ff2640c7440 msgr2=0x7ff26406bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:05.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.949+0000 7ff263e00640 1 --2- 172.21.15.120:0/988802974 >> v2:172.21.15.132:3300/0 conn(0x7ff2640c7440 0x7ff26406bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:05.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.949+0000 7ff263e00640 1 -- 172.21.15.120:0/988802974 >> v1:172.21.15.120:6789/0 conn(0x7ff26406c4f0 legacy=0x7ff2640c5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:05.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.949+0000 7ff263e00640 1 -- 172.21.15.120:0/988802974 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff26415afb0 con 0x7ff2641517f0 2024-04-18T04:45:05.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.949+0000 7ff262a00640 1 -- 172.21.15.120:0/988802974 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1733533806 0 0) 0x7ff2640c5a60 con 0x7ff26406c4f0 2024-04-18T04:45:05.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.953+0000 7ff263e00640 1 --2- 172.21.15.120:0/988802974 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2641517f0 0x7ff2640c6d70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff26406ade0 tx=0x7ff25401f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee19bead8007ad05 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:05.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.953+0000 7ff262a00640 1 -- 172.21.15.120:0/988802974 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2540af600 con 0x7ff2641517f0 2024-04-18T04:45:05.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.953+0000 7ff262a00640 1 -- 172.21.15.120:0/988802974 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2540ab050 con 0x7ff2641517f0 2024-04-18T04:45:05.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.953+0000 7ff262a00640 1 -- 172.21.15.120:0/988802974 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2540af980 con 0x7ff2641517f0 2024-04-18T04:45:05.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.953+0000 7ff26ae00640 1 -- 172.21.15.120:0/988802974 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2641517f0 msgr2=0x7ff2640c6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:05.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.953+0000 7ff26ae00640 1 --2- 172.21.15.120:0/988802974 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2641517f0 0x7ff2640c6d70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff26406ade0 tx=0x7ff25401f110 comp rx=0 tx=0).stop 2024-04-18T04:45:05.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.953+0000 7ff26ae00640 1 -- 172.21.15.120:0/988802974 shutdown_connections 2024-04-18T04:45:05.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.953+0000 7ff26ae00640 1 --2- 172.21.15.120:0/988802974 >> v2:172.21.15.132:3300/0 conn(0x7ff2640c7440 0x7ff26406bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:05.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.953+0000 7ff26ae00640 1 --2- 172.21.15.120:0/988802974 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2641517f0 0x7ff2640c6d70 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:05.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.953+0000 7ff26ae00640 1 -- 172.21.15.120:0/988802974 >> 172.21.15.120:0/988802974 conn(0x7ff2640c7a30 msgr2=0x7ff2640c7e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:05.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.953+0000 7ff26ae00640 1 -- 172.21.15.120:0/988802974 shutdown_connections 2024-04-18T04:45:05.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.953+0000 7ff26ae00640 1 -- 172.21.15.120:0/988802974 wait complete. 2024-04-18T04:45:05.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.953+0000 7ff26ae00640 1 Processor -- start 2024-04-18T04:45:05.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.953+0000 7ff26ae00640 1 -- start start 2024-04-18T04:45:05.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.957+0000 7ff26ae00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff26406c4f0 0x7ff26414a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:05.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.957+0000 7ff26ae00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2640c7440 0x7ff2641562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:05.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.957+0000 7ff26ae00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2641517f0 0x7ff264147540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:05.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.957+0000 7ff26ae00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2640cad10 con 0x7ff2641517f0 2024-04-18T04:45:05.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.957+0000 7ff26ae00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff264151d80 con 0x7ff26406c4f0 2024-04-18T04:45:05.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.957+0000 7ff26ae00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2641576d0 con 0x7ff2640c7440 2024-04-18T04:45:05.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.957+0000 7ff268e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2641517f0 0x7ff264147540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:05.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.957+0000 7ff268e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2641517f0 0x7ff264147540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34144/0 (socket says 172.21.15.120:34144) 2024-04-18T04:45:05.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.957+0000 7ff268e00640 1 -- 172.21.15.120:0/3891224261 learned_addr learned my addr 172.21.15.120:0/3891224261 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:05.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.957+0000 7ff263e00640 1 --2- 172.21.15.120:0/3891224261 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff26406c4f0 0x7ff26414a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:05.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.957+0000 7ff263400640 1 --2- 172.21.15.120:0/3891224261 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2640c7440 0x7ff2641562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:05.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.957+0000 7ff268e00640 1 -- 172.21.15.120:0/3891224261 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2640c7440 msgr2=0x7ff2641562a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:05.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.957+0000 7ff268e00640 1 --2- 172.21.15.120:0/3891224261 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2640c7440 0x7ff2641562a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:05.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.957+0000 7ff268e00640 1 -- 172.21.15.120:0/3891224261 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff26406c4f0 msgr2=0x7ff26414a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:05.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.957+0000 7ff268e00640 1 --2- 172.21.15.120:0/3891224261 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff26406c4f0 0x7ff26414a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:05.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.957+0000 7ff268e00640 1 -- 172.21.15.120:0/3891224261 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff254009a70 con 0x7ff2641517f0 2024-04-18T04:45:05.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.957+0000 7ff263400640 1 --2- 172.21.15.120:0/3891224261 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2640c7440 0x7ff2641562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:05.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.957+0000 7ff268e00640 1 --2- 172.21.15.120:0/3891224261 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2641517f0 0x7ff264147540 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff25c00c470 tx=0x7ff25c00c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:05.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.957+0000 7ff25be00640 1 -- 172.21.15.120:0/3891224261 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c0074e0 con 0x7ff2641517f0 2024-04-18T04:45:05.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.957+0000 7ff25be00640 1 -- 172.21.15.120:0/3891224261 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25c007640 con 0x7ff2641517f0 2024-04-18T04:45:05.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.957+0000 7ff26ae00640 1 -- 172.21.15.120:0/3891224261 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff26414fef0 con 0x7ff2641517f0 2024-04-18T04:45:05.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.957+0000 7ff25be00640 1 -- 172.21.15.120:0/3891224261 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c004a30 con 0x7ff2641517f0 2024-04-18T04:45:05.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.957+0000 7ff26ae00640 1 -- 172.21.15.120:0/3891224261 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff264147a80 con 0x7ff2641517f0 2024-04-18T04:45:05.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.957+0000 7ff26ae00640 1 -- 172.21.15.120:0/3891224261 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff264071c00 con 0x7ff2641517f0 2024-04-18T04:45:05.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.957+0000 7ff25be00640 1 -- 172.21.15.120:0/3891224261 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff25c004b90 con 0x7ff2641517f0 2024-04-18T04:45:05.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.961+0000 7ff25be00640 1 --2- 172.21.15.120:0/3891224261 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff2440666c0 0x7ff244068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:05.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.961+0000 7ff25be00640 1 -- 172.21.15.120:0/3891224261 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff25c0839f0 con 0x7ff2641517f0 2024-04-18T04:45:05.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.961+0000 7ff263e00640 1 --2- 172.21.15.120:0/3891224261 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff2440666c0 0x7ff244068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:05.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.961+0000 7ff263e00640 1 --2- 172.21.15.120:0/3891224261 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff2440666c0 0x7ff244068b80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff2540b1000 tx=0x7ff2540aa000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:05.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:05.965+0000 7ff25be00640 1 -- 172.21.15.120:0/3891224261 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7ff25c0509f0 con 0x7ff2641517f0 2024-04-18T04:45:06.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.117+0000 7ff26ae00640 1 -- 172.21.15.120:0/3891224261 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff2640729d0 con 0x7ff2641517f0 2024-04-18T04:45:06.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.117+0000 7ff25be00640 1 -- 172.21.15.120:0/3891224261 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff25c018020 con 0x7ff2641517f0 2024-04-18T04:45:06.119 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2024-04-18T04:45:06.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.121+0000 7ff26ae00640 1 -- 172.21.15.120:0/3891224261 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff2440666c0 msgr2=0x7ff244068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:06.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.121+0000 7ff26ae00640 1 --2- 172.21.15.120:0/3891224261 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff2440666c0 0x7ff244068b80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff2540b1000 tx=0x7ff2540aa000 comp rx=0 tx=0).stop 2024-04-18T04:45:06.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.121+0000 7ff26ae00640 1 -- 172.21.15.120:0/3891224261 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2641517f0 msgr2=0x7ff264147540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:06.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.121+0000 7ff26ae00640 1 --2- 172.21.15.120:0/3891224261 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2641517f0 0x7ff264147540 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff25c00c470 tx=0x7ff25c00c930 comp rx=0 tx=0).stop 2024-04-18T04:45:06.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.121+0000 7ff26ae00640 1 -- 172.21.15.120:0/3891224261 shutdown_connections 2024-04-18T04:45:06.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.121+0000 7ff26ae00640 1 --2- 172.21.15.120:0/3891224261 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff2440666c0 0x7ff244068b80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:06.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.121+0000 7ff26ae00640 1 --2- 172.21.15.120:0/3891224261 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2641517f0 0x7ff264147540 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:06.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.121+0000 7ff26ae00640 1 --2- 172.21.15.120:0/3891224261 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2640c7440 0x7ff2641562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:06.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.121+0000 7ff26ae00640 1 --2- 172.21.15.120:0/3891224261 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff26406c4f0 0x7ff26414a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:06.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.121+0000 7ff26ae00640 1 -- 172.21.15.120:0/3891224261 >> 172.21.15.120:0/3891224261 conn(0x7ff2640c7a30 msgr2=0x7ff2640c7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:06.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.121+0000 7ff26ae00640 1 -- 172.21.15.120:0/3891224261 shutdown_connections 2024-04-18T04:45:06.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.121+0000 7ff26ae00640 1 -- 172.21.15.120:0/3891224261 wait complete. 2024-04-18T04:45:06.140 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T04:45:06.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.277+0000 7fb67fa00640 1 Processor -- start 2024-04-18T04:45:06.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.277+0000 7fb67fa00640 1 -- start start 2024-04-18T04:45:06.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.281+0000 7fb67fa00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb67815a2f0 0x7fb678070a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:06.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.281+0000 7fb67fa00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb678159750 con 0x7fb6781538c0 2024-04-18T04:45:06.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.281+0000 7fb67fa00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6780c8480 con 0x7fb678070fe0 2024-04-18T04:45:06.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.281+0000 7fb67fa00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6780c8760 con 0x7fb67815a2f0 2024-04-18T04:45:06.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.281+0000 7fb67da00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb67815a2f0 0x7fb678070a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:06.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.281+0000 7fb67d000640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fb6781538c0 0x7fb678069ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:59296/0 (socket says 172.21.15.120:59296) 2024-04-18T04:45:06.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.281+0000 7fb67d000640 1 -- 172.21.15.120:0/2713887638 learned_addr learned my addr 172.21.15.120:0/2713887638 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:45:06.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.281+0000 7fb67da00640 1 -- 172.21.15.120:0/2713887638 >> v1:172.21.15.132:6789/0 conn(0x7fb678070fe0 legacy=0x7fb678159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:06.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.281+0000 7fb67da00640 1 -- 172.21.15.120:0/2713887638 >> v1:172.21.15.120:6789/0 conn(0x7fb6781538c0 legacy=0x7fb678069ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:06.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.281+0000 7fb67da00640 1 -- 172.21.15.120:0/2713887638 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb67806c830 con 0x7fb67815a2f0 2024-04-18T04:45:06.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.281+0000 7fb677400640 1 -- 172.21.15.120:0/2713887638 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1785602692 0 0) 0x7fb678159750 con 0x7fb6781538c0 2024-04-18T04:45:06.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.285+0000 7fb67da00640 1 --2- 172.21.15.120:0/2713887638 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb67815a2f0 0x7fb678070a40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb670009d90 tx=0x7fb67001f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a8095e395e073c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:06.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.285+0000 7fb677400640 1 -- 172.21.15.120:0/2713887638 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6700af600 con 0x7fb67815a2f0 2024-04-18T04:45:06.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.285+0000 7fb677400640 1 -- 172.21.15.120:0/2713887638 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6700ab050 con 0x7fb67815a2f0 2024-04-18T04:45:06.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.285+0000 7fb677400640 1 -- 172.21.15.120:0/2713887638 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6700af980 con 0x7fb67815a2f0 2024-04-18T04:45:06.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.285+0000 7fb67fa00640 1 -- 172.21.15.120:0/2713887638 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb67815a2f0 msgr2=0x7fb678070a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:06.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.285+0000 7fb67fa00640 1 --2- 172.21.15.120:0/2713887638 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb67815a2f0 0x7fb678070a40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb670009d90 tx=0x7fb67001f150 comp rx=0 tx=0).stop 2024-04-18T04:45:06.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.285+0000 7fb67fa00640 1 -- 172.21.15.120:0/2713887638 shutdown_connections 2024-04-18T04:45:06.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.285+0000 7fb67fa00640 1 --2- 172.21.15.120:0/2713887638 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb67815a2f0 0x7fb678070a40 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:06.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.285+0000 7fb67fa00640 1 -- 172.21.15.120:0/2713887638 >> 172.21.15.120:0/2713887638 conn(0x7fb6780cbed0 msgr2=0x7fb6780cc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:06.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.285+0000 7fb67fa00640 1 -- 172.21.15.120:0/2713887638 shutdown_connections 2024-04-18T04:45:06.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.285+0000 7fb67fa00640 1 -- 172.21.15.120:0/2713887638 wait complete. 2024-04-18T04:45:06.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.285+0000 7fb67fa00640 1 Processor -- start 2024-04-18T04:45:06.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.285+0000 7fb67fa00640 1 -- start start 2024-04-18T04:45:06.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.285+0000 7fb67fa00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb678070fe0 0x7fb67815ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:06.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.285+0000 7fb67fa00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6781538c0 0x7fb67814a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:06.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.285+0000 7fb67fa00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb67815a2f0 0x7fb678149750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:06.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.285+0000 7fb67fa00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6781eed80 con 0x7fb678070fe0 2024-04-18T04:45:06.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.285+0000 7fb67fa00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb678153fc0 con 0x7fb6781538c0 2024-04-18T04:45:06.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.285+0000 7fb67fa00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb678154f90 con 0x7fb67815a2f0 2024-04-18T04:45:06.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.285+0000 7fb67d000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb678070fe0 0x7fb67815ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:06.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.285+0000 7fb67d000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb678070fe0 0x7fb67815ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34164/0 (socket says 172.21.15.120:34164) 2024-04-18T04:45:06.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.285+0000 7fb67d000640 1 -- 172.21.15.120:0/3866435134 learned_addr learned my addr 172.21.15.120:0/3866435134 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:06.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.289+0000 7fb677e00640 1 --2- 172.21.15.120:0/3866435134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6781538c0 0x7fb67814a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:06.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.289+0000 7fb67da00640 1 --2- 172.21.15.120:0/3866435134 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb67815a2f0 0x7fb678149750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:06.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.289+0000 7fb67d000640 1 -- 172.21.15.120:0/3866435134 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb67815a2f0 msgr2=0x7fb678149750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:06.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.289+0000 7fb67d000640 1 --2- 172.21.15.120:0/3866435134 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb67815a2f0 0x7fb678149750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:06.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.289+0000 7fb67d000640 1 -- 172.21.15.120:0/3866435134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6781538c0 msgr2=0x7fb67814a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:06.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.289+0000 7fb67d000640 1 --2- 172.21.15.120:0/3866435134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6781538c0 0x7fb67814a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:06.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.289+0000 7fb67d000640 1 -- 172.21.15.120:0/3866435134 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb670009a70 con 0x7fb678070fe0 2024-04-18T04:45:06.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.289+0000 7fb67d000640 1 --2- 172.21.15.120:0/3866435134 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb678070fe0 0x7fb67815ce30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb66c00c4a0 tx=0x7fb66c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:06.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.289+0000 7fb674c00640 1 -- 172.21.15.120:0/3866435134 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66c0074e0 con 0x7fb678070fe0 2024-04-18T04:45:06.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.289+0000 7fb674c00640 1 -- 172.21.15.120:0/3866435134 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb66c007640 con 0x7fb678070fe0 2024-04-18T04:45:06.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.289+0000 7fb674c00640 1 -- 172.21.15.120:0/3866435134 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66c004a30 con 0x7fb678070fe0 2024-04-18T04:45:06.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.289+0000 7fb67fa00640 1 -- 172.21.15.120:0/3866435134 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6781eef70 con 0x7fb678070fe0 2024-04-18T04:45:06.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.289+0000 7fb67fa00640 1 -- 172.21.15.120:0/3866435134 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6781544b0 con 0x7fb678070fe0 2024-04-18T04:45:06.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.289+0000 7fb67fa00640 1 -- 172.21.15.120:0/3866435134 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6780729d0 con 0x7fb678070fe0 2024-04-18T04:45:06.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.289+0000 7fb674c00640 1 -- 172.21.15.120:0/3866435134 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb66c004b90 con 0x7fb678070fe0 2024-04-18T04:45:06.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.289+0000 7fb674c00640 1 --2- 172.21.15.120:0/3866435134 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb6580666c0 0x7fb658068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:06.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.289+0000 7fb674c00640 1 -- 172.21.15.120:0/3866435134 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb66c083620 con 0x7fb678070fe0 2024-04-18T04:45:06.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.293+0000 7fb677e00640 1 --2- 172.21.15.120:0/3866435134 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb6580666c0 0x7fb658068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:06.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.293+0000 7fb677e00640 1 --2- 172.21.15.120:0/3866435134 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb6580666c0 0x7fb658068b80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb6780c6140 tx=0x7fb664009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:06.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.293+0000 7fb674c00640 1 -- 172.21.15.120:0/3866435134 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fb66c050600 con 0x7fb678070fe0 2024-04-18T04:45:06.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.453+0000 7fb67fa00640 1 -- 172.21.15.120:0/3866435134 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb6780b10a0 con 0x7fb678070fe0 2024-04-18T04:45:06.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.453+0000 7fb674c00640 1 -- 172.21.15.120:0/3866435134 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb66c053c20 con 0x7fb678070fe0 2024-04-18T04:45:06.454 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2024-04-18T04:45:06.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.457+0000 7fb67fa00640 1 -- 172.21.15.120:0/3866435134 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb6580666c0 msgr2=0x7fb658068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:06.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.457+0000 7fb67fa00640 1 --2- 172.21.15.120:0/3866435134 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb6580666c0 0x7fb658068b80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb6780c6140 tx=0x7fb664009040 comp rx=0 tx=0).stop 2024-04-18T04:45:06.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.457+0000 7fb67fa00640 1 -- 172.21.15.120:0/3866435134 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb678070fe0 msgr2=0x7fb67815ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:06.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.457+0000 7fb67fa00640 1 --2- 172.21.15.120:0/3866435134 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb678070fe0 0x7fb67815ce30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb66c00c4a0 tx=0x7fb66c00c960 comp rx=0 tx=0).stop 2024-04-18T04:45:06.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.457+0000 7fb67fa00640 1 -- 172.21.15.120:0/3866435134 shutdown_connections 2024-04-18T04:45:06.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.457+0000 7fb67fa00640 1 --2- 172.21.15.120:0/3866435134 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb6580666c0 0x7fb658068b80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:06.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.457+0000 7fb67fa00640 1 --2- 172.21.15.120:0/3866435134 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb67815a2f0 0x7fb678149750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:06.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.457+0000 7fb67fa00640 1 --2- 172.21.15.120:0/3866435134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6781538c0 0x7fb67814a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:06.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.457+0000 7fb67fa00640 1 --2- 172.21.15.120:0/3866435134 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb678070fe0 0x7fb67815ce30 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:06.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.457+0000 7fb67fa00640 1 -- 172.21.15.120:0/3866435134 >> 172.21.15.120:0/3866435134 conn(0x7fb6780cbed0 msgr2=0x7fb678071ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:06.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.457+0000 7fb67fa00640 1 -- 172.21.15.120:0/3866435134 shutdown_connections 2024-04-18T04:45:06.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.457+0000 7fb67fa00640 1 -- 172.21.15.120:0/3866435134 wait complete. 2024-04-18T04:45:06.475 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T04:45:06.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.613+0000 7f07b0a00640 1 Processor -- start 2024-04-18T04:45:06.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.613+0000 7f07b0a00640 1 -- start start 2024-04-18T04:45:06.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.613+0000 7f07b0a00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f07ac150820 0x7f07ac0c0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:06.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.613+0000 7f07b0a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07ac0c09d0 0x7f07ac0caff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:06.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.613+0000 7f07b0a00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07ac071a60 con 0x7f07ac0cb530 2024-04-18T04:45:06.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.613+0000 7f07b0a00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07ac150c00 con 0x7f07ac150820 2024-04-18T04:45:06.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.613+0000 7f07b0a00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac157430 con 0x7f07ac0c09d0 2024-04-18T04:45:06.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.613+0000 7f07a9e00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f07ac150820 0x7f07ac0c0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:06.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.613+0000 7f07a9400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07ac0c09d0 0x7f07ac0caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:06.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.613+0000 7f07a9400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07ac0c09d0 0x7f07ac0caff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:42334/0 (socket says 172.21.15.120:42334) 2024-04-18T04:45:06.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.613+0000 7f07a9400640 1 -- 172.21.15.120:0/2373653518 learned_addr learned my addr 172.21.15.120:0/2373653518 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:06.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.613+0000 7f07a9400640 1 -- 172.21.15.120:0/2373653518 >> v2:172.21.15.132:3300/0 conn(0x7f07ac150820 msgr2=0x7f07ac0c0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:06.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.613+0000 7f07a9400640 1 --2- 172.21.15.120:0/2373653518 >> v2:172.21.15.132:3300/0 conn(0x7f07ac150820 0x7f07ac0c0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:06.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.613+0000 7f07a9400640 1 -- 172.21.15.120:0/2373653518 >> v1:172.21.15.132:6789/0 conn(0x7f07ac0cb530 legacy=0x7f07ac159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:06.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.613+0000 7f07a9400640 1 -- 172.21.15.120:0/2373653518 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07ac1565d0 con 0x7f07ac0c09d0 2024-04-18T04:45:06.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.613+0000 7f07a9e00640 1 --2- 172.21.15.120:0/2373653518 >> v2:172.21.15.132:3300/0 conn(0x7f07ac150820 0x7f07ac0c0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:45:06.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.617+0000 7f07a9400640 1 --2- 172.21.15.120:0/2373653518 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07ac0c09d0 0x7f07ac0caff0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0798009870 tx=0x7f079801c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b88628567d6eb6f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:06.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.617+0000 7f07a8a00640 1 -- 172.21.15.120:0/2373653518 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07980ab670 con 0x7f07ac0c09d0 2024-04-18T04:45:06.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.617+0000 7f07a8a00640 1 -- 172.21.15.120:0/2373653518 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07980ab7d0 con 0x7f07ac0c09d0 2024-04-18T04:45:06.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.617+0000 7f07a8a00640 1 -- 172.21.15.120:0/2373653518 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07980abb60 con 0x7f07ac0c09d0 2024-04-18T04:45:06.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.617+0000 7f07b0a00640 1 -- 172.21.15.120:0/2373653518 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07ac0c09d0 msgr2=0x7f07ac0caff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:06.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.617+0000 7f07b0a00640 1 --2- 172.21.15.120:0/2373653518 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07ac0c09d0 0x7f07ac0caff0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0798009870 tx=0x7f079801c560 comp rx=0 tx=0).stop 2024-04-18T04:45:06.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.617+0000 7f07b0a00640 1 -- 172.21.15.120:0/2373653518 shutdown_connections 2024-04-18T04:45:06.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.617+0000 7f07b0a00640 1 --2- 172.21.15.120:0/2373653518 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07ac0c09d0 0x7f07ac0caff0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:06.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.617+0000 7f07b0a00640 1 --2- 172.21.15.120:0/2373653518 >> v2:172.21.15.132:3300/0 conn(0x7f07ac150820 0x7f07ac0c0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:06.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.617+0000 7f07b0a00640 1 -- 172.21.15.120:0/2373653518 >> 172.21.15.120:0/2373653518 conn(0x7f07ac06b780 msgr2=0x7f07ac06bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:06.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.617+0000 7f07b0a00640 1 -- 172.21.15.120:0/2373653518 shutdown_connections 2024-04-18T04:45:06.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.617+0000 7f07b0a00640 1 -- 172.21.15.120:0/2373653518 wait complete. 2024-04-18T04:45:06.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.621+0000 7f07b0a00640 1 Processor -- start 2024-04-18T04:45:06.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.621+0000 7f07b0a00640 1 -- start start 2024-04-18T04:45:06.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.621+0000 7f07b0a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07ac0c09d0 0x7f07ac144720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:06.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.621+0000 7f07b0a00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07ac0cb530 0x7f07ac1628e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:06.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.621+0000 7f07b0a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07ac150820 0x7f07ac162e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:06.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.621+0000 7f07b0a00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac1f2bd0 con 0x7f07ac150820 2024-04-18T04:45:06.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.621+0000 7f07b0a00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac1f30c0 con 0x7f07ac0cb530 2024-04-18T04:45:06.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.621+0000 7f07b0a00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac162120 con 0x7f07ac0c09d0 2024-04-18T04:45:06.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.621+0000 7f07aa800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07ac150820 0x7f07ac162e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:06.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.621+0000 7f07aa800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07ac150820 0x7f07ac162e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34176/0 (socket says 172.21.15.120:34176) 2024-04-18T04:45:06.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.621+0000 7f07aa800640 1 -- 172.21.15.120:0/3729220168 learned_addr learned my addr 172.21.15.120:0/3729220168 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:06.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.621+0000 7f07a9e00640 1 --2- 172.21.15.120:0/3729220168 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07ac0c09d0 0x7f07ac144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:06.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.621+0000 7f07a9400640 1 --2- 172.21.15.120:0/3729220168 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07ac0cb530 0x7f07ac1628e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:06.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.621+0000 7f07aa800640 1 -- 172.21.15.120:0/3729220168 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07ac0c09d0 msgr2=0x7f07ac144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:06.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.621+0000 7f07aa800640 1 --2- 172.21.15.120:0/3729220168 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07ac0c09d0 0x7f07ac144720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:06.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.621+0000 7f07aa800640 1 -- 172.21.15.120:0/3729220168 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07ac0cb530 msgr2=0x7f07ac1628e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:06.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.621+0000 7f07aa800640 1 --2- 172.21.15.120:0/3729220168 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07ac0cb530 0x7f07ac1628e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:06.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.621+0000 7f07aa800640 1 -- 172.21.15.120:0/3729220168 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f079c009420 con 0x7f07ac150820 2024-04-18T04:45:06.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.621+0000 7f07aa800640 1 --2- 172.21.15.120:0/3729220168 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07ac150820 0x7f07ac162e20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f07a400c770 tx=0x7f07a400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:06.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.621+0000 7f07a2000640 1 -- 172.21.15.120:0/3729220168 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a4003b80 con 0x7f07ac150820 2024-04-18T04:45:06.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.621+0000 7f07a2000640 1 -- 172.21.15.120:0/3729220168 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a4003ce0 con 0x7f07ac150820 2024-04-18T04:45:06.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.621+0000 7f07b0a00640 1 -- 172.21.15.120:0/3729220168 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07980094d0 con 0x7f07ac150820 2024-04-18T04:45:06.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.621+0000 7f07a2000640 1 -- 172.21.15.120:0/3729220168 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a400aa90 con 0x7f07ac150820 2024-04-18T04:45:06.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.621+0000 7f07b0a00640 1 -- 172.21.15.120:0/3729220168 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07ac0c13c0 con 0x7f07ac150820 2024-04-18T04:45:06.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.625+0000 7f07b0a00640 1 -- 172.21.15.120:0/3729220168 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07ac0729d0 con 0x7f07ac150820 2024-04-18T04:45:06.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.625+0000 7f07a2000640 1 -- 172.21.15.120:0/3729220168 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f07a400abf0 con 0x7f07ac150820 2024-04-18T04:45:06.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.625+0000 7f07a2000640 1 --2- 172.21.15.120:0/3729220168 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f078c066690 0x7f078c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:06.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.625+0000 7f07a2000640 1 -- 172.21.15.120:0/3729220168 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f07a4084220 con 0x7f07ac150820 2024-04-18T04:45:06.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.625+0000 7f07a9e00640 1 --2- 172.21.15.120:0/3729220168 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f078c066690 0x7f078c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:06.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.625+0000 7f07a9e00640 1 --2- 172.21.15.120:0/3729220168 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f078c066690 0x7f078c068b50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f079c009c50 tx=0x7f079c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:06.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.629+0000 7f07a2000640 1 -- 172.21.15.120:0/3729220168 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f07a40512b0 con 0x7f07ac150820 2024-04-18T04:45:06.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.785+0000 7f07b0a00640 1 -- 172.21.15.120:0/3729220168 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f07ac0720e0 con 0x7f07ac150820 2024-04-18T04:45:06.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.785+0000 7f07a2000640 1 -- 172.21.15.120:0/3729220168 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f07a40548d0 con 0x7f07ac150820 2024-04-18T04:45:06.784 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 64 2024-04-18T04:45:06.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.785+0000 7f07b0a00640 1 -- 172.21.15.120:0/3729220168 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f078c066690 msgr2=0x7f078c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:06.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.785+0000 7f07b0a00640 1 --2- 172.21.15.120:0/3729220168 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f078c066690 0x7f078c068b50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f079c009c50 tx=0x7f079c009190 comp rx=0 tx=0).stop 2024-04-18T04:45:06.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.785+0000 7f07b0a00640 1 -- 172.21.15.120:0/3729220168 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07ac150820 msgr2=0x7f07ac162e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:06.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.785+0000 7f07b0a00640 1 --2- 172.21.15.120:0/3729220168 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07ac150820 0x7f07ac162e20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f07a400c770 tx=0x7f07a400cc30 comp rx=0 tx=0).stop 2024-04-18T04:45:06.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.785+0000 7f07b0a00640 1 -- 172.21.15.120:0/3729220168 shutdown_connections 2024-04-18T04:45:06.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.785+0000 7f07b0a00640 1 --2- 172.21.15.120:0/3729220168 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f078c066690 0x7f078c068b50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:06.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.785+0000 7f07b0a00640 1 --2- 172.21.15.120:0/3729220168 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07ac150820 0x7f07ac162e20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:06.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.785+0000 7f07b0a00640 1 --2- 172.21.15.120:0/3729220168 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07ac0cb530 0x7f07ac1628e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:06.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.785+0000 7f07b0a00640 1 --2- 172.21.15.120:0/3729220168 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07ac0c09d0 0x7f07ac144720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:06.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.785+0000 7f07b0a00640 1 -- 172.21.15.120:0/3729220168 >> 172.21.15.120:0/3729220168 conn(0x7f07ac06b780 msgr2=0x7f07ac146750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:06.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.785+0000 7f07b0a00640 1 -- 172.21.15.120:0/3729220168 shutdown_connections 2024-04-18T04:45:06.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.785+0000 7f07b0a00640 1 -- 172.21.15.120:0/3729220168 wait complete. 2024-04-18T04:45:06.806 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-18T04:45:06.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.945+0000 7f4452e00640 1 Processor -- start 2024-04-18T04:45:06.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.945+0000 7f4452e00640 1 -- start start 2024-04-18T04:45:06.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.945+0000 7f4452e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f444c153550 0x7f444c159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:06.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.945+0000 7f4452e00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f444c06afd0 0x7f444c06b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:06.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.945+0000 7f4452e00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f444c15a520 con 0x7f444c0c2430 2024-04-18T04:45:06.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.945+0000 7f4452e00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f444c06e260 con 0x7f444c06afd0 2024-04-18T04:45:06.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.945+0000 7f4452e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f444c0c7e10 con 0x7f444c153550 2024-04-18T04:45:06.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.945+0000 7f4443400640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f444c0c2430 0x7f444c0c2890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:59308/0 (socket says 172.21.15.120:59308) 2024-04-18T04:45:06.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.945+0000 7f4443400640 1 -- 172.21.15.120:0/44339166 learned_addr learned my addr 172.21.15.120:0/44339166 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:45:06.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.945+0000 7f4450e00640 1 --2- 172.21.15.120:0/44339166 >> v2:172.21.15.132:3300/0 conn(0x7f444c06afd0 0x7f444c06b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:06.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.945+0000 7f444be00640 1 --2- 172.21.15.120:0/44339166 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f444c153550 0x7f444c159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:06.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.945+0000 7f444b400640 1 -- 172.21.15.120:0/44339166 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 957620305 0 0) 0x7f444c15a520 con 0x7f444c0c2430 2024-04-18T04:45:06.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.945+0000 7f444b400640 1 -- 172.21.15.120:0/44339166 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4430003530 con 0x7f444c0c2430 2024-04-18T04:45:06.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.945+0000 7f444b400640 1 -- 172.21.15.120:0/44339166 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 184797471 0 0) 0x7f4430003530 con 0x7f444c0c2430 2024-04-18T04:45:06.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.945+0000 7f444b400640 1 -- 172.21.15.120:0/44339166 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f444c153550 msgr2=0x7f444c159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:06.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.945+0000 7f444b400640 1 --2- 172.21.15.120:0/44339166 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f444c153550 0x7f444c159fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:06.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.945+0000 7f444b400640 1 -- 172.21.15.120:0/44339166 >> v2:172.21.15.132:3300/0 conn(0x7f444c06afd0 msgr2=0x7f444c06b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:06.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.945+0000 7f444b400640 1 --2- 172.21.15.120:0/44339166 >> v2:172.21.15.132:3300/0 conn(0x7f444c06afd0 0x7f444c06b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:06.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.945+0000 7f444b400640 1 -- 172.21.15.120:0/44339166 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f444c06d300 con 0x7f444c0c2430 2024-04-18T04:45:06.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.945+0000 7f444b400640 1 -- 172.21.15.120:0/44339166 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7f4434001680 con 0x7f444c0c2430 2024-04-18T04:45:06.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.945+0000 7f444b400640 1 -- 172.21.15.120:0/44339166 >> v1:172.21.15.120:6789/0 conn(0x7f444c0c2430 legacy=0x7f444c0c2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:06.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.945+0000 7f444b400640 1 --2- 172.21.15.120:0/44339166 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f444c153550 0x7f4430003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:06.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.945+0000 7f444b400640 1 --2- 172.21.15.120:0/44339166 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4430003f00 0x7f44300047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:06.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.945+0000 7f444b400640 1 --2- 172.21.15.120:0/44339166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4430004d10 0x7f4430005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:06.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.945+0000 7f444b400640 1 -- 172.21.15.120:0/44339166 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444c06e260 con 0x7f4430004d10 2024-04-18T04:45:06.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.945+0000 7f444b400640 1 -- 172.21.15.120:0/44339166 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444c0c7e10 con 0x7f4430003f00 2024-04-18T04:45:06.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.945+0000 7f444b400640 1 -- 172.21.15.120:0/44339166 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f443000b9c0 con 0x7f444c153550 2024-04-18T04:45:06.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.945+0000 7f4450e00640 1 --2- 172.21.15.120:0/44339166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4430004d10 0x7f4430005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:06.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.949+0000 7f4443400640 1 --2- 172.21.15.120:0/44339166 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4430003f00 0x7f44300047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:06.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.949+0000 7f444be00640 1 --2- 172.21.15.120:0/44339166 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f444c153550 0x7f4430003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:06.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.949+0000 7f4450e00640 1 -- 172.21.15.120:0/44339166 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f444c153550 msgr2=0x7f4430003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:06.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.949+0000 7f4450e00640 1 --2- 172.21.15.120:0/44339166 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f444c153550 0x7f4430003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:06.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.949+0000 7f4450e00640 1 -- 172.21.15.120:0/44339166 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4430003f00 msgr2=0x7f44300047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:06.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.949+0000 7f4450e00640 1 --2- 172.21.15.120:0/44339166 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4430003f00 0x7f44300047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:06.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.949+0000 7f4450e00640 1 -- 172.21.15.120:0/44339166 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4430003530 con 0x7f4430004d10 2024-04-18T04:45:06.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.949+0000 7f4450e00640 1 --2- 172.21.15.120:0/44339166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4430004d10 0x7f4430005190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4444009fc0 tx=0x7f444401ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aac568b1e1a615d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:06.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.949+0000 7f444b400640 1 -- 172.21.15.120:0/44339166 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44440a5cd0 con 0x7f4430004d10 2024-04-18T04:45:06.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.949+0000 7f444b400640 1 -- 172.21.15.120:0/44339166 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444400f040 con 0x7f4430004d10 2024-04-18T04:45:06.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.949+0000 7f444b400640 1 -- 172.21.15.120:0/44339166 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44440ad680 con 0x7f4430004d10 2024-04-18T04:45:06.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.949+0000 7f4452e00640 1 -- 172.21.15.120:0/44339166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4430004d10 msgr2=0x7f4430005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:06.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.949+0000 7f4452e00640 1 --2- 172.21.15.120:0/44339166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4430004d10 0x7f4430005190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4444009fc0 tx=0x7f444401ccc0 comp rx=0 tx=0).stop 2024-04-18T04:45:06.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.949+0000 7f4450e00640 1 -- 172.21.15.120:0/44339166 reap_dead start 2024-04-18T04:45:06.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.953+0000 7f4452e00640 1 -- 172.21.15.120:0/44339166 shutdown_connections 2024-04-18T04:45:06.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.953+0000 7f4452e00640 1 -- 172.21.15.120:0/44339166 >> 172.21.15.120:0/44339166 conn(0x7f444c06f700 msgr2=0x7f444c06fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:06.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.953+0000 7f4452e00640 1 -- 172.21.15.120:0/44339166 shutdown_connections 2024-04-18T04:45:06.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.953+0000 7f4452e00640 1 -- 172.21.15.120:0/44339166 wait complete. 2024-04-18T04:45:06.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.953+0000 7f4452e00640 1 Processor -- start 2024-04-18T04:45:06.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.953+0000 7f4452e00640 1 -- start start 2024-04-18T04:45:06.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.953+0000 7f4452e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4430004d10 0x7f444c15b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:06.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.953+0000 7f4452e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f444c158720 0x7f444c154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:06.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.953+0000 7f4452e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f444c158b80 0x7f444c1f23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:06.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.953+0000 7f4452e00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444c1eeac0 con 0x7f444c158b80 2024-04-18T04:45:06.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.953+0000 7f4452e00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444c1eecb0 con 0x7f444c158720 2024-04-18T04:45:06.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.953+0000 7f4452e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f444c1eef90 con 0x7f4430004d10 2024-04-18T04:45:06.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.953+0000 7f4450e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f444c158b80 0x7f444c1f23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:06.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.953+0000 7f4450e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f444c158b80 0x7f444c1f23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34202/0 (socket says 172.21.15.120:34202) 2024-04-18T04:45:06.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.953+0000 7f4450e00640 1 -- 172.21.15.120:0/119579927 learned_addr learned my addr 172.21.15.120:0/119579927 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:06.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.953+0000 7f4443400640 1 --2- 172.21.15.120:0/119579927 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f444c158720 0x7f444c154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:06.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.953+0000 7f444be00640 1 --2- 172.21.15.120:0/119579927 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4430004d10 0x7f444c15b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:06.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.953+0000 7f4450e00640 1 -- 172.21.15.120:0/119579927 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4430004d10 msgr2=0x7f444c15b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:06.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.953+0000 7f4450e00640 1 --2- 172.21.15.120:0/119579927 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4430004d10 0x7f444c15b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:06.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.953+0000 7f4450e00640 1 -- 172.21.15.120:0/119579927 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f444c158720 msgr2=0x7f444c154510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:06.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.953+0000 7f4450e00640 1 --2- 172.21.15.120:0/119579927 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f444c158720 0x7f444c154510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:06.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.953+0000 7f4450e00640 1 -- 172.21.15.120:0/119579927 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f444c1ef270 con 0x7f444c158b80 2024-04-18T04:45:06.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.953+0000 7f4443400640 1 --2- 172.21.15.120:0/119579927 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f444c158720 0x7f444c154510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:06.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.953+0000 7f4450e00640 1 --2- 172.21.15.120:0/119579927 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f444c158b80 0x7f444c1f23f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4444002240 tx=0x7f4444009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:06.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.953+0000 7f4448c00640 1 -- 172.21.15.120:0/119579927 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44440039a0 con 0x7f444c158b80 2024-04-18T04:45:06.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.953+0000 7f4448c00640 1 -- 172.21.15.120:0/119579927 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4444003b00 con 0x7f444c158b80 2024-04-18T04:45:06.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.953+0000 7f4448c00640 1 -- 172.21.15.120:0/119579927 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4444003e90 con 0x7f444c158b80 2024-04-18T04:45:06.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.953+0000 7f4452e00640 1 -- 172.21.15.120:0/119579927 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f444c1ef550 con 0x7f444c158b80 2024-04-18T04:45:06.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.957+0000 7f4452e00640 1 -- 172.21.15.120:0/119579927 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f444c154a50 con 0x7f444c158b80 2024-04-18T04:45:06.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.957+0000 7f4452e00640 1 -- 172.21.15.120:0/119579927 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f444c066df0 con 0x7f444c158b80 2024-04-18T04:45:06.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.957+0000 7f4448c00640 1 -- 172.21.15.120:0/119579927 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f44440b4040 con 0x7f444c158b80 2024-04-18T04:45:06.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.957+0000 7f4448c00640 1 --2- 172.21.15.120:0/119579927 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4428066690 0x7f4428068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:06.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.957+0000 7f4448c00640 1 -- 172.21.15.120:0/119579927 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f444411e2a0 con 0x7f444c158b80 2024-04-18T04:45:06.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.957+0000 7f444be00640 1 --2- 172.21.15.120:0/119579927 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4428066690 0x7f4428068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:06.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.961+0000 7f444be00640 1 --2- 172.21.15.120:0/119579927 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4428066690 0x7f4428068b50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f443c009a30 tx=0x7f443c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:06.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:06.961+0000 7f4448c00640 1 -- 172.21.15.120:0/119579927 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f44440eb3c0 con 0x7f444c158b80 2024-04-18T04:45:07.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.117+0000 7f4452e00640 1 -- 172.21.15.120:0/119579927 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f444c067590 con 0x7f444c158b80 2024-04-18T04:45:07.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.117+0000 7f4448c00640 1 -- 172.21.15.120:0/119579927 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f44440ee9e0 con 0x7f444c158b80 2024-04-18T04:45:07.116 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2024-04-18T04:45:07.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.117+0000 7f4452e00640 1 -- 172.21.15.120:0/119579927 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4428066690 msgr2=0x7f4428068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:07.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.117+0000 7f4452e00640 1 --2- 172.21.15.120:0/119579927 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4428066690 0x7f4428068b50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f443c009a30 tx=0x7f443c008040 comp rx=0 tx=0).stop 2024-04-18T04:45:07.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.117+0000 7f4452e00640 1 -- 172.21.15.120:0/119579927 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f444c158b80 msgr2=0x7f444c1f23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:07.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.117+0000 7f4452e00640 1 --2- 172.21.15.120:0/119579927 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f444c158b80 0x7f444c1f23f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4444002240 tx=0x7f4444009750 comp rx=0 tx=0).stop 2024-04-18T04:45:07.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.117+0000 7f4452e00640 1 -- 172.21.15.120:0/119579927 shutdown_connections 2024-04-18T04:45:07.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.117+0000 7f4452e00640 1 --2- 172.21.15.120:0/119579927 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4428066690 0x7f4428068b50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:07.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.117+0000 7f4452e00640 1 --2- 172.21.15.120:0/119579927 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f444c158b80 0x7f444c1f23f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:07.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.117+0000 7f4452e00640 1 --2- 172.21.15.120:0/119579927 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f444c158720 0x7f444c154510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:07.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.117+0000 7f4452e00640 1 --2- 172.21.15.120:0/119579927 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4430004d10 0x7f444c15b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:07.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.117+0000 7f4452e00640 1 -- 172.21.15.120:0/119579927 >> 172.21.15.120:0/119579927 conn(0x7f444c06f700 msgr2=0x7f444c150580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:07.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.117+0000 7f4452e00640 1 -- 172.21.15.120:0/119579927 shutdown_connections 2024-04-18T04:45:07.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.117+0000 7f4452e00640 1 -- 172.21.15.120:0/119579927 wait complete. 2024-04-18T04:45:07.136 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:45:07.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.273+0000 7f1819400640 1 Processor -- start 2024-04-18T04:45:07.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.273+0000 7f1819400640 1 -- start start 2024-04-18T04:45:07.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.273+0000 7f1819400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1814150340 0x7f1814156430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:07.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.273+0000 7f1819400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f18140c7480 0x7f1814160db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:07.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.273+0000 7f1819400640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f181406f9b0 con 0x7f1814156970 2024-04-18T04:45:07.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.273+0000 7f1819400640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18140c0520 con 0x7f1814150340 2024-04-18T04:45:07.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.273+0000 7f1819400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18140c0800 con 0x7f18140c7480 2024-04-18T04:45:07.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.273+0000 7f1811e00640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f1814156970 0x7f18140c68d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:59310/0 (socket says 172.21.15.120:59310) 2024-04-18T04:45:07.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.273+0000 7f1811e00640 1 -- 172.21.15.120:0/4053012522 learned_addr learned my addr 172.21.15.120:0/4053012522 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:45:07.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.273+0000 7f1812800640 1 --2- 172.21.15.120:0/4053012522 >> v2:172.21.15.132:3300/0 conn(0x7f1814150340 0x7f1814156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:07.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.273+0000 7f1813200640 1 --2- 172.21.15.120:0/4053012522 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f18140c7480 0x7f1814160db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:07.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.273+0000 7f1811400640 1 -- 172.21.15.120:0/4053012522 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2428235957 0 0) 0x7f181406f9b0 con 0x7f1814156970 2024-04-18T04:45:07.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.273+0000 7f1811400640 1 -- 172.21.15.120:0/4053012522 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17f8003530 con 0x7f1814156970 2024-04-18T04:45:07.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.277+0000 7f1811400640 1 -- 172.21.15.120:0/4053012522 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3806131147 0 0) 0x7f17f8003530 con 0x7f1814156970 2024-04-18T04:45:07.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.277+0000 7f1811400640 1 -- 172.21.15.120:0/4053012522 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f18140c7480 msgr2=0x7f1814160db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:07.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.277+0000 7f1811400640 1 --2- 172.21.15.120:0/4053012522 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f18140c7480 0x7f1814160db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:07.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.277+0000 7f1811400640 1 -- 172.21.15.120:0/4053012522 >> v2:172.21.15.132:3300/0 conn(0x7f1814150340 msgr2=0x7f1814156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:07.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.277+0000 7f1811400640 1 --2- 172.21.15.120:0/4053012522 >> v2:172.21.15.132:3300/0 conn(0x7f1814150340 0x7f1814156430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:07.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.277+0000 7f1811400640 1 -- 172.21.15.120:0/4053012522 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f181406fc20 con 0x7f1814156970 2024-04-18T04:45:07.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.277+0000 7f1811400640 1 -- 172.21.15.120:0/4053012522 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7f1800001680 con 0x7f1814156970 2024-04-18T04:45:07.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.277+0000 7f1811400640 1 -- 172.21.15.120:0/4053012522 >> v1:172.21.15.120:6789/0 conn(0x7f1814156970 legacy=0x7f18140c68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:07.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.277+0000 7f1811400640 1 --2- 172.21.15.120:0/4053012522 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17f8003980 0x7f17f8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:07.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.277+0000 7f1811400640 1 --2- 172.21.15.120:0/4053012522 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17f80047d0 0x7f17f8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:07.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.277+0000 7f1811400640 1 --2- 172.21.15.120:0/4053012522 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f18140c7480 0x7f17f8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:07.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.277+0000 7f1811400640 1 -- 172.21.15.120:0/4053012522 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18140c0520 con 0x7f17f8003980 2024-04-18T04:45:07.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.277+0000 7f1811400640 1 -- 172.21.15.120:0/4053012522 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18140c0800 con 0x7f17f80047d0 2024-04-18T04:45:07.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.277+0000 7f1811400640 1 -- 172.21.15.120:0/4053012522 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f800dba0 con 0x7f18140c7480 2024-04-18T04:45:07.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.277+0000 7f1812800640 1 --2- 172.21.15.120:0/4053012522 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17f8003980 0x7f17f8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:07.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.277+0000 7f1813200640 1 --2- 172.21.15.120:0/4053012522 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f18140c7480 0x7f17f8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:07.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.277+0000 7f1811e00640 1 --2- 172.21.15.120:0/4053012522 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17f80047d0 0x7f17f8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:07.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.277+0000 7f1812800640 1 -- 172.21.15.120:0/4053012522 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f18140c7480 msgr2=0x7f17f8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:07.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.277+0000 7f1812800640 1 --2- 172.21.15.120:0/4053012522 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f18140c7480 0x7f17f8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:07.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.277+0000 7f1812800640 1 -- 172.21.15.120:0/4053012522 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17f80047d0 msgr2=0x7f17f8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:07.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.277+0000 7f1812800640 1 --2- 172.21.15.120:0/4053012522 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17f80047d0 0x7f17f8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:07.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.277+0000 7f1812800640 1 -- 172.21.15.120:0/4053012522 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f8003530 con 0x7f17f8003980 2024-04-18T04:45:07.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.277+0000 7f1811e00640 1 --2- 172.21.15.120:0/4053012522 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17f80047d0 0x7f17f8004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:45:07.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.277+0000 7f1812800640 1 --2- 172.21.15.120:0/4053012522 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17f8003980 0x7f17f8003da0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1804009ae0 tx=0x7f180401cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f3755f776fe3a5e server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:07.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.277+0000 7f1811400640 1 -- 172.21.15.120:0/4053012522 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18040a55c0 con 0x7f17f8003980 2024-04-18T04:45:07.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.277+0000 7f1811400640 1 -- 172.21.15.120:0/4053012522 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18040a5720 con 0x7f17f8003980 2024-04-18T04:45:07.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.277+0000 7f1811400640 1 -- 172.21.15.120:0/4053012522 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18040a5ad0 con 0x7f17f8003980 2024-04-18T04:45:07.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.281+0000 7f1819400640 1 -- 172.21.15.120:0/4053012522 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17f8003980 msgr2=0x7f17f8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:07.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.281+0000 7f1819400640 1 --2- 172.21.15.120:0/4053012522 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17f8003980 0x7f17f8003da0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1804009ae0 tx=0x7f180401cab0 comp rx=0 tx=0).stop 2024-04-18T04:45:07.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.281+0000 7f1813200640 1 -- 172.21.15.120:0/4053012522 reap_dead start 2024-04-18T04:45:07.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.281+0000 7f1819400640 1 -- 172.21.15.120:0/4053012522 shutdown_connections 2024-04-18T04:45:07.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.281+0000 7f1819400640 1 -- 172.21.15.120:0/4053012522 >> 172.21.15.120:0/4053012522 conn(0x7f18140c78c0 msgr2=0x7f18140c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:07.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.281+0000 7f1819400640 1 -- 172.21.15.120:0/4053012522 shutdown_connections 2024-04-18T04:45:07.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.281+0000 7f1819400640 1 -- 172.21.15.120:0/4053012522 wait complete. 2024-04-18T04:45:07.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.281+0000 7f1819400640 1 Processor -- start 2024-04-18T04:45:07.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.281+0000 7f1819400640 1 -- start start 2024-04-18T04:45:07.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.281+0000 7f1819400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17f8003980 0x7f18141f2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:07.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.281+0000 7f1819400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f18140c96a0 0x7f18140c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:07.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.281+0000 7f1819400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18141eed10 0x7f18141ef190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:07.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.281+0000 7f1819400640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18141ef6d0 con 0x7f18141eed10 2024-04-18T04:45:07.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.281+0000 7f1819400640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18141546c0 con 0x7f18140c96a0 2024-04-18T04:45:07.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.281+0000 7f1819400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18140caba0 con 0x7f17f8003980 2024-04-18T04:45:07.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.281+0000 7f1813200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18141eed10 0x7f18141ef190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:07.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.281+0000 7f1813200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18141eed10 0x7f18141ef190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34228/0 (socket says 172.21.15.120:34228) 2024-04-18T04:45:07.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.281+0000 7f1813200640 1 -- 172.21.15.120:0/455769837 learned_addr learned my addr 172.21.15.120:0/455769837 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:07.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.281+0000 7f1811e00640 1 --2- 172.21.15.120:0/455769837 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f18140c96a0 0x7f18140c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:07.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.281+0000 7f1812800640 1 --2- 172.21.15.120:0/455769837 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17f8003980 0x7f18141f2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:07.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.281+0000 7f1813200640 1 -- 172.21.15.120:0/455769837 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17f8003980 msgr2=0x7f18141f2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:07.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.281+0000 7f1813200640 1 --2- 172.21.15.120:0/455769837 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17f8003980 0x7f18141f2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:07.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.281+0000 7f1813200640 1 -- 172.21.15.120:0/455769837 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f18140c96a0 msgr2=0x7f18140c5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:07.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.281+0000 7f1813200640 1 --2- 172.21.15.120:0/455769837 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f18140c96a0 0x7f18140c5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:07.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.281+0000 7f1813200640 1 -- 172.21.15.120:0/455769837 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18141f31d0 con 0x7f18141eed10 2024-04-18T04:45:07.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.281+0000 7f1812800640 1 --2- 172.21.15.120:0/455769837 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17f8003980 0x7f18141f2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:07.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.285+0000 7f1813200640 1 --2- 172.21.15.120:0/455769837 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18141eed10 0x7f18141ef190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f181406e7a0 tx=0x7f180c0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:07.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.285+0000 7f180aa00640 1 -- 172.21.15.120:0/455769837 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180c00e070 con 0x7f18141eed10 2024-04-18T04:45:07.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.285+0000 7f180aa00640 1 -- 172.21.15.120:0/455769837 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f180c007e70 con 0x7f18141eed10 2024-04-18T04:45:07.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.285+0000 7f180aa00640 1 -- 172.21.15.120:0/455769837 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180c011e10 con 0x7f18141eed10 2024-04-18T04:45:07.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.285+0000 7f1819400640 1 -- 172.21.15.120:0/455769837 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f181414a770 con 0x7f18141eed10 2024-04-18T04:45:07.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.285+0000 7f1819400640 1 -- 172.21.15.120:0/455769837 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18140c90e0 con 0x7f18141eed10 2024-04-18T04:45:07.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.285+0000 7f1819400640 1 -- 172.21.15.120:0/455769837 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18140726d0 con 0x7f18141eed10 2024-04-18T04:45:07.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.285+0000 7f180aa00640 1 -- 172.21.15.120:0/455769837 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f180c0039a0 con 0x7f18141eed10 2024-04-18T04:45:07.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.285+0000 7f180aa00640 1 --2- 172.21.15.120:0/455769837 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f17f4066690 0x7f17f4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:07.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.285+0000 7f180aa00640 1 -- 172.21.15.120:0/455769837 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f180c084a10 con 0x7f18141eed10 2024-04-18T04:45:07.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.289+0000 7f1812800640 1 --2- 172.21.15.120:0/455769837 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f17f4066690 0x7f17f4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:07.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.289+0000 7f1812800640 1 --2- 172.21.15.120:0/455769837 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f17f4066690 0x7f17f4068b50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f18040af000 tx=0x7f18040046d0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:07.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.289+0000 7f180aa00640 1 -- 172.21.15.120:0/455769837 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f180c0519f0 con 0x7f18141eed10 2024-04-18T04:45:07.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.473+0000 7f1819400640 1 -- 172.21.15.120:0/455769837 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f18141f31d0 con 0x7f18141eed10 2024-04-18T04:45:07.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.473+0000 7f180aa00640 1 -- 172.21.15.120:0/455769837 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+6290 (secure 0 0 0) 0x7f18141f31d0 con 0x7f18141eed10 2024-04-18T04:45:07.475 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:45:07.475 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/1552155328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1552155328},{"type":"v1","addr":"172.21.15.132:6835","nonce":1552155328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:45:02.970026+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:creating","state_seq":1,"addr":"172.21.15.120:6833/2564667113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2564667113},{"type":"v1","addr":"172.21.15.120:6833","nonce":2564667113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:45:07.476 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 14 2024-04-18T04:45:07.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.477+0000 7f1819400640 1 -- 172.21.15.120:0/455769837 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f17f4066690 msgr2=0x7f17f4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:07.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.477+0000 7f1819400640 1 --2- 172.21.15.120:0/455769837 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f17f4066690 0x7f17f4068b50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f18040af000 tx=0x7f18040046d0 comp rx=0 tx=0).stop 2024-04-18T04:45:07.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.477+0000 7f1819400640 1 -- 172.21.15.120:0/455769837 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18141eed10 msgr2=0x7f18141ef190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:07.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.477+0000 7f1819400640 1 --2- 172.21.15.120:0/455769837 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18141eed10 0x7f18141ef190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f181406e7a0 tx=0x7f180c0115a0 comp rx=0 tx=0).stop 2024-04-18T04:45:07.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.477+0000 7f1819400640 1 -- 172.21.15.120:0/455769837 shutdown_connections 2024-04-18T04:45:07.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.477+0000 7f1819400640 1 --2- 172.21.15.120:0/455769837 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f17f4066690 0x7f17f4068b50 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:07.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.477+0000 7f1819400640 1 --2- 172.21.15.120:0/455769837 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18141eed10 0x7f18141ef190 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:07.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.477+0000 7f1819400640 1 --2- 172.21.15.120:0/455769837 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f18140c96a0 0x7f18140c5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:07.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.477+0000 7f1819400640 1 --2- 172.21.15.120:0/455769837 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17f8003980 0x7f18141f2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:07.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.477+0000 7f1819400640 1 -- 172.21.15.120:0/455769837 >> 172.21.15.120:0/455769837 conn(0x7f18140c78c0 msgr2=0x7f18140c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:07.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.477+0000 7f1819400640 1 -- 172.21.15.120:0/455769837 shutdown_connections 2024-04-18T04:45:07.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.477+0000 7f1819400640 1 -- 172.21.15.120:0/455769837 wait complete. 2024-04-18T04:45:07.496 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T04:45:07.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.629+0000 7f8eada00640 1 Processor -- start 2024-04-18T04:45:07.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.629+0000 7f8eada00640 1 -- start start 2024-04-18T04:45:07.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.633+0000 7f8eada00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8ea806b8c0 0x7f8ea80c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:07.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.633+0000 7f8eada00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ea806bca0 0x7f8ea806c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:07.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.633+0000 7f8eada00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8ea8151440 0x7f8ea81518d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:07.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.633+0000 7f8eada00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea8158610 con 0x7f8ea8151440 2024-04-18T04:45:07.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.633+0000 7f8eada00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea80c7740 con 0x7f8ea806b8c0 2024-04-18T04:45:07.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.633+0000 7f8eada00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea81576f0 con 0x7f8ea806bca0 2024-04-18T04:45:07.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.633+0000 7f8ea7400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8ea8151440 0x7f8ea81518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:07.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.633+0000 7f8ea7400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8ea8151440 0x7f8ea81518d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34232/0 (socket says 172.21.15.120:34232) 2024-04-18T04:45:07.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.633+0000 7f8ea7400640 1 -- 172.21.15.120:0/2496087874 learned_addr learned my addr 172.21.15.120:0/2496087874 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:07.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.633+0000 7f8ea6a00640 1 --2- 172.21.15.120:0/2496087874 >> v2:172.21.15.132:3300/0 conn(0x7f8ea806b8c0 0x7f8ea80c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:07.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.633+0000 7f8ea6000640 1 --2- 172.21.15.120:0/2496087874 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ea806bca0 0x7f8ea806c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:07.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.633+0000 7f8ea7400640 1 -- 172.21.15.120:0/2496087874 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ea806bca0 msgr2=0x7f8ea806c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:07.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.633+0000 7f8ea7400640 1 --2- 172.21.15.120:0/2496087874 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ea806bca0 0x7f8ea806c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:07.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.633+0000 7f8ea7400640 1 -- 172.21.15.120:0/2496087874 >> v2:172.21.15.132:3300/0 conn(0x7f8ea806b8c0 msgr2=0x7f8ea80c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:07.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.633+0000 7f8ea7400640 1 --2- 172.21.15.120:0/2496087874 >> v2:172.21.15.132:3300/0 conn(0x7f8ea806b8c0 0x7f8ea80c7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:07.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.633+0000 7f8ea7400640 1 -- 172.21.15.120:0/2496087874 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea8157990 con 0x7f8ea8151440 2024-04-18T04:45:07.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.633+0000 7f8ea6a00640 1 --2- 172.21.15.120:0/2496087874 >> v2:172.21.15.132:3300/0 conn(0x7f8ea806b8c0 0x7f8ea80c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:07.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.637+0000 7f8ea7400640 1 --2- 172.21.15.120:0/2496087874 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8ea8151440 0x7f8ea81518d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8ea80c8900 tx=0x7f8ea001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5618483b5024f57 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:07.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.637+0000 7f8ea5600640 1 -- 172.21.15.120:0/2496087874 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea00a89d0 con 0x7f8ea8151440 2024-04-18T04:45:07.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.637+0000 7f8ea5600640 1 -- 172.21.15.120:0/2496087874 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea00a8b30 con 0x7f8ea8151440 2024-04-18T04:45:07.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.637+0000 7f8ea5600640 1 -- 172.21.15.120:0/2496087874 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea00b0440 con 0x7f8ea8151440 2024-04-18T04:45:07.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.637+0000 7f8eada00640 1 -- 172.21.15.120:0/2496087874 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8ea8151440 msgr2=0x7f8ea81518d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:07.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.637+0000 7f8eada00640 1 --2- 172.21.15.120:0/2496087874 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8ea8151440 0x7f8ea81518d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8ea80c8900 tx=0x7f8ea001ed10 comp rx=0 tx=0).stop 2024-04-18T04:45:07.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.637+0000 7f8eada00640 1 -- 172.21.15.120:0/2496087874 shutdown_connections 2024-04-18T04:45:07.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.637+0000 7f8eada00640 1 --2- 172.21.15.120:0/2496087874 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8ea8151440 0x7f8ea81518d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:07.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.637+0000 7f8eada00640 1 --2- 172.21.15.120:0/2496087874 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ea806bca0 0x7f8ea806c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:07.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.637+0000 7f8eada00640 1 --2- 172.21.15.120:0/2496087874 >> v2:172.21.15.132:3300/0 conn(0x7f8ea806b8c0 0x7f8ea80c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:07.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.637+0000 7f8eada00640 1 -- 172.21.15.120:0/2496087874 >> 172.21.15.120:0/2496087874 conn(0x7f8ea80c78c0 msgr2=0x7f8ea80c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:07.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.637+0000 7f8eada00640 1 -- 172.21.15.120:0/2496087874 shutdown_connections 2024-04-18T04:45:07.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.637+0000 7f8eada00640 1 -- 172.21.15.120:0/2496087874 wait complete. 2024-04-18T04:45:07.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.637+0000 7f8eada00640 1 Processor -- start 2024-04-18T04:45:07.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.637+0000 7f8eada00640 1 -- start start 2024-04-18T04:45:07.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.637+0000 7f8eada00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ea806b8c0 0x7f8ea81eec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:07.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.637+0000 7f8eada00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8ea806bca0 0x7f8ea81555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:07.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.637+0000 7f8eada00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ea8151440 0x7f8ea8154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:07.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.637+0000 7f8eada00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea81522e0 con 0x7f8ea806bca0 2024-04-18T04:45:07.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.637+0000 7f8eada00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea81efbb0 con 0x7f8ea806b8c0 2024-04-18T04:45:07.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.637+0000 7f8eada00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea81ef310 con 0x7f8ea8151440 2024-04-18T04:45:07.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.641+0000 7f8ea6000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8ea806bca0 0x7f8ea81555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:07.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.641+0000 7f8ea6000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8ea806bca0 0x7f8ea81555a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34246/0 (socket says 172.21.15.120:34246) 2024-04-18T04:45:07.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.641+0000 7f8ea6000640 1 -- 172.21.15.120:0/2659581650 learned_addr learned my addr 172.21.15.120:0/2659581650 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:07.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.641+0000 7f8ea6a00640 1 --2- 172.21.15.120:0/2659581650 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ea806b8c0 0x7f8ea81eec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:07.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.641+0000 7f8ea7400640 1 --2- 172.21.15.120:0/2659581650 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ea8151440 0x7f8ea8154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:07.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.641+0000 7f8ea6000640 1 -- 172.21.15.120:0/2659581650 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ea8151440 msgr2=0x7f8ea8154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:07.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.641+0000 7f8ea6000640 1 --2- 172.21.15.120:0/2659581650 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ea8151440 0x7f8ea8154610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:07.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.641+0000 7f8ea6000640 1 -- 172.21.15.120:0/2659581650 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ea806b8c0 msgr2=0x7f8ea81eec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:07.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.641+0000 7f8ea6000640 1 --2- 172.21.15.120:0/2659581650 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ea806b8c0 0x7f8ea81eec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:07.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.641+0000 7f8ea6000640 1 -- 172.21.15.120:0/2659581650 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea00094d0 con 0x7f8ea806bca0 2024-04-18T04:45:07.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.641+0000 7f8ea7400640 1 --2- 172.21.15.120:0/2659581650 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ea8151440 0x7f8ea8154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:07.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.641+0000 7f8ea6000640 1 --2- 172.21.15.120:0/2659581650 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8ea806bca0 0x7f8ea81555a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8e9400d5f0 tx=0x7f8e9400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:07.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.641+0000 7f8e9ea00640 1 -- 172.21.15.120:0/2659581650 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e940125f0 con 0x7f8ea806bca0 2024-04-18T04:45:07.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.641+0000 7f8e9ea00640 1 -- 172.21.15.120:0/2659581650 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e94012750 con 0x7f8ea806bca0 2024-04-18T04:45:07.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.641+0000 7f8eada00640 1 -- 172.21.15.120:0/2659581650 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea81ef5f0 con 0x7f8ea806bca0 2024-04-18T04:45:07.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.641+0000 7f8e9ea00640 1 -- 172.21.15.120:0/2659581650 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e94012ae0 con 0x7f8ea806bca0 2024-04-18T04:45:07.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.641+0000 7f8eada00640 1 -- 172.21.15.120:0/2659581650 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea8151f70 con 0x7f8ea806bca0 2024-04-18T04:45:07.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.641+0000 7f8eada00640 1 -- 172.21.15.120:0/2659581650 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea8152130 con 0x7f8ea806bca0 2024-04-18T04:45:07.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.641+0000 7f8e9ea00640 1 -- 172.21.15.120:0/2659581650 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8e94012c40 con 0x7f8ea806bca0 2024-04-18T04:45:07.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.645+0000 7f8e9ea00640 1 --2- 172.21.15.120:0/2659581650 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8e88066690 0x7f8e88068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:07.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.645+0000 7f8e9ea00640 1 -- 172.21.15.120:0/2659581650 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8e94084920 con 0x7f8ea806bca0 2024-04-18T04:45:07.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.645+0000 7f8ea6a00640 1 --2- 172.21.15.120:0/2659581650 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8e88066690 0x7f8e88068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:07.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.645+0000 7f8ea6a00640 1 --2- 172.21.15.120:0/2659581650 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8e88066690 0x7f8e88068b50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8e98003ab0 tx=0x7f8e98009770 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:07.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.649+0000 7f8e9ea00640 1 -- 172.21.15.120:0/2659581650 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f8e94051900 con 0x7f8ea806bca0 2024-04-18T04:45:07.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.801+0000 7f8eada00640 1 -- 172.21.15.120:0/2659581650 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ea8072a70 con 0x7f8ea806bca0 2024-04-18T04:45:07.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.805+0000 7f8e9ea00640 1 -- 172.21.15.120:0/2659581650 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f8e94054f20 con 0x7f8ea806bca0 2024-04-18T04:45:07.803 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:45:07.803 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":25,"fsid":"8e73592f-08e2-4957-a98f-9d044cec4ba5","created":"2024-04-18T04:44:06.139983+0000","modified":"2024-04-18T04:44:34.676253+0000","last_up_change":"2024-04-18T04:44:17.410146+0000","last_in_change":"2024-04-18T04:44:08.470250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T04:44:16.864728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T04:44:28.825773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T04:44:29.245857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-18T04:44:32.314302+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a80903bd-d9be-4fb9-af99-6125cb26bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":27468},{"type":"v1","addr":"172.21.15.120:6801","nonce":27468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":27468},{"type":"v1","addr":"172.21.15.120:6803","nonce":27468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":27468},{"type":"v1","addr":"172.21.15.120:6807","nonce":27468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":27468},{"type":"v1","addr":"172.21.15.120:6805","nonce":27468}]},"public_addr":"172.21.15.120:6801/27468","cluster_addr":"172.21.15.120:6803/27468","heartbeat_back_addr":"172.21.15.120:6807/27468","heartbeat_front_addr":"172.21.15.120:6805/27468","state":["exists","up"]},{"osd":1,"uuid":"8f5f004b-6870-4c78-8d50-9622e631ec25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":27470},{"type":"v1","addr":"172.21.15.120:6823","nonce":27470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":27470},{"type":"v1","addr":"172.21.15.120:6827","nonce":27470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":27470},{"type":"v1","addr":"172.21.15.120:6831","nonce":27470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":27470},{"type":"v1","addr":"172.21.15.120:6829","nonce":27470}]},"public_addr":"172.21.15.120:6823/27470","cluster_addr":"172.21.15.120:6827/27470","heartbeat_back_addr":"172.21.15.120:6831/27470","heartbeat_front_addr":"172.21.15.120:6829/27470","state":["exists","up"]},{"osd":2,"uuid":"6e228a2b-6103-4301-a8b5-ee81dbb1f920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":27471},{"type":"v1","addr":"172.21.15.120:6817","nonce":27471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":27471},{"type":"v1","addr":"172.21.15.120:6819","nonce":27471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":27471},{"type":"v1","addr":"172.21.15.120:6826","nonce":27471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":27471},{"type":"v1","addr":"172.21.15.120:6822","nonce":27471}]},"public_addr":"172.21.15.120:6817/27471","cluster_addr":"172.21.15.120:6819/27471","heartbeat_back_addr":"172.21.15.120:6826/27471","heartbeat_front_addr":"172.21.15.120:6822/27471","state":["exists","up"]},{"osd":3,"uuid":"7a5cabd7-d898-4e32-a03c-25b46e790134","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":27469},{"type":"v1","addr":"172.21.15.120:6809","nonce":27469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":27469},{"type":"v1","addr":"172.21.15.120:6811","nonce":27469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":27469},{"type":"v1","addr":"172.21.15.120:6815","nonce":27469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":27469},{"type":"v1","addr":"172.21.15.120:6813","nonce":27469}]},"public_addr":"172.21.15.120:6809/27469","cluster_addr":"172.21.15.120:6811/27469","heartbeat_back_addr":"172.21.15.120:6815/27469","heartbeat_front_addr":"172.21.15.120:6813/27469","state":["exists","up"]},{"osd":4,"uuid":"8e9f530f-6bab-4b23-a1a3-a71362fefcc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":28102},{"type":"v1","addr":"172.21.15.132:6825","nonce":28102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":28102},{"type":"v1","addr":"172.21.15.132:6827","nonce":28102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":28102},{"type":"v1","addr":"172.21.15.132:6831","nonce":28102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":28102},{"type":"v1","addr":"172.21.15.132:6829","nonce":28102}]},"public_addr":"172.21.15.132:6825/28102","cluster_addr":"172.21.15.132:6827/28102","heartbeat_back_addr":"172.21.15.132:6831/28102","heartbeat_front_addr":"172.21.15.132:6829/28102","state":["exists","up"]},{"osd":5,"uuid":"2243fabe-cc81-40cf-91bc-f106fe275a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":28104},{"type":"v1","addr":"172.21.15.132:6809","nonce":28104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":28104},{"type":"v1","addr":"172.21.15.132:6811","nonce":28104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":28104},{"type":"v1","addr":"172.21.15.132:6815","nonce":28104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":28104},{"type":"v1","addr":"172.21.15.132:6813","nonce":28104}]},"public_addr":"172.21.15.132:6809/28104","cluster_addr":"172.21.15.132:6811/28104","heartbeat_back_addr":"172.21.15.132:6815/28104","heartbeat_front_addr":"172.21.15.132:6813/28104","state":["exists","up"]},{"osd":6,"uuid":"c093a5ed-25c8-41a7-a20d-606a1a1661e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":28103},{"type":"v1","addr":"172.21.15.132:6801","nonce":28103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":28103},{"type":"v1","addr":"172.21.15.132:6803","nonce":28103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":28103},{"type":"v1","addr":"172.21.15.132:6807","nonce":28103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":28103},{"type":"v1","addr":"172.21.15.132:6805","nonce":28103}]},"public_addr":"172.21.15.132:6801/28103","cluster_addr":"172.21.15.132:6803/28103","heartbeat_back_addr":"172.21.15.132:6807/28103","heartbeat_front_addr":"172.21.15.132:6805/28103","state":["exists","up"]},{"osd":7,"uuid":"c37426b7-1080-4434-9f3e-a3afbbdc0fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":28129},{"type":"v1","addr":"172.21.15.132:6817","nonce":28129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":28129},{"type":"v1","addr":"172.21.15.132:6819","nonce":28129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":28129},{"type":"v1","addr":"172.21.15.132:6823","nonce":28129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":28129},{"type":"v1","addr":"172.21.15.132:6821","nonce":28129}]},"public_addr":"172.21.15.132:6817/28129","cluster_addr":"172.21.15.132:6819/28129","heartbeat_back_addr":"172.21.15.132:6823/28129","heartbeat_front_addr":"172.21.15.132:6821/28129","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.053825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.289753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.274645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.146361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.943883+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.701955+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.851076+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.800782+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T04:45:07.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.805+0000 7f8eada00640 1 -- 172.21.15.120:0/2659581650 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8e88066690 msgr2=0x7f8e88068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:07.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.805+0000 7f8eada00640 1 --2- 172.21.15.120:0/2659581650 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8e88066690 0x7f8e88068b50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8e98003ab0 tx=0x7f8e98009770 comp rx=0 tx=0).stop 2024-04-18T04:45:07.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.805+0000 7f8eada00640 1 -- 172.21.15.120:0/2659581650 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8ea806bca0 msgr2=0x7f8ea81555a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:07.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.805+0000 7f8eada00640 1 --2- 172.21.15.120:0/2659581650 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8ea806bca0 0x7f8ea81555a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8e9400d5f0 tx=0x7f8e9400dab0 comp rx=0 tx=0).stop 2024-04-18T04:45:07.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.805+0000 7f8eada00640 1 -- 172.21.15.120:0/2659581650 shutdown_connections 2024-04-18T04:45:07.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.805+0000 7f8eada00640 1 --2- 172.21.15.120:0/2659581650 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8e88066690 0x7f8e88068b50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:07.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.805+0000 7f8eada00640 1 --2- 172.21.15.120:0/2659581650 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ea8151440 0x7f8ea8154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:07.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.805+0000 7f8eada00640 1 --2- 172.21.15.120:0/2659581650 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8ea806bca0 0x7f8ea81555a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:07.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.805+0000 7f8eada00640 1 --2- 172.21.15.120:0/2659581650 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ea806b8c0 0x7f8ea81eec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:07.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.805+0000 7f8eada00640 1 -- 172.21.15.120:0/2659581650 >> 172.21.15.120:0/2659581650 conn(0x7f8ea80c78c0 msgr2=0x7f8ea80c45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:07.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.805+0000 7f8eada00640 1 -- 172.21.15.120:0/2659581650 shutdown_connections 2024-04-18T04:45:07.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.805+0000 7f8eada00640 1 -- 172.21.15.120:0/2659581650 wait complete. 2024-04-18T04:45:07.824 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T04:44:16.864728+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T04:44:28.825773+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T04:44:29.245857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-18T04:44:32.314302+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-18T04:45:07.824 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T04:45:07.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.961+0000 7f5043e00640 1 Processor -- start 2024-04-18T04:45:07.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.961+0000 7f5043e00640 1 -- start start 2024-04-18T04:45:07.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.965+0000 7f5043e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f50440b0b40 0x7f504406f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:07.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.965+0000 7f5043e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f50440c0d90 0x7f504406fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:07.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.965+0000 7f5043e00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50440c0360 con 0x7f5044150440 2024-04-18T04:45:07.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.965+0000 7f5043e00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5044070e10 con 0x7f50440c0d90 2024-04-18T04:45:07.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.965+0000 7f5043e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f504406c380 con 0x7f50440b0b40 2024-04-18T04:45:07.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.965+0000 7f5043400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f50440c0d90 0x7f504406fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:07.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.965+0000 7f5043400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f50440c0d90 0x7f504406fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34254/0 (socket says 172.21.15.120:34254) 2024-04-18T04:45:07.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.965+0000 7f5043400640 1 -- 172.21.15.120:0/287313479 learned_addr learned my addr 172.21.15.120:0/287313479 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:07.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.965+0000 7f5042000640 1 --2- 172.21.15.120:0/287313479 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f50440b0b40 0x7f504406f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:07.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.965+0000 7f5043400640 1 -- 172.21.15.120:0/287313479 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f50440b0b40 msgr2=0x7f504406f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:07.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.965+0000 7f5043400640 1 --2- 172.21.15.120:0/287313479 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f50440b0b40 0x7f504406f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:07.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.965+0000 7f5043400640 1 -- 172.21.15.120:0/287313479 >> v1:172.21.15.132:6789/0 conn(0x7f5044150440 legacy=0x7f50440c18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:07.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.965+0000 7f5043400640 1 -- 172.21.15.120:0/287313479 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50440c1fb0 con 0x7f50440c0d90 2024-04-18T04:45:07.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.969+0000 7f5043400640 1 --2- 172.21.15.120:0/287313479 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50440c0d90 0x7f504406fc30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f503c00d150 tx=0x7f503c01eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f3320bb8e89c721 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:07.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.969+0000 7f5041600640 1 -- 172.21.15.120:0/287313479 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c00b2d0 con 0x7f50440c0d90 2024-04-18T04:45:07.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.969+0000 7f5041600640 1 -- 172.21.15.120:0/287313479 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503c00b430 con 0x7f50440c0d90 2024-04-18T04:45:07.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.969+0000 7f5041600640 1 -- 172.21.15.120:0/287313479 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c0a7b90 con 0x7f50440c0d90 2024-04-18T04:45:07.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.969+0000 7f5043e00640 1 -- 172.21.15.120:0/287313479 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50440c0d90 msgr2=0x7f504406fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:07.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.969+0000 7f5043e00640 1 --2- 172.21.15.120:0/287313479 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50440c0d90 0x7f504406fc30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f503c00d150 tx=0x7f503c01eba0 comp rx=0 tx=0).stop 2024-04-18T04:45:07.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.969+0000 7f5043e00640 1 -- 172.21.15.120:0/287313479 shutdown_connections 2024-04-18T04:45:07.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.969+0000 7f5043e00640 1 --2- 172.21.15.120:0/287313479 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50440c0d90 0x7f504406fc30 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:07.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.969+0000 7f5043e00640 1 --2- 172.21.15.120:0/287313479 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f50440b0b40 0x7f504406f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:07.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.969+0000 7f5043e00640 1 -- 172.21.15.120:0/287313479 >> 172.21.15.120:0/287313479 conn(0x7f504406b860 msgr2=0x7f504406bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:07.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.969+0000 7f5043e00640 1 -- 172.21.15.120:0/287313479 shutdown_connections 2024-04-18T04:45:07.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.969+0000 7f5043e00640 1 -- 172.21.15.120:0/287313479 wait complete. 2024-04-18T04:45:07.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.969+0000 7f5043e00640 1 Processor -- start 2024-04-18T04:45:07.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.969+0000 7f5043e00640 1 -- start start 2024-04-18T04:45:07.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.973+0000 7f5043e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50440b0b40 0x7f504414b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:07.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.973+0000 7f5043e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50440c0d90 0x7f504414bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:07.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.973+0000 7f5043e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5044150440 0x7f50441f1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:07.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.973+0000 7f5043e00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50440c50b0 con 0x7f50440c0d90 2024-04-18T04:45:07.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.973+0000 7f5043e00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50440c42c0 con 0x7f50440b0b40 2024-04-18T04:45:07.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.973+0000 7f5043e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50440c4530 con 0x7f5044150440 2024-04-18T04:45:07.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.973+0000 7f5042000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50440c0d90 0x7f504414bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:07.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.973+0000 7f5042000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50440c0d90 0x7f504414bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34260/0 (socket says 172.21.15.120:34260) 2024-04-18T04:45:07.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.973+0000 7f5042000640 1 -- 172.21.15.120:0/151017523 learned_addr learned my addr 172.21.15.120:0/151017523 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:07.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.973+0000 7f5042a00640 1 --2- 172.21.15.120:0/151017523 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50440b0b40 0x7f504414b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:07.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.973+0000 7f5043400640 1 --2- 172.21.15.120:0/151017523 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5044150440 0x7f50441f1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:07.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.973+0000 7f5042000640 1 -- 172.21.15.120:0/151017523 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5044150440 msgr2=0x7f50441f1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:07.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.973+0000 7f5042000640 1 --2- 172.21.15.120:0/151017523 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5044150440 0x7f50441f1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:07.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.973+0000 7f5042000640 1 -- 172.21.15.120:0/151017523 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50440b0b40 msgr2=0x7f504414b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:07.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.973+0000 7f5042000640 1 --2- 172.21.15.120:0/151017523 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50440b0b40 0x7f504414b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:07.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.973+0000 7f5042000640 1 -- 172.21.15.120:0/151017523 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f503c00bd40 con 0x7f50440c0d90 2024-04-18T04:45:07.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.973+0000 7f5042a00640 1 --2- 172.21.15.120:0/151017523 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50440b0b40 0x7f504414b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:07.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.973+0000 7f5042000640 1 --2- 172.21.15.120:0/151017523 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50440c0d90 0x7f504414bf40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f503400d5f0 tx=0x7f503400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:07.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.973+0000 7f503aa00640 1 -- 172.21.15.120:0/151017523 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50340125f0 con 0x7f50440c0d90 2024-04-18T04:45:07.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.973+0000 7f503aa00640 1 -- 172.21.15.120:0/151017523 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5034012750 con 0x7f50440c0d90 2024-04-18T04:45:07.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.973+0000 7f5043e00640 1 -- 172.21.15.120:0/151017523 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50440c4810 con 0x7f50440c0d90 2024-04-18T04:45:07.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.973+0000 7f503aa00640 1 -- 172.21.15.120:0/151017523 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5034012ae0 con 0x7f50440c0d90 2024-04-18T04:45:07.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.973+0000 7f5043e00640 1 -- 172.21.15.120:0/151017523 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50440c4dd0 con 0x7f50440c0d90 2024-04-18T04:45:07.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.973+0000 7f5043e00640 1 -- 172.21.15.120:0/151017523 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50440728f0 con 0x7f50440c0d90 2024-04-18T04:45:07.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.973+0000 7f503aa00640 1 -- 172.21.15.120:0/151017523 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5034012c40 con 0x7f50440c0d90 2024-04-18T04:45:07.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.977+0000 7f503aa00640 1 --2- 172.21.15.120:0/151017523 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f5020066690 0x7f5020068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:07.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.977+0000 7f503aa00640 1 -- 172.21.15.120:0/151017523 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5034084990 con 0x7f50440c0d90 2024-04-18T04:45:07.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.977+0000 7f5042a00640 1 --2- 172.21.15.120:0/151017523 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f5020066690 0x7f5020068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:07.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.977+0000 7f5042a00640 1 --2- 172.21.15.120:0/151017523 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f5020066690 0x7f5020068b50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f502c000f70 tx=0x7f502c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:07.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:07.981+0000 7f503aa00640 1 -- 172.21.15.120:0/151017523 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f5034051970 con 0x7f50440c0d90 2024-04-18T04:45:08.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.137+0000 7f5043e00640 1 -- 172.21.15.120:0/151017523 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f504406adc0 con 0x7f50440c0d90 2024-04-18T04:45:08.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.141+0000 7f503aa00640 1 -- 172.21.15.120:0/151017523 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5034051970 con 0x7f50440c0d90 2024-04-18T04:45:08.139 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2024-04-18T04:45:08.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.141+0000 7f5043e00640 1 -- 172.21.15.120:0/151017523 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f5020066690 msgr2=0x7f5020068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:08.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.141+0000 7f5043e00640 1 --2- 172.21.15.120:0/151017523 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f5020066690 0x7f5020068b50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f502c000f70 tx=0x7f502c009040 comp rx=0 tx=0).stop 2024-04-18T04:45:08.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.141+0000 7f5043e00640 1 -- 172.21.15.120:0/151017523 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50440c0d90 msgr2=0x7f504414bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:08.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.141+0000 7f5043e00640 1 --2- 172.21.15.120:0/151017523 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50440c0d90 0x7f504414bf40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f503400d5f0 tx=0x7f503400dab0 comp rx=0 tx=0).stop 2024-04-18T04:45:08.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.141+0000 7f5043e00640 1 -- 172.21.15.120:0/151017523 shutdown_connections 2024-04-18T04:45:08.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.141+0000 7f5043e00640 1 --2- 172.21.15.120:0/151017523 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f5020066690 0x7f5020068b50 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:08.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.141+0000 7f5043e00640 1 --2- 172.21.15.120:0/151017523 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5044150440 0x7f50441f1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:08.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.141+0000 7f5043e00640 1 --2- 172.21.15.120:0/151017523 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50440c0d90 0x7f504414bf40 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:08.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.141+0000 7f5043e00640 1 --2- 172.21.15.120:0/151017523 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50440b0b40 0x7f504414b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:08.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.141+0000 7f5043e00640 1 -- 172.21.15.120:0/151017523 >> 172.21.15.120:0/151017523 conn(0x7f504406b860 msgr2=0x7f50440c68d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:08.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.141+0000 7f5043e00640 1 -- 172.21.15.120:0/151017523 shutdown_connections 2024-04-18T04:45:08.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.141+0000 7f5043e00640 1 -- 172.21.15.120:0/151017523 wait complete. 2024-04-18T04:45:08.160 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T04:45:08.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.296+0000 7f86bd800640 1 Processor -- start 2024-04-18T04:45:08.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.296+0000 7f86bd800640 1 -- start start 2024-04-18T04:45:08.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.300+0000 7f86bd800640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f86b814fc40 0x7f86b8156610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:08.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.300+0000 7f86bd800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f86b8150020 0x7f86b806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:08.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.300+0000 7f86bd800640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f86b80c1270 0x7f86b80c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:08.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.300+0000 7f86bd800640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86b80c0860 con 0x7f86b814fc40 2024-04-18T04:45:08.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.300+0000 7f86bd800640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86b80c6a90 con 0x7f86b80c1270 2024-04-18T04:45:08.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.300+0000 7f86bd800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86b8156b50 con 0x7f86b8150020 2024-04-18T04:45:08.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.300+0000 7f86b6a00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f86b814fc40 0x7f86b8156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:08.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.300+0000 7f86b6a00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f86b814fc40 0x7f86b8156610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34264/0 (socket says 172.21.15.120:34264) 2024-04-18T04:45:08.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.300+0000 7f86b6a00640 1 -- 172.21.15.120:0/453910623 learned_addr learned my addr 172.21.15.120:0/453910623 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:08.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.300+0000 7f86b7400640 1 --2- 172.21.15.120:0/453910623 >> v2:172.21.15.132:3300/0 conn(0x7f86b80c1270 0x7f86b80c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:08.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.300+0000 7f86b6000640 1 --2- 172.21.15.120:0/453910623 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f86b8150020 0x7f86b806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:08.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.300+0000 7f86b6a00640 1 -- 172.21.15.120:0/453910623 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f86b8150020 msgr2=0x7f86b806d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:08.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.300+0000 7f86b6a00640 1 --2- 172.21.15.120:0/453910623 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f86b8150020 0x7f86b806d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:08.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.300+0000 7f86b6a00640 1 -- 172.21.15.120:0/453910623 >> v2:172.21.15.132:3300/0 conn(0x7f86b80c1270 msgr2=0x7f86b80c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:08.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.300+0000 7f86b6a00640 1 --2- 172.21.15.120:0/453910623 >> v2:172.21.15.132:3300/0 conn(0x7f86b80c1270 0x7f86b80c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:08.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.300+0000 7f86b6a00640 1 -- 172.21.15.120:0/453910623 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b806d980 con 0x7f86b814fc40 2024-04-18T04:45:08.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.300+0000 7f86b7400640 1 --2- 172.21.15.120:0/453910623 >> v2:172.21.15.132:3300/0 conn(0x7f86b80c1270 0x7f86b80c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:08.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.304+0000 7f86b6a00640 1 --2- 172.21.15.120:0/453910623 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86b814fc40 0x7f86b8156610 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f86b80b0590 tx=0x7f86a80213e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16087a04b4e5750 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:08.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.304+0000 7f86b5600640 1 -- 172.21.15.120:0/453910623 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a80aaea0 con 0x7f86b814fc40 2024-04-18T04:45:08.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.304+0000 7f86b5600640 1 -- 172.21.15.120:0/453910623 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86a80ad030 con 0x7f86b814fc40 2024-04-18T04:45:08.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.304+0000 7f86b5600640 1 -- 172.21.15.120:0/453910623 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a80b3630 con 0x7f86b814fc40 2024-04-18T04:45:08.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.304+0000 7f86bd800640 1 -- 172.21.15.120:0/453910623 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86b814fc40 msgr2=0x7f86b8156610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:08.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.304+0000 7f86bd800640 1 --2- 172.21.15.120:0/453910623 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86b814fc40 0x7f86b8156610 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f86b80b0590 tx=0x7f86a80213e0 comp rx=0 tx=0).stop 2024-04-18T04:45:08.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.304+0000 7f86bd800640 1 -- 172.21.15.120:0/453910623 shutdown_connections 2024-04-18T04:45:08.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.304+0000 7f86bd800640 1 --2- 172.21.15.120:0/453910623 >> v2:172.21.15.132:3300/0 conn(0x7f86b80c1270 0x7f86b80c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:08.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.304+0000 7f86bd800640 1 --2- 172.21.15.120:0/453910623 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f86b8150020 0x7f86b806d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:08.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.304+0000 7f86bd800640 1 --2- 172.21.15.120:0/453910623 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86b814fc40 0x7f86b8156610 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:08.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.304+0000 7f86bd800640 1 -- 172.21.15.120:0/453910623 >> 172.21.15.120:0/453910623 conn(0x7f86b806b780 msgr2=0x7f86b806bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:08.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.304+0000 7f86bd800640 1 -- 172.21.15.120:0/453910623 shutdown_connections 2024-04-18T04:45:08.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.304+0000 7f86bd800640 1 -- 172.21.15.120:0/453910623 wait complete. 2024-04-18T04:45:08.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.304+0000 7f86bd800640 1 Processor -- start 2024-04-18T04:45:08.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.304+0000 7f86bd800640 1 -- start start 2024-04-18T04:45:08.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.308+0000 7f86bd800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f86b80c1270 0x7f86b80aec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:08.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.308+0000 7f86bd800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86b814fc40 0x7f86b80ad880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:08.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.308+0000 7f86bd800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86b8071e90 0x7f86b8070960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:08.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.308+0000 7f86bd800640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b81efde0 con 0x7f86b8071e90 2024-04-18T04:45:08.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.308+0000 7f86bd800640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b80af1b0 con 0x7f86b814fc40 2024-04-18T04:45:08.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.308+0000 7f86bd800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86b80ae0a0 con 0x7f86b80c1270 2024-04-18T04:45:08.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.308+0000 7f86b7400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86b8071e90 0x7f86b8070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:08.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.308+0000 7f86b7400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86b8071e90 0x7f86b8070960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34278/0 (socket says 172.21.15.120:34278) 2024-04-18T04:45:08.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.308+0000 7f86b7400640 1 -- 172.21.15.120:0/3783085902 learned_addr learned my addr 172.21.15.120:0/3783085902 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:08.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.308+0000 7f86b6000640 1 --2- 172.21.15.120:0/3783085902 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86b814fc40 0x7f86b80ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:08.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.308+0000 7f86b6a00640 1 --2- 172.21.15.120:0/3783085902 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f86b80c1270 0x7f86b80aec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:08.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.308+0000 7f86b7400640 1 -- 172.21.15.120:0/3783085902 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f86b80c1270 msgr2=0x7f86b80aec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:08.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.308+0000 7f86b7400640 1 --2- 172.21.15.120:0/3783085902 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f86b80c1270 0x7f86b80aec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:08.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.308+0000 7f86b7400640 1 -- 172.21.15.120:0/3783085902 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86b814fc40 msgr2=0x7f86b80ad880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:08.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.308+0000 7f86b7400640 1 --2- 172.21.15.120:0/3783085902 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86b814fc40 0x7f86b80ad880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:08.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.308+0000 7f86b7400640 1 -- 172.21.15.120:0/3783085902 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a800bd40 con 0x7f86b8071e90 2024-04-18T04:45:08.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.308+0000 7f86b7400640 1 --2- 172.21.15.120:0/3783085902 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86b8071e90 0x7f86b8070960 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f86b000e870 tx=0x7f86b000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:08.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.308+0000 7f86aea00640 1 -- 172.21.15.120:0/3783085902 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b000c8d0 con 0x7f86b8071e90 2024-04-18T04:45:08.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.308+0000 7f86aea00640 1 -- 172.21.15.120:0/3783085902 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b000ca30 con 0x7f86b8071e90 2024-04-18T04:45:08.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.308+0000 7f86aea00640 1 -- 172.21.15.120:0/3783085902 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b000cde0 con 0x7f86b8071e90 2024-04-18T04:45:08.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.308+0000 7f86bd800640 1 -- 172.21.15.120:0/3783085902 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86b81ef160 con 0x7f86b8071e90 2024-04-18T04:45:08.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.308+0000 7f86bd800640 1 -- 172.21.15.120:0/3783085902 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86b81ef720 con 0x7f86b8071e90 2024-04-18T04:45:08.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.308+0000 7f86bd800640 1 -- 172.21.15.120:0/3783085902 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86b80c1ef0 con 0x7f86b8071e90 2024-04-18T04:45:08.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.308+0000 7f86aea00640 1 -- 172.21.15.120:0/3783085902 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f86b0013410 con 0x7f86b8071e90 2024-04-18T04:45:08.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.312+0000 7f86aea00640 1 --2- 172.21.15.120:0/3783085902 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8698066690 0x7f8698068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:08.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.312+0000 7f86aea00640 1 -- 172.21.15.120:0/3783085902 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f86b00843c0 con 0x7f86b8071e90 2024-04-18T04:45:08.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.312+0000 7f86b6a00640 1 --2- 172.21.15.120:0/3783085902 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8698066690 0x7f8698068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:08.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.312+0000 7f86b6a00640 1 --2- 172.21.15.120:0/3783085902 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8698066690 0x7f8698068b50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f86a80b5000 tx=0x7f86a800a040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:08.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.312+0000 7f86aea00640 1 -- 172.21.15.120:0/3783085902 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f86b00513a0 con 0x7f86b8071e90 2024-04-18T04:45:08.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.468+0000 7f86bd800640 1 -- 172.21.15.120:0/3783085902 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f86b80729d0 con 0x7f86b8071e90 2024-04-18T04:45:08.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.468+0000 7f86aea00640 1 -- 172.21.15.120:0/3783085902 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f86b00549c0 con 0x7f86b8071e90 2024-04-18T04:45:08.468 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2024-04-18T04:45:08.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.468+0000 7f86bd800640 1 -- 172.21.15.120:0/3783085902 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8698066690 msgr2=0x7f8698068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:08.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.468+0000 7f86bd800640 1 --2- 172.21.15.120:0/3783085902 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8698066690 0x7f8698068b50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f86a80b5000 tx=0x7f86a800a040 comp rx=0 tx=0).stop 2024-04-18T04:45:08.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.468+0000 7f86bd800640 1 -- 172.21.15.120:0/3783085902 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86b8071e90 msgr2=0x7f86b8070960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:08.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.468+0000 7f86bd800640 1 --2- 172.21.15.120:0/3783085902 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86b8071e90 0x7f86b8070960 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f86b000e870 tx=0x7f86b000ed30 comp rx=0 tx=0).stop 2024-04-18T04:45:08.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.468+0000 7f86bd800640 1 -- 172.21.15.120:0/3783085902 shutdown_connections 2024-04-18T04:45:08.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.468+0000 7f86bd800640 1 --2- 172.21.15.120:0/3783085902 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8698066690 0x7f8698068b50 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:08.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.468+0000 7f86bd800640 1 --2- 172.21.15.120:0/3783085902 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86b8071e90 0x7f86b8070960 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:08.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.468+0000 7f86bd800640 1 --2- 172.21.15.120:0/3783085902 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86b814fc40 0x7f86b80ad880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:08.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.468+0000 7f86bd800640 1 --2- 172.21.15.120:0/3783085902 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f86b80c1270 0x7f86b80aec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:08.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.468+0000 7f86bd800640 1 -- 172.21.15.120:0/3783085902 >> 172.21.15.120:0/3783085902 conn(0x7f86b806b780 msgr2=0x7f86b80c7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:08.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.468+0000 7f86bd800640 1 -- 172.21.15.120:0/3783085902 shutdown_connections 2024-04-18T04:45:08.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.468+0000 7f86bd800640 1 -- 172.21.15.120:0/3783085902 wait complete. 2024-04-18T04:45:08.489 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T04:45:08.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.628+0000 7efffea00640 1 Processor -- start 2024-04-18T04:45:08.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.628+0000 7efffea00640 1 -- start start 2024-04-18T04:45:08.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.628+0000 7efffea00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7efff8151730 0x7efff8158150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:08.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.628+0000 7efffea00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7efff806dcf0 0x7efff80c73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:08.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.628+0000 7efffea00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efff8072640 con 0x7efff80caff0 2024-04-18T04:45:08.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.628+0000 7efffea00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efff8071120 con 0x7efff806dcf0 2024-04-18T04:45:08.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.628+0000 7efffea00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efff8072360 con 0x7efff8151730 2024-04-18T04:45:08.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.628+0000 7effefe00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7efff806dcf0 0x7efff80c73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:08.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.628+0000 7efffca00640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7efff80caff0 0x7efff815ab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:59324/0 (socket says 172.21.15.120:59324) 2024-04-18T04:45:08.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.628+0000 7efffca00640 1 -- 172.21.15.120:0/2630581715 learned_addr learned my addr 172.21.15.120:0/2630581715 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:45:08.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.628+0000 7efff7e00640 1 --2- 172.21.15.120:0/2630581715 >> v2:172.21.15.132:3300/0 conn(0x7efff8151730 0x7efff8158150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:08.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.628+0000 7effefe00640 1 -- 172.21.15.120:0/2630581715 >> v2:172.21.15.132:3300/0 conn(0x7efff8151730 msgr2=0x7efff8158150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:08.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.628+0000 7effefe00640 1 --2- 172.21.15.120:0/2630581715 >> v2:172.21.15.132:3300/0 conn(0x7efff8151730 0x7efff8158150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:08.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.628+0000 7effefe00640 1 -- 172.21.15.120:0/2630581715 >> v1:172.21.15.120:6789/0 conn(0x7efff80caff0 legacy=0x7efff815ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:08.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.628+0000 7effefe00640 1 -- 172.21.15.120:0/2630581715 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff806f9d0 con 0x7efff806dcf0 2024-04-18T04:45:08.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.628+0000 7efff7400640 1 -- 172.21.15.120:0/2630581715 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3372073525 0 0) 0x7efff8072640 con 0x7efff80caff0 2024-04-18T04:45:08.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.628+0000 7efff7e00640 1 --2- 172.21.15.120:0/2630581715 >> v2:172.21.15.132:3300/0 conn(0x7efff8151730 0x7efff8158150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:08.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.632+0000 7effefe00640 1 --2- 172.21.15.120:0/2630581715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efff806dcf0 0x7efff80c73d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7efff806dc80 tx=0x7effe001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7ec701887b7aa05 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:08.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.632+0000 7efff7400640 1 -- 172.21.15.120:0/2630581715 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe00a8970 con 0x7efff806dcf0 2024-04-18T04:45:08.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.632+0000 7efff7400640 1 -- 172.21.15.120:0/2630581715 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe00a8ad0 con 0x7efff806dcf0 2024-04-18T04:45:08.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.632+0000 7efff7400640 1 -- 172.21.15.120:0/2630581715 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe00a8e60 con 0x7efff806dcf0 2024-04-18T04:45:08.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.632+0000 7efffea00640 1 -- 172.21.15.120:0/2630581715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efff806dcf0 msgr2=0x7efff80c73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:08.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.632+0000 7efffea00640 1 --2- 172.21.15.120:0/2630581715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efff806dcf0 0x7efff80c73d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7efff806dc80 tx=0x7effe001ec70 comp rx=0 tx=0).stop 2024-04-18T04:45:08.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.632+0000 7efffea00640 1 -- 172.21.15.120:0/2630581715 shutdown_connections 2024-04-18T04:45:08.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.632+0000 7efffea00640 1 --2- 172.21.15.120:0/2630581715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efff806dcf0 0x7efff80c73d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:08.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.632+0000 7efffea00640 1 --2- 172.21.15.120:0/2630581715 >> v2:172.21.15.132:3300/0 conn(0x7efff8151730 0x7efff8158150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:08.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.632+0000 7efffea00640 1 -- 172.21.15.120:0/2630581715 >> 172.21.15.120:0/2630581715 conn(0x7efff806b780 msgr2=0x7efff806bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:08.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.632+0000 7efffea00640 1 -- 172.21.15.120:0/2630581715 shutdown_connections 2024-04-18T04:45:08.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.632+0000 7efffea00640 1 -- 172.21.15.120:0/2630581715 wait complete. 2024-04-18T04:45:08.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.632+0000 7efffea00640 1 Processor -- start 2024-04-18T04:45:08.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.632+0000 7efffea00640 1 -- start start 2024-04-18T04:45:08.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.636+0000 7efffea00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efff806dcf0 0x7efff8158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:08.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.636+0000 7efffea00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efff80caff0 0x7efff81ec7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:08.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.636+0000 7efffea00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efff8151730 0x7efff81496c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:08.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.636+0000 7efffea00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff8159330 con 0x7efff8151730 2024-04-18T04:45:08.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.636+0000 7efffea00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff814e930 con 0x7efff806dcf0 2024-04-18T04:45:08.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.636+0000 7efffea00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff814ec10 con 0x7efff80caff0 2024-04-18T04:45:08.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.636+0000 7efffca00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efff8151730 0x7efff81496c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:08.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.636+0000 7efffca00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efff8151730 0x7efff81496c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34298/0 (socket says 172.21.15.120:34298) 2024-04-18T04:45:08.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.636+0000 7efffca00640 1 -- 172.21.15.120:0/2353658634 learned_addr learned my addr 172.21.15.120:0/2353658634 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:08.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.636+0000 7effefe00640 1 --2- 172.21.15.120:0/2353658634 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efff80caff0 0x7efff81ec7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:08.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.636+0000 7efff7e00640 1 --2- 172.21.15.120:0/2353658634 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efff806dcf0 0x7efff8158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:08.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.636+0000 7efffca00640 1 -- 172.21.15.120:0/2353658634 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efff80caff0 msgr2=0x7efff81ec7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:08.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.636+0000 7efffca00640 1 --2- 172.21.15.120:0/2353658634 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efff80caff0 0x7efff81ec7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:08.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.636+0000 7efffca00640 1 -- 172.21.15.120:0/2353658634 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efff806dcf0 msgr2=0x7efff8158950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:08.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.636+0000 7efffca00640 1 --2- 172.21.15.120:0/2353658634 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efff806dcf0 0x7efff8158950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:08.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.636+0000 7efffca00640 1 -- 172.21.15.120:0/2353658634 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe0009420 con 0x7efff8151730 2024-04-18T04:45:08.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.636+0000 7efffca00640 1 --2- 172.21.15.120:0/2353658634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efff8151730 0x7efff81496c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7efff0001570 tx=0x7efff000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:08.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.636+0000 7efff4c00640 1 -- 172.21.15.120:0/2353658634 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff000a640 con 0x7efff8151730 2024-04-18T04:45:08.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.636+0000 7efff4c00640 1 -- 172.21.15.120:0/2353658634 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff000a7c0 con 0x7efff8151730 2024-04-18T04:45:08.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.636+0000 7efff4c00640 1 -- 172.21.15.120:0/2353658634 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff000ab70 con 0x7efff8151730 2024-04-18T04:45:08.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.636+0000 7efffea00640 1 -- 172.21.15.120:0/2353658634 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efff81efff0 con 0x7efff8151730 2024-04-18T04:45:08.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.636+0000 7efffea00640 1 -- 172.21.15.120:0/2353658634 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efff81f05b0 con 0x7efff8151730 2024-04-18T04:45:08.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.636+0000 7efffea00640 1 -- 172.21.15.120:0/2353658634 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efff81f07a0 con 0x7efff8151730 2024-04-18T04:45:08.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.640+0000 7efff4c00640 1 -- 172.21.15.120:0/2353658634 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efff000acd0 con 0x7efff8151730 2024-04-18T04:45:08.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.640+0000 7efff4c00640 1 --2- 172.21.15.120:0/2353658634 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7effd4066690 0x7effd4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:08.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.640+0000 7efff4c00640 1 -- 172.21.15.120:0/2353658634 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efff00839b0 con 0x7efff8151730 2024-04-18T04:45:08.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.640+0000 7efff7e00640 1 --2- 172.21.15.120:0/2353658634 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7effd4066690 0x7effd4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:08.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.640+0000 7efff7e00640 1 --2- 172.21.15.120:0/2353658634 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7effd4066690 0x7effd4068b50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7effe8009950 tx=0x7effe8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:08.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.644+0000 7efff4c00640 1 -- 172.21.15.120:0/2353658634 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7efff0050ad0 con 0x7efff8151730 2024-04-18T04:45:08.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.796+0000 7efffea00640 1 -- 172.21.15.120:0/2353658634 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efff80729d0 con 0x7efff8151730 2024-04-18T04:45:08.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.796+0000 7efff4c00640 1 -- 172.21.15.120:0/2353658634 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7efff0018020 con 0x7efff8151730 2024-04-18T04:45:08.797 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 64 2024-04-18T04:45:08.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.796+0000 7efffea00640 1 -- 172.21.15.120:0/2353658634 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7effd4066690 msgr2=0x7effd4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:08.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.796+0000 7efffea00640 1 --2- 172.21.15.120:0/2353658634 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7effd4066690 0x7effd4068b50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7effe8009950 tx=0x7effe8008040 comp rx=0 tx=0).stop 2024-04-18T04:45:08.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.796+0000 7efffea00640 1 -- 172.21.15.120:0/2353658634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efff8151730 msgr2=0x7efff81496c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:08.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.796+0000 7efffea00640 1 --2- 172.21.15.120:0/2353658634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efff8151730 0x7efff81496c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7efff0001570 tx=0x7efff000cca0 comp rx=0 tx=0).stop 2024-04-18T04:45:08.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.796+0000 7efffea00640 1 -- 172.21.15.120:0/2353658634 shutdown_connections 2024-04-18T04:45:08.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.796+0000 7efffea00640 1 --2- 172.21.15.120:0/2353658634 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7effd4066690 0x7effd4068b50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:08.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.796+0000 7efffea00640 1 --2- 172.21.15.120:0/2353658634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efff8151730 0x7efff81496c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:08.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.796+0000 7efffea00640 1 --2- 172.21.15.120:0/2353658634 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efff80caff0 0x7efff81ec7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:08.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.796+0000 7efffea00640 1 --2- 172.21.15.120:0/2353658634 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efff806dcf0 0x7efff8158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:08.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.796+0000 7efffea00640 1 -- 172.21.15.120:0/2353658634 >> 172.21.15.120:0/2353658634 conn(0x7efff806b780 msgr2=0x7efff80c9530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:08.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.796+0000 7efffea00640 1 -- 172.21.15.120:0/2353658634 shutdown_connections 2024-04-18T04:45:08.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.796+0000 7efffea00640 1 -- 172.21.15.120:0/2353658634 wait complete. 2024-04-18T04:45:08.818 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-18T04:45:08.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.956+0000 7f07fc800640 1 Processor -- start 2024-04-18T04:45:08.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.956+0000 7f07fc800640 1 -- start start 2024-04-18T04:45:08.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.956+0000 7f07fc800640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f07f4153890 0x7f07f41596e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:08.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.956+0000 7f07fc800640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f07f4153c70 0x7f07f4070c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:08.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.956+0000 7f07fc800640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07f4070790 con 0x7f07f4071160 2024-04-18T04:45:08.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.956+0000 7f07fc800640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f4071ae0 con 0x7f07f4153c70 2024-04-18T04:45:08.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.956+0000 7f07fc800640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f4159c20 con 0x7f07f4153890 2024-04-18T04:45:08.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.956+0000 7f07fa800640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f07f4071160 0x7f07f40c6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:59340/0 (socket says 172.21.15.120:59340) 2024-04-18T04:45:08.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.956+0000 7f07fa800640 1 -- 172.21.15.120:0/4252207005 learned_addr learned my addr 172.21.15.120:0/4252207005 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:45:08.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.956+0000 7f07f9400640 1 --2- 172.21.15.120:0/4252207005 >> v2:172.21.15.120:3300/0 conn(0x7f07f4153c70 0x7f07f4070c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:08.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.956+0000 7f07f9e00640 1 --2- 172.21.15.120:0/4252207005 >> v2:172.21.15.132:3300/0 conn(0x7f07f4153890 0x7f07f41596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:08.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.956+0000 7f07f9400640 1 -- 172.21.15.120:0/4252207005 >> v2:172.21.15.132:3300/0 conn(0x7f07f4153890 msgr2=0x7f07f41596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:08.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.956+0000 7f07f9400640 1 --2- 172.21.15.120:0/4252207005 >> v2:172.21.15.132:3300/0 conn(0x7f07f4153890 0x7f07f41596e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:08.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.956+0000 7f07f9400640 1 -- 172.21.15.120:0/4252207005 >> v1:172.21.15.120:6789/0 conn(0x7f07f4071160 legacy=0x7f07f40c6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:08.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.956+0000 7f07f9400640 1 -- 172.21.15.120:0/4252207005 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f4159e90 con 0x7f07f4153c70 2024-04-18T04:45:08.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.956+0000 7f07f8a00640 1 -- 172.21.15.120:0/4252207005 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3311629500 0 0) 0x7f07f4070790 con 0x7f07f4071160 2024-04-18T04:45:08.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.960+0000 7f07f9400640 1 --2- 172.21.15.120:0/4252207005 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07f4153c70 0x7f07f4070c20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f07f406add0 tx=0x7f07e401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fd68b933d7197eb server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:08.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.960+0000 7f07f8a00640 1 -- 172.21.15.120:0/4252207005 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e40ab600 con 0x7f07f4153c70 2024-04-18T04:45:08.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.960+0000 7f07f8a00640 1 -- 172.21.15.120:0/4252207005 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e40a7050 con 0x7f07f4153c70 2024-04-18T04:45:08.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.960+0000 7f07f8a00640 1 -- 172.21.15.120:0/4252207005 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e40ab980 con 0x7f07f4153c70 2024-04-18T04:45:08.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.960+0000 7f07fc800640 1 -- 172.21.15.120:0/4252207005 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07f4153c70 msgr2=0x7f07f4070c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:08.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.960+0000 7f07fc800640 1 --2- 172.21.15.120:0/4252207005 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07f4153c70 0x7f07f4070c20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f07f406add0 tx=0x7f07e401c480 comp rx=0 tx=0).stop 2024-04-18T04:45:08.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.960+0000 7f07fc800640 1 -- 172.21.15.120:0/4252207005 shutdown_connections 2024-04-18T04:45:08.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.960+0000 7f07fc800640 1 --2- 172.21.15.120:0/4252207005 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07f4153c70 0x7f07f4070c20 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:08.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.960+0000 7f07fc800640 1 --2- 172.21.15.120:0/4252207005 >> v2:172.21.15.132:3300/0 conn(0x7f07f4153890 0x7f07f41596e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:08.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.960+0000 7f07fc800640 1 -- 172.21.15.120:0/4252207005 >> 172.21.15.120:0/4252207005 conn(0x7f07f4066a50 msgr2=0x7f07f4069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:08.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.960+0000 7f07fc800640 1 -- 172.21.15.120:0/4252207005 shutdown_connections 2024-04-18T04:45:08.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.960+0000 7f07fc800640 1 -- 172.21.15.120:0/4252207005 wait complete. 2024-04-18T04:45:08.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.964+0000 7f07fc800640 1 Processor -- start 2024-04-18T04:45:08.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.964+0000 7f07fc800640 1 -- start start 2024-04-18T04:45:08.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.964+0000 7f07fc800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07f4071160 0x7f07f40c4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:08.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.964+0000 7f07fc800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07f4153890 0x7f07f414a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:08.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.964+0000 7f07fc800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07f4153c70 0x7f07f415c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:08.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.964+0000 7f07fc800640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f4157830 con 0x7f07f4153c70 2024-04-18T04:45:08.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.964+0000 7f07fc800640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f4158120 con 0x7f07f4071160 2024-04-18T04:45:08.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.964+0000 7f07fc800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f415ca40 con 0x7f07f4153890 2024-04-18T04:45:08.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.964+0000 7f07fa800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07f4153c70 0x7f07f415c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:08.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.964+0000 7f07fa800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07f4153c70 0x7f07f415c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34314/0 (socket says 172.21.15.120:34314) 2024-04-18T04:45:08.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.964+0000 7f07fa800640 1 -- 172.21.15.120:0/3787656531 learned_addr learned my addr 172.21.15.120:0/3787656531 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:08.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.964+0000 7f07f9e00640 1 --2- 172.21.15.120:0/3787656531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07f4071160 0x7f07f40c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:08.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.964+0000 7f07f9400640 1 --2- 172.21.15.120:0/3787656531 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07f4153890 0x7f07f414a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:08.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.964+0000 7f07fa800640 1 -- 172.21.15.120:0/3787656531 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07f4153890 msgr2=0x7f07f414a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:08.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.964+0000 7f07fa800640 1 --2- 172.21.15.120:0/3787656531 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07f4153890 0x7f07f414a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:08.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.964+0000 7f07fa800640 1 -- 172.21.15.120:0/3787656531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07f4071160 msgr2=0x7f07f40c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:08.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.964+0000 7f07fa800640 1 --2- 172.21.15.120:0/3787656531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07f4071160 0x7f07f40c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:08.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.964+0000 7f07fa800640 1 -- 172.21.15.120:0/3787656531 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e4009420 con 0x7f07f4153c70 2024-04-18T04:45:08.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.964+0000 7f07fa800640 1 --2- 172.21.15.120:0/3787656531 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07f4153c70 0x7f07f415c120 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f07f0001570 tx=0x7f07f000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:08.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.964+0000 7f07ee000640 1 -- 172.21.15.120:0/3787656531 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f000ce40 con 0x7f07f4153c70 2024-04-18T04:45:08.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.964+0000 7f07ee000640 1 -- 172.21.15.120:0/3787656531 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f000a5e0 con 0x7f07f4153c70 2024-04-18T04:45:08.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.964+0000 7f07ee000640 1 -- 172.21.15.120:0/3787656531 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f000a990 con 0x7f07f4153c70 2024-04-18T04:45:08.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.964+0000 7f07fc800640 1 -- 172.21.15.120:0/3787656531 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f415ba10 con 0x7f07f4153c70 2024-04-18T04:45:08.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.964+0000 7f07fc800640 1 -- 172.21.15.120:0/3787656531 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f415ac50 con 0x7f07f4153c70 2024-04-18T04:45:08.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.968+0000 7f07fc800640 1 -- 172.21.15.120:0/3787656531 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f40729d0 con 0x7f07f4153c70 2024-04-18T04:45:08.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.968+0000 7f07ee000640 1 -- 172.21.15.120:0/3787656531 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f07f000aaf0 con 0x7f07f4153c70 2024-04-18T04:45:08.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.968+0000 7f07ee000640 1 --2- 172.21.15.120:0/3787656531 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f07d8066690 0x7f07d8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:08.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.968+0000 7f07ee000640 1 -- 172.21.15.120:0/3787656531 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f07f00837e0 con 0x7f07f4153c70 2024-04-18T04:45:08.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.968+0000 7f07f9e00640 1 --2- 172.21.15.120:0/3787656531 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f07d8066690 0x7f07d8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:08.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.972+0000 7f07f9e00640 1 --2- 172.21.15.120:0/3787656531 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f07d8066690 0x7f07d8068b50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f07e8009b60 tx=0x7f07e8009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:08.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:08.972+0000 7f07ee000640 1 -- 172.21.15.120:0/3787656531 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f07f0050900 con 0x7f07f4153c70 2024-04-18T04:45:09.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.128+0000 7f07fc800640 1 -- 172.21.15.120:0/3787656531 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f07f40c8950 con 0x7f07f4153c70 2024-04-18T04:45:09.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.128+0000 7f07ee000640 1 -- 172.21.15.120:0/3787656531 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f07f0018020 con 0x7f07f4153c70 2024-04-18T04:45:09.128 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2024-04-18T04:45:09.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.128+0000 7f07fc800640 1 -- 172.21.15.120:0/3787656531 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f07d8066690 msgr2=0x7f07d8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:09.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.128+0000 7f07fc800640 1 --2- 172.21.15.120:0/3787656531 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f07d8066690 0x7f07d8068b50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f07e8009b60 tx=0x7f07e8009190 comp rx=0 tx=0).stop 2024-04-18T04:45:09.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.128+0000 7f07fc800640 1 -- 172.21.15.120:0/3787656531 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07f4153c70 msgr2=0x7f07f415c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:09.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.128+0000 7f07fc800640 1 --2- 172.21.15.120:0/3787656531 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07f4153c70 0x7f07f415c120 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f07f0001570 tx=0x7f07f000cc50 comp rx=0 tx=0).stop 2024-04-18T04:45:09.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.128+0000 7f07fc800640 1 -- 172.21.15.120:0/3787656531 shutdown_connections 2024-04-18T04:45:09.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.128+0000 7f07fc800640 1 --2- 172.21.15.120:0/3787656531 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f07d8066690 0x7f07d8068b50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:09.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.128+0000 7f07fc800640 1 --2- 172.21.15.120:0/3787656531 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07f4153c70 0x7f07f415c120 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:09.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.128+0000 7f07fc800640 1 --2- 172.21.15.120:0/3787656531 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07f4153890 0x7f07f414a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:09.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.128+0000 7f07fc800640 1 --2- 172.21.15.120:0/3787656531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07f4071160 0x7f07f40c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:09.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.128+0000 7f07fc800640 1 -- 172.21.15.120:0/3787656531 >> 172.21.15.120:0/3787656531 conn(0x7f07f4066a50 msgr2=0x7f07f40c7a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:09.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.128+0000 7f07fc800640 1 -- 172.21.15.120:0/3787656531 shutdown_connections 2024-04-18T04:45:09.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.128+0000 7f07fc800640 1 -- 172.21.15.120:0/3787656531 wait complete. 2024-04-18T04:45:09.148 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:45:09.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.284+0000 7f07ace00640 1 Processor -- start 2024-04-18T04:45:09.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.284+0000 7f07ace00640 1 -- start start 2024-04-18T04:45:09.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.284+0000 7f07ace00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f07a80ccee0 0x7f07a80cd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:09.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.284+0000 7f07ace00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07a8070410 con 0x7f07a81573c0 2024-04-18T04:45:09.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.284+0000 7f07ace00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07a81577d0 con 0x7f07a81515e0 2024-04-18T04:45:09.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.284+0000 7f07ace00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07a80c3120 con 0x7f07a80ccee0 2024-04-18T04:45:09.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.284+0000 7f07a5400640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f07a81573c0 0x7f07a806fd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:59342/0 (socket says 172.21.15.120:59342) 2024-04-18T04:45:09.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.284+0000 7f07a5400640 1 -- 172.21.15.120:0/2859347212 learned_addr learned my addr 172.21.15.120:0/2859347212 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:45:09.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.284+0000 7f07a6800640 1 --2- 172.21.15.120:0/2859347212 >> v2:172.21.15.132:3300/0 conn(0x7f07a80ccee0 0x7f07a80cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:09.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.284+0000 7f07a4a00640 1 -- 172.21.15.120:0/2859347212 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2209752045 0 0) 0x7f07a8070410 con 0x7f07a81573c0 2024-04-18T04:45:09.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.284+0000 7f07a4a00640 1 -- 172.21.15.120:0/2859347212 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f078c003530 con 0x7f07a81573c0 2024-04-18T04:45:09.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.284+0000 7f07a4a00640 1 -- 172.21.15.120:0/2859347212 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2317559989 0 0) 0x7f07a81577d0 con 0x7f07a81515e0 2024-04-18T04:45:09.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.284+0000 7f07a4a00640 1 -- 172.21.15.120:0/2859347212 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07a8070410 con 0x7f07a81515e0 2024-04-18T04:45:09.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.284+0000 7f07a4a00640 1 -- 172.21.15.120:0/2859347212 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2704728536 0 0) 0x7f078c003530 con 0x7f07a81573c0 2024-04-18T04:45:09.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.284+0000 7f07a4a00640 1 -- 172.21.15.120:0/2859347212 >> v2:172.21.15.132:3300/0 conn(0x7f07a80ccee0 msgr2=0x7f07a80cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:09.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.284+0000 7f07a4a00640 1 --2- 172.21.15.120:0/2859347212 >> v2:172.21.15.132:3300/0 conn(0x7f07a80ccee0 0x7f07a80cd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:09.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.284+0000 7f07a4a00640 1 -- 172.21.15.120:0/2859347212 >> v1:172.21.15.132:6789/0 conn(0x7f07a81515e0 legacy=0x7f07a80ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:09.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.284+0000 7f07a4a00640 1 -- 172.21.15.120:0/2859347212 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a8157a50 con 0x7f07a81573c0 2024-04-18T04:45:09.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.284+0000 7f07a4a00640 1 -- 172.21.15.120:0/2859347212 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7f0794001600 con 0x7f07a81573c0 2024-04-18T04:45:09.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.284+0000 7f07a4a00640 1 -- 172.21.15.120:0/2859347212 >> v1:172.21.15.120:6789/0 conn(0x7f07a81573c0 legacy=0x7f07a806fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:09.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.284+0000 7f07a4a00640 1 --2- 172.21.15.120:0/2859347212 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f078c003b90 0x7f078c003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:09.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.284+0000 7f07a4a00640 1 --2- 172.21.15.120:0/2859347212 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f078c0047d0 0x7f078c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:09.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.284+0000 7f07a4a00640 1 --2- 172.21.15.120:0/2859347212 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f078c005190 0x7f078c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:09.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.284+0000 7f07a4a00640 1 -- 172.21.15.120:0/2859347212 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078c00bfb0 con 0x7f078c0047d0 2024-04-18T04:45:09.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.284+0000 7f07a4a00640 1 -- 172.21.15.120:0/2859347212 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078c00c120 con 0x7f078c005190 2024-04-18T04:45:09.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.284+0000 7f07a4a00640 1 -- 172.21.15.120:0/2859347212 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f078c00c2e0 con 0x7f078c003b90 2024-04-18T04:45:09.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.288+0000 7f07a5400640 1 --2- 172.21.15.120:0/2859347212 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f078c0047d0 0x7f078c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:09.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.288+0000 7f07a6800640 1 --2- 172.21.15.120:0/2859347212 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f078c005190 0x7f078c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:09.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.288+0000 7f07a5e00640 1 --2- 172.21.15.120:0/2859347212 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f078c003b90 0x7f078c003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:09.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.288+0000 7f07a5400640 1 -- 172.21.15.120:0/2859347212 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f078c003b90 msgr2=0x7f078c003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:09.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.288+0000 7f07a5400640 1 --2- 172.21.15.120:0/2859347212 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f078c003b90 0x7f078c003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:09.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.288+0000 7f07a5400640 1 -- 172.21.15.120:0/2859347212 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f078c005190 msgr2=0x7f078c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:09.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.288+0000 7f07a5400640 1 --2- 172.21.15.120:0/2859347212 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f078c005190 0x7f078c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:09.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.288+0000 7f07a5400640 1 -- 172.21.15.120:0/2859347212 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f078c003530 con 0x7f078c0047d0 2024-04-18T04:45:09.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.288+0000 7f07a6800640 1 -- 172.21.15.120:0/2859347212 reap_dead start 2024-04-18T04:45:09.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.288+0000 7f07a5400640 1 --2- 172.21.15.120:0/2859347212 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f078c0047d0 0x7f078c004c50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0794007f20 tx=0x7f079401f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69a082e2ab617190 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:09.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.288+0000 7f07a4a00640 1 -- 172.21.15.120:0/2859347212 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07940a8dd0 con 0x7f078c0047d0 2024-04-18T04:45:09.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.288+0000 7f07a4a00640 1 -- 172.21.15.120:0/2859347212 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07940058e0 con 0x7f078c0047d0 2024-04-18T04:45:09.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.288+0000 7f07a4a00640 1 -- 172.21.15.120:0/2859347212 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0794005cd0 con 0x7f078c0047d0 2024-04-18T04:45:09.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.292+0000 7f07ace00640 1 -- 172.21.15.120:0/2859347212 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f078c0047d0 msgr2=0x7f078c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:09.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.292+0000 7f07ace00640 1 --2- 172.21.15.120:0/2859347212 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f078c0047d0 0x7f078c004c50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0794007f20 tx=0x7f079401f1b0 comp rx=0 tx=0).stop 2024-04-18T04:45:09.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.292+0000 7f07ace00640 1 -- 172.21.15.120:0/2859347212 shutdown_connections 2024-04-18T04:45:09.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.292+0000 7f07ace00640 1 --2- 172.21.15.120:0/2859347212 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f078c0047d0 0x7f078c004c50 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:09.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.292+0000 7f07ace00640 1 -- 172.21.15.120:0/2859347212 >> 172.21.15.120:0/2859347212 conn(0x7f07a806e0f0 msgr2=0x7f07a8071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:09.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.292+0000 7f07ace00640 1 -- 172.21.15.120:0/2859347212 shutdown_connections 2024-04-18T04:45:09.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.292+0000 7f07ace00640 1 -- 172.21.15.120:0/2859347212 wait complete. 2024-04-18T04:45:09.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.292+0000 7f07ace00640 1 Processor -- start 2024-04-18T04:45:09.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.292+0000 7f07ace00640 1 -- start start 2024-04-18T04:45:09.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.292+0000 7f07ace00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f078c0047d0 0x7f07a80ad880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:09.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.292+0000 7f07ace00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07a8153b90 0x7f07a81ee8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:09.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.292+0000 7f07ace00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07a81eee30 0x7f07a8154e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:09.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.292+0000 7f07ace00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a806cc70 con 0x7f07a8153b90 2024-04-18T04:45:09.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.292+0000 7f07ace00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a8152f20 con 0x7f07a81eee30 2024-04-18T04:45:09.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.292+0000 7f07ace00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a806cea0 con 0x7f078c0047d0 2024-04-18T04:45:09.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.292+0000 7f07a5400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07a8153b90 0x7f07a81ee8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:09.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.292+0000 7f07a5400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07a8153b90 0x7f07a81ee8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34330/0 (socket says 172.21.15.120:34330) 2024-04-18T04:45:09.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.292+0000 7f07a5400640 1 -- 172.21.15.120:0/3891788996 learned_addr learned my addr 172.21.15.120:0/3891788996 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:09.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.292+0000 7f07a5e00640 1 --2- 172.21.15.120:0/3891788996 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f078c0047d0 0x7f07a80ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:09.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.292+0000 7f07a6800640 1 --2- 172.21.15.120:0/3891788996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07a81eee30 0x7f07a8154e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:09.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.292+0000 7f07a5400640 1 -- 172.21.15.120:0/3891788996 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f078c0047d0 msgr2=0x7f07a80ad880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:09.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.292+0000 7f07a5400640 1 --2- 172.21.15.120:0/3891788996 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f078c0047d0 0x7f07a80ad880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:09.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.292+0000 7f07a5400640 1 -- 172.21.15.120:0/3891788996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07a81eee30 msgr2=0x7f07a8154e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:09.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.292+0000 7f07a5400640 1 --2- 172.21.15.120:0/3891788996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07a81eee30 0x7f07a8154e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:09.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.292+0000 7f07a5400640 1 -- 172.21.15.120:0/3891788996 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a81ef370 con 0x7f07a8153b90 2024-04-18T04:45:09.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.292+0000 7f07a5400640 1 --2- 172.21.15.120:0/3891788996 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07a8153b90 0x7f07a81ee8f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f079401efe0 tx=0x7f078c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:09.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.296+0000 7f079e000640 1 -- 172.21.15.120:0/3891788996 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07940b7070 con 0x7f07a8153b90 2024-04-18T04:45:09.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.296+0000 7f079e000640 1 -- 172.21.15.120:0/3891788996 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07940a8d50 con 0x7f07a8153b90 2024-04-18T04:45:09.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.296+0000 7f079e000640 1 -- 172.21.15.120:0/3891788996 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0794005cb0 con 0x7f07a8153b90 2024-04-18T04:45:09.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.296+0000 7f07ace00640 1 -- 172.21.15.120:0/3891788996 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07a8152bb0 con 0x7f07a8153b90 2024-04-18T04:45:09.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.296+0000 7f07ace00640 1 -- 172.21.15.120:0/3891788996 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07a80ae830 con 0x7f07a8153b90 2024-04-18T04:45:09.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.296+0000 7f07ace00640 1 -- 172.21.15.120:0/3891788996 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07a8152a10 con 0x7f07a8153b90 2024-04-18T04:45:09.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.296+0000 7f079e000640 1 -- 172.21.15.120:0/3891788996 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f07940ba070 con 0x7f07a8153b90 2024-04-18T04:45:09.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.296+0000 7f079e000640 1 --2- 172.21.15.120:0/3891788996 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f07880666c0 0x7f0788068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:09.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.296+0000 7f079e000640 1 -- 172.21.15.120:0/3891788996 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0794120a70 con 0x7f07a8153b90 2024-04-18T04:45:09.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.296+0000 7f07a5e00640 1 --2- 172.21.15.120:0/3891788996 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f07880666c0 0x7f0788068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:09.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.300+0000 7f07a5e00640 1 --2- 172.21.15.120:0/3891788996 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f07880666c0 0x7f0788068b80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0798000c10 tx=0x7f0798009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:09.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.300+0000 7f079e000640 1 -- 172.21.15.120:0/3891788996 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f07a8152a10 con 0x7f07a8153b90 2024-04-18T04:45:09.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.488+0000 7f07ace00640 1 -- 172.21.15.120:0/3891788996 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07a8152a10 con 0x7f07a8153b90 2024-04-18T04:45:09.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.488+0000 7f079e000640 1 -- 172.21.15.120:0/3891788996 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6289 (secure 0 0 0) 0x7f07a8152a10 con 0x7f07a8153b90 2024-04-18T04:45:09.488 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:45:09.489 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/1552155328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1552155328},{"type":"v1","addr":"172.21.15.132:6835","nonce":1552155328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:45:08.005139+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.120:6833/2564667113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2564667113},{"type":"v1","addr":"172.21.15.120:6833","nonce":2564667113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:45:09.489 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 15 2024-04-18T04:45:09.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.488+0000 7f07ace00640 1 -- 172.21.15.120:0/3891788996 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f07880666c0 msgr2=0x7f0788068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:09.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.488+0000 7f07ace00640 1 --2- 172.21.15.120:0/3891788996 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f07880666c0 0x7f0788068b80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0798000c10 tx=0x7f0798009040 comp rx=0 tx=0).stop 2024-04-18T04:45:09.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.488+0000 7f07ace00640 1 -- 172.21.15.120:0/3891788996 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07a8153b90 msgr2=0x7f07a81ee8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:09.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.488+0000 7f07ace00640 1 --2- 172.21.15.120:0/3891788996 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07a8153b90 0x7f07a81ee8f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f079401efe0 tx=0x7f078c005800 comp rx=0 tx=0).stop 2024-04-18T04:45:09.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.488+0000 7f07ace00640 1 -- 172.21.15.120:0/3891788996 shutdown_connections 2024-04-18T04:45:09.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.488+0000 7f07ace00640 1 --2- 172.21.15.120:0/3891788996 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f07880666c0 0x7f0788068b80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:09.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.488+0000 7f07ace00640 1 --2- 172.21.15.120:0/3891788996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07a81eee30 0x7f07a8154e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:09.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.488+0000 7f07ace00640 1 --2- 172.21.15.120:0/3891788996 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07a8153b90 0x7f07a81ee8f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:09.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.488+0000 7f07ace00640 1 --2- 172.21.15.120:0/3891788996 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f078c0047d0 0x7f07a80ad880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:09.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.488+0000 7f07ace00640 1 -- 172.21.15.120:0/3891788996 >> 172.21.15.120:0/3891788996 conn(0x7f07a806e0f0 msgr2=0x7f07a8071990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:09.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.488+0000 7f07ace00640 1 -- 172.21.15.120:0/3891788996 shutdown_connections 2024-04-18T04:45:09.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.488+0000 7f07ace00640 1 -- 172.21.15.120:0/3891788996 wait complete. 2024-04-18T04:45:09.509 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T04:45:09.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.644+0000 7ff399200640 1 Processor -- start 2024-04-18T04:45:09.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.644+0000 7ff399200640 1 -- start start 2024-04-18T04:45:09.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.644+0000 7ff399200640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff3940c6100 0x7ff39406a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:09.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.644+0000 7ff399200640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff39415a980 con 0x7ff3940c9610 2024-04-18T04:45:09.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.644+0000 7ff399200640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff39415ad60 con 0x7ff394151810 2024-04-18T04:45:09.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.644+0000 7ff399200640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff39406ab10 con 0x7ff3940c6100 2024-04-18T04:45:09.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.644+0000 7ff392800640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff3940c6100 0x7ff39406a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:09.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.644+0000 7ff389400640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7ff3940c9610 0x7ff394069ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:59344/0 (socket says 172.21.15.120:59344) 2024-04-18T04:45:09.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.644+0000 7ff389400640 1 -- 172.21.15.120:0/2617252011 learned_addr learned my addr 172.21.15.120:0/2617252011 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:45:09.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.644+0000 7ff392800640 1 -- 172.21.15.120:0/2617252011 >> v1:172.21.15.132:6789/0 conn(0x7ff394151810 legacy=0x7ff39415b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:09.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.644+0000 7ff392800640 1 -- 172.21.15.120:0/2617252011 >> v1:172.21.15.120:6789/0 conn(0x7ff3940c9610 legacy=0x7ff394069ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:09.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.644+0000 7ff391400640 1 -- 172.21.15.120:0/2617252011 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3072658210 0 0) 0x7ff39415a980 con 0x7ff3940c9610 2024-04-18T04:45:09.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.644+0000 7ff392800640 1 -- 172.21.15.120:0/2617252011 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3940c8740 con 0x7ff3940c6100 2024-04-18T04:45:09.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.648+0000 7ff392800640 1 --2- 172.21.15.120:0/2617252011 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3940c6100 0x7ff39406a5d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff38c009d90 tx=0x7ff38c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=143150ab92896a70 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:09.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.648+0000 7ff391400640 1 -- 172.21.15.120:0/2617252011 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c0a5a30 con 0x7ff3940c6100 2024-04-18T04:45:09.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.648+0000 7ff391400640 1 -- 172.21.15.120:0/2617252011 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38c0a5b90 con 0x7ff3940c6100 2024-04-18T04:45:09.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.648+0000 7ff391400640 1 -- 172.21.15.120:0/2617252011 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c0ad440 con 0x7ff3940c6100 2024-04-18T04:45:09.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.648+0000 7ff399200640 1 -- 172.21.15.120:0/2617252011 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3940c6100 msgr2=0x7ff39406a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:09.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.648+0000 7ff399200640 1 --2- 172.21.15.120:0/2617252011 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3940c6100 0x7ff39406a5d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff38c009d90 tx=0x7ff38c01c970 comp rx=0 tx=0).stop 2024-04-18T04:45:09.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.648+0000 7ff399200640 1 -- 172.21.15.120:0/2617252011 shutdown_connections 2024-04-18T04:45:09.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.648+0000 7ff399200640 1 --2- 172.21.15.120:0/2617252011 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3940c6100 0x7ff39406a5d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:09.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.648+0000 7ff399200640 1 -- 172.21.15.120:0/2617252011 >> 172.21.15.120:0/2617252011 conn(0x7ff3940c8a40 msgr2=0x7ff3940c8e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:09.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.648+0000 7ff399200640 1 -- 172.21.15.120:0/2617252011 shutdown_connections 2024-04-18T04:45:09.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.648+0000 7ff399200640 1 -- 172.21.15.120:0/2617252011 wait complete. 2024-04-18T04:45:09.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.652+0000 7ff399200640 1 Processor -- start 2024-04-18T04:45:09.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.652+0000 7ff399200640 1 -- start start 2024-04-18T04:45:09.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.652+0000 7ff399200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3940c6100 0x7ff3941f2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:09.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.652+0000 7ff399200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3940c9610 0x7ff39406cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:09.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.652+0000 7ff399200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff394151810 0x7ff39406d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:09.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.652+0000 7ff399200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3940c5230 con 0x7ff3940c6100 2024-04-18T04:45:09.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.652+0000 7ff399200640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff394149950 con 0x7ff3940c9610 2024-04-18T04:45:09.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.652+0000 7ff399200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff394149390 con 0x7ff394151810 2024-04-18T04:45:09.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.652+0000 7ff391e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3940c6100 0x7ff3941f2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:09.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.652+0000 7ff391e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3940c6100 0x7ff3941f2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34354/0 (socket says 172.21.15.120:34354) 2024-04-18T04:45:09.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.652+0000 7ff391e00640 1 -- 172.21.15.120:0/3132704354 learned_addr learned my addr 172.21.15.120:0/3132704354 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:09.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.652+0000 7ff389400640 1 --2- 172.21.15.120:0/3132704354 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3940c9610 0x7ff39406cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:09.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.652+0000 7ff392800640 1 --2- 172.21.15.120:0/3132704354 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff394151810 0x7ff39406d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:09.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.652+0000 7ff391e00640 1 -- 172.21.15.120:0/3132704354 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff394151810 msgr2=0x7ff39406d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:09.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.652+0000 7ff391e00640 1 --2- 172.21.15.120:0/3132704354 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff394151810 0x7ff39406d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:09.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.652+0000 7ff391e00640 1 -- 172.21.15.120:0/3132704354 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3940c9610 msgr2=0x7ff39406cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:09.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.652+0000 7ff391e00640 1 --2- 172.21.15.120:0/3132704354 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3940c9610 0x7ff39406cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:09.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.652+0000 7ff391e00640 1 -- 172.21.15.120:0/3132704354 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff38c009a70 con 0x7ff3940c6100 2024-04-18T04:45:09.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.652+0000 7ff389400640 1 --2- 172.21.15.120:0/3132704354 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3940c9610 0x7ff39406cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:09.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.652+0000 7ff391e00640 1 --2- 172.21.15.120:0/3132704354 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3940c6100 0x7ff3941f2060 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff38400c3c0 tx=0x7ff38400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:09.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.652+0000 7ff38aa00640 1 -- 172.21.15.120:0/3132704354 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3840052d0 con 0x7ff3940c6100 2024-04-18T04:45:09.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.652+0000 7ff38aa00640 1 -- 172.21.15.120:0/3132704354 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff384005430 con 0x7ff3940c6100 2024-04-18T04:45:09.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.652+0000 7ff38aa00640 1 -- 172.21.15.120:0/3132704354 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff384003840 con 0x7ff3940c6100 2024-04-18T04:45:09.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.652+0000 7ff399200640 1 -- 172.21.15.120:0/3132704354 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff394149670 con 0x7ff3940c6100 2024-04-18T04:45:09.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.652+0000 7ff399200640 1 -- 172.21.15.120:0/3132704354 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3940c39f0 con 0x7ff3940c6100 2024-04-18T04:45:09.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.656+0000 7ff399200640 1 -- 172.21.15.120:0/3132704354 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3940c8420 con 0x7ff3940c6100 2024-04-18T04:45:09.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.656+0000 7ff38aa00640 1 -- 172.21.15.120:0/3132704354 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff3840039a0 con 0x7ff3940c6100 2024-04-18T04:45:09.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.656+0000 7ff38aa00640 1 --2- 172.21.15.120:0/3132704354 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff3700666c0 0x7ff370068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:09.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.656+0000 7ff38aa00640 1 -- 172.21.15.120:0/3132704354 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff384083a80 con 0x7ff3940c6100 2024-04-18T04:45:09.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.656+0000 7ff389400640 1 --2- 172.21.15.120:0/3132704354 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff3700666c0 0x7ff370068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:09.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.656+0000 7ff389400640 1 --2- 172.21.15.120:0/3132704354 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff3700666c0 0x7ff370068b80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff37c007fd0 tx=0x7ff37c007c80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:09.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.660+0000 7ff38aa00640 1 -- 172.21.15.120:0/3132704354 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7ff3840509d0 con 0x7ff3940c6100 2024-04-18T04:45:09.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.816+0000 7ff399200640 1 -- 172.21.15.120:0/3132704354 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff394072a70 con 0x7ff3940c6100 2024-04-18T04:45:09.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.816+0000 7ff38aa00640 1 -- 172.21.15.120:0/3132704354 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7ff384017020 con 0x7ff3940c6100 2024-04-18T04:45:09.818 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:45:09.818 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":25,"fsid":"8e73592f-08e2-4957-a98f-9d044cec4ba5","created":"2024-04-18T04:44:06.139983+0000","modified":"2024-04-18T04:44:34.676253+0000","last_up_change":"2024-04-18T04:44:17.410146+0000","last_in_change":"2024-04-18T04:44:08.470250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T04:44:16.864728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T04:44:28.825773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T04:44:29.245857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-18T04:44:32.314302+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a80903bd-d9be-4fb9-af99-6125cb26bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":27468},{"type":"v1","addr":"172.21.15.120:6801","nonce":27468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":27468},{"type":"v1","addr":"172.21.15.120:6803","nonce":27468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":27468},{"type":"v1","addr":"172.21.15.120:6807","nonce":27468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":27468},{"type":"v1","addr":"172.21.15.120:6805","nonce":27468}]},"public_addr":"172.21.15.120:6801/27468","cluster_addr":"172.21.15.120:6803/27468","heartbeat_back_addr":"172.21.15.120:6807/27468","heartbeat_front_addr":"172.21.15.120:6805/27468","state":["exists","up"]},{"osd":1,"uuid":"8f5f004b-6870-4c78-8d50-9622e631ec25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":27470},{"type":"v1","addr":"172.21.15.120:6823","nonce":27470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":27470},{"type":"v1","addr":"172.21.15.120:6827","nonce":27470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":27470},{"type":"v1","addr":"172.21.15.120:6831","nonce":27470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":27470},{"type":"v1","addr":"172.21.15.120:6829","nonce":27470}]},"public_addr":"172.21.15.120:6823/27470","cluster_addr":"172.21.15.120:6827/27470","heartbeat_back_addr":"172.21.15.120:6831/27470","heartbeat_front_addr":"172.21.15.120:6829/27470","state":["exists","up"]},{"osd":2,"uuid":"6e228a2b-6103-4301-a8b5-ee81dbb1f920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":27471},{"type":"v1","addr":"172.21.15.120:6817","nonce":27471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":27471},{"type":"v1","addr":"172.21.15.120:6819","nonce":27471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":27471},{"type":"v1","addr":"172.21.15.120:6826","nonce":27471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":27471},{"type":"v1","addr":"172.21.15.120:6822","nonce":27471}]},"public_addr":"172.21.15.120:6817/27471","cluster_addr":"172.21.15.120:6819/27471","heartbeat_back_addr":"172.21.15.120:6826/27471","heartbeat_front_addr":"172.21.15.120:6822/27471","state":["exists","up"]},{"osd":3,"uuid":"7a5cabd7-d898-4e32-a03c-25b46e790134","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":27469},{"type":"v1","addr":"172.21.15.120:6809","nonce":27469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":27469},{"type":"v1","addr":"172.21.15.120:6811","nonce":27469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":27469},{"type":"v1","addr":"172.21.15.120:6815","nonce":27469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":27469},{"type":"v1","addr":"172.21.15.120:6813","nonce":27469}]},"public_addr":"172.21.15.120:6809/27469","cluster_addr":"172.21.15.120:6811/27469","heartbeat_back_addr":"172.21.15.120:6815/27469","heartbeat_front_addr":"172.21.15.120:6813/27469","state":["exists","up"]},{"osd":4,"uuid":"8e9f530f-6bab-4b23-a1a3-a71362fefcc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":28102},{"type":"v1","addr":"172.21.15.132:6825","nonce":28102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":28102},{"type":"v1","addr":"172.21.15.132:6827","nonce":28102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":28102},{"type":"v1","addr":"172.21.15.132:6831","nonce":28102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":28102},{"type":"v1","addr":"172.21.15.132:6829","nonce":28102}]},"public_addr":"172.21.15.132:6825/28102","cluster_addr":"172.21.15.132:6827/28102","heartbeat_back_addr":"172.21.15.132:6831/28102","heartbeat_front_addr":"172.21.15.132:6829/28102","state":["exists","up"]},{"osd":5,"uuid":"2243fabe-cc81-40cf-91bc-f106fe275a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":28104},{"type":"v1","addr":"172.21.15.132:6809","nonce":28104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":28104},{"type":"v1","addr":"172.21.15.132:6811","nonce":28104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":28104},{"type":"v1","addr":"172.21.15.132:6815","nonce":28104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":28104},{"type":"v1","addr":"172.21.15.132:6813","nonce":28104}]},"public_addr":"172.21.15.132:6809/28104","cluster_addr":"172.21.15.132:6811/28104","heartbeat_back_addr":"172.21.15.132:6815/28104","heartbeat_front_addr":"172.21.15.132:6813/28104","state":["exists","up"]},{"osd":6,"uuid":"c093a5ed-25c8-41a7-a20d-606a1a1661e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":28103},{"type":"v1","addr":"172.21.15.132:6801","nonce":28103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":28103},{"type":"v1","addr":"172.21.15.132:6803","nonce":28103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":28103},{"type":"v1","addr":"172.21.15.132:6807","nonce":28103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":28103},{"type":"v1","addr":"172.21.15.132:6805","nonce":28103}]},"public_addr":"172.21.15.132:6801/28103","cluster_addr":"172.21.15.132:6803/28103","heartbeat_back_addr":"172.21.15.132:6807/28103","heartbeat_front_addr":"172.21.15.132:6805/28103","state":["exists","up"]},{"osd":7,"uuid":"c37426b7-1080-4434-9f3e-a3afbbdc0fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":28129},{"type":"v1","addr":"172.21.15.132:6817","nonce":28129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":28129},{"type":"v1","addr":"172.21.15.132:6819","nonce":28129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":28129},{"type":"v1","addr":"172.21.15.132:6823","nonce":28129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":28129},{"type":"v1","addr":"172.21.15.132:6821","nonce":28129}]},"public_addr":"172.21.15.132:6817/28129","cluster_addr":"172.21.15.132:6819/28129","heartbeat_back_addr":"172.21.15.132:6823/28129","heartbeat_front_addr":"172.21.15.132:6821/28129","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.053825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.289753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.274645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.146361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.943883+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.701955+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.851076+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.800782+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T04:45:09.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.820+0000 7ff399200640 1 -- 172.21.15.120:0/3132704354 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff3700666c0 msgr2=0x7ff370068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:09.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.820+0000 7ff399200640 1 --2- 172.21.15.120:0/3132704354 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff3700666c0 0x7ff370068b80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff37c007fd0 tx=0x7ff37c007c80 comp rx=0 tx=0).stop 2024-04-18T04:45:09.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.820+0000 7ff399200640 1 -- 172.21.15.120:0/3132704354 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3940c6100 msgr2=0x7ff3941f2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:09.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.820+0000 7ff399200640 1 --2- 172.21.15.120:0/3132704354 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3940c6100 0x7ff3941f2060 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff38400c3c0 tx=0x7ff38400c880 comp rx=0 tx=0).stop 2024-04-18T04:45:09.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.820+0000 7ff399200640 1 -- 172.21.15.120:0/3132704354 shutdown_connections 2024-04-18T04:45:09.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.820+0000 7ff399200640 1 --2- 172.21.15.120:0/3132704354 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff3700666c0 0x7ff370068b80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:09.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.820+0000 7ff399200640 1 --2- 172.21.15.120:0/3132704354 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff394151810 0x7ff39406d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:09.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.820+0000 7ff399200640 1 --2- 172.21.15.120:0/3132704354 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3940c9610 0x7ff39406cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:09.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.820+0000 7ff399200640 1 --2- 172.21.15.120:0/3132704354 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3940c6100 0x7ff3941f2060 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:09.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.820+0000 7ff399200640 1 -- 172.21.15.120:0/3132704354 >> 172.21.15.120:0/3132704354 conn(0x7ff3940c8a40 msgr2=0x7ff394159840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:09.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.820+0000 7ff399200640 1 -- 172.21.15.120:0/3132704354 shutdown_connections 2024-04-18T04:45:09.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.820+0000 7ff399200640 1 -- 172.21.15.120:0/3132704354 wait complete. 2024-04-18T04:45:09.839 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:45:09.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.976+0000 7f946b600640 1 Processor -- start 2024-04-18T04:45:09.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.976+0000 7f946b600640 1 -- start start 2024-04-18T04:45:09.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.976+0000 7f946b600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9464156f60 0x7f94640c8280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:09.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.976+0000 7f946b600640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f946406c310 0x7f946406c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:09.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.976+0000 7f946b600640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f946406cce0 con 0x7f94640c68d0 2024-04-18T04:45:09.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.976+0000 7f946b600640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94640c7400 con 0x7f946406c310 2024-04-18T04:45:09.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.976+0000 7f946b600640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f946415a8d0 con 0x7f9464156f60 2024-04-18T04:45:09.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.976+0000 7f9469600640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f946406c310 0x7f946406c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:09.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.976+0000 7f9468c00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9464156f60 0x7f94640c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:09.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.976+0000 7f9468c00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9464156f60 0x7f94640c8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:42480/0 (socket says 172.21.15.120:42480) 2024-04-18T04:45:09.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.976+0000 7f9469600640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f946406c310 0x7f946406c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:60808/0 (socket says 172.21.15.120:60808) 2024-04-18T04:45:09.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.976+0000 7f9468c00640 1 -- 172.21.15.120:0/2935139929 learned_addr learned my addr 172.21.15.120:0/2935139929 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:09.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.976+0000 7f9463e00640 1 --1- 172.21.15.120:0/2935139929 >> v1:172.21.15.132:6789/0 conn(0x7f94640c68d0 0x7f946406d4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:41842/0 (socket says 172.21.15.120:41842) 2024-04-18T04:45:09.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.976+0000 7f9468c00640 1 -- 172.21.15.120:0/2935139929 >> v2:172.21.15.132:3300/0 conn(0x7f946406c310 msgr2=0x7f946406c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:09.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.976+0000 7f9468c00640 1 --2- 172.21.15.120:0/2935139929 >> v2:172.21.15.132:3300/0 conn(0x7f946406c310 0x7f946406c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:09.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.976+0000 7f9468c00640 1 -- 172.21.15.120:0/2935139929 >> v1:172.21.15.132:6789/0 conn(0x7f94640c68d0 legacy=0x7f946406d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:09.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.976+0000 7f9468c00640 1 -- 172.21.15.120:0/2935139929 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9464157340 con 0x7f9464156f60 2024-04-18T04:45:09.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.980+0000 7f9468c00640 1 --2- 172.21.15.120:0/2935139929 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9464156f60 0x7f94640c8280 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f944c009870 tx=0x7f944c01c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6daa882bf72879f server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:09.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.980+0000 7f9463400640 1 -- 172.21.15.120:0/2935139929 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944c0a9620 con 0x7f9464156f60 2024-04-18T04:45:09.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.980+0000 7f9463400640 1 -- 172.21.15.120:0/2935139929 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f944c0a9780 con 0x7f9464156f60 2024-04-18T04:45:09.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.980+0000 7f9463400640 1 -- 172.21.15.120:0/2935139929 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944c0a9b10 con 0x7f9464156f60 2024-04-18T04:45:09.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.980+0000 7f946b600640 1 -- 172.21.15.120:0/2935139929 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9464156f60 msgr2=0x7f94640c8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:09.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.980+0000 7f946b600640 1 --2- 172.21.15.120:0/2935139929 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9464156f60 0x7f94640c8280 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f944c009870 tx=0x7f944c01c560 comp rx=0 tx=0).stop 2024-04-18T04:45:09.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.980+0000 7f946b600640 1 -- 172.21.15.120:0/2935139929 shutdown_connections 2024-04-18T04:45:09.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.980+0000 7f946b600640 1 --2- 172.21.15.120:0/2935139929 >> v2:172.21.15.132:3300/0 conn(0x7f946406c310 0x7f946406c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:09.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.980+0000 7f946b600640 1 --2- 172.21.15.120:0/2935139929 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9464156f60 0x7f94640c8280 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:09.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.980+0000 7f946b600640 1 -- 172.21.15.120:0/2935139929 >> 172.21.15.120:0/2935139929 conn(0x7f94640c89d0 msgr2=0x7f94640c8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:09.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.980+0000 7f946b600640 1 -- 172.21.15.120:0/2935139929 shutdown_connections 2024-04-18T04:45:09.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.980+0000 7f946b600640 1 -- 172.21.15.120:0/2935139929 wait complete. 2024-04-18T04:45:09.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.984+0000 7f946b600640 1 Processor -- start 2024-04-18T04:45:09.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.984+0000 7f946b600640 1 -- start start 2024-04-18T04:45:09.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.984+0000 7f946b600640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f946406c310 0x7f946413a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:09.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.984+0000 7f946b600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94640c68d0 0x7f946414bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:09.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.984+0000 7f946b600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9464156f60 0x7f946414c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:09.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.984+0000 7f946b600640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94641f2870 con 0x7f94640c68d0 2024-04-18T04:45:09.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.984+0000 7f946b600640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94641f1c60 con 0x7f946406c310 2024-04-18T04:45:09.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.984+0000 7f946b600640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94641f1f40 con 0x7f9464156f60 2024-04-18T04:45:09.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.984+0000 7f9463e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94640c68d0 0x7f946414bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:09.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.984+0000 7f9463e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94640c68d0 0x7f946414bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34366/0 (socket says 172.21.15.120:34366) 2024-04-18T04:45:09.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.984+0000 7f9463e00640 1 -- 172.21.15.120:0/3066377744 learned_addr learned my addr 172.21.15.120:0/3066377744 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:09.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.984+0000 7f9468c00640 1 --2- 172.21.15.120:0/3066377744 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f946406c310 0x7f946413a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:09.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.984+0000 7f9469600640 1 --2- 172.21.15.120:0/3066377744 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9464156f60 0x7f946414c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:09.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.984+0000 7f9463e00640 1 -- 172.21.15.120:0/3066377744 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9464156f60 msgr2=0x7f946414c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:09.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.984+0000 7f9463e00640 1 --2- 172.21.15.120:0/3066377744 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9464156f60 0x7f946414c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:09.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.984+0000 7f9463e00640 1 -- 172.21.15.120:0/3066377744 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f946406c310 msgr2=0x7f946413a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:09.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.984+0000 7f9463e00640 1 --2- 172.21.15.120:0/3066377744 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f946406c310 0x7f946413a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:09.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.984+0000 7f9463e00640 1 -- 172.21.15.120:0/3066377744 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f944c0094d0 con 0x7f94640c68d0 2024-04-18T04:45:09.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.984+0000 7f9469600640 1 --2- 172.21.15.120:0/3066377744 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9464156f60 0x7f946414c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:09.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.984+0000 7f9463e00640 1 --2- 172.21.15.120:0/3066377744 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94640c68d0 0x7f946414bea0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f945400c420 tx=0x7f945400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:09.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.984+0000 7f9460c00640 1 -- 172.21.15.120:0/3066377744 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94540074e0 con 0x7f94640c68d0 2024-04-18T04:45:09.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.984+0000 7f9460c00640 1 -- 172.21.15.120:0/3066377744 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9454007640 con 0x7f94640c68d0 2024-04-18T04:45:09.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.984+0000 7f946b600640 1 -- 172.21.15.120:0/3066377744 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94641f2220 con 0x7f94640c68d0 2024-04-18T04:45:09.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.984+0000 7f9460c00640 1 -- 172.21.15.120:0/3066377744 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9454004a30 con 0x7f94640c68d0 2024-04-18T04:45:09.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.984+0000 7f946b600640 1 -- 172.21.15.120:0/3066377744 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94641f1910 con 0x7f94640c68d0 2024-04-18T04:45:09.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.988+0000 7f946b600640 1 -- 172.21.15.120:0/3066377744 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9464067590 con 0x7f94640c68d0 2024-04-18T04:45:09.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.988+0000 7f9460c00640 1 -- 172.21.15.120:0/3066377744 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9454004b90 con 0x7f94640c68d0 2024-04-18T04:45:09.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.988+0000 7f9460c00640 1 --2- 172.21.15.120:0/3066377744 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f94400666c0 0x7f9440068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:09.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.988+0000 7f9460c00640 1 -- 172.21.15.120:0/3066377744 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9454083f50 con 0x7f94640c68d0 2024-04-18T04:45:09.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.988+0000 7f9468c00640 1 --2- 172.21.15.120:0/3066377744 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f94400666c0 0x7f9440068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:09.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.988+0000 7f9468c00640 1 --2- 172.21.15.120:0/3066377744 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f94400666c0 0x7f9440068b80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f944c009870 tx=0x7f944c0a7000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:09.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:09.992+0000 7f9460c00640 1 -- 172.21.15.120:0/3066377744 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f9454050ea0 con 0x7f94640c68d0 2024-04-18T04:45:10.174 INFO:tasks.ceph.mds.e.smithi120.stderr:2024-04-18T04:45:10.172+0000 7fbec2000640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-18T04:45:10.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.180+0000 7f946b600640 1 -- 172.21.15.120:0/3066377744 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f94640cbd40 con 0x7f94640c68d0 2024-04-18T04:45:10.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.180+0000 7f9460c00640 1 -- 172.21.15.120:0/3066377744 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6289 (secure 0 0 0) 0x7f94540544c0 con 0x7f94640c68d0 2024-04-18T04:45:10.181 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:45:10.181 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/1552155328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1552155328},{"type":"v1","addr":"172.21.15.132:6835","nonce":1552155328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:45:08.005139+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.120:6833/2564667113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2564667113},{"type":"v1","addr":"172.21.15.120:6833","nonce":2564667113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:45:10.181 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 15 2024-04-18T04:45:10.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.184+0000 7f946b600640 1 -- 172.21.15.120:0/3066377744 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f94400666c0 msgr2=0x7f9440068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:10.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.184+0000 7f946b600640 1 --2- 172.21.15.120:0/3066377744 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f94400666c0 0x7f9440068b80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f944c009870 tx=0x7f944c0a7000 comp rx=0 tx=0).stop 2024-04-18T04:45:10.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.184+0000 7f946b600640 1 -- 172.21.15.120:0/3066377744 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94640c68d0 msgr2=0x7f946414bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:10.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.184+0000 7f946b600640 1 --2- 172.21.15.120:0/3066377744 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94640c68d0 0x7f946414bea0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f945400c420 tx=0x7f945400c8e0 comp rx=0 tx=0).stop 2024-04-18T04:45:10.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.184+0000 7f946b600640 1 -- 172.21.15.120:0/3066377744 shutdown_connections 2024-04-18T04:45:10.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.184+0000 7f946b600640 1 --2- 172.21.15.120:0/3066377744 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f94400666c0 0x7f9440068b80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:10.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.184+0000 7f946b600640 1 --2- 172.21.15.120:0/3066377744 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9464156f60 0x7f946414c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:10.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.184+0000 7f946b600640 1 --2- 172.21.15.120:0/3066377744 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94640c68d0 0x7f946414bea0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:10.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.184+0000 7f946b600640 1 --2- 172.21.15.120:0/3066377744 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f946406c310 0x7f946413a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:10.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.184+0000 7f946b600640 1 -- 172.21.15.120:0/3066377744 >> 172.21.15.120:0/3066377744 conn(0x7f94640c89d0 msgr2=0x7f94640c9e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:10.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.184+0000 7f946b600640 1 -- 172.21.15.120:0/3066377744 shutdown_connections 2024-04-18T04:45:10.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.184+0000 7f946b600640 1 -- 172.21.15.120:0/3066377744 wait complete. 2024-04-18T04:45:10.805 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-18T04:44:30.251235+0000', 'modified': '2024-04-18T04:45:08.005139+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4288, 'mds_1': 4275, 'mds_2': 4263}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4263': {'gid': 4263, 'name': 'c', 'rank': 2, 'incarnation': 14, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.120:6833/2564667113', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6832', 'nonce': 2564667113}, {'type': 'v1', 'addr': '172.21.15.120:6833', 'nonce': 2564667113}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4275': {'gid': 4275, 'name': 'a', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.120:6836/1079090700', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6834', 'nonce': 1079090700}, {'type': 'v1', 'addr': '172.21.15.120:6836', 'nonce': 1079090700}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4288': {'gid': 4288, 'name': 'e', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.120:6837/76856194', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6835', 'nonce': 76856194}, {'type': 'v1', 'addr': '172.21.15.120:6837', 'nonce': 76856194}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-18T04:45:10.805 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-04-18T04:45:10.806 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-18T04:45:10.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.944+0000 7f9d31200640 1 Processor -- start 2024-04-18T04:45:10.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.944+0000 7f9d31200640 1 -- start start 2024-04-18T04:45:10.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.944+0000 7f9d31200640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9d2c1535e0 0x7f9d2c0c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:10.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.944+0000 7f9d31200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d2c06e6d0 0x7f9d2c15a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:10.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.944+0000 7f9d31200640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d2c06afd0 con 0x7f9d2c0cd1f0 2024-04-18T04:45:10.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.944+0000 7f9d31200640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d2c06c3c0 con 0x7f9d2c1535e0 2024-04-18T04:45:10.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.944+0000 7f9d31200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c06be10 con 0x7f9d2c06e6d0 2024-04-18T04:45:10.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.944+0000 7f9d29400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d2c06e6d0 0x7f9d2c15a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:10.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.944+0000 7f9d29e00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9d2c1535e0 0x7f9d2c0c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:10.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.944+0000 7f9d29400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d2c06e6d0 0x7f9d2c15a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:56118/0 (socket says 172.21.15.120:56118) 2024-04-18T04:45:10.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.944+0000 7f9d29e00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9d2c1535e0 0x7f9d2c0c79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:45792/0 (socket says 172.21.15.120:45792) 2024-04-18T04:45:10.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.944+0000 7f9d29400640 1 -- 172.21.15.120:0/1175362069 learned_addr learned my addr 172.21.15.120:0/1175362069 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:10.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.944+0000 7f9d2a800640 1 --1- 172.21.15.120:0/1175362069 >> v1:172.21.15.132:6789/0 conn(0x7f9d2c0cd1f0 0x7f9d2c0c2570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:47840/0 (socket says 172.21.15.120:47840) 2024-04-18T04:45:10.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.944+0000 7f9d29e00640 1 -- 172.21.15.120:0/1175362069 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d2c06e6d0 msgr2=0x7f9d2c15a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:10.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.944+0000 7f9d29e00640 1 --2- 172.21.15.120:0/1175362069 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d2c06e6d0 0x7f9d2c15a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:10.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.944+0000 7f9d29e00640 1 -- 172.21.15.120:0/1175362069 >> v1:172.21.15.132:6789/0 conn(0x7f9d2c0cd1f0 legacy=0x7f9d2c0c2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:10.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.944+0000 7f9d29e00640 1 -- 172.21.15.120:0/1175362069 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d2c06b200 con 0x7f9d2c1535e0 2024-04-18T04:45:10.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.944+0000 7f9d29400640 1 --2- 172.21.15.120:0/1175362069 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d2c06e6d0 0x7f9d2c15a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:45:10.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.948+0000 7f9d29e00640 1 --2- 172.21.15.120:0/1175362069 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d2c1535e0 0x7f9d2c0c79c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c0097c0 tx=0x7f9d1c01c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17fe247a7c21952c server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:10.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.948+0000 7f9d28a00640 1 -- 172.21.15.120:0/1175362069 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c0ab670 con 0x7f9d2c1535e0 2024-04-18T04:45:10.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.948+0000 7f9d28a00640 1 -- 172.21.15.120:0/1175362069 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1c0ab7d0 con 0x7f9d2c1535e0 2024-04-18T04:45:10.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.948+0000 7f9d28a00640 1 -- 172.21.15.120:0/1175362069 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c0abb60 con 0x7f9d2c1535e0 2024-04-18T04:45:10.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.948+0000 7f9d31200640 1 -- 172.21.15.120:0/1175362069 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d2c1535e0 msgr2=0x7f9d2c0c79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:10.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.948+0000 7f9d31200640 1 --2- 172.21.15.120:0/1175362069 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d2c1535e0 0x7f9d2c0c79c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c0097c0 tx=0x7f9d1c01c470 comp rx=0 tx=0).stop 2024-04-18T04:45:10.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.948+0000 7f9d31200640 1 -- 172.21.15.120:0/1175362069 shutdown_connections 2024-04-18T04:45:10.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.948+0000 7f9d31200640 1 --2- 172.21.15.120:0/1175362069 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d2c06e6d0 0x7f9d2c15a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:10.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.948+0000 7f9d31200640 1 --2- 172.21.15.120:0/1175362069 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d2c1535e0 0x7f9d2c0c79c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:10.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.948+0000 7f9d31200640 1 -- 172.21.15.120:0/1175362069 >> 172.21.15.120:0/1175362069 conn(0x7f9d2c065d90 msgr2=0x7f9d2c0661a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:10.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.948+0000 7f9d31200640 1 -- 172.21.15.120:0/1175362069 shutdown_connections 2024-04-18T04:45:10.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.948+0000 7f9d31200640 1 -- 172.21.15.120:0/1175362069 wait complete. 2024-04-18T04:45:10.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.952+0000 7f9d31200640 1 Processor -- start 2024-04-18T04:45:10.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.952+0000 7f9d31200640 1 -- start start 2024-04-18T04:45:10.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.952+0000 7f9d31200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d2c06e6d0 0x7f9d2c158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:10.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.952+0000 7f9d31200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d2c0cd1f0 0x7f9d2c154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:10.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.952+0000 7f9d31200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d2c1535e0 0x7f9d2c154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:10.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.952+0000 7f9d31200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c1f38b0 con 0x7f9d2c0cd1f0 2024-04-18T04:45:10.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.952+0000 7f9d31200640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c0c6ea0 con 0x7f9d2c1535e0 2024-04-18T04:45:10.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.952+0000 7f9d31200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c1f3330 con 0x7f9d2c06e6d0 2024-04-18T04:45:10.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.952+0000 7f9d29400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d2c0cd1f0 0x7f9d2c154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:10.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.952+0000 7f9d29400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d2c0cd1f0 0x7f9d2c154000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46520/0 (socket says 172.21.15.120:46520) 2024-04-18T04:45:10.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.952+0000 7f9d29400640 1 -- 172.21.15.120:0/3239449115 learned_addr learned my addr 172.21.15.120:0/3239449115 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:10.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.952+0000 7f9d29e00640 1 --2- 172.21.15.120:0/3239449115 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d2c06e6d0 0x7f9d2c158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:10.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.952+0000 7f9d2a800640 1 --2- 172.21.15.120:0/3239449115 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d2c1535e0 0x7f9d2c154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:10.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.952+0000 7f9d29400640 1 -- 172.21.15.120:0/3239449115 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d2c06e6d0 msgr2=0x7f9d2c158710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:10.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.952+0000 7f9d29400640 1 --2- 172.21.15.120:0/3239449115 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d2c06e6d0 0x7f9d2c158710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:10.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.952+0000 7f9d29400640 1 -- 172.21.15.120:0/3239449115 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d2c1535e0 msgr2=0x7f9d2c154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:10.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.952+0000 7f9d29400640 1 --2- 172.21.15.120:0/3239449115 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d2c1535e0 0x7f9d2c154540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:10.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.952+0000 7f9d29400640 1 -- 172.21.15.120:0/3239449115 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d180094d0 con 0x7f9d2c0cd1f0 2024-04-18T04:45:10.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.952+0000 7f9d2a800640 1 --2- 172.21.15.120:0/3239449115 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d2c1535e0 0x7f9d2c154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:10.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.952+0000 7f9d29400640 1 --2- 172.21.15.120:0/3239449115 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d2c0cd1f0 0x7f9d2c154000 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9d1800e9d0 tx=0x7f9d1800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:10.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.952+0000 7f9d22000640 1 -- 172.21.15.120:0/3239449115 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1800ca60 con 0x7f9d2c0cd1f0 2024-04-18T04:45:10.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.952+0000 7f9d22000640 1 -- 172.21.15.120:0/3239449115 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1800cbc0 con 0x7f9d2c0cd1f0 2024-04-18T04:45:10.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.952+0000 7f9d31200640 1 -- 172.21.15.120:0/3239449115 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d1c009420 con 0x7f9d2c0cd1f0 2024-04-18T04:45:10.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.952+0000 7f9d22000640 1 -- 172.21.15.120:0/3239449115 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d18013470 con 0x7f9d2c0cd1f0 2024-04-18T04:45:10.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.952+0000 7f9d31200640 1 -- 172.21.15.120:0/3239449115 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d2c153b40 con 0x7f9d2c0cd1f0 2024-04-18T04:45:10.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.956+0000 7f9d22000640 1 -- 172.21.15.120:0/3239449115 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9d180135d0 con 0x7f9d2c0cd1f0 2024-04-18T04:45:10.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.956+0000 7f9d22000640 1 --2- 172.21.15.120:0/3239449115 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9d0c066690 0x7f9d0c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:10.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.956+0000 7f9d22000640 1 -- 172.21.15.120:0/3239449115 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9d18084b10 con 0x7f9d2c0cd1f0 2024-04-18T04:45:10.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.956+0000 7f9d29e00640 1 --2- 172.21.15.120:0/3239449115 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9d0c066690 0x7f9d0c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:10.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.956+0000 7f9d345b4000 1 Processor -- start 2024-04-18T04:45:10.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.956+0000 7f9d345b4000 1 -- start start 2024-04-18T04:45:10.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.956+0000 7f9d29e00640 1 --2- 172.21.15.120:0/3239449115 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9d0c066690 0x7f9d0c068b50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c0af000 tx=0x7f9d1c0a7000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:10.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.956+0000 7f9d345b4000 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636ecd14af0 0x5636eccde700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:10.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.956+0000 7f9d345b4000 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5636ecd14ed0 0x5636eccdec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:10.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.956+0000 7f9d345b4000 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5636ecd18b30 0x5636ecd18f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:10.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.956+0000 7f9d345b4000 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636ecba0e80 con 0x5636ecd14af0 2024-04-18T04:45:10.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.956+0000 7f9d345b4000 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636ecb2eaf0 con 0x5636ecd14ed0 2024-04-18T04:45:10.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.956+0000 7f9d345b4000 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x5636ecb2c0c0 con 0x5636ecd18b30 2024-04-18T04:45:10.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.960+0000 7f9d29e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636ecd14af0 0x5636eccde700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:10.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.960+0000 7f9d29e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636ecd14af0 0x5636eccde700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46526/0 (socket says 172.21.15.120:46526) 2024-04-18T04:45:10.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.960+0000 7f9d29e00640 1 -- 172.21.15.120:0/3339155867 learned_addr learned my addr 172.21.15.120:0/3339155867 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:10.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.960+0000 7f9d2a800640 1 --2- 172.21.15.120:0/3339155867 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5636ecd18b30 0x5636ecd18f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:10.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.960+0000 7f9d29400640 1 --2- 172.21.15.120:0/3339155867 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5636ecd14ed0 0x5636eccdec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:10.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.960+0000 7f9d29e00640 1 -- 172.21.15.120:0/3339155867 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5636ecd18b30 msgr2=0x5636ecd18f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:10.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.960+0000 7f9d29e00640 1 --2- 172.21.15.120:0/3339155867 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5636ecd18b30 0x5636ecd18f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:10.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.960+0000 7f9d29e00640 1 -- 172.21.15.120:0/3339155867 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5636ecd14ed0 msgr2=0x5636eccdec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:10.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.960+0000 7f9d29e00640 1 --2- 172.21.15.120:0/3339155867 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5636ecd14ed0 0x5636eccdec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:10.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.960+0000 7f9d29e00640 1 -- 172.21.15.120:0/3339155867 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5636ec823890 con 0x5636ecd14af0 2024-04-18T04:45:10.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.960+0000 7f9d2a800640 1 --2- 172.21.15.120:0/3339155867 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5636ecd18b30 0x5636ecd18f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:10.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.960+0000 7f9d29e00640 1 --2- 172.21.15.120:0/3339155867 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636ecd14af0 0x5636eccde700 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c0ad040 tx=0x7f9d1c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=334377075769f68d server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:10.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.960+0000 7f9d16a00640 1 -- 172.21.15.120:0/3339155867 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c0c2790 con 0x5636ecd14af0 2024-04-18T04:45:10.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.960+0000 7f9d16a00640 1 -- 172.21.15.120:0/3339155867 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1c0c6070 con 0x5636ecd14af0 2024-04-18T04:45:10.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.960+0000 7f9d16a00640 1 -- 172.21.15.120:0/3339155867 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c0c2af0 con 0x5636ecd14af0 2024-04-18T04:45:10.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.960+0000 7f9d345b4000 1 -- 172.21.15.120:0/3339155867 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636ecd14af0 msgr2=0x5636eccde700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:10.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.960+0000 7f9d345b4000 1 --2- 172.21.15.120:0/3339155867 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636ecd14af0 0x5636eccde700 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c0ad040 tx=0x7f9d1c004740 comp rx=0 tx=0).stop 2024-04-18T04:45:10.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.960+0000 7f9d345b4000 1 -- 172.21.15.120:0/3339155867 shutdown_connections 2024-04-18T04:45:10.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.960+0000 7f9d345b4000 1 --2- 172.21.15.120:0/3339155867 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5636ecd18b30 0x5636ecd18f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:10.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.960+0000 7f9d345b4000 1 --2- 172.21.15.120:0/3339155867 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5636ecd14ed0 0x5636eccdec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:10.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.960+0000 7f9d345b4000 1 --2- 172.21.15.120:0/3339155867 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636ecd14af0 0x5636eccde700 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:10.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.960+0000 7f9d345b4000 1 -- 172.21.15.120:0/3339155867 >> 172.21.15.120:0/3339155867 conn(0x5636eccdf190 msgr2=0x5636eccdf570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:10.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.960+0000 7f9d345b4000 1 -- 172.21.15.120:0/3339155867 shutdown_connections 2024-04-18T04:45:10.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.960+0000 7f9d345b4000 1 -- 172.21.15.120:0/3339155867 wait complete. 2024-04-18T04:45:10.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.960+0000 7f9d345b4000 1 -- start start 2024-04-18T04:45:10.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.960+0000 7f9d345b4000 1 Processor -- start 2024-04-18T04:45:10.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.960+0000 7f9d345b4000 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5636ecd14af0 0x5636eccdd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:10.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.960+0000 7f9d345b4000 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5636ecd18b30 0x5636eccddc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:10.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.960+0000 7f9d345b4000 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636ecd1f390 0x5636ecd1f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:10.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.960+0000 7f9d345b4000 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636ecb279b0 con 0x5636ecd1f390 2024-04-18T04:45:10.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.960+0000 7f9d345b4000 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636ecac6c00 con 0x5636ecd18b30 2024-04-18T04:45:10.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.960+0000 7f9d345b4000 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x5636ecae5070 con 0x5636ecd14af0 2024-04-18T04:45:10.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.960+0000 7f9d345b4000 10 client.0 _ll_register_callbacks cb 0x5636eccc4ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-18T04:45:10.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.960+0000 7f9d2a800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636ecd1f390 0x5636ecd1f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:10.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.964+0000 7f9d2a800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636ecd1f390 0x5636ecd1f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46528/0 (socket says 172.21.15.120:46528) 2024-04-18T04:45:10.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.964+0000 7f9d2a800640 1 -- 172.21.15.120:0/403549327 learned_addr learned my addr 172.21.15.120:0/403549327 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:10.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.964+0000 7f9d29e00640 1 --2- 172.21.15.120:0/403549327 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5636ecd14af0 0x5636eccdd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:10.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.964+0000 7f9d29400640 1 --2- 172.21.15.120:0/403549327 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5636ecd18b30 0x5636eccddc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:10.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.964+0000 7f9d2a800640 1 -- 172.21.15.120:0/403549327 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5636ecd14af0 msgr2=0x5636eccdd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:10.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.964+0000 7f9d2a800640 1 --2- 172.21.15.120:0/403549327 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5636ecd14af0 0x5636eccdd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:10.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.964+0000 7f9d2a800640 1 -- 172.21.15.120:0/403549327 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5636ecd18b30 msgr2=0x5636eccddc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:10.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.964+0000 7f9d2a800640 1 --2- 172.21.15.120:0/403549327 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5636ecd18b30 0x5636eccddc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:10.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.964+0000 7f9d2a800640 1 -- 172.21.15.120:0/403549327 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d1c0bc070 con 0x5636ecd1f390 2024-04-18T04:45:10.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.964+0000 7f9d2a800640 1 --2- 172.21.15.120:0/403549327 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636ecd1f390 0x5636ecd1f770 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9d240015f0 tx=0x7f9d24001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=404798ac37d36e40 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:10.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.964+0000 7f9d0b400640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-04-18T04:45:10.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.964+0000 7f9d0b400640 1 -- 172.21.15.120:0/403549327 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d24012590 con 0x5636ecd1f390 2024-04-18T04:45:10.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.964+0000 7f9d345b4000 1 -- 172.21.15.120:0/403549327 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5636ecae45f0 con 0x5636ecd1f390 2024-04-18T04:45:10.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.964+0000 7f9d0b400640 1 -- 172.21.15.120:0/403549327 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9d240126f0 con 0x5636ecd1f390 2024-04-18T04:45:10.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.964+0000 7f9d0b400640 1 -- 172.21.15.120:0/403549327 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d240128b0 con 0x5636ecd1f390 2024-04-18T04:45:10.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.964+0000 7f9d345b4000 10 client.4833 fetch_fsmap learned FSMap version 15 2024-04-18T04:45:10.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.964+0000 7f9d345b4000 1 -- 172.21.15.120:0/403549327 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x5636ecaecab0 con 0x5636ecd1f390 2024-04-18T04:45:10.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.964+0000 7f9d0b400640 1 -- 172.21.15.120:0/403549327 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5636ecae45f0 con 0x5636ecd1f390 2024-04-18T04:45:10.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.964+0000 7f9d0b400640 1 -- 172.21.15.120:0/403549327 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 15) v1 ==== 4236+0+0 (secure 0 0 0) 0x7f9d24012a10 con 0x5636ecd1f390 2024-04-18T04:45:10.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.964+0000 7f9d345b4000 10 client.4833 fetch_fsmap finished waiting for FSMap version 15 2024-04-18T04:45:10.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.964+0000 7f9d345b4000 10 client.4833 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-18T04:45:10.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.964+0000 7f9d345b4000 20 client.4833 populate_metadata read hostname 'smithi120' 2024-04-18T04:45:10.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.964+0000 7f9d345b4000 1 --2- 172.21.15.120:0/403549327 >> [v2:172.21.15.120:6832/2564667113,v1:172.21.15.120:6833/2564667113] conn(0x5636ecd20510 0x5636ecd208f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:10.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.964+0000 7f9d345b4000 4 client.4833 mds_command: new command op to 4263 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-18T04:45:10.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.964+0000 7f9d345b4000 1 -- 172.21.15.120:0/403549327 --> [v2:172.21.15.120:6832/2564667113,v1:172.21.15.120:6833/2564667113] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5636ecb24790 con 0x5636ecd20510 2024-04-18T04:45:10.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.964+0000 7f9d29e00640 1 --2- 172.21.15.120:0/403549327 >> [v2:172.21.15.120:6832/2564667113,v1:172.21.15.120:6833/2564667113] conn(0x5636ecd20510 0x5636ecd208f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:10.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.964+0000 7f9d29e00640 1 --2- 172.21.15.120:0/403549327 >> [v2:172.21.15.120:6832/2564667113,v1:172.21.15.120:6833/2564667113] conn(0x5636ecd20510 0x5636ecd208f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c37ebc705d132164 server_cookie=de6dd067fd66eab5 in_seq=0 out_seq=0 2024-04-18T04:45:10.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:10.964+0000 7f9d0b400640 10 client.4833 ms_handle_connect on v2:172.21.15.120:6832/2564667113 2024-04-18T04:45:13.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.012+0000 7f9d0b400640 1 -- 172.21.15.120:0/403549327 <== mds.2 v2:172.21.15.120:6832/2564667113 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5636ecb24790 con 0x5636ecd20510 2024-04-18T04:45:13.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.012+0000 7f9d0b400640 10 client.4833 handle_command_reply: tid=0 2024-04-18T04:45:13.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.012+0000 7f9d29e00640 1 -- 172.21.15.120:0/403549327 >> [v2:172.21.15.120:6832/2564667113,v1:172.21.15.120:6833/2564667113] conn(0x5636ecd20510 msgr2=0x5636ecd208f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 18 2024-04-18T04:45:13.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.012+0000 7f9d29e00640 1 -- 172.21.15.120:0/403549327 >> [v2:172.21.15.120:6832/2564667113,v1:172.21.15.120:6833/2564667113] conn(0x5636ecd20510 msgr2=0x5636ecd208f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T04:45:13.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.012+0000 7f9d29e00640 1 --2- 172.21.15.120:0/403549327 >> [v2:172.21.15.120:6832/2564667113,v1:172.21.15.120:6833/2564667113] conn(0x5636ecd20510 0x5636ecd208f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T04:45:13.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.012+0000 7f9d345b4000 1 client.4833 shutdown 2024-04-18T04:45:13.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.012+0000 7f9d29e00640 1 --2- 172.21.15.120:0/403549327 >> [v2:172.21.15.120:6832/2564667113,v1:172.21.15.120:6833/2564667113] conn(0x5636ecd20510 0x5636ecd208f0 unknown :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-18T04:45:13.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.012+0000 7f9d345b4000 1 -- 172.21.15.120:0/403549327 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636ecd1f390 msgr2=0x5636ecd1f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:13.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.012+0000 7f9d345b4000 1 --2- 172.21.15.120:0/403549327 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636ecd1f390 0x5636ecd1f770 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9d240015f0 tx=0x7f9d24001ab0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.012+0000 7f9d29e00640 1 --2- 172.21.15.120:0/403549327 >> [v2:172.21.15.120:6832/2564667113,v1:172.21.15.120:6833/2564667113] conn(0x5636ecd20510 0x5636ecd208f0 unknown :-1 s=BANNER_CONNECTING pgs=14 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.012+0000 7f9d29e00640 -1 monclient: get_auth_request but no auth handler is set up 2024-04-18T04:45:13.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.012+0000 7f9d29e00640 0 --2- 172.21.15.120:0/403549327 >> [v2:172.21.15.120:6832/2564667113,v1:172.21.15.120:6833/2564667113] conn(0x5636ecd20510 0x5636ecd208f0 unknown :-1 s=AUTH_CONNECTING pgs=14 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -13 2024-04-18T04:45:13.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.012+0000 7f9d29e00640 1 --2- 172.21.15.120:0/403549327 >> [v2:172.21.15.120:6832/2564667113,v1:172.21.15.120:6833/2564667113] conn(0x5636ecd20510 0x5636ecd208f0 unknown :-1 s=AUTH_CONNECTING pgs=14 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.012+0000 7f9d0b400640 0 client.4833 ms_handle_reset on v2:172.21.15.120:6832/2564667113 2024-04-18T04:45:13.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.012+0000 7f9d345b4000 1 -- 172.21.15.120:0/403549327 shutdown_connections 2024-04-18T04:45:13.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.012+0000 7f9d345b4000 1 --2- 172.21.15.120:0/403549327 >> [v2:172.21.15.120:6832/2564667113,v1:172.21.15.120:6833/2564667113] conn(0x5636ecd20510 0x5636ecd208f0 unknown :-1 s=CLOSED pgs=14 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.012+0000 7f9d345b4000 1 --2- 172.21.15.120:0/403549327 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636ecd1f390 0x5636ecd1f770 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.012+0000 7f9d345b4000 1 --2- 172.21.15.120:0/403549327 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5636ecd18b30 0x5636eccddc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.012+0000 7f9d345b4000 1 --2- 172.21.15.120:0/403549327 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5636ecd14af0 0x5636eccdd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.012+0000 7f9d345b4000 1 -- 172.21.15.120:0/403549327 >> 172.21.15.120:0/403549327 conn(0x5636eccdf190 msgr2=0x5636ecd174e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:13.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.012+0000 7f9d345b4000 1 -- 172.21.15.120:0/403549327 shutdown_connections 2024-04-18T04:45:13.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.012+0000 7f9d345b4000 1 -- 172.21.15.120:0/403549327 wait complete. 2024-04-18T04:45:13.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.012+0000 7f9d345b4000 20 client.4833 trim_cache size 0 max 16384 2024-04-18T04:45:13.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.028+0000 7f9d345b4000 1 Processor -- start 2024-04-18T04:45:13.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.032+0000 7f9d345b4000 1 -- start start 2024-04-18T04:45:13.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.032+0000 7f9d345b4000 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5636ecd14af0 0x5636ecd2ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.032+0000 7f9d345b4000 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5636ecd18b30 0x5636ecd2b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.032+0000 7f9d345b4000 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636ecd1f390 0x5636eccd9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.032+0000 7f9d345b4000 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636ec7e4940 con 0x5636ecd1f390 2024-04-18T04:45:13.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.032+0000 7f9d345b4000 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636ecb29fa0 con 0x5636ecd14af0 2024-04-18T04:45:13.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.032+0000 7f9d345b4000 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x5636ecb26840 con 0x5636ecd18b30 2024-04-18T04:45:13.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.032+0000 7f9d2a800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636ecd1f390 0x5636eccd9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.032+0000 7f9d2a800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636ecd1f390 0x5636eccd9ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46544/0 (socket says 172.21.15.120:46544) 2024-04-18T04:45:13.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.032+0000 7f9d2a800640 1 -- 172.21.15.120:0/3159801455 learned_addr learned my addr 172.21.15.120:0/3159801455 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:13.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.032+0000 7f9d29e00640 1 --2- 172.21.15.120:0/3159801455 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5636ecd14af0 0x5636ecd2ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.032+0000 7f9d29400640 1 --2- 172.21.15.120:0/3159801455 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5636ecd18b30 0x5636ecd2b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.032+0000 7f9d2a800640 1 -- 172.21.15.120:0/3159801455 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5636ecd18b30 msgr2=0x5636ecd2b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:13.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.032+0000 7f9d2a800640 1 --2- 172.21.15.120:0/3159801455 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5636ecd18b30 0x5636ecd2b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.032+0000 7f9d2a800640 1 -- 172.21.15.120:0/3159801455 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5636ecd14af0 msgr2=0x5636ecd2ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:13.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.032+0000 7f9d2a800640 1 --2- 172.21.15.120:0/3159801455 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5636ecd14af0 0x5636ecd2ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.032+0000 7f9d2a800640 1 -- 172.21.15.120:0/3159801455 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5636ecad2c00 con 0x5636ecd1f390 2024-04-18T04:45:13.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.032+0000 7f9d29400640 1 --2- 172.21.15.120:0/3159801455 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5636ecd18b30 0x5636ecd2b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:13.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.032+0000 7f9d2a800640 1 --2- 172.21.15.120:0/3159801455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636ecd1f390 0x5636eccd9ee0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9d24001230 tx=0x7f9d24005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a1a8e8aa2a0becc server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:13.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.032+0000 7f9d17400640 1 -- 172.21.15.120:0/3159801455 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d24005cc0 con 0x5636ecd1f390 2024-04-18T04:45:13.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.032+0000 7f9d17400640 1 -- 172.21.15.120:0/3159801455 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d24007720 con 0x5636ecd1f390 2024-04-18T04:45:13.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.032+0000 7f9d17400640 1 -- 172.21.15.120:0/3159801455 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d24012590 con 0x5636ecd1f390 2024-04-18T04:45:13.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.032+0000 7f9d345b4000 1 -- 172.21.15.120:0/3159801455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636ecd1f390 msgr2=0x5636eccd9ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:13.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.032+0000 7f9d345b4000 1 --2- 172.21.15.120:0/3159801455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636ecd1f390 0x5636eccd9ee0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9d24001230 tx=0x7f9d24005f90 comp rx=0 tx=0).stop 2024-04-18T04:45:13.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.036+0000 7f9d345b4000 1 -- 172.21.15.120:0/3159801455 shutdown_connections 2024-04-18T04:45:13.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.036+0000 7f9d345b4000 1 --2- 172.21.15.120:0/3159801455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636ecd1f390 0x5636eccd9ee0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.036+0000 7f9d345b4000 1 --2- 172.21.15.120:0/3159801455 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5636ecd18b30 0x5636ecd2b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.036+0000 7f9d345b4000 1 --2- 172.21.15.120:0/3159801455 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5636ecd14af0 0x5636ecd2ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.036+0000 7f9d345b4000 1 -- 172.21.15.120:0/3159801455 >> 172.21.15.120:0/3159801455 conn(0x5636eccdf190 msgr2=0x5636ecd2a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:13.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.036+0000 7f9d345b4000 1 -- 172.21.15.120:0/3159801455 shutdown_connections 2024-04-18T04:45:13.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.036+0000 7f9d345b4000 1 -- 172.21.15.120:0/3159801455 wait complete. 2024-04-18T04:45:13.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.036+0000 7f9d345b4000 1 -- start start 2024-04-18T04:45:13.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.036+0000 7f9d345b4000 1 Processor -- start 2024-04-18T04:45:13.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.036+0000 7f9d345b4000 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5636ecd14af0 0x5636ecd7d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.036+0000 7f9d345b4000 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5636ecd18b30 0x5636ecd76d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.036+0000 7f9d345b4000 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636ecd1f390 0x5636ecd772d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.036+0000 7f9d345b4000 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636ecb24db0 con 0x5636ecd1f390 2024-04-18T04:45:13.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.036+0000 7f9d345b4000 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636ecb231a0 con 0x5636ecd18b30 2024-04-18T04:45:13.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.036+0000 7f9d345b4000 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x5636ecb251c0 con 0x5636ecd14af0 2024-04-18T04:45:13.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.036+0000 7f9d345b4000 10 client.0 _ll_register_callbacks cb 0x5636ecaf4ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-18T04:45:13.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.036+0000 7f9d2a800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636ecd1f390 0x5636ecd772d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.036+0000 7f9d2a800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636ecd1f390 0x5636ecd772d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46556/0 (socket says 172.21.15.120:46556) 2024-04-18T04:45:13.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.036+0000 7f9d2a800640 1 -- 172.21.15.120:0/404526937 learned_addr learned my addr 172.21.15.120:0/404526937 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:13.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.036+0000 7f9d29e00640 1 --2- 172.21.15.120:0/404526937 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5636ecd14af0 0x5636ecd7d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.036+0000 7f9d29400640 1 --2- 172.21.15.120:0/404526937 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5636ecd18b30 0x5636ecd76d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.036+0000 7f9d2a800640 1 -- 172.21.15.120:0/404526937 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5636ecd14af0 msgr2=0x5636ecd7d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:13.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.036+0000 7f9d2a800640 1 --2- 172.21.15.120:0/404526937 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5636ecd14af0 0x5636ecd7d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.036+0000 7f9d2a800640 1 -- 172.21.15.120:0/404526937 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5636ecd18b30 msgr2=0x5636ecd76d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:13.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.036+0000 7f9d2a800640 1 --2- 172.21.15.120:0/404526937 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5636ecd18b30 0x5636ecd76d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.036+0000 7f9d2a800640 1 -- 172.21.15.120:0/404526937 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5636ecaecab0 con 0x5636ecd1f390 2024-04-18T04:45:13.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.036+0000 7f9d2a800640 1 --2- 172.21.15.120:0/404526937 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636ecd1f390 0x5636ecd772d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9d240015f0 tx=0x7f9d24013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2728b2f12590300 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:13.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.036+0000 7f9d0b400640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-04-18T04:45:13.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.036+0000 7f9d0b400640 1 -- 172.21.15.120:0/404526937 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d24012590 con 0x5636ecd1f390 2024-04-18T04:45:13.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.036+0000 7f9d0b400640 1 -- 172.21.15.120:0/404526937 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9d240126f0 con 0x5636ecd1f390 2024-04-18T04:45:13.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.036+0000 7f9d345b4000 1 -- 172.21.15.120:0/404526937 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5636ecaf7460 con 0x5636ecd1f390 2024-04-18T04:45:13.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.036+0000 7f9d0b400640 1 -- 172.21.15.120:0/404526937 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d24012930 con 0x5636ecd1f390 2024-04-18T04:45:13.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.036+0000 7f9d345b4000 10 client.4839 fetch_fsmap learned FSMap version 15 2024-04-18T04:45:13.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.036+0000 7f9d345b4000 1 -- 172.21.15.120:0/404526937 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x5636ec823cc0 con 0x5636ecd1f390 2024-04-18T04:45:13.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.040+0000 7f9d0b400640 1 -- 172.21.15.120:0/404526937 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5636ecaf7460 con 0x5636ecd1f390 2024-04-18T04:45:13.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.040+0000 7f9d0b400640 1 -- 172.21.15.120:0/404526937 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 15) v1 ==== 4236+0+0 (secure 0 0 0) 0x7f9d24014d20 con 0x5636ecd1f390 2024-04-18T04:45:13.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.040+0000 7f9d345b4000 10 client.4839 fetch_fsmap finished waiting for FSMap version 15 2024-04-18T04:45:13.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.040+0000 7f9d345b4000 10 client.4839 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-18T04:45:13.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.040+0000 7f9d345b4000 20 client.4839 populate_metadata read hostname 'smithi120' 2024-04-18T04:45:13.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.040+0000 7f9d345b4000 1 --2- 172.21.15.120:0/404526937 >> [v2:172.21.15.120:6832/2564667113,v1:172.21.15.120:6833/2564667113] conn(0x5636ecd79d10 0x5636ecd7a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.040+0000 7f9d345b4000 4 client.4839 mds_command: new command op to 4263 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-18T04:45:13.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.040+0000 7f9d345b4000 1 -- 172.21.15.120:0/404526937 --> [v2:172.21.15.120:6832/2564667113,v1:172.21.15.120:6833/2564667113] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5636ecaf09c0 con 0x5636ecd79d10 2024-04-18T04:45:13.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.040+0000 7f9d29e00640 1 --2- 172.21.15.120:0/404526937 >> [v2:172.21.15.120:6832/2564667113,v1:172.21.15.120:6833/2564667113] conn(0x5636ecd79d10 0x5636ecd7a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.040+0000 7f9d29e00640 1 --2- 172.21.15.120:0/404526937 >> [v2:172.21.15.120:6832/2564667113,v1:172.21.15.120:6833/2564667113] conn(0x5636ecd79d10 0x5636ecd7a0f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b4653e5af42f5d89 server_cookie=d91b720dcd4f913c in_seq=0 out_seq=0 2024-04-18T04:45:13.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.040+0000 7f9d0b400640 10 client.4839 ms_handle_connect on v2:172.21.15.120:6832/2564667113 2024-04-18T04:45:13.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.040+0000 7f9d0b400640 1 -- 172.21.15.120:0/404526937 <== mds.2 v2:172.21.15.120:6832/2564667113 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5636ecaf09c0 con 0x5636ecd79d10 2024-04-18T04:45:13.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.040+0000 7f9d0b400640 10 client.4839 handle_command_reply: tid=0 2024-04-18T04:45:13.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.040+0000 7f9d345b4000 1 client.4839 shutdown 2024-04-18T04:45:13.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.040+0000 7f9d345b4000 1 -- 172.21.15.120:0/404526937 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636ecd1f390 msgr2=0x5636ecd772d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:13.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.040+0000 7f9d345b4000 1 --2- 172.21.15.120:0/404526937 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636ecd1f390 0x5636ecd772d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9d240015f0 tx=0x7f9d24013000 comp rx=0 tx=0).stop 2024-04-18T04:45:13.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.040+0000 7f9d345b4000 1 -- 172.21.15.120:0/404526937 shutdown_connections 2024-04-18T04:45:13.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.040+0000 7f9d345b4000 1 --2- 172.21.15.120:0/404526937 >> [v2:172.21.15.120:6832/2564667113,v1:172.21.15.120:6833/2564667113] conn(0x5636ecd79d10 0x5636ecd7a0f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.040+0000 7f9d345b4000 1 --2- 172.21.15.120:0/404526937 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636ecd1f390 0x5636ecd772d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.040+0000 7f9d345b4000 1 --2- 172.21.15.120:0/404526937 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5636ecd18b30 0x5636ecd76d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.040+0000 7f9d0b400640 0 client.4839 ms_handle_reset on v2:172.21.15.120:6832/2564667113 2024-04-18T04:45:13.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.040+0000 7f9d345b4000 1 --2- 172.21.15.120:0/404526937 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5636ecd14af0 0x5636ecd7d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.040+0000 7f9d345b4000 1 -- 172.21.15.120:0/404526937 >> 172.21.15.120:0/404526937 conn(0x5636eccdf190 msgr2=0x5636ecd2ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:13.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.040+0000 7f9d345b4000 1 -- 172.21.15.120:0/404526937 shutdown_connections 2024-04-18T04:45:13.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.040+0000 7f9d345b4000 1 -- 172.21.15.120:0/404526937 wait complete. 2024-04-18T04:45:13.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.040+0000 7f9d345b4000 20 client.4839 trim_cache size 0 max 16384 2024-04-18T04:45:13.044 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-18T04:45:13.044 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_fsid": "8e73592f-08e2-4957-a98f-9d044cec4ba5", 2024-04-18T04:45:13.044 INFO:teuthology.orchestra.run.smithi120.stdout: "whoami": 2, 2024-04-18T04:45:13.044 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4263, 2024-04-18T04:45:13.044 INFO:teuthology.orchestra.run.smithi120.stdout: "want_state": "up:active", 2024-04-18T04:45:13.044 INFO:teuthology.orchestra.run.smithi120.stdout: "state": "up:active", 2024-04-18T04:45:13.045 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs", 2024-04-18T04:45:13.045 INFO:teuthology.orchestra.run.smithi120.stdout: "rank_uptime": 10.06924053, 2024-04-18T04:45:13.045 INFO:teuthology.orchestra.run.smithi120.stdout: "mdsmap_epoch": 15, 2024-04-18T04:45:13.045 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch": 27, 2024-04-18T04:45:13.045 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch_barrier": 25, 2024-04-18T04:45:13.045 INFO:teuthology.orchestra.run.smithi120.stdout: "uptime": 48.875732065999998 2024-04-18T04:45:13.045 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-18T04:45:13.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.040+0000 7f9d31200640 1 -- 172.21.15.120:0/3239449115 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9d0c066690 msgr2=0x7f9d0c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:13.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.040+0000 7f9d31200640 1 --2- 172.21.15.120:0/3239449115 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9d0c066690 0x7f9d0c068b50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c0af000 tx=0x7f9d1c0a7000 comp rx=0 tx=0).stop 2024-04-18T04:45:13.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.040+0000 7f9d31200640 1 -- 172.21.15.120:0/3239449115 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d2c0cd1f0 msgr2=0x7f9d2c154000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:13.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.040+0000 7f9d31200640 1 --2- 172.21.15.120:0/3239449115 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d2c0cd1f0 0x7f9d2c154000 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9d1800e9d0 tx=0x7f9d1800ee90 comp rx=0 tx=0).stop 2024-04-18T04:45:13.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.040+0000 7f9d31200640 1 -- 172.21.15.120:0/3239449115 shutdown_connections 2024-04-18T04:45:13.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.040+0000 7f9d31200640 1 --2- 172.21.15.120:0/3239449115 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9d0c066690 0x7f9d0c068b50 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.040+0000 7f9d31200640 1 --2- 172.21.15.120:0/3239449115 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d2c1535e0 0x7f9d2c154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.040+0000 7f9d31200640 1 --2- 172.21.15.120:0/3239449115 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d2c0cd1f0 0x7f9d2c154000 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.040+0000 7f9d31200640 1 --2- 172.21.15.120:0/3239449115 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d2c06e6d0 0x7f9d2c158710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.040+0000 7f9d31200640 1 -- 172.21.15.120:0/3239449115 >> 172.21.15.120:0/3239449115 conn(0x7f9d2c065d90 msgr2=0x7f9d2c0c2570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:13.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.040+0000 7f9d31200640 1 -- 172.21.15.120:0/3239449115 shutdown_connections 2024-04-18T04:45:13.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.040+0000 7f9d31200640 1 -- 172.21.15.120:0/3239449115 wait complete. 2024-04-18T04:45:13.067 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-18T04:45:13.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.208+0000 7fc00ec00640 1 Processor -- start 2024-04-18T04:45:13.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.208+0000 7fc00ec00640 1 -- start start 2024-04-18T04:45:13.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.208+0000 7fc00ec00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc0081516b0 0x7fc0080b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.208+0000 7fc00ec00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc0080c5c20 0x7fc0080c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.208+0000 7fc00ec00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0080ae000 con 0x7fc0080c7580 2024-04-18T04:45:13.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.208+0000 7fc00ec00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0080c86f0 con 0x7fc0081516b0 2024-04-18T04:45:13.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.208+0000 7fc00ec00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0080ada80 con 0x7fc0080c5c20 2024-04-18T04:45:13.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.208+0000 7fc00ce00640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fc0080c7580 0x7fc008069ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:35284/0 (socket says 172.21.15.120:35284) 2024-04-18T04:45:13.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.208+0000 7fc00ce00640 1 -- 172.21.15.120:0/3763835280 learned_addr learned my addr 172.21.15.120:0/3763835280 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:45:13.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.208+0000 7fc00d800640 1 --2- 172.21.15.120:0/3763835280 >> v2:172.21.15.132:3300/0 conn(0x7fc0081516b0 0x7fc0080b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.208+0000 7fc00e200640 1 --2- 172.21.15.120:0/3763835280 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc0080c5c20 0x7fc0080c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.208+0000 7fc007e00640 1 -- 172.21.15.120:0/3763835280 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 611394692 0 0) 0x7fc0080ae000 con 0x7fc0080c7580 2024-04-18T04:45:13.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.208+0000 7fc007e00640 1 -- 172.21.15.120:0/3763835280 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbff0003530 con 0x7fc0080c7580 2024-04-18T04:45:13.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.208+0000 7fc00d800640 1 -- 172.21.15.120:0/3763835280 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc0080c5c20 msgr2=0x7fc0080c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:13.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.208+0000 7fc00d800640 1 --2- 172.21.15.120:0/3763835280 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc0080c5c20 0x7fc0080c66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.208+0000 7fc00d800640 1 -- 172.21.15.120:0/3763835280 >> v1:172.21.15.120:6789/0 conn(0x7fc0080c7580 legacy=0x7fc008069ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:13.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.208+0000 7fc007e00640 1 -- 172.21.15.120:0/3763835280 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4243875623 0 0) 0x7fbff0003530 con 0x7fc0080c7580 2024-04-18T04:45:13.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.208+0000 7fc00d800640 1 -- 172.21.15.120:0/3763835280 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0080add20 con 0x7fc0081516b0 2024-04-18T04:45:13.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.212+0000 7fc00d800640 1 --2- 172.21.15.120:0/3763835280 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0081516b0 0x7fc0080b03f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbffc009d90 tx=0x7fbffc01c770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1047f665881be6e server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:13.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.212+0000 7fc007e00640 1 -- 172.21.15.120:0/3763835280 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff4001680 con 0x7fc0081516b0 2024-04-18T04:45:13.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.212+0000 7fc007e00640 1 -- 172.21.15.120:0/3763835280 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbffc0a6490 con 0x7fc0081516b0 2024-04-18T04:45:13.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.212+0000 7fc007e00640 1 -- 172.21.15.120:0/3763835280 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc0a6800 con 0x7fc0081516b0 2024-04-18T04:45:13.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.212+0000 7fc00ec00640 1 -- 172.21.15.120:0/3763835280 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0081516b0 msgr2=0x7fc0080b03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:13.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.212+0000 7fc00ec00640 1 --2- 172.21.15.120:0/3763835280 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0081516b0 0x7fc0080b03f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbffc009d90 tx=0x7fbffc01c770 comp rx=0 tx=0).stop 2024-04-18T04:45:13.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.212+0000 7fc00ec00640 1 -- 172.21.15.120:0/3763835280 shutdown_connections 2024-04-18T04:45:13.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.212+0000 7fc00ec00640 1 --2- 172.21.15.120:0/3763835280 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc0080c5c20 0x7fc0080c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.212+0000 7fc00ec00640 1 --2- 172.21.15.120:0/3763835280 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0081516b0 0x7fc0080b03f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.212+0000 7fc00ec00640 1 -- 172.21.15.120:0/3763835280 >> 172.21.15.120:0/3763835280 conn(0x7fc00806c1c0 msgr2=0x7fc00806c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:13.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.212+0000 7fc00ec00640 1 -- 172.21.15.120:0/3763835280 shutdown_connections 2024-04-18T04:45:13.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.212+0000 7fc00ec00640 1 -- 172.21.15.120:0/3763835280 wait complete. 2024-04-18T04:45:13.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.216+0000 7fc00ec00640 1 Processor -- start 2024-04-18T04:45:13.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.216+0000 7fc00ec00640 1 -- start start 2024-04-18T04:45:13.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.216+0000 7fc00ec00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0080c5c20 0x7fc008144650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.216+0000 7fc00ec00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc0080c7580 0x7fc008156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.216+0000 7fc00ec00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc0081516b0 0x7fc008155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.216+0000 7fc00ec00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc008146d00 con 0x7fc0081516b0 2024-04-18T04:45:13.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.216+0000 7fc00ec00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc008071dd0 con 0x7fc0080c5c20 2024-04-18T04:45:13.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.216+0000 7fc00ec00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc008144b90 con 0x7fc0080c7580 2024-04-18T04:45:13.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.216+0000 7fc00e200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc0081516b0 0x7fc008155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.216+0000 7fc00e200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc0081516b0 0x7fc008155110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46564/0 (socket says 172.21.15.120:46564) 2024-04-18T04:45:13.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.216+0000 7fc00e200640 1 -- 172.21.15.120:0/2457141871 learned_addr learned my addr 172.21.15.120:0/2457141871 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:13.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.216+0000 7fc00d800640 1 --2- 172.21.15.120:0/2457141871 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0080c5c20 0x7fc008144650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.216+0000 7fc00ce00640 1 --2- 172.21.15.120:0/2457141871 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc0080c7580 0x7fc008156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.216+0000 7fc00e200640 1 -- 172.21.15.120:0/2457141871 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc0080c7580 msgr2=0x7fc008156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:13.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.216+0000 7fc00e200640 1 --2- 172.21.15.120:0/2457141871 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc0080c7580 0x7fc008156b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.216+0000 7fc00e200640 1 -- 172.21.15.120:0/2457141871 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0080c5c20 msgr2=0x7fc008144650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:13.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.216+0000 7fc00e200640 1 --2- 172.21.15.120:0/2457141871 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0080c5c20 0x7fc008144650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.216+0000 7fc00e200640 1 -- 172.21.15.120:0/2457141871 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbffc009a70 con 0x7fc0081516b0 2024-04-18T04:45:13.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.216+0000 7fc00ce00640 1 --2- 172.21.15.120:0/2457141871 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc0080c7580 0x7fc008156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:13.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.216+0000 7fc00d800640 1 --2- 172.21.15.120:0/2457141871 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0080c5c20 0x7fc008144650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:13.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.216+0000 7fc00e200640 1 --2- 172.21.15.120:0/2457141871 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc0081516b0 0x7fc008155110 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc00000e7f0 tx=0x7fc00000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:13.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.216+0000 7fc005600640 1 -- 172.21.15.120:0/2457141871 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc000009480 con 0x7fc0081516b0 2024-04-18T04:45:13.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.216+0000 7fc005600640 1 -- 172.21.15.120:0/2457141871 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00000c730 con 0x7fc0081516b0 2024-04-18T04:45:13.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.216+0000 7fc00ec00640 1 -- 172.21.15.120:0/2457141871 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc00814db80 con 0x7fc0081516b0 2024-04-18T04:45:13.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.216+0000 7fc005600640 1 -- 172.21.15.120:0/2457141871 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00000cb00 con 0x7fc0081516b0 2024-04-18T04:45:13.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.216+0000 7fc00ec00640 1 -- 172.21.15.120:0/2457141871 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0081f1d60 con 0x7fc0081516b0 2024-04-18T04:45:13.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.220+0000 7fc005600640 1 -- 172.21.15.120:0/2457141871 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc00000cc60 con 0x7fc0081516b0 2024-04-18T04:45:13.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.220+0000 7fc005600640 1 --2- 172.21.15.120:0/2457141871 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fbfe8066690 0x7fbfe8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.220+0000 7fc005600640 1 -- 172.21.15.120:0/2457141871 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc0000845c0 con 0x7fc0081516b0 2024-04-18T04:45:13.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.220+0000 7fc00d800640 1 --2- 172.21.15.120:0/2457141871 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fbfe8066690 0x7fbfe8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.220+0000 7fc0136fd000 1 Processor -- start 2024-04-18T04:45:13.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.220+0000 7fc0136fd000 1 -- start start 2024-04-18T04:45:13.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.224+0000 7fc00d800640 1 --2- 172.21.15.120:0/2457141871 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fbfe8066690 0x7fbfe8068b50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbffc0ae000 tx=0x7fbffc0a7000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:13.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.224+0000 7fc0136fd000 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556a4ba2faf0 0x556a4b9f9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.224+0000 7fc0136fd000 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a4ba2fed0 0x556a4b9f9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.224+0000 7fc0136fd000 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x556a4ba33b30 0x556a4ba33f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.224+0000 7fc0136fd000 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a4b8bbe80 con 0x556a4ba2fed0 2024-04-18T04:45:13.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.224+0000 7fc0136fd000 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a4b849af0 con 0x556a4ba2faf0 2024-04-18T04:45:13.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.224+0000 7fc0136fd000 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x556a4b8470c0 con 0x556a4ba33b30 2024-04-18T04:45:13.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.224+0000 7fc00ce00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a4ba2fed0 0x556a4b9f9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.224+0000 7fc00ce00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a4ba2fed0 0x556a4b9f9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46578/0 (socket says 172.21.15.120:46578) 2024-04-18T04:45:13.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.224+0000 7fc00ce00640 1 -- 172.21.15.120:0/2675045512 learned_addr learned my addr 172.21.15.120:0/2675045512 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:13.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.224+0000 7fc00d800640 1 --2- 172.21.15.120:0/2675045512 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556a4ba2faf0 0x556a4b9f9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.224+0000 7fc00e200640 1 --2- 172.21.15.120:0/2675045512 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x556a4ba33b30 0x556a4ba33f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.224+0000 7fc00ce00640 1 -- 172.21.15.120:0/2675045512 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x556a4ba33b30 msgr2=0x556a4ba33f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:13.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.224+0000 7fc00ce00640 1 --2- 172.21.15.120:0/2675045512 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x556a4ba33b30 0x556a4ba33f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.224+0000 7fc00ce00640 1 -- 172.21.15.120:0/2675045512 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556a4ba2faf0 msgr2=0x556a4b9f9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:13.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.224+0000 7fc00ce00640 1 --2- 172.21.15.120:0/2675045512 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556a4ba2faf0 0x556a4b9f9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.224+0000 7fc00ce00640 1 -- 172.21.15.120:0/2675045512 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a4b53e890 con 0x556a4ba2fed0 2024-04-18T04:45:13.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.224+0000 7fc00e200640 1 --2- 172.21.15.120:0/2675045512 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x556a4ba33b30 0x556a4ba33f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:13.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.224+0000 7fc00ce00640 1 --2- 172.21.15.120:0/2675045512 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a4ba2fed0 0x556a4b9f9c40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbff4001390 tx=0x7fbff4007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f2b8956a9df54e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:13.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.224+0000 7fbffa000640 1 -- 172.21.15.120:0/2675045512 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff4005af0 con 0x556a4ba2fed0 2024-04-18T04:45:13.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.224+0000 7fbffa000640 1 -- 172.21.15.120:0/2675045512 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff4005c50 con 0x556a4ba2fed0 2024-04-18T04:45:13.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.224+0000 7fbffa000640 1 -- 172.21.15.120:0/2675045512 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff40070d0 con 0x556a4ba2fed0 2024-04-18T04:45:13.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.224+0000 7fc0136fd000 1 -- 172.21.15.120:0/2675045512 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a4ba2fed0 msgr2=0x556a4b9f9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:13.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.224+0000 7fc0136fd000 1 --2- 172.21.15.120:0/2675045512 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a4ba2fed0 0x556a4b9f9c40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbff4001390 tx=0x7fbff4007d90 comp rx=0 tx=0).stop 2024-04-18T04:45:13.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.224+0000 7fc0136fd000 1 -- 172.21.15.120:0/2675045512 shutdown_connections 2024-04-18T04:45:13.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.224+0000 7fc0136fd000 1 --2- 172.21.15.120:0/2675045512 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x556a4ba33b30 0x556a4ba33f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.224+0000 7fc0136fd000 1 --2- 172.21.15.120:0/2675045512 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a4ba2fed0 0x556a4b9f9c40 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.224+0000 7fc0136fd000 1 --2- 172.21.15.120:0/2675045512 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556a4ba2faf0 0x556a4b9f9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.224+0000 7fc0136fd000 1 -- 172.21.15.120:0/2675045512 >> 172.21.15.120:0/2675045512 conn(0x556a4b9fa190 msgr2=0x556a4b9fa570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:13.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.224+0000 7fc0136fd000 1 -- 172.21.15.120:0/2675045512 shutdown_connections 2024-04-18T04:45:13.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.224+0000 7fc0136fd000 1 -- 172.21.15.120:0/2675045512 wait complete. 2024-04-18T04:45:13.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.224+0000 7fc0136fd000 1 -- start start 2024-04-18T04:45:13.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.224+0000 7fc0136fd000 1 Processor -- start 2024-04-18T04:45:13.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fc0136fd000 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x556a4ba2faf0 0x556a4b9f8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fc0136fd000 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556a4ba33b30 0x556a4b9f8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fc0136fd000 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a4ba3a390 0x556a4ba3a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fc0136fd000 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a4b8429b0 con 0x556a4ba3a390 2024-04-18T04:45:13.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fc0136fd000 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a4b7e1c00 con 0x556a4ba33b30 2024-04-18T04:45:13.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fc0136fd000 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x556a4b800070 con 0x556a4ba2faf0 2024-04-18T04:45:13.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fc0136fd000 10 client.0 _ll_register_callbacks cb 0x556a4b9dfae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-18T04:45:13.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fc00e200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a4ba3a390 0x556a4ba3a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fc00e200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a4ba3a390 0x556a4ba3a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46594/0 (socket says 172.21.15.120:46594) 2024-04-18T04:45:13.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fc00e200640 1 -- 172.21.15.120:0/1485844731 learned_addr learned my addr 172.21.15.120:0/1485844731 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:13.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fc00d800640 1 --2- 172.21.15.120:0/1485844731 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x556a4ba2faf0 0x556a4b9f8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fc00ce00640 1 --2- 172.21.15.120:0/1485844731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556a4ba33b30 0x556a4b9f8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fc00e200640 1 -- 172.21.15.120:0/1485844731 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x556a4ba2faf0 msgr2=0x556a4b9f8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:13.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fc00e200640 1 --2- 172.21.15.120:0/1485844731 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x556a4ba2faf0 0x556a4b9f8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fc00e200640 1 -- 172.21.15.120:0/1485844731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556a4ba33b30 msgr2=0x556a4b9f8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:13.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fc00e200640 1 --2- 172.21.15.120:0/1485844731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556a4ba33b30 0x556a4b9f8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fc00e200640 1 -- 172.21.15.120:0/1485844731 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff400f040 con 0x556a4ba3a390 2024-04-18T04:45:13.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fc00e200640 1 --2- 172.21.15.120:0/1485844731 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a4ba3a390 0x556a4ba3a770 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc000009fd0 tx=0x7fc000055300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64fd511c51bc75ed server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:13.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fbfeea00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-04-18T04:45:13.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fbfeea00640 1 -- 172.21.15.120:0/1485844731 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc000054730 con 0x556a4ba3a390 2024-04-18T04:45:13.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fbfeea00640 1 -- 172.21.15.120:0/1485844731 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc000054890 con 0x556a4ba3a390 2024-04-18T04:45:13.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fc0136fd000 1 -- 172.21.15.120:0/1485844731 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556a4b7ff5f0 con 0x556a4ba3a390 2024-04-18T04:45:13.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fbfeea00640 1 -- 172.21.15.120:0/1485844731 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc00005d1a0 con 0x556a4ba3a390 2024-04-18T04:45:13.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fc0136fd000 10 client.4851 fetch_fsmap learned FSMap version 15 2024-04-18T04:45:13.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fc0136fd000 1 -- 172.21.15.120:0/1485844731 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x556a4b807ab0 con 0x556a4ba3a390 2024-04-18T04:45:13.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fbfeea00640 1 -- 172.21.15.120:0/1485844731 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556a4b7ff5f0 con 0x556a4ba3a390 2024-04-18T04:45:13.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fbfeea00640 1 -- 172.21.15.120:0/1485844731 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 15) v1 ==== 4236+0+0 (secure 0 0 0) 0x7fc000058070 con 0x556a4ba3a390 2024-04-18T04:45:13.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fc0136fd000 10 client.4851 fetch_fsmap finished waiting for FSMap version 15 2024-04-18T04:45:13.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fc0136fd000 10 client.4851 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-18T04:45:13.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fc0136fd000 20 client.4851 populate_metadata read hostname 'smithi120' 2024-04-18T04:45:13.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fc0136fd000 1 --2- 172.21.15.120:0/1485844731 >> [v2:172.21.15.120:6834/1079090700,v1:172.21.15.120:6836/1079090700] conn(0x556a4ba3b510 0x556a4ba3b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fc0136fd000 4 client.4851 mds_command: new command op to 4275 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-18T04:45:13.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fc0136fd000 1 -- 172.21.15.120:0/1485844731 --> [v2:172.21.15.120:6834/1079090700,v1:172.21.15.120:6836/1079090700] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556a4b83f790 con 0x556a4ba3b510 2024-04-18T04:45:13.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fc00d800640 1 --2- 172.21.15.120:0/1485844731 >> [v2:172.21.15.120:6834/1079090700,v1:172.21.15.120:6836/1079090700] conn(0x556a4ba3b510 0x556a4ba3b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fc00d800640 1 --2- 172.21.15.120:0/1485844731 >> [v2:172.21.15.120:6834/1079090700,v1:172.21.15.120:6836/1079090700] conn(0x556a4ba3b510 0x556a4ba3b8f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ac08851a9695c6d0 server_cookie=86aaedc86518697d in_seq=0 out_seq=0 2024-04-18T04:45:13.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fbfeea00640 10 client.4851 ms_handle_connect on v2:172.21.15.120:6834/1079090700 2024-04-18T04:45:13.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fbfeea00640 1 -- 172.21.15.120:0/1485844731 <== mds.1 v2:172.21.15.120:6834/1079090700 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556a4b83f790 con 0x556a4ba3b510 2024-04-18T04:45:13.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fbfeea00640 10 client.4851 handle_command_reply: tid=0 2024-04-18T04:45:13.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fc0136fd000 1 client.4851 shutdown 2024-04-18T04:45:13.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fc0136fd000 1 -- 172.21.15.120:0/1485844731 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a4ba3a390 msgr2=0x556a4ba3a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:13.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fc0136fd000 1 --2- 172.21.15.120:0/1485844731 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a4ba3a390 0x556a4ba3a770 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc000009fd0 tx=0x7fc000055300 comp rx=0 tx=0).stop 2024-04-18T04:45:13.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fc0136fd000 1 -- 172.21.15.120:0/1485844731 shutdown_connections 2024-04-18T04:45:13.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fc0136fd000 1 --2- 172.21.15.120:0/1485844731 >> [v2:172.21.15.120:6834/1079090700,v1:172.21.15.120:6836/1079090700] conn(0x556a4ba3b510 0x556a4ba3b8f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fc0136fd000 1 --2- 172.21.15.120:0/1485844731 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a4ba3a390 0x556a4ba3a770 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fc0136fd000 1 --2- 172.21.15.120:0/1485844731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556a4ba33b30 0x556a4b9f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fc0136fd000 1 --2- 172.21.15.120:0/1485844731 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x556a4ba2faf0 0x556a4b9f8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fc0136fd000 1 -- 172.21.15.120:0/1485844731 >> 172.21.15.120:0/1485844731 conn(0x556a4b9fa190 msgr2=0x556a4ba324e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:13.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.228+0000 7fbfeea00640 0 client.4851 ms_handle_reset on v2:172.21.15.120:6834/1079090700 2024-04-18T04:45:13.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.232+0000 7fc0136fd000 1 -- 172.21.15.120:0/1485844731 shutdown_connections 2024-04-18T04:45:13.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.232+0000 7fc0136fd000 1 -- 172.21.15.120:0/1485844731 wait complete. 2024-04-18T04:45:13.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.232+0000 7fc0136fd000 20 client.4851 trim_cache size 0 max 16384 2024-04-18T04:45:13.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.244+0000 7fc0136fd000 1 Processor -- start 2024-04-18T04:45:13.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.244+0000 7fc0136fd000 1 -- start start 2024-04-18T04:45:13.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.244+0000 7fc0136fd000 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x556a4b9fa190 0x556a4ba9c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.244+0000 7fc0136fd000 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556a4ba2faf0 0x556a4ba9cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.244+0000 7fc0136fd000 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a4ba33b30 0x556a4ba9d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.244+0000 7fc0136fd000 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a4b4ff940 con 0x556a4ba33b30 2024-04-18T04:45:13.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.244+0000 7fc0136fd000 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a4b83cbb0 con 0x556a4ba2faf0 2024-04-18T04:45:13.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.244+0000 7fc0136fd000 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x556a4b9f8770 con 0x556a4b9fa190 2024-04-18T04:45:13.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.248+0000 7fc00e200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a4ba33b30 0x556a4ba9d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.248+0000 7fc00e200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a4ba33b30 0x556a4ba9d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46596/0 (socket says 172.21.15.120:46596) 2024-04-18T04:45:13.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.248+0000 7fc00e200640 1 -- 172.21.15.120:0/2502710824 learned_addr learned my addr 172.21.15.120:0/2502710824 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:13.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.248+0000 7fc00d800640 1 --2- 172.21.15.120:0/2502710824 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x556a4b9fa190 0x556a4ba9c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.248+0000 7fc00ce00640 1 --2- 172.21.15.120:0/2502710824 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556a4ba2faf0 0x556a4ba9cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.248+0000 7fc00e200640 1 -- 172.21.15.120:0/2502710824 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x556a4b9fa190 msgr2=0x556a4ba9c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:13.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.248+0000 7fc00e200640 1 --2- 172.21.15.120:0/2502710824 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x556a4b9fa190 0x556a4ba9c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.248+0000 7fc00e200640 1 -- 172.21.15.120:0/2502710824 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556a4ba2faf0 msgr2=0x556a4ba9cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:13.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.248+0000 7fc00e200640 1 --2- 172.21.15.120:0/2502710824 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556a4ba2faf0 0x556a4ba9cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.248+0000 7fc00e200640 1 -- 172.21.15.120:0/2502710824 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a4b7edc00 con 0x556a4ba33b30 2024-04-18T04:45:13.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.248+0000 7fc00e200640 1 --2- 172.21.15.120:0/2502710824 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a4ba33b30 0x556a4ba9d130 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc0000515d0 tx=0x7fc000084000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f07f6582b5cf0fa server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:13.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.248+0000 7fbffaa00640 1 -- 172.21.15.120:0/2502710824 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc000059070 con 0x556a4ba33b30 2024-04-18T04:45:13.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.248+0000 7fbffaa00640 1 -- 172.21.15.120:0/2502710824 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc000054ba0 con 0x556a4ba33b30 2024-04-18T04:45:13.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.248+0000 7fbffaa00640 1 -- 172.21.15.120:0/2502710824 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc000055010 con 0x556a4ba33b30 2024-04-18T04:45:13.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.248+0000 7fc0136fd000 1 -- 172.21.15.120:0/2502710824 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a4ba33b30 msgr2=0x556a4ba9d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:13.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.248+0000 7fc0136fd000 1 --2- 172.21.15.120:0/2502710824 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a4ba33b30 0x556a4ba9d130 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc0000515d0 tx=0x7fc000084000 comp rx=0 tx=0).stop 2024-04-18T04:45:13.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.248+0000 7fc0136fd000 1 -- 172.21.15.120:0/2502710824 shutdown_connections 2024-04-18T04:45:13.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.248+0000 7fc0136fd000 1 --2- 172.21.15.120:0/2502710824 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a4ba33b30 0x556a4ba9d130 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.248+0000 7fc0136fd000 1 --2- 172.21.15.120:0/2502710824 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556a4ba2faf0 0x556a4ba9cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.248+0000 7fc0136fd000 1 --2- 172.21.15.120:0/2502710824 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x556a4b9fa190 0x556a4ba9c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.248+0000 7fc0136fd000 1 -- 172.21.15.120:0/2502710824 >> 172.21.15.120:0/2502710824 conn(0x556a4b9f88d0 msgr2=0x556a4b9f4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:13.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.248+0000 7fc0136fd000 1 -- 172.21.15.120:0/2502710824 shutdown_connections 2024-04-18T04:45:13.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.248+0000 7fc0136fd000 1 -- 172.21.15.120:0/2502710824 wait complete. 2024-04-18T04:45:13.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.248+0000 7fc0136fd000 1 -- start start 2024-04-18T04:45:13.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.248+0000 7fc0136fd000 1 Processor -- start 2024-04-18T04:45:13.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.248+0000 7fc0136fd000 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x556a4b9fa190 0x556a4baa0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.248+0000 7fc0136fd000 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556a4ba2faf0 0x556a4ba9e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.248+0000 7fc0136fd000 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a4ba33b30 0x556a4ba9eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.248+0000 7fc0136fd000 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a4b843260 con 0x556a4ba33b30 2024-04-18T04:45:13.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.248+0000 7fc0136fd000 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a4b804650 con 0x556a4ba2faf0 2024-04-18T04:45:13.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.248+0000 7fc0136fd000 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x556a4b779450 con 0x556a4b9fa190 2024-04-18T04:45:13.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.248+0000 7fc0136fd000 10 client.0 _ll_register_callbacks cb 0x556a4b80fff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-18T04:45:13.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.248+0000 7fc00e200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a4ba33b30 0x556a4ba9eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.248+0000 7fc00e200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a4ba33b30 0x556a4ba9eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46604/0 (socket says 172.21.15.120:46604) 2024-04-18T04:45:13.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.248+0000 7fc00e200640 1 -- 172.21.15.120:0/4286130766 learned_addr learned my addr 172.21.15.120:0/4286130766 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:13.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.248+0000 7fc00d800640 1 --2- 172.21.15.120:0/4286130766 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x556a4b9fa190 0x556a4baa0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.248+0000 7fc00ce00640 1 --2- 172.21.15.120:0/4286130766 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556a4ba2faf0 0x556a4ba9e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.248+0000 7fc00e200640 1 -- 172.21.15.120:0/4286130766 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x556a4b9fa190 msgr2=0x556a4baa0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:13.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.248+0000 7fc00e200640 1 --2- 172.21.15.120:0/4286130766 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x556a4b9fa190 0x556a4baa0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.248+0000 7fc00e200640 1 -- 172.21.15.120:0/4286130766 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556a4ba2faf0 msgr2=0x556a4ba9e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:13.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.248+0000 7fc00e200640 1 --2- 172.21.15.120:0/4286130766 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556a4ba2faf0 0x556a4ba9e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.248+0000 7fc00e200640 1 -- 172.21.15.120:0/4286130766 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556a4b807ab0 con 0x556a4ba33b30 2024-04-18T04:45:13.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.248+0000 7fc00d800640 1 --2- 172.21.15.120:0/4286130766 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x556a4b9fa190 0x556a4baa0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:13.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fc00e200640 1 --2- 172.21.15.120:0/4286130766 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a4ba33b30 0x556a4ba9eb80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc000054f40 tx=0x7fc000082690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=151a0ebbef12cda4 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:13.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fbfeea00640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-04-18T04:45:13.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fbfeea00640 1 -- 172.21.15.120:0/4286130766 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc000054940 con 0x556a4ba33b30 2024-04-18T04:45:13.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fc0136fd000 1 -- 172.21.15.120:0/4286130766 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556a4ba4f1f0 con 0x556a4ba33b30 2024-04-18T04:45:13.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fbfeea00640 1 -- 172.21.15.120:0/4286130766 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc0000822a0 con 0x556a4ba33b30 2024-04-18T04:45:13.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fbfeea00640 1 -- 172.21.15.120:0/4286130766 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc000082460 con 0x556a4ba33b30 2024-04-18T04:45:13.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fc0136fd000 10 client.4857 fetch_fsmap learned FSMap version 15 2024-04-18T04:45:13.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fc0136fd000 1 -- 172.21.15.120:0/4286130766 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x556a4b53ecc0 con 0x556a4ba33b30 2024-04-18T04:45:13.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fbfeea00640 1 -- 172.21.15.120:0/4286130766 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556a4ba4f1f0 con 0x556a4ba33b30 2024-04-18T04:45:13.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fbfeea00640 1 -- 172.21.15.120:0/4286130766 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 15) v1 ==== 4236+0+0 (secure 0 0 0) 0x7fc000079060 con 0x556a4ba33b30 2024-04-18T04:45:13.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fc0136fd000 10 client.4857 fetch_fsmap finished waiting for FSMap version 15 2024-04-18T04:45:13.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fc0136fd000 10 client.4857 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-18T04:45:13.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fc0136fd000 20 client.4857 populate_metadata read hostname 'smithi120' 2024-04-18T04:45:13.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fc0136fd000 1 --2- 172.21.15.120:0/4286130766 >> [v2:172.21.15.120:6834/1079090700,v1:172.21.15.120:6836/1079090700] conn(0x556a4ba3a390 0x556a4ba9a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fc0136fd000 4 client.4857 mds_command: new command op to 4275 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-18T04:45:13.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fc0136fd000 1 -- 172.21.15.120:0/4286130766 --> [v2:172.21.15.120:6834/1079090700,v1:172.21.15.120:6836/1079090700] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556a4b812460 con 0x556a4ba3a390 2024-04-18T04:45:13.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fc00d800640 1 --2- 172.21.15.120:0/4286130766 >> [v2:172.21.15.120:6834/1079090700,v1:172.21.15.120:6836/1079090700] conn(0x556a4ba3a390 0x556a4ba9a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fc00d800640 1 --2- 172.21.15.120:0/4286130766 >> [v2:172.21.15.120:6834/1079090700,v1:172.21.15.120:6836/1079090700] conn(0x556a4ba3a390 0x556a4ba9a030 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e7741528ce6596c1 server_cookie=70e23c0f66230704 in_seq=0 out_seq=0 2024-04-18T04:45:13.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fbfeea00640 10 client.4857 ms_handle_connect on v2:172.21.15.120:6834/1079090700 2024-04-18T04:45:13.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fbfeea00640 1 -- 172.21.15.120:0/4286130766 <== mds.1 v2:172.21.15.120:6834/1079090700 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x556a4b812460 con 0x556a4ba3a390 2024-04-18T04:45:13.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fbfeea00640 10 client.4857 handle_command_reply: tid=0 2024-04-18T04:45:13.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fc0136fd000 1 client.4857 shutdown 2024-04-18T04:45:13.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fc0136fd000 1 -- 172.21.15.120:0/4286130766 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a4ba33b30 msgr2=0x556a4ba9eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:13.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fc0136fd000 1 --2- 172.21.15.120:0/4286130766 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a4ba33b30 0x556a4ba9eb80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc000054f40 tx=0x7fc000082690 comp rx=0 tx=0).stop 2024-04-18T04:45:13.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fc0136fd000 1 -- 172.21.15.120:0/4286130766 shutdown_connections 2024-04-18T04:45:13.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fc0136fd000 1 --2- 172.21.15.120:0/4286130766 >> [v2:172.21.15.120:6834/1079090700,v1:172.21.15.120:6836/1079090700] conn(0x556a4ba3a390 0x556a4ba9a030 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fc0136fd000 1 --2- 172.21.15.120:0/4286130766 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556a4ba33b30 0x556a4ba9eb80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fc0136fd000 1 --2- 172.21.15.120:0/4286130766 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556a4ba2faf0 0x556a4ba9e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fc0136fd000 1 --2- 172.21.15.120:0/4286130766 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x556a4b9fa190 0x556a4baa0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fbfeea00640 0 client.4857 ms_handle_reset on v2:172.21.15.120:6834/1079090700 2024-04-18T04:45:13.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fc0136fd000 1 -- 172.21.15.120:0/4286130766 >> 172.21.15.120:0/4286130766 conn(0x556a4b9f88d0 msgr2=0x556a4b9f7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:13.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fc0136fd000 1 -- 172.21.15.120:0/4286130766 shutdown_connections 2024-04-18T04:45:13.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fc0136fd000 1 -- 172.21.15.120:0/4286130766 wait complete. 2024-04-18T04:45:13.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fc0136fd000 20 client.4857 trim_cache size 0 max 16384 2024-04-18T04:45:13.260 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-18T04:45:13.260 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_fsid": "8e73592f-08e2-4957-a98f-9d044cec4ba5", 2024-04-18T04:45:13.260 INFO:teuthology.orchestra.run.smithi120.stdout: "whoami": 1, 2024-04-18T04:45:13.260 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4275, 2024-04-18T04:45:13.260 INFO:teuthology.orchestra.run.smithi120.stdout: "want_state": "up:active", 2024-04-18T04:45:13.260 INFO:teuthology.orchestra.run.smithi120.stdout: "state": "up:active", 2024-04-18T04:45:13.260 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs", 2024-04-18T04:45:13.260 INFO:teuthology.orchestra.run.smithi120.stdout: "rank_uptime": 16.330133283999999, 2024-04-18T04:45:13.260 INFO:teuthology.orchestra.run.smithi120.stdout: "mdsmap_epoch": 15, 2024-04-18T04:45:13.260 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch": 27, 2024-04-18T04:45:13.260 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch_barrier": 25, 2024-04-18T04:45:13.261 INFO:teuthology.orchestra.run.smithi120.stdout: "uptime": 49.072299876999999 2024-04-18T04:45:13.261 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-18T04:45:13.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fc00ec00640 1 -- 172.21.15.120:0/2457141871 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fbfe8066690 msgr2=0x7fbfe8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:13.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fc00ec00640 1 --2- 172.21.15.120:0/2457141871 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fbfe8066690 0x7fbfe8068b50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbffc0ae000 tx=0x7fbffc0a7000 comp rx=0 tx=0).stop 2024-04-18T04:45:13.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fc00ec00640 1 -- 172.21.15.120:0/2457141871 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc0081516b0 msgr2=0x7fc008155110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:13.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fc00ec00640 1 --2- 172.21.15.120:0/2457141871 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc0081516b0 0x7fc008155110 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc00000e7f0 tx=0x7fc00000ecb0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fc00ec00640 1 -- 172.21.15.120:0/2457141871 shutdown_connections 2024-04-18T04:45:13.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fc00ec00640 1 --2- 172.21.15.120:0/2457141871 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fbfe8066690 0x7fbfe8068b50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fc00ec00640 1 --2- 172.21.15.120:0/2457141871 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc0081516b0 0x7fc008155110 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fc00ec00640 1 --2- 172.21.15.120:0/2457141871 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc0080c7580 0x7fc008156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fc00ec00640 1 --2- 172.21.15.120:0/2457141871 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0080c5c20 0x7fc008144650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fc00ec00640 1 -- 172.21.15.120:0/2457141871 >> 172.21.15.120:0/2457141871 conn(0x7fc00806c1c0 msgr2=0x7fc008069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:13.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fc00ec00640 1 -- 172.21.15.120:0/2457141871 shutdown_connections 2024-04-18T04:45:13.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.252+0000 7fc00ec00640 1 -- 172.21.15.120:0/2457141871 wait complete. 2024-04-18T04:45:13.273 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-04-18T04:45:13.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.408+0000 7f0e1c800640 1 Processor -- start 2024-04-18T04:45:13.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.408+0000 7f0e1c800640 1 -- start start 2024-04-18T04:45:13.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.408+0000 7f0e1c800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0e14153900 0x7f0e140c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.408+0000 7f0e1c800640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0e140c6000 0x7f0e140c8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.408+0000 7f0e1c800640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e14070390 con 0x7f0e140c85d0 2024-04-18T04:45:13.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.408+0000 7f0e1c800640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e14153ce0 con 0x7f0e140c6000 2024-04-18T04:45:13.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.408+0000 7f0e1c800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e141595a0 con 0x7f0e14153900 2024-04-18T04:45:13.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.408+0000 7f0e19400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0e140c6000 0x7f0e140c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.408+0000 7f0e19400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0e140c6000 0x7f0e140c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46610/0 (socket says 172.21.15.120:46610) 2024-04-18T04:45:13.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.408+0000 7f0e19400640 1 -- 172.21.15.120:0/2958717145 learned_addr learned my addr 172.21.15.120:0/2958717145 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:13.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.412+0000 7f0e19e00640 1 --2- 172.21.15.120:0/2958717145 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0e14153900 0x7f0e140c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.412+0000 7f0e19400640 1 -- 172.21.15.120:0/2958717145 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0e14153900 msgr2=0x7f0e140c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:13.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.412+0000 7f0e19400640 1 --2- 172.21.15.120:0/2958717145 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0e14153900 0x7f0e140c6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.412+0000 7f0e19400640 1 -- 172.21.15.120:0/2958717145 >> v1:172.21.15.132:6789/0 conn(0x7f0e140c85d0 legacy=0x7f0e14159aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:13.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.412+0000 7f0e19400640 1 -- 172.21.15.120:0/2958717145 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e14070ae0 con 0x7f0e140c6000 2024-04-18T04:45:13.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.412+0000 7f0e19400640 1 --2- 172.21.15.120:0/2958717145 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e140c6000 0x7f0e140c8090 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0e04009870 tx=0x7f0e0401ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6201a60c2c73d03e server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:13.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.412+0000 7f0e18a00640 1 -- 172.21.15.120:0/2958717145 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e040a8a50 con 0x7f0e140c6000 2024-04-18T04:45:13.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.412+0000 7f0e18a00640 1 -- 172.21.15.120:0/2958717145 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e040a8bb0 con 0x7f0e140c6000 2024-04-18T04:45:13.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.412+0000 7f0e18a00640 1 -- 172.21.15.120:0/2958717145 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e040b0440 con 0x7f0e140c6000 2024-04-18T04:45:13.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.416+0000 7f0e1c800640 1 -- 172.21.15.120:0/2958717145 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e140c6000 msgr2=0x7f0e140c8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:13.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.416+0000 7f0e1c800640 1 --2- 172.21.15.120:0/2958717145 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e140c6000 0x7f0e140c8090 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0e04009870 tx=0x7f0e0401ed50 comp rx=0 tx=0).stop 2024-04-18T04:45:13.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.416+0000 7f0e1c800640 1 -- 172.21.15.120:0/2958717145 shutdown_connections 2024-04-18T04:45:13.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.416+0000 7f0e1c800640 1 --2- 172.21.15.120:0/2958717145 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e140c6000 0x7f0e140c8090 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.416+0000 7f0e1c800640 1 --2- 172.21.15.120:0/2958717145 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0e14153900 0x7f0e140c6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.416+0000 7f0e1c800640 1 -- 172.21.15.120:0/2958717145 >> 172.21.15.120:0/2958717145 conn(0x7f0e14069ec0 msgr2=0x7f0e1406a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:13.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.416+0000 7f0e1c800640 1 -- 172.21.15.120:0/2958717145 shutdown_connections 2024-04-18T04:45:13.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.416+0000 7f0e1c800640 1 -- 172.21.15.120:0/2958717145 wait complete. 2024-04-18T04:45:13.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.416+0000 7f0e1c800640 1 Processor -- start 2024-04-18T04:45:13.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.416+0000 7f0e1c800640 1 -- start start 2024-04-18T04:45:13.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.416+0000 7f0e1c800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0e140c6000 0x7f0e14156140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.416+0000 7f0e1c800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e140c85d0 0x7f0e14156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.416+0000 7f0e1c800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e14153900 0x7f0e14154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.416+0000 7f0e1c800640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1415d3f0 con 0x7f0e140c85d0 2024-04-18T04:45:13.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.416+0000 7f0e1c800640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e141ef460 con 0x7f0e14153900 2024-04-18T04:45:13.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.416+0000 7f0e1c800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e14153eb0 con 0x7f0e140c6000 2024-04-18T04:45:13.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.416+0000 7f0e19400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e140c85d0 0x7f0e14156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.416+0000 7f0e19400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e140c85d0 0x7f0e14156680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46618/0 (socket says 172.21.15.120:46618) 2024-04-18T04:45:13.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.416+0000 7f0e19400640 1 -- 172.21.15.120:0/783569275 learned_addr learned my addr 172.21.15.120:0/783569275 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:13.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.416+0000 7f0e19e00640 1 --2- 172.21.15.120:0/783569275 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0e140c6000 0x7f0e14156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.416+0000 7f0e1a800640 1 --2- 172.21.15.120:0/783569275 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e14153900 0x7f0e14154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.416+0000 7f0e19400640 1 -- 172.21.15.120:0/783569275 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0e140c6000 msgr2=0x7f0e14156140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:13.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.416+0000 7f0e19400640 1 --2- 172.21.15.120:0/783569275 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0e140c6000 0x7f0e14156140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.416+0000 7f0e19400640 1 -- 172.21.15.120:0/783569275 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e14153900 msgr2=0x7f0e14154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:13.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.416+0000 7f0e19400640 1 --2- 172.21.15.120:0/783569275 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e14153900 0x7f0e14154e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.416+0000 7f0e19400640 1 -- 172.21.15.120:0/783569275 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e040094d0 con 0x7f0e140c85d0 2024-04-18T04:45:13.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.416+0000 7f0e19400640 1 --2- 172.21.15.120:0/783569275 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e140c85d0 0x7f0e14156680 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0e040b3040 tx=0x7f0e0401baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:13.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.420+0000 7f0e0e000640 1 -- 172.21.15.120:0/783569275 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e040b0dd0 con 0x7f0e140c85d0 2024-04-18T04:45:13.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.420+0000 7f0e0e000640 1 -- 172.21.15.120:0/783569275 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e040bb460 con 0x7f0e140c85d0 2024-04-18T04:45:13.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.420+0000 7f0e0e000640 1 -- 172.21.15.120:0/783569275 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e040bb810 con 0x7f0e140c85d0 2024-04-18T04:45:13.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.420+0000 7f0e1c800640 1 -- 172.21.15.120:0/783569275 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e1414f0d0 con 0x7f0e140c85d0 2024-04-18T04:45:13.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.420+0000 7f0e1c800640 1 -- 172.21.15.120:0/783569275 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e141540c0 con 0x7f0e140c85d0 2024-04-18T04:45:13.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.420+0000 7f0e0e000640 1 -- 172.21.15.120:0/783569275 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0e040b83f0 con 0x7f0e140c85d0 2024-04-18T04:45:13.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.420+0000 7f0e0e000640 1 --2- 172.21.15.120:0/783569275 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0df80666c0 0x7f0df8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.420+0000 7f0e0e000640 1 -- 172.21.15.120:0/783569275 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0e04121e60 con 0x7f0e140c85d0 2024-04-18T04:45:13.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.420+0000 7f0e19e00640 1 --2- 172.21.15.120:0/783569275 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0df80666c0 0x7f0df8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.420+0000 7f0e1fcf3000 1 Processor -- start 2024-04-18T04:45:13.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.420+0000 7f0e1fcf3000 1 -- start start 2024-04-18T04:45:13.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.424+0000 7f0e19e00640 1 --2- 172.21.15.120:0/783569275 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0df80666c0 0x7f0df8068b80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0e08009a50 tx=0x7f0e08008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:13.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.424+0000 7f0e1fcf3000 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4f679faf0 0x55a4f6769700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.424+0000 7f0e1fcf3000 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4f679fed0 0x55a4f6769c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.424+0000 7f0e1fcf3000 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55a4f67a3b30 0x55a4f67a3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.424+0000 7f0e1fcf3000 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4f662be80 con 0x55a4f679fed0 2024-04-18T04:45:13.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.424+0000 7f0e1fcf3000 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4f65b9af0 con 0x55a4f679faf0 2024-04-18T04:45:13.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.424+0000 7f0e1fcf3000 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a4f65b70c0 con 0x55a4f67a3b30 2024-04-18T04:45:13.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.424+0000 7f0e19400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4f679fed0 0x55a4f6769c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.424+0000 7f0e19400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4f679fed0 0x55a4f6769c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46624/0 (socket says 172.21.15.120:46624) 2024-04-18T04:45:13.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.424+0000 7f0e19400640 1 -- 172.21.15.120:0/4006549272 learned_addr learned my addr 172.21.15.120:0/4006549272 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:13.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.424+0000 7f0e19e00640 1 --2- 172.21.15.120:0/4006549272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4f679faf0 0x55a4f6769700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.424+0000 7f0e1a800640 1 --2- 172.21.15.120:0/4006549272 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55a4f67a3b30 0x55a4f67a3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.424+0000 7f0e19400640 1 -- 172.21.15.120:0/4006549272 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55a4f67a3b30 msgr2=0x55a4f67a3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:13.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.424+0000 7f0e19400640 1 --2- 172.21.15.120:0/4006549272 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55a4f67a3b30 0x55a4f67a3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.424+0000 7f0e19400640 1 -- 172.21.15.120:0/4006549272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4f679faf0 msgr2=0x55a4f6769700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:13.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.424+0000 7f0e19400640 1 --2- 172.21.15.120:0/4006549272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4f679faf0 0x55a4f6769700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.424+0000 7f0e19400640 1 -- 172.21.15.120:0/4006549272 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a4f62ae890 con 0x55a4f679fed0 2024-04-18T04:45:13.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.424+0000 7f0e19400640 1 --2- 172.21.15.120:0/4006549272 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4f679fed0 0x55a4f6769c40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0e0401c980 tx=0x7f0e040f2930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c48f5d802e4f71a server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:13.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.424+0000 7f0e02a00640 1 -- 172.21.15.120:0/4006549272 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e040f2a30 con 0x55a4f679fed0 2024-04-18T04:45:13.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.424+0000 7f0e02a00640 1 -- 172.21.15.120:0/4006549272 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e040f6860 con 0x55a4f679fed0 2024-04-18T04:45:13.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.424+0000 7f0e02a00640 1 -- 172.21.15.120:0/4006549272 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e040fae20 con 0x55a4f679fed0 2024-04-18T04:45:13.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.424+0000 7f0e1fcf3000 1 -- 172.21.15.120:0/4006549272 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4f679fed0 msgr2=0x55a4f6769c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:13.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.424+0000 7f0e1fcf3000 1 --2- 172.21.15.120:0/4006549272 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4f679fed0 0x55a4f6769c40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0e0401c980 tx=0x7f0e040f2930 comp rx=0 tx=0).stop 2024-04-18T04:45:13.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.424+0000 7f0e1fcf3000 1 -- 172.21.15.120:0/4006549272 shutdown_connections 2024-04-18T04:45:13.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.424+0000 7f0e1fcf3000 1 --2- 172.21.15.120:0/4006549272 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55a4f67a3b30 0x55a4f67a3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.424+0000 7f0e1fcf3000 1 --2- 172.21.15.120:0/4006549272 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4f679fed0 0x55a4f6769c40 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.424+0000 7f0e1fcf3000 1 --2- 172.21.15.120:0/4006549272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4f679faf0 0x55a4f6769700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.424+0000 7f0e1fcf3000 1 -- 172.21.15.120:0/4006549272 >> 172.21.15.120:0/4006549272 conn(0x55a4f676a190 msgr2=0x55a4f676a570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:13.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.424+0000 7f0e1fcf3000 1 -- 172.21.15.120:0/4006549272 shutdown_connections 2024-04-18T04:45:13.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.424+0000 7f0e1fcf3000 1 -- 172.21.15.120:0/4006549272 wait complete. 2024-04-18T04:45:13.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.424+0000 7f0e1fcf3000 1 -- start start 2024-04-18T04:45:13.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.424+0000 7f0e1fcf3000 1 Processor -- start 2024-04-18T04:45:13.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.424+0000 7f0e1fcf3000 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4f679faf0 0x55a4f679e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.424+0000 7f0e1fcf3000 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55a4f67a3b30 0x55a4f679ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.424+0000 7f0e1fcf3000 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4f67aa390 0x55a4f67aa770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.424+0000 7f0e1fcf3000 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4f65b29b0 con 0x55a4f67aa390 2024-04-18T04:45:13.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.424+0000 7f0e1fcf3000 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4f6551c00 con 0x55a4f679faf0 2024-04-18T04:45:13.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.424+0000 7f0e1fcf3000 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a4f6570070 con 0x55a4f67a3b30 2024-04-18T04:45:13.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.424+0000 7f0e1fcf3000 10 client.0 _ll_register_callbacks cb 0x55a4f674fae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-18T04:45:13.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0e1a800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4f67aa390 0x55a4f67aa770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0e1a800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4f67aa390 0x55a4f67aa770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46628/0 (socket says 172.21.15.120:46628) 2024-04-18T04:45:13.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0e19400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55a4f67a3b30 0x55a4f679ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0e1a800640 1 -- 172.21.15.120:0/3660460914 learned_addr learned my addr 172.21.15.120:0/3660460914 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:13.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0e19e00640 1 --2- 172.21.15.120:0/3660460914 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4f679faf0 0x55a4f679e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0e1a800640 1 -- 172.21.15.120:0/3660460914 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55a4f67a3b30 msgr2=0x55a4f679ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:13.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0e1a800640 1 --2- 172.21.15.120:0/3660460914 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55a4f67a3b30 0x55a4f679ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0e1a800640 1 -- 172.21.15.120:0/3660460914 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4f679faf0 msgr2=0x55a4f679e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:13.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0e1a800640 1 --2- 172.21.15.120:0/3660460914 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4f679faf0 0x55a4f679e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0e1a800640 1 -- 172.21.15.120:0/3660460914 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e141540c0 con 0x55a4f67aa390 2024-04-18T04:45:13.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0e1a800640 1 --2- 172.21.15.120:0/3660460914 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4f67aa390 0x55a4f67aa770 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0e100059b0 tx=0x7f0e100019e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f3d077d427acb11 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:13.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0df7400640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-04-18T04:45:13.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0df7400640 1 -- 172.21.15.120:0/3660460914 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e100124d0 con 0x55a4f67aa390 2024-04-18T04:45:13.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0e1fcf3000 1 -- 172.21.15.120:0/3660460914 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a4f656f5f0 con 0x55a4f67aa390 2024-04-18T04:45:13.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0df7400640 1 -- 172.21.15.120:0/3660460914 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0e10012630 con 0x55a4f67aa390 2024-04-18T04:45:13.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0df7400640 1 -- 172.21.15.120:0/3660460914 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e10003de0 con 0x55a4f67aa390 2024-04-18T04:45:13.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0e1fcf3000 10 client.4869 fetch_fsmap learned FSMap version 15 2024-04-18T04:45:13.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0e1fcf3000 1 -- 172.21.15.120:0/3660460914 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55a4f6577ab0 con 0x55a4f67aa390 2024-04-18T04:45:13.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0df7400640 1 -- 172.21.15.120:0/3660460914 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a4f656f5f0 con 0x55a4f67aa390 2024-04-18T04:45:13.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0df7400640 1 -- 172.21.15.120:0/3660460914 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 15) v1 ==== 4236+0+0 (secure 0 0 0) 0x7f0e100127f0 con 0x55a4f67aa390 2024-04-18T04:45:13.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0e1fcf3000 10 client.4869 fetch_fsmap finished waiting for FSMap version 15 2024-04-18T04:45:13.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0e1fcf3000 10 client.4869 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-18T04:45:13.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0e1fcf3000 20 client.4869 populate_metadata read hostname 'smithi120' 2024-04-18T04:45:13.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0e1fcf3000 1 --2- 172.21.15.120:0/3660460914 >> [v2:172.21.15.120:6835/76856194,v1:172.21.15.120:6837/76856194] conn(0x55a4f67ab4e0 0x55a4f67ab8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0e1fcf3000 4 client.4869 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-18T04:45:13.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0e1fcf3000 1 -- 172.21.15.120:0/3660460914 --> [v2:172.21.15.120:6835/76856194,v1:172.21.15.120:6837/76856194] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a4f65af790 con 0x55a4f67ab4e0 2024-04-18T04:45:13.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0e19e00640 1 --2- 172.21.15.120:0/3660460914 >> [v2:172.21.15.120:6835/76856194,v1:172.21.15.120:6837/76856194] conn(0x55a4f67ab4e0 0x55a4f67ab8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0e19e00640 1 --2- 172.21.15.120:0/3660460914 >> [v2:172.21.15.120:6835/76856194,v1:172.21.15.120:6837/76856194] conn(0x55a4f67ab4e0 0x55a4f67ab8c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d12fea547cc660fd server_cookie=95cd55a96032e4b3 in_seq=0 out_seq=0 2024-04-18T04:45:13.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0df7400640 10 client.4869 ms_handle_connect on v2:172.21.15.120:6835/76856194 2024-04-18T04:45:13.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0df7400640 1 -- 172.21.15.120:0/3660460914 <== mds.0 v2:172.21.15.120:6835/76856194 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a4f65af790 con 0x55a4f67ab4e0 2024-04-18T04:45:13.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0df7400640 10 client.4869 handle_command_reply: tid=0 2024-04-18T04:45:13.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0e1fcf3000 1 client.4869 shutdown 2024-04-18T04:45:13.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0e1fcf3000 1 -- 172.21.15.120:0/3660460914 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4f67aa390 msgr2=0x55a4f67aa770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:13.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0e1fcf3000 1 --2- 172.21.15.120:0/3660460914 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4f67aa390 0x55a4f67aa770 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0e100059b0 tx=0x7f0e100019e0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0e1fcf3000 1 -- 172.21.15.120:0/3660460914 shutdown_connections 2024-04-18T04:45:13.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0e1fcf3000 1 --2- 172.21.15.120:0/3660460914 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4f67aa390 0x55a4f67aa770 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0e1fcf3000 1 --2- 172.21.15.120:0/3660460914 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55a4f67a3b30 0x55a4f679ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0e1fcf3000 1 --2- 172.21.15.120:0/3660460914 >> [v2:172.21.15.120:6835/76856194,v1:172.21.15.120:6837/76856194] conn(0x55a4f67ab4e0 0x55a4f67ab8c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0e1fcf3000 1 --2- 172.21.15.120:0/3660460914 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4f679faf0 0x55a4f679e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0e1fcf3000 1 -- 172.21.15.120:0/3660460914 >> 172.21.15.120:0/3660460914 conn(0x55a4f676a190 msgr2=0x55a4f67a24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:13.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0df7400640 0 client.4869 ms_handle_reset on v2:172.21.15.120:6835/76856194 2024-04-18T04:45:13.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0e1fcf3000 1 -- 172.21.15.120:0/3660460914 shutdown_connections 2024-04-18T04:45:13.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0e1fcf3000 1 -- 172.21.15.120:0/3660460914 wait complete. 2024-04-18T04:45:13.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.428+0000 7f0e1fcf3000 20 client.4869 trim_cache size 0 max 16384 2024-04-18T04:45:13.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.444+0000 7f0e1fcf3000 1 Processor -- start 2024-04-18T04:45:13.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.444+0000 7f0e1fcf3000 1 -- start start 2024-04-18T04:45:13.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.444+0000 7f0e1fcf3000 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4f676a190 0x55a4f679d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.444+0000 7f0e1fcf3000 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4f679faf0 0x55a4f679d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.444+0000 7f0e1fcf3000 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55a4f67a3b30 0x55a4f67a6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.444+0000 7f0e1fcf3000 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4f6769c40 con 0x55a4f679faf0 2024-04-18T04:45:13.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.444+0000 7f0e1fcf3000 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4f626f940 con 0x55a4f676a190 2024-04-18T04:45:13.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.444+0000 7f0e1fcf3000 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a4f65b5510 con 0x55a4f67a3b30 2024-04-18T04:45:13.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.444+0000 7f0e19400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4f679faf0 0x55a4f679d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.444+0000 7f0e19400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4f679faf0 0x55a4f679d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46644/0 (socket says 172.21.15.120:46644) 2024-04-18T04:45:13.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.444+0000 7f0e19400640 1 -- 172.21.15.120:0/4233154085 learned_addr learned my addr 172.21.15.120:0/4233154085 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:13.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.444+0000 7f0e19e00640 1 --2- 172.21.15.120:0/4233154085 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4f676a190 0x55a4f679d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.444+0000 7f0e1a800640 1 --2- 172.21.15.120:0/4233154085 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55a4f67a3b30 0x55a4f67a6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.444+0000 7f0e19400640 1 -- 172.21.15.120:0/4233154085 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55a4f67a3b30 msgr2=0x55a4f67a6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:13.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.444+0000 7f0e19400640 1 --2- 172.21.15.120:0/4233154085 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55a4f67a3b30 0x55a4f67a6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.444+0000 7f0e19400640 1 -- 172.21.15.120:0/4233154085 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4f676a190 msgr2=0x55a4f679d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:13.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.444+0000 7f0e19400640 1 --2- 172.21.15.120:0/4233154085 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4f676a190 0x55a4f679d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.444+0000 7f0e19400640 1 -- 172.21.15.120:0/4233154085 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a4f655dc00 con 0x55a4f679faf0 2024-04-18T04:45:13.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.444+0000 7f0e19e00640 1 --2- 172.21.15.120:0/4233154085 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4f676a190 0x55a4f679d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:45:13.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.448+0000 7f0e19400640 1 --2- 172.21.15.120:0/4233154085 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4f679faf0 0x55a4f679d660 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0e0401c980 tx=0x7f0e040bd000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8afb0f0c2547d792 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:13.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.448+0000 7f0e03400640 1 -- 172.21.15.120:0/4233154085 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0411d070 con 0x55a4f679faf0 2024-04-18T04:45:13.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.448+0000 7f0e03400640 1 -- 172.21.15.120:0/4233154085 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e040f68e0 con 0x55a4f679faf0 2024-04-18T04:45:13.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.448+0000 7f0e03400640 1 -- 172.21.15.120:0/4233154085 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e040f2a30 con 0x55a4f679faf0 2024-04-18T04:45:13.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.448+0000 7f0e1fcf3000 1 -- 172.21.15.120:0/4233154085 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4f679faf0 msgr2=0x55a4f679d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:13.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.448+0000 7f0e1fcf3000 1 --2- 172.21.15.120:0/4233154085 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4f679faf0 0x55a4f679d660 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0e0401c980 tx=0x7f0e040bd000 comp rx=0 tx=0).stop 2024-04-18T04:45:13.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.448+0000 7f0e1fcf3000 1 -- 172.21.15.120:0/4233154085 shutdown_connections 2024-04-18T04:45:13.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.448+0000 7f0e1fcf3000 1 --2- 172.21.15.120:0/4233154085 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55a4f67a3b30 0x55a4f67a6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.448+0000 7f0e1fcf3000 1 --2- 172.21.15.120:0/4233154085 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4f679faf0 0x55a4f679d660 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.448+0000 7f0e1fcf3000 1 --2- 172.21.15.120:0/4233154085 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4f676a190 0x55a4f679d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.448+0000 7f0e1fcf3000 1 -- 172.21.15.120:0/4233154085 >> 172.21.15.120:0/4233154085 conn(0x55a4f6761fb0 msgr2=0x55a4f67a2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:13.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.448+0000 7f0e1fcf3000 1 -- 172.21.15.120:0/4233154085 shutdown_connections 2024-04-18T04:45:13.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.448+0000 7f0e1fcf3000 1 -- 172.21.15.120:0/4233154085 wait complete. 2024-04-18T04:45:13.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.448+0000 7f0e1fcf3000 1 -- start start 2024-04-18T04:45:13.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.448+0000 7f0e1fcf3000 1 Processor -- start 2024-04-18T04:45:13.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.448+0000 7f0e1fcf3000 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4f676a190 0x55a4f67a9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.448+0000 7f0e1fcf3000 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4f679faf0 0x55a4f6808470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.448+0000 7f0e1fcf3000 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55a4f67a3b30 0x55a4f68089b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.448+0000 7f0e1fcf3000 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4f656bf80 con 0x55a4f679faf0 2024-04-18T04:45:13.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.448+0000 7f0e1fcf3000 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4f65b69b0 con 0x55a4f676a190 2024-04-18T04:45:13.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.448+0000 7f0e1fcf3000 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a4f65ae1a0 con 0x55a4f67a3b30 2024-04-18T04:45:13.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.448+0000 7f0e1fcf3000 10 client.0 _ll_register_callbacks cb 0x55a4f657fff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-18T04:45:13.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.448+0000 7f0e19400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4f679faf0 0x55a4f6808470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.448+0000 7f0e19400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4f679faf0 0x55a4f6808470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46658/0 (socket says 172.21.15.120:46658) 2024-04-18T04:45:13.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.448+0000 7f0e19400640 1 -- 172.21.15.120:0/1733421427 learned_addr learned my addr 172.21.15.120:0/1733421427 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:13.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.448+0000 7f0e19e00640 1 --2- 172.21.15.120:0/1733421427 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4f676a190 0x55a4f67a9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.448+0000 7f0e19400640 1 -- 172.21.15.120:0/1733421427 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55a4f67a3b30 msgr2=0x55a4f68089b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-18T04:45:13.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.448+0000 7f0e19400640 1 --2- 172.21.15.120:0/1733421427 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55a4f67a3b30 0x55a4f68089b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.448+0000 7f0e19400640 1 -- 172.21.15.120:0/1733421427 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4f676a190 msgr2=0x55a4f67a9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:13.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.448+0000 7f0e19400640 1 --2- 172.21.15.120:0/1733421427 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4f676a190 0x55a4f67a9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.448+0000 7f0e19400640 1 -- 172.21.15.120:0/1733421427 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a4f62ae890 con 0x55a4f679faf0 2024-04-18T04:45:13.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.448+0000 7f0e19400640 1 --2- 172.21.15.120:0/1733421427 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4f679faf0 0x55a4f6808470 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0e0401d400 tx=0x7f0e04000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49c253b6c303e882 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:13.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.448+0000 7f0df7400640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-04-18T04:45:13.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.448+0000 7f0df7400640 1 -- 172.21.15.120:0/1733421427 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0411d030 con 0x55a4f679faf0 2024-04-18T04:45:13.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.448+0000 7f0df7400640 1 -- 172.21.15.120:0/1733421427 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0e0411e070 con 0x55a4f679faf0 2024-04-18T04:45:13.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.448+0000 7f0e1fcf3000 1 -- 172.21.15.120:0/1733421427 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a4f679f980 con 0x55a4f679faf0 2024-04-18T04:45:13.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.452+0000 7f0df7400640 1 -- 172.21.15.120:0/1733421427 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e040faea0 con 0x55a4f679faf0 2024-04-18T04:45:13.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.452+0000 7f0e1fcf3000 10 client.4875 fetch_fsmap learned FSMap version 15 2024-04-18T04:45:13.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.452+0000 7f0e1fcf3000 1 -- 172.21.15.120:0/1733421427 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55a4f62aecc0 con 0x55a4f679faf0 2024-04-18T04:45:13.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.452+0000 7f0df7400640 1 -- 172.21.15.120:0/1733421427 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a4f679f980 con 0x55a4f679faf0 2024-04-18T04:45:13.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.452+0000 7f0df7400640 1 -- 172.21.15.120:0/1733421427 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 15) v1 ==== 4236+0+0 (secure 0 0 0) 0x7f0e040b7070 con 0x55a4f679faf0 2024-04-18T04:45:13.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.452+0000 7f0e1fcf3000 10 client.4875 fetch_fsmap finished waiting for FSMap version 15 2024-04-18T04:45:13.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.452+0000 7f0e1fcf3000 10 client.4875 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-18T04:45:13.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.452+0000 7f0e1fcf3000 20 client.4875 populate_metadata read hostname 'smithi120' 2024-04-18T04:45:13.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.452+0000 7f0e1fcf3000 1 --2- 172.21.15.120:0/1733421427 >> [v2:172.21.15.120:6835/76856194,v1:172.21.15.120:6837/76856194] conn(0x55a4f67aa390 0x55a4f6801dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:13.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.452+0000 7f0e1fcf3000 4 client.4875 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-18T04:45:13.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.452+0000 7f0e1fcf3000 1 -- 172.21.15.120:0/1733421427 --> [v2:172.21.15.120:6835/76856194,v1:172.21.15.120:6837/76856194] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a4f6582460 con 0x55a4f67aa390 2024-04-18T04:45:13.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.452+0000 7f0e19e00640 1 --2- 172.21.15.120:0/1733421427 >> [v2:172.21.15.120:6835/76856194,v1:172.21.15.120:6837/76856194] conn(0x55a4f67aa390 0x55a4f6801dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:13.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.452+0000 7f0df7400640 10 client.4875 ms_handle_connect on v2:172.21.15.120:6835/76856194 2024-04-18T04:45:13.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.452+0000 7f0e19e00640 1 --2- 172.21.15.120:0/1733421427 >> [v2:172.21.15.120:6835/76856194,v1:172.21.15.120:6837/76856194] conn(0x55a4f67aa390 0x55a4f6801dd0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b71c649875b1e699 server_cookie=4079d1bff98ce896 in_seq=0 out_seq=0 2024-04-18T04:45:13.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.452+0000 7f0df7400640 1 -- 172.21.15.120:0/1733421427 <== mds.0 v2:172.21.15.120:6835/76856194 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55a4f6582460 con 0x55a4f67aa390 2024-04-18T04:45:13.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.452+0000 7f0df7400640 10 client.4875 handle_command_reply: tid=0 2024-04-18T04:45:13.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.452+0000 7f0e1fcf3000 1 client.4875 shutdown 2024-04-18T04:45:13.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.452+0000 7f0e1fcf3000 1 -- 172.21.15.120:0/1733421427 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4f679faf0 msgr2=0x55a4f6808470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:13.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.452+0000 7f0e1fcf3000 1 --2- 172.21.15.120:0/1733421427 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4f679faf0 0x55a4f6808470 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0e0401d400 tx=0x7f0e04000bd0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.452+0000 7f0e1fcf3000 1 -- 172.21.15.120:0/1733421427 shutdown_connections 2024-04-18T04:45:13.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.452+0000 7f0e1fcf3000 1 --2- 172.21.15.120:0/1733421427 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55a4f67a3b30 0x55a4f68089b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.452+0000 7f0e1fcf3000 1 --2- 172.21.15.120:0/1733421427 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4f679faf0 0x55a4f6808470 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.452+0000 7f0e1fcf3000 1 --2- 172.21.15.120:0/1733421427 >> [v2:172.21.15.120:6835/76856194,v1:172.21.15.120:6837/76856194] conn(0x55a4f67aa390 0x55a4f6801dd0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.452+0000 7f0e1fcf3000 1 --2- 172.21.15.120:0/1733421427 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4f676a190 0x55a4f67a9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.452+0000 7f0df7400640 0 client.4875 ms_handle_reset on v2:172.21.15.120:6835/76856194 2024-04-18T04:45:13.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.452+0000 7f0e1fcf3000 1 -- 172.21.15.120:0/1733421427 >> 172.21.15.120:0/1733421427 conn(0x55a4f6761fb0 msgr2=0x55a4f679d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:13.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.452+0000 7f0e1fcf3000 1 -- 172.21.15.120:0/1733421427 shutdown_connections 2024-04-18T04:45:13.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.452+0000 7f0e1fcf3000 1 -- 172.21.15.120:0/1733421427 wait complete. 2024-04-18T04:45:13.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.452+0000 7f0e1fcf3000 20 client.4875 trim_cache size 0 max 16384 2024-04-18T04:45:13.458 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-18T04:45:13.458 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_fsid": "8e73592f-08e2-4957-a98f-9d044cec4ba5", 2024-04-18T04:45:13.458 INFO:teuthology.orchestra.run.smithi120.stdout: "whoami": 0, 2024-04-18T04:45:13.458 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4288, 2024-04-18T04:45:13.458 INFO:teuthology.orchestra.run.smithi120.stdout: "want_state": "up:active", 2024-04-18T04:45:13.458 INFO:teuthology.orchestra.run.smithi120.stdout: "state": "up:active", 2024-04-18T04:45:13.458 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs", 2024-04-18T04:45:13.459 INFO:teuthology.orchestra.run.smithi120.stdout: "rank_uptime": 43.200401943999999, 2024-04-18T04:45:13.459 INFO:teuthology.orchestra.run.smithi120.stdout: "mdsmap_epoch": 15, 2024-04-18T04:45:13.459 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch": 27, 2024-04-18T04:45:13.459 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch_barrier": 25, 2024-04-18T04:45:13.459 INFO:teuthology.orchestra.run.smithi120.stdout: "uptime": 49.271305019000003 2024-04-18T04:45:13.459 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-18T04:45:13.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.452+0000 7f0e1c800640 1 -- 172.21.15.120:0/783569275 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0df80666c0 msgr2=0x7f0df8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:13.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.452+0000 7f0e1c800640 1 --2- 172.21.15.120:0/783569275 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0df80666c0 0x7f0df8068b80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0e08009a50 tx=0x7f0e08008040 comp rx=0 tx=0).stop 2024-04-18T04:45:13.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.452+0000 7f0e1c800640 1 -- 172.21.15.120:0/783569275 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e140c85d0 msgr2=0x7f0e14156680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:13.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.452+0000 7f0e1c800640 1 --2- 172.21.15.120:0/783569275 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e140c85d0 0x7f0e14156680 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0e040b3040 tx=0x7f0e0401baf0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.452+0000 7f0e1c800640 1 -- 172.21.15.120:0/783569275 shutdown_connections 2024-04-18T04:45:13.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.452+0000 7f0e1c800640 1 --2- 172.21.15.120:0/783569275 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0df80666c0 0x7f0df8068b80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.452+0000 7f0e1c800640 1 --2- 172.21.15.120:0/783569275 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e14153900 0x7f0e14154e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.452+0000 7f0e1c800640 1 --2- 172.21.15.120:0/783569275 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e140c85d0 0x7f0e14156680 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.452+0000 7f0e1c800640 1 --2- 172.21.15.120:0/783569275 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0e140c6000 0x7f0e14156140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:13.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.452+0000 7f0e1c800640 1 -- 172.21.15.120:0/783569275 >> 172.21.15.120:0/783569275 conn(0x7f0e14069ec0 msgr2=0x7f0e14159aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:13.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.452+0000 7f0e1c800640 1 -- 172.21.15.120:0/783569275 shutdown_connections 2024-04-18T04:45:13.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:13.452+0000 7f0e1c800640 1 -- 172.21.15.120:0/783569275 wait complete. 2024-04-18T04:45:13.472 INFO:teuthology.run_tasks:Running task sequential... 2024-04-18T04:45:13.481 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-18T04:45:13.481 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-18T04:45:13.482 INFO:teuthology.task.print:Enabling mgr modules 2024-04-18T04:45:13.482 INFO:teuthology.run_tasks:Running task kclient... 2024-04-18T04:45:13.705 INFO:tasks.kclient:Mounting kernel clients... 2024-04-18T04:45:13.705 INFO:tasks.kclient:config is {'client.0': {}} 2024-04-18T04:45:13.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:45:13.705 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list 2024-04-18T04:45:13.715 INFO:teuthology.orchestra.run.smithi120.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-18T04:45:13.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:45:13.715 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-18T04:45:13.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:45:13.780 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link delete ceph-brx 2024-04-18T04:45:13.950 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-04-18T04:45:13.950 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-18T04:45:13.950 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-18T04:45:13.950 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-18T04:45:14.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.088+0000 7f2c53800640 1 Processor -- start 2024-04-18T04:45:14.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.088+0000 7f2c53800640 1 -- start start 2024-04-18T04:45:14.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.088+0000 7f2c53800640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2c4c06a500 0x7f2c4c153180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:14.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.088+0000 7f2c53800640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f2c4c06cc10 0x7f2c4c1536c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:14.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.088+0000 7f2c53800640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c4c0c7830 con 0x7f2c4c06a120 2024-04-18T04:45:14.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.088+0000 7f2c53800640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c4c153c00 con 0x7f2c4c06cc10 2024-04-18T04:45:14.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.088+0000 7f2c53800640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c4c06c070 con 0x7f2c4c06a500 2024-04-18T04:45:14.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.088+0000 7f2c50e00640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f2c4c06a120 0x7f2c4c06c500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:35292/0 (socket says 172.21.15.120:35292) 2024-04-18T04:45:14.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.088+0000 7f2c51800640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f2c4c06cc10 0x7f2c4c1536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:14.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.088+0000 7f2c50e00640 1 -- 172.21.15.120:0/3657071440 learned_addr learned my addr 172.21.15.120:0/3657071440 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:45:14.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.088+0000 7f2c4be00640 1 --2- 172.21.15.120:0/3657071440 >> v2:172.21.15.132:3300/0 conn(0x7f2c4c06a500 0x7f2c4c153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:14.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.088+0000 7f2c4b400640 1 -- 172.21.15.120:0/3657071440 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3820721626 0 0) 0x7f2c4c0c7830 con 0x7f2c4c06a120 2024-04-18T04:45:14.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.088+0000 7f2c4b400640 1 -- 172.21.15.120:0/3657071440 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c34003530 con 0x7f2c4c06a120 2024-04-18T04:45:14.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.088+0000 7f2c51800640 1 -- 172.21.15.120:0/3657071440 >> v2:172.21.15.132:3300/0 conn(0x7f2c4c06a500 msgr2=0x7f2c4c153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:14.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.088+0000 7f2c51800640 1 --2- 172.21.15.120:0/3657071440 >> v2:172.21.15.132:3300/0 conn(0x7f2c4c06a500 0x7f2c4c153180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:14.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.088+0000 7f2c51800640 1 -- 172.21.15.120:0/3657071440 >> v1:172.21.15.120:6789/0 conn(0x7f2c4c06a120 legacy=0x7f2c4c06c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:14.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.088+0000 7f2c51800640 1 -- 172.21.15.120:0/3657071440 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c4c1599d0 con 0x7f2c4c06cc10 2024-04-18T04:45:14.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.092+0000 7f2c51800640 1 --2- 172.21.15.120:0/3657071440 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c4c06cc10 0x7f2c4c1536c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c06af20 tx=0x7f2c4401f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c23ee4a35530d7da server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:14.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.092+0000 7f2c4b400640 1 -- 172.21.15.120:0/3657071440 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c440af600 con 0x7f2c4c06cc10 2024-04-18T04:45:14.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.092+0000 7f2c4b400640 1 -- 172.21.15.120:0/3657071440 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c440ab050 con 0x7f2c4c06cc10 2024-04-18T04:45:14.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.092+0000 7f2c4b400640 1 -- 172.21.15.120:0/3657071440 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c440af980 con 0x7f2c4c06cc10 2024-04-18T04:45:14.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.092+0000 7f2c53800640 1 -- 172.21.15.120:0/3657071440 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c4c06cc10 msgr2=0x7f2c4c1536c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:14.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.092+0000 7f2c53800640 1 --2- 172.21.15.120:0/3657071440 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c4c06cc10 0x7f2c4c1536c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c06af20 tx=0x7f2c4401f110 comp rx=0 tx=0).stop 2024-04-18T04:45:14.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.092+0000 7f2c53800640 1 -- 172.21.15.120:0/3657071440 shutdown_connections 2024-04-18T04:45:14.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.092+0000 7f2c53800640 1 --2- 172.21.15.120:0/3657071440 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c4c06cc10 0x7f2c4c1536c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:14.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.092+0000 7f2c53800640 1 --2- 172.21.15.120:0/3657071440 >> v2:172.21.15.132:3300/0 conn(0x7f2c4c06a500 0x7f2c4c153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:14.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.092+0000 7f2c53800640 1 -- 172.21.15.120:0/3657071440 >> 172.21.15.120:0/3657071440 conn(0x7f2c4c0c8a40 msgr2=0x7f2c4c0c8e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:14.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.092+0000 7f2c53800640 1 -- 172.21.15.120:0/3657071440 shutdown_connections 2024-04-18T04:45:14.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.092+0000 7f2c53800640 1 -- 172.21.15.120:0/3657071440 wait complete. 2024-04-18T04:45:14.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.092+0000 7f2c53800640 1 Processor -- start 2024-04-18T04:45:14.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.092+0000 7f2c53800640 1 -- start start 2024-04-18T04:45:14.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.096+0000 7f2c53800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c4c06a120 0x7f2c4c14f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:14.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.096+0000 7f2c53800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c4c06a500 0x7f2c4c14e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:14.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.096+0000 7f2c53800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2c4c06cc10 0x7f2c4c1efed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:14.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.096+0000 7f2c53800640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4c148150 con 0x7f2c4c06a500 2024-04-18T04:45:14.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.096+0000 7f2c53800640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4c151ff0 con 0x7f2c4c06a120 2024-04-18T04:45:14.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.096+0000 7f2c53800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4c157370 con 0x7f2c4c06cc10 2024-04-18T04:45:14.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.096+0000 7f2c4be00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c4c06a500 0x7f2c4c14e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:14.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.096+0000 7f2c4be00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c4c06a500 0x7f2c4c14e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46678/0 (socket says 172.21.15.120:46678) 2024-04-18T04:45:14.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.096+0000 7f2c4be00640 1 -- 172.21.15.120:0/1479686761 learned_addr learned my addr 172.21.15.120:0/1479686761 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:14.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.096+0000 7f2c50e00640 1 --2- 172.21.15.120:0/1479686761 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c4c06a120 0x7f2c4c14f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:14.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.096+0000 7f2c51800640 1 --2- 172.21.15.120:0/1479686761 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2c4c06cc10 0x7f2c4c1efed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:14.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.096+0000 7f2c4be00640 1 -- 172.21.15.120:0/1479686761 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2c4c06cc10 msgr2=0x7f2c4c1efed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:14.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.096+0000 7f2c4be00640 1 --2- 172.21.15.120:0/1479686761 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2c4c06cc10 0x7f2c4c1efed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:14.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.096+0000 7f2c4be00640 1 -- 172.21.15.120:0/1479686761 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c4c06a120 msgr2=0x7f2c4c14f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:14.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.096+0000 7f2c4be00640 1 --2- 172.21.15.120:0/1479686761 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c4c06a120 0x7f2c4c14f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:14.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.096+0000 7f2c4be00640 1 -- 172.21.15.120:0/1479686761 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c44009a70 con 0x7f2c4c06a500 2024-04-18T04:45:14.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.096+0000 7f2c4be00640 1 --2- 172.21.15.120:0/1479686761 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c4c06a500 0x7f2c4c14e0b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2c3800d7d0 tx=0x7f2c3800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:14.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.096+0000 7f2c48c00640 1 -- 172.21.15.120:0/1479686761 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3800b6c0 con 0x7f2c4c06a500 2024-04-18T04:45:14.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.096+0000 7f2c48c00640 1 -- 172.21.15.120:0/1479686761 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3800b820 con 0x7f2c4c06a500 2024-04-18T04:45:14.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.096+0000 7f2c53800640 1 -- 172.21.15.120:0/1479686761 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c4c152480 con 0x7f2c4c06a500 2024-04-18T04:45:14.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.096+0000 7f2c48c00640 1 -- 172.21.15.120:0/1479686761 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3800bbd0 con 0x7f2c4c06a500 2024-04-18T04:45:14.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.096+0000 7f2c53800640 1 -- 172.21.15.120:0/1479686761 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c4c1519a0 con 0x7f2c4c06a500 2024-04-18T04:45:14.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.096+0000 7f2c53800640 1 -- 172.21.15.120:0/1479686761 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c4c15a230 con 0x7f2c4c06a500 2024-04-18T04:45:14.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.096+0000 7f2c48c00640 1 -- 172.21.15.120:0/1479686761 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2c3800bd30 con 0x7f2c4c06a500 2024-04-18T04:45:14.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.100+0000 7f2c48c00640 1 --2- 172.21.15.120:0/1479686761 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2c2c066690 0x7f2c2c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:14.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.100+0000 7f2c48c00640 1 -- 172.21.15.120:0/1479686761 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2c380849d0 con 0x7f2c4c06a500 2024-04-18T04:45:14.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.100+0000 7f2c50e00640 1 --2- 172.21.15.120:0/1479686761 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2c2c066690 0x7f2c2c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:14.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.100+0000 7f2c50e00640 1 --2- 172.21.15.120:0/1479686761 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2c2c066690 0x7f2c2c068b50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2c400011f0 tx=0x7f2c40007d40 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:14.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.104+0000 7f2c48c00640 1 -- 172.21.15.120:0/1479686761 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f2c38051970 con 0x7f2c4c06a500 2024-04-18T04:45:14.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.288+0000 7f2c53800640 1 -- 172.21.15.120:0/1479686761 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2c4c072a70 con 0x7f2c4c06a500 2024-04-18T04:45:14.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.288+0000 7f2c48c00640 1 -- 172.21.15.120:0/1479686761 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+88 (secure 0 0 0) 0x7f2c38054f90 con 0x7f2c4c06a500 2024-04-18T04:45:14.291 INFO:teuthology.orchestra.run.smithi120.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-18T04:45:14.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.292+0000 7f2c53800640 1 -- 172.21.15.120:0/1479686761 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2c2c066690 msgr2=0x7f2c2c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:14.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.292+0000 7f2c53800640 1 --2- 172.21.15.120:0/1479686761 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2c2c066690 0x7f2c2c068b50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2c400011f0 tx=0x7f2c40007d40 comp rx=0 tx=0).stop 2024-04-18T04:45:14.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.292+0000 7f2c53800640 1 -- 172.21.15.120:0/1479686761 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c4c06a500 msgr2=0x7f2c4c14e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:14.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.292+0000 7f2c53800640 1 --2- 172.21.15.120:0/1479686761 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c4c06a500 0x7f2c4c14e0b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2c3800d7d0 tx=0x7f2c3800dc90 comp rx=0 tx=0).stop 2024-04-18T04:45:14.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.292+0000 7f2c53800640 1 -- 172.21.15.120:0/1479686761 shutdown_connections 2024-04-18T04:45:14.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.292+0000 7f2c53800640 1 --2- 172.21.15.120:0/1479686761 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2c2c066690 0x7f2c2c068b50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:14.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.292+0000 7f2c53800640 1 --2- 172.21.15.120:0/1479686761 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2c4c06cc10 0x7f2c4c1efed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:14.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.292+0000 7f2c53800640 1 --2- 172.21.15.120:0/1479686761 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c4c06a500 0x7f2c4c14e0b0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:14.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.292+0000 7f2c53800640 1 --2- 172.21.15.120:0/1479686761 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c4c06a120 0x7f2c4c14f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:14.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.292+0000 7f2c53800640 1 -- 172.21.15.120:0/1479686761 >> 172.21.15.120:0/1479686761 conn(0x7f2c4c0c8a40 msgr2=0x7f2c4c150230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:14.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.292+0000 7f2c53800640 1 -- 172.21.15.120:0/1479686761 shutdown_connections 2024-04-18T04:45:14.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:14.292+0000 7f2c53800640 1 -- 172.21.15.120:0/1479686761 wait complete. 2024-04-18T04:45:14.313 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-18T04:45:14.313 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-18T04:45:14.313 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi120.front.sepia.ceph.com 2024-04-18T04:45:14.313 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-18T04:45:14.313 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-18T04:45:14.313 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-18T04:45:14.313 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-18T04:45:14.313 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-18T04:45:14.313 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-18T04:45:14.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:45:14.314 DEBUG:teuthology.orchestra.run.smithi120:> ip addr 2024-04-18T04:45:14.323 INFO:teuthology.orchestra.run.smithi120.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-18T04:45:14.324 INFO:teuthology.orchestra.run.smithi120.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-18T04:45:14.324 INFO:teuthology.orchestra.run.smithi120.stdout: inet 127.0.0.1/8 scope host lo 2024-04-18T04:45:14.324 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-04-18T04:45:14.324 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 ::1/128 scope host 2024-04-18T04:45:14.324 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-04-18T04:45:14.324 INFO:teuthology.orchestra.run.smithi120.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-18T04:45:14.324 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:26 brd ff:ff:ff:ff:ff:ff 2024-04-18T04:45:14.324 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f0 2024-04-18T04:45:14.324 INFO:teuthology.orchestra.run.smithi120.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-18T04:45:14.324 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:27 brd ff:ff:ff:ff:ff:ff 2024-04-18T04:45:14.324 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f1 2024-04-18T04:45:14.324 INFO:teuthology.orchestra.run.smithi120.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-18T04:45:14.325 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8e brd ff:ff:ff:ff:ff:ff 2024-04-18T04:45:14.325 INFO:teuthology.orchestra.run.smithi120.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-18T04:45:14.325 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8f brd ff:ff:ff:ff:ff:ff 2024-04-18T04:45:14.325 INFO:teuthology.orchestra.run.smithi120.stdout: inet 172.21.15.120/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-18T04:45:14.325 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft 42449sec preferred_lft 42449sec 2024-04-18T04:45:14.325 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::ec4:7aff:fe8f:478f/64 scope link 2024-04-18T04:45:14.325 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-04-18T04:45:14.325 INFO:teuthology.orchestra.run.smithi120.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-18T04:45:14.325 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 02:42:e3:e8:23:da brd ff:ff:ff:ff:ff:ff 2024-04-18T04:45:14.325 INFO:teuthology.orchestra.run.smithi120.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-18T04:45:14.325 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-04-18T04:45:14.325 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-18T04:45:14.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:45:14.326 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec bash -c ' 2024-04-18T04:45:14.326 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-04-18T04:45:14.326 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link add name ceph-brx type bridge 2024-04-18T04:45:14.326 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip addr flush dev ceph-brx 2024-04-18T04:45:14.326 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set ceph-brx up 2024-04-18T04:45:14.326 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-18T04:45:14.326 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-04-18T04:45:14.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:45:14.433 DEBUG:teuthology.orchestra.run.smithi120:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-18T04:45:14.451 INFO:teuthology.orchestra.run.smithi120.stdout:1 2024-04-18T04:45:14.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:45:14.453 DEBUG:teuthology.orchestra.run.smithi120:> route 2024-04-18T04:45:14.509 INFO:teuthology.orchestra.run.smithi120.stdout:Kernel IP routing table 2024-04-18T04:45:14.509 INFO:teuthology.orchestra.run.smithi120.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-18T04:45:14.509 INFO:teuthology.orchestra.run.smithi120.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-18T04:45:14.509 INFO:teuthology.orchestra.run.smithi120.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-18T04:45:14.509 INFO:teuthology.orchestra.run.smithi120.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-18T04:45:14.509 INFO:teuthology.orchestra.run.smithi120.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-18T04:45:14.510 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-18T04:45:14.510 INFO:teuthology.orchestra.run.smithi120.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-18T04:45:14.510 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-18T04:45:14.510 INFO:teuthology.orchestra.run.smithi120.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-18T04:45:14.510 INFO:teuthology.orchestra.run.smithi120.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-18T04:45:14.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:45:14.510 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec bash -c ' 2024-04-18T04:45:14.510 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-04-18T04:45:14.510 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-18T04:45:14.510 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-18T04:45:14.511 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-18T04:45:14.511 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-04-18T04:45:14.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:45:14.600 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list 2024-04-18T04:45:14.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:45:14.609 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list-id 2024-04-18T04:45:14.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:45:14.659 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec bash -c ' 2024-04-18T04:45:14.659 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-04-18T04:45:14.659 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-18T04:45:14.659 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-18T04:45:14.659 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-04-18T04:45:14.744 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-18T04:45:14.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:45:14.744 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec bash -c ' 2024-04-18T04:45:14.745 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-04-18T04:45:14.745 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-18T04:45:14.745 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-18T04:45:14.745 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-18T04:45:14.745 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-18T04:45:14.745 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-18T04:45:14.745 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-04-18T04:45:14.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:45:14.883 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec bash -c ' 2024-04-18T04:45:14.883 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-04-18T04:45:14.883 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set brx.0 up 2024-04-18T04:45:14.883 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set dev brx.0 master ceph-brx 2024-04-18T04:45:14.883 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-04-18T04:45:14.922 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-18T04:45:14.922 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-18T04:45:14.975 INFO:teuthology.orchestra.run.smithi120.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-18T04:45:14.975 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-18T04:45:14.975 DEBUG:teuthology.orchestra.run.smithi120:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-18T04:45:15.030 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-18T04:45:15.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:45:15.030 DEBUG:teuthology.orchestra.run.smithi120:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-18T04:45:15.123 INFO:teuthology.orchestra.run.smithi120.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-18T04:45:15.123 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-18T04:45:15.123 INFO:teuthology.orchestra.run.smithi120.stdout:invalid new device string format 2024-04-18T04:45:15.678 INFO:teuthology.orchestra.run.smithi120.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-18T04:45:15.678 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-18T04:45:15.678 INFO:teuthology.orchestra.run.smithi120.stdout:invalid new device string format 2024-04-18T04:45:15.678 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: resolved to: "172.21.15.120:3300,172.21.15.132:3300,172.21.15.132:3301" 2024-04-18T04:45:15.678 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-18T04:45:15.692 INFO:teuthology.orchestra.run.smithi120.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-18T04:45:15.692 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-18T04:45:15.692 INFO:teuthology.orchestra.run.smithi120.stdout:invalid new device string format 2024-04-18T04:45:15.692 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: resolved to: "172.21.15.120:3300,172.21.15.132:3300,172.21.15.132:3301" 2024-04-18T04:45:15.692 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-18T04:45:15.692 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: resolved to: "172.21.15.120:6789,172.21.15.132:6789,172.21.15.132:6790" 2024-04-18T04:45:15.692 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.120:6789,172.21.15.132:6789,172.21.15.132:6790:/ 2024-04-18T04:45:15.692 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=8e73592f-08e2-4957-a98f-9d044cec4ba5" will pass to kernel 2024-04-18T04:45:15.696 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-18T04:45:15.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:45:15.696 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-18T04:45:15.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:45:15.717 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-18T04:45:15.770 INFO:teuthology.orchestra.run.smithi120.stdout:client4887 2024-04-18T04:45:15.770 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-18T04:45:15.770 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-18T04:45:15.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:45:15.819 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-18T04:45:15.873 INFO:teuthology.orchestra.run.smithi120.stdout:client4887 2024-04-18T04:45:15.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:45:15.873 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-18T04:45:15.925 INFO:teuthology.orchestra.run.smithi120.stdout:client4887 2024-04-18T04:45:15.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:45:15.926 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/8e73592f-08e2-4957-a98f-9d044cec4ba5.client4887/status') 2024-04-18T04:45:15.986 INFO:teuthology.orchestra.run.smithi120.stdout:instance: client.4887 (3)192.168.0.1:0/1148666537 2024-04-18T04:45:15.986 INFO:teuthology.orchestra.run.smithi120.stdout:blocklisted: false 2024-04-18T04:45:15.986 INFO:teuthology.orchestra.run.smithi120.stderr:0+1 records in 2024-04-18T04:45:15.987 INFO:teuthology.orchestra.run.smithi120.stderr:0+1 records out 2024-04-18T04:45:15.987 INFO:teuthology.orchestra.run.smithi120.stderr:69 bytes copied, 5.3396e-05 s, 1.3 MB/s 2024-04-18T04:45:15.988 INFO:teuthology.run_tasks:Running task mds_thrash... 2024-04-18T04:45:16.002 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T04:45:16.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.168+0000 7fcd3d000640 1 Processor -- start 2024-04-18T04:45:16.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.168+0000 7fcd3d000640 1 -- start start 2024-04-18T04:45:16.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.172+0000 7fcd3d000640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcd38153ab0 0x7fcd38159600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:16.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.172+0000 7fcd3d000640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd380c7d60 con 0x7fcd3806f300 2024-04-18T04:45:16.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.172+0000 7fcd3d000640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd3806bfd0 con 0x7fcd3806d590 2024-04-18T04:45:16.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.172+0000 7fcd3d000640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd380c8e70 con 0x7fcd38153ab0 2024-04-18T04:45:16.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.172+0000 7fcd37e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcd38153ab0 0x7fcd38159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:16.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.172+0000 7fcd37e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcd38153ab0 0x7fcd38159600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46688/0 (socket says 172.21.15.120:46688) 2024-04-18T04:45:16.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.172+0000 7fcd37400640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fcd3806f300 0x7fcd380c9300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:35304/0 (socket says 172.21.15.120:35304) 2024-04-18T04:45:16.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.172+0000 7fcd37e00640 1 -- 172.21.15.120:0/69382970 learned_addr learned my addr 172.21.15.120:0/69382970 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:16.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.172+0000 7fcd37e00640 1 -- 172.21.15.120:0/69382970 >> v1:172.21.15.132:6789/0 conn(0x7fcd3806d590 legacy=0x7fcd381533a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:16.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.172+0000 7fcd37e00640 1 -- 172.21.15.120:0/69382970 >> v1:172.21.15.120:6789/0 conn(0x7fcd3806f300 legacy=0x7fcd380c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:16.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.172+0000 7fcd37e00640 1 -- 172.21.15.120:0/69382970 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3806b750 con 0x7fcd38153ab0 2024-04-18T04:45:16.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.172+0000 7fcd36a00640 1 -- 172.21.15.120:0/69382970 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2566954153 0 0) 0x7fcd28001120 con 0x7fcd3806f300 2024-04-18T04:45:16.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.176+0000 7fcd37e00640 1 --2- 172.21.15.120:0/69382970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd38153ab0 0x7fcd38159600 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcd30009e50 tx=0x7fcd3001ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e37e307fd54efed7 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:16.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.176+0000 7fcd36a00640 1 -- 172.21.15.120:0/69382970 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd300a58d0 con 0x7fcd38153ab0 2024-04-18T04:45:16.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.176+0000 7fcd36a00640 1 -- 172.21.15.120:0/69382970 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd300a5a30 con 0x7fcd38153ab0 2024-04-18T04:45:16.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.176+0000 7fcd36a00640 1 -- 172.21.15.120:0/69382970 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd300a5dc0 con 0x7fcd38153ab0 2024-04-18T04:45:16.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.176+0000 7fcd3d000640 1 -- 172.21.15.120:0/69382970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd38153ab0 msgr2=0x7fcd38159600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:16.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.176+0000 7fcd3d000640 1 --2- 172.21.15.120:0/69382970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd38153ab0 0x7fcd38159600 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcd30009e50 tx=0x7fcd3001ca00 comp rx=0 tx=0).stop 2024-04-18T04:45:16.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.176+0000 7fcd3d000640 1 -- 172.21.15.120:0/69382970 shutdown_connections 2024-04-18T04:45:16.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.176+0000 7fcd3d000640 1 --2- 172.21.15.120:0/69382970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd38153ab0 0x7fcd38159600 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:16.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.176+0000 7fcd3d000640 1 -- 172.21.15.120:0/69382970 >> 172.21.15.120:0/69382970 conn(0x7fcd380ccf50 msgr2=0x7fcd380cd360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:16.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.176+0000 7fcd3d000640 1 -- 172.21.15.120:0/69382970 shutdown_connections 2024-04-18T04:45:16.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.176+0000 7fcd3d000640 1 -- 172.21.15.120:0/69382970 wait complete. 2024-04-18T04:45:16.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.176+0000 7fcd3d000640 1 Processor -- start 2024-04-18T04:45:16.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.176+0000 7fcd3d000640 1 -- start start 2024-04-18T04:45:16.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.176+0000 7fcd3d000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcd3806d590 0x7fcd3815d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:16.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.176+0000 7fcd3d000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd3806f300 0x7fcd38159a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:16.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.176+0000 7fcd3d000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd38153ab0 0x7fcd380c5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:16.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.176+0000 7fcd3d000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3814df90 con 0x7fcd38153ab0 2024-04-18T04:45:16.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.176+0000 7fcd3d000640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3814e270 con 0x7fcd3806f300 2024-04-18T04:45:16.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.176+0000 7fcd3d000640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3814e550 con 0x7fcd3806d590 2024-04-18T04:45:16.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.176+0000 7fcd37e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd38153ab0 0x7fcd380c5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:16.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.180+0000 7fcd37e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd38153ab0 0x7fcd380c5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46704/0 (socket says 172.21.15.120:46704) 2024-04-18T04:45:16.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.180+0000 7fcd37e00640 1 -- 172.21.15.120:0/1291175457 learned_addr learned my addr 172.21.15.120:0/1291175457 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:16.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.180+0000 7fcd2ea00640 1 --2- 172.21.15.120:0/1291175457 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd3806f300 0x7fcd38159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:16.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.180+0000 7fcd37400640 1 --2- 172.21.15.120:0/1291175457 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcd3806d590 0x7fcd3815d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:16.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.180+0000 7fcd37e00640 1 -- 172.21.15.120:0/1291175457 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcd3806d590 msgr2=0x7fcd3815d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:16.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.180+0000 7fcd37e00640 1 --2- 172.21.15.120:0/1291175457 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcd3806d590 0x7fcd3815d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:16.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.180+0000 7fcd37e00640 1 -- 172.21.15.120:0/1291175457 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd3806f300 msgr2=0x7fcd38159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:16.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.180+0000 7fcd37e00640 1 --2- 172.21.15.120:0/1291175457 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd3806f300 0x7fcd38159a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:16.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.180+0000 7fcd37e00640 1 -- 172.21.15.120:0/1291175457 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd30009b30 con 0x7fcd38153ab0 2024-04-18T04:45:16.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.180+0000 7fcd37400640 1 --2- 172.21.15.120:0/1291175457 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcd3806d590 0x7fcd3815d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:16.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.180+0000 7fcd37e00640 1 --2- 172.21.15.120:0/1291175457 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd38153ab0 0x7fcd380c5760 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fcd300af040 tx=0x7fcd300197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:16.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.180+0000 7fcd2fe00640 1 -- 172.21.15.120:0/1291175457 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd300b8880 con 0x7fcd38153ab0 2024-04-18T04:45:16.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.180+0000 7fcd2fe00640 1 -- 172.21.15.120:0/1291175457 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd300b89e0 con 0x7fcd38153ab0 2024-04-18T04:45:16.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.180+0000 7fcd2fe00640 1 -- 172.21.15.120:0/1291175457 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd300b8d90 con 0x7fcd38153ab0 2024-04-18T04:45:16.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.180+0000 7fcd3d000640 1 -- 172.21.15.120:0/1291175457 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd3814e830 con 0x7fcd38153ab0 2024-04-18T04:45:16.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.180+0000 7fcd3d000640 1 -- 172.21.15.120:0/1291175457 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd3814c810 con 0x7fcd38153ab0 2024-04-18T04:45:16.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.180+0000 7fcd3d000640 1 -- 172.21.15.120:0/1291175457 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd38067070 con 0x7fcd38153ab0 2024-04-18T04:45:16.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.180+0000 7fcd2fe00640 1 -- 172.21.15.120:0/1291175457 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcd300c1410 con 0x7fcd38153ab0 2024-04-18T04:45:16.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.184+0000 7fcd2fe00640 1 --2- 172.21.15.120:0/1291175457 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fcd140666c0 0x7fcd14068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:16.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.184+0000 7fcd2fe00640 1 -- 172.21.15.120:0/1291175457 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcd3011f620 con 0x7fcd38153ab0 2024-04-18T04:45:16.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.184+0000 7fcd37400640 1 --2- 172.21.15.120:0/1291175457 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fcd140666c0 0x7fcd14068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:16.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.184+0000 7fcd37400640 1 --2- 172.21.15.120:0/1291175457 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fcd140666c0 0x7fcd14068b80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcd28007910 tx=0x7fcd28007ae0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:16.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.188+0000 7fcd2fe00640 1 -- 172.21.15.120:0/1291175457 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fcd300ec5c0 con 0x7fcd38153ab0 2024-04-18T04:45:16.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.344+0000 7fcd3d000640 1 -- 172.21.15.120:0/1291175457 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd38158a30 con 0x7fcd38153ab0 2024-04-18T04:45:16.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.344+0000 7fcd2fe00640 1 -- 172.21.15.120:0/1291175457 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18257 (secure 0 0 0) 0x7fcd300efbe0 con 0x7fcd38153ab0 2024-04-18T04:45:16.347 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:45:16.347 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":27,"fsid":"8e73592f-08e2-4957-a98f-9d044cec4ba5","created":"2024-04-18T04:44:06.139983+0000","modified":"2024-04-18T04:45:12.029792+0000","last_up_change":"2024-04-18T04:44:17.410146+0000","last_in_change":"2024-04-18T04:44:08.470250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T04:44:16.864728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T04:44:28.825773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T04:44:29.245857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-18T04:44:32.314302+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a80903bd-d9be-4fb9-af99-6125cb26bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":27468},{"type":"v1","addr":"172.21.15.120:6801","nonce":27468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":27468},{"type":"v1","addr":"172.21.15.120:6803","nonce":27468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":27468},{"type":"v1","addr":"172.21.15.120:6807","nonce":27468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":27468},{"type":"v1","addr":"172.21.15.120:6805","nonce":27468}]},"public_addr":"172.21.15.120:6801/27468","cluster_addr":"172.21.15.120:6803/27468","heartbeat_back_addr":"172.21.15.120:6807/27468","heartbeat_front_addr":"172.21.15.120:6805/27468","state":["exists","up"]},{"osd":1,"uuid":"8f5f004b-6870-4c78-8d50-9622e631ec25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":27470},{"type":"v1","addr":"172.21.15.120:6823","nonce":27470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":27470},{"type":"v1","addr":"172.21.15.120:6827","nonce":27470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":27470},{"type":"v1","addr":"172.21.15.120:6831","nonce":27470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":27470},{"type":"v1","addr":"172.21.15.120:6829","nonce":27470}]},"public_addr":"172.21.15.120:6823/27470","cluster_addr":"172.21.15.120:6827/27470","heartbeat_back_addr":"172.21.15.120:6831/27470","heartbeat_front_addr":"172.21.15.120:6829/27470","state":["exists","up"]},{"osd":2,"uuid":"6e228a2b-6103-4301-a8b5-ee81dbb1f920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":27471},{"type":"v1","addr":"172.21.15.120:6817","nonce":27471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":27471},{"type":"v1","addr":"172.21.15.120:6819","nonce":27471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":27471},{"type":"v1","addr":"172.21.15.120:6826","nonce":27471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":27471},{"type":"v1","addr":"172.21.15.120:6822","nonce":27471}]},"public_addr":"172.21.15.120:6817/27471","cluster_addr":"172.21.15.120:6819/27471","heartbeat_back_addr":"172.21.15.120:6826/27471","heartbeat_front_addr":"172.21.15.120:6822/27471","state":["exists","up"]},{"osd":3,"uuid":"7a5cabd7-d898-4e32-a03c-25b46e790134","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":27469},{"type":"v1","addr":"172.21.15.120:6809","nonce":27469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":27469},{"type":"v1","addr":"172.21.15.120:6811","nonce":27469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":27469},{"type":"v1","addr":"172.21.15.120:6815","nonce":27469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":27469},{"type":"v1","addr":"172.21.15.120:6813","nonce":27469}]},"public_addr":"172.21.15.120:6809/27469","cluster_addr":"172.21.15.120:6811/27469","heartbeat_back_addr":"172.21.15.120:6815/27469","heartbeat_front_addr":"172.21.15.120:6813/27469","state":["exists","up"]},{"osd":4,"uuid":"8e9f530f-6bab-4b23-a1a3-a71362fefcc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":28102},{"type":"v1","addr":"172.21.15.132:6825","nonce":28102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":28102},{"type":"v1","addr":"172.21.15.132:6827","nonce":28102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":28102},{"type":"v1","addr":"172.21.15.132:6831","nonce":28102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":28102},{"type":"v1","addr":"172.21.15.132:6829","nonce":28102}]},"public_addr":"172.21.15.132:6825/28102","cluster_addr":"172.21.15.132:6827/28102","heartbeat_back_addr":"172.21.15.132:6831/28102","heartbeat_front_addr":"172.21.15.132:6829/28102","state":["exists","up"]},{"osd":5,"uuid":"2243fabe-cc81-40cf-91bc-f106fe275a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":28104},{"type":"v1","addr":"172.21.15.132:6809","nonce":28104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":28104},{"type":"v1","addr":"172.21.15.132:6811","nonce":28104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":28104},{"type":"v1","addr":"172.21.15.132:6815","nonce":28104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":28104},{"type":"v1","addr":"172.21.15.132:6813","nonce":28104}]},"public_addr":"172.21.15.132:6809/28104","cluster_addr":"172.21.15.132:6811/28104","heartbeat_back_addr":"172.21.15.132:6815/28104","heartbeat_front_addr":"172.21.15.132:6813/28104","state":["exists","up"]},{"osd":6,"uuid":"c093a5ed-25c8-41a7-a20d-606a1a1661e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":28103},{"type":"v1","addr":"172.21.15.132:6801","nonce":28103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":28103},{"type":"v1","addr":"172.21.15.132:6803","nonce":28103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":28103},{"type":"v1","addr":"172.21.15.132:6807","nonce":28103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":28103},{"type":"v1","addr":"172.21.15.132:6805","nonce":28103}]},"public_addr":"172.21.15.132:6801/28103","cluster_addr":"172.21.15.132:6803/28103","heartbeat_back_addr":"172.21.15.132:6807/28103","heartbeat_front_addr":"172.21.15.132:6805/28103","state":["exists","up"]},{"osd":7,"uuid":"c37426b7-1080-4434-9f3e-a3afbbdc0fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":28129},{"type":"v1","addr":"172.21.15.132:6817","nonce":28129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":28129},{"type":"v1","addr":"172.21.15.132:6819","nonce":28129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":28129},{"type":"v1","addr":"172.21.15.132:6823","nonce":28129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":28129},{"type":"v1","addr":"172.21.15.132:6821","nonce":28129}]},"public_addr":"172.21.15.132:6817/28129","cluster_addr":"172.21.15.132:6819/28129","heartbeat_back_addr":"172.21.15.132:6823/28129","heartbeat_front_addr":"172.21.15.132:6821/28129","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.053825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.289753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.274645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.146361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.943883+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.701955+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.851076+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.800782+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":1}]},{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T04:45:16.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.348+0000 7fcd3d000640 1 -- 172.21.15.120:0/1291175457 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fcd140666c0 msgr2=0x7fcd14068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:16.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.348+0000 7fcd3d000640 1 --2- 172.21.15.120:0/1291175457 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fcd140666c0 0x7fcd14068b80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcd28007910 tx=0x7fcd28007ae0 comp rx=0 tx=0).stop 2024-04-18T04:45:16.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.348+0000 7fcd3d000640 1 -- 172.21.15.120:0/1291175457 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd38153ab0 msgr2=0x7fcd380c5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:16.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.348+0000 7fcd3d000640 1 --2- 172.21.15.120:0/1291175457 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd38153ab0 0x7fcd380c5760 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fcd300af040 tx=0x7fcd300197a0 comp rx=0 tx=0).stop 2024-04-18T04:45:16.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.348+0000 7fcd3d000640 1 -- 172.21.15.120:0/1291175457 shutdown_connections 2024-04-18T04:45:16.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.348+0000 7fcd3d000640 1 --2- 172.21.15.120:0/1291175457 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fcd140666c0 0x7fcd14068b80 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:16.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.348+0000 7fcd3d000640 1 --2- 172.21.15.120:0/1291175457 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd38153ab0 0x7fcd380c5760 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:16.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.348+0000 7fcd3d000640 1 --2- 172.21.15.120:0/1291175457 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd3806f300 0x7fcd38159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:16.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.348+0000 7fcd3d000640 1 --2- 172.21.15.120:0/1291175457 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcd3806d590 0x7fcd3815d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:16.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.348+0000 7fcd3d000640 1 -- 172.21.15.120:0/1291175457 >> 172.21.15.120:0/1291175457 conn(0x7fcd380ccf50 msgr2=0x7fcd380cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:16.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.348+0000 7fcd3d000640 1 -- 172.21.15.120:0/1291175457 shutdown_connections 2024-04-18T04:45:16.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.348+0000 7fcd3d000640 1 -- 172.21.15.120:0/1291175457 wait complete. 2024-04-18T04:45:16.368 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T04:44:16.864728+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T04:44:28.825773+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T04:44:29.245857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-18T04:44:32.314302+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-18T04:45:16.369 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T04:45:16.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.504+0000 7f531c000640 1 Processor -- start 2024-04-18T04:45:16.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.504+0000 7f531c000640 1 -- start start 2024-04-18T04:45:16.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.508+0000 7f531c000640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f5314150820 0x7f53140c0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:16.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.508+0000 7f531c000640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5314159d90 0x7f531415a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:16.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.508+0000 7f531c000640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5314071a60 con 0x7f53140c09d0 2024-04-18T04:45:16.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.508+0000 7f531c000640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5314150c00 con 0x7f5314150820 2024-04-18T04:45:16.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.508+0000 7f531c000640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5314157430 con 0x7f5314159d90 2024-04-18T04:45:16.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.508+0000 7f5319600640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f5314150820 0x7f53140c0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:16.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.508+0000 7f5319600640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f5314150820 0x7f53140c0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46706/0 (socket says 172.21.15.120:46706) 2024-04-18T04:45:16.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.508+0000 7f5319600640 1 -- 172.21.15.120:0/1261488719 learned_addr learned my addr 172.21.15.120:0/1261488719 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:16.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.508+0000 7f531a000640 1 --2- 172.21.15.120:0/1261488719 >> v2:172.21.15.132:3300/0 conn(0x7f5314159d90 0x7f531415a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:16.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.508+0000 7f5319600640 1 -- 172.21.15.120:0/1261488719 >> v2:172.21.15.132:3300/0 conn(0x7f5314159d90 msgr2=0x7f531415a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:16.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.508+0000 7f5319600640 1 --2- 172.21.15.120:0/1261488719 >> v2:172.21.15.132:3300/0 conn(0x7f5314159d90 0x7f531415a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:16.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.508+0000 7f5319600640 1 -- 172.21.15.120:0/1261488719 >> v1:172.21.15.132:6789/0 conn(0x7f53140c09d0 legacy=0x7f53140caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:16.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.508+0000 7f5319600640 1 -- 172.21.15.120:0/1261488719 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53141565d0 con 0x7f5314150820 2024-04-18T04:45:16.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.512+0000 7f5319600640 1 --2- 172.21.15.120:0/1261488719 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5314150820 0x7f53140c0490 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f53140c8c70 tx=0x7f530801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=658f701341d1cee9 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:16.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.512+0000 7f5313e00640 1 -- 172.21.15.120:0/1261488719 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53080ab600 con 0x7f5314150820 2024-04-18T04:45:16.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.512+0000 7f5313e00640 1 -- 172.21.15.120:0/1261488719 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53080ab760 con 0x7f5314150820 2024-04-18T04:45:16.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.512+0000 7f5313e00640 1 -- 172.21.15.120:0/1261488719 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53080abaf0 con 0x7f5314150820 2024-04-18T04:45:16.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.512+0000 7f531c000640 1 -- 172.21.15.120:0/1261488719 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5314150820 msgr2=0x7f53140c0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:16.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.512+0000 7f531c000640 1 --2- 172.21.15.120:0/1261488719 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5314150820 0x7f53140c0490 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f53140c8c70 tx=0x7f530801c4f0 comp rx=0 tx=0).stop 2024-04-18T04:45:16.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.512+0000 7f531c000640 1 -- 172.21.15.120:0/1261488719 shutdown_connections 2024-04-18T04:45:16.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.512+0000 7f531c000640 1 --2- 172.21.15.120:0/1261488719 >> v2:172.21.15.132:3300/0 conn(0x7f5314159d90 0x7f531415a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:16.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.512+0000 7f531c000640 1 --2- 172.21.15.120:0/1261488719 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5314150820 0x7f53140c0490 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:16.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.512+0000 7f531c000640 1 -- 172.21.15.120:0/1261488719 >> 172.21.15.120:0/1261488719 conn(0x7f531406b780 msgr2=0x7f531406bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:16.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.512+0000 7f531c000640 1 -- 172.21.15.120:0/1261488719 shutdown_connections 2024-04-18T04:45:16.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.512+0000 7f531c000640 1 -- 172.21.15.120:0/1261488719 wait complete. 2024-04-18T04:45:16.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.512+0000 7f531c000640 1 Processor -- start 2024-04-18T04:45:16.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.512+0000 7f531c000640 1 -- start start 2024-04-18T04:45:16.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.512+0000 7f531c000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53140c09d0 0x7f5314136fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:16.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.512+0000 7f531c000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5314150820 0x7f5314070e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:16.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.512+0000 7f531c000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5314159d90 0x7f5314071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:16.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.512+0000 7f531c000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53141f68b0 con 0x7f53140c09d0 2024-04-18T04:45:16.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.512+0000 7f531c000640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531414cd30 con 0x7f5314159d90 2024-04-18T04:45:16.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.512+0000 7f531c000640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f531414bc60 con 0x7f5314150820 2024-04-18T04:45:16.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.512+0000 7f5319600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53140c09d0 0x7f5314136fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:16.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.512+0000 7f5319600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53140c09d0 0x7f5314136fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46722/0 (socket says 172.21.15.120:46722) 2024-04-18T04:45:16.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.512+0000 7f5319600640 1 -- 172.21.15.120:0/3503222085 learned_addr learned my addr 172.21.15.120:0/3503222085 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:16.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.516+0000 7f531a000640 1 --2- 172.21.15.120:0/3503222085 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5314159d90 0x7f5314071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:16.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.516+0000 7f5318c00640 1 --2- 172.21.15.120:0/3503222085 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5314150820 0x7f5314070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:16.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.516+0000 7f5319600640 1 -- 172.21.15.120:0/3503222085 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5314150820 msgr2=0x7f5314070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:16.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.516+0000 7f5319600640 1 --2- 172.21.15.120:0/3503222085 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5314150820 0x7f5314070e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:16.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.516+0000 7f5319600640 1 -- 172.21.15.120:0/3503222085 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5314159d90 msgr2=0x7f5314071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:16.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.516+0000 7f5319600640 1 --2- 172.21.15.120:0/3503222085 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5314159d90 0x7f5314071390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:16.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.516+0000 7f5319600640 1 -- 172.21.15.120:0/3503222085 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53080094d0 con 0x7f53140c09d0 2024-04-18T04:45:16.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.516+0000 7f5319600640 1 --2- 172.21.15.120:0/3503222085 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53140c09d0 0x7f5314136fb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5308019100 tx=0x7f530801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:16.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.516+0000 7f5311600640 1 -- 172.21.15.120:0/3503222085 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53080ab600 con 0x7f53140c09d0 2024-04-18T04:45:16.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.516+0000 7f5311600640 1 -- 172.21.15.120:0/3503222085 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53080b4800 con 0x7f53140c09d0 2024-04-18T04:45:16.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.516+0000 7f531c000640 1 -- 172.21.15.120:0/3503222085 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5314159820 con 0x7f53140c09d0 2024-04-18T04:45:16.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.516+0000 7f5311600640 1 -- 172.21.15.120:0/3503222085 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53080b4bb0 con 0x7f53140c09d0 2024-04-18T04:45:16.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.516+0000 7f531c000640 1 -- 172.21.15.120:0/3503222085 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f531414c400 con 0x7f53140c09d0 2024-04-18T04:45:16.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.516+0000 7f531c000640 1 -- 172.21.15.120:0/3503222085 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53140729d0 con 0x7f53140c09d0 2024-04-18T04:45:16.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.516+0000 7f5311600640 1 -- 172.21.15.120:0/3503222085 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f53080b4d10 con 0x7f53140c09d0 2024-04-18T04:45:16.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.516+0000 7f5311600640 1 --2- 172.21.15.120:0/3503222085 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f52f4066690 0x7f52f4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:16.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.516+0000 7f5311600640 1 -- 172.21.15.120:0/3503222085 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f530811ee10 con 0x7f53140c09d0 2024-04-18T04:45:16.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.516+0000 7f5318c00640 1 --2- 172.21.15.120:0/3503222085 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f52f4066690 0x7f52f4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:16.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.520+0000 7f5318c00640 1 --2- 172.21.15.120:0/3503222085 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f52f4066690 0x7f52f4068b50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f53141584c0 tx=0x7f5300009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:16.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.520+0000 7f5311600640 1 -- 172.21.15.120:0/3503222085 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f5308122030 con 0x7f53140c09d0 2024-04-18T04:45:16.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.676+0000 7f531c000640 1 -- 172.21.15.120:0/3503222085 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5314067500 con 0x7f53140c09d0 2024-04-18T04:45:16.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.676+0000 7f5311600640 1 -- 172.21.15.120:0/3503222085 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f53080ebd40 con 0x7f53140c09d0 2024-04-18T04:45:16.677 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2024-04-18T04:45:16.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.676+0000 7f531c000640 1 -- 172.21.15.120:0/3503222085 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f52f4066690 msgr2=0x7f52f4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:16.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.676+0000 7f531c000640 1 --2- 172.21.15.120:0/3503222085 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f52f4066690 0x7f52f4068b50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f53141584c0 tx=0x7f5300009040 comp rx=0 tx=0).stop 2024-04-18T04:45:16.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.676+0000 7f531c000640 1 -- 172.21.15.120:0/3503222085 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53140c09d0 msgr2=0x7f5314136fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:16.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.676+0000 7f531c000640 1 --2- 172.21.15.120:0/3503222085 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53140c09d0 0x7f5314136fb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5308019100 tx=0x7f530801ad30 comp rx=0 tx=0).stop 2024-04-18T04:45:16.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.676+0000 7f531c000640 1 -- 172.21.15.120:0/3503222085 shutdown_connections 2024-04-18T04:45:16.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.676+0000 7f531c000640 1 --2- 172.21.15.120:0/3503222085 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f52f4066690 0x7f52f4068b50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:16.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.676+0000 7f531c000640 1 --2- 172.21.15.120:0/3503222085 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5314159d90 0x7f5314071390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:16.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.676+0000 7f531c000640 1 --2- 172.21.15.120:0/3503222085 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5314150820 0x7f5314070e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:16.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.676+0000 7f531c000640 1 --2- 172.21.15.120:0/3503222085 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53140c09d0 0x7f5314136fb0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:16.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.676+0000 7f531c000640 1 -- 172.21.15.120:0/3503222085 >> 172.21.15.120:0/3503222085 conn(0x7f531406b780 msgr2=0x7f53140c8170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:16.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.676+0000 7f531c000640 1 -- 172.21.15.120:0/3503222085 shutdown_connections 2024-04-18T04:45:16.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.676+0000 7f531c000640 1 -- 172.21.15.120:0/3503222085 wait complete. 2024-04-18T04:45:16.698 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T04:45:16.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.836+0000 7f33a7400640 1 Processor -- start 2024-04-18T04:45:16.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.836+0000 7f33a7400640 1 -- start start 2024-04-18T04:45:16.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.836+0000 7f33a7400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f33a00caff0 0x7f33a00cb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:16.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.836+0000 7f33a7400640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33a0072640 con 0x7f33a0158150 2024-04-18T04:45:16.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.836+0000 7f33a7400640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33a0072360 con 0x7f33a0151730 2024-04-18T04:45:16.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.836+0000 7f33a7400640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33a0071120 con 0x7f33a00caff0 2024-04-18T04:45:16.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.840+0000 7f339fe00640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f33a0158150 0x7f33a00c73d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:35316/0 (socket says 172.21.15.120:35316) 2024-04-18T04:45:16.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.840+0000 7f339fe00640 1 -- 172.21.15.120:0/4055439372 learned_addr learned my addr 172.21.15.120:0/4055439372 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:45:16.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.840+0000 7f33a5400640 1 --2- 172.21.15.120:0/4055439372 >> v2:172.21.15.132:3300/0 conn(0x7f33a00caff0 0x7f33a00cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:16.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.840+0000 7f339f400640 1 -- 172.21.15.120:0/4055439372 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3976719841 0 0) 0x7f33a0072640 con 0x7f33a0158150 2024-04-18T04:45:16.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.840+0000 7f339f400640 1 -- 172.21.15.120:0/4055439372 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3384003530 con 0x7f33a0158150 2024-04-18T04:45:16.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.840+0000 7f339f400640 1 -- 172.21.15.120:0/4055439372 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 442395696 0 0) 0x7f3384003530 con 0x7f33a0158150 2024-04-18T04:45:16.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.840+0000 7f339f400640 1 -- 172.21.15.120:0/4055439372 >> v2:172.21.15.132:3300/0 conn(0x7f33a00caff0 msgr2=0x7f33a00cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:16.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.840+0000 7f339f400640 1 --2- 172.21.15.120:0/4055439372 >> v2:172.21.15.132:3300/0 conn(0x7f33a00caff0 0x7f33a00cb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:16.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.840+0000 7f339f400640 1 -- 172.21.15.120:0/4055439372 >> v1:172.21.15.132:6789/0 conn(0x7f33a0151730 legacy=0x7f33a006dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:16.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.840+0000 7f339f400640 1 -- 172.21.15.120:0/4055439372 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a006f9d0 con 0x7f33a0158150 2024-04-18T04:45:16.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.840+0000 7f339f400640 1 -- 172.21.15.120:0/4055439372 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7f338c001680 con 0x7f33a0158150 2024-04-18T04:45:16.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.840+0000 7f339f400640 1 -- 172.21.15.120:0/4055439372 >> v1:172.21.15.120:6789/0 conn(0x7f33a0158150 legacy=0x7f33a00c73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:16.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.840+0000 7f339f400640 1 --2- 172.21.15.120:0/4055439372 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3384003980 0x7f3384003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:16.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.840+0000 7f339f400640 1 --2- 172.21.15.120:0/4055439372 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33840047d0 0x7f3384004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:16.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.840+0000 7f339f400640 1 --2- 172.21.15.120:0/4055439372 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3384005190 0x7f338400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:16.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.840+0000 7f339f400640 1 -- 172.21.15.120:0/4055439372 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a0071120 con 0x7f3384003980 2024-04-18T04:45:16.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.840+0000 7f339f400640 1 -- 172.21.15.120:0/4055439372 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338400c030 con 0x7f33840047d0 2024-04-18T04:45:16.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.840+0000 7f339f400640 1 -- 172.21.15.120:0/4055439372 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f338400c1f0 con 0x7f3384005190 2024-04-18T04:45:16.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.840+0000 7f33a5400640 1 --2- 172.21.15.120:0/4055439372 >> v2:172.21.15.132:3300/0 conn(0x7f33a00caff0 0x7f33a00cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:45:16.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.840+0000 7f33a4a00640 1 --2- 172.21.15.120:0/4055439372 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3384003980 0x7f3384003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:16.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.840+0000 7f339fe00640 1 --2- 172.21.15.120:0/4055439372 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33840047d0 0x7f3384004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:16.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.840+0000 7f33a4a00640 1 -- 172.21.15.120:0/4055439372 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3384005190 msgr2=0x7f338400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:16.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.840+0000 7f33a4a00640 1 --2- 172.21.15.120:0/4055439372 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3384005190 0x7f338400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:16.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.840+0000 7f33a4a00640 1 -- 172.21.15.120:0/4055439372 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33840047d0 msgr2=0x7f3384004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:16.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.840+0000 7f33a4a00640 1 --2- 172.21.15.120:0/4055439372 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33840047d0 0x7f3384004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:16.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.840+0000 7f33a4a00640 1 -- 172.21.15.120:0/4055439372 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3384003530 con 0x7f3384003980 2024-04-18T04:45:16.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.840+0000 7f33a5400640 1 -- 172.21.15.120:0/4055439372 reap_dead start 2024-04-18T04:45:16.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.844+0000 7f33a4a00640 1 --2- 172.21.15.120:0/4055439372 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3384003980 0x7f3384003da0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3390001e70 tx=0x7f339001c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2593f43312bb5996 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:16.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.844+0000 7f339f400640 1 -- 172.21.15.120:0/4055439372 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3390003b80 con 0x7f3384003980 2024-04-18T04:45:16.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.844+0000 7f339f400640 1 -- 172.21.15.120:0/4055439372 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3390003ce0 con 0x7f3384003980 2024-04-18T04:45:16.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.844+0000 7f339f400640 1 -- 172.21.15.120:0/4055439372 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3390005310 con 0x7f3384003980 2024-04-18T04:45:16.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.844+0000 7f33a7400640 1 -- 172.21.15.120:0/4055439372 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3384003980 msgr2=0x7f3384003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:16.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.844+0000 7f33a7400640 1 --2- 172.21.15.120:0/4055439372 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3384003980 0x7f3384003da0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3390001e70 tx=0x7f339001c760 comp rx=0 tx=0).stop 2024-04-18T04:45:16.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.844+0000 7f33a7400640 1 -- 172.21.15.120:0/4055439372 shutdown_connections 2024-04-18T04:45:16.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.844+0000 7f33a7400640 1 --2- 172.21.15.120:0/4055439372 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3384003980 0x7f3384003da0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:16.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.844+0000 7f33a7400640 1 -- 172.21.15.120:0/4055439372 >> 172.21.15.120:0/4055439372 conn(0x7f33a006b780 msgr2=0x7f33a006bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:16.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.844+0000 7f33a7400640 1 -- 172.21.15.120:0/4055439372 shutdown_connections 2024-04-18T04:45:16.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.844+0000 7f33a7400640 1 -- 172.21.15.120:0/4055439372 wait complete. 2024-04-18T04:45:16.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.844+0000 7f33a7400640 1 Processor -- start 2024-04-18T04:45:16.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.844+0000 7f33a7400640 1 -- start start 2024-04-18T04:45:16.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.848+0000 7f33a7400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3384003980 0x7f33a00c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:16.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.848+0000 7f33a7400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33a01567c0 0x7f33a01efc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:16.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.848+0000 7f33a7400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f33a0156c20 0x7f33a01f01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:16.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.848+0000 7f33a7400640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a00cb940 con 0x7f3384003980 2024-04-18T04:45:16.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.848+0000 7f33a7400640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a01571e0 con 0x7f33a01567c0 2024-04-18T04:45:16.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.848+0000 7f33a7400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a01f31a0 con 0x7f33a0156c20 2024-04-18T04:45:16.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.848+0000 7f33a4a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3384003980 0x7f33a00c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:16.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.848+0000 7f33a4a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3384003980 0x7f33a00c5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46744/0 (socket says 172.21.15.120:46744) 2024-04-18T04:45:16.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.848+0000 7f33a4a00640 1 -- 172.21.15.120:0/596228729 learned_addr learned my addr 172.21.15.120:0/596228729 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:16.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.848+0000 7f33a5400640 1 --2- 172.21.15.120:0/596228729 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f33a0156c20 0x7f33a01f01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:16.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.848+0000 7f339fe00640 1 --2- 172.21.15.120:0/596228729 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33a01567c0 0x7f33a01efc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:16.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.848+0000 7f33a4a00640 1 -- 172.21.15.120:0/596228729 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f33a0156c20 msgr2=0x7f33a01f01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:16.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.848+0000 7f33a4a00640 1 --2- 172.21.15.120:0/596228729 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f33a0156c20 0x7f33a01f01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:16.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.848+0000 7f33a4a00640 1 -- 172.21.15.120:0/596228729 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33a01567c0 msgr2=0x7f33a01efc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:16.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.848+0000 7f33a4a00640 1 --2- 172.21.15.120:0/596228729 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33a01567c0 0x7f33a01efc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:16.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.848+0000 7f33a4a00640 1 -- 172.21.15.120:0/596228729 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a01f3480 con 0x7f3384003980 2024-04-18T04:45:16.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.848+0000 7f33a4a00640 1 --2- 172.21.15.120:0/596228729 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3384003980 0x7f33a00c5cb0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3390000f90 tx=0x7f3384005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:16.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.848+0000 7f339cc00640 1 -- 172.21.15.120:0/596228729 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3390003b80 con 0x7f3384003980 2024-04-18T04:45:16.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.848+0000 7f339cc00640 1 -- 172.21.15.120:0/596228729 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33900050d0 con 0x7f3384003980 2024-04-18T04:45:16.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.848+0000 7f339cc00640 1 -- 172.21.15.120:0/596228729 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3390005440 con 0x7f3384003980 2024-04-18T04:45:16.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.848+0000 7f33a7400640 1 -- 172.21.15.120:0/596228729 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33a01f3760 con 0x7f3384003980 2024-04-18T04:45:16.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.848+0000 7f33a7400640 1 -- 172.21.15.120:0/596228729 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33a00c61f0 con 0x7f3384003980 2024-04-18T04:45:16.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.848+0000 7f33a7400640 1 -- 172.21.15.120:0/596228729 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33a0067590 con 0x7f3384003980 2024-04-18T04:45:16.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.848+0000 7f339cc00640 1 -- 172.21.15.120:0/596228729 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f33900b2050 con 0x7f3384003980 2024-04-18T04:45:16.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.852+0000 7f339cc00640 1 --2- 172.21.15.120:0/596228729 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3380066690 0x7f3380068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:16.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.852+0000 7f339cc00640 1 -- 172.21.15.120:0/596228729 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f339011e780 con 0x7f3384003980 2024-04-18T04:45:16.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.852+0000 7f339fe00640 1 --2- 172.21.15.120:0/596228729 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3380066690 0x7f3380068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:16.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.852+0000 7f339fe00640 1 --2- 172.21.15.120:0/596228729 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3380066690 0x7f3380068b50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f338c001ec0 tx=0x7f338c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:16.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:16.856+0000 7f339cc00640 1 -- 172.21.15.120:0/596228729 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f33900ef120 con 0x7f3384003980 2024-04-18T04:45:17.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.008+0000 7f33a7400640 1 -- 172.21.15.120:0/596228729 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f33a00729d0 con 0x7f3384003980 2024-04-18T04:45:17.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.008+0000 7f339cc00640 1 -- 172.21.15.120:0/596228729 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f33900eecb0 con 0x7f3384003980 2024-04-18T04:45:17.011 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2024-04-18T04:45:17.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.012+0000 7f33a7400640 1 -- 172.21.15.120:0/596228729 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3380066690 msgr2=0x7f3380068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:17.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.012+0000 7f33a7400640 1 --2- 172.21.15.120:0/596228729 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3380066690 0x7f3380068b50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f338c001ec0 tx=0x7f338c009040 comp rx=0 tx=0).stop 2024-04-18T04:45:17.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.012+0000 7f33a7400640 1 -- 172.21.15.120:0/596228729 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3384003980 msgr2=0x7f33a00c5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:17.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.012+0000 7f33a7400640 1 --2- 172.21.15.120:0/596228729 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3384003980 0x7f33a00c5cb0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3390000f90 tx=0x7f3384005800 comp rx=0 tx=0).stop 2024-04-18T04:45:17.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.012+0000 7f33a7400640 1 -- 172.21.15.120:0/596228729 shutdown_connections 2024-04-18T04:45:17.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.012+0000 7f33a7400640 1 --2- 172.21.15.120:0/596228729 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3380066690 0x7f3380068b50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:17.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.012+0000 7f33a7400640 1 --2- 172.21.15.120:0/596228729 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f33a0156c20 0x7f33a01f01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:17.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.012+0000 7f33a7400640 1 --2- 172.21.15.120:0/596228729 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33a01567c0 0x7f33a01efc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:17.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.012+0000 7f33a7400640 1 --2- 172.21.15.120:0/596228729 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3384003980 0x7f33a00c5cb0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:17.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.012+0000 7f33a7400640 1 -- 172.21.15.120:0/596228729 >> 172.21.15.120:0/596228729 conn(0x7f33a006b780 msgr2=0x7f33a0158e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:17.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.012+0000 7f33a7400640 1 -- 172.21.15.120:0/596228729 shutdown_connections 2024-04-18T04:45:17.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.012+0000 7f33a7400640 1 -- 172.21.15.120:0/596228729 wait complete. 2024-04-18T04:45:17.032 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T04:45:17.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.172+0000 7f1019c00640 1 Processor -- start 2024-04-18T04:45:17.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.172+0000 7f1019c00640 1 -- start start 2024-04-18T04:45:17.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.172+0000 7f1019c00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1014066200 0x7f10140c1e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:17.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.172+0000 7f1019c00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f10140c7820 0x7f10140c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:17.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.172+0000 7f1019c00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1014157ac0 con 0x7f1014065e20 2024-04-18T04:45:17.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.172+0000 7f1019c00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10140c2990 con 0x7f10140c7820 2024-04-18T04:45:17.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.172+0000 7f1019c00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f101415aa40 con 0x7f1014066200 2024-04-18T04:45:17.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.172+0000 7f1013e00640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f1014065e20 0x7f10141573b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:35318/0 (socket says 172.21.15.120:35318) 2024-04-18T04:45:17.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.172+0000 7f1013e00640 1 -- 172.21.15.120:0/4070778731 learned_addr learned my addr 172.21.15.120:0/4070778731 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:45:17.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.172+0000 7f1019200640 1 --2- 172.21.15.120:0/4070778731 >> v2:172.21.15.120:3300/0 conn(0x7f10140c7820 0x7f10140c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:17.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.176+0000 7f100b400640 1 --2- 172.21.15.120:0/4070778731 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1014066200 0x7f10140c1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:17.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.176+0000 7f1013400640 1 -- 172.21.15.120:0/4070778731 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 15563269 0 0) 0x7f1014157ac0 con 0x7f1014065e20 2024-04-18T04:45:17.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.176+0000 7f1013400640 1 -- 172.21.15.120:0/4070778731 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ff8003530 con 0x7f1014065e20 2024-04-18T04:45:17.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.176+0000 7f1019200640 1 -- 172.21.15.120:0/4070778731 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1014066200 msgr2=0x7f10140c1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:17.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.176+0000 7f1019200640 1 --2- 172.21.15.120:0/4070778731 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1014066200 0x7f10140c1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:17.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.176+0000 7f1019200640 1 -- 172.21.15.120:0/4070778731 >> v1:172.21.15.120:6789/0 conn(0x7f1014065e20 legacy=0x7f10141573b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:17.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.176+0000 7f1019200640 1 -- 172.21.15.120:0/4070778731 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f101415ace0 con 0x7f10140c7820 2024-04-18T04:45:17.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.176+0000 7f1019200640 1 --2- 172.21.15.120:0/4070778731 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f10140c7820 0x7f10140c65f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f100c009d90 tx=0x7f100c01f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b63bcd374773a92 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:17.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.176+0000 7f1013400640 1 -- 172.21.15.120:0/4070778731 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c0af600 con 0x7f10140c7820 2024-04-18T04:45:17.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.176+0000 7f1013400640 1 -- 172.21.15.120:0/4070778731 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100c0ab050 con 0x7f10140c7820 2024-04-18T04:45:17.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.176+0000 7f1013400640 1 -- 172.21.15.120:0/4070778731 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c0af960 con 0x7f10140c7820 2024-04-18T04:45:17.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.180+0000 7f1019c00640 1 -- 172.21.15.120:0/4070778731 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f10140c7820 msgr2=0x7f10140c65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:17.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.180+0000 7f1019c00640 1 --2- 172.21.15.120:0/4070778731 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f10140c7820 0x7f10140c65f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f100c009d90 tx=0x7f100c01f150 comp rx=0 tx=0).stop 2024-04-18T04:45:17.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.180+0000 7f1019c00640 1 -- 172.21.15.120:0/4070778731 shutdown_connections 2024-04-18T04:45:17.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.180+0000 7f1019c00640 1 --2- 172.21.15.120:0/4070778731 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f10140c7820 0x7f10140c65f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:17.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.180+0000 7f1019c00640 1 --2- 172.21.15.120:0/4070778731 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1014066200 0x7f10140c1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:17.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.180+0000 7f1019c00640 1 -- 172.21.15.120:0/4070778731 >> 172.21.15.120:0/4070778731 conn(0x7f101406da30 msgr2=0x7f1014071830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:17.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.180+0000 7f1019c00640 1 -- 172.21.15.120:0/4070778731 shutdown_connections 2024-04-18T04:45:17.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.180+0000 7f1019c00640 1 -- 172.21.15.120:0/4070778731 wait complete. 2024-04-18T04:45:17.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.180+0000 7f1019c00640 1 Processor -- start 2024-04-18T04:45:17.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.180+0000 7f1019c00640 1 -- start start 2024-04-18T04:45:17.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.180+0000 7f1019c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1014065e20 0x7f10141f0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:17.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.180+0000 7f1019c00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1014066200 0x7f101414df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:17.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.180+0000 7f1019c00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f10140c7820 0x7f10141f1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:17.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.180+0000 7f1019c00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1014156470 con 0x7f1014065e20 2024-04-18T04:45:17.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.180+0000 7f1019c00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10141e2d20 con 0x7f10140c7820 2024-04-18T04:45:17.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.180+0000 7f1019c00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10141f2c60 con 0x7f1014066200 2024-04-18T04:45:17.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.180+0000 7f1013e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1014065e20 0x7f10141f0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:17.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.180+0000 7f1013e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1014065e20 0x7f10141f0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46756/0 (socket says 172.21.15.120:46756) 2024-04-18T04:45:17.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.180+0000 7f1013e00640 1 -- 172.21.15.120:0/1239314785 learned_addr learned my addr 172.21.15.120:0/1239314785 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:17.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.180+0000 7f1019200640 1 --2- 172.21.15.120:0/1239314785 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f10140c7820 0x7f10141f1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:17.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.180+0000 7f100b400640 1 --2- 172.21.15.120:0/1239314785 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1014066200 0x7f101414df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:17.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.180+0000 7f1013e00640 1 -- 172.21.15.120:0/1239314785 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1014066200 msgr2=0x7f101414df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:17.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.180+0000 7f1013e00640 1 --2- 172.21.15.120:0/1239314785 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1014066200 0x7f101414df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:17.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.180+0000 7f1013e00640 1 -- 172.21.15.120:0/1239314785 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f10140c7820 msgr2=0x7f10141f1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:17.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.180+0000 7f1013e00640 1 --2- 172.21.15.120:0/1239314785 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f10140c7820 0x7f10141f1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:17.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.180+0000 7f1013e00640 1 -- 172.21.15.120:0/1239314785 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f100c009a70 con 0x7f1014065e20 2024-04-18T04:45:17.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.180+0000 7f1013e00640 1 --2- 172.21.15.120:0/1239314785 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1014065e20 0x7f10141f0890 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f100400c480 tx=0x7f100400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:17.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.184+0000 7f1010c00640 1 -- 172.21.15.120:0/1239314785 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1004005cf0 con 0x7f1014065e20 2024-04-18T04:45:17.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.184+0000 7f1010c00640 1 -- 172.21.15.120:0/1239314785 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1004005e50 con 0x7f1014065e20 2024-04-18T04:45:17.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.184+0000 7f1010c00640 1 -- 172.21.15.120:0/1239314785 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1004007290 con 0x7f1014065e20 2024-04-18T04:45:17.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.184+0000 7f1019c00640 1 -- 172.21.15.120:0/1239314785 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10140cd2d0 con 0x7f1014065e20 2024-04-18T04:45:17.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.184+0000 7f1019c00640 1 -- 172.21.15.120:0/1239314785 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1014157010 con 0x7f1014065e20 2024-04-18T04:45:17.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.184+0000 7f1019c00640 1 -- 172.21.15.120:0/1239314785 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10140728f0 con 0x7f1014065e20 2024-04-18T04:45:17.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.184+0000 7f1010c00640 1 -- 172.21.15.120:0/1239314785 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f10040073f0 con 0x7f1014065e20 2024-04-18T04:45:17.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.184+0000 7f1010c00640 1 --2- 172.21.15.120:0/1239314785 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0ff00666c0 0x7f0ff0068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:17.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.184+0000 7f1010c00640 1 -- 172.21.15.120:0/1239314785 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1004083b50 con 0x7f1014065e20 2024-04-18T04:45:17.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.184+0000 7f100b400640 1 --2- 172.21.15.120:0/1239314785 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0ff00666c0 0x7f0ff0068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:17.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.188+0000 7f100b400640 1 --2- 172.21.15.120:0/1239314785 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0ff00666c0 0x7f0ff0068b80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1014156f20 tx=0x7f0ffc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:17.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.188+0000 7f1010c00640 1 -- 172.21.15.120:0/1239314785 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f1004050b00 con 0x7f1014065e20 2024-04-18T04:45:17.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.344+0000 7f1019c00640 1 -- 172.21.15.120:0/1239314785 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f10140c7600 con 0x7f1014065e20 2024-04-18T04:45:17.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.344+0000 7f1010c00640 1 -- 172.21.15.120:0/1239314785 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1004017070 con 0x7f1014065e20 2024-04-18T04:45:17.345 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 64 2024-04-18T04:45:17.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.344+0000 7f1019c00640 1 -- 172.21.15.120:0/1239314785 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0ff00666c0 msgr2=0x7f0ff0068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:17.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.344+0000 7f1019c00640 1 --2- 172.21.15.120:0/1239314785 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0ff00666c0 0x7f0ff0068b80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1014156f20 tx=0x7f0ffc008040 comp rx=0 tx=0).stop 2024-04-18T04:45:17.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.344+0000 7f1019c00640 1 -- 172.21.15.120:0/1239314785 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1014065e20 msgr2=0x7f10141f0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:17.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.344+0000 7f1019c00640 1 --2- 172.21.15.120:0/1239314785 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1014065e20 0x7f10141f0890 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f100400c480 tx=0x7f100400c940 comp rx=0 tx=0).stop 2024-04-18T04:45:17.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.344+0000 7f1019c00640 1 -- 172.21.15.120:0/1239314785 shutdown_connections 2024-04-18T04:45:17.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.344+0000 7f1019c00640 1 --2- 172.21.15.120:0/1239314785 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0ff00666c0 0x7f0ff0068b80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:17.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.344+0000 7f1019c00640 1 --2- 172.21.15.120:0/1239314785 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f10140c7820 0x7f10141f1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:17.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.344+0000 7f1019c00640 1 --2- 172.21.15.120:0/1239314785 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1014066200 0x7f101414df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:17.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.344+0000 7f1019c00640 1 --2- 172.21.15.120:0/1239314785 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1014065e20 0x7f10141f0890 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:17.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.344+0000 7f1019c00640 1 -- 172.21.15.120:0/1239314785 >> 172.21.15.120:0/1239314785 conn(0x7f101406da30 msgr2=0x7f1014157260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:17.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.344+0000 7f1019c00640 1 -- 172.21.15.120:0/1239314785 shutdown_connections 2024-04-18T04:45:17.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.344+0000 7f1019c00640 1 -- 172.21.15.120:0/1239314785 wait complete. 2024-04-18T04:45:17.366 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-18T04:45:17.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.500+0000 7fc4fd200640 1 Processor -- start 2024-04-18T04:45:17.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.504+0000 7fc4fd200640 1 -- start start 2024-04-18T04:45:17.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.504+0000 7fc4fd200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc4f8158150 0x7fc4f80c73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:17.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.504+0000 7fc4fd200640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4f8072640 con 0x7fc4f80caff0 2024-04-18T04:45:17.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.504+0000 7fc4fd200640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4f8072360 con 0x7fc4f8151730 2024-04-18T04:45:17.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.504+0000 7fc4fd200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f8071120 con 0x7fc4f8158150 2024-04-18T04:45:17.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.504+0000 7fc4f6800640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fc4f80caff0 0x7fc4f8161eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:35320/0 (socket says 172.21.15.120:35320) 2024-04-18T04:45:17.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.504+0000 7fc4f6800640 1 -- 172.21.15.120:0/2903662707 learned_addr learned my addr 172.21.15.120:0/2903662707 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:45:17.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.504+0000 7fc4f5400640 1 --2- 172.21.15.120:0/2903662707 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc4f8158150 0x7fc4f80c73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:17.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.504+0000 7fc4f4a00640 1 -- 172.21.15.120:0/2903662707 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 825135790 0 0) 0x7fc4f8072640 con 0x7fc4f80caff0 2024-04-18T04:45:17.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.504+0000 7fc4f4a00640 1 -- 172.21.15.120:0/2903662707 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4dc003530 con 0x7fc4f80caff0 2024-04-18T04:45:17.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.504+0000 7fc4f4a00640 1 -- 172.21.15.120:0/2903662707 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1472994361 0 0) 0x7fc4f8072360 con 0x7fc4f8151730 2024-04-18T04:45:17.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.504+0000 7fc4f4a00640 1 -- 172.21.15.120:0/2903662707 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4f8072640 con 0x7fc4f8151730 2024-04-18T04:45:17.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.504+0000 7fc4f4a00640 1 -- 172.21.15.120:0/2903662707 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1974879887 0 0) 0x7fc4dc003530 con 0x7fc4f80caff0 2024-04-18T04:45:17.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.504+0000 7fc4f5400640 1 -- 172.21.15.120:0/2903662707 >> v1:172.21.15.132:6789/0 conn(0x7fc4f8151730 legacy=0x7fc4f806dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:17.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.504+0000 7fc4f5400640 1 -- 172.21.15.120:0/2903662707 >> v1:172.21.15.120:6789/0 conn(0x7fc4f80caff0 legacy=0x7fc4f8161eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:17.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.504+0000 7fc4f5400640 1 -- 172.21.15.120:0/2903662707 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f806f9d0 con 0x7fc4f8158150 2024-04-18T04:45:17.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.508+0000 7fc4f5400640 1 --2- 172.21.15.120:0/2903662707 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc4f8158150 0x7fc4f80c73d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc4e40097f0 tx=0x7fc4e401c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f31eb83eff2d4aba server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:17.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.508+0000 7fc4f4a00640 1 -- 172.21.15.120:0/2903662707 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f0001680 con 0x7fc4f8158150 2024-04-18T04:45:17.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.508+0000 7fc4f4a00640 1 -- 172.21.15.120:0/2903662707 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e40a7050 con 0x7fc4f8158150 2024-04-18T04:45:17.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.508+0000 7fc4f4a00640 1 -- 172.21.15.120:0/2903662707 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e40ab620 con 0x7fc4f8158150 2024-04-18T04:45:17.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.508+0000 7fc4fd200640 1 -- 172.21.15.120:0/2903662707 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc4f8158150 msgr2=0x7fc4f80c73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:17.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.508+0000 7fc4fd200640 1 --2- 172.21.15.120:0/2903662707 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc4f8158150 0x7fc4f80c73d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc4e40097f0 tx=0x7fc4e401c400 comp rx=0 tx=0).stop 2024-04-18T04:45:17.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.508+0000 7fc4fd200640 1 -- 172.21.15.120:0/2903662707 shutdown_connections 2024-04-18T04:45:17.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.508+0000 7fc4fd200640 1 --2- 172.21.15.120:0/2903662707 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc4f8158150 0x7fc4f80c73d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:17.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.508+0000 7fc4fd200640 1 -- 172.21.15.120:0/2903662707 >> 172.21.15.120:0/2903662707 conn(0x7fc4f806b780 msgr2=0x7fc4f806bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:17.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.508+0000 7fc4fd200640 1 -- 172.21.15.120:0/2903662707 shutdown_connections 2024-04-18T04:45:17.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.508+0000 7fc4fd200640 1 -- 172.21.15.120:0/2903662707 wait complete. 2024-04-18T04:45:17.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.512+0000 7fc4fd200640 1 Processor -- start 2024-04-18T04:45:17.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.512+0000 7fc4fd200640 1 -- start start 2024-04-18T04:45:17.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.512+0000 7fc4fd200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4f80caff0 0x7fc4f80c5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:17.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.512+0000 7fc4fd200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4f8151730 0x7fc4f81f3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:17.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.512+0000 7fc4fd200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc4f8158150 0x7fc4f81f36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:17.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.512+0000 7fc4fd200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f8151130 con 0x7fc4f80caff0 2024-04-18T04:45:17.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.512+0000 7fc4fd200640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f8155770 con 0x7fc4f8151730 2024-04-18T04:45:17.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.512+0000 7fc4fd200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f8152d50 con 0x7fc4f8158150 2024-04-18T04:45:17.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.512+0000 7fc4f5e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4f80caff0 0x7fc4f80c5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:17.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.512+0000 7fc4f5e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4f80caff0 0x7fc4f80c5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46766/0 (socket says 172.21.15.120:46766) 2024-04-18T04:45:17.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.512+0000 7fc4f5e00640 1 -- 172.21.15.120:0/1626132009 learned_addr learned my addr 172.21.15.120:0/1626132009 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:17.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.512+0000 7fc4f5400640 1 --2- 172.21.15.120:0/1626132009 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4f8151730 0x7fc4f81f3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:17.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.512+0000 7fc4f6800640 1 --2- 172.21.15.120:0/1626132009 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc4f8158150 0x7fc4f81f36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:17.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.512+0000 7fc4f5e00640 1 -- 172.21.15.120:0/1626132009 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc4f8158150 msgr2=0x7fc4f81f36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:17.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.512+0000 7fc4f5e00640 1 --2- 172.21.15.120:0/1626132009 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc4f8158150 0x7fc4f81f36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:17.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.512+0000 7fc4f5e00640 1 -- 172.21.15.120:0/1626132009 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4f8151730 msgr2=0x7fc4f81f3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:17.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.512+0000 7fc4f5e00640 1 --2- 172.21.15.120:0/1626132009 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4f8151730 0x7fc4f81f3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:17.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.512+0000 7fc4f5e00640 1 -- 172.21.15.120:0/1626132009 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e4009420 con 0x7fc4f80caff0 2024-04-18T04:45:17.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.512+0000 7fc4f6800640 1 --2- 172.21.15.120:0/1626132009 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc4f8158150 0x7fc4f81f36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:17.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.512+0000 7fc4f5e00640 1 --2- 172.21.15.120:0/1626132009 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4f80caff0 0x7fc4f80c5710 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc4e800c8a0 tx=0x7fc4e800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:17.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.512+0000 7fc4ee000640 1 -- 172.21.15.120:0/1626132009 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e8003b80 con 0x7fc4f80caff0 2024-04-18T04:45:17.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.512+0000 7fc4ee000640 1 -- 172.21.15.120:0/1626132009 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e8003ce0 con 0x7fc4f80caff0 2024-04-18T04:45:17.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.512+0000 7fc4fd200640 1 -- 172.21.15.120:0/1626132009 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4f8152a70 con 0x7fc4f80caff0 2024-04-18T04:45:17.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.512+0000 7fc4ee000640 1 -- 172.21.15.120:0/1626132009 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e800aa30 con 0x7fc4f80caff0 2024-04-18T04:45:17.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.512+0000 7fc4fd200640 1 -- 172.21.15.120:0/1626132009 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4f80c0440 con 0x7fc4f80caff0 2024-04-18T04:45:17.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.512+0000 7fc4fd200640 1 -- 172.21.15.120:0/1626132009 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4f80729d0 con 0x7fc4f80caff0 2024-04-18T04:45:17.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.516+0000 7fc4ee000640 1 -- 172.21.15.120:0/1626132009 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc4e800ab90 con 0x7fc4f80caff0 2024-04-18T04:45:17.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.516+0000 7fc4ee000640 1 --2- 172.21.15.120:0/1626132009 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc4d8066690 0x7fc4d8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:17.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.516+0000 7fc4ee000640 1 -- 172.21.15.120:0/1626132009 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc4e80843f0 con 0x7fc4f80caff0 2024-04-18T04:45:17.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.516+0000 7fc4f5400640 1 --2- 172.21.15.120:0/1626132009 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc4d8066690 0x7fc4d8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:17.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.516+0000 7fc4f5400640 1 --2- 172.21.15.120:0/1626132009 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc4d8066690 0x7fc4d8068b50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc4e40ad000 tx=0x7fc4e40a6000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:17.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.520+0000 7fc4ee000640 1 -- 172.21.15.120:0/1626132009 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fc4e8051390 con 0x7fc4f80caff0 2024-04-18T04:45:17.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.672+0000 7fc4fd200640 1 -- 172.21.15.120:0/1626132009 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc4f80c4ee0 con 0x7fc4f80caff0 2024-04-18T04:45:17.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.672+0000 7fc4ee000640 1 -- 172.21.15.120:0/1626132009 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc4e80549b0 con 0x7fc4f80caff0 2024-04-18T04:45:17.672 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2024-04-18T04:45:17.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.672+0000 7fc4fd200640 1 -- 172.21.15.120:0/1626132009 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc4d8066690 msgr2=0x7fc4d8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:17.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.672+0000 7fc4fd200640 1 --2- 172.21.15.120:0/1626132009 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc4d8066690 0x7fc4d8068b50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc4e40ad000 tx=0x7fc4e40a6000 comp rx=0 tx=0).stop 2024-04-18T04:45:17.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.672+0000 7fc4fd200640 1 -- 172.21.15.120:0/1626132009 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4f80caff0 msgr2=0x7fc4f80c5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:17.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.672+0000 7fc4fd200640 1 --2- 172.21.15.120:0/1626132009 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4f80caff0 0x7fc4f80c5710 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc4e800c8a0 tx=0x7fc4e800cd60 comp rx=0 tx=0).stop 2024-04-18T04:45:17.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.672+0000 7fc4fd200640 1 -- 172.21.15.120:0/1626132009 shutdown_connections 2024-04-18T04:45:17.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.672+0000 7fc4fd200640 1 --2- 172.21.15.120:0/1626132009 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc4d8066690 0x7fc4d8068b50 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:17.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.672+0000 7fc4fd200640 1 --2- 172.21.15.120:0/1626132009 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc4f8158150 0x7fc4f81f36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:17.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.672+0000 7fc4fd200640 1 --2- 172.21.15.120:0/1626132009 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4f8151730 0x7fc4f81f3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:17.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.672+0000 7fc4fd200640 1 --2- 172.21.15.120:0/1626132009 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4f80caff0 0x7fc4f80c5710 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:17.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.672+0000 7fc4fd200640 1 -- 172.21.15.120:0/1626132009 >> 172.21.15.120:0/1626132009 conn(0x7fc4f806b780 msgr2=0x7fc4f806bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:17.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.672+0000 7fc4fd200640 1 -- 172.21.15.120:0/1626132009 shutdown_connections 2024-04-18T04:45:17.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.672+0000 7fc4fd200640 1 -- 172.21.15.120:0/1626132009 wait complete. 2024-04-18T04:45:17.693 INFO:tasks.mds_thrash:mds thrasher using random seed: 1713415517 2024-04-18T04:45:17.693 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T04:45:17.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.828+0000 7f76edc00640 1 Processor -- start 2024-04-18T04:45:17.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.828+0000 7f76edc00640 1 -- start start 2024-04-18T04:45:17.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.828+0000 7f76edc00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f76e80c7480 0x7f76e80c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:17.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.828+0000 7f76edc00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f76e80bfe70 0x7f76e80c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:17.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.828+0000 7f76edc00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e806f9b0 con 0x7f76e8150340 2024-04-18T04:45:17.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.828+0000 7f76edc00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76e8156b40 con 0x7f76e80c7480 2024-04-18T04:45:17.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.828+0000 7f76edc00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76e80c0520 con 0x7f76e80bfe70 2024-04-18T04:45:17.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.832+0000 7f76de000640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f76e80c7480 0x7f76e80c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:17.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.832+0000 7f76de000640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f76e80c7480 0x7f76e80c68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46770/0 (socket says 172.21.15.120:46770) 2024-04-18T04:45:17.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.832+0000 7f76de000640 1 -- 172.21.15.120:0/1540603853 learned_addr learned my addr 172.21.15.120:0/1540603853 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:17.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.832+0000 7f76e7400640 1 --2- 172.21.15.120:0/1540603853 >> v2:172.21.15.132:3300/0 conn(0x7f76e80bfe70 0x7f76e80c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:17.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.832+0000 7f76de000640 1 -- 172.21.15.120:0/1540603853 >> v2:172.21.15.132:3300/0 conn(0x7f76e80bfe70 msgr2=0x7f76e80c6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:17.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.832+0000 7f76de000640 1 --2- 172.21.15.120:0/1540603853 >> v2:172.21.15.132:3300/0 conn(0x7f76e80bfe70 0x7f76e80c6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:17.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.832+0000 7f76de000640 1 -- 172.21.15.120:0/1540603853 >> v1:172.21.15.132:6789/0 conn(0x7f76e8150340 legacy=0x7f76e8156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:17.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.832+0000 7f76de000640 1 -- 172.21.15.120:0/1540603853 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e80c0800 con 0x7f76e80c7480 2024-04-18T04:45:17.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.832+0000 7f76de000640 1 --2- 172.21.15.120:0/1540603853 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f76e80c7480 0x7f76e80c68d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f76e8071a20 tx=0x7f76d001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a926f217d3290ae server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:17.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.832+0000 7f76e6000640 1 -- 172.21.15.120:0/1540603853 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d00a8a10 con 0x7f76e80c7480 2024-04-18T04:45:17.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.832+0000 7f76e6000640 1 -- 172.21.15.120:0/1540603853 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d00a8b70 con 0x7f76e80c7480 2024-04-18T04:45:17.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.832+0000 7f76e6000640 1 -- 172.21.15.120:0/1540603853 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d00b0440 con 0x7f76e80c7480 2024-04-18T04:45:17.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.836+0000 7f76edc00640 1 -- 172.21.15.120:0/1540603853 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f76e80c7480 msgr2=0x7f76e80c68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:17.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.836+0000 7f76edc00640 1 --2- 172.21.15.120:0/1540603853 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f76e80c7480 0x7f76e80c68d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f76e8071a20 tx=0x7f76d001ed10 comp rx=0 tx=0).stop 2024-04-18T04:45:17.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.836+0000 7f76edc00640 1 -- 172.21.15.120:0/1540603853 shutdown_connections 2024-04-18T04:45:17.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.836+0000 7f76edc00640 1 --2- 172.21.15.120:0/1540603853 >> v2:172.21.15.132:3300/0 conn(0x7f76e80bfe70 0x7f76e80c6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:17.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.836+0000 7f76edc00640 1 --2- 172.21.15.120:0/1540603853 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f76e80c7480 0x7f76e80c68d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:17.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.836+0000 7f76edc00640 1 -- 172.21.15.120:0/1540603853 >> 172.21.15.120:0/1540603853 conn(0x7f76e80c78c0 msgr2=0x7f76e80c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:17.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.836+0000 7f76edc00640 1 -- 172.21.15.120:0/1540603853 shutdown_connections 2024-04-18T04:45:17.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.836+0000 7f76edc00640 1 -- 172.21.15.120:0/1540603853 wait complete. 2024-04-18T04:45:17.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.836+0000 7f76edc00640 1 Processor -- start 2024-04-18T04:45:17.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.836+0000 7f76edc00640 1 -- start start 2024-04-18T04:45:17.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.836+0000 7f76edc00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f76e80bfe70 0x7f76e81f0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:17.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.836+0000 7f76edc00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76e80c7480 0x7f76e80ca620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:17.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.836+0000 7f76edc00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f76e8150340 0x7f76e81ecde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:17.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.836+0000 7f76edc00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e81f0ab0 con 0x7f76e8150340 2024-04-18T04:45:17.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.836+0000 7f76edc00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e814bf90 con 0x7f76e80c7480 2024-04-18T04:45:17.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.836+0000 7f76edc00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e814c270 con 0x7f76e80bfe70 2024-04-18T04:45:17.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.836+0000 7f76e7400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f76e8150340 0x7f76e81ecde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:17.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.836+0000 7f76e7400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f76e8150340 0x7f76e81ecde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46780/0 (socket says 172.21.15.120:46780) 2024-04-18T04:45:17.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.836+0000 7f76e7400640 1 -- 172.21.15.120:0/2549798979 learned_addr learned my addr 172.21.15.120:0/2549798979 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:17.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.836+0000 7f76de000640 1 --2- 172.21.15.120:0/2549798979 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76e80c7480 0x7f76e80ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:17.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.836+0000 7f76e6a00640 1 --2- 172.21.15.120:0/2549798979 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f76e80bfe70 0x7f76e81f0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:17.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.836+0000 7f76e7400640 1 -- 172.21.15.120:0/2549798979 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f76e80bfe70 msgr2=0x7f76e81f0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:17.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.836+0000 7f76e7400640 1 --2- 172.21.15.120:0/2549798979 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f76e80bfe70 0x7f76e81f0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:17.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.836+0000 7f76e7400640 1 -- 172.21.15.120:0/2549798979 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76e80c7480 msgr2=0x7f76e80ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:17.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.836+0000 7f76e7400640 1 --2- 172.21.15.120:0/2549798979 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76e80c7480 0x7f76e80ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:17.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.836+0000 7f76e7400640 1 -- 172.21.15.120:0/2549798979 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d00094d0 con 0x7f76e8150340 2024-04-18T04:45:17.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.840+0000 7f76e7400640 1 --2- 172.21.15.120:0/2549798979 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f76e8150340 0x7f76e81ecde0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f76e000efc0 tx=0x7f76e000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:17.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.840+0000 7f76df400640 1 -- 172.21.15.120:0/2549798979 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e0009b10 con 0x7f76e8150340 2024-04-18T04:45:17.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.840+0000 7f76df400640 1 -- 172.21.15.120:0/2549798979 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e000f040 con 0x7f76e8150340 2024-04-18T04:45:17.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.840+0000 7f76df400640 1 -- 172.21.15.120:0/2549798979 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e00146c0 con 0x7f76e8150340 2024-04-18T04:45:17.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.840+0000 7f76edc00640 1 -- 172.21.15.120:0/2549798979 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76e81f03f0 con 0x7f76e8150340 2024-04-18T04:45:17.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.840+0000 7f76edc00640 1 -- 172.21.15.120:0/2549798979 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e814b940 con 0x7f76e8150340 2024-04-18T04:45:17.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.840+0000 7f76edc00640 1 -- 172.21.15.120:0/2549798979 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76e80726d0 con 0x7f76e8150340 2024-04-18T04:45:17.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.840+0000 7f76df400640 1 -- 172.21.15.120:0/2549798979 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f76e0014820 con 0x7f76e8150340 2024-04-18T04:45:17.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.840+0000 7f76df400640 1 --2- 172.21.15.120:0/2549798979 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f76c4066690 0x7f76c4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:17.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.840+0000 7f76df400640 1 -- 172.21.15.120:0/2549798979 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f76e0084fd0 con 0x7f76e8150340 2024-04-18T04:45:17.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.840+0000 7f76e6a00640 1 --2- 172.21.15.120:0/2549798979 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f76c4066690 0x7f76c4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:17.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.844+0000 7f76e6a00640 1 --2- 172.21.15.120:0/2549798979 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f76c4066690 0x7f76c4068b50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f76d8007fd0 tx=0x7f76d8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:17.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:17.844+0000 7f76df400640 1 -- 172.21.15.120:0/2549798979 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f76e0051f90 con 0x7f76e8150340 2024-04-18T04:45:18.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.004+0000 7f76edc00640 1 -- 172.21.15.120:0/2549798979 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76e8073e10 con 0x7f76e8150340 2024-04-18T04:45:18.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.004+0000 7f76df400640 1 -- 172.21.15.120:0/2549798979 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18257 (secure 0 0 0) 0x7f76e0018020 con 0x7f76e8150340 2024-04-18T04:45:18.006 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:45:18.006 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":27,"fsid":"8e73592f-08e2-4957-a98f-9d044cec4ba5","created":"2024-04-18T04:44:06.139983+0000","modified":"2024-04-18T04:45:12.029792+0000","last_up_change":"2024-04-18T04:44:17.410146+0000","last_in_change":"2024-04-18T04:44:08.470250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T04:44:16.864728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T04:44:28.825773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T04:44:29.245857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-18T04:44:32.314302+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a80903bd-d9be-4fb9-af99-6125cb26bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":27468},{"type":"v1","addr":"172.21.15.120:6801","nonce":27468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":27468},{"type":"v1","addr":"172.21.15.120:6803","nonce":27468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":27468},{"type":"v1","addr":"172.21.15.120:6807","nonce":27468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":27468},{"type":"v1","addr":"172.21.15.120:6805","nonce":27468}]},"public_addr":"172.21.15.120:6801/27468","cluster_addr":"172.21.15.120:6803/27468","heartbeat_back_addr":"172.21.15.120:6807/27468","heartbeat_front_addr":"172.21.15.120:6805/27468","state":["exists","up"]},{"osd":1,"uuid":"8f5f004b-6870-4c78-8d50-9622e631ec25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":27470},{"type":"v1","addr":"172.21.15.120:6823","nonce":27470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":27470},{"type":"v1","addr":"172.21.15.120:6827","nonce":27470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":27470},{"type":"v1","addr":"172.21.15.120:6831","nonce":27470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":27470},{"type":"v1","addr":"172.21.15.120:6829","nonce":27470}]},"public_addr":"172.21.15.120:6823/27470","cluster_addr":"172.21.15.120:6827/27470","heartbeat_back_addr":"172.21.15.120:6831/27470","heartbeat_front_addr":"172.21.15.120:6829/27470","state":["exists","up"]},{"osd":2,"uuid":"6e228a2b-6103-4301-a8b5-ee81dbb1f920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":27471},{"type":"v1","addr":"172.21.15.120:6817","nonce":27471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":27471},{"type":"v1","addr":"172.21.15.120:6819","nonce":27471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":27471},{"type":"v1","addr":"172.21.15.120:6826","nonce":27471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":27471},{"type":"v1","addr":"172.21.15.120:6822","nonce":27471}]},"public_addr":"172.21.15.120:6817/27471","cluster_addr":"172.21.15.120:6819/27471","heartbeat_back_addr":"172.21.15.120:6826/27471","heartbeat_front_addr":"172.21.15.120:6822/27471","state":["exists","up"]},{"osd":3,"uuid":"7a5cabd7-d898-4e32-a03c-25b46e790134","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":27469},{"type":"v1","addr":"172.21.15.120:6809","nonce":27469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":27469},{"type":"v1","addr":"172.21.15.120:6811","nonce":27469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":27469},{"type":"v1","addr":"172.21.15.120:6815","nonce":27469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":27469},{"type":"v1","addr":"172.21.15.120:6813","nonce":27469}]},"public_addr":"172.21.15.120:6809/27469","cluster_addr":"172.21.15.120:6811/27469","heartbeat_back_addr":"172.21.15.120:6815/27469","heartbeat_front_addr":"172.21.15.120:6813/27469","state":["exists","up"]},{"osd":4,"uuid":"8e9f530f-6bab-4b23-a1a3-a71362fefcc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":28102},{"type":"v1","addr":"172.21.15.132:6825","nonce":28102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":28102},{"type":"v1","addr":"172.21.15.132:6827","nonce":28102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":28102},{"type":"v1","addr":"172.21.15.132:6831","nonce":28102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":28102},{"type":"v1","addr":"172.21.15.132:6829","nonce":28102}]},"public_addr":"172.21.15.132:6825/28102","cluster_addr":"172.21.15.132:6827/28102","heartbeat_back_addr":"172.21.15.132:6831/28102","heartbeat_front_addr":"172.21.15.132:6829/28102","state":["exists","up"]},{"osd":5,"uuid":"2243fabe-cc81-40cf-91bc-f106fe275a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":28104},{"type":"v1","addr":"172.21.15.132:6809","nonce":28104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":28104},{"type":"v1","addr":"172.21.15.132:6811","nonce":28104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":28104},{"type":"v1","addr":"172.21.15.132:6815","nonce":28104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":28104},{"type":"v1","addr":"172.21.15.132:6813","nonce":28104}]},"public_addr":"172.21.15.132:6809/28104","cluster_addr":"172.21.15.132:6811/28104","heartbeat_back_addr":"172.21.15.132:6815/28104","heartbeat_front_addr":"172.21.15.132:6813/28104","state":["exists","up"]},{"osd":6,"uuid":"c093a5ed-25c8-41a7-a20d-606a1a1661e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":28103},{"type":"v1","addr":"172.21.15.132:6801","nonce":28103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":28103},{"type":"v1","addr":"172.21.15.132:6803","nonce":28103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":28103},{"type":"v1","addr":"172.21.15.132:6807","nonce":28103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":28103},{"type":"v1","addr":"172.21.15.132:6805","nonce":28103}]},"public_addr":"172.21.15.132:6801/28103","cluster_addr":"172.21.15.132:6803/28103","heartbeat_back_addr":"172.21.15.132:6807/28103","heartbeat_front_addr":"172.21.15.132:6805/28103","state":["exists","up"]},{"osd":7,"uuid":"c37426b7-1080-4434-9f3e-a3afbbdc0fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":28129},{"type":"v1","addr":"172.21.15.132:6817","nonce":28129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":28129},{"type":"v1","addr":"172.21.15.132:6819","nonce":28129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":28129},{"type":"v1","addr":"172.21.15.132:6823","nonce":28129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":28129},{"type":"v1","addr":"172.21.15.132:6821","nonce":28129}]},"public_addr":"172.21.15.132:6817/28129","cluster_addr":"172.21.15.132:6819/28129","heartbeat_back_addr":"172.21.15.132:6823/28129","heartbeat_front_addr":"172.21.15.132:6821/28129","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.053825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.289753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.274645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.146361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.943883+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.701955+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.851076+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.800782+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":1}]},{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T04:45:18.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.008+0000 7f76edc00640 1 -- 172.21.15.120:0/2549798979 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f76c4066690 msgr2=0x7f76c4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:18.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.008+0000 7f76edc00640 1 --2- 172.21.15.120:0/2549798979 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f76c4066690 0x7f76c4068b50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f76d8007fd0 tx=0x7f76d8009040 comp rx=0 tx=0).stop 2024-04-18T04:45:18.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.008+0000 7f76edc00640 1 -- 172.21.15.120:0/2549798979 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f76e8150340 msgr2=0x7f76e81ecde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:18.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.008+0000 7f76edc00640 1 --2- 172.21.15.120:0/2549798979 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f76e8150340 0x7f76e81ecde0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f76e000efc0 tx=0x7f76e000c490 comp rx=0 tx=0).stop 2024-04-18T04:45:18.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.008+0000 7f76edc00640 1 -- 172.21.15.120:0/2549798979 shutdown_connections 2024-04-18T04:45:18.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.008+0000 7f76edc00640 1 --2- 172.21.15.120:0/2549798979 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f76c4066690 0x7f76c4068b50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:18.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.008+0000 7f76edc00640 1 --2- 172.21.15.120:0/2549798979 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f76e8150340 0x7f76e81ecde0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:18.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.008+0000 7f76edc00640 1 --2- 172.21.15.120:0/2549798979 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76e80c7480 0x7f76e80ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:18.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.008+0000 7f76edc00640 1 --2- 172.21.15.120:0/2549798979 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f76e80bfe70 0x7f76e81f0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:18.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.008+0000 7f76edc00640 1 -- 172.21.15.120:0/2549798979 >> 172.21.15.120:0/2549798979 conn(0x7f76e80c78c0 msgr2=0x7f76e80c67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:18.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.008+0000 7f76edc00640 1 -- 172.21.15.120:0/2549798979 shutdown_connections 2024-04-18T04:45:18.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.008+0000 7f76edc00640 1 -- 172.21.15.120:0/2549798979 wait complete. 2024-04-18T04:45:18.027 INFO:tasks.mds_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T04:44:16.864728+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T04:44:28.825773+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T04:44:29.245857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-18T04:44:32.314302+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-18T04:45:18.027 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T04:45:18.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.164+0000 7f6ca6800640 1 Processor -- start 2024-04-18T04:45:18.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.164+0000 7f6ca6800640 1 -- start start 2024-04-18T04:45:18.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.168+0000 7f6ca6800640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6ca0150820 0x7f6ca00c0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:18.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.168+0000 7f6ca6800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6ca00c09d0 0x7f6ca00caff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:18.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.168+0000 7f6ca6800640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca0071a60 con 0x7f6ca00cb530 2024-04-18T04:45:18.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.168+0000 7f6ca6800640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca0150c00 con 0x7f6ca0150820 2024-04-18T04:45:18.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.168+0000 7f6ca6800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca0157430 con 0x7f6ca00c09d0 2024-04-18T04:45:18.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.168+0000 7f6c9f400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6ca0150820 0x7f6ca00c0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:18.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.168+0000 7f6c9f400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6ca0150820 0x7f6ca00c0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46792/0 (socket says 172.21.15.120:46792) 2024-04-18T04:45:18.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.168+0000 7f6c9f400640 1 -- 172.21.15.120:0/3001844744 learned_addr learned my addr 172.21.15.120:0/3001844744 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:18.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.168+0000 7f6c96a00640 1 --2- 172.21.15.120:0/3001844744 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6ca00c09d0 0x7f6ca00caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:18.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.168+0000 7f6c9f400640 1 -- 172.21.15.120:0/3001844744 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6ca00c09d0 msgr2=0x7f6ca00caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:18.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.168+0000 7f6c9f400640 1 --2- 172.21.15.120:0/3001844744 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6ca00c09d0 0x7f6ca00caff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:18.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.168+0000 7f6c9f400640 1 -- 172.21.15.120:0/3001844744 >> v1:172.21.15.132:6789/0 conn(0x7f6ca00cb530 legacy=0x7f6ca0159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:18.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.168+0000 7f6c9f400640 1 -- 172.21.15.120:0/3001844744 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca01565d0 con 0x7f6ca0150820 2024-04-18T04:45:18.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.172+0000 7f6c9f400640 1 --2- 172.21.15.120:0/3001844744 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ca0150820 0x7f6ca00c0490 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6c90009870 tx=0x7f6c9001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9875bc4351615df1 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:18.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.172+0000 7f6c9ea00640 1 -- 172.21.15.120:0/3001844744 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c900ab670 con 0x7f6ca0150820 2024-04-18T04:45:18.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.172+0000 7f6c9ea00640 1 -- 172.21.15.120:0/3001844744 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c900ab7d0 con 0x7f6ca0150820 2024-04-18T04:45:18.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.172+0000 7f6c9ea00640 1 -- 172.21.15.120:0/3001844744 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c900abb60 con 0x7f6ca0150820 2024-04-18T04:45:18.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.172+0000 7f6ca6800640 1 -- 172.21.15.120:0/3001844744 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ca0150820 msgr2=0x7f6ca00c0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:18.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.172+0000 7f6ca6800640 1 --2- 172.21.15.120:0/3001844744 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ca0150820 0x7f6ca00c0490 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6c90009870 tx=0x7f6c9001c560 comp rx=0 tx=0).stop 2024-04-18T04:45:18.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.172+0000 7f6ca6800640 1 -- 172.21.15.120:0/3001844744 shutdown_connections 2024-04-18T04:45:18.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.172+0000 7f6ca6800640 1 --2- 172.21.15.120:0/3001844744 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6ca00c09d0 0x7f6ca00caff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:18.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.172+0000 7f6ca6800640 1 --2- 172.21.15.120:0/3001844744 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ca0150820 0x7f6ca00c0490 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:18.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.172+0000 7f6ca6800640 1 -- 172.21.15.120:0/3001844744 >> 172.21.15.120:0/3001844744 conn(0x7f6ca006b780 msgr2=0x7f6ca006bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:18.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.172+0000 7f6ca6800640 1 -- 172.21.15.120:0/3001844744 shutdown_connections 2024-04-18T04:45:18.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.172+0000 7f6ca6800640 1 -- 172.21.15.120:0/3001844744 wait complete. 2024-04-18T04:45:18.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.172+0000 7f6ca6800640 1 Processor -- start 2024-04-18T04:45:18.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.172+0000 7f6ca6800640 1 -- start start 2024-04-18T04:45:18.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.172+0000 7f6ca6800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ca00c09d0 0x7f6ca01556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:18.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.172+0000 7f6ca6800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6ca00cb530 0x7f6ca01542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:18.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.172+0000 7f6ca6800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ca0150820 0x7f6ca0140740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:18.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.172+0000 7f6ca6800640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca0142be0 con 0x7f6ca0150820 2024-04-18T04:45:18.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.172+0000 7f6ca6800640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca01ee3b0 con 0x7f6ca00c09d0 2024-04-18T04:45:18.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.172+0000 7f6ca6800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca01ee840 con 0x7f6ca00cb530 2024-04-18T04:45:18.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.172+0000 7f6c9fe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ca0150820 0x7f6ca0140740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:18.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.176+0000 7f6c9fe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ca0150820 0x7f6ca0140740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46804/0 (socket says 172.21.15.120:46804) 2024-04-18T04:45:18.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.176+0000 7f6c9fe00640 1 -- 172.21.15.120:0/1509189384 learned_addr learned my addr 172.21.15.120:0/1509189384 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:18.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.176+0000 7f6c9f400640 1 --2- 172.21.15.120:0/1509189384 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ca00c09d0 0x7f6ca01556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:18.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.176+0000 7f6c96a00640 1 --2- 172.21.15.120:0/1509189384 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6ca00cb530 0x7f6ca01542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:18.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.176+0000 7f6c9fe00640 1 -- 172.21.15.120:0/1509189384 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6ca00cb530 msgr2=0x7f6ca01542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:18.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.176+0000 7f6c9fe00640 1 --2- 172.21.15.120:0/1509189384 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6ca00cb530 0x7f6ca01542a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:18.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.176+0000 7f6c9fe00640 1 -- 172.21.15.120:0/1509189384 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ca00c09d0 msgr2=0x7f6ca01556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:18.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.176+0000 7f6c9fe00640 1 --2- 172.21.15.120:0/1509189384 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ca00c09d0 0x7f6ca01556e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:18.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.176+0000 7f6c9fe00640 1 -- 172.21.15.120:0/1509189384 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c900094d0 con 0x7f6ca0150820 2024-04-18T04:45:18.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.176+0000 7f6c96a00640 1 --2- 172.21.15.120:0/1509189384 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6ca00cb530 0x7f6ca01542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:18.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.176+0000 7f6c9fe00640 1 --2- 172.21.15.120:0/1509189384 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ca0150820 0x7f6ca0140740 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800c770 tx=0x7f6c9800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:18.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.176+0000 7f6c97e00640 1 -- 172.21.15.120:0/1509189384 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c98003b80 con 0x7f6ca0150820 2024-04-18T04:45:18.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.176+0000 7f6c97e00640 1 -- 172.21.15.120:0/1509189384 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c98003ce0 con 0x7f6ca0150820 2024-04-18T04:45:18.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.176+0000 7f6ca6800640 1 -- 172.21.15.120:0/1509189384 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca0155f90 con 0x7f6ca0150820 2024-04-18T04:45:18.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.176+0000 7f6c97e00640 1 -- 172.21.15.120:0/1509189384 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9800aa90 con 0x7f6ca0150820 2024-04-18T04:45:18.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.176+0000 7f6ca6800640 1 -- 172.21.15.120:0/1509189384 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca01edd60 con 0x7f6ca0150820 2024-04-18T04:45:18.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.176+0000 7f6ca6800640 1 -- 172.21.15.120:0/1509189384 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca01ee560 con 0x7f6ca0150820 2024-04-18T04:45:18.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.176+0000 7f6c97e00640 1 -- 172.21.15.120:0/1509189384 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6c9800abf0 con 0x7f6ca0150820 2024-04-18T04:45:18.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.176+0000 7f6c97e00640 1 --2- 172.21.15.120:0/1509189384 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6c7c066690 0x7f6c7c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:18.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.176+0000 7f6c97e00640 1 -- 172.21.15.120:0/1509189384 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6c98084430 con 0x7f6ca0150820 2024-04-18T04:45:18.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.180+0000 7f6c9f400640 1 --2- 172.21.15.120:0/1509189384 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6c7c066690 0x7f6c7c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:18.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.180+0000 7f6c9f400640 1 --2- 172.21.15.120:0/1509189384 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6c7c066690 0x7f6c7c068b50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6c900af000 tx=0x7f6c900b6040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:18.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.184+0000 7f6c97e00640 1 -- 172.21.15.120:0/1509189384 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f6ca01ee560 con 0x7f6ca0150820 2024-04-18T04:45:18.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.340+0000 7f6ca6800640 1 -- 172.21.15.120:0/1509189384 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6ca01ee520 con 0x7f6ca0150820 2024-04-18T04:45:18.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.340+0000 7f6c97e00640 1 -- 172.21.15.120:0/1509189384 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6c980512b0 con 0x7f6ca0150820 2024-04-18T04:45:18.343 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2024-04-18T04:45:18.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.344+0000 7f6ca6800640 1 -- 172.21.15.120:0/1509189384 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6c7c066690 msgr2=0x7f6c7c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:18.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.344+0000 7f6ca6800640 1 --2- 172.21.15.120:0/1509189384 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6c7c066690 0x7f6c7c068b50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6c900af000 tx=0x7f6c900b6040 comp rx=0 tx=0).stop 2024-04-18T04:45:18.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.344+0000 7f6ca6800640 1 -- 172.21.15.120:0/1509189384 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ca0150820 msgr2=0x7f6ca0140740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:18.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.344+0000 7f6ca6800640 1 --2- 172.21.15.120:0/1509189384 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ca0150820 0x7f6ca0140740 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800c770 tx=0x7f6c9800cc30 comp rx=0 tx=0).stop 2024-04-18T04:45:18.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.344+0000 7f6ca6800640 1 -- 172.21.15.120:0/1509189384 shutdown_connections 2024-04-18T04:45:18.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.344+0000 7f6ca6800640 1 --2- 172.21.15.120:0/1509189384 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6c7c066690 0x7f6c7c068b50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:18.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.344+0000 7f6ca6800640 1 --2- 172.21.15.120:0/1509189384 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ca0150820 0x7f6ca0140740 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:18.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.344+0000 7f6ca6800640 1 --2- 172.21.15.120:0/1509189384 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6ca00cb530 0x7f6ca01542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:18.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.344+0000 7f6ca6800640 1 --2- 172.21.15.120:0/1509189384 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ca00c09d0 0x7f6ca01556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:18.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.344+0000 7f6ca6800640 1 -- 172.21.15.120:0/1509189384 >> 172.21.15.120:0/1509189384 conn(0x7f6ca006b780 msgr2=0x7f6ca014fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:18.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.344+0000 7f6ca6800640 1 -- 172.21.15.120:0/1509189384 shutdown_connections 2024-04-18T04:45:18.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.344+0000 7f6ca6800640 1 -- 172.21.15.120:0/1509189384 wait complete. 2024-04-18T04:45:18.364 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T04:45:18.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.500+0000 7fa486400640 1 Processor -- start 2024-04-18T04:45:18.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.500+0000 7fa486400640 1 -- start start 2024-04-18T04:45:18.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.500+0000 7fa486400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa4800caff0 0x7fa4800cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:18.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.500+0000 7fa486400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa480159d90 0x7fa48015a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:18.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.500+0000 7fa486400640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa480071a60 con 0x7fa480150820 2024-04-18T04:45:18.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.500+0000 7fa486400640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa480150c00 con 0x7fa4800caff0 2024-04-18T04:45:18.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.500+0000 7fa486400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa480157430 con 0x7fa480159d90 2024-04-18T04:45:18.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.504+0000 7fa476a00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa4800caff0 0x7fa4800cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:18.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.504+0000 7fa476a00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa4800caff0 0x7fa4800cb440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46816/0 (socket says 172.21.15.120:46816) 2024-04-18T04:45:18.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.504+0000 7fa476a00640 1 -- 172.21.15.120:0/886842028 learned_addr learned my addr 172.21.15.120:0/886842028 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:18.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.504+0000 7fa47fe00640 1 --2- 172.21.15.120:0/886842028 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa480159d90 0x7fa48015a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:18.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.504+0000 7fa476a00640 1 -- 172.21.15.120:0/886842028 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa480159d90 msgr2=0x7fa48015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:18.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.504+0000 7fa476a00640 1 --2- 172.21.15.120:0/886842028 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa480159d90 0x7fa48015a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:18.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.504+0000 7fa476a00640 1 -- 172.21.15.120:0/886842028 >> v1:172.21.15.132:6789/0 conn(0x7fa480150820 legacy=0x7fa4800c0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:18.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.504+0000 7fa476a00640 1 -- 172.21.15.120:0/886842028 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa48015a720 con 0x7fa4800caff0 2024-04-18T04:45:18.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.504+0000 7fa476a00640 1 --2- 172.21.15.120:0/886842028 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa4800caff0 0x7fa4800cb440 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa468009870 tx=0x7fa46801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b00180a3a545dd3 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:18.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.504+0000 7fa47ea00640 1 -- 172.21.15.120:0/886842028 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4680aa610 con 0x7fa4800caff0 2024-04-18T04:45:18.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.504+0000 7fa47ea00640 1 -- 172.21.15.120:0/886842028 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4680a6040 con 0x7fa4800caff0 2024-04-18T04:45:18.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.504+0000 7fa47ea00640 1 -- 172.21.15.120:0/886842028 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4680aa990 con 0x7fa4800caff0 2024-04-18T04:45:18.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.508+0000 7fa486400640 1 -- 172.21.15.120:0/886842028 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa4800caff0 msgr2=0x7fa4800cb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:18.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.508+0000 7fa486400640 1 --2- 172.21.15.120:0/886842028 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa4800caff0 0x7fa4800cb440 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa468009870 tx=0x7fa46801c4f0 comp rx=0 tx=0).stop 2024-04-18T04:45:18.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.508+0000 7fa486400640 1 -- 172.21.15.120:0/886842028 shutdown_connections 2024-04-18T04:45:18.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.508+0000 7fa486400640 1 --2- 172.21.15.120:0/886842028 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa480159d90 0x7fa48015a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:18.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.508+0000 7fa486400640 1 --2- 172.21.15.120:0/886842028 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa4800caff0 0x7fa4800cb440 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:18.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.508+0000 7fa486400640 1 -- 172.21.15.120:0/886842028 >> 172.21.15.120:0/886842028 conn(0x7fa48006b780 msgr2=0x7fa48006bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:18.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.508+0000 7fa486400640 1 -- 172.21.15.120:0/886842028 shutdown_connections 2024-04-18T04:45:18.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.508+0000 7fa486400640 1 -- 172.21.15.120:0/886842028 wait complete. 2024-04-18T04:45:18.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.508+0000 7fa486400640 1 Processor -- start 2024-04-18T04:45:18.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.508+0000 7fa486400640 1 -- start start 2024-04-18T04:45:18.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.508+0000 7fa486400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa4800caff0 0x7fa48013e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:18.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.508+0000 7fa486400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa480150820 0x7fa48013ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:18.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.508+0000 7fa486400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa480159d90 0x7fa48013f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:18.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.508+0000 7fa486400640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa480070f70 con 0x7fa480150820 2024-04-18T04:45:18.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.508+0000 7fa486400640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4801efc40 con 0x7fa480159d90 2024-04-18T04:45:18.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.508+0000 7fa486400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4801eff20 con 0x7fa4800caff0 2024-04-18T04:45:18.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.508+0000 7fa476a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa480150820 0x7fa48013ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:18.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.508+0000 7fa476a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa480150820 0x7fa48013ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46826/0 (socket says 172.21.15.120:46826) 2024-04-18T04:45:18.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.508+0000 7fa476a00640 1 -- 172.21.15.120:0/3703469064 learned_addr learned my addr 172.21.15.120:0/3703469064 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:18.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.508+0000 7fa47f400640 1 --2- 172.21.15.120:0/3703469064 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa4800caff0 0x7fa48013e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:18.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.508+0000 7fa47fe00640 1 --2- 172.21.15.120:0/3703469064 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa480159d90 0x7fa48013f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:18.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.508+0000 7fa476a00640 1 -- 172.21.15.120:0/3703469064 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa4800caff0 msgr2=0x7fa48013e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:18.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.508+0000 7fa476a00640 1 --2- 172.21.15.120:0/3703469064 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa4800caff0 0x7fa48013e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:18.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.508+0000 7fa476a00640 1 -- 172.21.15.120:0/3703469064 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa480159d90 msgr2=0x7fa48013f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:18.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.508+0000 7fa476a00640 1 --2- 172.21.15.120:0/3703469064 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa480159d90 0x7fa48013f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:18.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.508+0000 7fa476a00640 1 -- 172.21.15.120:0/3703469064 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4680094d0 con 0x7fa480150820 2024-04-18T04:45:18.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.508+0000 7fa47fe00640 1 --2- 172.21.15.120:0/3703469064 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa480159d90 0x7fa48013f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:18.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.508+0000 7fa47f400640 1 --2- 172.21.15.120:0/3703469064 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa4800caff0 0x7fa48013e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:18.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.512+0000 7fa476a00640 1 --2- 172.21.15.120:0/3703469064 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa480150820 0x7fa48013ef60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa4680ac040 tx=0x7fa46801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:18.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.512+0000 7fa477e00640 1 -- 172.21.15.120:0/3703469064 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4680bd5f0 con 0x7fa480150820 2024-04-18T04:45:18.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.512+0000 7fa477e00640 1 -- 172.21.15.120:0/3703469064 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4680bd770 con 0x7fa480150820 2024-04-18T04:45:18.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.512+0000 7fa477e00640 1 -- 172.21.15.120:0/3703469064 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4680bdb20 con 0x7fa480150820 2024-04-18T04:45:18.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.512+0000 7fa486400640 1 -- 172.21.15.120:0/3703469064 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4801f0200 con 0x7fa480150820 2024-04-18T04:45:18.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.512+0000 7fa486400640 1 -- 172.21.15.120:0/3703469064 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4801f07c0 con 0x7fa480150820 2024-04-18T04:45:18.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.512+0000 7fa486400640 1 -- 172.21.15.120:0/3703469064 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4800729d0 con 0x7fa480150820 2024-04-18T04:45:18.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.512+0000 7fa477e00640 1 -- 172.21.15.120:0/3703469064 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa4680b33f0 con 0x7fa480150820 2024-04-18T04:45:18.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.512+0000 7fa477e00640 1 --2- 172.21.15.120:0/3703469064 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fa45c0666c0 0x7fa45c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:18.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.512+0000 7fa477e00640 1 -- 172.21.15.120:0/3703469064 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa46811f160 con 0x7fa480150820 2024-04-18T04:45:18.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.512+0000 7fa47f400640 1 --2- 172.21.15.120:0/3703469064 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fa45c0666c0 0x7fa45c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:18.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.516+0000 7fa47f400640 1 --2- 172.21.15.120:0/3703469064 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fa45c0666c0 0x7fa45c068b80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa470003ec0 tx=0x7fa470009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:18.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.516+0000 7fa477e00640 1 -- 172.21.15.120:0/3703469064 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fa4680ec250 con 0x7fa480150820 2024-04-18T04:45:18.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.668+0000 7fa486400640 1 -- 172.21.15.120:0/3703469064 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa480070300 con 0x7fa480150820 2024-04-18T04:45:18.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.668+0000 7fa477e00640 1 -- 172.21.15.120:0/3703469064 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa4680ef870 con 0x7fa480150820 2024-04-18T04:45:18.671 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2024-04-18T04:45:18.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.672+0000 7fa486400640 1 -- 172.21.15.120:0/3703469064 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fa45c0666c0 msgr2=0x7fa45c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:18.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.672+0000 7fa486400640 1 --2- 172.21.15.120:0/3703469064 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fa45c0666c0 0x7fa45c068b80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa470003ec0 tx=0x7fa470009040 comp rx=0 tx=0).stop 2024-04-18T04:45:18.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.672+0000 7fa486400640 1 -- 172.21.15.120:0/3703469064 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa480150820 msgr2=0x7fa48013ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:18.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.672+0000 7fa486400640 1 --2- 172.21.15.120:0/3703469064 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa480150820 0x7fa48013ef60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa4680ac040 tx=0x7fa46801ad30 comp rx=0 tx=0).stop 2024-04-18T04:45:18.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.672+0000 7fa486400640 1 -- 172.21.15.120:0/3703469064 shutdown_connections 2024-04-18T04:45:18.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.672+0000 7fa486400640 1 --2- 172.21.15.120:0/3703469064 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fa45c0666c0 0x7fa45c068b80 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:18.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.672+0000 7fa486400640 1 --2- 172.21.15.120:0/3703469064 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa480159d90 0x7fa48013f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:18.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.672+0000 7fa486400640 1 --2- 172.21.15.120:0/3703469064 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa480150820 0x7fa48013ef60 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:18.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.672+0000 7fa486400640 1 --2- 172.21.15.120:0/3703469064 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa4800caff0 0x7fa48013e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:18.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.672+0000 7fa486400640 1 -- 172.21.15.120:0/3703469064 >> 172.21.15.120:0/3703469064 conn(0x7fa48006b780 msgr2=0x7fa4800c0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:18.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.672+0000 7fa486400640 1 -- 172.21.15.120:0/3703469064 shutdown_connections 2024-04-18T04:45:18.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.672+0000 7fa486400640 1 -- 172.21.15.120:0/3703469064 wait complete. 2024-04-18T04:45:18.692 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T04:45:18.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.828+0000 7f06f9200640 1 Processor -- start 2024-04-18T04:45:18.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.828+0000 7f06f9200640 1 -- start start 2024-04-18T04:45:18.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.832+0000 7f06f9200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f06f4153900 0x7f06f4065bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:18.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.832+0000 7f06f9200640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06f415a510 con 0x7f06f4153520 2024-04-18T04:45:18.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.832+0000 7f06f9200640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06f40c2760 con 0x7f06f41422f0 2024-04-18T04:45:18.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.832+0000 7f06f9200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f40c2d00 con 0x7f06f4153900 2024-04-18T04:45:18.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.832+0000 7f06f3400640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f06f4153520 0x7f06f40c1e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:35330/0 (socket says 172.21.15.120:35330) 2024-04-18T04:45:18.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.832+0000 7f06f3400640 1 -- 172.21.15.120:0/3311095082 learned_addr learned my addr 172.21.15.120:0/3311095082 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:45:18.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.832+0000 7f06f3e00640 1 --2- 172.21.15.120:0/3311095082 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f06f4153900 0x7f06f4065bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:18.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.832+0000 7f06f2a00640 1 -- 172.21.15.120:0/3311095082 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2732358296 0 0) 0x7f06f415a510 con 0x7f06f4153520 2024-04-18T04:45:18.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.832+0000 7f06f2a00640 1 -- 172.21.15.120:0/3311095082 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06d8003530 con 0x7f06f4153520 2024-04-18T04:45:18.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.832+0000 7f06f2a00640 1 -- 172.21.15.120:0/3311095082 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1376794737 0 0) 0x7f06f40c2760 con 0x7f06f41422f0 2024-04-18T04:45:18.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.832+0000 7f06f2a00640 1 -- 172.21.15.120:0/3311095082 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06f415a510 con 0x7f06f41422f0 2024-04-18T04:45:18.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.832+0000 7f06f3e00640 1 -- 172.21.15.120:0/3311095082 >> v1:172.21.15.132:6789/0 conn(0x7f06f41422f0 legacy=0x7f06f415cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:18.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.832+0000 7f06f3e00640 1 -- 172.21.15.120:0/3311095082 >> v1:172.21.15.120:6789/0 conn(0x7f06f4153520 legacy=0x7f06f40c1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:18.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.832+0000 7f06f3e00640 1 -- 172.21.15.120:0/3311095082 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f40c2a20 con 0x7f06f4153900 2024-04-18T04:45:18.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.836+0000 7f06f3e00640 1 --2- 172.21.15.120:0/3311095082 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f06f4153900 0x7f06f4065bc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f06ec0097f0 tx=0x7f06ec01c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be0ac7dc73666b5d server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:18.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.836+0000 7f06f2a00640 1 -- 172.21.15.120:0/3311095082 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec0aa660 con 0x7f06f4153900 2024-04-18T04:45:18.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.836+0000 7f06f2a00640 1 -- 172.21.15.120:0/3311095082 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ec0aa7c0 con 0x7f06f4153900 2024-04-18T04:45:18.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.836+0000 7f06f2a00640 1 -- 172.21.15.120:0/3311095082 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec0aab30 con 0x7f06f4153900 2024-04-18T04:45:18.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.836+0000 7f06f9200640 1 -- 172.21.15.120:0/3311095082 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f06f4153900 msgr2=0x7f06f4065bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:18.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.836+0000 7f06f9200640 1 --2- 172.21.15.120:0/3311095082 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f06f4153900 0x7f06f4065bc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f06ec0097f0 tx=0x7f06ec01c4e0 comp rx=0 tx=0).stop 2024-04-18T04:45:18.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.836+0000 7f06f9200640 1 -- 172.21.15.120:0/3311095082 shutdown_connections 2024-04-18T04:45:18.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.836+0000 7f06f9200640 1 --2- 172.21.15.120:0/3311095082 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f06f4153900 0x7f06f4065bc0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:18.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.836+0000 7f06f9200640 1 -- 172.21.15.120:0/3311095082 >> 172.21.15.120:0/3311095082 conn(0x7f06f406da30 msgr2=0x7f06f4071830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:18.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.836+0000 7f06f9200640 1 -- 172.21.15.120:0/3311095082 shutdown_connections 2024-04-18T04:45:18.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.836+0000 7f06f9200640 1 -- 172.21.15.120:0/3311095082 wait complete. 2024-04-18T04:45:18.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.836+0000 7f06f9200640 1 Processor -- start 2024-04-18T04:45:18.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.836+0000 7f06f9200640 1 -- start start 2024-04-18T04:45:18.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.840+0000 7f06f9200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06f41422f0 0x7f06f415b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:18.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.840+0000 7f06f9200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f06f4153520 0x7f06f415b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:18.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.840+0000 7f06f9200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06f4153900 0x7f06f414dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:18.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.840+0000 7f06f9200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f4150e80 con 0x7f06f4153900 2024-04-18T04:45:18.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.840+0000 7f06f9200640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f414d020 con 0x7f06f41422f0 2024-04-18T04:45:18.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.840+0000 7f06f9200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f414e960 con 0x7f06f4153520 2024-04-18T04:45:18.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.840+0000 7f06f3e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06f4153900 0x7f06f414dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:18.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.840+0000 7f06f3e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06f4153900 0x7f06f414dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46838/0 (socket says 172.21.15.120:46838) 2024-04-18T04:45:18.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.840+0000 7f06f3e00640 1 -- 172.21.15.120:0/2546348890 learned_addr learned my addr 172.21.15.120:0/2546348890 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:18.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.840+0000 7f06f3400640 1 --2- 172.21.15.120:0/2546348890 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06f41422f0 0x7f06f415b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:18.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.840+0000 7f06eaa00640 1 --2- 172.21.15.120:0/2546348890 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f06f4153520 0x7f06f415b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:18.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.840+0000 7f06f3e00640 1 -- 172.21.15.120:0/2546348890 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f06f4153520 msgr2=0x7f06f415b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:18.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.840+0000 7f06f3e00640 1 --2- 172.21.15.120:0/2546348890 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f06f4153520 0x7f06f415b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:18.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.840+0000 7f06f3e00640 1 -- 172.21.15.120:0/2546348890 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06f41422f0 msgr2=0x7f06f415b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:18.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.840+0000 7f06f3e00640 1 --2- 172.21.15.120:0/2546348890 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06f41422f0 0x7f06f415b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:18.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.840+0000 7f06f3e00640 1 -- 172.21.15.120:0/2546348890 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ec009420 con 0x7f06f4153900 2024-04-18T04:45:18.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.840+0000 7f06f3400640 1 --2- 172.21.15.120:0/2546348890 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06f41422f0 0x7f06f415b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:18.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.840+0000 7f06f3e00640 1 --2- 172.21.15.120:0/2546348890 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06f4153900 0x7f06f414dac0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f06ec0097f0 tx=0x7f06ec019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:18.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.840+0000 7f06ebe00640 1 -- 172.21.15.120:0/2546348890 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec0aad40 con 0x7f06f4153900 2024-04-18T04:45:18.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.840+0000 7f06ebe00640 1 -- 172.21.15.120:0/2546348890 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ec0be450 con 0x7f06f4153900 2024-04-18T04:45:18.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.840+0000 7f06f9200640 1 -- 172.21.15.120:0/2546348890 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06f415d360 con 0x7f06f4153900 2024-04-18T04:45:18.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.840+0000 7f06ebe00640 1 -- 172.21.15.120:0/2546348890 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec0aaea0 con 0x7f06f4153900 2024-04-18T04:45:18.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.840+0000 7f06f9200640 1 -- 172.21.15.120:0/2546348890 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06f414d2c0 con 0x7f06f4153900 2024-04-18T04:45:18.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.840+0000 7f06f9200640 1 -- 172.21.15.120:0/2546348890 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06f40728f0 con 0x7f06f4153900 2024-04-18T04:45:18.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.840+0000 7f06ebe00640 1 -- 172.21.15.120:0/2546348890 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f06ec0be7c0 con 0x7f06f4153900 2024-04-18T04:45:18.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.844+0000 7f06ebe00640 1 --2- 172.21.15.120:0/2546348890 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f06d0066690 0x7f06d0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:18.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.844+0000 7f06ebe00640 1 -- 172.21.15.120:0/2546348890 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f06ec0a6040 con 0x7f06f4153900 2024-04-18T04:45:18.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.844+0000 7f06f3400640 1 --2- 172.21.15.120:0/2546348890 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f06d0066690 0x7f06d0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:18.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.844+0000 7f06f3400640 1 --2- 172.21.15.120:0/2546348890 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f06d0066690 0x7f06d0068b50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f06e40012f0 tx=0x7f06e4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:18.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:18.848+0000 7f06ebe00640 1 -- 172.21.15.120:0/2546348890 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f06ec0ebfc0 con 0x7f06f4153900 2024-04-18T04:45:19.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.000+0000 7f06f9200640 1 -- 172.21.15.120:0/2546348890 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f06f4153300 con 0x7f06f4153900 2024-04-18T04:45:19.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.000+0000 7f06ebe00640 1 -- 172.21.15.120:0/2546348890 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f06ec0ef5e0 con 0x7f06f4153900 2024-04-18T04:45:19.002 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 64 2024-04-18T04:45:19.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.004+0000 7f06f9200640 1 -- 172.21.15.120:0/2546348890 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f06d0066690 msgr2=0x7f06d0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:19.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.004+0000 7f06f9200640 1 --2- 172.21.15.120:0/2546348890 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f06d0066690 0x7f06d0068b50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f06e40012f0 tx=0x7f06e4009040 comp rx=0 tx=0).stop 2024-04-18T04:45:19.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.004+0000 7f06f9200640 1 -- 172.21.15.120:0/2546348890 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06f4153900 msgr2=0x7f06f414dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:19.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.004+0000 7f06f9200640 1 --2- 172.21.15.120:0/2546348890 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06f4153900 0x7f06f414dac0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f06ec0097f0 tx=0x7f06ec019280 comp rx=0 tx=0).stop 2024-04-18T04:45:19.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.004+0000 7f06f9200640 1 -- 172.21.15.120:0/2546348890 shutdown_connections 2024-04-18T04:45:19.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.004+0000 7f06f9200640 1 --2- 172.21.15.120:0/2546348890 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f06d0066690 0x7f06d0068b50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:19.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.004+0000 7f06f9200640 1 --2- 172.21.15.120:0/2546348890 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06f4153900 0x7f06f414dac0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:19.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.004+0000 7f06f9200640 1 --2- 172.21.15.120:0/2546348890 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f06f4153520 0x7f06f415b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:19.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.004+0000 7f06f9200640 1 --2- 172.21.15.120:0/2546348890 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06f41422f0 0x7f06f415b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:19.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.004+0000 7f06f9200640 1 -- 172.21.15.120:0/2546348890 >> 172.21.15.120:0/2546348890 conn(0x7f06f406da30 msgr2=0x7f06f406f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:19.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.004+0000 7f06f9200640 1 -- 172.21.15.120:0/2546348890 shutdown_connections 2024-04-18T04:45:19.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.004+0000 7f06f9200640 1 -- 172.21.15.120:0/2546348890 wait complete. 2024-04-18T04:45:19.023 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-18T04:45:19.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.160+0000 7f2b2a200640 1 Processor -- start 2024-04-18T04:45:19.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.160+0000 7f2b2a200640 1 -- start start 2024-04-18T04:45:19.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.164+0000 7f2b2a200640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f2b24158150 0x7f2b240c73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:19.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.164+0000 7f2b2a200640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2b240caff0 0x7f2b240cb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:19.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.164+0000 7f2b2a200640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b24072640 con 0x7f2b24151730 2024-04-18T04:45:19.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.164+0000 7f2b2a200640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b24071120 con 0x7f2b24158150 2024-04-18T04:45:19.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.164+0000 7f2b2a200640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b240cb940 con 0x7f2b240caff0 2024-04-18T04:45:19.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.164+0000 7f2b1aa00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f2b24158150 0x7f2b240c73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:19.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.164+0000 7f2b1aa00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f2b24158150 0x7f2b240c73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46854/0 (socket says 172.21.15.120:46854) 2024-04-18T04:45:19.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.164+0000 7f2b1aa00640 1 -- 172.21.15.120:0/919043919 learned_addr learned my addr 172.21.15.120:0/919043919 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:19.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.164+0000 7f2b23e00640 1 --2- 172.21.15.120:0/919043919 >> v2:172.21.15.132:3300/0 conn(0x7f2b240caff0 0x7f2b240cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:19.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.164+0000 7f2b1aa00640 1 -- 172.21.15.120:0/919043919 >> v2:172.21.15.132:3300/0 conn(0x7f2b240caff0 msgr2=0x7f2b240cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:19.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.164+0000 7f2b1aa00640 1 --2- 172.21.15.120:0/919043919 >> v2:172.21.15.132:3300/0 conn(0x7f2b240caff0 0x7f2b240cb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:19.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.164+0000 7f2b1aa00640 1 -- 172.21.15.120:0/919043919 >> v1:172.21.15.132:6789/0 conn(0x7f2b24151730 legacy=0x7f2b2406dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:19.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.164+0000 7f2b1aa00640 1 -- 172.21.15.120:0/919043919 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b24072360 con 0x7f2b24158150 2024-04-18T04:45:19.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.168+0000 7f2b1aa00640 1 --2- 172.21.15.120:0/919043919 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b24158150 0x7f2b240c73d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2b240c7360 tx=0x7f2b0c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69fdff401d0b3d77 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:19.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.168+0000 7f2b22a00640 1 -- 172.21.15.120:0/919043919 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c0ab610 con 0x7f2b24158150 2024-04-18T04:45:19.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.168+0000 7f2b22a00640 1 -- 172.21.15.120:0/919043919 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b0c0ab770 con 0x7f2b24158150 2024-04-18T04:45:19.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.168+0000 7f2b22a00640 1 -- 172.21.15.120:0/919043919 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c0abb00 con 0x7f2b24158150 2024-04-18T04:45:19.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.168+0000 7f2b2a200640 1 -- 172.21.15.120:0/919043919 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b24158150 msgr2=0x7f2b240c73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:19.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.168+0000 7f2b2a200640 1 --2- 172.21.15.120:0/919043919 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b24158150 0x7f2b240c73d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2b240c7360 tx=0x7f2b0c01c520 comp rx=0 tx=0).stop 2024-04-18T04:45:19.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.168+0000 7f2b2a200640 1 -- 172.21.15.120:0/919043919 shutdown_connections 2024-04-18T04:45:19.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.168+0000 7f2b2a200640 1 --2- 172.21.15.120:0/919043919 >> v2:172.21.15.132:3300/0 conn(0x7f2b240caff0 0x7f2b240cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:19.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.168+0000 7f2b2a200640 1 --2- 172.21.15.120:0/919043919 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b24158150 0x7f2b240c73d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:19.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.168+0000 7f2b2a200640 1 -- 172.21.15.120:0/919043919 >> 172.21.15.120:0/919043919 conn(0x7f2b2406b780 msgr2=0x7f2b2406bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:19.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.168+0000 7f2b2a200640 1 -- 172.21.15.120:0/919043919 shutdown_connections 2024-04-18T04:45:19.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.168+0000 7f2b2a200640 1 -- 172.21.15.120:0/919043919 wait complete. 2024-04-18T04:45:19.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.168+0000 7f2b2a200640 1 Processor -- start 2024-04-18T04:45:19.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.168+0000 7f2b2a200640 1 -- start start 2024-04-18T04:45:19.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.168+0000 7f2b2a200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b240caff0 0x7f2b240bfe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:19.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.168+0000 7f2b2a200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b24151730 0x7f2b24158cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:19.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.168+0000 7f2b2a200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b24158150 0x7f2b241496e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:19.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.168+0000 7f2b2a200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b241f2a70 con 0x7f2b24158150 2024-04-18T04:45:19.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.172+0000 7f2b2a200640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b240c03b0 con 0x7f2b240caff0 2024-04-18T04:45:19.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.172+0000 7f2b2a200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b241510e0 con 0x7f2b24151730 2024-04-18T04:45:19.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.172+0000 7f2b23e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b24158150 0x7f2b241496e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:19.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.172+0000 7f2b23e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b24158150 0x7f2b241496e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46858/0 (socket says 172.21.15.120:46858) 2024-04-18T04:45:19.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.172+0000 7f2b23e00640 1 -- 172.21.15.120:0/2658893496 learned_addr learned my addr 172.21.15.120:0/2658893496 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:19.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.172+0000 7f2b23400640 1 --2- 172.21.15.120:0/2658893496 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b240caff0 0x7f2b240bfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:19.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.172+0000 7f2b1aa00640 1 --2- 172.21.15.120:0/2658893496 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b24151730 0x7f2b24158cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:19.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.172+0000 7f2b23e00640 1 -- 172.21.15.120:0/2658893496 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b24151730 msgr2=0x7f2b24158cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:19.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.172+0000 7f2b23e00640 1 --2- 172.21.15.120:0/2658893496 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b24151730 0x7f2b24158cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:19.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.172+0000 7f2b23e00640 1 -- 172.21.15.120:0/2658893496 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b240caff0 msgr2=0x7f2b240bfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:19.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.172+0000 7f2b23e00640 1 --2- 172.21.15.120:0/2658893496 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b240caff0 0x7f2b240bfe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:19.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.172+0000 7f2b23e00640 1 -- 172.21.15.120:0/2658893496 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b0c0094d0 con 0x7f2b24158150 2024-04-18T04:45:19.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.172+0000 7f2b23400640 1 --2- 172.21.15.120:0/2658893496 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b240caff0 0x7f2b240bfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:19.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.172+0000 7f2b23e00640 1 --2- 172.21.15.120:0/2658893496 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b24158150 0x7f2b241496e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c00d590 tx=0x7f2b1c00da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:19.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.172+0000 7f2b1be00640 1 -- 172.21.15.120:0/2658893496 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c0125f0 con 0x7f2b24158150 2024-04-18T04:45:19.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.172+0000 7f2b1be00640 1 -- 172.21.15.120:0/2658893496 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b1c012770 con 0x7f2b24158150 2024-04-18T04:45:19.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.172+0000 7f2b1be00640 1 -- 172.21.15.120:0/2658893496 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c012b20 con 0x7f2b24158150 2024-04-18T04:45:19.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.172+0000 7f2b2a200640 1 -- 172.21.15.120:0/2658893496 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b241f1e30 con 0x7f2b24158150 2024-04-18T04:45:19.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.172+0000 7f2b2a200640 1 -- 172.21.15.120:0/2658893496 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b241f23b0 con 0x7f2b24158150 2024-04-18T04:45:19.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.172+0000 7f2b2a200640 1 -- 172.21.15.120:0/2658893496 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b241f2bb0 con 0x7f2b24158150 2024-04-18T04:45:19.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.172+0000 7f2b1be00640 1 -- 172.21.15.120:0/2658893496 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2b1c012c80 con 0x7f2b24158150 2024-04-18T04:45:19.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.172+0000 7f2b1be00640 1 --2- 172.21.15.120:0/2658893496 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2b00066690 0x7f2b00068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:19.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.176+0000 7f2b1be00640 1 -- 172.21.15.120:0/2658893496 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2b1c0849d0 con 0x7f2b24158150 2024-04-18T04:45:19.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.176+0000 7f2b23400640 1 --2- 172.21.15.120:0/2658893496 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2b00066690 0x7f2b00068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:19.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.176+0000 7f2b23400640 1 --2- 172.21.15.120:0/2658893496 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2b00066690 0x7f2b00068b50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2b140012f0 tx=0x7f2b14009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:19.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.180+0000 7f2b1be00640 1 -- 172.21.15.120:0/2658893496 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f2b241f2bb0 con 0x7f2b24158150 2024-04-18T04:45:19.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.332+0000 7f2b2a200640 1 -- 172.21.15.120:0/2658893496 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2b241f2bb0 con 0x7f2b24158150 2024-04-18T04:45:19.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.332+0000 7f2b1be00640 1 -- 172.21.15.120:0/2658893496 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2b241f2bb0 con 0x7f2b24158150 2024-04-18T04:45:19.334 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2024-04-18T04:45:19.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.336+0000 7f2b2a200640 1 -- 172.21.15.120:0/2658893496 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2b00066690 msgr2=0x7f2b00068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:19.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.336+0000 7f2b2a200640 1 --2- 172.21.15.120:0/2658893496 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2b00066690 0x7f2b00068b50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2b140012f0 tx=0x7f2b14009040 comp rx=0 tx=0).stop 2024-04-18T04:45:19.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.336+0000 7f2b2a200640 1 -- 172.21.15.120:0/2658893496 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b24158150 msgr2=0x7f2b241496e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:19.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.336+0000 7f2b2a200640 1 --2- 172.21.15.120:0/2658893496 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b24158150 0x7f2b241496e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c00d590 tx=0x7f2b1c00da50 comp rx=0 tx=0).stop 2024-04-18T04:45:19.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.336+0000 7f2b2a200640 1 -- 172.21.15.120:0/2658893496 shutdown_connections 2024-04-18T04:45:19.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.336+0000 7f2b2a200640 1 --2- 172.21.15.120:0/2658893496 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2b00066690 0x7f2b00068b50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:19.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.336+0000 7f2b2a200640 1 --2- 172.21.15.120:0/2658893496 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b24158150 0x7f2b241496e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:19.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.336+0000 7f2b2a200640 1 --2- 172.21.15.120:0/2658893496 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b24151730 0x7f2b24158cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:19.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.336+0000 7f2b2a200640 1 --2- 172.21.15.120:0/2658893496 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b240caff0 0x7f2b240bfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:19.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.336+0000 7f2b2a200640 1 -- 172.21.15.120:0/2658893496 >> 172.21.15.120:0/2658893496 conn(0x7f2b2406b780 msgr2=0x7f2b240c8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:19.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.336+0000 7f2b2a200640 1 -- 172.21.15.120:0/2658893496 shutdown_connections 2024-04-18T04:45:19.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.336+0000 7f2b2a200640 1 -- 172.21.15.120:0/2658893496 wait complete. 2024-04-18T04:45:19.356 INFO:tasks.mds_thrash:Wait for all MDSs to reach steady state... 2024-04-18T04:45:19.356 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:45:19.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.492+0000 7feb2de00640 1 Processor -- start 2024-04-18T04:45:19.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.492+0000 7feb2de00640 1 -- start start 2024-04-18T04:45:19.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.492+0000 7feb2de00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb281515e0 0x7feb281573c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:19.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.492+0000 7feb2de00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7feb280ca280 0x7feb2806fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:19.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.492+0000 7feb2de00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7feb280ca680 0x7feb280ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:19.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.492+0000 7feb2de00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb280c3120 con 0x7feb280ca280 2024-04-18T04:45:19.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.492+0000 7feb2de00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb28157a50 con 0x7feb280ca680 2024-04-18T04:45:19.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.492+0000 7feb2de00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb28157d10 con 0x7feb281515e0 2024-04-18T04:45:19.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.492+0000 7feb1fe00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7feb280ca280 0x7feb2806fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:19.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.492+0000 7feb1fe00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7feb280ca280 0x7feb2806fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46864/0 (socket says 172.21.15.120:46864) 2024-04-18T04:45:19.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.492+0000 7feb1fe00640 1 -- 172.21.15.120:0/351649455 learned_addr learned my addr 172.21.15.120:0/351649455 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:19.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.492+0000 7feb27400640 1 --2- 172.21.15.120:0/351649455 >> v2:172.21.15.132:3300/0 conn(0x7feb280ca680 0x7feb280ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:19.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.492+0000 7feb26a00640 1 --2- 172.21.15.120:0/351649455 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb281515e0 0x7feb281573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:19.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.492+0000 7feb1fe00640 1 -- 172.21.15.120:0/351649455 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb281515e0 msgr2=0x7feb281573c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:19.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.492+0000 7feb1fe00640 1 --2- 172.21.15.120:0/351649455 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb281515e0 0x7feb281573c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:19.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.492+0000 7feb1fe00640 1 -- 172.21.15.120:0/351649455 >> v2:172.21.15.132:3300/0 conn(0x7feb280ca680 msgr2=0x7feb280ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:19.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.492+0000 7feb1fe00640 1 --2- 172.21.15.120:0/351649455 >> v2:172.21.15.132:3300/0 conn(0x7feb280ca680 0x7feb280ccee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:19.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.492+0000 7feb1fe00640 1 -- 172.21.15.120:0/351649455 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb28157ff0 con 0x7feb280ca280 2024-04-18T04:45:19.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.496+0000 7feb1fe00640 1 --2- 172.21.15.120:0/351649455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb280ca280 0x7feb2806fd00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7feb280c8840 tx=0x7feb1001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99545032f76bb090 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:19.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.496+0000 7feb26000640 1 -- 172.21.15.120:0/351649455 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb100a89d0 con 0x7feb280ca280 2024-04-18T04:45:19.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.496+0000 7feb26000640 1 -- 172.21.15.120:0/351649455 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb100a8b30 con 0x7feb280ca280 2024-04-18T04:45:19.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.496+0000 7feb26000640 1 -- 172.21.15.120:0/351649455 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb100b0440 con 0x7feb280ca280 2024-04-18T04:45:19.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.496+0000 7feb2de00640 1 -- 172.21.15.120:0/351649455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb280ca280 msgr2=0x7feb2806fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:19.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.496+0000 7feb2de00640 1 --2- 172.21.15.120:0/351649455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb280ca280 0x7feb2806fd00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7feb280c8840 tx=0x7feb1001ed10 comp rx=0 tx=0).stop 2024-04-18T04:45:19.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.496+0000 7feb2de00640 1 -- 172.21.15.120:0/351649455 shutdown_connections 2024-04-18T04:45:19.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.496+0000 7feb2de00640 1 --2- 172.21.15.120:0/351649455 >> v2:172.21.15.132:3300/0 conn(0x7feb280ca680 0x7feb280ccee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:19.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.496+0000 7feb2de00640 1 --2- 172.21.15.120:0/351649455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb280ca280 0x7feb2806fd00 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:19.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.496+0000 7feb2de00640 1 --2- 172.21.15.120:0/351649455 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb281515e0 0x7feb281573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:19.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.496+0000 7feb2de00640 1 -- 172.21.15.120:0/351649455 >> 172.21.15.120:0/351649455 conn(0x7feb2806e0f0 msgr2=0x7feb28071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:19.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.496+0000 7feb2de00640 1 -- 172.21.15.120:0/351649455 shutdown_connections 2024-04-18T04:45:19.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.496+0000 7feb2de00640 1 -- 172.21.15.120:0/351649455 wait complete. 2024-04-18T04:45:19.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.496+0000 7feb2de00640 1 Processor -- start 2024-04-18T04:45:19.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.496+0000 7feb2de00640 1 -- start start 2024-04-18T04:45:19.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.500+0000 7feb2de00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb280ca280 0x7feb281ef3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:19.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.500+0000 7feb2de00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb280ca680 0x7feb280c6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:19.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.500+0000 7feb2de00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb281515e0 0x7feb280c59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:19.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.500+0000 7feb2de00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb28152970 con 0x7feb280ca680 2024-04-18T04:45:19.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.500+0000 7feb2de00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb28151a10 con 0x7feb281515e0 2024-04-18T04:45:19.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.500+0000 7feb2de00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb28151cf0 con 0x7feb280ca280 2024-04-18T04:45:19.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.500+0000 7feb1fe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb280ca680 0x7feb280c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:19.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.500+0000 7feb1fe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb280ca680 0x7feb280c6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46880/0 (socket says 172.21.15.120:46880) 2024-04-18T04:45:19.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.500+0000 7feb1fe00640 1 -- 172.21.15.120:0/1980223985 learned_addr learned my addr 172.21.15.120:0/1980223985 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:19.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.500+0000 7feb26a00640 1 --2- 172.21.15.120:0/1980223985 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb280ca280 0x7feb281ef3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:19.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.500+0000 7feb27400640 1 --2- 172.21.15.120:0/1980223985 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb281515e0 0x7feb280c59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:19.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.500+0000 7feb1fe00640 1 -- 172.21.15.120:0/1980223985 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb280ca280 msgr2=0x7feb281ef3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:19.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.500+0000 7feb1fe00640 1 --2- 172.21.15.120:0/1980223985 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb280ca280 0x7feb281ef3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:19.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.500+0000 7feb1fe00640 1 -- 172.21.15.120:0/1980223985 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb281515e0 msgr2=0x7feb280c59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:19.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.500+0000 7feb1fe00640 1 --2- 172.21.15.120:0/1980223985 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb281515e0 0x7feb280c59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:19.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.500+0000 7feb1fe00640 1 -- 172.21.15.120:0/1980223985 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb100094d0 con 0x7feb280ca680 2024-04-18T04:45:19.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.500+0000 7feb26a00640 1 --2- 172.21.15.120:0/1980223985 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb280ca280 0x7feb281ef3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:19.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.500+0000 7feb1fe00640 1 --2- 172.21.15.120:0/1980223985 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb280ca680 0x7feb280c6440 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7feb1001d3c0 tx=0x7feb1001bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:19.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.500+0000 7feb1f400640 1 -- 172.21.15.120:0/1980223985 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb100ba600 con 0x7feb280ca680 2024-04-18T04:45:19.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.500+0000 7feb1f400640 1 -- 172.21.15.120:0/1980223985 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb100ba760 con 0x7feb280ca680 2024-04-18T04:45:19.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.500+0000 7feb1f400640 1 -- 172.21.15.120:0/1980223985 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb100bab10 con 0x7feb280ca680 2024-04-18T04:45:19.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.500+0000 7feb2de00640 1 -- 172.21.15.120:0/1980223985 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb28151fd0 con 0x7feb280ca680 2024-04-18T04:45:19.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.500+0000 7feb2de00640 1 -- 172.21.15.120:0/1980223985 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb28152590 con 0x7feb280ca680 2024-04-18T04:45:19.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.500+0000 7feb2de00640 1 -- 172.21.15.120:0/1980223985 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb28153f10 con 0x7feb280ca680 2024-04-18T04:45:19.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.500+0000 7feb1f400640 1 -- 172.21.15.120:0/1980223985 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7feb100bac70 con 0x7feb280ca680 2024-04-18T04:45:19.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.504+0000 7feb1f400640 1 --2- 172.21.15.120:0/1980223985 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7feb04066690 0x7feb04068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:19.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.504+0000 7feb1f400640 1 -- 172.21.15.120:0/1980223985 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7feb10122c00 con 0x7feb280ca680 2024-04-18T04:45:19.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.504+0000 7feb26a00640 1 --2- 172.21.15.120:0/1980223985 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7feb04066690 0x7feb04068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:19.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.504+0000 7feb26a00640 1 --2- 172.21.15.120:0/1980223985 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7feb04066690 0x7feb04068b50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7feb1800b9f0 tx=0x7feb18008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:19.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.508+0000 7feb1f400640 1 -- 172.21.15.120:0/1980223985 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7feb28153f10 con 0x7feb280ca680 2024-04-18T04:45:19.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.696+0000 7feb2de00640 1 -- 172.21.15.120:0/1980223985 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb28153f10 con 0x7feb280ca680 2024-04-18T04:45:19.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.696+0000 7feb1f400640 1 -- 172.21.15.120:0/1980223985 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6289 (secure 0 0 0) 0x7feb28153f10 con 0x7feb280ca680 2024-04-18T04:45:19.697 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:45:19.697 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/1552155328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1552155328},{"type":"v1","addr":"172.21.15.132:6835","nonce":1552155328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:45:08.005139+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.120:6833/2564667113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2564667113},{"type":"v1","addr":"172.21.15.120:6833","nonce":2564667113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:45:19.697 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 15 2024-04-18T04:45:19.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.696+0000 7feb2de00640 1 -- 172.21.15.120:0/1980223985 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7feb04066690 msgr2=0x7feb04068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:19.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.696+0000 7feb2de00640 1 --2- 172.21.15.120:0/1980223985 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7feb04066690 0x7feb04068b50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7feb1800b9f0 tx=0x7feb18008040 comp rx=0 tx=0).stop 2024-04-18T04:45:19.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.696+0000 7feb2de00640 1 -- 172.21.15.120:0/1980223985 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb280ca680 msgr2=0x7feb280c6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:19.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.696+0000 7feb2de00640 1 --2- 172.21.15.120:0/1980223985 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb280ca680 0x7feb280c6440 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7feb1001d3c0 tx=0x7feb1001bab0 comp rx=0 tx=0).stop 2024-04-18T04:45:19.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.696+0000 7feb2de00640 1 -- 172.21.15.120:0/1980223985 shutdown_connections 2024-04-18T04:45:19.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.696+0000 7feb2de00640 1 --2- 172.21.15.120:0/1980223985 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7feb04066690 0x7feb04068b50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:19.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.696+0000 7feb2de00640 1 --2- 172.21.15.120:0/1980223985 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb281515e0 0x7feb280c59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:19.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.696+0000 7feb2de00640 1 --2- 172.21.15.120:0/1980223985 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb280ca680 0x7feb280c6440 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:19.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.696+0000 7feb2de00640 1 --2- 172.21.15.120:0/1980223985 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb280ca280 0x7feb281ef3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:19.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.696+0000 7feb2de00640 1 -- 172.21.15.120:0/1980223985 >> 172.21.15.120:0/1980223985 conn(0x7feb2806e0f0 msgr2=0x7feb280b26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:19.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.696+0000 7feb2de00640 1 -- 172.21.15.120:0/1980223985 shutdown_connections 2024-04-18T04:45:19.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.696+0000 7feb2de00640 1 -- 172.21.15.120:0/1980223985 wait complete. 2024-04-18T04:45:19.719 INFO:tasks.mds_thrash:Ready to start thrashing 2024-04-18T04:45:19.719 INFO:tasks.mds_thrash.ceph_manager:waiting for clean 2024-04-18T04:45:19.719 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T04:45:19.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.852+0000 7fb5b9200640 1 Processor -- start 2024-04-18T04:45:19.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.852+0000 7fb5b9200640 1 -- start start 2024-04-18T04:45:19.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.856+0000 7fb5b9200640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb5b40c7480 0x7fb5b40c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:19.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.856+0000 7fb5b9200640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb5b40bfe70 0x7fb5b40c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:19.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.856+0000 7fb5b9200640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5b406f9b0 con 0x7fb5b4150340 2024-04-18T04:45:19.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.856+0000 7fb5b9200640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5b4156b40 con 0x7fb5b40c7480 2024-04-18T04:45:19.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.856+0000 7fb5b9200640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5b40c0520 con 0x7fb5b40bfe70 2024-04-18T04:45:19.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.856+0000 7fb5a9400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb5b40c7480 0x7fb5b40c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:19.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.856+0000 7fb5a9400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb5b40c7480 0x7fb5b40c68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46896/0 (socket says 172.21.15.120:46896) 2024-04-18T04:45:19.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.856+0000 7fb5a9400640 1 -- 172.21.15.120:0/1166864667 learned_addr learned my addr 172.21.15.120:0/1166864667 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:19.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.856+0000 7fb5b2800640 1 --2- 172.21.15.120:0/1166864667 >> v2:172.21.15.132:3300/0 conn(0x7fb5b40bfe70 0x7fb5b40c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:19.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.856+0000 7fb5a9400640 1 -- 172.21.15.120:0/1166864667 >> v2:172.21.15.132:3300/0 conn(0x7fb5b40bfe70 msgr2=0x7fb5b40c6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:19.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.856+0000 7fb5a9400640 1 --2- 172.21.15.120:0/1166864667 >> v2:172.21.15.132:3300/0 conn(0x7fb5b40bfe70 0x7fb5b40c6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:19.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.856+0000 7fb5a9400640 1 -- 172.21.15.120:0/1166864667 >> v1:172.21.15.132:6789/0 conn(0x7fb5b4150340 legacy=0x7fb5b4156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:19.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.856+0000 7fb5a9400640 1 -- 172.21.15.120:0/1166864667 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b40c0800 con 0x7fb5b40c7480 2024-04-18T04:45:19.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.856+0000 7fb5a9400640 1 --2- 172.21.15.120:0/1166864667 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5b40c7480 0x7fb5b40c68d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4071a20 tx=0x7fb59c01ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dd2bff4d72838d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:19.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.856+0000 7fb5b1400640 1 -- 172.21.15.120:0/1166864667 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59c0a89d0 con 0x7fb5b40c7480 2024-04-18T04:45:19.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.856+0000 7fb5b1400640 1 -- 172.21.15.120:0/1166864667 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59c0a8b30 con 0x7fb5b40c7480 2024-04-18T04:45:19.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.856+0000 7fb5b1400640 1 -- 172.21.15.120:0/1166864667 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59c0b0440 con 0x7fb5b40c7480 2024-04-18T04:45:19.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.860+0000 7fb5b9200640 1 -- 172.21.15.120:0/1166864667 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5b40c7480 msgr2=0x7fb5b40c68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:19.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.860+0000 7fb5b9200640 1 --2- 172.21.15.120:0/1166864667 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5b40c7480 0x7fb5b40c68d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4071a20 tx=0x7fb59c01ecd0 comp rx=0 tx=0).stop 2024-04-18T04:45:19.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.860+0000 7fb5b9200640 1 -- 172.21.15.120:0/1166864667 shutdown_connections 2024-04-18T04:45:19.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.860+0000 7fb5b9200640 1 --2- 172.21.15.120:0/1166864667 >> v2:172.21.15.132:3300/0 conn(0x7fb5b40bfe70 0x7fb5b40c6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:19.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.860+0000 7fb5b9200640 1 --2- 172.21.15.120:0/1166864667 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5b40c7480 0x7fb5b40c68d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:19.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.860+0000 7fb5b9200640 1 -- 172.21.15.120:0/1166864667 >> 172.21.15.120:0/1166864667 conn(0x7fb5b40c78c0 msgr2=0x7fb5b40c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:19.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.860+0000 7fb5b9200640 1 -- 172.21.15.120:0/1166864667 shutdown_connections 2024-04-18T04:45:19.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.860+0000 7fb5b9200640 1 -- 172.21.15.120:0/1166864667 wait complete. 2024-04-18T04:45:19.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.860+0000 7fb5b9200640 1 Processor -- start 2024-04-18T04:45:19.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.860+0000 7fb5b9200640 1 -- start start 2024-04-18T04:45:19.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.860+0000 7fb5b9200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb5b40bfe70 0x7fb5b4145bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:19.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.860+0000 7fb5b9200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5b40c7480 0x7fb5b41471f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:19.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.860+0000 7fb5b9200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5b4150340 0x7fb5b414b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:19.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.860+0000 7fb5b9200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b41dfc40 con 0x7fb5b40c7480 2024-04-18T04:45:19.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.860+0000 7fb5b9200640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b4146100 con 0x7fb5b4150340 2024-04-18T04:45:19.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.860+0000 7fb5b9200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b4147730 con 0x7fb5b40bfe70 2024-04-18T04:45:19.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.860+0000 7fb5a9400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5b40c7480 0x7fb5b41471f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:19.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.860+0000 7fb5a9400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5b40c7480 0x7fb5b41471f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46912/0 (socket says 172.21.15.120:46912) 2024-04-18T04:45:19.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.860+0000 7fb5a9400640 1 -- 172.21.15.120:0/810241076 learned_addr learned my addr 172.21.15.120:0/810241076 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:19.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.860+0000 7fb5b2800640 1 --2- 172.21.15.120:0/810241076 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5b4150340 0x7fb5b414b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:19.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.860+0000 7fb5b1e00640 1 --2- 172.21.15.120:0/810241076 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb5b40bfe70 0x7fb5b4145bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:19.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.860+0000 7fb5a9400640 1 -- 172.21.15.120:0/810241076 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb5b40bfe70 msgr2=0x7fb5b4145bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:19.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.860+0000 7fb5a9400640 1 --2- 172.21.15.120:0/810241076 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb5b40bfe70 0x7fb5b4145bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:19.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.860+0000 7fb5a9400640 1 -- 172.21.15.120:0/810241076 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5b4150340 msgr2=0x7fb5b414b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:19.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.860+0000 7fb5a9400640 1 --2- 172.21.15.120:0/810241076 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5b4150340 0x7fb5b414b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:19.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.860+0000 7fb5a9400640 1 -- 172.21.15.120:0/810241076 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb59c0094d0 con 0x7fb5b40c7480 2024-04-18T04:45:19.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.864+0000 7fb5a9400640 1 --2- 172.21.15.120:0/810241076 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5b40c7480 0x7fb5b41471f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb59c0b3040 tx=0x7fb59c01ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:19.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.864+0000 7fb5aaa00640 1 -- 172.21.15.120:0/810241076 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59c0ba600 con 0x7fb5b40c7480 2024-04-18T04:45:19.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.864+0000 7fb5aaa00640 1 -- 172.21.15.120:0/810241076 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59c0ba760 con 0x7fb5b40c7480 2024-04-18T04:45:19.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.864+0000 7fb5aaa00640 1 -- 172.21.15.120:0/810241076 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59c0bab10 con 0x7fb5b40c7480 2024-04-18T04:45:19.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.864+0000 7fb5b9200640 1 -- 172.21.15.120:0/810241076 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5b41f29b0 con 0x7fb5b40c7480 2024-04-18T04:45:19.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.864+0000 7fb5b9200640 1 -- 172.21.15.120:0/810241076 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5b41f2f70 con 0x7fb5b40c7480 2024-04-18T04:45:19.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.864+0000 7fb5b9200640 1 -- 172.21.15.120:0/810241076 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5b40726d0 con 0x7fb5b40c7480 2024-04-18T04:45:19.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.864+0000 7fb5aaa00640 1 -- 172.21.15.120:0/810241076 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb59c0bac70 con 0x7fb5b40c7480 2024-04-18T04:45:19.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.864+0000 7fb5aaa00640 1 --2- 172.21.15.120:0/810241076 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb5900666c0 0x7fb590068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:19.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.864+0000 7fb5aaa00640 1 -- 172.21.15.120:0/810241076 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb59c122c50 con 0x7fb5b40c7480 2024-04-18T04:45:19.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.864+0000 7fb5b1e00640 1 --2- 172.21.15.120:0/810241076 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb5900666c0 0x7fb590068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:19.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.868+0000 7fb5b1e00640 1 --2- 172.21.15.120:0/810241076 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb5900666c0 0x7fb590068b80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb5a400b810 tx=0x7fb5a4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:19.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:19.868+0000 7fb5aaa00640 1 -- 172.21.15.120:0/810241076 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fb59c0efad0 con 0x7fb5b40c7480 2024-04-18T04:45:20.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.020+0000 7fb5b9200640 1 -- 172.21.15.120:0/810241076 --> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb5b40c0ae0 con 0x7fb5900666c0 2024-04-18T04:45:20.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.032+0000 7fb5aaa00640 1 -- 172.21.15.120:0/810241076 <== mgr.4113 v2:172.21.15.132:6832/27788 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+348500 (secure 0 0 0) 0x7fb5a400b400 con 0x7fb5900666c0 2024-04-18T04:45:20.037 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:45:20.040 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-04-18T04:45:20.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.036+0000 7fb5b9200640 1 -- 172.21.15.120:0/810241076 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb5900666c0 msgr2=0x7fb590068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:20.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.036+0000 7fb5b9200640 1 --2- 172.21.15.120:0/810241076 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb5900666c0 0x7fb590068b80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb5a400b810 tx=0x7fb5a4008040 comp rx=0 tx=0).stop 2024-04-18T04:45:20.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.036+0000 7fb5b9200640 1 -- 172.21.15.120:0/810241076 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5b40c7480 msgr2=0x7fb5b41471f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:20.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.036+0000 7fb5b9200640 1 --2- 172.21.15.120:0/810241076 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5b40c7480 0x7fb5b41471f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb59c0b3040 tx=0x7fb59c01ba70 comp rx=0 tx=0).stop 2024-04-18T04:45:20.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.036+0000 7fb5b9200640 1 -- 172.21.15.120:0/810241076 shutdown_connections 2024-04-18T04:45:20.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.036+0000 7fb5b9200640 1 --2- 172.21.15.120:0/810241076 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb5900666c0 0x7fb590068b80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:20.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.036+0000 7fb5b9200640 1 --2- 172.21.15.120:0/810241076 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5b4150340 0x7fb5b414b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:20.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.036+0000 7fb5b9200640 1 --2- 172.21.15.120:0/810241076 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5b40c7480 0x7fb5b41471f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:20.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.036+0000 7fb5b9200640 1 --2- 172.21.15.120:0/810241076 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb5b40bfe70 0x7fb5b4145bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:20.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.036+0000 7fb5b9200640 1 -- 172.21.15.120:0/810241076 >> 172.21.15.120:0/810241076 conn(0x7fb5b40c78c0 msgr2=0x7fb5b40c0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:20.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.036+0000 7fb5b9200640 1 -- 172.21.15.120:0/810241076 shutdown_connections 2024-04-18T04:45:20.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.036+0000 7fb5b9200640 1 -- 172.21.15.120:0/810241076 wait complete. 2024-04-18T04:45:20.057 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-04-18T04:45:18.808540+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597936,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":288,"num_write_kb":2459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218660,"kb_used_data":2496,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756060,"statfs":{"total":773094113280,"available":772870205440,"internally_reserved":0,"allocated":2555904,"data_stored":2126496,"data_compressed":66624,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":832,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003643"},"pg_stats":[{"pgid":"2.1f","version":"25'9","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040333+0000","last_change":"2024-04-18T04:44:29.891079+0000","last_active":"2024-04-18T04:45:11.040333+0000","last_peered":"2024-04-18T04:45:11.040333+0000","last_clean":"2024-04-18T04:45:11.040333+0000","last_became_active":"2024-04-18T04:44:29.890853+0000","last_became_peered":"2024-04-18T04:44:29.890853+0000","last_unstale":"2024-04-18T04:45:11.040333+0000","last_undegraded":"2024-04-18T04:45:11.040333+0000","last_fullsized":"2024-04-18T04:45:11.040333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:12:22.299583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.033252+0000","last_change":"2024-04-18T04:44:30.296344+0000","last_active":"2024-04-18T04:45:11.033252+0000","last_peered":"2024-04-18T04:45:11.033252+0000","last_clean":"2024-04-18T04:45:11.033252+0000","last_became_active":"2024-04-18T04:44:30.296064+0000","last_became_peered":"2024-04-18T04:44:30.296064+0000","last_unstale":"2024-04-18T04:45:11.033252+0000","last_undegraded":"2024-04-18T04:45:11.033252+0000","last_fullsized":"2024-04-18T04:45:11.033252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:53:32.250308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.032245+0000","last_change":"2024-04-18T04:44:34.306605+0000","last_active":"2024-04-18T04:45:11.032245+0000","last_peered":"2024-04-18T04:45:11.032245+0000","last_clean":"2024-04-18T04:45:11.032245+0000","last_became_active":"2024-04-18T04:44:34.306224+0000","last_became_peered":"2024-04-18T04:44:34.306224+0000","last_unstale":"2024-04-18T04:45:11.032245+0000","last_undegraded":"2024-04-18T04:45:11.032245+0000","last_fullsized":"2024-04-18T04:45:11.032245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:13:15.107711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.033341+0000","last_change":"2024-04-18T04:44:29.881521+0000","last_active":"2024-04-18T04:45:11.033341+0000","last_peered":"2024-04-18T04:45:11.033341+0000","last_clean":"2024-04-18T04:45:11.033341+0000","last_became_active":"2024-04-18T04:44:29.881258+0000","last_became_peered":"2024-04-18T04:44:29.881258+0000","last_unstale":"2024-04-18T04:45:11.033341+0000","last_undegraded":"2024-04-18T04:45:11.033341+0000","last_fullsized":"2024-04-18T04:45:11.033341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:28:40.075960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040116+0000","last_change":"2024-04-18T04:44:30.314205+0000","last_active":"2024-04-18T04:45:11.040116+0000","last_peered":"2024-04-18T04:45:11.040116+0000","last_clean":"2024-04-18T04:45:11.040116+0000","last_became_active":"2024-04-18T04:44:30.313987+0000","last_became_peered":"2024-04-18T04:44:30.313987+0000","last_unstale":"2024-04-18T04:45:11.040116+0000","last_undegraded":"2024-04-18T04:45:11.040116+0000","last_fullsized":"2024-04-18T04:45:11.040116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:55:31.107861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.045581+0000","last_change":"2024-04-18T04:44:34.339646+0000","last_active":"2024-04-18T04:45:11.045581+0000","last_peered":"2024-04-18T04:45:11.045581+0000","last_clean":"2024-04-18T04:45:11.045581+0000","last_became_active":"2024-04-18T04:44:34.338485+0000","last_became_peered":"2024-04-18T04:44:34.338485+0000","last_unstale":"2024-04-18T04:45:11.045581+0000","last_undegraded":"2024-04-18T04:45:11.045581+0000","last_fullsized":"2024-04-18T04:45:11.045581+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:47:01.277301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'4","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.041934+0000","last_change":"2024-04-18T04:44:29.897785+0000","last_active":"2024-04-18T04:45:11.041934+0000","last_peered":"2024-04-18T04:45:11.041934+0000","last_clean":"2024-04-18T04:45:11.041934+0000","last_became_active":"2024-04-18T04:44:29.896520+0000","last_became_peered":"2024-04-18T04:44:29.896520+0000","last_unstale":"2024-04-18T04:45:11.041934+0000","last_undegraded":"2024-04-18T04:45:11.041934+0000","last_fullsized":"2024-04-18T04:45:11.041934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:25:52.871139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.048559+0000","last_change":"2024-04-18T04:44:30.300588+0000","last_active":"2024-04-18T04:45:11.048559+0000","last_peered":"2024-04-18T04:45:11.048559+0000","last_clean":"2024-04-18T04:45:11.048559+0000","last_became_active":"2024-04-18T04:44:30.299939+0000","last_became_peered":"2024-04-18T04:44:30.299939+0000","last_unstale":"2024-04-18T04:45:11.048559+0000","last_undegraded":"2024-04-18T04:45:11.048559+0000","last_fullsized":"2024-04-18T04:45:11.048559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:57:07.547985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.050267+0000","last_change":"2024-04-18T04:44:34.338794+0000","last_active":"2024-04-18T04:45:11.050267+0000","last_peered":"2024-04-18T04:45:11.050267+0000","last_clean":"2024-04-18T04:45:11.050267+0000","last_became_active":"2024-04-18T04:44:34.337938+0000","last_became_peered":"2024-04-18T04:44:34.337938+0000","last_unstale":"2024-04-18T04:45:11.050267+0000","last_undegraded":"2024-04-18T04:45:11.050267+0000","last_fullsized":"2024-04-18T04:45:11.050267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:48.827970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040848+0000","last_change":"2024-04-18T04:44:29.903118+0000","last_active":"2024-04-18T04:45:11.040848+0000","last_peered":"2024-04-18T04:45:11.040848+0000","last_clean":"2024-04-18T04:45:11.040848+0000","last_became_active":"2024-04-18T04:44:29.902611+0000","last_became_peered":"2024-04-18T04:44:29.902611+0000","last_unstale":"2024-04-18T04:45:11.040848+0000","last_undegraded":"2024-04-18T04:45:11.040848+0000","last_fullsized":"2024-04-18T04:45:11.040848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:38:42.595095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.048818+0000","last_change":"2024-04-18T04:44:30.301328+0000","last_active":"2024-04-18T04:45:11.048818+0000","last_peered":"2024-04-18T04:45:11.048818+0000","last_clean":"2024-04-18T04:45:11.048818+0000","last_became_active":"2024-04-18T04:44:30.300303+0000","last_became_peered":"2024-04-18T04:44:30.300303+0000","last_unstale":"2024-04-18T04:45:11.048818+0000","last_undegraded":"2024-04-18T04:45:11.048818+0000","last_fullsized":"2024-04-18T04:45:11.048818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:24:11.941483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.048428+0000","last_change":"2024-04-18T04:44:34.327044+0000","last_active":"2024-04-18T04:45:11.048428+0000","last_peered":"2024-04-18T04:45:11.048428+0000","last_clean":"2024-04-18T04:45:11.048428+0000","last_became_active":"2024-04-18T04:44:34.326161+0000","last_became_peered":"2024-04-18T04:44:34.326161+0000","last_unstale":"2024-04-18T04:45:11.048428+0000","last_undegraded":"2024-04-18T04:45:11.048428+0000","last_fullsized":"2024-04-18T04:45:11.048428+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:47:41.413530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.037314+0000","last_change":"2024-04-18T04:44:30.296493+0000","last_active":"2024-04-18T04:45:11.037314+0000","last_peered":"2024-04-18T04:45:11.037314+0000","last_clean":"2024-04-18T04:45:11.037314+0000","last_became_active":"2024-04-18T04:44:30.295657+0000","last_became_peered":"2024-04-18T04:44:30.295657+0000","last_unstale":"2024-04-18T04:45:11.037314+0000","last_undegraded":"2024-04-18T04:45:11.037314+0000","last_fullsized":"2024-04-18T04:45:11.037314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:39:40.270643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040192+0000","last_change":"2024-04-18T04:44:29.900036+0000","last_active":"2024-04-18T04:45:11.040192+0000","last_peered":"2024-04-18T04:45:11.040192+0000","last_clean":"2024-04-18T04:45:11.040192+0000","last_became_active":"2024-04-18T04:44:29.899402+0000","last_became_peered":"2024-04-18T04:44:29.899402+0000","last_unstale":"2024-04-18T04:45:11.040192+0000","last_undegraded":"2024-04-18T04:45:11.040192+0000","last_fullsized":"2024-04-18T04:45:11.040192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:45:51.681317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.051768+0000","last_change":"2024-04-18T04:44:34.320846+0000","last_active":"2024-04-18T04:45:11.051768+0000","last_peered":"2024-04-18T04:45:11.051768+0000","last_clean":"2024-04-18T04:45:11.051768+0000","last_became_active":"2024-04-18T04:44:34.319868+0000","last_became_peered":"2024-04-18T04:44:34.319868+0000","last_unstale":"2024-04-18T04:45:11.051768+0000","last_undegraded":"2024-04-18T04:45:11.051768+0000","last_fullsized":"2024-04-18T04:45:11.051768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:08:30.863140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.032877+0000","last_change":"2024-04-18T04:44:30.271756+0000","last_active":"2024-04-18T04:45:11.032877+0000","last_peered":"2024-04-18T04:45:11.032877+0000","last_clean":"2024-04-18T04:45:11.032877+0000","last_became_active":"2024-04-18T04:44:30.271420+0000","last_became_peered":"2024-04-18T04:44:30.271420+0000","last_unstale":"2024-04-18T04:45:11.032877+0000","last_undegraded":"2024-04-18T04:45:11.032877+0000","last_fullsized":"2024-04-18T04:45:11.032877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:27:18.559327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"25'1","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.037938+0000","last_change":"2024-04-18T04:44:29.878416+0000","last_active":"2024-04-18T04:45:11.037938+0000","last_peered":"2024-04-18T04:45:11.037938+0000","last_clean":"2024-04-18T04:45:11.037938+0000","last_became_active":"2024-04-18T04:44:29.878139+0000","last_became_peered":"2024-04-18T04:44:29.878139+0000","last_unstale":"2024-04-18T04:45:11.037938+0000","last_undegraded":"2024-04-18T04:45:11.037938+0000","last_fullsized":"2024-04-18T04:45:11.037938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:19:00.769888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.051399+0000","last_change":"2024-04-18T04:44:34.346123+0000","last_active":"2024-04-18T04:45:11.051399+0000","last_peered":"2024-04-18T04:45:11.051399+0000","last_clean":"2024-04-18T04:45:11.051399+0000","last_became_active":"2024-04-18T04:44:34.345267+0000","last_became_peered":"2024-04-18T04:44:34.345267+0000","last_unstale":"2024-04-18T04:45:11.051399+0000","last_undegraded":"2024-04-18T04:45:11.051399+0000","last_fullsized":"2024-04-18T04:45:11.051399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:14:08.078650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.032542+0000","last_change":"2024-04-18T04:44:30.274049+0000","last_active":"2024-04-18T04:45:11.032542+0000","last_peered":"2024-04-18T04:45:11.032542+0000","last_clean":"2024-04-18T04:45:11.032542+0000","last_became_active":"2024-04-18T04:44:30.273752+0000","last_became_peered":"2024-04-18T04:44:30.273752+0000","last_unstale":"2024-04-18T04:45:11.032542+0000","last_undegraded":"2024-04-18T04:45:11.032542+0000","last_fullsized":"2024-04-18T04:45:11.032542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:48:20.479069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.037593+0000","last_change":"2024-04-18T04:44:29.890569+0000","last_active":"2024-04-18T04:45:11.037593+0000","last_peered":"2024-04-18T04:45:11.037593+0000","last_clean":"2024-04-18T04:45:11.037593+0000","last_became_active":"2024-04-18T04:44:29.889684+0000","last_became_peered":"2024-04-18T04:44:29.889684+0000","last_unstale":"2024-04-18T04:45:11.037593+0000","last_undegraded":"2024-04-18T04:45:11.037593+0000","last_fullsized":"2024-04-18T04:45:11.037593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:53:00.230580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.038087+0000","last_change":"2024-04-18T04:44:34.313634+0000","last_active":"2024-04-18T04:45:11.038087+0000","last_peered":"2024-04-18T04:45:11.038087+0000","last_clean":"2024-04-18T04:45:11.038087+0000","last_became_active":"2024-04-18T04:44:34.313161+0000","last_became_peered":"2024-04-18T04:44:34.313161+0000","last_unstale":"2024-04-18T04:45:11.038087+0000","last_undegraded":"2024-04-18T04:45:11.038087+0000","last_fullsized":"2024-04-18T04:45:11.038087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:01:07.805128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.048108+0000","last_change":"2024-04-18T04:44:30.284805+0000","last_active":"2024-04-18T04:45:11.048108+0000","last_peered":"2024-04-18T04:45:11.048108+0000","last_clean":"2024-04-18T04:45:11.048108+0000","last_became_active":"2024-04-18T04:44:30.279238+0000","last_became_peered":"2024-04-18T04:44:30.279238+0000","last_unstale":"2024-04-18T04:45:11.048108+0000","last_undegraded":"2024-04-18T04:45:11.048108+0000","last_fullsized":"2024-04-18T04:45:11.048108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:59:24.067420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.038238+0000","last_change":"2024-04-18T04:44:29.890816+0000","last_active":"2024-04-18T04:45:11.038238+0000","last_peered":"2024-04-18T04:45:11.038238+0000","last_clean":"2024-04-18T04:45:11.038238+0000","last_became_active":"2024-04-18T04:44:29.890272+0000","last_became_peered":"2024-04-18T04:44:29.890272+0000","last_unstale":"2024-04-18T04:45:11.038238+0000","last_undegraded":"2024-04-18T04:45:11.038238+0000","last_fullsized":"2024-04-18T04:45:11.038238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:30:22.614083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.052138+0000","last_change":"2024-04-18T04:44:34.344973+0000","last_active":"2024-04-18T04:45:11.052138+0000","last_peered":"2024-04-18T04:45:11.052138+0000","last_clean":"2024-04-18T04:45:11.052138+0000","last_became_active":"2024-04-18T04:44:34.344007+0000","last_became_peered":"2024-04-18T04:44:34.344007+0000","last_unstale":"2024-04-18T04:45:11.052138+0000","last_undegraded":"2024-04-18T04:45:11.052138+0000","last_fullsized":"2024-04-18T04:45:11.052138+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:56:43.476132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040630+0000","last_change":"2024-04-18T04:44:30.278193+0000","last_active":"2024-04-18T04:45:11.040630+0000","last_peered":"2024-04-18T04:45:11.040630+0000","last_clean":"2024-04-18T04:45:11.040630+0000","last_became_active":"2024-04-18T04:44:30.277916+0000","last_became_peered":"2024-04-18T04:44:30.277916+0000","last_unstale":"2024-04-18T04:45:11.040630+0000","last_undegraded":"2024-04-18T04:45:11.040630+0000","last_fullsized":"2024-04-18T04:45:11.040630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:57:19.783436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.037867+0000","last_change":"2024-04-18T04:44:29.896901+0000","last_active":"2024-04-18T04:45:11.037867+0000","last_peered":"2024-04-18T04:45:11.037867+0000","last_clean":"2024-04-18T04:45:11.037867+0000","last_became_active":"2024-04-18T04:44:29.896392+0000","last_became_peered":"2024-04-18T04:44:29.896392+0000","last_unstale":"2024-04-18T04:45:11.037867+0000","last_undegraded":"2024-04-18T04:45:11.037867+0000","last_fullsized":"2024-04-18T04:45:11.037867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:46:08.869450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.047144+0000","last_change":"2024-04-18T04:44:34.339233+0000","last_active":"2024-04-18T04:45:11.047144+0000","last_peered":"2024-04-18T04:45:11.047144+0000","last_clean":"2024-04-18T04:45:11.047144+0000","last_became_active":"2024-04-18T04:44:34.338294+0000","last_became_peered":"2024-04-18T04:44:34.338294+0000","last_unstale":"2024-04-18T04:45:11.047144+0000","last_undegraded":"2024-04-18T04:45:11.047144+0000","last_fullsized":"2024-04-18T04:45:11.047144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:20:35.738410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T04:45:12.047012+0000","last_change":"2024-04-18T04:45:12.045887+0000","last_active":"2024-04-18T04:45:12.047012+0000","last_peered":"2024-04-18T04:45:12.047012+0000","last_clean":"2024-04-18T04:45:12.047012+0000","last_became_active":"2024-04-18T04:45:12.045671+0000","last_became_peered":"2024-04-18T04:45:12.045671+0000","last_unstale":"2024-04-18T04:45:12.047012+0000","last_undegraded":"2024-04-18T04:45:12.047012+0000","last_fullsized":"2024-04-18T04:45:12.047012+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:22:58.022926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"25'3","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.039099+0000","last_change":"2024-04-18T04:44:29.894503+0000","last_active":"2024-04-18T04:45:11.039099+0000","last_peered":"2024-04-18T04:45:11.039099+0000","last_clean":"2024-04-18T04:45:11.039099+0000","last_became_active":"2024-04-18T04:44:29.894210+0000","last_became_peered":"2024-04-18T04:44:29.894210+0000","last_unstale":"2024-04-18T04:45:11.039099+0000","last_undegraded":"2024-04-18T04:45:11.039099+0000","last_fullsized":"2024-04-18T04:45:11.039099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:14:56.979204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.032183+0000","last_change":"2024-04-18T04:44:34.305652+0000","last_active":"2024-04-18T04:45:11.032183+0000","last_peered":"2024-04-18T04:45:11.032183+0000","last_clean":"2024-04-18T04:45:11.032183+0000","last_became_active":"2024-04-18T04:44:34.305180+0000","last_became_peered":"2024-04-18T04:44:34.305180+0000","last_unstale":"2024-04-18T04:45:11.032183+0000","last_undegraded":"2024-04-18T04:45:11.032183+0000","last_fullsized":"2024-04-18T04:45:11.032183+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:03:10.781821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.038292+0000","last_change":"2024-04-18T04:44:30.267158+0000","last_active":"2024-04-18T04:45:11.038292+0000","last_peered":"2024-04-18T04:45:11.038292+0000","last_clean":"2024-04-18T04:45:11.038292+0000","last_became_active":"2024-04-18T04:44:30.266814+0000","last_became_peered":"2024-04-18T04:44:30.266814+0000","last_unstale":"2024-04-18T04:45:11.038292+0000","last_undegraded":"2024-04-18T04:45:11.038292+0000","last_fullsized":"2024-04-18T04:45:11.038292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:16:02.152817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.042412+0000","last_change":"2024-04-18T04:44:29.898812+0000","last_active":"2024-04-18T04:45:11.042412+0000","last_peered":"2024-04-18T04:45:11.042412+0000","last_clean":"2024-04-18T04:45:11.042412+0000","last_became_active":"2024-04-18T04:44:29.897156+0000","last_became_peered":"2024-04-18T04:44:29.897156+0000","last_unstale":"2024-04-18T04:45:11.042412+0000","last_undegraded":"2024-04-18T04:45:11.042412+0000","last_fullsized":"2024-04-18T04:45:11.042412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:09:47.746394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040150+0000","last_change":"2024-04-18T04:44:34.324721+0000","last_active":"2024-04-18T04:45:11.040150+0000","last_peered":"2024-04-18T04:45:11.040150+0000","last_clean":"2024-04-18T04:45:11.040150+0000","last_became_active":"2024-04-18T04:44:34.322925+0000","last_became_peered":"2024-04-18T04:44:34.322925+0000","last_unstale":"2024-04-18T04:45:11.040150+0000","last_undegraded":"2024-04-18T04:45:11.040150+0000","last_fullsized":"2024-04-18T04:45:11.040150+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:11:59.682230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.048982+0000","last_change":"2024-04-18T04:44:30.281640+0000","last_active":"2024-04-18T04:45:11.048982+0000","last_peered":"2024-04-18T04:45:11.048982+0000","last_clean":"2024-04-18T04:45:11.048982+0000","last_became_active":"2024-04-18T04:44:30.280968+0000","last_became_peered":"2024-04-18T04:44:30.280968+0000","last_unstale":"2024-04-18T04:45:11.048982+0000","last_undegraded":"2024-04-18T04:45:11.048982+0000","last_fullsized":"2024-04-18T04:45:11.048982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:35:20.755711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.038370+0000","last_change":"2024-04-18T04:44:29.882715+0000","last_active":"2024-04-18T04:45:11.038370+0000","last_peered":"2024-04-18T04:45:11.038370+0000","last_clean":"2024-04-18T04:45:11.038370+0000","last_became_active":"2024-04-18T04:44:29.882335+0000","last_became_peered":"2024-04-18T04:44:29.882335+0000","last_unstale":"2024-04-18T04:45:11.038370+0000","last_undegraded":"2024-04-18T04:45:11.038370+0000","last_fullsized":"2024-04-18T04:45:11.038370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:32:59.709151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.037436+0000","last_change":"2024-04-18T04:44:34.325029+0000","last_active":"2024-04-18T04:45:11.037436+0000","last_peered":"2024-04-18T04:45:11.037436+0000","last_clean":"2024-04-18T04:45:11.037436+0000","last_became_active":"2024-04-18T04:44:34.324082+0000","last_became_peered":"2024-04-18T04:44:34.324082+0000","last_unstale":"2024-04-18T04:45:11.037436+0000","last_undegraded":"2024-04-18T04:45:11.037436+0000","last_fullsized":"2024-04-18T04:45:11.037436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:28:10.378037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.050780+0000","last_change":"2024-04-18T04:44:30.276174+0000","last_active":"2024-04-18T04:45:11.050780+0000","last_peered":"2024-04-18T04:45:11.050780+0000","last_clean":"2024-04-18T04:45:11.050780+0000","last_became_active":"2024-04-18T04:44:30.270878+0000","last_became_peered":"2024-04-18T04:44:30.270878+0000","last_unstale":"2024-04-18T04:45:11.050780+0000","last_undegraded":"2024-04-18T04:45:11.050780+0000","last_fullsized":"2024-04-18T04:45:11.050780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:35:12.296277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"25'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.048628+0000","last_change":"2024-04-18T04:44:29.896745+0000","last_active":"2024-04-18T04:45:11.048628+0000","last_peered":"2024-04-18T04:45:11.048628+0000","last_clean":"2024-04-18T04:45:11.048628+0000","last_became_active":"2024-04-18T04:44:29.896199+0000","last_became_peered":"2024-04-18T04:44:29.896199+0000","last_unstale":"2024-04-18T04:45:11.048628+0000","last_undegraded":"2024-04-18T04:45:11.048628+0000","last_fullsized":"2024-04-18T04:45:11.048628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:25:05.424668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.038216+0000","last_change":"2024-04-18T04:44:34.337429+0000","last_active":"2024-04-18T04:45:11.038216+0000","last_peered":"2024-04-18T04:45:11.038216+0000","last_clean":"2024-04-18T04:45:11.038216+0000","last_became_active":"2024-04-18T04:44:34.337089+0000","last_became_peered":"2024-04-18T04:44:34.337089+0000","last_unstale":"2024-04-18T04:45:11.038216+0000","last_undegraded":"2024-04-18T04:45:11.038216+0000","last_fullsized":"2024-04-18T04:45:11.038216+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:00:56.976431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.037512+0000","last_change":"2024-04-18T04:44:30.270874+0000","last_active":"2024-04-18T04:45:11.037512+0000","last_peered":"2024-04-18T04:45:11.037512+0000","last_clean":"2024-04-18T04:45:11.037512+0000","last_became_active":"2024-04-18T04:44:30.270636+0000","last_became_peered":"2024-04-18T04:44:30.270636+0000","last_unstale":"2024-04-18T04:45:11.037512+0000","last_undegraded":"2024-04-18T04:45:11.037512+0000","last_fullsized":"2024-04-18T04:45:11.037512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:25:49.889554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"25'4","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.035662+0000","last_change":"2024-04-18T04:44:29.878607+0000","last_active":"2024-04-18T04:45:11.035662+0000","last_peered":"2024-04-18T04:45:11.035662+0000","last_clean":"2024-04-18T04:45:11.035662+0000","last_became_active":"2024-04-18T04:44:29.878330+0000","last_became_peered":"2024-04-18T04:44:29.878330+0000","last_unstale":"2024-04-18T04:45:11.035662+0000","last_undegraded":"2024-04-18T04:45:11.035662+0000","last_fullsized":"2024-04-18T04:45:11.035662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:09:18.088701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.038115+0000","last_change":"2024-04-18T04:44:34.323315+0000","last_active":"2024-04-18T04:45:11.038115+0000","last_peered":"2024-04-18T04:45:11.038115+0000","last_clean":"2024-04-18T04:45:11.038115+0000","last_became_active":"2024-04-18T04:44:34.322983+0000","last_became_peered":"2024-04-18T04:44:34.322983+0000","last_unstale":"2024-04-18T04:45:11.038115+0000","last_undegraded":"2024-04-18T04:45:11.038115+0000","last_fullsized":"2024-04-18T04:45:11.038115+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:48:12.803273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.039727+0000","last_change":"2024-04-18T04:44:30.285533+0000","last_active":"2024-04-18T04:45:11.039727+0000","last_peered":"2024-04-18T04:45:11.039727+0000","last_clean":"2024-04-18T04:45:11.039727+0000","last_became_active":"2024-04-18T04:44:30.285113+0000","last_became_peered":"2024-04-18T04:44:30.285113+0000","last_unstale":"2024-04-18T04:45:11.039727+0000","last_undegraded":"2024-04-18T04:45:11.039727+0000","last_fullsized":"2024-04-18T04:45:11.039727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:37:20.367349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"25'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.038377+0000","last_change":"2024-04-18T04:44:29.890701+0000","last_active":"2024-04-18T04:45:11.038377+0000","last_peered":"2024-04-18T04:45:11.038377+0000","last_clean":"2024-04-18T04:45:11.038377+0000","last_became_active":"2024-04-18T04:44:29.890207+0000","last_became_peered":"2024-04-18T04:44:29.890207+0000","last_unstale":"2024-04-18T04:45:11.038377+0000","last_undegraded":"2024-04-18T04:45:11.038377+0000","last_fullsized":"2024-04-18T04:45:11.038377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:06:58.470725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T04:45:12.378646+0000","last_change":"2024-04-18T04:45:12.378646+0000","last_active":"2024-04-18T04:45:12.378646+0000","last_peered":"2024-04-18T04:45:12.378646+0000","last_clean":"2024-04-18T04:45:12.378646+0000","last_became_active":"2024-04-18T04:45:12.378263+0000","last_became_peered":"2024-04-18T04:45:12.378263+0000","last_unstale":"2024-04-18T04:45:12.378646+0000","last_undegraded":"2024-04-18T04:45:12.378646+0000","last_fullsized":"2024-04-18T04:45:12.378646+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:59:31.439452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.032623+0000","last_change":"2024-04-18T04:44:30.306826+0000","last_active":"2024-04-18T04:45:11.032623+0000","last_peered":"2024-04-18T04:45:11.032623+0000","last_clean":"2024-04-18T04:45:11.032623+0000","last_became_active":"2024-04-18T04:44:30.306320+0000","last_became_peered":"2024-04-18T04:44:30.306320+0000","last_unstale":"2024-04-18T04:45:11.032623+0000","last_undegraded":"2024-04-18T04:45:11.032623+0000","last_fullsized":"2024-04-18T04:45:11.032623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:47:38.564197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"25'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.046193+0000","last_change":"2024-04-18T04:44:29.888023+0000","last_active":"2024-04-18T04:45:11.046193+0000","last_peered":"2024-04-18T04:45:11.046193+0000","last_clean":"2024-04-18T04:45:11.046193+0000","last_became_active":"2024-04-18T04:44:29.887440+0000","last_became_peered":"2024-04-18T04:44:29.887440+0000","last_unstale":"2024-04-18T04:45:11.046193+0000","last_undegraded":"2024-04-18T04:45:11.046193+0000","last_fullsized":"2024-04-18T04:45:11.046193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:07:01.067445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.038470+0000","last_change":"2024-04-18T04:44:18.629794+0000","last_active":"2024-04-18T04:45:11.038470+0000","last_peered":"2024-04-18T04:45:11.038470+0000","last_clean":"2024-04-18T04:45:11.038470+0000","last_became_active":"2024-04-18T04:44:18.627792+0000","last_became_peered":"2024-04-18T04:44:18.627792+0000","last_unstale":"2024-04-18T04:45:11.038470+0000","last_undegraded":"2024-04-18T04:45:11.038470+0000","last_fullsized":"2024-04-18T04:45:11.038470+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:17.410146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:17.410146+0000","last_clean_scrub_stamp":"2024-04-18T04:44:17.410146+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:30:49.101656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.039415+0000","last_change":"2024-04-18T04:44:34.333286+0000","last_active":"2024-04-18T04:45:11.039415+0000","last_peered":"2024-04-18T04:45:11.039415+0000","last_clean":"2024-04-18T04:45:11.039415+0000","last_became_active":"2024-04-18T04:44:34.332520+0000","last_became_peered":"2024-04-18T04:44:34.332520+0000","last_unstale":"2024-04-18T04:45:11.039415+0000","last_undegraded":"2024-04-18T04:45:11.039415+0000","last_fullsized":"2024-04-18T04:45:11.039415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:58:48.264040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.041500+0000","last_change":"2024-04-18T04:44:30.303602+0000","last_active":"2024-04-18T04:45:11.041500+0000","last_peered":"2024-04-18T04:45:11.041500+0000","last_clean":"2024-04-18T04:45:11.041500+0000","last_became_active":"2024-04-18T04:44:30.302157+0000","last_became_peered":"2024-04-18T04:44:30.302157+0000","last_unstale":"2024-04-18T04:45:11.041500+0000","last_undegraded":"2024-04-18T04:45:11.041500+0000","last_fullsized":"2024-04-18T04:45:11.041500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:09:57.582065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"25'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.035979+0000","last_change":"2024-04-18T04:44:29.890428+0000","last_active":"2024-04-18T04:45:11.035979+0000","last_peered":"2024-04-18T04:45:11.035979+0000","last_clean":"2024-04-18T04:45:11.035979+0000","last_became_active":"2024-04-18T04:44:29.890166+0000","last_became_peered":"2024-04-18T04:44:29.890166+0000","last_unstale":"2024-04-18T04:45:11.035979+0000","last_undegraded":"2024-04-18T04:45:11.035979+0000","last_fullsized":"2024-04-18T04:45:11.035979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:21:16.823377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.037062+0000","last_change":"2024-04-18T04:44:34.334071+0000","last_active":"2024-04-18T04:45:11.037062+0000","last_peered":"2024-04-18T04:45:11.037062+0000","last_clean":"2024-04-18T04:45:11.037062+0000","last_became_active":"2024-04-18T04:44:34.332695+0000","last_became_peered":"2024-04-18T04:44:34.332695+0000","last_unstale":"2024-04-18T04:45:11.037062+0000","last_undegraded":"2024-04-18T04:45:11.037062+0000","last_fullsized":"2024-04-18T04:45:11.037062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:22:52.371921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.048836+0000","last_change":"2024-04-18T04:44:30.287908+0000","last_active":"2024-04-18T04:45:11.048836+0000","last_peered":"2024-04-18T04:45:11.048836+0000","last_clean":"2024-04-18T04:45:11.048836+0000","last_became_active":"2024-04-18T04:44:30.287217+0000","last_became_peered":"2024-04-18T04:44:30.287217+0000","last_unstale":"2024-04-18T04:45:11.048836+0000","last_undegraded":"2024-04-18T04:45:11.048836+0000","last_fullsized":"2024-04-18T04:45:11.048836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:47:14.962330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.038311+0000","last_change":"2024-04-18T04:44:29.886376+0000","last_active":"2024-04-18T04:45:11.038311+0000","last_peered":"2024-04-18T04:45:11.038311+0000","last_clean":"2024-04-18T04:45:11.038311+0000","last_became_active":"2024-04-18T04:44:29.886058+0000","last_became_peered":"2024-04-18T04:44:29.886058+0000","last_unstale":"2024-04-18T04:45:11.038311+0000","last_undegraded":"2024-04-18T04:45:11.038311+0000","last_fullsized":"2024-04-18T04:45:11.038311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:29:59.678071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T04:45:12.373987+0000","last_change":"2024-04-18T04:45:12.373987+0000","last_active":"2024-04-18T04:45:12.373987+0000","last_peered":"2024-04-18T04:45:12.373987+0000","last_clean":"2024-04-18T04:45:12.373987+0000","last_became_active":"2024-04-18T04:45:12.373269+0000","last_became_peered":"2024-04-18T04:45:12.373269+0000","last_unstale":"2024-04-18T04:45:12.373987+0000","last_undegraded":"2024-04-18T04:45:12.373987+0000","last_fullsized":"2024-04-18T04:45:12.373987+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:19:01.073786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T04:45:12.046573+0000","last_change":"2024-04-18T04:45:12.043098+0000","last_active":"2024-04-18T04:45:12.046573+0000","last_peered":"2024-04-18T04:45:12.046573+0000","last_clean":"2024-04-18T04:45:12.046573+0000","last_became_active":"2024-04-18T04:45:12.042803+0000","last_became_peered":"2024-04-18T04:45:12.042803+0000","last_unstale":"2024-04-18T04:45:12.046573+0000","last_undegraded":"2024-04-18T04:45:12.046573+0000","last_fullsized":"2024-04-18T04:45:12.046573+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:15:13.837607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.036150+0000","last_change":"2024-04-18T04:44:29.878650+0000","last_active":"2024-04-18T04:45:11.036150+0000","last_peered":"2024-04-18T04:45:11.036150+0000","last_clean":"2024-04-18T04:45:11.036150+0000","last_became_active":"2024-04-18T04:44:29.878361+0000","last_became_peered":"2024-04-18T04:44:29.878361+0000","last_unstale":"2024-04-18T04:45:11.036150+0000","last_undegraded":"2024-04-18T04:45:11.036150+0000","last_fullsized":"2024-04-18T04:45:11.036150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:57:41.162118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.044110+0000","last_change":"2024-04-18T04:44:34.339023+0000","last_active":"2024-04-18T04:45:11.044110+0000","last_peered":"2024-04-18T04:45:11.044110+0000","last_clean":"2024-04-18T04:45:11.044110+0000","last_became_active":"2024-04-18T04:44:34.338042+0000","last_became_peered":"2024-04-18T04:44:34.338042+0000","last_unstale":"2024-04-18T04:45:11.044110+0000","last_undegraded":"2024-04-18T04:45:11.044110+0000","last_fullsized":"2024-04-18T04:45:11.044110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:48:58.174635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.042856+0000","last_change":"2024-04-18T04:44:30.291740+0000","last_active":"2024-04-18T04:45:11.042856+0000","last_peered":"2024-04-18T04:45:11.042856+0000","last_clean":"2024-04-18T04:45:11.042856+0000","last_became_active":"2024-04-18T04:44:30.290379+0000","last_became_peered":"2024-04-18T04:44:30.290379+0000","last_unstale":"2024-04-18T04:45:11.042856+0000","last_undegraded":"2024-04-18T04:45:11.042856+0000","last_fullsized":"2024-04-18T04:45:11.042856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:44:25.111858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'2","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T04:45:12.041554+0000","last_change":"2024-04-18T04:44:29.882833+0000","last_active":"2024-04-18T04:45:12.041554+0000","last_peered":"2024-04-18T04:45:12.041554+0000","last_clean":"2024-04-18T04:45:12.041554+0000","last_became_active":"2024-04-18T04:44:29.881671+0000","last_became_peered":"2024-04-18T04:44:29.881671+0000","last_unstale":"2024-04-18T04:45:12.041554+0000","last_undegraded":"2024-04-18T04:45:12.041554+0000","last_fullsized":"2024-04-18T04:45:12.041554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:29:22.037641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.046910+0000","last_change":"2024-04-18T04:44:34.342465+0000","last_active":"2024-04-18T04:45:11.046910+0000","last_peered":"2024-04-18T04:45:11.046910+0000","last_clean":"2024-04-18T04:45:11.046910+0000","last_became_active":"2024-04-18T04:44:34.340327+0000","last_became_peered":"2024-04-18T04:44:34.340327+0000","last_unstale":"2024-04-18T04:45:11.046910+0000","last_undegraded":"2024-04-18T04:45:11.046910+0000","last_fullsized":"2024-04-18T04:45:11.046910+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:31:44.168899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.039103+0000","last_change":"2024-04-18T04:44:30.299403+0000","last_active":"2024-04-18T04:45:11.039103+0000","last_peered":"2024-04-18T04:45:11.039103+0000","last_clean":"2024-04-18T04:45:11.039103+0000","last_became_active":"2024-04-18T04:44:30.298417+0000","last_became_peered":"2024-04-18T04:44:30.298417+0000","last_unstale":"2024-04-18T04:45:11.039103+0000","last_undegraded":"2024-04-18T04:45:11.039103+0000","last_fullsized":"2024-04-18T04:45:11.039103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:43:24.120294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'15","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.035582+0000","last_change":"2024-04-18T04:44:29.875345+0000","last_active":"2024-04-18T04:45:11.035582+0000","last_peered":"2024-04-18T04:45:11.035582+0000","last_clean":"2024-04-18T04:45:11.035582+0000","last_became_active":"2024-04-18T04:44:29.875059+0000","last_became_peered":"2024-04-18T04:44:29.875059+0000","last_unstale":"2024-04-18T04:45:11.035582+0000","last_undegraded":"2024-04-18T04:45:11.035582+0000","last_fullsized":"2024-04-18T04:45:11.035582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:06:54.218096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040511+0000","last_change":"2024-04-18T04:44:34.334498+0000","last_active":"2024-04-18T04:45:11.040511+0000","last_peered":"2024-04-18T04:45:11.040511+0000","last_clean":"2024-04-18T04:45:11.040511+0000","last_became_active":"2024-04-18T04:44:34.334192+0000","last_became_peered":"2024-04-18T04:44:34.334192+0000","last_unstale":"2024-04-18T04:45:11.040511+0000","last_undegraded":"2024-04-18T04:45:11.040511+0000","last_fullsized":"2024-04-18T04:45:11.040511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:15:49.669556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.037340+0000","last_change":"2024-04-18T04:44:30.298289+0000","last_active":"2024-04-18T04:45:11.037340+0000","last_peered":"2024-04-18T04:45:11.037340+0000","last_clean":"2024-04-18T04:45:11.037340+0000","last_became_active":"2024-04-18T04:44:30.295404+0000","last_became_peered":"2024-04-18T04:44:30.295404+0000","last_unstale":"2024-04-18T04:45:11.037340+0000","last_undegraded":"2024-04-18T04:45:11.037340+0000","last_fullsized":"2024-04-18T04:45:11.037340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:10:32.465032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'4","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T04:45:12.053680+0000","last_change":"2024-04-18T04:44:29.894196+0000","last_active":"2024-04-18T04:45:12.053680+0000","last_peered":"2024-04-18T04:45:12.053680+0000","last_clean":"2024-04-18T04:45:12.053680+0000","last_became_active":"2024-04-18T04:44:29.893668+0000","last_became_peered":"2024-04-18T04:44:29.893668+0000","last_unstale":"2024-04-18T04:45:12.053680+0000","last_undegraded":"2024-04-18T04:45:12.053680+0000","last_fullsized":"2024-04-18T04:45:12.053680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:39:03.812043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":798,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T04:45:12.057192+0000","last_change":"2024-04-18T04:45:12.057192+0000","last_active":"2024-04-18T04:45:12.057192+0000","last_peered":"2024-04-18T04:45:12.057192+0000","last_clean":"2024-04-18T04:45:12.057192+0000","last_became_active":"2024-04-18T04:45:12.056680+0000","last_became_peered":"2024-04-18T04:45:12.056680+0000","last_unstale":"2024-04-18T04:45:12.057192+0000","last_undegraded":"2024-04-18T04:45:12.057192+0000","last_fullsized":"2024-04-18T04:45:12.057192+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:48:07.893811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.039974+0000","last_change":"2024-04-18T04:44:30.289122+0000","last_active":"2024-04-18T04:45:11.039974+0000","last_peered":"2024-04-18T04:45:11.039974+0000","last_clean":"2024-04-18T04:45:11.039974+0000","last_became_active":"2024-04-18T04:44:30.288364+0000","last_became_peered":"2024-04-18T04:44:30.288364+0000","last_unstale":"2024-04-18T04:45:11.039974+0000","last_undegraded":"2024-04-18T04:45:11.039974+0000","last_fullsized":"2024-04-18T04:45:11.039974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:04:02.162723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.048354+0000","last_change":"2024-04-18T04:44:29.894521+0000","last_active":"2024-04-18T04:45:11.048354+0000","last_peered":"2024-04-18T04:45:11.048354+0000","last_clean":"2024-04-18T04:45:11.048354+0000","last_became_active":"2024-04-18T04:44:29.889150+0000","last_became_peered":"2024-04-18T04:44:29.889150+0000","last_unstale":"2024-04-18T04:45:11.048354+0000","last_undegraded":"2024-04-18T04:45:11.048354+0000","last_fullsized":"2024-04-18T04:45:11.048354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:39:13.323434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.033184+0000","last_change":"2024-04-18T04:44:34.305657+0000","last_active":"2024-04-18T04:45:11.033184+0000","last_peered":"2024-04-18T04:45:11.033184+0000","last_clean":"2024-04-18T04:45:11.033184+0000","last_became_active":"2024-04-18T04:44:34.305341+0000","last_became_peered":"2024-04-18T04:44:34.305341+0000","last_unstale":"2024-04-18T04:45:11.033184+0000","last_undegraded":"2024-04-18T04:45:11.033184+0000","last_fullsized":"2024-04-18T04:45:11.033184+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:32:39.937173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040473+0000","last_change":"2024-04-18T04:44:30.307042+0000","last_active":"2024-04-18T04:45:11.040473+0000","last_peered":"2024-04-18T04:45:11.040473+0000","last_clean":"2024-04-18T04:45:11.040473+0000","last_became_active":"2024-04-18T04:44:30.306726+0000","last_became_peered":"2024-04-18T04:44:30.306726+0000","last_unstale":"2024-04-18T04:45:11.040473+0000","last_undegraded":"2024-04-18T04:45:11.040473+0000","last_fullsized":"2024-04-18T04:45:11.040473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:55:33.543142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'6","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040640+0000","last_change":"2024-04-18T04:44:29.887498+0000","last_active":"2024-04-18T04:45:11.040640+0000","last_peered":"2024-04-18T04:45:11.040640+0000","last_clean":"2024-04-18T04:45:11.040640+0000","last_became_active":"2024-04-18T04:44:29.887095+0000","last_became_peered":"2024-04-18T04:44:29.887095+0000","last_unstale":"2024-04-18T04:45:11.040640+0000","last_undegraded":"2024-04-18T04:45:11.040640+0000","last_fullsized":"2024-04-18T04:45:11.040640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:54:34.700562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.048646+0000","last_change":"2024-04-18T04:44:34.322042+0000","last_active":"2024-04-18T04:45:11.048646+0000","last_peered":"2024-04-18T04:45:11.048646+0000","last_clean":"2024-04-18T04:45:11.048646+0000","last_became_active":"2024-04-18T04:44:34.320776+0000","last_became_peered":"2024-04-18T04:44:34.320776+0000","last_unstale":"2024-04-18T04:45:11.048646+0000","last_undegraded":"2024-04-18T04:45:11.048646+0000","last_fullsized":"2024-04-18T04:45:11.048646+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:53:47.399337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.041296+0000","last_change":"2024-04-18T04:44:30.299413+0000","last_active":"2024-04-18T04:45:11.041296+0000","last_peered":"2024-04-18T04:45:11.041296+0000","last_clean":"2024-04-18T04:45:11.041296+0000","last_became_active":"2024-04-18T04:44:30.293185+0000","last_became_peered":"2024-04-18T04:44:30.293185+0000","last_unstale":"2024-04-18T04:45:11.041296+0000","last_undegraded":"2024-04-18T04:45:11.041296+0000","last_fullsized":"2024-04-18T04:45:11.041296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:43:53.831429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'11","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.039234+0000","last_change":"2024-04-18T04:44:29.893351+0000","last_active":"2024-04-18T04:45:11.039234+0000","last_peered":"2024-04-18T04:45:11.039234+0000","last_clean":"2024-04-18T04:45:11.039234+0000","last_became_active":"2024-04-18T04:44:29.892647+0000","last_became_peered":"2024-04-18T04:44:29.892647+0000","last_unstale":"2024-04-18T04:45:11.039234+0000","last_undegraded":"2024-04-18T04:45:11.039234+0000","last_fullsized":"2024-04-18T04:45:11.039234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:16:59.759149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3796,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.037810+0000","last_change":"2024-04-18T04:44:34.337866+0000","last_active":"2024-04-18T04:45:11.037810+0000","last_peered":"2024-04-18T04:45:11.037810+0000","last_clean":"2024-04-18T04:45:11.037810+0000","last_became_active":"2024-04-18T04:44:34.337486+0000","last_became_peered":"2024-04-18T04:44:34.337486+0000","last_unstale":"2024-04-18T04:45:11.037810+0000","last_undegraded":"2024-04-18T04:45:11.037810+0000","last_fullsized":"2024-04-18T04:45:11.037810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:42:13.751926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.051884+0000","last_change":"2024-04-18T04:44:30.308477+0000","last_active":"2024-04-18T04:45:11.051884+0000","last_peered":"2024-04-18T04:45:11.051884+0000","last_clean":"2024-04-18T04:45:11.051884+0000","last_became_active":"2024-04-18T04:44:30.307237+0000","last_became_peered":"2024-04-18T04:44:30.307237+0000","last_unstale":"2024-04-18T04:45:11.051884+0000","last_undegraded":"2024-04-18T04:45:11.051884+0000","last_fullsized":"2024-04-18T04:45:11.051884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:33:58.300542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'4","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.038229+0000","last_change":"2024-04-18T04:44:29.898488+0000","last_active":"2024-04-18T04:45:11.038229+0000","last_peered":"2024-04-18T04:45:11.038229+0000","last_clean":"2024-04-18T04:45:11.038229+0000","last_became_active":"2024-04-18T04:44:29.898113+0000","last_became_peered":"2024-04-18T04:44:29.898113+0000","last_unstale":"2024-04-18T04:45:11.038229+0000","last_undegraded":"2024-04-18T04:45:11.038229+0000","last_fullsized":"2024-04-18T04:45:11.038229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:11:14.585142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.049967+0000","last_change":"2024-04-18T04:44:34.344769+0000","last_active":"2024-04-18T04:45:11.049967+0000","last_peered":"2024-04-18T04:45:11.049967+0000","last_clean":"2024-04-18T04:45:11.049967+0000","last_became_active":"2024-04-18T04:44:34.343636+0000","last_became_peered":"2024-04-18T04:44:34.343636+0000","last_unstale":"2024-04-18T04:45:11.049967+0000","last_undegraded":"2024-04-18T04:45:11.049967+0000","last_fullsized":"2024-04-18T04:45:11.049967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:45:09.481681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040252+0000","last_change":"2024-04-18T04:44:30.290494+0000","last_active":"2024-04-18T04:45:11.040252+0000","last_peered":"2024-04-18T04:45:11.040252+0000","last_clean":"2024-04-18T04:45:11.040252+0000","last_became_active":"2024-04-18T04:44:30.290127+0000","last_became_peered":"2024-04-18T04:44:30.290127+0000","last_unstale":"2024-04-18T04:45:11.040252+0000","last_undegraded":"2024-04-18T04:45:11.040252+0000","last_fullsized":"2024-04-18T04:45:11.040252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:34:21.239813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"25'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.049243+0000","last_change":"2024-04-18T04:44:29.895686+0000","last_active":"2024-04-18T04:45:11.049243+0000","last_peered":"2024-04-18T04:45:11.049243+0000","last_clean":"2024-04-18T04:45:11.049243+0000","last_became_active":"2024-04-18T04:44:29.895083+0000","last_became_peered":"2024-04-18T04:44:29.895083+0000","last_unstale":"2024-04-18T04:45:11.049243+0000","last_undegraded":"2024-04-18T04:45:11.049243+0000","last_fullsized":"2024-04-18T04:45:11.049243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:27:17.897401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.032344+0000","last_change":"2024-04-18T04:44:34.338412+0000","last_active":"2024-04-18T04:45:11.032344+0000","last_peered":"2024-04-18T04:45:11.032344+0000","last_clean":"2024-04-18T04:45:11.032344+0000","last_became_active":"2024-04-18T04:44:34.338062+0000","last_became_peered":"2024-04-18T04:44:34.338062+0000","last_unstale":"2024-04-18T04:45:11.032344+0000","last_undegraded":"2024-04-18T04:45:11.032344+0000","last_fullsized":"2024-04-18T04:45:11.032344+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:49:28.342905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.049013+0000","last_change":"2024-04-18T04:44:30.307946+0000","last_active":"2024-04-18T04:45:11.049013+0000","last_peered":"2024-04-18T04:45:11.049013+0000","last_clean":"2024-04-18T04:45:11.049013+0000","last_became_active":"2024-04-18T04:44:30.307168+0000","last_became_peered":"2024-04-18T04:44:30.307168+0000","last_unstale":"2024-04-18T04:45:11.049013+0000","last_undegraded":"2024-04-18T04:45:11.049013+0000","last_fullsized":"2024-04-18T04:45:11.049013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:43:56.218333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"25'3","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.037172+0000","last_change":"2024-04-18T04:44:29.903183+0000","last_active":"2024-04-18T04:45:11.037172+0000","last_peered":"2024-04-18T04:45:11.037172+0000","last_clean":"2024-04-18T04:45:11.037172+0000","last_became_active":"2024-04-18T04:44:29.902647+0000","last_became_peered":"2024-04-18T04:44:29.902647+0000","last_unstale":"2024-04-18T04:45:11.037172+0000","last_undegraded":"2024-04-18T04:45:11.037172+0000","last_fullsized":"2024-04-18T04:45:11.037172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:45:13.009571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.032335+0000","last_change":"2024-04-18T04:44:34.338653+0000","last_active":"2024-04-18T04:45:11.032335+0000","last_peered":"2024-04-18T04:45:11.032335+0000","last_clean":"2024-04-18T04:45:11.032335+0000","last_became_active":"2024-04-18T04:44:34.338288+0000","last_became_peered":"2024-04-18T04:44:34.338288+0000","last_unstale":"2024-04-18T04:45:11.032335+0000","last_undegraded":"2024-04-18T04:45:11.032335+0000","last_fullsized":"2024-04-18T04:45:11.032335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:58:27.654288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040403+0000","last_change":"2024-04-18T04:44:34.306999+0000","last_active":"2024-04-18T04:45:11.040403+0000","last_peered":"2024-04-18T04:45:11.040403+0000","last_clean":"2024-04-18T04:45:11.040403+0000","last_became_active":"2024-04-18T04:44:34.306657+0000","last_became_peered":"2024-04-18T04:44:34.306657+0000","last_unstale":"2024-04-18T04:45:11.040403+0000","last_undegraded":"2024-04-18T04:45:11.040403+0000","last_fullsized":"2024-04-18T04:45:11.040403+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:52:58.512928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.037436+0000","last_change":"2024-04-18T04:44:30.271947+0000","last_active":"2024-04-18T04:45:11.037436+0000","last_peered":"2024-04-18T04:45:11.037436+0000","last_clean":"2024-04-18T04:45:11.037436+0000","last_became_active":"2024-04-18T04:44:30.271619+0000","last_became_peered":"2024-04-18T04:44:30.271619+0000","last_unstale":"2024-04-18T04:45:11.037436+0000","last_undegraded":"2024-04-18T04:45:11.037436+0000","last_fullsized":"2024-04-18T04:45:11.037436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:32:11.612016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.045479+0000","last_change":"2024-04-18T04:44:29.897616+0000","last_active":"2024-04-18T04:45:11.045479+0000","last_peered":"2024-04-18T04:45:11.045479+0000","last_clean":"2024-04-18T04:45:11.045479+0000","last_became_active":"2024-04-18T04:44:29.889922+0000","last_became_peered":"2024-04-18T04:44:29.889922+0000","last_unstale":"2024-04-18T04:45:11.045479+0000","last_undegraded":"2024-04-18T04:45:11.045479+0000","last_fullsized":"2024-04-18T04:45:11.045479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:11:52.717768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.036613+0000","last_change":"2024-04-18T04:44:34.333403+0000","last_active":"2024-04-18T04:45:11.036613+0000","last_peered":"2024-04-18T04:45:11.036613+0000","last_clean":"2024-04-18T04:45:11.036613+0000","last_became_active":"2024-04-18T04:44:34.332551+0000","last_became_peered":"2024-04-18T04:44:34.332551+0000","last_unstale":"2024-04-18T04:45:11.036613+0000","last_undegraded":"2024-04-18T04:45:11.036613+0000","last_fullsized":"2024-04-18T04:45:11.036613+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:33:28.594002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.032463+0000","last_change":"2024-04-18T04:44:30.271099+0000","last_active":"2024-04-18T04:45:11.032463+0000","last_peered":"2024-04-18T04:45:11.032463+0000","last_clean":"2024-04-18T04:45:11.032463+0000","last_became_active":"2024-04-18T04:44:30.270804+0000","last_became_peered":"2024-04-18T04:44:30.270804+0000","last_unstale":"2024-04-18T04:45:11.032463+0000","last_undegraded":"2024-04-18T04:45:11.032463+0000","last_fullsized":"2024-04-18T04:45:11.032463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:18:27.955171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"25'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.032498+0000","last_change":"2024-04-18T04:44:29.895084+0000","last_active":"2024-04-18T04:45:11.032498+0000","last_peered":"2024-04-18T04:45:11.032498+0000","last_clean":"2024-04-18T04:45:11.032498+0000","last_became_active":"2024-04-18T04:44:29.894829+0000","last_became_peered":"2024-04-18T04:44:29.894829+0000","last_unstale":"2024-04-18T04:45:11.032498+0000","last_undegraded":"2024-04-18T04:45:11.032498+0000","last_fullsized":"2024-04-18T04:45:11.032498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:54.812428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'3","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.037746+0000","last_change":"2024-04-18T04:44:29.892826+0000","last_active":"2024-04-18T04:45:11.037746+0000","last_peered":"2024-04-18T04:45:11.037746+0000","last_clean":"2024-04-18T04:45:11.037746+0000","last_became_active":"2024-04-18T04:44:29.892282+0000","last_became_peered":"2024-04-18T04:44:29.892282+0000","last_unstale":"2024-04-18T04:45:11.037746+0000","last_undegraded":"2024-04-18T04:45:11.037746+0000","last_fullsized":"2024-04-18T04:45:11.037746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:02.844116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040554+0000","last_change":"2024-04-18T04:44:30.285312+0000","last_active":"2024-04-18T04:45:11.040554+0000","last_peered":"2024-04-18T04:45:11.040554+0000","last_clean":"2024-04-18T04:45:11.040554+0000","last_became_active":"2024-04-18T04:44:30.285055+0000","last_became_peered":"2024-04-18T04:44:30.285055+0000","last_unstale":"2024-04-18T04:45:11.040554+0000","last_undegraded":"2024-04-18T04:45:11.040554+0000","last_fullsized":"2024-04-18T04:45:11.040554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:50:00.641018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.035771+0000","last_change":"2024-04-18T04:44:34.323352+0000","last_active":"2024-04-18T04:45:11.035771+0000","last_peered":"2024-04-18T04:45:11.035771+0000","last_clean":"2024-04-18T04:45:11.035771+0000","last_became_active":"2024-04-18T04:44:34.321645+0000","last_became_peered":"2024-04-18T04:44:34.321645+0000","last_unstale":"2024-04-18T04:45:11.035771+0000","last_undegraded":"2024-04-18T04:45:11.035771+0000","last_fullsized":"2024-04-18T04:45:11.035771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:33:27.387013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.033447+0000","last_change":"2024-04-18T04:44:29.891865+0000","last_active":"2024-04-18T04:45:11.033447+0000","last_peered":"2024-04-18T04:45:11.033447+0000","last_clean":"2024-04-18T04:45:11.033447+0000","last_became_active":"2024-04-18T04:44:29.891610+0000","last_became_peered":"2024-04-18T04:44:29.891610+0000","last_unstale":"2024-04-18T04:45:11.033447+0000","last_undegraded":"2024-04-18T04:45:11.033447+0000","last_fullsized":"2024-04-18T04:45:11.033447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:36:42.266497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.049770+0000","last_change":"2024-04-18T04:44:30.279080+0000","last_active":"2024-04-18T04:45:11.049770+0000","last_peered":"2024-04-18T04:45:11.049770+0000","last_clean":"2024-04-18T04:45:11.049770+0000","last_became_active":"2024-04-18T04:44:30.278275+0000","last_became_peered":"2024-04-18T04:44:30.278275+0000","last_unstale":"2024-04-18T04:45:11.049770+0000","last_undegraded":"2024-04-18T04:45:11.049770+0000","last_fullsized":"2024-04-18T04:45:11.049770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:51:48.272703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.032843+0000","last_change":"2024-04-18T04:44:34.313835+0000","last_active":"2024-04-18T04:45:11.032843+0000","last_peered":"2024-04-18T04:45:11.032843+0000","last_clean":"2024-04-18T04:45:11.032843+0000","last_became_active":"2024-04-18T04:44:34.313416+0000","last_became_peered":"2024-04-18T04:44:34.313416+0000","last_unstale":"2024-04-18T04:45:11.032843+0000","last_undegraded":"2024-04-18T04:45:11.032843+0000","last_fullsized":"2024-04-18T04:45:11.032843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:57:47.245809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.036965+0000","last_change":"2024-04-18T04:44:30.297229+0000","last_active":"2024-04-18T04:45:11.036965+0000","last_peered":"2024-04-18T04:45:11.036965+0000","last_clean":"2024-04-18T04:45:11.036965+0000","last_became_active":"2024-04-18T04:44:30.296354+0000","last_became_peered":"2024-04-18T04:44:30.296354+0000","last_unstale":"2024-04-18T04:45:11.036965+0000","last_undegraded":"2024-04-18T04:45:11.036965+0000","last_fullsized":"2024-04-18T04:45:11.036965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:30:35.845106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.035644+0000","last_change":"2024-04-18T04:44:30.281213+0000","last_active":"2024-04-18T04:45:11.035644+0000","last_peered":"2024-04-18T04:45:11.035644+0000","last_clean":"2024-04-18T04:45:11.035644+0000","last_became_active":"2024-04-18T04:44:30.280941+0000","last_became_peered":"2024-04-18T04:44:30.280941+0000","last_unstale":"2024-04-18T04:45:11.035644+0000","last_undegraded":"2024-04-18T04:45:11.035644+0000","last_fullsized":"2024-04-18T04:45:11.035644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:15:37.795670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.048113+0000","last_change":"2024-04-18T04:44:30.288507+0000","last_active":"2024-04-18T04:45:11.048113+0000","last_peered":"2024-04-18T04:45:11.048113+0000","last_clean":"2024-04-18T04:45:11.048113+0000","last_became_active":"2024-04-18T04:44:30.287820+0000","last_became_peered":"2024-04-18T04:44:30.287820+0000","last_unstale":"2024-04-18T04:45:11.048113+0000","last_undegraded":"2024-04-18T04:45:11.048113+0000","last_fullsized":"2024-04-18T04:45:11.048113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:25:29.500586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040472+0000","last_change":"2024-04-18T04:44:30.273278+0000","last_active":"2024-04-18T04:45:11.040472+0000","last_peered":"2024-04-18T04:45:11.040472+0000","last_clean":"2024-04-18T04:45:11.040472+0000","last_became_active":"2024-04-18T04:44:30.272973+0000","last_became_peered":"2024-04-18T04:44:30.272973+0000","last_unstale":"2024-04-18T04:45:11.040472+0000","last_undegraded":"2024-04-18T04:45:11.040472+0000","last_fullsized":"2024-04-18T04:45:11.040472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:37:02.421925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.033267+0000","last_change":"2024-04-18T04:44:30.298936+0000","last_active":"2024-04-18T04:45:11.033267+0000","last_peered":"2024-04-18T04:45:11.033267+0000","last_clean":"2024-04-18T04:45:11.033267+0000","last_became_active":"2024-04-18T04:44:30.298637+0000","last_became_peered":"2024-04-18T04:44:30.298637+0000","last_unstale":"2024-04-18T04:45:11.033267+0000","last_undegraded":"2024-04-18T04:45:11.033267+0000","last_fullsized":"2024-04-18T04:45:11.033267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:04:33.188772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.038089+0000","last_change":"2024-04-18T04:44:30.274613+0000","last_active":"2024-04-18T04:45:11.038089+0000","last_peered":"2024-04-18T04:45:11.038089+0000","last_clean":"2024-04-18T04:45:11.038089+0000","last_became_active":"2024-04-18T04:44:30.274328+0000","last_became_peered":"2024-04-18T04:44:30.274328+0000","last_unstale":"2024-04-18T04:45:11.038089+0000","last_undegraded":"2024-04-18T04:45:11.038089+0000","last_fullsized":"2024-04-18T04:45:11.038089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:55:41.700955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040493+0000","last_change":"2024-04-18T04:44:30.309403+0000","last_active":"2024-04-18T04:45:11.040493+0000","last_peered":"2024-04-18T04:45:11.040493+0000","last_clean":"2024-04-18T04:45:11.040493+0000","last_became_active":"2024-04-18T04:44:30.308415+0000","last_became_peered":"2024-04-18T04:44:30.308415+0000","last_unstale":"2024-04-18T04:45:11.040493+0000","last_undegraded":"2024-04-18T04:45:11.040493+0000","last_fullsized":"2024-04-18T04:45:11.040493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:51:58.935503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.033484+0000","last_change":"2024-04-18T04:44:30.293996+0000","last_active":"2024-04-18T04:45:11.033484+0000","last_peered":"2024-04-18T04:45:11.033484+0000","last_clean":"2024-04-18T04:45:11.033484+0000","last_became_active":"2024-04-18T04:44:30.293748+0000","last_became_peered":"2024-04-18T04:44:30.293748+0000","last_unstale":"2024-04-18T04:45:11.033484+0000","last_undegraded":"2024-04-18T04:45:11.033484+0000","last_fullsized":"2024-04-18T04:45:11.033484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:18:32.116499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T04:45:12.043771+0000","last_change":"2024-04-18T04:45:12.040362+0000","last_active":"2024-04-18T04:45:12.043771+0000","last_peered":"2024-04-18T04:45:12.043771+0000","last_clean":"2024-04-18T04:45:12.043771+0000","last_became_active":"2024-04-18T04:45:12.040045+0000","last_became_peered":"2024-04-18T04:45:12.040045+0000","last_unstale":"2024-04-18T04:45:12.043771+0000","last_undegraded":"2024-04-18T04:45:12.043771+0000","last_fullsized":"2024-04-18T04:45:12.043771+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:18:21.482610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.032447+0000","last_change":"2024-04-18T04:44:30.285836+0000","last_active":"2024-04-18T04:45:11.032447+0000","last_peered":"2024-04-18T04:45:11.032447+0000","last_clean":"2024-04-18T04:45:11.032447+0000","last_became_active":"2024-04-18T04:44:30.285602+0000","last_became_peered":"2024-04-18T04:44:30.285602+0000","last_unstale":"2024-04-18T04:45:11.032447+0000","last_undegraded":"2024-04-18T04:45:11.032447+0000","last_fullsized":"2024-04-18T04:45:11.032447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:34:39.594780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T04:45:12.044206+0000","last_change":"2024-04-18T04:45:12.040347+0000","last_active":"2024-04-18T04:45:12.044206+0000","last_peered":"2024-04-18T04:45:12.044206+0000","last_clean":"2024-04-18T04:45:12.044206+0000","last_became_active":"2024-04-18T04:45:12.040023+0000","last_became_peered":"2024-04-18T04:45:12.040023+0000","last_unstale":"2024-04-18T04:45:12.044206+0000","last_undegraded":"2024-04-18T04:45:12.044206+0000","last_fullsized":"2024-04-18T04:45:12.044206+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:24.207082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040230+0000","last_change":"2024-04-18T04:44:30.310229+0000","last_active":"2024-04-18T04:45:11.040230+0000","last_peered":"2024-04-18T04:45:11.040230+0000","last_clean":"2024-04-18T04:45:11.040230+0000","last_became_active":"2024-04-18T04:44:30.310045+0000","last_became_peered":"2024-04-18T04:44:30.310045+0000","last_unstale":"2024-04-18T04:45:11.040230+0000","last_undegraded":"2024-04-18T04:45:11.040230+0000","last_fullsized":"2024-04-18T04:45:11.040230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:22:55.588300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.039012+0000","last_change":"2024-04-18T04:44:30.305644+0000","last_active":"2024-04-18T04:45:11.039012+0000","last_peered":"2024-04-18T04:45:11.039012+0000","last_clean":"2024-04-18T04:45:11.039012+0000","last_became_active":"2024-04-18T04:44:30.304921+0000","last_became_peered":"2024-04-18T04:44:30.304921+0000","last_unstale":"2024-04-18T04:45:11.039012+0000","last_undegraded":"2024-04-18T04:45:11.039012+0000","last_fullsized":"2024-04-18T04:45:11.039012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:17:37.235711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.042156+0000","last_change":"2024-04-18T04:44:30.294105+0000","last_active":"2024-04-18T04:45:11.042156+0000","last_peered":"2024-04-18T04:45:11.042156+0000","last_clean":"2024-04-18T04:45:11.042156+0000","last_became_active":"2024-04-18T04:44:30.291742+0000","last_became_peered":"2024-04-18T04:44:30.291742+0000","last_unstale":"2024-04-18T04:45:11.042156+0000","last_undegraded":"2024-04-18T04:45:11.042156+0000","last_fullsized":"2024-04-18T04:45:11.042156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:43:26.428261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.036089+0000","last_change":"2024-04-18T04:44:30.296496+0000","last_active":"2024-04-18T04:45:11.036089+0000","last_peered":"2024-04-18T04:45:11.036089+0000","last_clean":"2024-04-18T04:45:11.036089+0000","last_became_active":"2024-04-18T04:44:30.296177+0000","last_became_peered":"2024-04-18T04:44:30.296177+0000","last_unstale":"2024-04-18T04:45:11.036089+0000","last_undegraded":"2024-04-18T04:45:11.036089+0000","last_fullsized":"2024-04-18T04:45:11.036089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:46:44.829326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.049700+0000","last_change":"2024-04-18T04:44:30.306568+0000","last_active":"2024-04-18T04:45:11.049700+0000","last_peered":"2024-04-18T04:45:11.049700+0000","last_clean":"2024-04-18T04:45:11.049700+0000","last_became_active":"2024-04-18T04:44:30.305674+0000","last_became_peered":"2024-04-18T04:44:30.305674+0000","last_unstale":"2024-04-18T04:45:11.049700+0000","last_undegraded":"2024-04-18T04:45:11.049700+0000","last_fullsized":"2024-04-18T04:45:11.049700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:58:10.740164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.044497+0000","last_change":"2024-04-18T04:44:30.307297+0000","last_active":"2024-04-18T04:45:11.044497+0000","last_peered":"2024-04-18T04:45:11.044497+0000","last_clean":"2024-04-18T04:45:11.044497+0000","last_became_active":"2024-04-18T04:44:30.305470+0000","last_became_peered":"2024-04-18T04:44:30.305470+0000","last_unstale":"2024-04-18T04:45:11.044497+0000","last_undegraded":"2024-04-18T04:45:11.044497+0000","last_fullsized":"2024-04-18T04:45:11.044497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:01:00.587115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.037512+0000","last_change":"2024-04-18T04:44:30.280849+0000","last_active":"2024-04-18T04:45:11.037512+0000","last_peered":"2024-04-18T04:45:11.037512+0000","last_clean":"2024-04-18T04:45:11.037512+0000","last_became_active":"2024-04-18T04:44:30.280535+0000","last_became_peered":"2024-04-18T04:44:30.280535+0000","last_unstale":"2024-04-18T04:45:11.037512+0000","last_undegraded":"2024-04-18T04:45:11.037512+0000","last_fullsized":"2024-04-18T04:45:11.037512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:01:06.241941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040393+0000","last_change":"2024-04-18T04:44:30.278849+0000","last_active":"2024-04-18T04:45:11.040393+0000","last_peered":"2024-04-18T04:45:11.040393+0000","last_clean":"2024-04-18T04:45:11.040393+0000","last_became_active":"2024-04-18T04:44:30.278624+0000","last_became_peered":"2024-04-18T04:44:30.278624+0000","last_unstale":"2024-04-18T04:45:11.040393+0000","last_undegraded":"2024-04-18T04:45:11.040393+0000","last_fullsized":"2024-04-18T04:45:11.040393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:31:30.791150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.032793+0000","last_change":"2024-04-18T04:44:30.296148+0000","last_active":"2024-04-18T04:45:11.032793+0000","last_peered":"2024-04-18T04:45:11.032793+0000","last_clean":"2024-04-18T04:45:11.032793+0000","last_became_active":"2024-04-18T04:44:30.295754+0000","last_became_peered":"2024-04-18T04:44:30.295754+0000","last_unstale":"2024-04-18T04:45:11.032793+0000","last_undegraded":"2024-04-18T04:45:11.032793+0000","last_fullsized":"2024-04-18T04:45:11.032793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:39:53.809075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.051669+0000","last_change":"2024-04-18T04:44:30.298061+0000","last_active":"2024-04-18T04:45:11.051669+0000","last_peered":"2024-04-18T04:45:11.051669+0000","last_clean":"2024-04-18T04:45:11.051669+0000","last_became_active":"2024-04-18T04:44:30.297416+0000","last_became_peered":"2024-04-18T04:44:30.297416+0000","last_unstale":"2024-04-18T04:45:11.051669+0000","last_undegraded":"2024-04-18T04:45:11.051669+0000","last_fullsized":"2024-04-18T04:45:11.051669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:35:48.612670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.039607+0000","last_change":"2024-04-18T04:44:30.292802+0000","last_active":"2024-04-18T04:45:11.039607+0000","last_peered":"2024-04-18T04:45:11.039607+0000","last_clean":"2024-04-18T04:45:11.039607+0000","last_became_active":"2024-04-18T04:44:30.291939+0000","last_became_peered":"2024-04-18T04:44:30.291939+0000","last_unstale":"2024-04-18T04:45:11.039607+0000","last_undegraded":"2024-04-18T04:45:11.039607+0000","last_fullsized":"2024-04-18T04:45:11.039607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:33:04.689561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040283+0000","last_change":"2024-04-18T04:44:30.309020+0000","last_active":"2024-04-18T04:45:11.040283+0000","last_peered":"2024-04-18T04:45:11.040283+0000","last_clean":"2024-04-18T04:45:11.040283+0000","last_became_active":"2024-04-18T04:44:30.307604+0000","last_became_peered":"2024-04-18T04:44:30.307604+0000","last_unstale":"2024-04-18T04:45:11.040283+0000","last_undegraded":"2024-04-18T04:45:11.040283+0000","last_fullsized":"2024-04-18T04:45:11.040283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:44:54.764284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.046696+0000","last_change":"2024-04-18T04:44:30.314533+0000","last_active":"2024-04-18T04:45:11.046696+0000","last_peered":"2024-04-18T04:45:11.046696+0000","last_clean":"2024-04-18T04:45:11.046696+0000","last_became_active":"2024-04-18T04:44:30.313985+0000","last_became_peered":"2024-04-18T04:44:30.313985+0000","last_unstale":"2024-04-18T04:45:11.046696+0000","last_undegraded":"2024-04-18T04:45:11.046696+0000","last_fullsized":"2024-04-18T04:45:11.046696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:02:03.941709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.032261+0000","last_change":"2024-04-18T04:44:30.309273+0000","last_active":"2024-04-18T04:45:11.032261+0000","last_peered":"2024-04-18T04:45:11.032261+0000","last_clean":"2024-04-18T04:45:11.032261+0000","last_became_active":"2024-04-18T04:44:30.309002+0000","last_became_peered":"2024-04-18T04:44:30.309002+0000","last_unstale":"2024-04-18T04:45:11.032261+0000","last_undegraded":"2024-04-18T04:45:11.032261+0000","last_fullsized":"2024-04-18T04:45:11.032261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:49:10.005359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.038949+0000","last_change":"2024-04-18T04:44:30.292371+0000","last_active":"2024-04-18T04:45:11.038949+0000","last_peered":"2024-04-18T04:45:11.038949+0000","last_clean":"2024-04-18T04:45:11.038949+0000","last_became_active":"2024-04-18T04:44:30.290504+0000","last_became_peered":"2024-04-18T04:44:30.290504+0000","last_unstale":"2024-04-18T04:45:11.038949+0000","last_undegraded":"2024-04-18T04:45:11.038949+0000","last_fullsized":"2024-04-18T04:45:11.038949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:11.998355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.047855+0000","last_change":"2024-04-18T04:44:30.299935+0000","last_active":"2024-04-18T04:45:11.047855+0000","last_peered":"2024-04-18T04:45:11.047855+0000","last_clean":"2024-04-18T04:45:11.047855+0000","last_became_active":"2024-04-18T04:44:30.290175+0000","last_became_peered":"2024-04-18T04:44:30.290175+0000","last_unstale":"2024-04-18T04:45:11.047855+0000","last_undegraded":"2024-04-18T04:45:11.047855+0000","last_fullsized":"2024-04-18T04:45:11.047855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:15:13.703423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.039660+0000","last_change":"2024-04-18T04:44:30.288940+0000","last_active":"2024-04-18T04:45:11.039660+0000","last_peered":"2024-04-18T04:45:11.039660+0000","last_clean":"2024-04-18T04:45:11.039660+0000","last_became_active":"2024-04-18T04:44:30.288131+0000","last_became_peered":"2024-04-18T04:44:30.288131+0000","last_unstale":"2024-04-18T04:45:11.039660+0000","last_undegraded":"2024-04-18T04:45:11.039660+0000","last_fullsized":"2024-04-18T04:45:11.039660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:31:08.895305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.048345+0000","last_change":"2024-04-18T04:44:30.288066+0000","last_active":"2024-04-18T04:45:11.048345+0000","last_peered":"2024-04-18T04:45:11.048345+0000","last_clean":"2024-04-18T04:45:11.048345+0000","last_became_active":"2024-04-18T04:44:30.287325+0000","last_became_peered":"2024-04-18T04:44:30.287325+0000","last_unstale":"2024-04-18T04:45:11.048345+0000","last_undegraded":"2024-04-18T04:45:11.048345+0000","last_fullsized":"2024-04-18T04:45:11.048345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:58:04.111225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.039976+0000","last_change":"2024-04-18T04:44:30.275485+0000","last_active":"2024-04-18T04:45:11.039976+0000","last_peered":"2024-04-18T04:45:11.039976+0000","last_clean":"2024-04-18T04:45:11.039976+0000","last_became_active":"2024-04-18T04:44:30.275118+0000","last_became_peered":"2024-04-18T04:44:30.275118+0000","last_unstale":"2024-04-18T04:45:11.039976+0000","last_undegraded":"2024-04-18T04:45:11.039976+0000","last_fullsized":"2024-04-18T04:45:11.039976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:25:09.625660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.039018+0000","last_change":"2024-04-18T04:44:30.277119+0000","last_active":"2024-04-18T04:45:11.039018+0000","last_peered":"2024-04-18T04:45:11.039018+0000","last_clean":"2024-04-18T04:45:11.039018+0000","last_became_active":"2024-04-18T04:44:30.276654+0000","last_became_peered":"2024-04-18T04:44:30.276654+0000","last_unstale":"2024-04-18T04:45:11.039018+0000","last_undegraded":"2024-04-18T04:45:11.039018+0000","last_fullsized":"2024-04-18T04:45:11.039018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:52.420199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.046316+0000","last_change":"2024-04-18T04:44:30.302905+0000","last_active":"2024-04-18T04:45:11.046316+0000","last_peered":"2024-04-18T04:45:11.046316+0000","last_clean":"2024-04-18T04:45:11.046316+0000","last_became_active":"2024-04-18T04:44:30.302180+0000","last_became_peered":"2024-04-18T04:44:30.302180+0000","last_unstale":"2024-04-18T04:45:11.046316+0000","last_undegraded":"2024-04-18T04:45:11.046316+0000","last_fullsized":"2024-04-18T04:45:11.046316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:41:53.211956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7568,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":15136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66624,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":307200,"data_stored":120788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]}]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":117146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]}]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":307200,"data_stored":117272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]}]},{"osd":7,"up_from":14,"seq":60129542160,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":707964,"data_compressed":33312,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:45:17 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":4.2729999999999997,"5min":4.2729999999999997,"15min":4.2729999999999997},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":4.1500000000000004,"5min":4.1500000000000004,"15min":4.1500000000000004},"last":0.58099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":4,"last update":"Thu Apr 18 04:45:17 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.1070000000000002,"5min":2.1070000000000002,"15min":2.1070000000000002},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":1.0049999999999999}]},{"osd":5,"last update":"Thu Apr 18 04:45:17 2024","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.044},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.3130000000000002,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":1.167}]},{"osd":6,"last update":"Thu Apr 18 04:45:17 2024","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":1.218}]}]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":303104,"data_stored":121012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:45:16 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.55900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":4,"last update":"Thu Apr 18 04:45:16 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.002}]},{"osd":5,"last update":"Thu Apr 18 04:45:16 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":1.101},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.83499999999999996}]},{"osd":7,"last update":"Thu Apr 18 04:45:16 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.91000000000000003}]}]},{"osd":5,"up_from":14,"seq":60129542160,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":303104,"data_stored":117706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542160,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":117252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":364544,"data_stored":707356,"data_compressed":33312,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33312,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33312,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T04:45:20.064 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T04:45:20.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.236+0000 7ffb2ea00640 1 Processor -- start 2024-04-18T04:45:20.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.236+0000 7ffb2ea00640 1 -- start start 2024-04-18T04:45:20.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.240+0000 7ffb2ea00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb281515f0 0x7ffb28157e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:20.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.240+0000 7ffb2ea00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ffb280c2870 0x7ffb280ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:20.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.240+0000 7ffb2ea00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb280c7820 con 0x7ffb281586f0 2024-04-18T04:45:20.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.240+0000 7ffb2ea00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb28157a20 con 0x7ffb280c2870 2024-04-18T04:45:20.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.240+0000 7ffb2ea00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb280c8030 con 0x7ffb281515f0 2024-04-18T04:45:20.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.240+0000 7ffb2cc00640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7ffb281586f0 0x7ffb28072010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:35342/0 (socket says 172.21.15.120:35342) 2024-04-18T04:45:20.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.240+0000 7ffb2cc00640 1 -- 172.21.15.120:0/4144033233 learned_addr learned my addr 172.21.15.120:0/4144033233 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:45:20.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.240+0000 7ffb27e00640 1 -- 172.21.15.120:0/4144033233 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2594975767 0 0) 0x7ffb280c7820 con 0x7ffb281586f0 2024-04-18T04:45:20.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.240+0000 7ffb27e00640 1 -- 172.21.15.120:0/4144033233 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb10003530 con 0x7ffb281586f0 2024-04-18T04:45:20.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.240+0000 7ffb27e00640 1 -- 172.21.15.120:0/4144033233 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2568592842 0 0) 0x7ffb10003530 con 0x7ffb281586f0 2024-04-18T04:45:20.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.240+0000 7ffb27e00640 1 -- 172.21.15.120:0/4144033233 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb281515f0 msgr2=0x7ffb28157e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:20.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.240+0000 7ffb27e00640 1 --2- 172.21.15.120:0/4144033233 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb281515f0 0x7ffb28157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:20.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.240+0000 7ffb27e00640 1 -- 172.21.15.120:0/4144033233 >> v2:172.21.15.132:3300/0 conn(0x7ffb280c2870 msgr2=0x7ffb280ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:20.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.240+0000 7ffb27e00640 1 --2- 172.21.15.120:0/4144033233 >> v2:172.21.15.132:3300/0 conn(0x7ffb280c2870 0x7ffb280ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:20.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.240+0000 7ffb27e00640 1 -- 172.21.15.120:0/4144033233 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb281573a0 con 0x7ffb281586f0 2024-04-18T04:45:20.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.240+0000 7ffb27e00640 1 -- 172.21.15.120:0/4144033233 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7ffb14001680 con 0x7ffb281586f0 2024-04-18T04:45:20.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.240+0000 7ffb27e00640 1 -- 172.21.15.120:0/4144033233 >> v1:172.21.15.120:6789/0 conn(0x7ffb281586f0 legacy=0x7ffb28072010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:20.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.240+0000 7ffb27e00640 1 --2- 172.21.15.120:0/4144033233 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb10003980 0x7ffb10003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:20.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.240+0000 7ffb27e00640 1 --2- 172.21.15.120:0/4144033233 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb100047d0 0x7ffb10004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:20.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.240+0000 7ffb27e00640 1 --2- 172.21.15.120:0/4144033233 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb281515f0 0x7ffb1000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:20.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.240+0000 7ffb27e00640 1 -- 172.21.15.120:0/4144033233 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb28157a20 con 0x7ffb100047d0 2024-04-18T04:45:20.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.240+0000 7ffb27e00640 1 -- 172.21.15.120:0/4144033233 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb280c8030 con 0x7ffb10003980 2024-04-18T04:45:20.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.240+0000 7ffb27e00640 1 -- 172.21.15.120:0/4144033233 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb10005570 con 0x7ffb281515f0 2024-04-18T04:45:20.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.240+0000 7ffb2cc00640 1 --2- 172.21.15.120:0/4144033233 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb100047d0 0x7ffb10004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:20.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.240+0000 7ffb2d600640 1 --2- 172.21.15.120:0/4144033233 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb10003980 0x7ffb10003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:20.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.240+0000 7ffb2cc00640 1 -- 172.21.15.120:0/4144033233 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb281515f0 msgr2=0x7ffb1000b990 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-18T04:45:20.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.240+0000 7ffb2cc00640 1 --2- 172.21.15.120:0/4144033233 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb281515f0 0x7ffb1000b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:20.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.240+0000 7ffb2cc00640 1 -- 172.21.15.120:0/4144033233 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb10003980 msgr2=0x7ffb10003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:20.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.240+0000 7ffb2cc00640 1 --2- 172.21.15.120:0/4144033233 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb10003980 0x7ffb10003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:20.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.240+0000 7ffb2cc00640 1 -- 172.21.15.120:0/4144033233 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb10003530 con 0x7ffb100047d0 2024-04-18T04:45:20.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.244+0000 7ffb2cc00640 1 --2- 172.21.15.120:0/4144033233 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb100047d0 0x7ffb10004c50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ffb1400c290 tx=0x7ffb1401f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35cc09c875fd27f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:20.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.244+0000 7ffb27e00640 1 -- 172.21.15.120:0/4144033233 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb14005ae0 con 0x7ffb100047d0 2024-04-18T04:45:20.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.244+0000 7ffb27e00640 1 -- 172.21.15.120:0/4144033233 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb140ab070 con 0x7ffb100047d0 2024-04-18T04:45:20.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.244+0000 7ffb27e00640 1 -- 172.21.15.120:0/4144033233 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb14005e80 con 0x7ffb100047d0 2024-04-18T04:45:20.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.244+0000 7ffb2ea00640 1 -- 172.21.15.120:0/4144033233 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb100047d0 msgr2=0x7ffb10004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:20.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.244+0000 7ffb2ea00640 1 --2- 172.21.15.120:0/4144033233 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb100047d0 0x7ffb10004c50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ffb1400c290 tx=0x7ffb1401f450 comp rx=0 tx=0).stop 2024-04-18T04:45:20.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.244+0000 7ffb2e000640 1 -- 172.21.15.120:0/4144033233 reap_dead start 2024-04-18T04:45:20.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.244+0000 7ffb2ea00640 1 -- 172.21.15.120:0/4144033233 shutdown_connections 2024-04-18T04:45:20.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.244+0000 7ffb2ea00640 1 -- 172.21.15.120:0/4144033233 >> 172.21.15.120:0/4144033233 conn(0x7ffb2806d8f0 msgr2=0x7ffb28065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:20.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.244+0000 7ffb2ea00640 1 -- 172.21.15.120:0/4144033233 shutdown_connections 2024-04-18T04:45:20.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.244+0000 7ffb2ea00640 1 -- 172.21.15.120:0/4144033233 wait complete. 2024-04-18T04:45:20.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.248+0000 7ffb2ea00640 1 Processor -- start 2024-04-18T04:45:20.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.248+0000 7ffb2ea00640 1 -- start start 2024-04-18T04:45:20.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.248+0000 7ffb2ea00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb100047d0 0x7ffb281f2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:20.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.248+0000 7ffb2ea00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb280cb510 0x7ffb281539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:20.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.248+0000 7ffb2ea00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb28153ee0 0x7ffb281568f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:20.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.248+0000 7ffb2ea00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb281f2fa0 con 0x7ffb28153ee0 2024-04-18T04:45:20.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.248+0000 7ffb2ea00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb281efa40 con 0x7ffb280cb510 2024-04-18T04:45:20.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.248+0000 7ffb2ea00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb280cb2e0 con 0x7ffb100047d0 2024-04-18T04:45:20.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.248+0000 7ffb2e000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb28153ee0 0x7ffb281568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:20.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.248+0000 7ffb2e000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb28153ee0 0x7ffb281568f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46926/0 (socket says 172.21.15.120:46926) 2024-04-18T04:45:20.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.248+0000 7ffb2e000640 1 -- 172.21.15.120:0/4023977129 learned_addr learned my addr 172.21.15.120:0/4023977129 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:20.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.248+0000 7ffb2d600640 1 --2- 172.21.15.120:0/4023977129 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb100047d0 0x7ffb281f2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:20.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.248+0000 7ffb2cc00640 1 --2- 172.21.15.120:0/4023977129 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb280cb510 0x7ffb281539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:20.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.248+0000 7ffb2e000640 1 -- 172.21.15.120:0/4023977129 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb100047d0 msgr2=0x7ffb281f2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:20.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.248+0000 7ffb2e000640 1 --2- 172.21.15.120:0/4023977129 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb100047d0 0x7ffb281f2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:20.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.248+0000 7ffb2e000640 1 -- 172.21.15.120:0/4023977129 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb280cb510 msgr2=0x7ffb281539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:20.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.248+0000 7ffb2e000640 1 --2- 172.21.15.120:0/4023977129 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb280cb510 0x7ffb281539a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:20.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.248+0000 7ffb2e000640 1 -- 172.21.15.120:0/4023977129 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb280cad30 con 0x7ffb28153ee0 2024-04-18T04:45:20.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.248+0000 7ffb2e000640 1 --2- 172.21.15.120:0/4023977129 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb28153ee0 0x7ffb281568f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ffb28154e10 tx=0x7ffb2000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:20.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.248+0000 7ffb25600640 1 -- 172.21.15.120:0/4023977129 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2000aa20 con 0x7ffb28153ee0 2024-04-18T04:45:20.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.248+0000 7ffb25600640 1 -- 172.21.15.120:0/4023977129 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2000aba0 con 0x7ffb28153ee0 2024-04-18T04:45:20.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.248+0000 7ffb25600640 1 -- 172.21.15.120:0/4023977129 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb20012400 con 0x7ffb28153ee0 2024-04-18T04:45:20.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.248+0000 7ffb2ea00640 1 -- 172.21.15.120:0/4023977129 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb280cb000 con 0x7ffb28153ee0 2024-04-18T04:45:20.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.248+0000 7ffb2ea00640 1 -- 172.21.15.120:0/4023977129 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb281eef60 con 0x7ffb28153ee0 2024-04-18T04:45:20.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.248+0000 7ffb2ea00640 1 -- 172.21.15.120:0/4023977129 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb28067590 con 0x7ffb28153ee0 2024-04-18T04:45:20.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.252+0000 7ffb25600640 1 -- 172.21.15.120:0/4023977129 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ffb2001b3b0 con 0x7ffb28153ee0 2024-04-18T04:45:20.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.252+0000 7ffb25600640 1 --2- 172.21.15.120:0/4023977129 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ffb08066690 0x7ffb08068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:20.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.252+0000 7ffb25600640 1 -- 172.21.15.120:0/4023977129 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ffb200840c0 con 0x7ffb28153ee0 2024-04-18T04:45:20.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.252+0000 7ffb2d600640 1 --2- 172.21.15.120:0/4023977129 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ffb08066690 0x7ffb08068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:20.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.252+0000 7ffb2d600640 1 --2- 172.21.15.120:0/4023977129 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ffb08066690 0x7ffb08068b50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c006fd0 tx=0x7ffb1c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:20.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.256+0000 7ffb25600640 1 -- 172.21.15.120:0/4023977129 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7ffb20050fe0 con 0x7ffb28153ee0 2024-04-18T04:45:20.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.404+0000 7ffb2ea00640 1 -- 172.21.15.120:0/4023977129 --> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffb280c7a70 con 0x7ffb08066690 2024-04-18T04:45:20.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.432+0000 7ffb25600640 1 -- 172.21.15.120:0/4023977129 <== mgr.4113 v2:172.21.15.132:6832/27788 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+348500 (secure 0 0 0) 0x7ffb1c00b160 con 0x7ffb08066690 2024-04-18T04:45:20.437 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:45:20.439 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-04-18T04:45:20.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.436+0000 7ffb2ea00640 1 -- 172.21.15.120:0/4023977129 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ffb08066690 msgr2=0x7ffb08068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:20.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.436+0000 7ffb2ea00640 1 --2- 172.21.15.120:0/4023977129 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ffb08066690 0x7ffb08068b50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c006fd0 tx=0x7ffb1c008040 comp rx=0 tx=0).stop 2024-04-18T04:45:20.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.436+0000 7ffb2ea00640 1 -- 172.21.15.120:0/4023977129 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb28153ee0 msgr2=0x7ffb281568f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:20.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.436+0000 7ffb2ea00640 1 --2- 172.21.15.120:0/4023977129 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb28153ee0 0x7ffb281568f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ffb28154e10 tx=0x7ffb2000ccd0 comp rx=0 tx=0).stop 2024-04-18T04:45:20.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.436+0000 7ffb2ea00640 1 -- 172.21.15.120:0/4023977129 shutdown_connections 2024-04-18T04:45:20.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.436+0000 7ffb2ea00640 1 --2- 172.21.15.120:0/4023977129 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ffb08066690 0x7ffb08068b50 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:20.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.436+0000 7ffb2ea00640 1 --2- 172.21.15.120:0/4023977129 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb28153ee0 0x7ffb281568f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:20.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.436+0000 7ffb2ea00640 1 --2- 172.21.15.120:0/4023977129 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb280cb510 0x7ffb281539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:20.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.436+0000 7ffb2ea00640 1 --2- 172.21.15.120:0/4023977129 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb100047d0 0x7ffb281f2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:20.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.436+0000 7ffb2ea00640 1 -- 172.21.15.120:0/4023977129 >> 172.21.15.120:0/4023977129 conn(0x7ffb2806d8f0 msgr2=0x7ffb280c9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:20.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.436+0000 7ffb2ea00640 1 -- 172.21.15.120:0/4023977129 shutdown_connections 2024-04-18T04:45:20.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.436+0000 7ffb2ea00640 1 -- 172.21.15.120:0/4023977129 wait complete. 2024-04-18T04:45:20.456 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-04-18T04:45:18.808540+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597936,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":288,"num_write_kb":2459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218660,"kb_used_data":2496,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756060,"statfs":{"total":773094113280,"available":772870205440,"internally_reserved":0,"allocated":2555904,"data_stored":2126496,"data_compressed":66624,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":832,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003643"},"pg_stats":[{"pgid":"2.1f","version":"25'9","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040333+0000","last_change":"2024-04-18T04:44:29.891079+0000","last_active":"2024-04-18T04:45:11.040333+0000","last_peered":"2024-04-18T04:45:11.040333+0000","last_clean":"2024-04-18T04:45:11.040333+0000","last_became_active":"2024-04-18T04:44:29.890853+0000","last_became_peered":"2024-04-18T04:44:29.890853+0000","last_unstale":"2024-04-18T04:45:11.040333+0000","last_undegraded":"2024-04-18T04:45:11.040333+0000","last_fullsized":"2024-04-18T04:45:11.040333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:12:22.299583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.033252+0000","last_change":"2024-04-18T04:44:30.296344+0000","last_active":"2024-04-18T04:45:11.033252+0000","last_peered":"2024-04-18T04:45:11.033252+0000","last_clean":"2024-04-18T04:45:11.033252+0000","last_became_active":"2024-04-18T04:44:30.296064+0000","last_became_peered":"2024-04-18T04:44:30.296064+0000","last_unstale":"2024-04-18T04:45:11.033252+0000","last_undegraded":"2024-04-18T04:45:11.033252+0000","last_fullsized":"2024-04-18T04:45:11.033252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:53:32.250308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.032245+0000","last_change":"2024-04-18T04:44:34.306605+0000","last_active":"2024-04-18T04:45:11.032245+0000","last_peered":"2024-04-18T04:45:11.032245+0000","last_clean":"2024-04-18T04:45:11.032245+0000","last_became_active":"2024-04-18T04:44:34.306224+0000","last_became_peered":"2024-04-18T04:44:34.306224+0000","last_unstale":"2024-04-18T04:45:11.032245+0000","last_undegraded":"2024-04-18T04:45:11.032245+0000","last_fullsized":"2024-04-18T04:45:11.032245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:13:15.107711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.033341+0000","last_change":"2024-04-18T04:44:29.881521+0000","last_active":"2024-04-18T04:45:11.033341+0000","last_peered":"2024-04-18T04:45:11.033341+0000","last_clean":"2024-04-18T04:45:11.033341+0000","last_became_active":"2024-04-18T04:44:29.881258+0000","last_became_peered":"2024-04-18T04:44:29.881258+0000","last_unstale":"2024-04-18T04:45:11.033341+0000","last_undegraded":"2024-04-18T04:45:11.033341+0000","last_fullsized":"2024-04-18T04:45:11.033341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:28:40.075960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040116+0000","last_change":"2024-04-18T04:44:30.314205+0000","last_active":"2024-04-18T04:45:11.040116+0000","last_peered":"2024-04-18T04:45:11.040116+0000","last_clean":"2024-04-18T04:45:11.040116+0000","last_became_active":"2024-04-18T04:44:30.313987+0000","last_became_peered":"2024-04-18T04:44:30.313987+0000","last_unstale":"2024-04-18T04:45:11.040116+0000","last_undegraded":"2024-04-18T04:45:11.040116+0000","last_fullsized":"2024-04-18T04:45:11.040116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:55:31.107861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.045581+0000","last_change":"2024-04-18T04:44:34.339646+0000","last_active":"2024-04-18T04:45:11.045581+0000","last_peered":"2024-04-18T04:45:11.045581+0000","last_clean":"2024-04-18T04:45:11.045581+0000","last_became_active":"2024-04-18T04:44:34.338485+0000","last_became_peered":"2024-04-18T04:44:34.338485+0000","last_unstale":"2024-04-18T04:45:11.045581+0000","last_undegraded":"2024-04-18T04:45:11.045581+0000","last_fullsized":"2024-04-18T04:45:11.045581+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:47:01.277301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'4","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.041934+0000","last_change":"2024-04-18T04:44:29.897785+0000","last_active":"2024-04-18T04:45:11.041934+0000","last_peered":"2024-04-18T04:45:11.041934+0000","last_clean":"2024-04-18T04:45:11.041934+0000","last_became_active":"2024-04-18T04:44:29.896520+0000","last_became_peered":"2024-04-18T04:44:29.896520+0000","last_unstale":"2024-04-18T04:45:11.041934+0000","last_undegraded":"2024-04-18T04:45:11.041934+0000","last_fullsized":"2024-04-18T04:45:11.041934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:25:52.871139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.048559+0000","last_change":"2024-04-18T04:44:30.300588+0000","last_active":"2024-04-18T04:45:11.048559+0000","last_peered":"2024-04-18T04:45:11.048559+0000","last_clean":"2024-04-18T04:45:11.048559+0000","last_became_active":"2024-04-18T04:44:30.299939+0000","last_became_peered":"2024-04-18T04:44:30.299939+0000","last_unstale":"2024-04-18T04:45:11.048559+0000","last_undegraded":"2024-04-18T04:45:11.048559+0000","last_fullsized":"2024-04-18T04:45:11.048559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:57:07.547985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.050267+0000","last_change":"2024-04-18T04:44:34.338794+0000","last_active":"2024-04-18T04:45:11.050267+0000","last_peered":"2024-04-18T04:45:11.050267+0000","last_clean":"2024-04-18T04:45:11.050267+0000","last_became_active":"2024-04-18T04:44:34.337938+0000","last_became_peered":"2024-04-18T04:44:34.337938+0000","last_unstale":"2024-04-18T04:45:11.050267+0000","last_undegraded":"2024-04-18T04:45:11.050267+0000","last_fullsized":"2024-04-18T04:45:11.050267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:48.827970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040848+0000","last_change":"2024-04-18T04:44:29.903118+0000","last_active":"2024-04-18T04:45:11.040848+0000","last_peered":"2024-04-18T04:45:11.040848+0000","last_clean":"2024-04-18T04:45:11.040848+0000","last_became_active":"2024-04-18T04:44:29.902611+0000","last_became_peered":"2024-04-18T04:44:29.902611+0000","last_unstale":"2024-04-18T04:45:11.040848+0000","last_undegraded":"2024-04-18T04:45:11.040848+0000","last_fullsized":"2024-04-18T04:45:11.040848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:38:42.595095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.048818+0000","last_change":"2024-04-18T04:44:30.301328+0000","last_active":"2024-04-18T04:45:11.048818+0000","last_peered":"2024-04-18T04:45:11.048818+0000","last_clean":"2024-04-18T04:45:11.048818+0000","last_became_active":"2024-04-18T04:44:30.300303+0000","last_became_peered":"2024-04-18T04:44:30.300303+0000","last_unstale":"2024-04-18T04:45:11.048818+0000","last_undegraded":"2024-04-18T04:45:11.048818+0000","last_fullsized":"2024-04-18T04:45:11.048818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:24:11.941483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.048428+0000","last_change":"2024-04-18T04:44:34.327044+0000","last_active":"2024-04-18T04:45:11.048428+0000","last_peered":"2024-04-18T04:45:11.048428+0000","last_clean":"2024-04-18T04:45:11.048428+0000","last_became_active":"2024-04-18T04:44:34.326161+0000","last_became_peered":"2024-04-18T04:44:34.326161+0000","last_unstale":"2024-04-18T04:45:11.048428+0000","last_undegraded":"2024-04-18T04:45:11.048428+0000","last_fullsized":"2024-04-18T04:45:11.048428+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:47:41.413530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.037314+0000","last_change":"2024-04-18T04:44:30.296493+0000","last_active":"2024-04-18T04:45:11.037314+0000","last_peered":"2024-04-18T04:45:11.037314+0000","last_clean":"2024-04-18T04:45:11.037314+0000","last_became_active":"2024-04-18T04:44:30.295657+0000","last_became_peered":"2024-04-18T04:44:30.295657+0000","last_unstale":"2024-04-18T04:45:11.037314+0000","last_undegraded":"2024-04-18T04:45:11.037314+0000","last_fullsized":"2024-04-18T04:45:11.037314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:39:40.270643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040192+0000","last_change":"2024-04-18T04:44:29.900036+0000","last_active":"2024-04-18T04:45:11.040192+0000","last_peered":"2024-04-18T04:45:11.040192+0000","last_clean":"2024-04-18T04:45:11.040192+0000","last_became_active":"2024-04-18T04:44:29.899402+0000","last_became_peered":"2024-04-18T04:44:29.899402+0000","last_unstale":"2024-04-18T04:45:11.040192+0000","last_undegraded":"2024-04-18T04:45:11.040192+0000","last_fullsized":"2024-04-18T04:45:11.040192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:45:51.681317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.051768+0000","last_change":"2024-04-18T04:44:34.320846+0000","last_active":"2024-04-18T04:45:11.051768+0000","last_peered":"2024-04-18T04:45:11.051768+0000","last_clean":"2024-04-18T04:45:11.051768+0000","last_became_active":"2024-04-18T04:44:34.319868+0000","last_became_peered":"2024-04-18T04:44:34.319868+0000","last_unstale":"2024-04-18T04:45:11.051768+0000","last_undegraded":"2024-04-18T04:45:11.051768+0000","last_fullsized":"2024-04-18T04:45:11.051768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:08:30.863140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.032877+0000","last_change":"2024-04-18T04:44:30.271756+0000","last_active":"2024-04-18T04:45:11.032877+0000","last_peered":"2024-04-18T04:45:11.032877+0000","last_clean":"2024-04-18T04:45:11.032877+0000","last_became_active":"2024-04-18T04:44:30.271420+0000","last_became_peered":"2024-04-18T04:44:30.271420+0000","last_unstale":"2024-04-18T04:45:11.032877+0000","last_undegraded":"2024-04-18T04:45:11.032877+0000","last_fullsized":"2024-04-18T04:45:11.032877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:27:18.559327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"25'1","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.037938+0000","last_change":"2024-04-18T04:44:29.878416+0000","last_active":"2024-04-18T04:45:11.037938+0000","last_peered":"2024-04-18T04:45:11.037938+0000","last_clean":"2024-04-18T04:45:11.037938+0000","last_became_active":"2024-04-18T04:44:29.878139+0000","last_became_peered":"2024-04-18T04:44:29.878139+0000","last_unstale":"2024-04-18T04:45:11.037938+0000","last_undegraded":"2024-04-18T04:45:11.037938+0000","last_fullsized":"2024-04-18T04:45:11.037938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:19:00.769888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.051399+0000","last_change":"2024-04-18T04:44:34.346123+0000","last_active":"2024-04-18T04:45:11.051399+0000","last_peered":"2024-04-18T04:45:11.051399+0000","last_clean":"2024-04-18T04:45:11.051399+0000","last_became_active":"2024-04-18T04:44:34.345267+0000","last_became_peered":"2024-04-18T04:44:34.345267+0000","last_unstale":"2024-04-18T04:45:11.051399+0000","last_undegraded":"2024-04-18T04:45:11.051399+0000","last_fullsized":"2024-04-18T04:45:11.051399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:14:08.078650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.032542+0000","last_change":"2024-04-18T04:44:30.274049+0000","last_active":"2024-04-18T04:45:11.032542+0000","last_peered":"2024-04-18T04:45:11.032542+0000","last_clean":"2024-04-18T04:45:11.032542+0000","last_became_active":"2024-04-18T04:44:30.273752+0000","last_became_peered":"2024-04-18T04:44:30.273752+0000","last_unstale":"2024-04-18T04:45:11.032542+0000","last_undegraded":"2024-04-18T04:45:11.032542+0000","last_fullsized":"2024-04-18T04:45:11.032542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:48:20.479069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.037593+0000","last_change":"2024-04-18T04:44:29.890569+0000","last_active":"2024-04-18T04:45:11.037593+0000","last_peered":"2024-04-18T04:45:11.037593+0000","last_clean":"2024-04-18T04:45:11.037593+0000","last_became_active":"2024-04-18T04:44:29.889684+0000","last_became_peered":"2024-04-18T04:44:29.889684+0000","last_unstale":"2024-04-18T04:45:11.037593+0000","last_undegraded":"2024-04-18T04:45:11.037593+0000","last_fullsized":"2024-04-18T04:45:11.037593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:53:00.230580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.038087+0000","last_change":"2024-04-18T04:44:34.313634+0000","last_active":"2024-04-18T04:45:11.038087+0000","last_peered":"2024-04-18T04:45:11.038087+0000","last_clean":"2024-04-18T04:45:11.038087+0000","last_became_active":"2024-04-18T04:44:34.313161+0000","last_became_peered":"2024-04-18T04:44:34.313161+0000","last_unstale":"2024-04-18T04:45:11.038087+0000","last_undegraded":"2024-04-18T04:45:11.038087+0000","last_fullsized":"2024-04-18T04:45:11.038087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:01:07.805128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.048108+0000","last_change":"2024-04-18T04:44:30.284805+0000","last_active":"2024-04-18T04:45:11.048108+0000","last_peered":"2024-04-18T04:45:11.048108+0000","last_clean":"2024-04-18T04:45:11.048108+0000","last_became_active":"2024-04-18T04:44:30.279238+0000","last_became_peered":"2024-04-18T04:44:30.279238+0000","last_unstale":"2024-04-18T04:45:11.048108+0000","last_undegraded":"2024-04-18T04:45:11.048108+0000","last_fullsized":"2024-04-18T04:45:11.048108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:59:24.067420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.038238+0000","last_change":"2024-04-18T04:44:29.890816+0000","last_active":"2024-04-18T04:45:11.038238+0000","last_peered":"2024-04-18T04:45:11.038238+0000","last_clean":"2024-04-18T04:45:11.038238+0000","last_became_active":"2024-04-18T04:44:29.890272+0000","last_became_peered":"2024-04-18T04:44:29.890272+0000","last_unstale":"2024-04-18T04:45:11.038238+0000","last_undegraded":"2024-04-18T04:45:11.038238+0000","last_fullsized":"2024-04-18T04:45:11.038238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:30:22.614083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.052138+0000","last_change":"2024-04-18T04:44:34.344973+0000","last_active":"2024-04-18T04:45:11.052138+0000","last_peered":"2024-04-18T04:45:11.052138+0000","last_clean":"2024-04-18T04:45:11.052138+0000","last_became_active":"2024-04-18T04:44:34.344007+0000","last_became_peered":"2024-04-18T04:44:34.344007+0000","last_unstale":"2024-04-18T04:45:11.052138+0000","last_undegraded":"2024-04-18T04:45:11.052138+0000","last_fullsized":"2024-04-18T04:45:11.052138+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:56:43.476132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040630+0000","last_change":"2024-04-18T04:44:30.278193+0000","last_active":"2024-04-18T04:45:11.040630+0000","last_peered":"2024-04-18T04:45:11.040630+0000","last_clean":"2024-04-18T04:45:11.040630+0000","last_became_active":"2024-04-18T04:44:30.277916+0000","last_became_peered":"2024-04-18T04:44:30.277916+0000","last_unstale":"2024-04-18T04:45:11.040630+0000","last_undegraded":"2024-04-18T04:45:11.040630+0000","last_fullsized":"2024-04-18T04:45:11.040630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:57:19.783436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.037867+0000","last_change":"2024-04-18T04:44:29.896901+0000","last_active":"2024-04-18T04:45:11.037867+0000","last_peered":"2024-04-18T04:45:11.037867+0000","last_clean":"2024-04-18T04:45:11.037867+0000","last_became_active":"2024-04-18T04:44:29.896392+0000","last_became_peered":"2024-04-18T04:44:29.896392+0000","last_unstale":"2024-04-18T04:45:11.037867+0000","last_undegraded":"2024-04-18T04:45:11.037867+0000","last_fullsized":"2024-04-18T04:45:11.037867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:46:08.869450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.047144+0000","last_change":"2024-04-18T04:44:34.339233+0000","last_active":"2024-04-18T04:45:11.047144+0000","last_peered":"2024-04-18T04:45:11.047144+0000","last_clean":"2024-04-18T04:45:11.047144+0000","last_became_active":"2024-04-18T04:44:34.338294+0000","last_became_peered":"2024-04-18T04:44:34.338294+0000","last_unstale":"2024-04-18T04:45:11.047144+0000","last_undegraded":"2024-04-18T04:45:11.047144+0000","last_fullsized":"2024-04-18T04:45:11.047144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:20:35.738410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T04:45:12.047012+0000","last_change":"2024-04-18T04:45:12.045887+0000","last_active":"2024-04-18T04:45:12.047012+0000","last_peered":"2024-04-18T04:45:12.047012+0000","last_clean":"2024-04-18T04:45:12.047012+0000","last_became_active":"2024-04-18T04:45:12.045671+0000","last_became_peered":"2024-04-18T04:45:12.045671+0000","last_unstale":"2024-04-18T04:45:12.047012+0000","last_undegraded":"2024-04-18T04:45:12.047012+0000","last_fullsized":"2024-04-18T04:45:12.047012+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:22:58.022926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"25'3","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.039099+0000","last_change":"2024-04-18T04:44:29.894503+0000","last_active":"2024-04-18T04:45:11.039099+0000","last_peered":"2024-04-18T04:45:11.039099+0000","last_clean":"2024-04-18T04:45:11.039099+0000","last_became_active":"2024-04-18T04:44:29.894210+0000","last_became_peered":"2024-04-18T04:44:29.894210+0000","last_unstale":"2024-04-18T04:45:11.039099+0000","last_undegraded":"2024-04-18T04:45:11.039099+0000","last_fullsized":"2024-04-18T04:45:11.039099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:14:56.979204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.032183+0000","last_change":"2024-04-18T04:44:34.305652+0000","last_active":"2024-04-18T04:45:11.032183+0000","last_peered":"2024-04-18T04:45:11.032183+0000","last_clean":"2024-04-18T04:45:11.032183+0000","last_became_active":"2024-04-18T04:44:34.305180+0000","last_became_peered":"2024-04-18T04:44:34.305180+0000","last_unstale":"2024-04-18T04:45:11.032183+0000","last_undegraded":"2024-04-18T04:45:11.032183+0000","last_fullsized":"2024-04-18T04:45:11.032183+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:03:10.781821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.038292+0000","last_change":"2024-04-18T04:44:30.267158+0000","last_active":"2024-04-18T04:45:11.038292+0000","last_peered":"2024-04-18T04:45:11.038292+0000","last_clean":"2024-04-18T04:45:11.038292+0000","last_became_active":"2024-04-18T04:44:30.266814+0000","last_became_peered":"2024-04-18T04:44:30.266814+0000","last_unstale":"2024-04-18T04:45:11.038292+0000","last_undegraded":"2024-04-18T04:45:11.038292+0000","last_fullsized":"2024-04-18T04:45:11.038292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:16:02.152817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.042412+0000","last_change":"2024-04-18T04:44:29.898812+0000","last_active":"2024-04-18T04:45:11.042412+0000","last_peered":"2024-04-18T04:45:11.042412+0000","last_clean":"2024-04-18T04:45:11.042412+0000","last_became_active":"2024-04-18T04:44:29.897156+0000","last_became_peered":"2024-04-18T04:44:29.897156+0000","last_unstale":"2024-04-18T04:45:11.042412+0000","last_undegraded":"2024-04-18T04:45:11.042412+0000","last_fullsized":"2024-04-18T04:45:11.042412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:09:47.746394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040150+0000","last_change":"2024-04-18T04:44:34.324721+0000","last_active":"2024-04-18T04:45:11.040150+0000","last_peered":"2024-04-18T04:45:11.040150+0000","last_clean":"2024-04-18T04:45:11.040150+0000","last_became_active":"2024-04-18T04:44:34.322925+0000","last_became_peered":"2024-04-18T04:44:34.322925+0000","last_unstale":"2024-04-18T04:45:11.040150+0000","last_undegraded":"2024-04-18T04:45:11.040150+0000","last_fullsized":"2024-04-18T04:45:11.040150+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:11:59.682230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.048982+0000","last_change":"2024-04-18T04:44:30.281640+0000","last_active":"2024-04-18T04:45:11.048982+0000","last_peered":"2024-04-18T04:45:11.048982+0000","last_clean":"2024-04-18T04:45:11.048982+0000","last_became_active":"2024-04-18T04:44:30.280968+0000","last_became_peered":"2024-04-18T04:44:30.280968+0000","last_unstale":"2024-04-18T04:45:11.048982+0000","last_undegraded":"2024-04-18T04:45:11.048982+0000","last_fullsized":"2024-04-18T04:45:11.048982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:35:20.755711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.038370+0000","last_change":"2024-04-18T04:44:29.882715+0000","last_active":"2024-04-18T04:45:11.038370+0000","last_peered":"2024-04-18T04:45:11.038370+0000","last_clean":"2024-04-18T04:45:11.038370+0000","last_became_active":"2024-04-18T04:44:29.882335+0000","last_became_peered":"2024-04-18T04:44:29.882335+0000","last_unstale":"2024-04-18T04:45:11.038370+0000","last_undegraded":"2024-04-18T04:45:11.038370+0000","last_fullsized":"2024-04-18T04:45:11.038370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:32:59.709151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.037436+0000","last_change":"2024-04-18T04:44:34.325029+0000","last_active":"2024-04-18T04:45:11.037436+0000","last_peered":"2024-04-18T04:45:11.037436+0000","last_clean":"2024-04-18T04:45:11.037436+0000","last_became_active":"2024-04-18T04:44:34.324082+0000","last_became_peered":"2024-04-18T04:44:34.324082+0000","last_unstale":"2024-04-18T04:45:11.037436+0000","last_undegraded":"2024-04-18T04:45:11.037436+0000","last_fullsized":"2024-04-18T04:45:11.037436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:28:10.378037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.050780+0000","last_change":"2024-04-18T04:44:30.276174+0000","last_active":"2024-04-18T04:45:11.050780+0000","last_peered":"2024-04-18T04:45:11.050780+0000","last_clean":"2024-04-18T04:45:11.050780+0000","last_became_active":"2024-04-18T04:44:30.270878+0000","last_became_peered":"2024-04-18T04:44:30.270878+0000","last_unstale":"2024-04-18T04:45:11.050780+0000","last_undegraded":"2024-04-18T04:45:11.050780+0000","last_fullsized":"2024-04-18T04:45:11.050780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:35:12.296277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"25'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.048628+0000","last_change":"2024-04-18T04:44:29.896745+0000","last_active":"2024-04-18T04:45:11.048628+0000","last_peered":"2024-04-18T04:45:11.048628+0000","last_clean":"2024-04-18T04:45:11.048628+0000","last_became_active":"2024-04-18T04:44:29.896199+0000","last_became_peered":"2024-04-18T04:44:29.896199+0000","last_unstale":"2024-04-18T04:45:11.048628+0000","last_undegraded":"2024-04-18T04:45:11.048628+0000","last_fullsized":"2024-04-18T04:45:11.048628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:25:05.424668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.038216+0000","last_change":"2024-04-18T04:44:34.337429+0000","last_active":"2024-04-18T04:45:11.038216+0000","last_peered":"2024-04-18T04:45:11.038216+0000","last_clean":"2024-04-18T04:45:11.038216+0000","last_became_active":"2024-04-18T04:44:34.337089+0000","last_became_peered":"2024-04-18T04:44:34.337089+0000","last_unstale":"2024-04-18T04:45:11.038216+0000","last_undegraded":"2024-04-18T04:45:11.038216+0000","last_fullsized":"2024-04-18T04:45:11.038216+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:00:56.976431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.037512+0000","last_change":"2024-04-18T04:44:30.270874+0000","last_active":"2024-04-18T04:45:11.037512+0000","last_peered":"2024-04-18T04:45:11.037512+0000","last_clean":"2024-04-18T04:45:11.037512+0000","last_became_active":"2024-04-18T04:44:30.270636+0000","last_became_peered":"2024-04-18T04:44:30.270636+0000","last_unstale":"2024-04-18T04:45:11.037512+0000","last_undegraded":"2024-04-18T04:45:11.037512+0000","last_fullsized":"2024-04-18T04:45:11.037512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:25:49.889554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"25'4","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.035662+0000","last_change":"2024-04-18T04:44:29.878607+0000","last_active":"2024-04-18T04:45:11.035662+0000","last_peered":"2024-04-18T04:45:11.035662+0000","last_clean":"2024-04-18T04:45:11.035662+0000","last_became_active":"2024-04-18T04:44:29.878330+0000","last_became_peered":"2024-04-18T04:44:29.878330+0000","last_unstale":"2024-04-18T04:45:11.035662+0000","last_undegraded":"2024-04-18T04:45:11.035662+0000","last_fullsized":"2024-04-18T04:45:11.035662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:09:18.088701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.038115+0000","last_change":"2024-04-18T04:44:34.323315+0000","last_active":"2024-04-18T04:45:11.038115+0000","last_peered":"2024-04-18T04:45:11.038115+0000","last_clean":"2024-04-18T04:45:11.038115+0000","last_became_active":"2024-04-18T04:44:34.322983+0000","last_became_peered":"2024-04-18T04:44:34.322983+0000","last_unstale":"2024-04-18T04:45:11.038115+0000","last_undegraded":"2024-04-18T04:45:11.038115+0000","last_fullsized":"2024-04-18T04:45:11.038115+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:48:12.803273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.039727+0000","last_change":"2024-04-18T04:44:30.285533+0000","last_active":"2024-04-18T04:45:11.039727+0000","last_peered":"2024-04-18T04:45:11.039727+0000","last_clean":"2024-04-18T04:45:11.039727+0000","last_became_active":"2024-04-18T04:44:30.285113+0000","last_became_peered":"2024-04-18T04:44:30.285113+0000","last_unstale":"2024-04-18T04:45:11.039727+0000","last_undegraded":"2024-04-18T04:45:11.039727+0000","last_fullsized":"2024-04-18T04:45:11.039727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:37:20.367349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"25'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.038377+0000","last_change":"2024-04-18T04:44:29.890701+0000","last_active":"2024-04-18T04:45:11.038377+0000","last_peered":"2024-04-18T04:45:11.038377+0000","last_clean":"2024-04-18T04:45:11.038377+0000","last_became_active":"2024-04-18T04:44:29.890207+0000","last_became_peered":"2024-04-18T04:44:29.890207+0000","last_unstale":"2024-04-18T04:45:11.038377+0000","last_undegraded":"2024-04-18T04:45:11.038377+0000","last_fullsized":"2024-04-18T04:45:11.038377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:06:58.470725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T04:45:12.378646+0000","last_change":"2024-04-18T04:45:12.378646+0000","last_active":"2024-04-18T04:45:12.378646+0000","last_peered":"2024-04-18T04:45:12.378646+0000","last_clean":"2024-04-18T04:45:12.378646+0000","last_became_active":"2024-04-18T04:45:12.378263+0000","last_became_peered":"2024-04-18T04:45:12.378263+0000","last_unstale":"2024-04-18T04:45:12.378646+0000","last_undegraded":"2024-04-18T04:45:12.378646+0000","last_fullsized":"2024-04-18T04:45:12.378646+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:59:31.439452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.032623+0000","last_change":"2024-04-18T04:44:30.306826+0000","last_active":"2024-04-18T04:45:11.032623+0000","last_peered":"2024-04-18T04:45:11.032623+0000","last_clean":"2024-04-18T04:45:11.032623+0000","last_became_active":"2024-04-18T04:44:30.306320+0000","last_became_peered":"2024-04-18T04:44:30.306320+0000","last_unstale":"2024-04-18T04:45:11.032623+0000","last_undegraded":"2024-04-18T04:45:11.032623+0000","last_fullsized":"2024-04-18T04:45:11.032623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:47:38.564197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"25'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.046193+0000","last_change":"2024-04-18T04:44:29.888023+0000","last_active":"2024-04-18T04:45:11.046193+0000","last_peered":"2024-04-18T04:45:11.046193+0000","last_clean":"2024-04-18T04:45:11.046193+0000","last_became_active":"2024-04-18T04:44:29.887440+0000","last_became_peered":"2024-04-18T04:44:29.887440+0000","last_unstale":"2024-04-18T04:45:11.046193+0000","last_undegraded":"2024-04-18T04:45:11.046193+0000","last_fullsized":"2024-04-18T04:45:11.046193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:07:01.067445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.038470+0000","last_change":"2024-04-18T04:44:18.629794+0000","last_active":"2024-04-18T04:45:11.038470+0000","last_peered":"2024-04-18T04:45:11.038470+0000","last_clean":"2024-04-18T04:45:11.038470+0000","last_became_active":"2024-04-18T04:44:18.627792+0000","last_became_peered":"2024-04-18T04:44:18.627792+0000","last_unstale":"2024-04-18T04:45:11.038470+0000","last_undegraded":"2024-04-18T04:45:11.038470+0000","last_fullsized":"2024-04-18T04:45:11.038470+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:17.410146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:17.410146+0000","last_clean_scrub_stamp":"2024-04-18T04:44:17.410146+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:30:49.101656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.039415+0000","last_change":"2024-04-18T04:44:34.333286+0000","last_active":"2024-04-18T04:45:11.039415+0000","last_peered":"2024-04-18T04:45:11.039415+0000","last_clean":"2024-04-18T04:45:11.039415+0000","last_became_active":"2024-04-18T04:44:34.332520+0000","last_became_peered":"2024-04-18T04:44:34.332520+0000","last_unstale":"2024-04-18T04:45:11.039415+0000","last_undegraded":"2024-04-18T04:45:11.039415+0000","last_fullsized":"2024-04-18T04:45:11.039415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:58:48.264040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.041500+0000","last_change":"2024-04-18T04:44:30.303602+0000","last_active":"2024-04-18T04:45:11.041500+0000","last_peered":"2024-04-18T04:45:11.041500+0000","last_clean":"2024-04-18T04:45:11.041500+0000","last_became_active":"2024-04-18T04:44:30.302157+0000","last_became_peered":"2024-04-18T04:44:30.302157+0000","last_unstale":"2024-04-18T04:45:11.041500+0000","last_undegraded":"2024-04-18T04:45:11.041500+0000","last_fullsized":"2024-04-18T04:45:11.041500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:09:57.582065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"25'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.035979+0000","last_change":"2024-04-18T04:44:29.890428+0000","last_active":"2024-04-18T04:45:11.035979+0000","last_peered":"2024-04-18T04:45:11.035979+0000","last_clean":"2024-04-18T04:45:11.035979+0000","last_became_active":"2024-04-18T04:44:29.890166+0000","last_became_peered":"2024-04-18T04:44:29.890166+0000","last_unstale":"2024-04-18T04:45:11.035979+0000","last_undegraded":"2024-04-18T04:45:11.035979+0000","last_fullsized":"2024-04-18T04:45:11.035979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:21:16.823377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.037062+0000","last_change":"2024-04-18T04:44:34.334071+0000","last_active":"2024-04-18T04:45:11.037062+0000","last_peered":"2024-04-18T04:45:11.037062+0000","last_clean":"2024-04-18T04:45:11.037062+0000","last_became_active":"2024-04-18T04:44:34.332695+0000","last_became_peered":"2024-04-18T04:44:34.332695+0000","last_unstale":"2024-04-18T04:45:11.037062+0000","last_undegraded":"2024-04-18T04:45:11.037062+0000","last_fullsized":"2024-04-18T04:45:11.037062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:22:52.371921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.048836+0000","last_change":"2024-04-18T04:44:30.287908+0000","last_active":"2024-04-18T04:45:11.048836+0000","last_peered":"2024-04-18T04:45:11.048836+0000","last_clean":"2024-04-18T04:45:11.048836+0000","last_became_active":"2024-04-18T04:44:30.287217+0000","last_became_peered":"2024-04-18T04:44:30.287217+0000","last_unstale":"2024-04-18T04:45:11.048836+0000","last_undegraded":"2024-04-18T04:45:11.048836+0000","last_fullsized":"2024-04-18T04:45:11.048836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:47:14.962330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.038311+0000","last_change":"2024-04-18T04:44:29.886376+0000","last_active":"2024-04-18T04:45:11.038311+0000","last_peered":"2024-04-18T04:45:11.038311+0000","last_clean":"2024-04-18T04:45:11.038311+0000","last_became_active":"2024-04-18T04:44:29.886058+0000","last_became_peered":"2024-04-18T04:44:29.886058+0000","last_unstale":"2024-04-18T04:45:11.038311+0000","last_undegraded":"2024-04-18T04:45:11.038311+0000","last_fullsized":"2024-04-18T04:45:11.038311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:29:59.678071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T04:45:12.373987+0000","last_change":"2024-04-18T04:45:12.373987+0000","last_active":"2024-04-18T04:45:12.373987+0000","last_peered":"2024-04-18T04:45:12.373987+0000","last_clean":"2024-04-18T04:45:12.373987+0000","last_became_active":"2024-04-18T04:45:12.373269+0000","last_became_peered":"2024-04-18T04:45:12.373269+0000","last_unstale":"2024-04-18T04:45:12.373987+0000","last_undegraded":"2024-04-18T04:45:12.373987+0000","last_fullsized":"2024-04-18T04:45:12.373987+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:19:01.073786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T04:45:12.046573+0000","last_change":"2024-04-18T04:45:12.043098+0000","last_active":"2024-04-18T04:45:12.046573+0000","last_peered":"2024-04-18T04:45:12.046573+0000","last_clean":"2024-04-18T04:45:12.046573+0000","last_became_active":"2024-04-18T04:45:12.042803+0000","last_became_peered":"2024-04-18T04:45:12.042803+0000","last_unstale":"2024-04-18T04:45:12.046573+0000","last_undegraded":"2024-04-18T04:45:12.046573+0000","last_fullsized":"2024-04-18T04:45:12.046573+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:15:13.837607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.036150+0000","last_change":"2024-04-18T04:44:29.878650+0000","last_active":"2024-04-18T04:45:11.036150+0000","last_peered":"2024-04-18T04:45:11.036150+0000","last_clean":"2024-04-18T04:45:11.036150+0000","last_became_active":"2024-04-18T04:44:29.878361+0000","last_became_peered":"2024-04-18T04:44:29.878361+0000","last_unstale":"2024-04-18T04:45:11.036150+0000","last_undegraded":"2024-04-18T04:45:11.036150+0000","last_fullsized":"2024-04-18T04:45:11.036150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:57:41.162118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.044110+0000","last_change":"2024-04-18T04:44:34.339023+0000","last_active":"2024-04-18T04:45:11.044110+0000","last_peered":"2024-04-18T04:45:11.044110+0000","last_clean":"2024-04-18T04:45:11.044110+0000","last_became_active":"2024-04-18T04:44:34.338042+0000","last_became_peered":"2024-04-18T04:44:34.338042+0000","last_unstale":"2024-04-18T04:45:11.044110+0000","last_undegraded":"2024-04-18T04:45:11.044110+0000","last_fullsized":"2024-04-18T04:45:11.044110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:48:58.174635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.042856+0000","last_change":"2024-04-18T04:44:30.291740+0000","last_active":"2024-04-18T04:45:11.042856+0000","last_peered":"2024-04-18T04:45:11.042856+0000","last_clean":"2024-04-18T04:45:11.042856+0000","last_became_active":"2024-04-18T04:44:30.290379+0000","last_became_peered":"2024-04-18T04:44:30.290379+0000","last_unstale":"2024-04-18T04:45:11.042856+0000","last_undegraded":"2024-04-18T04:45:11.042856+0000","last_fullsized":"2024-04-18T04:45:11.042856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:44:25.111858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'2","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T04:45:12.041554+0000","last_change":"2024-04-18T04:44:29.882833+0000","last_active":"2024-04-18T04:45:12.041554+0000","last_peered":"2024-04-18T04:45:12.041554+0000","last_clean":"2024-04-18T04:45:12.041554+0000","last_became_active":"2024-04-18T04:44:29.881671+0000","last_became_peered":"2024-04-18T04:44:29.881671+0000","last_unstale":"2024-04-18T04:45:12.041554+0000","last_undegraded":"2024-04-18T04:45:12.041554+0000","last_fullsized":"2024-04-18T04:45:12.041554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:29:22.037641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.046910+0000","last_change":"2024-04-18T04:44:34.342465+0000","last_active":"2024-04-18T04:45:11.046910+0000","last_peered":"2024-04-18T04:45:11.046910+0000","last_clean":"2024-04-18T04:45:11.046910+0000","last_became_active":"2024-04-18T04:44:34.340327+0000","last_became_peered":"2024-04-18T04:44:34.340327+0000","last_unstale":"2024-04-18T04:45:11.046910+0000","last_undegraded":"2024-04-18T04:45:11.046910+0000","last_fullsized":"2024-04-18T04:45:11.046910+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:31:44.168899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.039103+0000","last_change":"2024-04-18T04:44:30.299403+0000","last_active":"2024-04-18T04:45:11.039103+0000","last_peered":"2024-04-18T04:45:11.039103+0000","last_clean":"2024-04-18T04:45:11.039103+0000","last_became_active":"2024-04-18T04:44:30.298417+0000","last_became_peered":"2024-04-18T04:44:30.298417+0000","last_unstale":"2024-04-18T04:45:11.039103+0000","last_undegraded":"2024-04-18T04:45:11.039103+0000","last_fullsized":"2024-04-18T04:45:11.039103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:43:24.120294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'15","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.035582+0000","last_change":"2024-04-18T04:44:29.875345+0000","last_active":"2024-04-18T04:45:11.035582+0000","last_peered":"2024-04-18T04:45:11.035582+0000","last_clean":"2024-04-18T04:45:11.035582+0000","last_became_active":"2024-04-18T04:44:29.875059+0000","last_became_peered":"2024-04-18T04:44:29.875059+0000","last_unstale":"2024-04-18T04:45:11.035582+0000","last_undegraded":"2024-04-18T04:45:11.035582+0000","last_fullsized":"2024-04-18T04:45:11.035582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:06:54.218096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040511+0000","last_change":"2024-04-18T04:44:34.334498+0000","last_active":"2024-04-18T04:45:11.040511+0000","last_peered":"2024-04-18T04:45:11.040511+0000","last_clean":"2024-04-18T04:45:11.040511+0000","last_became_active":"2024-04-18T04:44:34.334192+0000","last_became_peered":"2024-04-18T04:44:34.334192+0000","last_unstale":"2024-04-18T04:45:11.040511+0000","last_undegraded":"2024-04-18T04:45:11.040511+0000","last_fullsized":"2024-04-18T04:45:11.040511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:15:49.669556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.037340+0000","last_change":"2024-04-18T04:44:30.298289+0000","last_active":"2024-04-18T04:45:11.037340+0000","last_peered":"2024-04-18T04:45:11.037340+0000","last_clean":"2024-04-18T04:45:11.037340+0000","last_became_active":"2024-04-18T04:44:30.295404+0000","last_became_peered":"2024-04-18T04:44:30.295404+0000","last_unstale":"2024-04-18T04:45:11.037340+0000","last_undegraded":"2024-04-18T04:45:11.037340+0000","last_fullsized":"2024-04-18T04:45:11.037340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:10:32.465032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'4","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T04:45:12.053680+0000","last_change":"2024-04-18T04:44:29.894196+0000","last_active":"2024-04-18T04:45:12.053680+0000","last_peered":"2024-04-18T04:45:12.053680+0000","last_clean":"2024-04-18T04:45:12.053680+0000","last_became_active":"2024-04-18T04:44:29.893668+0000","last_became_peered":"2024-04-18T04:44:29.893668+0000","last_unstale":"2024-04-18T04:45:12.053680+0000","last_undegraded":"2024-04-18T04:45:12.053680+0000","last_fullsized":"2024-04-18T04:45:12.053680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:39:03.812043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":798,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T04:45:12.057192+0000","last_change":"2024-04-18T04:45:12.057192+0000","last_active":"2024-04-18T04:45:12.057192+0000","last_peered":"2024-04-18T04:45:12.057192+0000","last_clean":"2024-04-18T04:45:12.057192+0000","last_became_active":"2024-04-18T04:45:12.056680+0000","last_became_peered":"2024-04-18T04:45:12.056680+0000","last_unstale":"2024-04-18T04:45:12.057192+0000","last_undegraded":"2024-04-18T04:45:12.057192+0000","last_fullsized":"2024-04-18T04:45:12.057192+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:48:07.893811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.039974+0000","last_change":"2024-04-18T04:44:30.289122+0000","last_active":"2024-04-18T04:45:11.039974+0000","last_peered":"2024-04-18T04:45:11.039974+0000","last_clean":"2024-04-18T04:45:11.039974+0000","last_became_active":"2024-04-18T04:44:30.288364+0000","last_became_peered":"2024-04-18T04:44:30.288364+0000","last_unstale":"2024-04-18T04:45:11.039974+0000","last_undegraded":"2024-04-18T04:45:11.039974+0000","last_fullsized":"2024-04-18T04:45:11.039974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:04:02.162723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.048354+0000","last_change":"2024-04-18T04:44:29.894521+0000","last_active":"2024-04-18T04:45:11.048354+0000","last_peered":"2024-04-18T04:45:11.048354+0000","last_clean":"2024-04-18T04:45:11.048354+0000","last_became_active":"2024-04-18T04:44:29.889150+0000","last_became_peered":"2024-04-18T04:44:29.889150+0000","last_unstale":"2024-04-18T04:45:11.048354+0000","last_undegraded":"2024-04-18T04:45:11.048354+0000","last_fullsized":"2024-04-18T04:45:11.048354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:39:13.323434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.033184+0000","last_change":"2024-04-18T04:44:34.305657+0000","last_active":"2024-04-18T04:45:11.033184+0000","last_peered":"2024-04-18T04:45:11.033184+0000","last_clean":"2024-04-18T04:45:11.033184+0000","last_became_active":"2024-04-18T04:44:34.305341+0000","last_became_peered":"2024-04-18T04:44:34.305341+0000","last_unstale":"2024-04-18T04:45:11.033184+0000","last_undegraded":"2024-04-18T04:45:11.033184+0000","last_fullsized":"2024-04-18T04:45:11.033184+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:32:39.937173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040473+0000","last_change":"2024-04-18T04:44:30.307042+0000","last_active":"2024-04-18T04:45:11.040473+0000","last_peered":"2024-04-18T04:45:11.040473+0000","last_clean":"2024-04-18T04:45:11.040473+0000","last_became_active":"2024-04-18T04:44:30.306726+0000","last_became_peered":"2024-04-18T04:44:30.306726+0000","last_unstale":"2024-04-18T04:45:11.040473+0000","last_undegraded":"2024-04-18T04:45:11.040473+0000","last_fullsized":"2024-04-18T04:45:11.040473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:55:33.543142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'6","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040640+0000","last_change":"2024-04-18T04:44:29.887498+0000","last_active":"2024-04-18T04:45:11.040640+0000","last_peered":"2024-04-18T04:45:11.040640+0000","last_clean":"2024-04-18T04:45:11.040640+0000","last_became_active":"2024-04-18T04:44:29.887095+0000","last_became_peered":"2024-04-18T04:44:29.887095+0000","last_unstale":"2024-04-18T04:45:11.040640+0000","last_undegraded":"2024-04-18T04:45:11.040640+0000","last_fullsized":"2024-04-18T04:45:11.040640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:54:34.700562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.048646+0000","last_change":"2024-04-18T04:44:34.322042+0000","last_active":"2024-04-18T04:45:11.048646+0000","last_peered":"2024-04-18T04:45:11.048646+0000","last_clean":"2024-04-18T04:45:11.048646+0000","last_became_active":"2024-04-18T04:44:34.320776+0000","last_became_peered":"2024-04-18T04:44:34.320776+0000","last_unstale":"2024-04-18T04:45:11.048646+0000","last_undegraded":"2024-04-18T04:45:11.048646+0000","last_fullsized":"2024-04-18T04:45:11.048646+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:53:47.399337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.041296+0000","last_change":"2024-04-18T04:44:30.299413+0000","last_active":"2024-04-18T04:45:11.041296+0000","last_peered":"2024-04-18T04:45:11.041296+0000","last_clean":"2024-04-18T04:45:11.041296+0000","last_became_active":"2024-04-18T04:44:30.293185+0000","last_became_peered":"2024-04-18T04:44:30.293185+0000","last_unstale":"2024-04-18T04:45:11.041296+0000","last_undegraded":"2024-04-18T04:45:11.041296+0000","last_fullsized":"2024-04-18T04:45:11.041296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:43:53.831429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'11","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.039234+0000","last_change":"2024-04-18T04:44:29.893351+0000","last_active":"2024-04-18T04:45:11.039234+0000","last_peered":"2024-04-18T04:45:11.039234+0000","last_clean":"2024-04-18T04:45:11.039234+0000","last_became_active":"2024-04-18T04:44:29.892647+0000","last_became_peered":"2024-04-18T04:44:29.892647+0000","last_unstale":"2024-04-18T04:45:11.039234+0000","last_undegraded":"2024-04-18T04:45:11.039234+0000","last_fullsized":"2024-04-18T04:45:11.039234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:16:59.759149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3796,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.037810+0000","last_change":"2024-04-18T04:44:34.337866+0000","last_active":"2024-04-18T04:45:11.037810+0000","last_peered":"2024-04-18T04:45:11.037810+0000","last_clean":"2024-04-18T04:45:11.037810+0000","last_became_active":"2024-04-18T04:44:34.337486+0000","last_became_peered":"2024-04-18T04:44:34.337486+0000","last_unstale":"2024-04-18T04:45:11.037810+0000","last_undegraded":"2024-04-18T04:45:11.037810+0000","last_fullsized":"2024-04-18T04:45:11.037810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:42:13.751926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.051884+0000","last_change":"2024-04-18T04:44:30.308477+0000","last_active":"2024-04-18T04:45:11.051884+0000","last_peered":"2024-04-18T04:45:11.051884+0000","last_clean":"2024-04-18T04:45:11.051884+0000","last_became_active":"2024-04-18T04:44:30.307237+0000","last_became_peered":"2024-04-18T04:44:30.307237+0000","last_unstale":"2024-04-18T04:45:11.051884+0000","last_undegraded":"2024-04-18T04:45:11.051884+0000","last_fullsized":"2024-04-18T04:45:11.051884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:33:58.300542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'4","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.038229+0000","last_change":"2024-04-18T04:44:29.898488+0000","last_active":"2024-04-18T04:45:11.038229+0000","last_peered":"2024-04-18T04:45:11.038229+0000","last_clean":"2024-04-18T04:45:11.038229+0000","last_became_active":"2024-04-18T04:44:29.898113+0000","last_became_peered":"2024-04-18T04:44:29.898113+0000","last_unstale":"2024-04-18T04:45:11.038229+0000","last_undegraded":"2024-04-18T04:45:11.038229+0000","last_fullsized":"2024-04-18T04:45:11.038229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:11:14.585142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.049967+0000","last_change":"2024-04-18T04:44:34.344769+0000","last_active":"2024-04-18T04:45:11.049967+0000","last_peered":"2024-04-18T04:45:11.049967+0000","last_clean":"2024-04-18T04:45:11.049967+0000","last_became_active":"2024-04-18T04:44:34.343636+0000","last_became_peered":"2024-04-18T04:44:34.343636+0000","last_unstale":"2024-04-18T04:45:11.049967+0000","last_undegraded":"2024-04-18T04:45:11.049967+0000","last_fullsized":"2024-04-18T04:45:11.049967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:45:09.481681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040252+0000","last_change":"2024-04-18T04:44:30.290494+0000","last_active":"2024-04-18T04:45:11.040252+0000","last_peered":"2024-04-18T04:45:11.040252+0000","last_clean":"2024-04-18T04:45:11.040252+0000","last_became_active":"2024-04-18T04:44:30.290127+0000","last_became_peered":"2024-04-18T04:44:30.290127+0000","last_unstale":"2024-04-18T04:45:11.040252+0000","last_undegraded":"2024-04-18T04:45:11.040252+0000","last_fullsized":"2024-04-18T04:45:11.040252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:34:21.239813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"25'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.049243+0000","last_change":"2024-04-18T04:44:29.895686+0000","last_active":"2024-04-18T04:45:11.049243+0000","last_peered":"2024-04-18T04:45:11.049243+0000","last_clean":"2024-04-18T04:45:11.049243+0000","last_became_active":"2024-04-18T04:44:29.895083+0000","last_became_peered":"2024-04-18T04:44:29.895083+0000","last_unstale":"2024-04-18T04:45:11.049243+0000","last_undegraded":"2024-04-18T04:45:11.049243+0000","last_fullsized":"2024-04-18T04:45:11.049243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:27:17.897401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.032344+0000","last_change":"2024-04-18T04:44:34.338412+0000","last_active":"2024-04-18T04:45:11.032344+0000","last_peered":"2024-04-18T04:45:11.032344+0000","last_clean":"2024-04-18T04:45:11.032344+0000","last_became_active":"2024-04-18T04:44:34.338062+0000","last_became_peered":"2024-04-18T04:44:34.338062+0000","last_unstale":"2024-04-18T04:45:11.032344+0000","last_undegraded":"2024-04-18T04:45:11.032344+0000","last_fullsized":"2024-04-18T04:45:11.032344+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:49:28.342905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.049013+0000","last_change":"2024-04-18T04:44:30.307946+0000","last_active":"2024-04-18T04:45:11.049013+0000","last_peered":"2024-04-18T04:45:11.049013+0000","last_clean":"2024-04-18T04:45:11.049013+0000","last_became_active":"2024-04-18T04:44:30.307168+0000","last_became_peered":"2024-04-18T04:44:30.307168+0000","last_unstale":"2024-04-18T04:45:11.049013+0000","last_undegraded":"2024-04-18T04:45:11.049013+0000","last_fullsized":"2024-04-18T04:45:11.049013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:43:56.218333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"25'3","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.037172+0000","last_change":"2024-04-18T04:44:29.903183+0000","last_active":"2024-04-18T04:45:11.037172+0000","last_peered":"2024-04-18T04:45:11.037172+0000","last_clean":"2024-04-18T04:45:11.037172+0000","last_became_active":"2024-04-18T04:44:29.902647+0000","last_became_peered":"2024-04-18T04:44:29.902647+0000","last_unstale":"2024-04-18T04:45:11.037172+0000","last_undegraded":"2024-04-18T04:45:11.037172+0000","last_fullsized":"2024-04-18T04:45:11.037172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:45:13.009571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.032335+0000","last_change":"2024-04-18T04:44:34.338653+0000","last_active":"2024-04-18T04:45:11.032335+0000","last_peered":"2024-04-18T04:45:11.032335+0000","last_clean":"2024-04-18T04:45:11.032335+0000","last_became_active":"2024-04-18T04:44:34.338288+0000","last_became_peered":"2024-04-18T04:44:34.338288+0000","last_unstale":"2024-04-18T04:45:11.032335+0000","last_undegraded":"2024-04-18T04:45:11.032335+0000","last_fullsized":"2024-04-18T04:45:11.032335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:58:27.654288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040403+0000","last_change":"2024-04-18T04:44:34.306999+0000","last_active":"2024-04-18T04:45:11.040403+0000","last_peered":"2024-04-18T04:45:11.040403+0000","last_clean":"2024-04-18T04:45:11.040403+0000","last_became_active":"2024-04-18T04:44:34.306657+0000","last_became_peered":"2024-04-18T04:44:34.306657+0000","last_unstale":"2024-04-18T04:45:11.040403+0000","last_undegraded":"2024-04-18T04:45:11.040403+0000","last_fullsized":"2024-04-18T04:45:11.040403+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:52:58.512928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.037436+0000","last_change":"2024-04-18T04:44:30.271947+0000","last_active":"2024-04-18T04:45:11.037436+0000","last_peered":"2024-04-18T04:45:11.037436+0000","last_clean":"2024-04-18T04:45:11.037436+0000","last_became_active":"2024-04-18T04:44:30.271619+0000","last_became_peered":"2024-04-18T04:44:30.271619+0000","last_unstale":"2024-04-18T04:45:11.037436+0000","last_undegraded":"2024-04-18T04:45:11.037436+0000","last_fullsized":"2024-04-18T04:45:11.037436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:32:11.612016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.045479+0000","last_change":"2024-04-18T04:44:29.897616+0000","last_active":"2024-04-18T04:45:11.045479+0000","last_peered":"2024-04-18T04:45:11.045479+0000","last_clean":"2024-04-18T04:45:11.045479+0000","last_became_active":"2024-04-18T04:44:29.889922+0000","last_became_peered":"2024-04-18T04:44:29.889922+0000","last_unstale":"2024-04-18T04:45:11.045479+0000","last_undegraded":"2024-04-18T04:45:11.045479+0000","last_fullsized":"2024-04-18T04:45:11.045479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:11:52.717768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.036613+0000","last_change":"2024-04-18T04:44:34.333403+0000","last_active":"2024-04-18T04:45:11.036613+0000","last_peered":"2024-04-18T04:45:11.036613+0000","last_clean":"2024-04-18T04:45:11.036613+0000","last_became_active":"2024-04-18T04:44:34.332551+0000","last_became_peered":"2024-04-18T04:44:34.332551+0000","last_unstale":"2024-04-18T04:45:11.036613+0000","last_undegraded":"2024-04-18T04:45:11.036613+0000","last_fullsized":"2024-04-18T04:45:11.036613+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:33:28.594002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.032463+0000","last_change":"2024-04-18T04:44:30.271099+0000","last_active":"2024-04-18T04:45:11.032463+0000","last_peered":"2024-04-18T04:45:11.032463+0000","last_clean":"2024-04-18T04:45:11.032463+0000","last_became_active":"2024-04-18T04:44:30.270804+0000","last_became_peered":"2024-04-18T04:44:30.270804+0000","last_unstale":"2024-04-18T04:45:11.032463+0000","last_undegraded":"2024-04-18T04:45:11.032463+0000","last_fullsized":"2024-04-18T04:45:11.032463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:18:27.955171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"25'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.032498+0000","last_change":"2024-04-18T04:44:29.895084+0000","last_active":"2024-04-18T04:45:11.032498+0000","last_peered":"2024-04-18T04:45:11.032498+0000","last_clean":"2024-04-18T04:45:11.032498+0000","last_became_active":"2024-04-18T04:44:29.894829+0000","last_became_peered":"2024-04-18T04:44:29.894829+0000","last_unstale":"2024-04-18T04:45:11.032498+0000","last_undegraded":"2024-04-18T04:45:11.032498+0000","last_fullsized":"2024-04-18T04:45:11.032498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:54.812428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'3","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.037746+0000","last_change":"2024-04-18T04:44:29.892826+0000","last_active":"2024-04-18T04:45:11.037746+0000","last_peered":"2024-04-18T04:45:11.037746+0000","last_clean":"2024-04-18T04:45:11.037746+0000","last_became_active":"2024-04-18T04:44:29.892282+0000","last_became_peered":"2024-04-18T04:44:29.892282+0000","last_unstale":"2024-04-18T04:45:11.037746+0000","last_undegraded":"2024-04-18T04:45:11.037746+0000","last_fullsized":"2024-04-18T04:45:11.037746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:02.844116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040554+0000","last_change":"2024-04-18T04:44:30.285312+0000","last_active":"2024-04-18T04:45:11.040554+0000","last_peered":"2024-04-18T04:45:11.040554+0000","last_clean":"2024-04-18T04:45:11.040554+0000","last_became_active":"2024-04-18T04:44:30.285055+0000","last_became_peered":"2024-04-18T04:44:30.285055+0000","last_unstale":"2024-04-18T04:45:11.040554+0000","last_undegraded":"2024-04-18T04:45:11.040554+0000","last_fullsized":"2024-04-18T04:45:11.040554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:50:00.641018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.035771+0000","last_change":"2024-04-18T04:44:34.323352+0000","last_active":"2024-04-18T04:45:11.035771+0000","last_peered":"2024-04-18T04:45:11.035771+0000","last_clean":"2024-04-18T04:45:11.035771+0000","last_became_active":"2024-04-18T04:44:34.321645+0000","last_became_peered":"2024-04-18T04:44:34.321645+0000","last_unstale":"2024-04-18T04:45:11.035771+0000","last_undegraded":"2024-04-18T04:45:11.035771+0000","last_fullsized":"2024-04-18T04:45:11.035771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:33:27.387013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.033447+0000","last_change":"2024-04-18T04:44:29.891865+0000","last_active":"2024-04-18T04:45:11.033447+0000","last_peered":"2024-04-18T04:45:11.033447+0000","last_clean":"2024-04-18T04:45:11.033447+0000","last_became_active":"2024-04-18T04:44:29.891610+0000","last_became_peered":"2024-04-18T04:44:29.891610+0000","last_unstale":"2024-04-18T04:45:11.033447+0000","last_undegraded":"2024-04-18T04:45:11.033447+0000","last_fullsized":"2024-04-18T04:45:11.033447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:36:42.266497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.049770+0000","last_change":"2024-04-18T04:44:30.279080+0000","last_active":"2024-04-18T04:45:11.049770+0000","last_peered":"2024-04-18T04:45:11.049770+0000","last_clean":"2024-04-18T04:45:11.049770+0000","last_became_active":"2024-04-18T04:44:30.278275+0000","last_became_peered":"2024-04-18T04:44:30.278275+0000","last_unstale":"2024-04-18T04:45:11.049770+0000","last_undegraded":"2024-04-18T04:45:11.049770+0000","last_fullsized":"2024-04-18T04:45:11.049770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:51:48.272703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.032843+0000","last_change":"2024-04-18T04:44:34.313835+0000","last_active":"2024-04-18T04:45:11.032843+0000","last_peered":"2024-04-18T04:45:11.032843+0000","last_clean":"2024-04-18T04:45:11.032843+0000","last_became_active":"2024-04-18T04:44:34.313416+0000","last_became_peered":"2024-04-18T04:44:34.313416+0000","last_unstale":"2024-04-18T04:45:11.032843+0000","last_undegraded":"2024-04-18T04:45:11.032843+0000","last_fullsized":"2024-04-18T04:45:11.032843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:57:47.245809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.036965+0000","last_change":"2024-04-18T04:44:30.297229+0000","last_active":"2024-04-18T04:45:11.036965+0000","last_peered":"2024-04-18T04:45:11.036965+0000","last_clean":"2024-04-18T04:45:11.036965+0000","last_became_active":"2024-04-18T04:44:30.296354+0000","last_became_peered":"2024-04-18T04:44:30.296354+0000","last_unstale":"2024-04-18T04:45:11.036965+0000","last_undegraded":"2024-04-18T04:45:11.036965+0000","last_fullsized":"2024-04-18T04:45:11.036965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:30:35.845106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.035644+0000","last_change":"2024-04-18T04:44:30.281213+0000","last_active":"2024-04-18T04:45:11.035644+0000","last_peered":"2024-04-18T04:45:11.035644+0000","last_clean":"2024-04-18T04:45:11.035644+0000","last_became_active":"2024-04-18T04:44:30.280941+0000","last_became_peered":"2024-04-18T04:44:30.280941+0000","last_unstale":"2024-04-18T04:45:11.035644+0000","last_undegraded":"2024-04-18T04:45:11.035644+0000","last_fullsized":"2024-04-18T04:45:11.035644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:15:37.795670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.048113+0000","last_change":"2024-04-18T04:44:30.288507+0000","last_active":"2024-04-18T04:45:11.048113+0000","last_peered":"2024-04-18T04:45:11.048113+0000","last_clean":"2024-04-18T04:45:11.048113+0000","last_became_active":"2024-04-18T04:44:30.287820+0000","last_became_peered":"2024-04-18T04:44:30.287820+0000","last_unstale":"2024-04-18T04:45:11.048113+0000","last_undegraded":"2024-04-18T04:45:11.048113+0000","last_fullsized":"2024-04-18T04:45:11.048113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:25:29.500586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040472+0000","last_change":"2024-04-18T04:44:30.273278+0000","last_active":"2024-04-18T04:45:11.040472+0000","last_peered":"2024-04-18T04:45:11.040472+0000","last_clean":"2024-04-18T04:45:11.040472+0000","last_became_active":"2024-04-18T04:44:30.272973+0000","last_became_peered":"2024-04-18T04:44:30.272973+0000","last_unstale":"2024-04-18T04:45:11.040472+0000","last_undegraded":"2024-04-18T04:45:11.040472+0000","last_fullsized":"2024-04-18T04:45:11.040472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:37:02.421925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.033267+0000","last_change":"2024-04-18T04:44:30.298936+0000","last_active":"2024-04-18T04:45:11.033267+0000","last_peered":"2024-04-18T04:45:11.033267+0000","last_clean":"2024-04-18T04:45:11.033267+0000","last_became_active":"2024-04-18T04:44:30.298637+0000","last_became_peered":"2024-04-18T04:44:30.298637+0000","last_unstale":"2024-04-18T04:45:11.033267+0000","last_undegraded":"2024-04-18T04:45:11.033267+0000","last_fullsized":"2024-04-18T04:45:11.033267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:04:33.188772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.038089+0000","last_change":"2024-04-18T04:44:30.274613+0000","last_active":"2024-04-18T04:45:11.038089+0000","last_peered":"2024-04-18T04:45:11.038089+0000","last_clean":"2024-04-18T04:45:11.038089+0000","last_became_active":"2024-04-18T04:44:30.274328+0000","last_became_peered":"2024-04-18T04:44:30.274328+0000","last_unstale":"2024-04-18T04:45:11.038089+0000","last_undegraded":"2024-04-18T04:45:11.038089+0000","last_fullsized":"2024-04-18T04:45:11.038089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:55:41.700955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040493+0000","last_change":"2024-04-18T04:44:30.309403+0000","last_active":"2024-04-18T04:45:11.040493+0000","last_peered":"2024-04-18T04:45:11.040493+0000","last_clean":"2024-04-18T04:45:11.040493+0000","last_became_active":"2024-04-18T04:44:30.308415+0000","last_became_peered":"2024-04-18T04:44:30.308415+0000","last_unstale":"2024-04-18T04:45:11.040493+0000","last_undegraded":"2024-04-18T04:45:11.040493+0000","last_fullsized":"2024-04-18T04:45:11.040493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:51:58.935503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.033484+0000","last_change":"2024-04-18T04:44:30.293996+0000","last_active":"2024-04-18T04:45:11.033484+0000","last_peered":"2024-04-18T04:45:11.033484+0000","last_clean":"2024-04-18T04:45:11.033484+0000","last_became_active":"2024-04-18T04:44:30.293748+0000","last_became_peered":"2024-04-18T04:44:30.293748+0000","last_unstale":"2024-04-18T04:45:11.033484+0000","last_undegraded":"2024-04-18T04:45:11.033484+0000","last_fullsized":"2024-04-18T04:45:11.033484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:18:32.116499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T04:45:12.043771+0000","last_change":"2024-04-18T04:45:12.040362+0000","last_active":"2024-04-18T04:45:12.043771+0000","last_peered":"2024-04-18T04:45:12.043771+0000","last_clean":"2024-04-18T04:45:12.043771+0000","last_became_active":"2024-04-18T04:45:12.040045+0000","last_became_peered":"2024-04-18T04:45:12.040045+0000","last_unstale":"2024-04-18T04:45:12.043771+0000","last_undegraded":"2024-04-18T04:45:12.043771+0000","last_fullsized":"2024-04-18T04:45:12.043771+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:18:21.482610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.032447+0000","last_change":"2024-04-18T04:44:30.285836+0000","last_active":"2024-04-18T04:45:11.032447+0000","last_peered":"2024-04-18T04:45:11.032447+0000","last_clean":"2024-04-18T04:45:11.032447+0000","last_became_active":"2024-04-18T04:44:30.285602+0000","last_became_peered":"2024-04-18T04:44:30.285602+0000","last_unstale":"2024-04-18T04:45:11.032447+0000","last_undegraded":"2024-04-18T04:45:11.032447+0000","last_fullsized":"2024-04-18T04:45:11.032447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:34:39.594780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T04:45:12.044206+0000","last_change":"2024-04-18T04:45:12.040347+0000","last_active":"2024-04-18T04:45:12.044206+0000","last_peered":"2024-04-18T04:45:12.044206+0000","last_clean":"2024-04-18T04:45:12.044206+0000","last_became_active":"2024-04-18T04:45:12.040023+0000","last_became_peered":"2024-04-18T04:45:12.040023+0000","last_unstale":"2024-04-18T04:45:12.044206+0000","last_undegraded":"2024-04-18T04:45:12.044206+0000","last_fullsized":"2024-04-18T04:45:12.044206+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:24.207082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040230+0000","last_change":"2024-04-18T04:44:30.310229+0000","last_active":"2024-04-18T04:45:11.040230+0000","last_peered":"2024-04-18T04:45:11.040230+0000","last_clean":"2024-04-18T04:45:11.040230+0000","last_became_active":"2024-04-18T04:44:30.310045+0000","last_became_peered":"2024-04-18T04:44:30.310045+0000","last_unstale":"2024-04-18T04:45:11.040230+0000","last_undegraded":"2024-04-18T04:45:11.040230+0000","last_fullsized":"2024-04-18T04:45:11.040230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:22:55.588300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.039012+0000","last_change":"2024-04-18T04:44:30.305644+0000","last_active":"2024-04-18T04:45:11.039012+0000","last_peered":"2024-04-18T04:45:11.039012+0000","last_clean":"2024-04-18T04:45:11.039012+0000","last_became_active":"2024-04-18T04:44:30.304921+0000","last_became_peered":"2024-04-18T04:44:30.304921+0000","last_unstale":"2024-04-18T04:45:11.039012+0000","last_undegraded":"2024-04-18T04:45:11.039012+0000","last_fullsized":"2024-04-18T04:45:11.039012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:17:37.235711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.042156+0000","last_change":"2024-04-18T04:44:30.294105+0000","last_active":"2024-04-18T04:45:11.042156+0000","last_peered":"2024-04-18T04:45:11.042156+0000","last_clean":"2024-04-18T04:45:11.042156+0000","last_became_active":"2024-04-18T04:44:30.291742+0000","last_became_peered":"2024-04-18T04:44:30.291742+0000","last_unstale":"2024-04-18T04:45:11.042156+0000","last_undegraded":"2024-04-18T04:45:11.042156+0000","last_fullsized":"2024-04-18T04:45:11.042156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:43:26.428261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.036089+0000","last_change":"2024-04-18T04:44:30.296496+0000","last_active":"2024-04-18T04:45:11.036089+0000","last_peered":"2024-04-18T04:45:11.036089+0000","last_clean":"2024-04-18T04:45:11.036089+0000","last_became_active":"2024-04-18T04:44:30.296177+0000","last_became_peered":"2024-04-18T04:44:30.296177+0000","last_unstale":"2024-04-18T04:45:11.036089+0000","last_undegraded":"2024-04-18T04:45:11.036089+0000","last_fullsized":"2024-04-18T04:45:11.036089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:46:44.829326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.049700+0000","last_change":"2024-04-18T04:44:30.306568+0000","last_active":"2024-04-18T04:45:11.049700+0000","last_peered":"2024-04-18T04:45:11.049700+0000","last_clean":"2024-04-18T04:45:11.049700+0000","last_became_active":"2024-04-18T04:44:30.305674+0000","last_became_peered":"2024-04-18T04:44:30.305674+0000","last_unstale":"2024-04-18T04:45:11.049700+0000","last_undegraded":"2024-04-18T04:45:11.049700+0000","last_fullsized":"2024-04-18T04:45:11.049700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:58:10.740164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.044497+0000","last_change":"2024-04-18T04:44:30.307297+0000","last_active":"2024-04-18T04:45:11.044497+0000","last_peered":"2024-04-18T04:45:11.044497+0000","last_clean":"2024-04-18T04:45:11.044497+0000","last_became_active":"2024-04-18T04:44:30.305470+0000","last_became_peered":"2024-04-18T04:44:30.305470+0000","last_unstale":"2024-04-18T04:45:11.044497+0000","last_undegraded":"2024-04-18T04:45:11.044497+0000","last_fullsized":"2024-04-18T04:45:11.044497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:01:00.587115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.037512+0000","last_change":"2024-04-18T04:44:30.280849+0000","last_active":"2024-04-18T04:45:11.037512+0000","last_peered":"2024-04-18T04:45:11.037512+0000","last_clean":"2024-04-18T04:45:11.037512+0000","last_became_active":"2024-04-18T04:44:30.280535+0000","last_became_peered":"2024-04-18T04:44:30.280535+0000","last_unstale":"2024-04-18T04:45:11.037512+0000","last_undegraded":"2024-04-18T04:45:11.037512+0000","last_fullsized":"2024-04-18T04:45:11.037512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:01:06.241941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040393+0000","last_change":"2024-04-18T04:44:30.278849+0000","last_active":"2024-04-18T04:45:11.040393+0000","last_peered":"2024-04-18T04:45:11.040393+0000","last_clean":"2024-04-18T04:45:11.040393+0000","last_became_active":"2024-04-18T04:44:30.278624+0000","last_became_peered":"2024-04-18T04:44:30.278624+0000","last_unstale":"2024-04-18T04:45:11.040393+0000","last_undegraded":"2024-04-18T04:45:11.040393+0000","last_fullsized":"2024-04-18T04:45:11.040393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:31:30.791150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.032793+0000","last_change":"2024-04-18T04:44:30.296148+0000","last_active":"2024-04-18T04:45:11.032793+0000","last_peered":"2024-04-18T04:45:11.032793+0000","last_clean":"2024-04-18T04:45:11.032793+0000","last_became_active":"2024-04-18T04:44:30.295754+0000","last_became_peered":"2024-04-18T04:44:30.295754+0000","last_unstale":"2024-04-18T04:45:11.032793+0000","last_undegraded":"2024-04-18T04:45:11.032793+0000","last_fullsized":"2024-04-18T04:45:11.032793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:39:53.809075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.051669+0000","last_change":"2024-04-18T04:44:30.298061+0000","last_active":"2024-04-18T04:45:11.051669+0000","last_peered":"2024-04-18T04:45:11.051669+0000","last_clean":"2024-04-18T04:45:11.051669+0000","last_became_active":"2024-04-18T04:44:30.297416+0000","last_became_peered":"2024-04-18T04:44:30.297416+0000","last_unstale":"2024-04-18T04:45:11.051669+0000","last_undegraded":"2024-04-18T04:45:11.051669+0000","last_fullsized":"2024-04-18T04:45:11.051669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:35:48.612670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.039607+0000","last_change":"2024-04-18T04:44:30.292802+0000","last_active":"2024-04-18T04:45:11.039607+0000","last_peered":"2024-04-18T04:45:11.039607+0000","last_clean":"2024-04-18T04:45:11.039607+0000","last_became_active":"2024-04-18T04:44:30.291939+0000","last_became_peered":"2024-04-18T04:44:30.291939+0000","last_unstale":"2024-04-18T04:45:11.039607+0000","last_undegraded":"2024-04-18T04:45:11.039607+0000","last_fullsized":"2024-04-18T04:45:11.039607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:33:04.689561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040283+0000","last_change":"2024-04-18T04:44:30.309020+0000","last_active":"2024-04-18T04:45:11.040283+0000","last_peered":"2024-04-18T04:45:11.040283+0000","last_clean":"2024-04-18T04:45:11.040283+0000","last_became_active":"2024-04-18T04:44:30.307604+0000","last_became_peered":"2024-04-18T04:44:30.307604+0000","last_unstale":"2024-04-18T04:45:11.040283+0000","last_undegraded":"2024-04-18T04:45:11.040283+0000","last_fullsized":"2024-04-18T04:45:11.040283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:44:54.764284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.046696+0000","last_change":"2024-04-18T04:44:30.314533+0000","last_active":"2024-04-18T04:45:11.046696+0000","last_peered":"2024-04-18T04:45:11.046696+0000","last_clean":"2024-04-18T04:45:11.046696+0000","last_became_active":"2024-04-18T04:44:30.313985+0000","last_became_peered":"2024-04-18T04:44:30.313985+0000","last_unstale":"2024-04-18T04:45:11.046696+0000","last_undegraded":"2024-04-18T04:45:11.046696+0000","last_fullsized":"2024-04-18T04:45:11.046696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:02:03.941709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.032261+0000","last_change":"2024-04-18T04:44:30.309273+0000","last_active":"2024-04-18T04:45:11.032261+0000","last_peered":"2024-04-18T04:45:11.032261+0000","last_clean":"2024-04-18T04:45:11.032261+0000","last_became_active":"2024-04-18T04:44:30.309002+0000","last_became_peered":"2024-04-18T04:44:30.309002+0000","last_unstale":"2024-04-18T04:45:11.032261+0000","last_undegraded":"2024-04-18T04:45:11.032261+0000","last_fullsized":"2024-04-18T04:45:11.032261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:49:10.005359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.038949+0000","last_change":"2024-04-18T04:44:30.292371+0000","last_active":"2024-04-18T04:45:11.038949+0000","last_peered":"2024-04-18T04:45:11.038949+0000","last_clean":"2024-04-18T04:45:11.038949+0000","last_became_active":"2024-04-18T04:44:30.290504+0000","last_became_peered":"2024-04-18T04:44:30.290504+0000","last_unstale":"2024-04-18T04:45:11.038949+0000","last_undegraded":"2024-04-18T04:45:11.038949+0000","last_fullsized":"2024-04-18T04:45:11.038949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:11.998355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.047855+0000","last_change":"2024-04-18T04:44:30.299935+0000","last_active":"2024-04-18T04:45:11.047855+0000","last_peered":"2024-04-18T04:45:11.047855+0000","last_clean":"2024-04-18T04:45:11.047855+0000","last_became_active":"2024-04-18T04:44:30.290175+0000","last_became_peered":"2024-04-18T04:44:30.290175+0000","last_unstale":"2024-04-18T04:45:11.047855+0000","last_undegraded":"2024-04-18T04:45:11.047855+0000","last_fullsized":"2024-04-18T04:45:11.047855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:15:13.703423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.039660+0000","last_change":"2024-04-18T04:44:30.288940+0000","last_active":"2024-04-18T04:45:11.039660+0000","last_peered":"2024-04-18T04:45:11.039660+0000","last_clean":"2024-04-18T04:45:11.039660+0000","last_became_active":"2024-04-18T04:44:30.288131+0000","last_became_peered":"2024-04-18T04:44:30.288131+0000","last_unstale":"2024-04-18T04:45:11.039660+0000","last_undegraded":"2024-04-18T04:45:11.039660+0000","last_fullsized":"2024-04-18T04:45:11.039660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:31:08.895305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.048345+0000","last_change":"2024-04-18T04:44:30.288066+0000","last_active":"2024-04-18T04:45:11.048345+0000","last_peered":"2024-04-18T04:45:11.048345+0000","last_clean":"2024-04-18T04:45:11.048345+0000","last_became_active":"2024-04-18T04:44:30.287325+0000","last_became_peered":"2024-04-18T04:44:30.287325+0000","last_unstale":"2024-04-18T04:45:11.048345+0000","last_undegraded":"2024-04-18T04:45:11.048345+0000","last_fullsized":"2024-04-18T04:45:11.048345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:58:04.111225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.039976+0000","last_change":"2024-04-18T04:44:30.275485+0000","last_active":"2024-04-18T04:45:11.039976+0000","last_peered":"2024-04-18T04:45:11.039976+0000","last_clean":"2024-04-18T04:45:11.039976+0000","last_became_active":"2024-04-18T04:44:30.275118+0000","last_became_peered":"2024-04-18T04:44:30.275118+0000","last_unstale":"2024-04-18T04:45:11.039976+0000","last_undegraded":"2024-04-18T04:45:11.039976+0000","last_fullsized":"2024-04-18T04:45:11.039976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:25:09.625660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.039018+0000","last_change":"2024-04-18T04:44:30.277119+0000","last_active":"2024-04-18T04:45:11.039018+0000","last_peered":"2024-04-18T04:45:11.039018+0000","last_clean":"2024-04-18T04:45:11.039018+0000","last_became_active":"2024-04-18T04:44:30.276654+0000","last_became_peered":"2024-04-18T04:44:30.276654+0000","last_unstale":"2024-04-18T04:45:11.039018+0000","last_undegraded":"2024-04-18T04:45:11.039018+0000","last_fullsized":"2024-04-18T04:45:11.039018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:52.420199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.046316+0000","last_change":"2024-04-18T04:44:30.302905+0000","last_active":"2024-04-18T04:45:11.046316+0000","last_peered":"2024-04-18T04:45:11.046316+0000","last_clean":"2024-04-18T04:45:11.046316+0000","last_became_active":"2024-04-18T04:44:30.302180+0000","last_became_peered":"2024-04-18T04:44:30.302180+0000","last_unstale":"2024-04-18T04:45:11.046316+0000","last_undegraded":"2024-04-18T04:45:11.046316+0000","last_fullsized":"2024-04-18T04:45:11.046316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:41:53.211956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7568,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":15136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66624,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":307200,"data_stored":120788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]}]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":117146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]}]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":307200,"data_stored":117272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]}]},{"osd":7,"up_from":14,"seq":60129542160,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":707964,"data_compressed":33312,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:45:17 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":4.2729999999999997,"5min":4.2729999999999997,"15min":4.2729999999999997},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":4.1500000000000004,"5min":4.1500000000000004,"15min":4.1500000000000004},"last":0.58099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":4,"last update":"Thu Apr 18 04:45:17 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.1070000000000002,"5min":2.1070000000000002,"15min":2.1070000000000002},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":1.0049999999999999}]},{"osd":5,"last update":"Thu Apr 18 04:45:17 2024","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.044},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.3130000000000002,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":1.167}]},{"osd":6,"last update":"Thu Apr 18 04:45:17 2024","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":1.218}]}]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":303104,"data_stored":121012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:45:16 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.55900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":4,"last update":"Thu Apr 18 04:45:16 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.002}]},{"osd":5,"last update":"Thu Apr 18 04:45:16 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":1.101},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.83499999999999996}]},{"osd":7,"last update":"Thu Apr 18 04:45:16 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.91000000000000003}]}]},{"osd":5,"up_from":14,"seq":60129542160,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":303104,"data_stored":117706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542160,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":117252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":364544,"data_stored":707356,"data_compressed":33312,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33312,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33312,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T04:45:20.462 INFO:tasks.mds_thrash.ceph_manager:clean! 2024-04-18T04:45:20.462 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T04:45:20.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.636+0000 7f59cb000640 1 Processor -- start 2024-04-18T04:45:20.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.636+0000 7f59cb000640 1 -- start start 2024-04-18T04:45:20.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.636+0000 7f59cb000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59c40c7480 0x7f59c40c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:20.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.636+0000 7f59cb000640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f59c40bfe70 0x7f59c40c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:20.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.636+0000 7f59cb000640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c406f9b0 con 0x7f59c4150340 2024-04-18T04:45:20.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.636+0000 7f59cb000640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c4156b40 con 0x7f59c40bfe70 2024-04-18T04:45:20.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.636+0000 7f59cb000640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c40c0520 con 0x7f59c40c7480 2024-04-18T04:45:20.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.636+0000 7f59c9000640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f59c40bfe70 0x7f59c40c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:20.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.636+0000 7f59c3e00640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f59c4150340 0x7f59c4156430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:35354/0 (socket says 172.21.15.120:35354) 2024-04-18T04:45:20.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.636+0000 7f59c9000640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f59c40bfe70 0x7f59c40c6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46930/0 (socket says 172.21.15.120:46930) 2024-04-18T04:45:20.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.636+0000 7f59c3e00640 1 -- 172.21.15.120:0/4064219666 learned_addr learned my addr 172.21.15.120:0/4064219666 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:45:20.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.640+0000 7f59bb400640 1 --2- 172.21.15.120:0/4064219666 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59c40c7480 0x7f59c40c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:20.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.640+0000 7f59c9000640 1 -- 172.21.15.120:0/4064219666 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59c40c7480 msgr2=0x7f59c40c68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:20.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.640+0000 7f59c9000640 1 --2- 172.21.15.120:0/4064219666 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59c40c7480 0x7f59c40c68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:20.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.640+0000 7f59c9000640 1 -- 172.21.15.120:0/4064219666 >> v1:172.21.15.120:6789/0 conn(0x7f59c4150340 legacy=0x7f59c4156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:20.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.640+0000 7f59c9000640 1 -- 172.21.15.120:0/4064219666 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c40c0800 con 0x7f59c40bfe70 2024-04-18T04:45:20.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.640+0000 7f59bb400640 1 --2- 172.21.15.120:0/4064219666 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59c40c7480 0x7f59c40c68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:20.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.640+0000 7f59c3400640 1 -- 172.21.15.120:0/4064219666 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2453940855 0 0) 0x7f59c406f9b0 con 0x7f59c4150340 2024-04-18T04:45:20.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.640+0000 7f59c9000640 1 --2- 172.21.15.120:0/4064219666 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59c40bfe70 0x7f59c40c6e10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f59bc009d90 tx=0x7f59bc01f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46845ad41cbe0c36 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:20.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.640+0000 7f59c3400640 1 -- 172.21.15.120:0/4064219666 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc0af600 con 0x7f59c40bfe70 2024-04-18T04:45:20.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.640+0000 7f59c3400640 1 -- 172.21.15.120:0/4064219666 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59bc0ab050 con 0x7f59c40bfe70 2024-04-18T04:45:20.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.640+0000 7f59c3400640 1 -- 172.21.15.120:0/4064219666 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc0af980 con 0x7f59c40bfe70 2024-04-18T04:45:20.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.640+0000 7f59cb000640 1 -- 172.21.15.120:0/4064219666 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59c40bfe70 msgr2=0x7f59c40c6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:20.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.640+0000 7f59cb000640 1 --2- 172.21.15.120:0/4064219666 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59c40bfe70 0x7f59c40c6e10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f59bc009d90 tx=0x7f59bc01f150 comp rx=0 tx=0).stop 2024-04-18T04:45:20.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.644+0000 7f59cb000640 1 -- 172.21.15.120:0/4064219666 shutdown_connections 2024-04-18T04:45:20.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.644+0000 7f59cb000640 1 --2- 172.21.15.120:0/4064219666 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59c40bfe70 0x7f59c40c6e10 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:20.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.644+0000 7f59cb000640 1 --2- 172.21.15.120:0/4064219666 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59c40c7480 0x7f59c40c68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:20.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.644+0000 7f59cb000640 1 -- 172.21.15.120:0/4064219666 >> 172.21.15.120:0/4064219666 conn(0x7f59c40c78c0 msgr2=0x7f59c40c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:20.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.644+0000 7f59cb000640 1 -- 172.21.15.120:0/4064219666 shutdown_connections 2024-04-18T04:45:20.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.644+0000 7f59cb000640 1 -- 172.21.15.120:0/4064219666 wait complete. 2024-04-18T04:45:20.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.644+0000 7f59cb000640 1 Processor -- start 2024-04-18T04:45:20.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.644+0000 7f59cb000640 1 -- start start 2024-04-18T04:45:20.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.644+0000 7f59cb000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59c40bfe70 0x7f59c41ef6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:20.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.644+0000 7f59cb000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59c40c7480 0x7f59c41476b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:20.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.644+0000 7f59cb000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59c4150340 0x7f59c41560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:20.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.644+0000 7f59cb000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c41efbf0 con 0x7f59c40bfe70 2024-04-18T04:45:20.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.644+0000 7f59cb000640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c4155520 con 0x7f59c4150340 2024-04-18T04:45:20.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.644+0000 7f59cb000640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c40c52b0 con 0x7f59c40c7480 2024-04-18T04:45:20.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.644+0000 7f59c3e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59c40bfe70 0x7f59c41ef6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:20.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.644+0000 7f59c3e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59c40bfe70 0x7f59c41ef6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46944/0 (socket says 172.21.15.120:46944) 2024-04-18T04:45:20.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.644+0000 7f59c3e00640 1 -- 172.21.15.120:0/1858089832 learned_addr learned my addr 172.21.15.120:0/1858089832 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:20.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.644+0000 7f59c9000640 1 --2- 172.21.15.120:0/1858089832 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59c4150340 0x7f59c41560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:20.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.644+0000 7f59bb400640 1 --2- 172.21.15.120:0/1858089832 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59c40c7480 0x7f59c41476b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:20.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.644+0000 7f59c3e00640 1 -- 172.21.15.120:0/1858089832 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59c40c7480 msgr2=0x7f59c41476b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:20.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.644+0000 7f59c3e00640 1 --2- 172.21.15.120:0/1858089832 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59c40c7480 0x7f59c41476b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:20.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.644+0000 7f59c3e00640 1 -- 172.21.15.120:0/1858089832 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59c4150340 msgr2=0x7f59c41560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:20.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.644+0000 7f59c3e00640 1 --2- 172.21.15.120:0/1858089832 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59c4150340 0x7f59c41560c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:20.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.644+0000 7f59c3e00640 1 -- 172.21.15.120:0/1858089832 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59bc009a70 con 0x7f59c40bfe70 2024-04-18T04:45:20.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.644+0000 7f59c3e00640 1 --2- 172.21.15.120:0/1858089832 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59c40bfe70 0x7f59c41ef6b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f59b400c4b0 tx=0x7f59b400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:20.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.644+0000 7f59c0c00640 1 -- 172.21.15.120:0/1858089832 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b40074e0 con 0x7f59c40bfe70 2024-04-18T04:45:20.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.644+0000 7f59c0c00640 1 -- 172.21.15.120:0/1858089832 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b4007660 con 0x7f59c40bfe70 2024-04-18T04:45:20.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.644+0000 7f59c0c00640 1 -- 172.21.15.120:0/1858089832 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b4004a30 con 0x7f59c40bfe70 2024-04-18T04:45:20.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.648+0000 7f59cb000640 1 -- 172.21.15.120:0/1858089832 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c4154650 con 0x7f59c40bfe70 2024-04-18T04:45:20.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.648+0000 7f59cb000640 1 -- 172.21.15.120:0/1858089832 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c4154910 con 0x7f59c40bfe70 2024-04-18T04:45:20.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.648+0000 7f59cb000640 1 -- 172.21.15.120:0/1858089832 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c40726d0 con 0x7f59c40bfe70 2024-04-18T04:45:20.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.648+0000 7f59c0c00640 1 -- 172.21.15.120:0/1858089832 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f59b4004b90 con 0x7f59c40bfe70 2024-04-18T04:45:20.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.648+0000 7f59c0c00640 1 --2- 172.21.15.120:0/1858089832 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f59a0066690 0x7f59a0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:20.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.648+0000 7f59c0c00640 1 -- 172.21.15.120:0/1858089832 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f59b4083820 con 0x7f59c40bfe70 2024-04-18T04:45:20.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.648+0000 7f59bb400640 1 --2- 172.21.15.120:0/1858089832 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f59a0066690 0x7f59a0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:20.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.652+0000 7f59bb400640 1 --2- 172.21.15.120:0/1858089832 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f59a0066690 0x7f59a0068b50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f59c40c66b0 tx=0x7f59ac008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:20.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.652+0000 7f59c0c00640 1 -- 172.21.15.120:0/1858089832 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f59b4054130 con 0x7f59c40bfe70 2024-04-18T04:45:20.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.800+0000 7f59cb000640 1 -- 172.21.15.120:0/1858089832 --> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f59c40c0ae0 con 0x7f59a0066690 2024-04-18T04:45:20.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.828+0000 7f59c0c00640 1 -- 172.21.15.120:0/1858089832 <== mgr.4113 v2:172.21.15.132:6832/27788 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+348500 (secure 0 0 0) 0x7f59ac00c590 con 0x7f59a0066690 2024-04-18T04:45:20.832 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:45:20.834 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-04-18T04:45:20.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.832+0000 7f59cb000640 1 -- 172.21.15.120:0/1858089832 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f59a0066690 msgr2=0x7f59a0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:20.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.832+0000 7f59cb000640 1 --2- 172.21.15.120:0/1858089832 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f59a0066690 0x7f59a0068b50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f59c40c66b0 tx=0x7f59ac008040 comp rx=0 tx=0).stop 2024-04-18T04:45:20.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.832+0000 7f59cb000640 1 -- 172.21.15.120:0/1858089832 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59c40bfe70 msgr2=0x7f59c41ef6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:20.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.832+0000 7f59cb000640 1 --2- 172.21.15.120:0/1858089832 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59c40bfe70 0x7f59c41ef6b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f59b400c4b0 tx=0x7f59b400c970 comp rx=0 tx=0).stop 2024-04-18T04:45:20.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.832+0000 7f59cb000640 1 -- 172.21.15.120:0/1858089832 shutdown_connections 2024-04-18T04:45:20.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.832+0000 7f59cb000640 1 --2- 172.21.15.120:0/1858089832 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f59a0066690 0x7f59a0068b50 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:20.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.832+0000 7f59cb000640 1 --2- 172.21.15.120:0/1858089832 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59c4150340 0x7f59c41560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:20.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.832+0000 7f59cb000640 1 --2- 172.21.15.120:0/1858089832 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59c40c7480 0x7f59c41476b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:20.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.832+0000 7f59cb000640 1 --2- 172.21.15.120:0/1858089832 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59c40bfe70 0x7f59c41ef6b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:20.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.832+0000 7f59cb000640 1 -- 172.21.15.120:0/1858089832 >> 172.21.15.120:0/1858089832 conn(0x7f59c40c78c0 msgr2=0x7f59c414f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:20.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.832+0000 7f59cb000640 1 -- 172.21.15.120:0/1858089832 shutdown_connections 2024-04-18T04:45:20.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:20.832+0000 7f59cb000640 1 -- 172.21.15.120:0/1858089832 wait complete. 2024-04-18T04:45:20.852 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-04-18T04:45:18.808540+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597936,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":288,"num_write_kb":2459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218660,"kb_used_data":2496,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756060,"statfs":{"total":773094113280,"available":772870205440,"internally_reserved":0,"allocated":2555904,"data_stored":2126496,"data_compressed":66624,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":832,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003643"},"pg_stats":[{"pgid":"2.1f","version":"25'9","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040333+0000","last_change":"2024-04-18T04:44:29.891079+0000","last_active":"2024-04-18T04:45:11.040333+0000","last_peered":"2024-04-18T04:45:11.040333+0000","last_clean":"2024-04-18T04:45:11.040333+0000","last_became_active":"2024-04-18T04:44:29.890853+0000","last_became_peered":"2024-04-18T04:44:29.890853+0000","last_unstale":"2024-04-18T04:45:11.040333+0000","last_undegraded":"2024-04-18T04:45:11.040333+0000","last_fullsized":"2024-04-18T04:45:11.040333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:12:22.299583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.033252+0000","last_change":"2024-04-18T04:44:30.296344+0000","last_active":"2024-04-18T04:45:11.033252+0000","last_peered":"2024-04-18T04:45:11.033252+0000","last_clean":"2024-04-18T04:45:11.033252+0000","last_became_active":"2024-04-18T04:44:30.296064+0000","last_became_peered":"2024-04-18T04:44:30.296064+0000","last_unstale":"2024-04-18T04:45:11.033252+0000","last_undegraded":"2024-04-18T04:45:11.033252+0000","last_fullsized":"2024-04-18T04:45:11.033252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:53:32.250308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.032245+0000","last_change":"2024-04-18T04:44:34.306605+0000","last_active":"2024-04-18T04:45:11.032245+0000","last_peered":"2024-04-18T04:45:11.032245+0000","last_clean":"2024-04-18T04:45:11.032245+0000","last_became_active":"2024-04-18T04:44:34.306224+0000","last_became_peered":"2024-04-18T04:44:34.306224+0000","last_unstale":"2024-04-18T04:45:11.032245+0000","last_undegraded":"2024-04-18T04:45:11.032245+0000","last_fullsized":"2024-04-18T04:45:11.032245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:13:15.107711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.033341+0000","last_change":"2024-04-18T04:44:29.881521+0000","last_active":"2024-04-18T04:45:11.033341+0000","last_peered":"2024-04-18T04:45:11.033341+0000","last_clean":"2024-04-18T04:45:11.033341+0000","last_became_active":"2024-04-18T04:44:29.881258+0000","last_became_peered":"2024-04-18T04:44:29.881258+0000","last_unstale":"2024-04-18T04:45:11.033341+0000","last_undegraded":"2024-04-18T04:45:11.033341+0000","last_fullsized":"2024-04-18T04:45:11.033341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:28:40.075960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040116+0000","last_change":"2024-04-18T04:44:30.314205+0000","last_active":"2024-04-18T04:45:11.040116+0000","last_peered":"2024-04-18T04:45:11.040116+0000","last_clean":"2024-04-18T04:45:11.040116+0000","last_became_active":"2024-04-18T04:44:30.313987+0000","last_became_peered":"2024-04-18T04:44:30.313987+0000","last_unstale":"2024-04-18T04:45:11.040116+0000","last_undegraded":"2024-04-18T04:45:11.040116+0000","last_fullsized":"2024-04-18T04:45:11.040116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:55:31.107861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.045581+0000","last_change":"2024-04-18T04:44:34.339646+0000","last_active":"2024-04-18T04:45:11.045581+0000","last_peered":"2024-04-18T04:45:11.045581+0000","last_clean":"2024-04-18T04:45:11.045581+0000","last_became_active":"2024-04-18T04:44:34.338485+0000","last_became_peered":"2024-04-18T04:44:34.338485+0000","last_unstale":"2024-04-18T04:45:11.045581+0000","last_undegraded":"2024-04-18T04:45:11.045581+0000","last_fullsized":"2024-04-18T04:45:11.045581+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:47:01.277301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'4","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.041934+0000","last_change":"2024-04-18T04:44:29.897785+0000","last_active":"2024-04-18T04:45:11.041934+0000","last_peered":"2024-04-18T04:45:11.041934+0000","last_clean":"2024-04-18T04:45:11.041934+0000","last_became_active":"2024-04-18T04:44:29.896520+0000","last_became_peered":"2024-04-18T04:44:29.896520+0000","last_unstale":"2024-04-18T04:45:11.041934+0000","last_undegraded":"2024-04-18T04:45:11.041934+0000","last_fullsized":"2024-04-18T04:45:11.041934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:25:52.871139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.048559+0000","last_change":"2024-04-18T04:44:30.300588+0000","last_active":"2024-04-18T04:45:11.048559+0000","last_peered":"2024-04-18T04:45:11.048559+0000","last_clean":"2024-04-18T04:45:11.048559+0000","last_became_active":"2024-04-18T04:44:30.299939+0000","last_became_peered":"2024-04-18T04:44:30.299939+0000","last_unstale":"2024-04-18T04:45:11.048559+0000","last_undegraded":"2024-04-18T04:45:11.048559+0000","last_fullsized":"2024-04-18T04:45:11.048559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:57:07.547985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.050267+0000","last_change":"2024-04-18T04:44:34.338794+0000","last_active":"2024-04-18T04:45:11.050267+0000","last_peered":"2024-04-18T04:45:11.050267+0000","last_clean":"2024-04-18T04:45:11.050267+0000","last_became_active":"2024-04-18T04:44:34.337938+0000","last_became_peered":"2024-04-18T04:44:34.337938+0000","last_unstale":"2024-04-18T04:45:11.050267+0000","last_undegraded":"2024-04-18T04:45:11.050267+0000","last_fullsized":"2024-04-18T04:45:11.050267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:48.827970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040848+0000","last_change":"2024-04-18T04:44:29.903118+0000","last_active":"2024-04-18T04:45:11.040848+0000","last_peered":"2024-04-18T04:45:11.040848+0000","last_clean":"2024-04-18T04:45:11.040848+0000","last_became_active":"2024-04-18T04:44:29.902611+0000","last_became_peered":"2024-04-18T04:44:29.902611+0000","last_unstale":"2024-04-18T04:45:11.040848+0000","last_undegraded":"2024-04-18T04:45:11.040848+0000","last_fullsized":"2024-04-18T04:45:11.040848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:38:42.595095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.048818+0000","last_change":"2024-04-18T04:44:30.301328+0000","last_active":"2024-04-18T04:45:11.048818+0000","last_peered":"2024-04-18T04:45:11.048818+0000","last_clean":"2024-04-18T04:45:11.048818+0000","last_became_active":"2024-04-18T04:44:30.300303+0000","last_became_peered":"2024-04-18T04:44:30.300303+0000","last_unstale":"2024-04-18T04:45:11.048818+0000","last_undegraded":"2024-04-18T04:45:11.048818+0000","last_fullsized":"2024-04-18T04:45:11.048818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:24:11.941483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.048428+0000","last_change":"2024-04-18T04:44:34.327044+0000","last_active":"2024-04-18T04:45:11.048428+0000","last_peered":"2024-04-18T04:45:11.048428+0000","last_clean":"2024-04-18T04:45:11.048428+0000","last_became_active":"2024-04-18T04:44:34.326161+0000","last_became_peered":"2024-04-18T04:44:34.326161+0000","last_unstale":"2024-04-18T04:45:11.048428+0000","last_undegraded":"2024-04-18T04:45:11.048428+0000","last_fullsized":"2024-04-18T04:45:11.048428+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:47:41.413530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.037314+0000","last_change":"2024-04-18T04:44:30.296493+0000","last_active":"2024-04-18T04:45:11.037314+0000","last_peered":"2024-04-18T04:45:11.037314+0000","last_clean":"2024-04-18T04:45:11.037314+0000","last_became_active":"2024-04-18T04:44:30.295657+0000","last_became_peered":"2024-04-18T04:44:30.295657+0000","last_unstale":"2024-04-18T04:45:11.037314+0000","last_undegraded":"2024-04-18T04:45:11.037314+0000","last_fullsized":"2024-04-18T04:45:11.037314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:39:40.270643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040192+0000","last_change":"2024-04-18T04:44:29.900036+0000","last_active":"2024-04-18T04:45:11.040192+0000","last_peered":"2024-04-18T04:45:11.040192+0000","last_clean":"2024-04-18T04:45:11.040192+0000","last_became_active":"2024-04-18T04:44:29.899402+0000","last_became_peered":"2024-04-18T04:44:29.899402+0000","last_unstale":"2024-04-18T04:45:11.040192+0000","last_undegraded":"2024-04-18T04:45:11.040192+0000","last_fullsized":"2024-04-18T04:45:11.040192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:45:51.681317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.051768+0000","last_change":"2024-04-18T04:44:34.320846+0000","last_active":"2024-04-18T04:45:11.051768+0000","last_peered":"2024-04-18T04:45:11.051768+0000","last_clean":"2024-04-18T04:45:11.051768+0000","last_became_active":"2024-04-18T04:44:34.319868+0000","last_became_peered":"2024-04-18T04:44:34.319868+0000","last_unstale":"2024-04-18T04:45:11.051768+0000","last_undegraded":"2024-04-18T04:45:11.051768+0000","last_fullsized":"2024-04-18T04:45:11.051768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:08:30.863140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.032877+0000","last_change":"2024-04-18T04:44:30.271756+0000","last_active":"2024-04-18T04:45:11.032877+0000","last_peered":"2024-04-18T04:45:11.032877+0000","last_clean":"2024-04-18T04:45:11.032877+0000","last_became_active":"2024-04-18T04:44:30.271420+0000","last_became_peered":"2024-04-18T04:44:30.271420+0000","last_unstale":"2024-04-18T04:45:11.032877+0000","last_undegraded":"2024-04-18T04:45:11.032877+0000","last_fullsized":"2024-04-18T04:45:11.032877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:27:18.559327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"25'1","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.037938+0000","last_change":"2024-04-18T04:44:29.878416+0000","last_active":"2024-04-18T04:45:11.037938+0000","last_peered":"2024-04-18T04:45:11.037938+0000","last_clean":"2024-04-18T04:45:11.037938+0000","last_became_active":"2024-04-18T04:44:29.878139+0000","last_became_peered":"2024-04-18T04:44:29.878139+0000","last_unstale":"2024-04-18T04:45:11.037938+0000","last_undegraded":"2024-04-18T04:45:11.037938+0000","last_fullsized":"2024-04-18T04:45:11.037938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:19:00.769888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.051399+0000","last_change":"2024-04-18T04:44:34.346123+0000","last_active":"2024-04-18T04:45:11.051399+0000","last_peered":"2024-04-18T04:45:11.051399+0000","last_clean":"2024-04-18T04:45:11.051399+0000","last_became_active":"2024-04-18T04:44:34.345267+0000","last_became_peered":"2024-04-18T04:44:34.345267+0000","last_unstale":"2024-04-18T04:45:11.051399+0000","last_undegraded":"2024-04-18T04:45:11.051399+0000","last_fullsized":"2024-04-18T04:45:11.051399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:14:08.078650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.032542+0000","last_change":"2024-04-18T04:44:30.274049+0000","last_active":"2024-04-18T04:45:11.032542+0000","last_peered":"2024-04-18T04:45:11.032542+0000","last_clean":"2024-04-18T04:45:11.032542+0000","last_became_active":"2024-04-18T04:44:30.273752+0000","last_became_peered":"2024-04-18T04:44:30.273752+0000","last_unstale":"2024-04-18T04:45:11.032542+0000","last_undegraded":"2024-04-18T04:45:11.032542+0000","last_fullsized":"2024-04-18T04:45:11.032542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:48:20.479069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.037593+0000","last_change":"2024-04-18T04:44:29.890569+0000","last_active":"2024-04-18T04:45:11.037593+0000","last_peered":"2024-04-18T04:45:11.037593+0000","last_clean":"2024-04-18T04:45:11.037593+0000","last_became_active":"2024-04-18T04:44:29.889684+0000","last_became_peered":"2024-04-18T04:44:29.889684+0000","last_unstale":"2024-04-18T04:45:11.037593+0000","last_undegraded":"2024-04-18T04:45:11.037593+0000","last_fullsized":"2024-04-18T04:45:11.037593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:53:00.230580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.038087+0000","last_change":"2024-04-18T04:44:34.313634+0000","last_active":"2024-04-18T04:45:11.038087+0000","last_peered":"2024-04-18T04:45:11.038087+0000","last_clean":"2024-04-18T04:45:11.038087+0000","last_became_active":"2024-04-18T04:44:34.313161+0000","last_became_peered":"2024-04-18T04:44:34.313161+0000","last_unstale":"2024-04-18T04:45:11.038087+0000","last_undegraded":"2024-04-18T04:45:11.038087+0000","last_fullsized":"2024-04-18T04:45:11.038087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:01:07.805128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.048108+0000","last_change":"2024-04-18T04:44:30.284805+0000","last_active":"2024-04-18T04:45:11.048108+0000","last_peered":"2024-04-18T04:45:11.048108+0000","last_clean":"2024-04-18T04:45:11.048108+0000","last_became_active":"2024-04-18T04:44:30.279238+0000","last_became_peered":"2024-04-18T04:44:30.279238+0000","last_unstale":"2024-04-18T04:45:11.048108+0000","last_undegraded":"2024-04-18T04:45:11.048108+0000","last_fullsized":"2024-04-18T04:45:11.048108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:59:24.067420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.038238+0000","last_change":"2024-04-18T04:44:29.890816+0000","last_active":"2024-04-18T04:45:11.038238+0000","last_peered":"2024-04-18T04:45:11.038238+0000","last_clean":"2024-04-18T04:45:11.038238+0000","last_became_active":"2024-04-18T04:44:29.890272+0000","last_became_peered":"2024-04-18T04:44:29.890272+0000","last_unstale":"2024-04-18T04:45:11.038238+0000","last_undegraded":"2024-04-18T04:45:11.038238+0000","last_fullsized":"2024-04-18T04:45:11.038238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:30:22.614083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.052138+0000","last_change":"2024-04-18T04:44:34.344973+0000","last_active":"2024-04-18T04:45:11.052138+0000","last_peered":"2024-04-18T04:45:11.052138+0000","last_clean":"2024-04-18T04:45:11.052138+0000","last_became_active":"2024-04-18T04:44:34.344007+0000","last_became_peered":"2024-04-18T04:44:34.344007+0000","last_unstale":"2024-04-18T04:45:11.052138+0000","last_undegraded":"2024-04-18T04:45:11.052138+0000","last_fullsized":"2024-04-18T04:45:11.052138+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:56:43.476132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040630+0000","last_change":"2024-04-18T04:44:30.278193+0000","last_active":"2024-04-18T04:45:11.040630+0000","last_peered":"2024-04-18T04:45:11.040630+0000","last_clean":"2024-04-18T04:45:11.040630+0000","last_became_active":"2024-04-18T04:44:30.277916+0000","last_became_peered":"2024-04-18T04:44:30.277916+0000","last_unstale":"2024-04-18T04:45:11.040630+0000","last_undegraded":"2024-04-18T04:45:11.040630+0000","last_fullsized":"2024-04-18T04:45:11.040630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:57:19.783436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.037867+0000","last_change":"2024-04-18T04:44:29.896901+0000","last_active":"2024-04-18T04:45:11.037867+0000","last_peered":"2024-04-18T04:45:11.037867+0000","last_clean":"2024-04-18T04:45:11.037867+0000","last_became_active":"2024-04-18T04:44:29.896392+0000","last_became_peered":"2024-04-18T04:44:29.896392+0000","last_unstale":"2024-04-18T04:45:11.037867+0000","last_undegraded":"2024-04-18T04:45:11.037867+0000","last_fullsized":"2024-04-18T04:45:11.037867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:46:08.869450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.047144+0000","last_change":"2024-04-18T04:44:34.339233+0000","last_active":"2024-04-18T04:45:11.047144+0000","last_peered":"2024-04-18T04:45:11.047144+0000","last_clean":"2024-04-18T04:45:11.047144+0000","last_became_active":"2024-04-18T04:44:34.338294+0000","last_became_peered":"2024-04-18T04:44:34.338294+0000","last_unstale":"2024-04-18T04:45:11.047144+0000","last_undegraded":"2024-04-18T04:45:11.047144+0000","last_fullsized":"2024-04-18T04:45:11.047144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:20:35.738410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T04:45:12.047012+0000","last_change":"2024-04-18T04:45:12.045887+0000","last_active":"2024-04-18T04:45:12.047012+0000","last_peered":"2024-04-18T04:45:12.047012+0000","last_clean":"2024-04-18T04:45:12.047012+0000","last_became_active":"2024-04-18T04:45:12.045671+0000","last_became_peered":"2024-04-18T04:45:12.045671+0000","last_unstale":"2024-04-18T04:45:12.047012+0000","last_undegraded":"2024-04-18T04:45:12.047012+0000","last_fullsized":"2024-04-18T04:45:12.047012+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:22:58.022926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"25'3","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.039099+0000","last_change":"2024-04-18T04:44:29.894503+0000","last_active":"2024-04-18T04:45:11.039099+0000","last_peered":"2024-04-18T04:45:11.039099+0000","last_clean":"2024-04-18T04:45:11.039099+0000","last_became_active":"2024-04-18T04:44:29.894210+0000","last_became_peered":"2024-04-18T04:44:29.894210+0000","last_unstale":"2024-04-18T04:45:11.039099+0000","last_undegraded":"2024-04-18T04:45:11.039099+0000","last_fullsized":"2024-04-18T04:45:11.039099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:14:56.979204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.032183+0000","last_change":"2024-04-18T04:44:34.305652+0000","last_active":"2024-04-18T04:45:11.032183+0000","last_peered":"2024-04-18T04:45:11.032183+0000","last_clean":"2024-04-18T04:45:11.032183+0000","last_became_active":"2024-04-18T04:44:34.305180+0000","last_became_peered":"2024-04-18T04:44:34.305180+0000","last_unstale":"2024-04-18T04:45:11.032183+0000","last_undegraded":"2024-04-18T04:45:11.032183+0000","last_fullsized":"2024-04-18T04:45:11.032183+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:03:10.781821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.038292+0000","last_change":"2024-04-18T04:44:30.267158+0000","last_active":"2024-04-18T04:45:11.038292+0000","last_peered":"2024-04-18T04:45:11.038292+0000","last_clean":"2024-04-18T04:45:11.038292+0000","last_became_active":"2024-04-18T04:44:30.266814+0000","last_became_peered":"2024-04-18T04:44:30.266814+0000","last_unstale":"2024-04-18T04:45:11.038292+0000","last_undegraded":"2024-04-18T04:45:11.038292+0000","last_fullsized":"2024-04-18T04:45:11.038292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:16:02.152817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.042412+0000","last_change":"2024-04-18T04:44:29.898812+0000","last_active":"2024-04-18T04:45:11.042412+0000","last_peered":"2024-04-18T04:45:11.042412+0000","last_clean":"2024-04-18T04:45:11.042412+0000","last_became_active":"2024-04-18T04:44:29.897156+0000","last_became_peered":"2024-04-18T04:44:29.897156+0000","last_unstale":"2024-04-18T04:45:11.042412+0000","last_undegraded":"2024-04-18T04:45:11.042412+0000","last_fullsized":"2024-04-18T04:45:11.042412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:09:47.746394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040150+0000","last_change":"2024-04-18T04:44:34.324721+0000","last_active":"2024-04-18T04:45:11.040150+0000","last_peered":"2024-04-18T04:45:11.040150+0000","last_clean":"2024-04-18T04:45:11.040150+0000","last_became_active":"2024-04-18T04:44:34.322925+0000","last_became_peered":"2024-04-18T04:44:34.322925+0000","last_unstale":"2024-04-18T04:45:11.040150+0000","last_undegraded":"2024-04-18T04:45:11.040150+0000","last_fullsized":"2024-04-18T04:45:11.040150+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:11:59.682230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.048982+0000","last_change":"2024-04-18T04:44:30.281640+0000","last_active":"2024-04-18T04:45:11.048982+0000","last_peered":"2024-04-18T04:45:11.048982+0000","last_clean":"2024-04-18T04:45:11.048982+0000","last_became_active":"2024-04-18T04:44:30.280968+0000","last_became_peered":"2024-04-18T04:44:30.280968+0000","last_unstale":"2024-04-18T04:45:11.048982+0000","last_undegraded":"2024-04-18T04:45:11.048982+0000","last_fullsized":"2024-04-18T04:45:11.048982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:35:20.755711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.038370+0000","last_change":"2024-04-18T04:44:29.882715+0000","last_active":"2024-04-18T04:45:11.038370+0000","last_peered":"2024-04-18T04:45:11.038370+0000","last_clean":"2024-04-18T04:45:11.038370+0000","last_became_active":"2024-04-18T04:44:29.882335+0000","last_became_peered":"2024-04-18T04:44:29.882335+0000","last_unstale":"2024-04-18T04:45:11.038370+0000","last_undegraded":"2024-04-18T04:45:11.038370+0000","last_fullsized":"2024-04-18T04:45:11.038370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:32:59.709151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.037436+0000","last_change":"2024-04-18T04:44:34.325029+0000","last_active":"2024-04-18T04:45:11.037436+0000","last_peered":"2024-04-18T04:45:11.037436+0000","last_clean":"2024-04-18T04:45:11.037436+0000","last_became_active":"2024-04-18T04:44:34.324082+0000","last_became_peered":"2024-04-18T04:44:34.324082+0000","last_unstale":"2024-04-18T04:45:11.037436+0000","last_undegraded":"2024-04-18T04:45:11.037436+0000","last_fullsized":"2024-04-18T04:45:11.037436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:28:10.378037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.050780+0000","last_change":"2024-04-18T04:44:30.276174+0000","last_active":"2024-04-18T04:45:11.050780+0000","last_peered":"2024-04-18T04:45:11.050780+0000","last_clean":"2024-04-18T04:45:11.050780+0000","last_became_active":"2024-04-18T04:44:30.270878+0000","last_became_peered":"2024-04-18T04:44:30.270878+0000","last_unstale":"2024-04-18T04:45:11.050780+0000","last_undegraded":"2024-04-18T04:45:11.050780+0000","last_fullsized":"2024-04-18T04:45:11.050780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:35:12.296277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"25'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.048628+0000","last_change":"2024-04-18T04:44:29.896745+0000","last_active":"2024-04-18T04:45:11.048628+0000","last_peered":"2024-04-18T04:45:11.048628+0000","last_clean":"2024-04-18T04:45:11.048628+0000","last_became_active":"2024-04-18T04:44:29.896199+0000","last_became_peered":"2024-04-18T04:44:29.896199+0000","last_unstale":"2024-04-18T04:45:11.048628+0000","last_undegraded":"2024-04-18T04:45:11.048628+0000","last_fullsized":"2024-04-18T04:45:11.048628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:25:05.424668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.038216+0000","last_change":"2024-04-18T04:44:34.337429+0000","last_active":"2024-04-18T04:45:11.038216+0000","last_peered":"2024-04-18T04:45:11.038216+0000","last_clean":"2024-04-18T04:45:11.038216+0000","last_became_active":"2024-04-18T04:44:34.337089+0000","last_became_peered":"2024-04-18T04:44:34.337089+0000","last_unstale":"2024-04-18T04:45:11.038216+0000","last_undegraded":"2024-04-18T04:45:11.038216+0000","last_fullsized":"2024-04-18T04:45:11.038216+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:00:56.976431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.037512+0000","last_change":"2024-04-18T04:44:30.270874+0000","last_active":"2024-04-18T04:45:11.037512+0000","last_peered":"2024-04-18T04:45:11.037512+0000","last_clean":"2024-04-18T04:45:11.037512+0000","last_became_active":"2024-04-18T04:44:30.270636+0000","last_became_peered":"2024-04-18T04:44:30.270636+0000","last_unstale":"2024-04-18T04:45:11.037512+0000","last_undegraded":"2024-04-18T04:45:11.037512+0000","last_fullsized":"2024-04-18T04:45:11.037512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:25:49.889554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"25'4","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.035662+0000","last_change":"2024-04-18T04:44:29.878607+0000","last_active":"2024-04-18T04:45:11.035662+0000","last_peered":"2024-04-18T04:45:11.035662+0000","last_clean":"2024-04-18T04:45:11.035662+0000","last_became_active":"2024-04-18T04:44:29.878330+0000","last_became_peered":"2024-04-18T04:44:29.878330+0000","last_unstale":"2024-04-18T04:45:11.035662+0000","last_undegraded":"2024-04-18T04:45:11.035662+0000","last_fullsized":"2024-04-18T04:45:11.035662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:09:18.088701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.038115+0000","last_change":"2024-04-18T04:44:34.323315+0000","last_active":"2024-04-18T04:45:11.038115+0000","last_peered":"2024-04-18T04:45:11.038115+0000","last_clean":"2024-04-18T04:45:11.038115+0000","last_became_active":"2024-04-18T04:44:34.322983+0000","last_became_peered":"2024-04-18T04:44:34.322983+0000","last_unstale":"2024-04-18T04:45:11.038115+0000","last_undegraded":"2024-04-18T04:45:11.038115+0000","last_fullsized":"2024-04-18T04:45:11.038115+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:48:12.803273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.039727+0000","last_change":"2024-04-18T04:44:30.285533+0000","last_active":"2024-04-18T04:45:11.039727+0000","last_peered":"2024-04-18T04:45:11.039727+0000","last_clean":"2024-04-18T04:45:11.039727+0000","last_became_active":"2024-04-18T04:44:30.285113+0000","last_became_peered":"2024-04-18T04:44:30.285113+0000","last_unstale":"2024-04-18T04:45:11.039727+0000","last_undegraded":"2024-04-18T04:45:11.039727+0000","last_fullsized":"2024-04-18T04:45:11.039727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:37:20.367349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"25'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.038377+0000","last_change":"2024-04-18T04:44:29.890701+0000","last_active":"2024-04-18T04:45:11.038377+0000","last_peered":"2024-04-18T04:45:11.038377+0000","last_clean":"2024-04-18T04:45:11.038377+0000","last_became_active":"2024-04-18T04:44:29.890207+0000","last_became_peered":"2024-04-18T04:44:29.890207+0000","last_unstale":"2024-04-18T04:45:11.038377+0000","last_undegraded":"2024-04-18T04:45:11.038377+0000","last_fullsized":"2024-04-18T04:45:11.038377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:06:58.470725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T04:45:12.378646+0000","last_change":"2024-04-18T04:45:12.378646+0000","last_active":"2024-04-18T04:45:12.378646+0000","last_peered":"2024-04-18T04:45:12.378646+0000","last_clean":"2024-04-18T04:45:12.378646+0000","last_became_active":"2024-04-18T04:45:12.378263+0000","last_became_peered":"2024-04-18T04:45:12.378263+0000","last_unstale":"2024-04-18T04:45:12.378646+0000","last_undegraded":"2024-04-18T04:45:12.378646+0000","last_fullsized":"2024-04-18T04:45:12.378646+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:59:31.439452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.032623+0000","last_change":"2024-04-18T04:44:30.306826+0000","last_active":"2024-04-18T04:45:11.032623+0000","last_peered":"2024-04-18T04:45:11.032623+0000","last_clean":"2024-04-18T04:45:11.032623+0000","last_became_active":"2024-04-18T04:44:30.306320+0000","last_became_peered":"2024-04-18T04:44:30.306320+0000","last_unstale":"2024-04-18T04:45:11.032623+0000","last_undegraded":"2024-04-18T04:45:11.032623+0000","last_fullsized":"2024-04-18T04:45:11.032623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:47:38.564197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"25'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.046193+0000","last_change":"2024-04-18T04:44:29.888023+0000","last_active":"2024-04-18T04:45:11.046193+0000","last_peered":"2024-04-18T04:45:11.046193+0000","last_clean":"2024-04-18T04:45:11.046193+0000","last_became_active":"2024-04-18T04:44:29.887440+0000","last_became_peered":"2024-04-18T04:44:29.887440+0000","last_unstale":"2024-04-18T04:45:11.046193+0000","last_undegraded":"2024-04-18T04:45:11.046193+0000","last_fullsized":"2024-04-18T04:45:11.046193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:07:01.067445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.038470+0000","last_change":"2024-04-18T04:44:18.629794+0000","last_active":"2024-04-18T04:45:11.038470+0000","last_peered":"2024-04-18T04:45:11.038470+0000","last_clean":"2024-04-18T04:45:11.038470+0000","last_became_active":"2024-04-18T04:44:18.627792+0000","last_became_peered":"2024-04-18T04:44:18.627792+0000","last_unstale":"2024-04-18T04:45:11.038470+0000","last_undegraded":"2024-04-18T04:45:11.038470+0000","last_fullsized":"2024-04-18T04:45:11.038470+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:17.410146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:17.410146+0000","last_clean_scrub_stamp":"2024-04-18T04:44:17.410146+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:30:49.101656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.039415+0000","last_change":"2024-04-18T04:44:34.333286+0000","last_active":"2024-04-18T04:45:11.039415+0000","last_peered":"2024-04-18T04:45:11.039415+0000","last_clean":"2024-04-18T04:45:11.039415+0000","last_became_active":"2024-04-18T04:44:34.332520+0000","last_became_peered":"2024-04-18T04:44:34.332520+0000","last_unstale":"2024-04-18T04:45:11.039415+0000","last_undegraded":"2024-04-18T04:45:11.039415+0000","last_fullsized":"2024-04-18T04:45:11.039415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:58:48.264040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.041500+0000","last_change":"2024-04-18T04:44:30.303602+0000","last_active":"2024-04-18T04:45:11.041500+0000","last_peered":"2024-04-18T04:45:11.041500+0000","last_clean":"2024-04-18T04:45:11.041500+0000","last_became_active":"2024-04-18T04:44:30.302157+0000","last_became_peered":"2024-04-18T04:44:30.302157+0000","last_unstale":"2024-04-18T04:45:11.041500+0000","last_undegraded":"2024-04-18T04:45:11.041500+0000","last_fullsized":"2024-04-18T04:45:11.041500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:09:57.582065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"25'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.035979+0000","last_change":"2024-04-18T04:44:29.890428+0000","last_active":"2024-04-18T04:45:11.035979+0000","last_peered":"2024-04-18T04:45:11.035979+0000","last_clean":"2024-04-18T04:45:11.035979+0000","last_became_active":"2024-04-18T04:44:29.890166+0000","last_became_peered":"2024-04-18T04:44:29.890166+0000","last_unstale":"2024-04-18T04:45:11.035979+0000","last_undegraded":"2024-04-18T04:45:11.035979+0000","last_fullsized":"2024-04-18T04:45:11.035979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:21:16.823377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.037062+0000","last_change":"2024-04-18T04:44:34.334071+0000","last_active":"2024-04-18T04:45:11.037062+0000","last_peered":"2024-04-18T04:45:11.037062+0000","last_clean":"2024-04-18T04:45:11.037062+0000","last_became_active":"2024-04-18T04:44:34.332695+0000","last_became_peered":"2024-04-18T04:44:34.332695+0000","last_unstale":"2024-04-18T04:45:11.037062+0000","last_undegraded":"2024-04-18T04:45:11.037062+0000","last_fullsized":"2024-04-18T04:45:11.037062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:22:52.371921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.048836+0000","last_change":"2024-04-18T04:44:30.287908+0000","last_active":"2024-04-18T04:45:11.048836+0000","last_peered":"2024-04-18T04:45:11.048836+0000","last_clean":"2024-04-18T04:45:11.048836+0000","last_became_active":"2024-04-18T04:44:30.287217+0000","last_became_peered":"2024-04-18T04:44:30.287217+0000","last_unstale":"2024-04-18T04:45:11.048836+0000","last_undegraded":"2024-04-18T04:45:11.048836+0000","last_fullsized":"2024-04-18T04:45:11.048836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:47:14.962330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.038311+0000","last_change":"2024-04-18T04:44:29.886376+0000","last_active":"2024-04-18T04:45:11.038311+0000","last_peered":"2024-04-18T04:45:11.038311+0000","last_clean":"2024-04-18T04:45:11.038311+0000","last_became_active":"2024-04-18T04:44:29.886058+0000","last_became_peered":"2024-04-18T04:44:29.886058+0000","last_unstale":"2024-04-18T04:45:11.038311+0000","last_undegraded":"2024-04-18T04:45:11.038311+0000","last_fullsized":"2024-04-18T04:45:11.038311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:29:59.678071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T04:45:12.373987+0000","last_change":"2024-04-18T04:45:12.373987+0000","last_active":"2024-04-18T04:45:12.373987+0000","last_peered":"2024-04-18T04:45:12.373987+0000","last_clean":"2024-04-18T04:45:12.373987+0000","last_became_active":"2024-04-18T04:45:12.373269+0000","last_became_peered":"2024-04-18T04:45:12.373269+0000","last_unstale":"2024-04-18T04:45:12.373987+0000","last_undegraded":"2024-04-18T04:45:12.373987+0000","last_fullsized":"2024-04-18T04:45:12.373987+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:19:01.073786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T04:45:12.046573+0000","last_change":"2024-04-18T04:45:12.043098+0000","last_active":"2024-04-18T04:45:12.046573+0000","last_peered":"2024-04-18T04:45:12.046573+0000","last_clean":"2024-04-18T04:45:12.046573+0000","last_became_active":"2024-04-18T04:45:12.042803+0000","last_became_peered":"2024-04-18T04:45:12.042803+0000","last_unstale":"2024-04-18T04:45:12.046573+0000","last_undegraded":"2024-04-18T04:45:12.046573+0000","last_fullsized":"2024-04-18T04:45:12.046573+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:15:13.837607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.036150+0000","last_change":"2024-04-18T04:44:29.878650+0000","last_active":"2024-04-18T04:45:11.036150+0000","last_peered":"2024-04-18T04:45:11.036150+0000","last_clean":"2024-04-18T04:45:11.036150+0000","last_became_active":"2024-04-18T04:44:29.878361+0000","last_became_peered":"2024-04-18T04:44:29.878361+0000","last_unstale":"2024-04-18T04:45:11.036150+0000","last_undegraded":"2024-04-18T04:45:11.036150+0000","last_fullsized":"2024-04-18T04:45:11.036150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:57:41.162118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.044110+0000","last_change":"2024-04-18T04:44:34.339023+0000","last_active":"2024-04-18T04:45:11.044110+0000","last_peered":"2024-04-18T04:45:11.044110+0000","last_clean":"2024-04-18T04:45:11.044110+0000","last_became_active":"2024-04-18T04:44:34.338042+0000","last_became_peered":"2024-04-18T04:44:34.338042+0000","last_unstale":"2024-04-18T04:45:11.044110+0000","last_undegraded":"2024-04-18T04:45:11.044110+0000","last_fullsized":"2024-04-18T04:45:11.044110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:48:58.174635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.042856+0000","last_change":"2024-04-18T04:44:30.291740+0000","last_active":"2024-04-18T04:45:11.042856+0000","last_peered":"2024-04-18T04:45:11.042856+0000","last_clean":"2024-04-18T04:45:11.042856+0000","last_became_active":"2024-04-18T04:44:30.290379+0000","last_became_peered":"2024-04-18T04:44:30.290379+0000","last_unstale":"2024-04-18T04:45:11.042856+0000","last_undegraded":"2024-04-18T04:45:11.042856+0000","last_fullsized":"2024-04-18T04:45:11.042856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:44:25.111858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'2","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T04:45:12.041554+0000","last_change":"2024-04-18T04:44:29.882833+0000","last_active":"2024-04-18T04:45:12.041554+0000","last_peered":"2024-04-18T04:45:12.041554+0000","last_clean":"2024-04-18T04:45:12.041554+0000","last_became_active":"2024-04-18T04:44:29.881671+0000","last_became_peered":"2024-04-18T04:44:29.881671+0000","last_unstale":"2024-04-18T04:45:12.041554+0000","last_undegraded":"2024-04-18T04:45:12.041554+0000","last_fullsized":"2024-04-18T04:45:12.041554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:29:22.037641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.046910+0000","last_change":"2024-04-18T04:44:34.342465+0000","last_active":"2024-04-18T04:45:11.046910+0000","last_peered":"2024-04-18T04:45:11.046910+0000","last_clean":"2024-04-18T04:45:11.046910+0000","last_became_active":"2024-04-18T04:44:34.340327+0000","last_became_peered":"2024-04-18T04:44:34.340327+0000","last_unstale":"2024-04-18T04:45:11.046910+0000","last_undegraded":"2024-04-18T04:45:11.046910+0000","last_fullsized":"2024-04-18T04:45:11.046910+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:31:44.168899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.039103+0000","last_change":"2024-04-18T04:44:30.299403+0000","last_active":"2024-04-18T04:45:11.039103+0000","last_peered":"2024-04-18T04:45:11.039103+0000","last_clean":"2024-04-18T04:45:11.039103+0000","last_became_active":"2024-04-18T04:44:30.298417+0000","last_became_peered":"2024-04-18T04:44:30.298417+0000","last_unstale":"2024-04-18T04:45:11.039103+0000","last_undegraded":"2024-04-18T04:45:11.039103+0000","last_fullsized":"2024-04-18T04:45:11.039103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:43:24.120294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'15","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.035582+0000","last_change":"2024-04-18T04:44:29.875345+0000","last_active":"2024-04-18T04:45:11.035582+0000","last_peered":"2024-04-18T04:45:11.035582+0000","last_clean":"2024-04-18T04:45:11.035582+0000","last_became_active":"2024-04-18T04:44:29.875059+0000","last_became_peered":"2024-04-18T04:44:29.875059+0000","last_unstale":"2024-04-18T04:45:11.035582+0000","last_undegraded":"2024-04-18T04:45:11.035582+0000","last_fullsized":"2024-04-18T04:45:11.035582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:06:54.218096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040511+0000","last_change":"2024-04-18T04:44:34.334498+0000","last_active":"2024-04-18T04:45:11.040511+0000","last_peered":"2024-04-18T04:45:11.040511+0000","last_clean":"2024-04-18T04:45:11.040511+0000","last_became_active":"2024-04-18T04:44:34.334192+0000","last_became_peered":"2024-04-18T04:44:34.334192+0000","last_unstale":"2024-04-18T04:45:11.040511+0000","last_undegraded":"2024-04-18T04:45:11.040511+0000","last_fullsized":"2024-04-18T04:45:11.040511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:15:49.669556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.037340+0000","last_change":"2024-04-18T04:44:30.298289+0000","last_active":"2024-04-18T04:45:11.037340+0000","last_peered":"2024-04-18T04:45:11.037340+0000","last_clean":"2024-04-18T04:45:11.037340+0000","last_became_active":"2024-04-18T04:44:30.295404+0000","last_became_peered":"2024-04-18T04:44:30.295404+0000","last_unstale":"2024-04-18T04:45:11.037340+0000","last_undegraded":"2024-04-18T04:45:11.037340+0000","last_fullsized":"2024-04-18T04:45:11.037340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:10:32.465032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'4","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T04:45:12.053680+0000","last_change":"2024-04-18T04:44:29.894196+0000","last_active":"2024-04-18T04:45:12.053680+0000","last_peered":"2024-04-18T04:45:12.053680+0000","last_clean":"2024-04-18T04:45:12.053680+0000","last_became_active":"2024-04-18T04:44:29.893668+0000","last_became_peered":"2024-04-18T04:44:29.893668+0000","last_unstale":"2024-04-18T04:45:12.053680+0000","last_undegraded":"2024-04-18T04:45:12.053680+0000","last_fullsized":"2024-04-18T04:45:12.053680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:39:03.812043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":798,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T04:45:12.057192+0000","last_change":"2024-04-18T04:45:12.057192+0000","last_active":"2024-04-18T04:45:12.057192+0000","last_peered":"2024-04-18T04:45:12.057192+0000","last_clean":"2024-04-18T04:45:12.057192+0000","last_became_active":"2024-04-18T04:45:12.056680+0000","last_became_peered":"2024-04-18T04:45:12.056680+0000","last_unstale":"2024-04-18T04:45:12.057192+0000","last_undegraded":"2024-04-18T04:45:12.057192+0000","last_fullsized":"2024-04-18T04:45:12.057192+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:48:07.893811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.039974+0000","last_change":"2024-04-18T04:44:30.289122+0000","last_active":"2024-04-18T04:45:11.039974+0000","last_peered":"2024-04-18T04:45:11.039974+0000","last_clean":"2024-04-18T04:45:11.039974+0000","last_became_active":"2024-04-18T04:44:30.288364+0000","last_became_peered":"2024-04-18T04:44:30.288364+0000","last_unstale":"2024-04-18T04:45:11.039974+0000","last_undegraded":"2024-04-18T04:45:11.039974+0000","last_fullsized":"2024-04-18T04:45:11.039974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:04:02.162723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.048354+0000","last_change":"2024-04-18T04:44:29.894521+0000","last_active":"2024-04-18T04:45:11.048354+0000","last_peered":"2024-04-18T04:45:11.048354+0000","last_clean":"2024-04-18T04:45:11.048354+0000","last_became_active":"2024-04-18T04:44:29.889150+0000","last_became_peered":"2024-04-18T04:44:29.889150+0000","last_unstale":"2024-04-18T04:45:11.048354+0000","last_undegraded":"2024-04-18T04:45:11.048354+0000","last_fullsized":"2024-04-18T04:45:11.048354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:39:13.323434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.033184+0000","last_change":"2024-04-18T04:44:34.305657+0000","last_active":"2024-04-18T04:45:11.033184+0000","last_peered":"2024-04-18T04:45:11.033184+0000","last_clean":"2024-04-18T04:45:11.033184+0000","last_became_active":"2024-04-18T04:44:34.305341+0000","last_became_peered":"2024-04-18T04:44:34.305341+0000","last_unstale":"2024-04-18T04:45:11.033184+0000","last_undegraded":"2024-04-18T04:45:11.033184+0000","last_fullsized":"2024-04-18T04:45:11.033184+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:32:39.937173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040473+0000","last_change":"2024-04-18T04:44:30.307042+0000","last_active":"2024-04-18T04:45:11.040473+0000","last_peered":"2024-04-18T04:45:11.040473+0000","last_clean":"2024-04-18T04:45:11.040473+0000","last_became_active":"2024-04-18T04:44:30.306726+0000","last_became_peered":"2024-04-18T04:44:30.306726+0000","last_unstale":"2024-04-18T04:45:11.040473+0000","last_undegraded":"2024-04-18T04:45:11.040473+0000","last_fullsized":"2024-04-18T04:45:11.040473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:55:33.543142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'6","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040640+0000","last_change":"2024-04-18T04:44:29.887498+0000","last_active":"2024-04-18T04:45:11.040640+0000","last_peered":"2024-04-18T04:45:11.040640+0000","last_clean":"2024-04-18T04:45:11.040640+0000","last_became_active":"2024-04-18T04:44:29.887095+0000","last_became_peered":"2024-04-18T04:44:29.887095+0000","last_unstale":"2024-04-18T04:45:11.040640+0000","last_undegraded":"2024-04-18T04:45:11.040640+0000","last_fullsized":"2024-04-18T04:45:11.040640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:54:34.700562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.048646+0000","last_change":"2024-04-18T04:44:34.322042+0000","last_active":"2024-04-18T04:45:11.048646+0000","last_peered":"2024-04-18T04:45:11.048646+0000","last_clean":"2024-04-18T04:45:11.048646+0000","last_became_active":"2024-04-18T04:44:34.320776+0000","last_became_peered":"2024-04-18T04:44:34.320776+0000","last_unstale":"2024-04-18T04:45:11.048646+0000","last_undegraded":"2024-04-18T04:45:11.048646+0000","last_fullsized":"2024-04-18T04:45:11.048646+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:53:47.399337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.041296+0000","last_change":"2024-04-18T04:44:30.299413+0000","last_active":"2024-04-18T04:45:11.041296+0000","last_peered":"2024-04-18T04:45:11.041296+0000","last_clean":"2024-04-18T04:45:11.041296+0000","last_became_active":"2024-04-18T04:44:30.293185+0000","last_became_peered":"2024-04-18T04:44:30.293185+0000","last_unstale":"2024-04-18T04:45:11.041296+0000","last_undegraded":"2024-04-18T04:45:11.041296+0000","last_fullsized":"2024-04-18T04:45:11.041296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:43:53.831429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'11","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.039234+0000","last_change":"2024-04-18T04:44:29.893351+0000","last_active":"2024-04-18T04:45:11.039234+0000","last_peered":"2024-04-18T04:45:11.039234+0000","last_clean":"2024-04-18T04:45:11.039234+0000","last_became_active":"2024-04-18T04:44:29.892647+0000","last_became_peered":"2024-04-18T04:44:29.892647+0000","last_unstale":"2024-04-18T04:45:11.039234+0000","last_undegraded":"2024-04-18T04:45:11.039234+0000","last_fullsized":"2024-04-18T04:45:11.039234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:16:59.759149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3796,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.037810+0000","last_change":"2024-04-18T04:44:34.337866+0000","last_active":"2024-04-18T04:45:11.037810+0000","last_peered":"2024-04-18T04:45:11.037810+0000","last_clean":"2024-04-18T04:45:11.037810+0000","last_became_active":"2024-04-18T04:44:34.337486+0000","last_became_peered":"2024-04-18T04:44:34.337486+0000","last_unstale":"2024-04-18T04:45:11.037810+0000","last_undegraded":"2024-04-18T04:45:11.037810+0000","last_fullsized":"2024-04-18T04:45:11.037810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:42:13.751926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.051884+0000","last_change":"2024-04-18T04:44:30.308477+0000","last_active":"2024-04-18T04:45:11.051884+0000","last_peered":"2024-04-18T04:45:11.051884+0000","last_clean":"2024-04-18T04:45:11.051884+0000","last_became_active":"2024-04-18T04:44:30.307237+0000","last_became_peered":"2024-04-18T04:44:30.307237+0000","last_unstale":"2024-04-18T04:45:11.051884+0000","last_undegraded":"2024-04-18T04:45:11.051884+0000","last_fullsized":"2024-04-18T04:45:11.051884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:33:58.300542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'4","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.038229+0000","last_change":"2024-04-18T04:44:29.898488+0000","last_active":"2024-04-18T04:45:11.038229+0000","last_peered":"2024-04-18T04:45:11.038229+0000","last_clean":"2024-04-18T04:45:11.038229+0000","last_became_active":"2024-04-18T04:44:29.898113+0000","last_became_peered":"2024-04-18T04:44:29.898113+0000","last_unstale":"2024-04-18T04:45:11.038229+0000","last_undegraded":"2024-04-18T04:45:11.038229+0000","last_fullsized":"2024-04-18T04:45:11.038229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:11:14.585142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.049967+0000","last_change":"2024-04-18T04:44:34.344769+0000","last_active":"2024-04-18T04:45:11.049967+0000","last_peered":"2024-04-18T04:45:11.049967+0000","last_clean":"2024-04-18T04:45:11.049967+0000","last_became_active":"2024-04-18T04:44:34.343636+0000","last_became_peered":"2024-04-18T04:44:34.343636+0000","last_unstale":"2024-04-18T04:45:11.049967+0000","last_undegraded":"2024-04-18T04:45:11.049967+0000","last_fullsized":"2024-04-18T04:45:11.049967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:45:09.481681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040252+0000","last_change":"2024-04-18T04:44:30.290494+0000","last_active":"2024-04-18T04:45:11.040252+0000","last_peered":"2024-04-18T04:45:11.040252+0000","last_clean":"2024-04-18T04:45:11.040252+0000","last_became_active":"2024-04-18T04:44:30.290127+0000","last_became_peered":"2024-04-18T04:44:30.290127+0000","last_unstale":"2024-04-18T04:45:11.040252+0000","last_undegraded":"2024-04-18T04:45:11.040252+0000","last_fullsized":"2024-04-18T04:45:11.040252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:34:21.239813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"25'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.049243+0000","last_change":"2024-04-18T04:44:29.895686+0000","last_active":"2024-04-18T04:45:11.049243+0000","last_peered":"2024-04-18T04:45:11.049243+0000","last_clean":"2024-04-18T04:45:11.049243+0000","last_became_active":"2024-04-18T04:44:29.895083+0000","last_became_peered":"2024-04-18T04:44:29.895083+0000","last_unstale":"2024-04-18T04:45:11.049243+0000","last_undegraded":"2024-04-18T04:45:11.049243+0000","last_fullsized":"2024-04-18T04:45:11.049243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:27:17.897401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.032344+0000","last_change":"2024-04-18T04:44:34.338412+0000","last_active":"2024-04-18T04:45:11.032344+0000","last_peered":"2024-04-18T04:45:11.032344+0000","last_clean":"2024-04-18T04:45:11.032344+0000","last_became_active":"2024-04-18T04:44:34.338062+0000","last_became_peered":"2024-04-18T04:44:34.338062+0000","last_unstale":"2024-04-18T04:45:11.032344+0000","last_undegraded":"2024-04-18T04:45:11.032344+0000","last_fullsized":"2024-04-18T04:45:11.032344+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:49:28.342905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.049013+0000","last_change":"2024-04-18T04:44:30.307946+0000","last_active":"2024-04-18T04:45:11.049013+0000","last_peered":"2024-04-18T04:45:11.049013+0000","last_clean":"2024-04-18T04:45:11.049013+0000","last_became_active":"2024-04-18T04:44:30.307168+0000","last_became_peered":"2024-04-18T04:44:30.307168+0000","last_unstale":"2024-04-18T04:45:11.049013+0000","last_undegraded":"2024-04-18T04:45:11.049013+0000","last_fullsized":"2024-04-18T04:45:11.049013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:43:56.218333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"25'3","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.037172+0000","last_change":"2024-04-18T04:44:29.903183+0000","last_active":"2024-04-18T04:45:11.037172+0000","last_peered":"2024-04-18T04:45:11.037172+0000","last_clean":"2024-04-18T04:45:11.037172+0000","last_became_active":"2024-04-18T04:44:29.902647+0000","last_became_peered":"2024-04-18T04:44:29.902647+0000","last_unstale":"2024-04-18T04:45:11.037172+0000","last_undegraded":"2024-04-18T04:45:11.037172+0000","last_fullsized":"2024-04-18T04:45:11.037172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:45:13.009571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.032335+0000","last_change":"2024-04-18T04:44:34.338653+0000","last_active":"2024-04-18T04:45:11.032335+0000","last_peered":"2024-04-18T04:45:11.032335+0000","last_clean":"2024-04-18T04:45:11.032335+0000","last_became_active":"2024-04-18T04:44:34.338288+0000","last_became_peered":"2024-04-18T04:44:34.338288+0000","last_unstale":"2024-04-18T04:45:11.032335+0000","last_undegraded":"2024-04-18T04:45:11.032335+0000","last_fullsized":"2024-04-18T04:45:11.032335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:58:27.654288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040403+0000","last_change":"2024-04-18T04:44:34.306999+0000","last_active":"2024-04-18T04:45:11.040403+0000","last_peered":"2024-04-18T04:45:11.040403+0000","last_clean":"2024-04-18T04:45:11.040403+0000","last_became_active":"2024-04-18T04:44:34.306657+0000","last_became_peered":"2024-04-18T04:44:34.306657+0000","last_unstale":"2024-04-18T04:45:11.040403+0000","last_undegraded":"2024-04-18T04:45:11.040403+0000","last_fullsized":"2024-04-18T04:45:11.040403+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:52:58.512928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.037436+0000","last_change":"2024-04-18T04:44:30.271947+0000","last_active":"2024-04-18T04:45:11.037436+0000","last_peered":"2024-04-18T04:45:11.037436+0000","last_clean":"2024-04-18T04:45:11.037436+0000","last_became_active":"2024-04-18T04:44:30.271619+0000","last_became_peered":"2024-04-18T04:44:30.271619+0000","last_unstale":"2024-04-18T04:45:11.037436+0000","last_undegraded":"2024-04-18T04:45:11.037436+0000","last_fullsized":"2024-04-18T04:45:11.037436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:32:11.612016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.045479+0000","last_change":"2024-04-18T04:44:29.897616+0000","last_active":"2024-04-18T04:45:11.045479+0000","last_peered":"2024-04-18T04:45:11.045479+0000","last_clean":"2024-04-18T04:45:11.045479+0000","last_became_active":"2024-04-18T04:44:29.889922+0000","last_became_peered":"2024-04-18T04:44:29.889922+0000","last_unstale":"2024-04-18T04:45:11.045479+0000","last_undegraded":"2024-04-18T04:45:11.045479+0000","last_fullsized":"2024-04-18T04:45:11.045479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:11:52.717768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.036613+0000","last_change":"2024-04-18T04:44:34.333403+0000","last_active":"2024-04-18T04:45:11.036613+0000","last_peered":"2024-04-18T04:45:11.036613+0000","last_clean":"2024-04-18T04:45:11.036613+0000","last_became_active":"2024-04-18T04:44:34.332551+0000","last_became_peered":"2024-04-18T04:44:34.332551+0000","last_unstale":"2024-04-18T04:45:11.036613+0000","last_undegraded":"2024-04-18T04:45:11.036613+0000","last_fullsized":"2024-04-18T04:45:11.036613+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:33:28.594002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.032463+0000","last_change":"2024-04-18T04:44:30.271099+0000","last_active":"2024-04-18T04:45:11.032463+0000","last_peered":"2024-04-18T04:45:11.032463+0000","last_clean":"2024-04-18T04:45:11.032463+0000","last_became_active":"2024-04-18T04:44:30.270804+0000","last_became_peered":"2024-04-18T04:44:30.270804+0000","last_unstale":"2024-04-18T04:45:11.032463+0000","last_undegraded":"2024-04-18T04:45:11.032463+0000","last_fullsized":"2024-04-18T04:45:11.032463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:18:27.955171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"25'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.032498+0000","last_change":"2024-04-18T04:44:29.895084+0000","last_active":"2024-04-18T04:45:11.032498+0000","last_peered":"2024-04-18T04:45:11.032498+0000","last_clean":"2024-04-18T04:45:11.032498+0000","last_became_active":"2024-04-18T04:44:29.894829+0000","last_became_peered":"2024-04-18T04:44:29.894829+0000","last_unstale":"2024-04-18T04:45:11.032498+0000","last_undegraded":"2024-04-18T04:45:11.032498+0000","last_fullsized":"2024-04-18T04:45:11.032498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:54.812428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'3","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.037746+0000","last_change":"2024-04-18T04:44:29.892826+0000","last_active":"2024-04-18T04:45:11.037746+0000","last_peered":"2024-04-18T04:45:11.037746+0000","last_clean":"2024-04-18T04:45:11.037746+0000","last_became_active":"2024-04-18T04:44:29.892282+0000","last_became_peered":"2024-04-18T04:44:29.892282+0000","last_unstale":"2024-04-18T04:45:11.037746+0000","last_undegraded":"2024-04-18T04:45:11.037746+0000","last_fullsized":"2024-04-18T04:45:11.037746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:02.844116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040554+0000","last_change":"2024-04-18T04:44:30.285312+0000","last_active":"2024-04-18T04:45:11.040554+0000","last_peered":"2024-04-18T04:45:11.040554+0000","last_clean":"2024-04-18T04:45:11.040554+0000","last_became_active":"2024-04-18T04:44:30.285055+0000","last_became_peered":"2024-04-18T04:44:30.285055+0000","last_unstale":"2024-04-18T04:45:11.040554+0000","last_undegraded":"2024-04-18T04:45:11.040554+0000","last_fullsized":"2024-04-18T04:45:11.040554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:50:00.641018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.035771+0000","last_change":"2024-04-18T04:44:34.323352+0000","last_active":"2024-04-18T04:45:11.035771+0000","last_peered":"2024-04-18T04:45:11.035771+0000","last_clean":"2024-04-18T04:45:11.035771+0000","last_became_active":"2024-04-18T04:44:34.321645+0000","last_became_peered":"2024-04-18T04:44:34.321645+0000","last_unstale":"2024-04-18T04:45:11.035771+0000","last_undegraded":"2024-04-18T04:45:11.035771+0000","last_fullsized":"2024-04-18T04:45:11.035771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:33:27.387013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.033447+0000","last_change":"2024-04-18T04:44:29.891865+0000","last_active":"2024-04-18T04:45:11.033447+0000","last_peered":"2024-04-18T04:45:11.033447+0000","last_clean":"2024-04-18T04:45:11.033447+0000","last_became_active":"2024-04-18T04:44:29.891610+0000","last_became_peered":"2024-04-18T04:44:29.891610+0000","last_unstale":"2024-04-18T04:45:11.033447+0000","last_undegraded":"2024-04-18T04:45:11.033447+0000","last_fullsized":"2024-04-18T04:45:11.033447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:36:42.266497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.049770+0000","last_change":"2024-04-18T04:44:30.279080+0000","last_active":"2024-04-18T04:45:11.049770+0000","last_peered":"2024-04-18T04:45:11.049770+0000","last_clean":"2024-04-18T04:45:11.049770+0000","last_became_active":"2024-04-18T04:44:30.278275+0000","last_became_peered":"2024-04-18T04:44:30.278275+0000","last_unstale":"2024-04-18T04:45:11.049770+0000","last_undegraded":"2024-04-18T04:45:11.049770+0000","last_fullsized":"2024-04-18T04:45:11.049770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:51:48.272703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.032843+0000","last_change":"2024-04-18T04:44:34.313835+0000","last_active":"2024-04-18T04:45:11.032843+0000","last_peered":"2024-04-18T04:45:11.032843+0000","last_clean":"2024-04-18T04:45:11.032843+0000","last_became_active":"2024-04-18T04:44:34.313416+0000","last_became_peered":"2024-04-18T04:44:34.313416+0000","last_unstale":"2024-04-18T04:45:11.032843+0000","last_undegraded":"2024-04-18T04:45:11.032843+0000","last_fullsized":"2024-04-18T04:45:11.032843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:57:47.245809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.036965+0000","last_change":"2024-04-18T04:44:30.297229+0000","last_active":"2024-04-18T04:45:11.036965+0000","last_peered":"2024-04-18T04:45:11.036965+0000","last_clean":"2024-04-18T04:45:11.036965+0000","last_became_active":"2024-04-18T04:44:30.296354+0000","last_became_peered":"2024-04-18T04:44:30.296354+0000","last_unstale":"2024-04-18T04:45:11.036965+0000","last_undegraded":"2024-04-18T04:45:11.036965+0000","last_fullsized":"2024-04-18T04:45:11.036965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:30:35.845106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.035644+0000","last_change":"2024-04-18T04:44:30.281213+0000","last_active":"2024-04-18T04:45:11.035644+0000","last_peered":"2024-04-18T04:45:11.035644+0000","last_clean":"2024-04-18T04:45:11.035644+0000","last_became_active":"2024-04-18T04:44:30.280941+0000","last_became_peered":"2024-04-18T04:44:30.280941+0000","last_unstale":"2024-04-18T04:45:11.035644+0000","last_undegraded":"2024-04-18T04:45:11.035644+0000","last_fullsized":"2024-04-18T04:45:11.035644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:15:37.795670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.048113+0000","last_change":"2024-04-18T04:44:30.288507+0000","last_active":"2024-04-18T04:45:11.048113+0000","last_peered":"2024-04-18T04:45:11.048113+0000","last_clean":"2024-04-18T04:45:11.048113+0000","last_became_active":"2024-04-18T04:44:30.287820+0000","last_became_peered":"2024-04-18T04:44:30.287820+0000","last_unstale":"2024-04-18T04:45:11.048113+0000","last_undegraded":"2024-04-18T04:45:11.048113+0000","last_fullsized":"2024-04-18T04:45:11.048113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:25:29.500586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040472+0000","last_change":"2024-04-18T04:44:30.273278+0000","last_active":"2024-04-18T04:45:11.040472+0000","last_peered":"2024-04-18T04:45:11.040472+0000","last_clean":"2024-04-18T04:45:11.040472+0000","last_became_active":"2024-04-18T04:44:30.272973+0000","last_became_peered":"2024-04-18T04:44:30.272973+0000","last_unstale":"2024-04-18T04:45:11.040472+0000","last_undegraded":"2024-04-18T04:45:11.040472+0000","last_fullsized":"2024-04-18T04:45:11.040472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:37:02.421925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.033267+0000","last_change":"2024-04-18T04:44:30.298936+0000","last_active":"2024-04-18T04:45:11.033267+0000","last_peered":"2024-04-18T04:45:11.033267+0000","last_clean":"2024-04-18T04:45:11.033267+0000","last_became_active":"2024-04-18T04:44:30.298637+0000","last_became_peered":"2024-04-18T04:44:30.298637+0000","last_unstale":"2024-04-18T04:45:11.033267+0000","last_undegraded":"2024-04-18T04:45:11.033267+0000","last_fullsized":"2024-04-18T04:45:11.033267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:04:33.188772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.038089+0000","last_change":"2024-04-18T04:44:30.274613+0000","last_active":"2024-04-18T04:45:11.038089+0000","last_peered":"2024-04-18T04:45:11.038089+0000","last_clean":"2024-04-18T04:45:11.038089+0000","last_became_active":"2024-04-18T04:44:30.274328+0000","last_became_peered":"2024-04-18T04:44:30.274328+0000","last_unstale":"2024-04-18T04:45:11.038089+0000","last_undegraded":"2024-04-18T04:45:11.038089+0000","last_fullsized":"2024-04-18T04:45:11.038089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:55:41.700955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040493+0000","last_change":"2024-04-18T04:44:30.309403+0000","last_active":"2024-04-18T04:45:11.040493+0000","last_peered":"2024-04-18T04:45:11.040493+0000","last_clean":"2024-04-18T04:45:11.040493+0000","last_became_active":"2024-04-18T04:44:30.308415+0000","last_became_peered":"2024-04-18T04:44:30.308415+0000","last_unstale":"2024-04-18T04:45:11.040493+0000","last_undegraded":"2024-04-18T04:45:11.040493+0000","last_fullsized":"2024-04-18T04:45:11.040493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:51:58.935503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.033484+0000","last_change":"2024-04-18T04:44:30.293996+0000","last_active":"2024-04-18T04:45:11.033484+0000","last_peered":"2024-04-18T04:45:11.033484+0000","last_clean":"2024-04-18T04:45:11.033484+0000","last_became_active":"2024-04-18T04:44:30.293748+0000","last_became_peered":"2024-04-18T04:44:30.293748+0000","last_unstale":"2024-04-18T04:45:11.033484+0000","last_undegraded":"2024-04-18T04:45:11.033484+0000","last_fullsized":"2024-04-18T04:45:11.033484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:18:32.116499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T04:45:12.043771+0000","last_change":"2024-04-18T04:45:12.040362+0000","last_active":"2024-04-18T04:45:12.043771+0000","last_peered":"2024-04-18T04:45:12.043771+0000","last_clean":"2024-04-18T04:45:12.043771+0000","last_became_active":"2024-04-18T04:45:12.040045+0000","last_became_peered":"2024-04-18T04:45:12.040045+0000","last_unstale":"2024-04-18T04:45:12.043771+0000","last_undegraded":"2024-04-18T04:45:12.043771+0000","last_fullsized":"2024-04-18T04:45:12.043771+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:18:21.482610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.032447+0000","last_change":"2024-04-18T04:44:30.285836+0000","last_active":"2024-04-18T04:45:11.032447+0000","last_peered":"2024-04-18T04:45:11.032447+0000","last_clean":"2024-04-18T04:45:11.032447+0000","last_became_active":"2024-04-18T04:44:30.285602+0000","last_became_peered":"2024-04-18T04:44:30.285602+0000","last_unstale":"2024-04-18T04:45:11.032447+0000","last_undegraded":"2024-04-18T04:45:11.032447+0000","last_fullsized":"2024-04-18T04:45:11.032447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:34:39.594780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T04:45:12.044206+0000","last_change":"2024-04-18T04:45:12.040347+0000","last_active":"2024-04-18T04:45:12.044206+0000","last_peered":"2024-04-18T04:45:12.044206+0000","last_clean":"2024-04-18T04:45:12.044206+0000","last_became_active":"2024-04-18T04:45:12.040023+0000","last_became_peered":"2024-04-18T04:45:12.040023+0000","last_unstale":"2024-04-18T04:45:12.044206+0000","last_undegraded":"2024-04-18T04:45:12.044206+0000","last_fullsized":"2024-04-18T04:45:12.044206+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:24.207082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040230+0000","last_change":"2024-04-18T04:44:30.310229+0000","last_active":"2024-04-18T04:45:11.040230+0000","last_peered":"2024-04-18T04:45:11.040230+0000","last_clean":"2024-04-18T04:45:11.040230+0000","last_became_active":"2024-04-18T04:44:30.310045+0000","last_became_peered":"2024-04-18T04:44:30.310045+0000","last_unstale":"2024-04-18T04:45:11.040230+0000","last_undegraded":"2024-04-18T04:45:11.040230+0000","last_fullsized":"2024-04-18T04:45:11.040230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:22:55.588300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.039012+0000","last_change":"2024-04-18T04:44:30.305644+0000","last_active":"2024-04-18T04:45:11.039012+0000","last_peered":"2024-04-18T04:45:11.039012+0000","last_clean":"2024-04-18T04:45:11.039012+0000","last_became_active":"2024-04-18T04:44:30.304921+0000","last_became_peered":"2024-04-18T04:44:30.304921+0000","last_unstale":"2024-04-18T04:45:11.039012+0000","last_undegraded":"2024-04-18T04:45:11.039012+0000","last_fullsized":"2024-04-18T04:45:11.039012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:17:37.235711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.042156+0000","last_change":"2024-04-18T04:44:30.294105+0000","last_active":"2024-04-18T04:45:11.042156+0000","last_peered":"2024-04-18T04:45:11.042156+0000","last_clean":"2024-04-18T04:45:11.042156+0000","last_became_active":"2024-04-18T04:44:30.291742+0000","last_became_peered":"2024-04-18T04:44:30.291742+0000","last_unstale":"2024-04-18T04:45:11.042156+0000","last_undegraded":"2024-04-18T04:45:11.042156+0000","last_fullsized":"2024-04-18T04:45:11.042156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:43:26.428261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.036089+0000","last_change":"2024-04-18T04:44:30.296496+0000","last_active":"2024-04-18T04:45:11.036089+0000","last_peered":"2024-04-18T04:45:11.036089+0000","last_clean":"2024-04-18T04:45:11.036089+0000","last_became_active":"2024-04-18T04:44:30.296177+0000","last_became_peered":"2024-04-18T04:44:30.296177+0000","last_unstale":"2024-04-18T04:45:11.036089+0000","last_undegraded":"2024-04-18T04:45:11.036089+0000","last_fullsized":"2024-04-18T04:45:11.036089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:46:44.829326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.049700+0000","last_change":"2024-04-18T04:44:30.306568+0000","last_active":"2024-04-18T04:45:11.049700+0000","last_peered":"2024-04-18T04:45:11.049700+0000","last_clean":"2024-04-18T04:45:11.049700+0000","last_became_active":"2024-04-18T04:44:30.305674+0000","last_became_peered":"2024-04-18T04:44:30.305674+0000","last_unstale":"2024-04-18T04:45:11.049700+0000","last_undegraded":"2024-04-18T04:45:11.049700+0000","last_fullsized":"2024-04-18T04:45:11.049700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:58:10.740164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.044497+0000","last_change":"2024-04-18T04:44:30.307297+0000","last_active":"2024-04-18T04:45:11.044497+0000","last_peered":"2024-04-18T04:45:11.044497+0000","last_clean":"2024-04-18T04:45:11.044497+0000","last_became_active":"2024-04-18T04:44:30.305470+0000","last_became_peered":"2024-04-18T04:44:30.305470+0000","last_unstale":"2024-04-18T04:45:11.044497+0000","last_undegraded":"2024-04-18T04:45:11.044497+0000","last_fullsized":"2024-04-18T04:45:11.044497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:01:00.587115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.037512+0000","last_change":"2024-04-18T04:44:30.280849+0000","last_active":"2024-04-18T04:45:11.037512+0000","last_peered":"2024-04-18T04:45:11.037512+0000","last_clean":"2024-04-18T04:45:11.037512+0000","last_became_active":"2024-04-18T04:44:30.280535+0000","last_became_peered":"2024-04-18T04:44:30.280535+0000","last_unstale":"2024-04-18T04:45:11.037512+0000","last_undegraded":"2024-04-18T04:45:11.037512+0000","last_fullsized":"2024-04-18T04:45:11.037512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:01:06.241941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040393+0000","last_change":"2024-04-18T04:44:30.278849+0000","last_active":"2024-04-18T04:45:11.040393+0000","last_peered":"2024-04-18T04:45:11.040393+0000","last_clean":"2024-04-18T04:45:11.040393+0000","last_became_active":"2024-04-18T04:44:30.278624+0000","last_became_peered":"2024-04-18T04:44:30.278624+0000","last_unstale":"2024-04-18T04:45:11.040393+0000","last_undegraded":"2024-04-18T04:45:11.040393+0000","last_fullsized":"2024-04-18T04:45:11.040393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:31:30.791150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.032793+0000","last_change":"2024-04-18T04:44:30.296148+0000","last_active":"2024-04-18T04:45:11.032793+0000","last_peered":"2024-04-18T04:45:11.032793+0000","last_clean":"2024-04-18T04:45:11.032793+0000","last_became_active":"2024-04-18T04:44:30.295754+0000","last_became_peered":"2024-04-18T04:44:30.295754+0000","last_unstale":"2024-04-18T04:45:11.032793+0000","last_undegraded":"2024-04-18T04:45:11.032793+0000","last_fullsized":"2024-04-18T04:45:11.032793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:39:53.809075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.051669+0000","last_change":"2024-04-18T04:44:30.298061+0000","last_active":"2024-04-18T04:45:11.051669+0000","last_peered":"2024-04-18T04:45:11.051669+0000","last_clean":"2024-04-18T04:45:11.051669+0000","last_became_active":"2024-04-18T04:44:30.297416+0000","last_became_peered":"2024-04-18T04:44:30.297416+0000","last_unstale":"2024-04-18T04:45:11.051669+0000","last_undegraded":"2024-04-18T04:45:11.051669+0000","last_fullsized":"2024-04-18T04:45:11.051669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:35:48.612670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.039607+0000","last_change":"2024-04-18T04:44:30.292802+0000","last_active":"2024-04-18T04:45:11.039607+0000","last_peered":"2024-04-18T04:45:11.039607+0000","last_clean":"2024-04-18T04:45:11.039607+0000","last_became_active":"2024-04-18T04:44:30.291939+0000","last_became_peered":"2024-04-18T04:44:30.291939+0000","last_unstale":"2024-04-18T04:45:11.039607+0000","last_undegraded":"2024-04-18T04:45:11.039607+0000","last_fullsized":"2024-04-18T04:45:11.039607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:33:04.689561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.040283+0000","last_change":"2024-04-18T04:44:30.309020+0000","last_active":"2024-04-18T04:45:11.040283+0000","last_peered":"2024-04-18T04:45:11.040283+0000","last_clean":"2024-04-18T04:45:11.040283+0000","last_became_active":"2024-04-18T04:44:30.307604+0000","last_became_peered":"2024-04-18T04:44:30.307604+0000","last_unstale":"2024-04-18T04:45:11.040283+0000","last_undegraded":"2024-04-18T04:45:11.040283+0000","last_fullsized":"2024-04-18T04:45:11.040283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:44:54.764284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.046696+0000","last_change":"2024-04-18T04:44:30.314533+0000","last_active":"2024-04-18T04:45:11.046696+0000","last_peered":"2024-04-18T04:45:11.046696+0000","last_clean":"2024-04-18T04:45:11.046696+0000","last_became_active":"2024-04-18T04:44:30.313985+0000","last_became_peered":"2024-04-18T04:44:30.313985+0000","last_unstale":"2024-04-18T04:45:11.046696+0000","last_undegraded":"2024-04-18T04:45:11.046696+0000","last_fullsized":"2024-04-18T04:45:11.046696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:02:03.941709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.032261+0000","last_change":"2024-04-18T04:44:30.309273+0000","last_active":"2024-04-18T04:45:11.032261+0000","last_peered":"2024-04-18T04:45:11.032261+0000","last_clean":"2024-04-18T04:45:11.032261+0000","last_became_active":"2024-04-18T04:44:30.309002+0000","last_became_peered":"2024-04-18T04:44:30.309002+0000","last_unstale":"2024-04-18T04:45:11.032261+0000","last_undegraded":"2024-04-18T04:45:11.032261+0000","last_fullsized":"2024-04-18T04:45:11.032261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:49:10.005359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.038949+0000","last_change":"2024-04-18T04:44:30.292371+0000","last_active":"2024-04-18T04:45:11.038949+0000","last_peered":"2024-04-18T04:45:11.038949+0000","last_clean":"2024-04-18T04:45:11.038949+0000","last_became_active":"2024-04-18T04:44:30.290504+0000","last_became_peered":"2024-04-18T04:44:30.290504+0000","last_unstale":"2024-04-18T04:45:11.038949+0000","last_undegraded":"2024-04-18T04:45:11.038949+0000","last_fullsized":"2024-04-18T04:45:11.038949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:11.998355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.047855+0000","last_change":"2024-04-18T04:44:30.299935+0000","last_active":"2024-04-18T04:45:11.047855+0000","last_peered":"2024-04-18T04:45:11.047855+0000","last_clean":"2024-04-18T04:45:11.047855+0000","last_became_active":"2024-04-18T04:44:30.290175+0000","last_became_peered":"2024-04-18T04:44:30.290175+0000","last_unstale":"2024-04-18T04:45:11.047855+0000","last_undegraded":"2024-04-18T04:45:11.047855+0000","last_fullsized":"2024-04-18T04:45:11.047855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:15:13.703423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.039660+0000","last_change":"2024-04-18T04:44:30.288940+0000","last_active":"2024-04-18T04:45:11.039660+0000","last_peered":"2024-04-18T04:45:11.039660+0000","last_clean":"2024-04-18T04:45:11.039660+0000","last_became_active":"2024-04-18T04:44:30.288131+0000","last_became_peered":"2024-04-18T04:44:30.288131+0000","last_unstale":"2024-04-18T04:45:11.039660+0000","last_undegraded":"2024-04-18T04:45:11.039660+0000","last_fullsized":"2024-04-18T04:45:11.039660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:31:08.895305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.048345+0000","last_change":"2024-04-18T04:44:30.288066+0000","last_active":"2024-04-18T04:45:11.048345+0000","last_peered":"2024-04-18T04:45:11.048345+0000","last_clean":"2024-04-18T04:45:11.048345+0000","last_became_active":"2024-04-18T04:44:30.287325+0000","last_became_peered":"2024-04-18T04:44:30.287325+0000","last_unstale":"2024-04-18T04:45:11.048345+0000","last_undegraded":"2024-04-18T04:45:11.048345+0000","last_fullsized":"2024-04-18T04:45:11.048345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:58:04.111225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.039976+0000","last_change":"2024-04-18T04:44:30.275485+0000","last_active":"2024-04-18T04:45:11.039976+0000","last_peered":"2024-04-18T04:45:11.039976+0000","last_clean":"2024-04-18T04:45:11.039976+0000","last_became_active":"2024-04-18T04:44:30.275118+0000","last_became_peered":"2024-04-18T04:44:30.275118+0000","last_unstale":"2024-04-18T04:45:11.039976+0000","last_undegraded":"2024-04-18T04:45:11.039976+0000","last_fullsized":"2024-04-18T04:45:11.039976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:25:09.625660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.039018+0000","last_change":"2024-04-18T04:44:30.277119+0000","last_active":"2024-04-18T04:45:11.039018+0000","last_peered":"2024-04-18T04:45:11.039018+0000","last_clean":"2024-04-18T04:45:11.039018+0000","last_became_active":"2024-04-18T04:44:30.276654+0000","last_became_peered":"2024-04-18T04:44:30.276654+0000","last_unstale":"2024-04-18T04:45:11.039018+0000","last_undegraded":"2024-04-18T04:45:11.039018+0000","last_fullsized":"2024-04-18T04:45:11.039018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:52.420199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-18T04:45:11.046316+0000","last_change":"2024-04-18T04:44:30.302905+0000","last_active":"2024-04-18T04:45:11.046316+0000","last_peered":"2024-04-18T04:45:11.046316+0000","last_clean":"2024-04-18T04:45:11.046316+0000","last_became_active":"2024-04-18T04:44:30.302180+0000","last_became_peered":"2024-04-18T04:44:30.302180+0000","last_unstale":"2024-04-18T04:45:11.046316+0000","last_undegraded":"2024-04-18T04:45:11.046316+0000","last_fullsized":"2024-04-18T04:45:11.046316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:41:53.211956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7568,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":15136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66624,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":307200,"data_stored":120788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]}]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":117146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]}]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":307200,"data_stored":117272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]}]},{"osd":7,"up_from":14,"seq":60129542160,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":707964,"data_compressed":33312,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:45:17 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":4.2729999999999997,"5min":4.2729999999999997,"15min":4.2729999999999997},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":4.1500000000000004,"5min":4.1500000000000004,"15min":4.1500000000000004},"last":0.58099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":4,"last update":"Thu Apr 18 04:45:17 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.1070000000000002,"5min":2.1070000000000002,"15min":2.1070000000000002},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":1.0049999999999999}]},{"osd":5,"last update":"Thu Apr 18 04:45:17 2024","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.044},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.3130000000000002,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":1.167}]},{"osd":6,"last update":"Thu Apr 18 04:45:17 2024","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":1.218}]}]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":303104,"data_stored":121012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:45:16 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.55900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":4,"last update":"Thu Apr 18 04:45:16 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.002}]},{"osd":5,"last update":"Thu Apr 18 04:45:16 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":1.101},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.83499999999999996}]},{"osd":7,"last update":"Thu Apr 18 04:45:16 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.91000000000000003}]}]},{"osd":5,"up_from":14,"seq":60129542160,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":303104,"data_stored":117706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542160,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":117252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":364544,"data_stored":707356,"data_compressed":33312,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33312,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33312,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T04:45:20.857 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T04:45:21.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.028+0000 7f6541a00640 1 Processor -- start 2024-04-18T04:45:21.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.028+0000 7f6541a00640 1 -- start start 2024-04-18T04:45:21.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.028+0000 7f6541a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f653c0c6f40 0x7f653c0c2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:21.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.028+0000 7f6541a00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f653c0c7320 0x7f653c0c6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:21.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.028+0000 7f6541a00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f653c0c6540 0x7f653c070970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:21.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.028+0000 7f6541a00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f653c0c6b70 con 0x7f653c0c7320 2024-04-18T04:45:21.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.028+0000 7f6541a00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f653c155bb0 con 0x7f653c0c6540 2024-04-18T04:45:21.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.028+0000 7f6541a00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f653c155e90 con 0x7f653c0c6f40 2024-04-18T04:45:21.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.032+0000 7f6533e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f653c0c7320 0x7f653c0c6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:21.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.032+0000 7f6533e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f653c0c7320 0x7f653c0c6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35458/0 (socket says 172.21.15.120:35458) 2024-04-18T04:45:21.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.032+0000 7f6533e00640 1 -- 172.21.15.120:0/2887091362 learned_addr learned my addr 172.21.15.120:0/2887091362 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:21.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.032+0000 7f653b400640 1 --2- 172.21.15.120:0/2887091362 >> v2:172.21.15.132:3300/0 conn(0x7f653c0c6540 0x7f653c070970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:21.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.032+0000 7f653aa00640 1 --2- 172.21.15.120:0/2887091362 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f653c0c6f40 0x7f653c0c2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:21.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.032+0000 7f6533e00640 1 -- 172.21.15.120:0/2887091362 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f653c0c6f40 msgr2=0x7f653c0c2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:21.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.032+0000 7f6533e00640 1 --2- 172.21.15.120:0/2887091362 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f653c0c6f40 0x7f653c0c2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:21.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.032+0000 7f6533e00640 1 -- 172.21.15.120:0/2887091362 >> v2:172.21.15.132:3300/0 conn(0x7f653c0c6540 msgr2=0x7f653c070970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:21.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.032+0000 7f6533e00640 1 --2- 172.21.15.120:0/2887091362 >> v2:172.21.15.132:3300/0 conn(0x7f653c0c6540 0x7f653c070970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:21.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.032+0000 7f6533e00640 1 -- 172.21.15.120:0/2887091362 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f653c156170 con 0x7f653c0c7320 2024-04-18T04:45:21.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.032+0000 7f653aa00640 1 --2- 172.21.15.120:0/2887091362 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f653c0c6f40 0x7f653c0c2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:21.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.032+0000 7f653b400640 1 --2- 172.21.15.120:0/2887091362 >> v2:172.21.15.132:3300/0 conn(0x7f653c0c6540 0x7f653c070970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:21.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.032+0000 7f6533e00640 1 --2- 172.21.15.120:0/2887091362 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f653c0c7320 0x7f653c0c6000 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f653c0cc250 tx=0x7f652401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72908cf115ec1d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:21.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.032+0000 7f653a000640 1 -- 172.21.15.120:0/2887091362 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65240a89d0 con 0x7f653c0c7320 2024-04-18T04:45:21.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.032+0000 7f653a000640 1 -- 172.21.15.120:0/2887091362 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65240a8b30 con 0x7f653c0c7320 2024-04-18T04:45:21.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.032+0000 7f653a000640 1 -- 172.21.15.120:0/2887091362 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65240b0440 con 0x7f653c0c7320 2024-04-18T04:45:21.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.036+0000 7f6541a00640 1 -- 172.21.15.120:0/2887091362 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f653c0c7320 msgr2=0x7f653c0c6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:21.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.036+0000 7f6541a00640 1 --2- 172.21.15.120:0/2887091362 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f653c0c7320 0x7f653c0c6000 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f653c0cc250 tx=0x7f652401ed10 comp rx=0 tx=0).stop 2024-04-18T04:45:21.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.036+0000 7f6541a00640 1 -- 172.21.15.120:0/2887091362 shutdown_connections 2024-04-18T04:45:21.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.036+0000 7f6541a00640 1 --2- 172.21.15.120:0/2887091362 >> v2:172.21.15.132:3300/0 conn(0x7f653c0c6540 0x7f653c070970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:21.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.036+0000 7f6541a00640 1 --2- 172.21.15.120:0/2887091362 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f653c0c7320 0x7f653c0c6000 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:21.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.036+0000 7f6541a00640 1 --2- 172.21.15.120:0/2887091362 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f653c0c6f40 0x7f653c0c2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:21.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.036+0000 7f6541a00640 1 -- 172.21.15.120:0/2887091362 >> 172.21.15.120:0/2887091362 conn(0x7f653c066450 msgr2=0x7f653c06dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:21.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.036+0000 7f6541a00640 1 -- 172.21.15.120:0/2887091362 shutdown_connections 2024-04-18T04:45:21.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.036+0000 7f6541a00640 1 -- 172.21.15.120:0/2887091362 wait complete. 2024-04-18T04:45:21.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.036+0000 7f6541a00640 1 Processor -- start 2024-04-18T04:45:21.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.036+0000 7f6541a00640 1 -- start start 2024-04-18T04:45:21.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.036+0000 7f6541a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f653c0c6540 0x7f653c1eef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:21.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.036+0000 7f6541a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f653c0c6f40 0x7f653c0c3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:21.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.036+0000 7f6541a00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f653c0c7320 0x7f653c1f2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:21.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.036+0000 7f6541a00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653c144ad0 con 0x7f653c0c6f40 2024-04-18T04:45:21.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.036+0000 7f6541a00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653c1f3430 con 0x7f653c0c7320 2024-04-18T04:45:21.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.036+0000 7f6541a00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f653c144510 con 0x7f653c0c6540 2024-04-18T04:45:21.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.036+0000 7f6533e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f653c0c6f40 0x7f653c0c3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:21.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.036+0000 7f6533e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f653c0c6f40 0x7f653c0c3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35462/0 (socket says 172.21.15.120:35462) 2024-04-18T04:45:21.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.036+0000 7f6533e00640 1 -- 172.21.15.120:0/2747268671 learned_addr learned my addr 172.21.15.120:0/2747268671 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:21.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.036+0000 7f653aa00640 1 --2- 172.21.15.120:0/2747268671 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f653c0c6540 0x7f653c1eef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:21.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.036+0000 7f653b400640 1 --2- 172.21.15.120:0/2747268671 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f653c0c7320 0x7f653c1f2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:21.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.036+0000 7f6533e00640 1 -- 172.21.15.120:0/2747268671 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f653c0c6540 msgr2=0x7f653c1eef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:21.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.036+0000 7f6533e00640 1 --2- 172.21.15.120:0/2747268671 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f653c0c6540 0x7f653c1eef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:21.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.036+0000 7f6533e00640 1 -- 172.21.15.120:0/2747268671 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f653c0c7320 msgr2=0x7f653c1f2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:21.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.036+0000 7f6533e00640 1 --2- 172.21.15.120:0/2747268671 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f653c0c7320 0x7f653c1f2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:21.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.036+0000 7f6533e00640 1 -- 172.21.15.120:0/2747268671 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65240094d0 con 0x7f653c0c6f40 2024-04-18T04:45:21.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.036+0000 7f653aa00640 1 --2- 172.21.15.120:0/2747268671 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f653c0c6540 0x7f653c1eef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:21.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.036+0000 7f6533e00640 1 --2- 172.21.15.120:0/2747268671 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f653c0c6f40 0x7f653c0c3ae0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f65240b3040 tx=0x7f652401bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:21.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.040+0000 7f6532a00640 1 -- 172.21.15.120:0/2747268671 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65240b0e80 con 0x7f653c0c6f40 2024-04-18T04:45:21.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.040+0000 7f6532a00640 1 -- 172.21.15.120:0/2747268671 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65240bb480 con 0x7f653c0c6f40 2024-04-18T04:45:21.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.040+0000 7f6541a00640 1 -- 172.21.15.120:0/2747268671 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f653c1447f0 con 0x7f653c0c6f40 2024-04-18T04:45:21.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.040+0000 7f6532a00640 1 -- 172.21.15.120:0/2747268671 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65240bb810 con 0x7f653c0c6f40 2024-04-18T04:45:21.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.040+0000 7f6541a00640 1 -- 172.21.15.120:0/2747268671 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f653c0c5960 con 0x7f653c0c6f40 2024-04-18T04:45:21.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.040+0000 7f6541a00640 1 -- 172.21.15.120:0/2747268671 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f653c072a70 con 0x7f653c0c6f40 2024-04-18T04:45:21.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.040+0000 7f6532a00640 1 -- 172.21.15.120:0/2747268671 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f65240bb970 con 0x7f653c0c6f40 2024-04-18T04:45:21.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.040+0000 7f6532a00640 1 --2- 172.21.15.120:0/2747268671 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6518066690 0x7f6518068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:21.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.044+0000 7f6532a00640 1 -- 172.21.15.120:0/2747268671 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6524122b90 con 0x7f653c0c6f40 2024-04-18T04:45:21.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.044+0000 7f653aa00640 1 --2- 172.21.15.120:0/2747268671 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6518066690 0x7f6518068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:21.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.044+0000 7f653aa00640 1 --2- 172.21.15.120:0/2747268671 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6518066690 0x7f6518068b50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f652c009970 tx=0x7f652c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:21.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.048+0000 7f6532a00640 1 -- 172.21.15.120:0/2747268671 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f65240efb40 con 0x7f653c0c6f40 2024-04-18T04:45:21.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.204+0000 7f6541a00640 1 -- 172.21.15.120:0/2747268671 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f653c0c6d20 con 0x7f653c0c6f40 2024-04-18T04:45:21.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.204+0000 7f6532a00640 1 -- 172.21.15.120:0/2747268671 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18257 (secure 0 0 0) 0x7f65240b5020 con 0x7f653c0c6f40 2024-04-18T04:45:21.207 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:45:21.207 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":27,"fsid":"8e73592f-08e2-4957-a98f-9d044cec4ba5","created":"2024-04-18T04:44:06.139983+0000","modified":"2024-04-18T04:45:12.029792+0000","last_up_change":"2024-04-18T04:44:17.410146+0000","last_in_change":"2024-04-18T04:44:08.470250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T04:44:16.864728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T04:44:28.825773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T04:44:29.245857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-18T04:44:32.314302+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a80903bd-d9be-4fb9-af99-6125cb26bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":27468},{"type":"v1","addr":"172.21.15.120:6801","nonce":27468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":27468},{"type":"v1","addr":"172.21.15.120:6803","nonce":27468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":27468},{"type":"v1","addr":"172.21.15.120:6807","nonce":27468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":27468},{"type":"v1","addr":"172.21.15.120:6805","nonce":27468}]},"public_addr":"172.21.15.120:6801/27468","cluster_addr":"172.21.15.120:6803/27468","heartbeat_back_addr":"172.21.15.120:6807/27468","heartbeat_front_addr":"172.21.15.120:6805/27468","state":["exists","up"]},{"osd":1,"uuid":"8f5f004b-6870-4c78-8d50-9622e631ec25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":27470},{"type":"v1","addr":"172.21.15.120:6823","nonce":27470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":27470},{"type":"v1","addr":"172.21.15.120:6827","nonce":27470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":27470},{"type":"v1","addr":"172.21.15.120:6831","nonce":27470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":27470},{"type":"v1","addr":"172.21.15.120:6829","nonce":27470}]},"public_addr":"172.21.15.120:6823/27470","cluster_addr":"172.21.15.120:6827/27470","heartbeat_back_addr":"172.21.15.120:6831/27470","heartbeat_front_addr":"172.21.15.120:6829/27470","state":["exists","up"]},{"osd":2,"uuid":"6e228a2b-6103-4301-a8b5-ee81dbb1f920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":27471},{"type":"v1","addr":"172.21.15.120:6817","nonce":27471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":27471},{"type":"v1","addr":"172.21.15.120:6819","nonce":27471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":27471},{"type":"v1","addr":"172.21.15.120:6826","nonce":27471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":27471},{"type":"v1","addr":"172.21.15.120:6822","nonce":27471}]},"public_addr":"172.21.15.120:6817/27471","cluster_addr":"172.21.15.120:6819/27471","heartbeat_back_addr":"172.21.15.120:6826/27471","heartbeat_front_addr":"172.21.15.120:6822/27471","state":["exists","up"]},{"osd":3,"uuid":"7a5cabd7-d898-4e32-a03c-25b46e790134","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":27469},{"type":"v1","addr":"172.21.15.120:6809","nonce":27469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":27469},{"type":"v1","addr":"172.21.15.120:6811","nonce":27469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":27469},{"type":"v1","addr":"172.21.15.120:6815","nonce":27469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":27469},{"type":"v1","addr":"172.21.15.120:6813","nonce":27469}]},"public_addr":"172.21.15.120:6809/27469","cluster_addr":"172.21.15.120:6811/27469","heartbeat_back_addr":"172.21.15.120:6815/27469","heartbeat_front_addr":"172.21.15.120:6813/27469","state":["exists","up"]},{"osd":4,"uuid":"8e9f530f-6bab-4b23-a1a3-a71362fefcc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":28102},{"type":"v1","addr":"172.21.15.132:6825","nonce":28102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":28102},{"type":"v1","addr":"172.21.15.132:6827","nonce":28102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":28102},{"type":"v1","addr":"172.21.15.132:6831","nonce":28102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":28102},{"type":"v1","addr":"172.21.15.132:6829","nonce":28102}]},"public_addr":"172.21.15.132:6825/28102","cluster_addr":"172.21.15.132:6827/28102","heartbeat_back_addr":"172.21.15.132:6831/28102","heartbeat_front_addr":"172.21.15.132:6829/28102","state":["exists","up"]},{"osd":5,"uuid":"2243fabe-cc81-40cf-91bc-f106fe275a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":28104},{"type":"v1","addr":"172.21.15.132:6809","nonce":28104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":28104},{"type":"v1","addr":"172.21.15.132:6811","nonce":28104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":28104},{"type":"v1","addr":"172.21.15.132:6815","nonce":28104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":28104},{"type":"v1","addr":"172.21.15.132:6813","nonce":28104}]},"public_addr":"172.21.15.132:6809/28104","cluster_addr":"172.21.15.132:6811/28104","heartbeat_back_addr":"172.21.15.132:6815/28104","heartbeat_front_addr":"172.21.15.132:6813/28104","state":["exists","up"]},{"osd":6,"uuid":"c093a5ed-25c8-41a7-a20d-606a1a1661e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":28103},{"type":"v1","addr":"172.21.15.132:6801","nonce":28103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":28103},{"type":"v1","addr":"172.21.15.132:6803","nonce":28103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":28103},{"type":"v1","addr":"172.21.15.132:6807","nonce":28103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":28103},{"type":"v1","addr":"172.21.15.132:6805","nonce":28103}]},"public_addr":"172.21.15.132:6801/28103","cluster_addr":"172.21.15.132:6803/28103","heartbeat_back_addr":"172.21.15.132:6807/28103","heartbeat_front_addr":"172.21.15.132:6805/28103","state":["exists","up"]},{"osd":7,"uuid":"c37426b7-1080-4434-9f3e-a3afbbdc0fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":28129},{"type":"v1","addr":"172.21.15.132:6817","nonce":28129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":28129},{"type":"v1","addr":"172.21.15.132:6819","nonce":28129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":28129},{"type":"v1","addr":"172.21.15.132:6823","nonce":28129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":28129},{"type":"v1","addr":"172.21.15.132:6821","nonce":28129}]},"public_addr":"172.21.15.132:6817/28129","cluster_addr":"172.21.15.132:6819/28129","heartbeat_back_addr":"172.21.15.132:6823/28129","heartbeat_front_addr":"172.21.15.132:6821/28129","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.053825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.289753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.274645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.146361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.943883+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.701955+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.851076+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.800782+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":1}]},{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T04:45:21.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.208+0000 7f6541a00640 1 -- 172.21.15.120:0/2747268671 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6518066690 msgr2=0x7f6518068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:21.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.208+0000 7f6541a00640 1 --2- 172.21.15.120:0/2747268671 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6518066690 0x7f6518068b50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f652c009970 tx=0x7f652c008040 comp rx=0 tx=0).stop 2024-04-18T04:45:21.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.208+0000 7f6541a00640 1 -- 172.21.15.120:0/2747268671 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f653c0c6f40 msgr2=0x7f653c0c3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:21.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.208+0000 7f6541a00640 1 --2- 172.21.15.120:0/2747268671 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f653c0c6f40 0x7f653c0c3ae0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f65240b3040 tx=0x7f652401bab0 comp rx=0 tx=0).stop 2024-04-18T04:45:21.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.208+0000 7f6541a00640 1 -- 172.21.15.120:0/2747268671 shutdown_connections 2024-04-18T04:45:21.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.208+0000 7f6541a00640 1 --2- 172.21.15.120:0/2747268671 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6518066690 0x7f6518068b50 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:21.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.208+0000 7f6541a00640 1 --2- 172.21.15.120:0/2747268671 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f653c0c7320 0x7f653c1f2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:21.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.208+0000 7f6541a00640 1 --2- 172.21.15.120:0/2747268671 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f653c0c6f40 0x7f653c0c3ae0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:21.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.208+0000 7f6541a00640 1 --2- 172.21.15.120:0/2747268671 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f653c0c6540 0x7f653c1eef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:21.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.208+0000 7f6541a00640 1 -- 172.21.15.120:0/2747268671 >> 172.21.15.120:0/2747268671 conn(0x7f653c066450 msgr2=0x7f653c14a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:21.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.208+0000 7f6541a00640 1 -- 172.21.15.120:0/2747268671 shutdown_connections 2024-04-18T04:45:21.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.208+0000 7f6541a00640 1 -- 172.21.15.120:0/2747268671 wait complete. 2024-04-18T04:45:21.228 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T04:44:16.864728+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T04:44:28.825773+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T04:44:29.245857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-18T04:44:32.314302+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-18T04:45:21.230 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T04:45:21.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.368+0000 7f5255400640 1 Processor -- start 2024-04-18T04:45:21.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.368+0000 7f5255400640 1 -- start start 2024-04-18T04:45:21.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.368+0000 7f5255400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f52500caff0 0x7f52500cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:21.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.368+0000 7f5255400640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5250071a60 con 0x7f5250150820 2024-04-18T04:45:21.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.368+0000 7f5255400640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5250157430 con 0x7f5250159d90 2024-04-18T04:45:21.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.368+0000 7f5255400640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5250150c00 con 0x7f52500caff0 2024-04-18T04:45:21.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.368+0000 7f524e800640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f5250150820 0x7f52500c0490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:56122/0 (socket says 172.21.15.120:56122) 2024-04-18T04:45:21.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.368+0000 7f524e800640 1 -- 172.21.15.120:0/2402004544 learned_addr learned my addr 172.21.15.120:0/2402004544 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:45:21.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.368+0000 7f524de00640 1 --2- 172.21.15.120:0/2402004544 >> v2:172.21.15.120:3300/0 conn(0x7f52500caff0 0x7f52500cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:21.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.368+0000 7f524de00640 1 -- 172.21.15.120:0/2402004544 >> v1:172.21.15.132:6789/0 conn(0x7f5250159d90 legacy=0x7f525015a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:21.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.368+0000 7f524de00640 1 -- 172.21.15.120:0/2402004544 >> v1:172.21.15.120:6789/0 conn(0x7f5250150820 legacy=0x7f52500c0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:21.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.368+0000 7f524de00640 1 -- 172.21.15.120:0/2402004544 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52501565d0 con 0x7f52500caff0 2024-04-18T04:45:21.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.368+0000 7f524d400640 1 -- 172.21.15.120:0/2402004544 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1732787341 0 0) 0x7f5250071a60 con 0x7f5250150820 2024-04-18T04:45:21.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.372+0000 7f524de00640 1 --2- 172.21.15.120:0/2402004544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52500caff0 0x7f52500cb440 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f523c0097c0 tx=0x7f523c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d639269d2b4e007 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:21.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.372+0000 7f524d400640 1 -- 172.21.15.120:0/2402004544 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c0a7070 con 0x7f52500caff0 2024-04-18T04:45:21.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.372+0000 7f524d400640 1 -- 172.21.15.120:0/2402004544 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523c0ab430 con 0x7f52500caff0 2024-04-18T04:45:21.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.372+0000 7f524d400640 1 -- 172.21.15.120:0/2402004544 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c0ab7c0 con 0x7f52500caff0 2024-04-18T04:45:21.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.372+0000 7f5255400640 1 -- 172.21.15.120:0/2402004544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52500caff0 msgr2=0x7f52500cb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:21.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.372+0000 7f5255400640 1 --2- 172.21.15.120:0/2402004544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52500caff0 0x7f52500cb440 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f523c0097c0 tx=0x7f523c01c430 comp rx=0 tx=0).stop 2024-04-18T04:45:21.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.372+0000 7f5255400640 1 -- 172.21.15.120:0/2402004544 shutdown_connections 2024-04-18T04:45:21.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.372+0000 7f5255400640 1 --2- 172.21.15.120:0/2402004544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52500caff0 0x7f52500cb440 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:21.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.372+0000 7f5255400640 1 -- 172.21.15.120:0/2402004544 >> 172.21.15.120:0/2402004544 conn(0x7f525006b780 msgr2=0x7f525006bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:21.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.372+0000 7f5255400640 1 -- 172.21.15.120:0/2402004544 shutdown_connections 2024-04-18T04:45:21.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.372+0000 7f5255400640 1 -- 172.21.15.120:0/2402004544 wait complete. 2024-04-18T04:45:21.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.376+0000 7f5255400640 1 Processor -- start 2024-04-18T04:45:21.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.376+0000 7f5255400640 1 -- start start 2024-04-18T04:45:21.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.376+0000 7f5255400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52500caff0 0x7f525013f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:21.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.376+0000 7f5255400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5250150820 0x7f5250141ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:21.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.376+0000 7f5255400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5250159d90 0x7f5250157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:21.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.376+0000 7f5255400640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5250145e50 con 0x7f5250150820 2024-04-18T04:45:21.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.376+0000 7f5255400640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5250145310 con 0x7f52500caff0 2024-04-18T04:45:21.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.376+0000 7f5255400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5250159110 con 0x7f5250159d90 2024-04-18T04:45:21.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.376+0000 7f524de00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5250150820 0x7f5250141ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:21.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.376+0000 7f524de00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5250150820 0x7f5250141ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35476/0 (socket says 172.21.15.120:35476) 2024-04-18T04:45:21.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.376+0000 7f524de00640 1 -- 172.21.15.120:0/2252654588 learned_addr learned my addr 172.21.15.120:0/2252654588 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:21.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.376+0000 7f524e800640 1 --2- 172.21.15.120:0/2252654588 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52500caff0 0x7f525013f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:21.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.376+0000 7f524f200640 1 --2- 172.21.15.120:0/2252654588 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5250159d90 0x7f5250157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:21.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.376+0000 7f524de00640 1 -- 172.21.15.120:0/2252654588 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5250159d90 msgr2=0x7f5250157c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:21.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.376+0000 7f524de00640 1 --2- 172.21.15.120:0/2252654588 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5250159d90 0x7f5250157c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:21.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.376+0000 7f524de00640 1 -- 172.21.15.120:0/2252654588 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52500caff0 msgr2=0x7f525013f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:21.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.376+0000 7f524de00640 1 --2- 172.21.15.120:0/2252654588 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52500caff0 0x7f525013f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:21.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.376+0000 7f524de00640 1 -- 172.21.15.120:0/2252654588 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523c009420 con 0x7f5250150820 2024-04-18T04:45:21.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.376+0000 7f524de00640 1 --2- 172.21.15.120:0/2252654588 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5250150820 0x7f5250141ed0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f523c0ad040 tx=0x7f523c01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:21.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.376+0000 7f5246a00640 1 -- 172.21.15.120:0/2252654588 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c0b5810 con 0x7f5250150820 2024-04-18T04:45:21.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.376+0000 7f5246a00640 1 -- 172.21.15.120:0/2252654588 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523c0b5990 con 0x7f5250150820 2024-04-18T04:45:21.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.376+0000 7f5246a00640 1 -- 172.21.15.120:0/2252654588 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c0b5d40 con 0x7f5250150820 2024-04-18T04:45:21.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.376+0000 7f5255400640 1 -- 172.21.15.120:0/2252654588 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52501455b0 con 0x7f5250150820 2024-04-18T04:45:21.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.376+0000 7f5255400640 1 -- 172.21.15.120:0/2252654588 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5250145b70 con 0x7f5250150820 2024-04-18T04:45:21.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.376+0000 7f5255400640 1 -- 172.21.15.120:0/2252654588 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5250067590 con 0x7f5250150820 2024-04-18T04:45:21.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.380+0000 7f5246a00640 1 -- 172.21.15.120:0/2252654588 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f523c0b4390 con 0x7f5250150820 2024-04-18T04:45:21.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.380+0000 7f5246a00640 1 --2- 172.21.15.120:0/2252654588 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f5230066690 0x7f5230068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:21.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.380+0000 7f5246a00640 1 -- 172.21.15.120:0/2252654588 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f523c11ede0 con 0x7f5250150820 2024-04-18T04:45:21.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.380+0000 7f524e800640 1 --2- 172.21.15.120:0/2252654588 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f5230066690 0x7f5230068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:21.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.380+0000 7f524e800640 1 --2- 172.21.15.120:0/2252654588 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f5230066690 0x7f5230068b50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5240000f70 tx=0x7f5240007b60 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:21.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.384+0000 7f5246a00640 1 -- 172.21.15.120:0/2252654588 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f523c0ebda0 con 0x7f5250150820 2024-04-18T04:45:21.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.540+0000 7f5255400640 1 -- 172.21.15.120:0/2252654588 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f52500729d0 con 0x7f5250150820 2024-04-18T04:45:21.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.540+0000 7f5246a00640 1 -- 172.21.15.120:0/2252654588 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f523c0c4020 con 0x7f5250150820 2024-04-18T04:45:21.542 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2024-04-18T04:45:21.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.540+0000 7f5255400640 1 -- 172.21.15.120:0/2252654588 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f5230066690 msgr2=0x7f5230068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:21.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.540+0000 7f5255400640 1 --2- 172.21.15.120:0/2252654588 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f5230066690 0x7f5230068b50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5240000f70 tx=0x7f5240007b60 comp rx=0 tx=0).stop 2024-04-18T04:45:21.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.540+0000 7f5255400640 1 -- 172.21.15.120:0/2252654588 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5250150820 msgr2=0x7f5250141ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:21.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.540+0000 7f5255400640 1 --2- 172.21.15.120:0/2252654588 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5250150820 0x7f5250141ed0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f523c0ad040 tx=0x7f523c01ac70 comp rx=0 tx=0).stop 2024-04-18T04:45:21.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.540+0000 7f5255400640 1 -- 172.21.15.120:0/2252654588 shutdown_connections 2024-04-18T04:45:21.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.540+0000 7f5255400640 1 --2- 172.21.15.120:0/2252654588 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f5230066690 0x7f5230068b50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:21.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.540+0000 7f5255400640 1 --2- 172.21.15.120:0/2252654588 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5250159d90 0x7f5250157c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:21.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.540+0000 7f5255400640 1 --2- 172.21.15.120:0/2252654588 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5250150820 0x7f5250141ed0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:21.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.540+0000 7f5255400640 1 --2- 172.21.15.120:0/2252654588 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52500caff0 0x7f525013f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:21.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.540+0000 7f5255400640 1 -- 172.21.15.120:0/2252654588 >> 172.21.15.120:0/2252654588 conn(0x7f525006b780 msgr2=0x7f5250146980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:21.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.544+0000 7f5255400640 1 -- 172.21.15.120:0/2252654588 shutdown_connections 2024-04-18T04:45:21.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.544+0000 7f5255400640 1 -- 172.21.15.120:0/2252654588 wait complete. 2024-04-18T04:45:21.563 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T04:45:21.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.700+0000 7fa8d2000640 1 Processor -- start 2024-04-18T04:45:21.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.700+0000 7fa8d2000640 1 -- start start 2024-04-18T04:45:21.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.700+0000 7fa8d2000640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa8cc1539a0 0x7fa8cc0c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:21.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.700+0000 7fa8d2000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8cc06c980 0x7fa8cc0ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:21.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.700+0000 7fa8d2000640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8cc0c82d0 con 0x7fa8cc0c9490 2024-04-18T04:45:21.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.700+0000 7fa8d2000640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8cc06cec0 con 0x7fa8cc1539a0 2024-04-18T04:45:21.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.700+0000 7fa8d2000640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc0c8cb0 con 0x7fa8cc06c980 2024-04-18T04:45:21.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.700+0000 7fa8cb400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa8cc1539a0 0x7fa8cc0c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:21.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.700+0000 7fa8cb400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa8cc1539a0 0x7fa8cc0c7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35490/0 (socket says 172.21.15.120:35490) 2024-04-18T04:45:21.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.700+0000 7fa8cb400640 1 -- 172.21.15.120:0/3288232780 learned_addr learned my addr 172.21.15.120:0/3288232780 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:21.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.700+0000 7fa8caa00640 1 --2- 172.21.15.120:0/3288232780 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8cc06c980 0x7fa8cc0ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:21.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.700+0000 7fa8cb400640 1 -- 172.21.15.120:0/3288232780 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8cc06c980 msgr2=0x7fa8cc0ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:21.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.700+0000 7fa8cb400640 1 --2- 172.21.15.120:0/3288232780 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8cc06c980 0x7fa8cc0ccee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:21.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.700+0000 7fa8cb400640 1 -- 172.21.15.120:0/3288232780 >> v1:172.21.15.132:6789/0 conn(0x7fa8cc0c9490 legacy=0x7fa8cc0c99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:21.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.700+0000 7fa8cb400640 1 -- 172.21.15.120:0/3288232780 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8cc06e8a0 con 0x7fa8cc1539a0 2024-04-18T04:45:21.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.700+0000 7fa8caa00640 1 --2- 172.21.15.120:0/3288232780 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8cc06c980 0x7fa8cc0ccee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:45:21.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.704+0000 7fa8cb400640 1 --2- 172.21.15.120:0/3288232780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa8cc1539a0 0x7fa8cc0c7d90 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc009870 tx=0x7fa8bc01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41b2369d2f776a5e server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:21.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.704+0000 7fa8ca000640 1 -- 172.21.15.120:0/3288232780 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc0a89d0 con 0x7fa8cc1539a0 2024-04-18T04:45:21.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.704+0000 7fa8ca000640 1 -- 172.21.15.120:0/3288232780 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8bc0a8b30 con 0x7fa8cc1539a0 2024-04-18T04:45:21.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.704+0000 7fa8ca000640 1 -- 172.21.15.120:0/3288232780 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc0b0440 con 0x7fa8cc1539a0 2024-04-18T04:45:21.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.704+0000 7fa8d2000640 1 -- 172.21.15.120:0/3288232780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa8cc1539a0 msgr2=0x7fa8cc0c7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:21.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.704+0000 7fa8d2000640 1 --2- 172.21.15.120:0/3288232780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa8cc1539a0 0x7fa8cc0c7d90 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc009870 tx=0x7fa8bc01ed10 comp rx=0 tx=0).stop 2024-04-18T04:45:21.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.704+0000 7fa8d2000640 1 -- 172.21.15.120:0/3288232780 shutdown_connections 2024-04-18T04:45:21.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.704+0000 7fa8d2000640 1 --2- 172.21.15.120:0/3288232780 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8cc06c980 0x7fa8cc0ccee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:21.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.704+0000 7fa8d2000640 1 --2- 172.21.15.120:0/3288232780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa8cc1539a0 0x7fa8cc0c7d90 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:21.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.704+0000 7fa8d2000640 1 -- 172.21.15.120:0/3288232780 >> 172.21.15.120:0/3288232780 conn(0x7fa8cc06a2f0 msgr2=0x7fa8cc065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:21.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.704+0000 7fa8d2000640 1 -- 172.21.15.120:0/3288232780 shutdown_connections 2024-04-18T04:45:21.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.704+0000 7fa8d2000640 1 -- 172.21.15.120:0/3288232780 wait complete. 2024-04-18T04:45:21.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.708+0000 7fa8d2000640 1 Processor -- start 2024-04-18T04:45:21.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.708+0000 7fa8d2000640 1 -- start start 2024-04-18T04:45:21.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.708+0000 7fa8d2000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8cc06c980 0x7fa8cc0cc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:21.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.708+0000 7fa8d2000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8cc0c9490 0x7fa8cc1e2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:21.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.708+0000 7fa8d2000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa8cc1539a0 0x7fa8cc1e2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:21.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.708+0000 7fa8d2000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc0cbe50 con 0x7fa8cc1539a0 2024-04-18T04:45:21.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.708+0000 7fa8d2000640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc1474d0 con 0x7fa8cc0c9490 2024-04-18T04:45:21.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.708+0000 7fa8d2000640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc0cb890 con 0x7fa8cc06c980 2024-04-18T04:45:21.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.708+0000 7fa8cbe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa8cc1539a0 0x7fa8cc1e2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:21.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.708+0000 7fa8cbe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa8cc1539a0 0x7fa8cc1e2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35492/0 (socket says 172.21.15.120:35492) 2024-04-18T04:45:21.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.708+0000 7fa8cbe00640 1 -- 172.21.15.120:0/1445168820 learned_addr learned my addr 172.21.15.120:0/1445168820 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:21.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.708+0000 7fa8cb400640 1 --2- 172.21.15.120:0/1445168820 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8cc06c980 0x7fa8cc0cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:21.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.708+0000 7fa8caa00640 1 --2- 172.21.15.120:0/1445168820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8cc0c9490 0x7fa8cc1e2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:21.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.708+0000 7fa8cbe00640 1 -- 172.21.15.120:0/1445168820 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8cc06c980 msgr2=0x7fa8cc0cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:21.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.708+0000 7fa8cbe00640 1 --2- 172.21.15.120:0/1445168820 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8cc06c980 0x7fa8cc0cc260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:21.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.708+0000 7fa8cbe00640 1 -- 172.21.15.120:0/1445168820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8cc0c9490 msgr2=0x7fa8cc1e2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:21.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.708+0000 7fa8cbe00640 1 --2- 172.21.15.120:0/1445168820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8cc0c9490 0x7fa8cc1e2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:21.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.708+0000 7fa8cbe00640 1 -- 172.21.15.120:0/1445168820 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8bc0094d0 con 0x7fa8cc1539a0 2024-04-18T04:45:21.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.708+0000 7fa8cbe00640 1 --2- 172.21.15.120:0/1445168820 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa8cc1539a0 0x7fa8cc1e2ff0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa8c400c7b0 tx=0x7fa8c400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:21.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.708+0000 7fa8c3400640 1 -- 172.21.15.120:0/1445168820 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4004b70 con 0x7fa8cc1539a0 2024-04-18T04:45:21.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.708+0000 7fa8c3400640 1 -- 172.21.15.120:0/1445168820 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c4004cd0 con 0x7fa8cc1539a0 2024-04-18T04:45:21.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.708+0000 7fa8d2000640 1 -- 172.21.15.120:0/1445168820 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8cc0cbb70 con 0x7fa8cc1539a0 2024-04-18T04:45:21.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.708+0000 7fa8c3400640 1 -- 172.21.15.120:0/1445168820 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c400aa90 con 0x7fa8cc1539a0 2024-04-18T04:45:21.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.708+0000 7fa8d2000640 1 -- 172.21.15.120:0/1445168820 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8cc147160 con 0x7fa8cc1539a0 2024-04-18T04:45:21.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.708+0000 7fa8d2000640 1 -- 172.21.15.120:0/1445168820 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8cc067590 con 0x7fa8cc1539a0 2024-04-18T04:45:21.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.712+0000 7fa8c3400640 1 -- 172.21.15.120:0/1445168820 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa8c400abf0 con 0x7fa8cc1539a0 2024-04-18T04:45:21.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.712+0000 7fa8c3400640 1 --2- 172.21.15.120:0/1445168820 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fa8ac066690 0x7fa8ac068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:21.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.712+0000 7fa8c3400640 1 -- 172.21.15.120:0/1445168820 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa8c4084750 con 0x7fa8cc1539a0 2024-04-18T04:45:21.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.712+0000 7fa8cb400640 1 --2- 172.21.15.120:0/1445168820 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fa8ac066690 0x7fa8ac068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:21.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.712+0000 7fa8cb400640 1 --2- 172.21.15.120:0/1445168820 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fa8ac066690 0x7fa8ac068b50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc0b2000 tx=0x7fa8bc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:21.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.716+0000 7fa8c3400640 1 -- 172.21.15.120:0/1445168820 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fa8c4051700 con 0x7fa8cc1539a0 2024-04-18T04:45:21.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.868+0000 7fa8d2000640 1 -- 172.21.15.120:0/1445168820 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa8cc146ce0 con 0x7fa8cc1539a0 2024-04-18T04:45:21.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.868+0000 7fa8c3400640 1 -- 172.21.15.120:0/1445168820 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa8cc146ce0 con 0x7fa8cc1539a0 2024-04-18T04:45:21.870 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2024-04-18T04:45:21.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.872+0000 7fa8d2000640 1 -- 172.21.15.120:0/1445168820 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fa8ac066690 msgr2=0x7fa8ac068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:21.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.872+0000 7fa8d2000640 1 --2- 172.21.15.120:0/1445168820 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fa8ac066690 0x7fa8ac068b50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc0b2000 tx=0x7fa8bc008040 comp rx=0 tx=0).stop 2024-04-18T04:45:21.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.872+0000 7fa8d2000640 1 -- 172.21.15.120:0/1445168820 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa8cc1539a0 msgr2=0x7fa8cc1e2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:21.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.872+0000 7fa8d2000640 1 --2- 172.21.15.120:0/1445168820 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa8cc1539a0 0x7fa8cc1e2ff0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa8c400c7b0 tx=0x7fa8c400cc70 comp rx=0 tx=0).stop 2024-04-18T04:45:21.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.872+0000 7fa8d2000640 1 -- 172.21.15.120:0/1445168820 shutdown_connections 2024-04-18T04:45:21.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.872+0000 7fa8d2000640 1 --2- 172.21.15.120:0/1445168820 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fa8ac066690 0x7fa8ac068b50 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:21.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.872+0000 7fa8d2000640 1 --2- 172.21.15.120:0/1445168820 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa8cc1539a0 0x7fa8cc1e2ff0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:21.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.872+0000 7fa8d2000640 1 --2- 172.21.15.120:0/1445168820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8cc0c9490 0x7fa8cc1e2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:21.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.872+0000 7fa8d2000640 1 --2- 172.21.15.120:0/1445168820 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8cc06c980 0x7fa8cc0cc260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:21.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.872+0000 7fa8d2000640 1 -- 172.21.15.120:0/1445168820 >> 172.21.15.120:0/1445168820 conn(0x7fa8cc06a2f0 msgr2=0x7fa8cc0c1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:21.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.872+0000 7fa8d2000640 1 -- 172.21.15.120:0/1445168820 shutdown_connections 2024-04-18T04:45:21.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:21.872+0000 7fa8d2000640 1 -- 172.21.15.120:0/1445168820 wait complete. 2024-04-18T04:45:21.891 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T04:45:22.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.028+0000 7f3f7f200640 1 Processor -- start 2024-04-18T04:45:22.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.028+0000 7f3f7f200640 1 -- start start 2024-04-18T04:45:22.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.032+0000 7f3f7f200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3f781535a0 0x7f3f78159480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:22.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.032+0000 7f3f7f200640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3f78153980 0x7f3f7806d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:22.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.032+0000 7f3f7f200640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f780c8790 con 0x7f3f780c8c20 2024-04-18T04:45:22.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.032+0000 7f3f7f200640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f7806dd30 con 0x7f3f78153980 2024-04-18T04:45:22.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.032+0000 7f3f7f200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7806e010 con 0x7f3f781535a0 2024-04-18T04:45:22.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.032+0000 7f3f7d400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3f78153980 0x7f3f7806d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:22.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.032+0000 7f3f7e800640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f3f780c8c20 0x7f3f780c9050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:56124/0 (socket says 172.21.15.120:56124) 2024-04-18T04:45:22.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.032+0000 7f3f7e800640 1 -- 172.21.15.120:0/420087605 learned_addr learned my addr 172.21.15.120:0/420087605 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:45:22.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.032+0000 7f3f7de00640 1 --2- 172.21.15.120:0/420087605 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3f781535a0 0x7f3f78159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:22.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.032+0000 7f3f7d400640 1 -- 172.21.15.120:0/420087605 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3f781535a0 msgr2=0x7f3f78159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:22.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.032+0000 7f3f7d400640 1 --2- 172.21.15.120:0/420087605 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3f781535a0 0x7f3f78159480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:22.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.032+0000 7f3f7d400640 1 -- 172.21.15.120:0/420087605 >> v1:172.21.15.120:6789/0 conn(0x7f3f780c8c20 legacy=0x7f3f780c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:22.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.032+0000 7f3f7d400640 1 -- 172.21.15.120:0/420087605 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f7806e2f0 con 0x7f3f78153980 2024-04-18T04:45:22.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.032+0000 7f3f7de00640 1 --2- 172.21.15.120:0/420087605 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3f781535a0 0x7f3f78159480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:22.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.032+0000 7f3f7ca00640 1 -- 172.21.15.120:0/420087605 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3585872720 0 0) 0x7f3f780c8790 con 0x7f3f780c8c20 2024-04-18T04:45:22.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.032+0000 7f3f7d400640 1 --2- 172.21.15.120:0/420087605 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f78153980 0x7f3f7806d6f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3f680097c0 tx=0x7f3f6801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27b1ed0c85bc9721 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:22.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.032+0000 7f3f7ca00640 1 -- 172.21.15.120:0/420087605 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f680a8990 con 0x7f3f78153980 2024-04-18T04:45:22.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.032+0000 7f3f7ca00640 1 -- 172.21.15.120:0/420087605 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f680a8af0 con 0x7f3f78153980 2024-04-18T04:45:22.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.036+0000 7f3f7ca00640 1 -- 172.21.15.120:0/420087605 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f680a8e80 con 0x7f3f78153980 2024-04-18T04:45:22.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.036+0000 7f3f7f200640 1 -- 172.21.15.120:0/420087605 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f78153980 msgr2=0x7f3f7806d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:22.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.036+0000 7f3f7f200640 1 --2- 172.21.15.120:0/420087605 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f78153980 0x7f3f7806d6f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3f680097c0 tx=0x7f3f6801ec90 comp rx=0 tx=0).stop 2024-04-18T04:45:22.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.036+0000 7f3f7f200640 1 -- 172.21.15.120:0/420087605 shutdown_connections 2024-04-18T04:45:22.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.036+0000 7f3f7f200640 1 --2- 172.21.15.120:0/420087605 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f78153980 0x7f3f7806d6f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:22.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.036+0000 7f3f7f200640 1 --2- 172.21.15.120:0/420087605 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3f781535a0 0x7f3f78159480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:22.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.036+0000 7f3f7f200640 1 -- 172.21.15.120:0/420087605 >> 172.21.15.120:0/420087605 conn(0x7f3f780ccde0 msgr2=0x7f3f780cd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:22.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.036+0000 7f3f7f200640 1 -- 172.21.15.120:0/420087605 shutdown_connections 2024-04-18T04:45:22.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.036+0000 7f3f7f200640 1 -- 172.21.15.120:0/420087605 wait complete. 2024-04-18T04:45:22.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.036+0000 7f3f7f200640 1 Processor -- start 2024-04-18T04:45:22.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.036+0000 7f3f7f200640 1 -- start start 2024-04-18T04:45:22.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.036+0000 7f3f7f200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f780c8c20 0x7f3f781ef2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:22.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.036+0000 7f3f7f200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f781535a0 0x7f3f780c3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:22.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.036+0000 7f3f7f200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3f78156b40 0x7f3f78146620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:22.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.036+0000 7f3f7f200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f781ef830 con 0x7f3f780c8c20 2024-04-18T04:45:22.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.036+0000 7f3f7f200640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f78154d60 con 0x7f3f781535a0 2024-04-18T04:45:22.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.036+0000 7f3f7f200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f78155600 con 0x7f3f78156b40 2024-04-18T04:45:22.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.036+0000 7f3f7de00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f780c8c20 0x7f3f781ef2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:22.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.036+0000 7f3f7de00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f780c8c20 0x7f3f781ef2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35506/0 (socket says 172.21.15.120:35506) 2024-04-18T04:45:22.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.036+0000 7f3f7de00640 1 -- 172.21.15.120:0/1176156063 learned_addr learned my addr 172.21.15.120:0/1176156063 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:22.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.036+0000 7f3f7d400640 1 --2- 172.21.15.120:0/1176156063 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f781535a0 0x7f3f780c3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:22.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.036+0000 7f3f7e800640 1 --2- 172.21.15.120:0/1176156063 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3f78156b40 0x7f3f78146620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:22.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.036+0000 7f3f7de00640 1 -- 172.21.15.120:0/1176156063 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3f78156b40 msgr2=0x7f3f78146620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:22.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.036+0000 7f3f7de00640 1 --2- 172.21.15.120:0/1176156063 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3f78156b40 0x7f3f78146620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:22.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.036+0000 7f3f7de00640 1 -- 172.21.15.120:0/1176156063 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f781535a0 msgr2=0x7f3f780c3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:22.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.036+0000 7f3f7de00640 1 --2- 172.21.15.120:0/1176156063 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f781535a0 0x7f3f780c3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:22.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.036+0000 7f3f7de00640 1 -- 172.21.15.120:0/1176156063 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f68009420 con 0x7f3f780c8c20 2024-04-18T04:45:22.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.040+0000 7f3f7de00640 1 --2- 172.21.15.120:0/1176156063 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f780c8c20 0x7f3f781ef2f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c00e810 tx=0x7f3f6c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:22.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.040+0000 7f3f72000640 1 -- 172.21.15.120:0/1176156063 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c00c8d0 con 0x7f3f780c8c20 2024-04-18T04:45:22.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.040+0000 7f3f72000640 1 -- 172.21.15.120:0/1176156063 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f6c00ca30 con 0x7f3f780c8c20 2024-04-18T04:45:22.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.040+0000 7f3f7f200640 1 -- 172.21.15.120:0/1176156063 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f780c2cf0 con 0x7f3f780c8c20 2024-04-18T04:45:22.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.040+0000 7f3f72000640 1 -- 172.21.15.120:0/1176156063 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c00cdc0 con 0x7f3f780c8c20 2024-04-18T04:45:22.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.040+0000 7f3f7f200640 1 -- 172.21.15.120:0/1176156063 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f781e8f30 con 0x7f3f780c8c20 2024-04-18T04:45:22.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.040+0000 7f3f7f200640 1 -- 172.21.15.120:0/1176156063 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f780728f0 con 0x7f3f780c8c20 2024-04-18T04:45:22.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.040+0000 7f3f72000640 1 -- 172.21.15.120:0/1176156063 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3f6c013410 con 0x7f3f780c8c20 2024-04-18T04:45:22.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.040+0000 7f3f72000640 1 --2- 172.21.15.120:0/1176156063 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3f5c0666c0 0x7f3f5c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:22.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.040+0000 7f3f72000640 1 -- 172.21.15.120:0/1176156063 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3f6c084390 con 0x7f3f780c8c20 2024-04-18T04:45:22.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.040+0000 7f3f7d400640 1 --2- 172.21.15.120:0/1176156063 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3f5c0666c0 0x7f3f5c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:22.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.044+0000 7f3f7d400640 1 --2- 172.21.15.120:0/1176156063 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3f5c0666c0 0x7f3f5c068b80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3f680b2000 tx=0x7f3f68008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:22.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.044+0000 7f3f72000640 1 -- 172.21.15.120:0/1176156063 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f3f6c051320 con 0x7f3f780c8c20 2024-04-18T04:45:22.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.200+0000 7f3f7f200640 1 -- 172.21.15.120:0/1176156063 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3f7814e960 con 0x7f3f780c8c20 2024-04-18T04:45:22.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.200+0000 7f3f72000640 1 -- 172.21.15.120:0/1176156063 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3f6c054940 con 0x7f3f780c8c20 2024-04-18T04:45:22.201 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 64 2024-04-18T04:45:22.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.200+0000 7f3f7f200640 1 -- 172.21.15.120:0/1176156063 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3f5c0666c0 msgr2=0x7f3f5c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:22.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.200+0000 7f3f7f200640 1 --2- 172.21.15.120:0/1176156063 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3f5c0666c0 0x7f3f5c068b80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3f680b2000 tx=0x7f3f68008040 comp rx=0 tx=0).stop 2024-04-18T04:45:22.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.200+0000 7f3f7f200640 1 -- 172.21.15.120:0/1176156063 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f780c8c20 msgr2=0x7f3f781ef2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:22.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.200+0000 7f3f7f200640 1 --2- 172.21.15.120:0/1176156063 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f780c8c20 0x7f3f781ef2f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c00e810 tx=0x7f3f6c00ecd0 comp rx=0 tx=0).stop 2024-04-18T04:45:22.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.200+0000 7f3f7f200640 1 -- 172.21.15.120:0/1176156063 shutdown_connections 2024-04-18T04:45:22.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.200+0000 7f3f7f200640 1 --2- 172.21.15.120:0/1176156063 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3f5c0666c0 0x7f3f5c068b80 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:22.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.200+0000 7f3f7f200640 1 --2- 172.21.15.120:0/1176156063 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3f78156b40 0x7f3f78146620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:22.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.200+0000 7f3f7f200640 1 --2- 172.21.15.120:0/1176156063 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f781535a0 0x7f3f780c3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:22.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.200+0000 7f3f7f200640 1 --2- 172.21.15.120:0/1176156063 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f780c8c20 0x7f3f781ef2f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:22.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.200+0000 7f3f7f200640 1 -- 172.21.15.120:0/1176156063 >> 172.21.15.120:0/1176156063 conn(0x7f3f780ccde0 msgr2=0x7f3f7815d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:22.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.200+0000 7f3f7f200640 1 -- 172.21.15.120:0/1176156063 shutdown_connections 2024-04-18T04:45:22.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.200+0000 7f3f7f200640 1 -- 172.21.15.120:0/1176156063 wait complete. 2024-04-18T04:45:22.223 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-18T04:45:22.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.364+0000 7f6db2c00640 1 Processor -- start 2024-04-18T04:45:22.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.364+0000 7f6db2c00640 1 -- start start 2024-04-18T04:45:22.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.364+0000 7f6db2c00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6dac153890 0x7f6dac1596e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:22.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.364+0000 7f6db2c00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6dac153c70 0x7f6dac070c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:22.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.364+0000 7f6db2c00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6dac071160 0x7f6dac0c6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:22.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.364+0000 7f6db2c00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dac071ae0 con 0x7f6dac071160 2024-04-18T04:45:22.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.364+0000 7f6db2c00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dac070790 con 0x7f6dac153890 2024-04-18T04:45:22.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.364+0000 7f6db2c00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac159c20 con 0x7f6dac153c70 2024-04-18T04:45:22.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.364+0000 7f6db0c00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6dac071160 0x7f6dac0c6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:22.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.364+0000 7f6db0c00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6dac071160 0x7f6dac0c6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35514/0 (socket says 172.21.15.120:35514) 2024-04-18T04:45:22.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.364+0000 7f6db0c00640 1 -- 172.21.15.120:0/2490388707 learned_addr learned my addr 172.21.15.120:0/2490388707 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:22.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.364+0000 7f6dabe00640 1 --2- 172.21.15.120:0/2490388707 >> v2:172.21.15.132:3300/0 conn(0x7f6dac153890 0x7f6dac1596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:22.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.364+0000 7f6da3400640 1 --2- 172.21.15.120:0/2490388707 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6dac153c70 0x7f6dac070c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:22.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.368+0000 7f6db0c00640 1 -- 172.21.15.120:0/2490388707 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6dac153c70 msgr2=0x7f6dac070c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:22.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.368+0000 7f6db0c00640 1 --2- 172.21.15.120:0/2490388707 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6dac153c70 0x7f6dac070c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:22.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.368+0000 7f6db0c00640 1 -- 172.21.15.120:0/2490388707 >> v2:172.21.15.132:3300/0 conn(0x7f6dac153890 msgr2=0x7f6dac1596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:22.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.368+0000 7f6db0c00640 1 --2- 172.21.15.120:0/2490388707 >> v2:172.21.15.132:3300/0 conn(0x7f6dac153890 0x7f6dac1596e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:22.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.368+0000 7f6db0c00640 1 -- 172.21.15.120:0/2490388707 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dac159e90 con 0x7f6dac071160 2024-04-18T04:45:22.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.368+0000 7f6dabe00640 1 --2- 172.21.15.120:0/2490388707 >> v2:172.21.15.132:3300/0 conn(0x7f6dac153890 0x7f6dac1596e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:22.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.368+0000 7f6db0c00640 1 --2- 172.21.15.120:0/2490388707 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6dac071160 0x7f6dac0c6000 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6dac06add0 tx=0x7f6da401f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4402d01a994f0385 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:22.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.368+0000 7f6dab400640 1 -- 172.21.15.120:0/2490388707 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da40af400 con 0x7f6dac071160 2024-04-18T04:45:22.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.368+0000 7f6dab400640 1 -- 172.21.15.120:0/2490388707 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da40ab050 con 0x7f6dac071160 2024-04-18T04:45:22.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.368+0000 7f6dab400640 1 -- 172.21.15.120:0/2490388707 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da40af780 con 0x7f6dac071160 2024-04-18T04:45:22.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.368+0000 7f6db2c00640 1 -- 172.21.15.120:0/2490388707 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6dac071160 msgr2=0x7f6dac0c6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:22.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.368+0000 7f6db2c00640 1 --2- 172.21.15.120:0/2490388707 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6dac071160 0x7f6dac0c6000 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6dac06add0 tx=0x7f6da401f1e0 comp rx=0 tx=0).stop 2024-04-18T04:45:22.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.368+0000 7f6db2c00640 1 -- 172.21.15.120:0/2490388707 shutdown_connections 2024-04-18T04:45:22.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.372+0000 7f6db2c00640 1 --2- 172.21.15.120:0/2490388707 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6dac071160 0x7f6dac0c6000 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:22.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.372+0000 7f6db2c00640 1 --2- 172.21.15.120:0/2490388707 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6dac153c70 0x7f6dac070c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:22.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.372+0000 7f6db2c00640 1 --2- 172.21.15.120:0/2490388707 >> v2:172.21.15.132:3300/0 conn(0x7f6dac153890 0x7f6dac1596e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:22.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.372+0000 7f6db2c00640 1 -- 172.21.15.120:0/2490388707 >> 172.21.15.120:0/2490388707 conn(0x7f6dac066a50 msgr2=0x7f6dac069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:22.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.372+0000 7f6db2c00640 1 -- 172.21.15.120:0/2490388707 shutdown_connections 2024-04-18T04:45:22.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.372+0000 7f6db2c00640 1 -- 172.21.15.120:0/2490388707 wait complete. 2024-04-18T04:45:22.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.372+0000 7f6db2c00640 1 Processor -- start 2024-04-18T04:45:22.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.372+0000 7f6db2c00640 1 -- start start 2024-04-18T04:45:22.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.372+0000 7f6db2c00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6dac071160 0x7f6dac1f2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:22.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.372+0000 7f6db2c00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6dac153890 0x7f6dac154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:22.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.372+0000 7f6db2c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6dac153c70 0x7f6dac15bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:22.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.372+0000 7f6db2c00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac157fd0 con 0x7f6dac153c70 2024-04-18T04:45:22.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.372+0000 7f6db2c00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac1590c0 con 0x7f6dac071160 2024-04-18T04:45:22.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.372+0000 7f6db2c00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac159850 con 0x7f6dac153890 2024-04-18T04:45:22.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.372+0000 7f6db0c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6dac153c70 0x7f6dac15bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:22.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.372+0000 7f6db0c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6dac153c70 0x7f6dac15bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35528/0 (socket says 172.21.15.120:35528) 2024-04-18T04:45:22.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.372+0000 7f6db0c00640 1 -- 172.21.15.120:0/3886892296 learned_addr learned my addr 172.21.15.120:0/3886892296 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:22.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.372+0000 7f6dabe00640 1 --2- 172.21.15.120:0/3886892296 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6dac071160 0x7f6dac1f2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:22.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.372+0000 7f6da3400640 1 --2- 172.21.15.120:0/3886892296 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6dac153890 0x7f6dac154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:22.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.372+0000 7f6db0c00640 1 -- 172.21.15.120:0/3886892296 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6dac153890 msgr2=0x7f6dac154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:22.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.372+0000 7f6db0c00640 1 --2- 172.21.15.120:0/3886892296 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6dac153890 0x7f6dac154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:22.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.372+0000 7f6db0c00640 1 -- 172.21.15.120:0/3886892296 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6dac071160 msgr2=0x7f6dac1f2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:22.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.372+0000 7f6db0c00640 1 --2- 172.21.15.120:0/3886892296 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6dac071160 0x7f6dac1f2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:22.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.372+0000 7f6db0c00640 1 -- 172.21.15.120:0/3886892296 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da4009b30 con 0x7f6dac153c70 2024-04-18T04:45:22.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.372+0000 7f6dabe00640 1 --2- 172.21.15.120:0/3886892296 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6dac071160 0x7f6dac1f2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:22.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.372+0000 7f6db0c00640 1 --2- 172.21.15.120:0/3886892296 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6dac153c70 0x7f6dac15bd00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6da40b2040 tx=0x7f6da401bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:22.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.372+0000 7f6da8c00640 1 -- 172.21.15.120:0/3886892296 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da40afd30 con 0x7f6dac153c70 2024-04-18T04:45:22.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.372+0000 7f6da8c00640 1 -- 172.21.15.120:0/3886892296 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da4009510 con 0x7f6dac153c70 2024-04-18T04:45:22.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.372+0000 7f6da8c00640 1 -- 172.21.15.120:0/3886892296 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da40ba660 con 0x7f6dac153c70 2024-04-18T04:45:22.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.376+0000 7f6db2c00640 1 -- 172.21.15.120:0/3886892296 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dac154d50 con 0x7f6dac153c70 2024-04-18T04:45:22.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.376+0000 7f6db2c00640 1 -- 172.21.15.120:0/3886892296 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dac159570 con 0x7f6dac153c70 2024-04-18T04:45:22.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.376+0000 7f6db2c00640 1 -- 172.21.15.120:0/3886892296 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dac0729d0 con 0x7f6dac153c70 2024-04-18T04:45:22.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.376+0000 7f6da8c00640 1 -- 172.21.15.120:0/3886892296 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6da40b6040 con 0x7f6dac153c70 2024-04-18T04:45:22.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.376+0000 7f6da8c00640 1 --2- 172.21.15.120:0/3886892296 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6d88066690 0x7f6d88068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:22.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.376+0000 7f6da8c00640 1 -- 172.21.15.120:0/3886892296 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6da4122800 con 0x7f6dac153c70 2024-04-18T04:45:22.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.376+0000 7f6dabe00640 1 --2- 172.21.15.120:0/3886892296 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6d88066690 0x7f6d88068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:22.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.380+0000 7f6dabe00640 1 --2- 172.21.15.120:0/3886892296 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6d88066690 0x7f6d88068b50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c00c940 tx=0x7f6d9c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:22.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.380+0000 7f6da8c00640 1 -- 172.21.15.120:0/3886892296 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f6da40ef900 con 0x7f6dac153c70 2024-04-18T04:45:22.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.532+0000 7f6db2c00640 1 -- 172.21.15.120:0/3886892296 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6dac0caf40 con 0x7f6dac153c70 2024-04-18T04:45:22.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.532+0000 7f6da8c00640 1 -- 172.21.15.120:0/3886892296 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6da40f2f20 con 0x7f6dac153c70 2024-04-18T04:45:22.534 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2024-04-18T04:45:22.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.536+0000 7f6db2c00640 1 -- 172.21.15.120:0/3886892296 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6d88066690 msgr2=0x7f6d88068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:22.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.536+0000 7f6db2c00640 1 --2- 172.21.15.120:0/3886892296 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6d88066690 0x7f6d88068b50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c00c940 tx=0x7f6d9c008040 comp rx=0 tx=0).stop 2024-04-18T04:45:22.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.536+0000 7f6db2c00640 1 -- 172.21.15.120:0/3886892296 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6dac153c70 msgr2=0x7f6dac15bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:22.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.536+0000 7f6db2c00640 1 --2- 172.21.15.120:0/3886892296 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6dac153c70 0x7f6dac15bd00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6da40b2040 tx=0x7f6da401bf80 comp rx=0 tx=0).stop 2024-04-18T04:45:22.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.536+0000 7f6db2c00640 1 -- 172.21.15.120:0/3886892296 shutdown_connections 2024-04-18T04:45:22.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.536+0000 7f6db2c00640 1 --2- 172.21.15.120:0/3886892296 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6d88066690 0x7f6d88068b50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:22.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.536+0000 7f6db2c00640 1 --2- 172.21.15.120:0/3886892296 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6dac153c70 0x7f6dac15bd00 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:22.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.536+0000 7f6db2c00640 1 --2- 172.21.15.120:0/3886892296 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6dac153890 0x7f6dac154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:22.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.536+0000 7f6db2c00640 1 --2- 172.21.15.120:0/3886892296 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6dac071160 0x7f6dac1f2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:22.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.536+0000 7f6db2c00640 1 -- 172.21.15.120:0/3886892296 >> 172.21.15.120:0/3886892296 conn(0x7f6dac066a50 msgr2=0x7f6dac0c5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:22.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.536+0000 7f6db2c00640 1 -- 172.21.15.120:0/3886892296 shutdown_connections 2024-04-18T04:45:22.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.536+0000 7f6db2c00640 1 -- 172.21.15.120:0/3886892296 wait complete. 2024-04-18T04:45:22.555 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:45:22.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.688+0000 7f6d6a600640 1 Processor -- start 2024-04-18T04:45:22.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.688+0000 7f6d6a600640 1 -- start start 2024-04-18T04:45:22.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.692+0000 7f6d6a600640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6d640c0a40 0x7f6d6406f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:22.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.692+0000 7f6d6a600640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d64150400 con 0x7f6d640c7280 2024-04-18T04:45:22.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.692+0000 7f6d6a600640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d640c0010 con 0x7f6d64150020 2024-04-18T04:45:22.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.692+0000 7f6d6a600640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d640c08b0 con 0x7f6d640c0a40 2024-04-18T04:45:22.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.692+0000 7f6d63e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6d640c0a40 0x7f6d6406f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:22.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.692+0000 7f6d63e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6d640c0a40 0x7f6d6406f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35532/0 (socket says 172.21.15.120:35532) 2024-04-18T04:45:22.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.692+0000 7f6d63e00640 1 -- 172.21.15.120:0/1301513223 learned_addr learned my addr 172.21.15.120:0/1301513223 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:22.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.692+0000 7f6d62a00640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f6d640c7280 0x7f6d6415e4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:56138/0 (socket says 172.21.15.120:56138) 2024-04-18T04:45:22.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.692+0000 7f6d63e00640 1 -- 172.21.15.120:0/1301513223 >> v1:172.21.15.132:6789/0 conn(0x7f6d64150020 legacy=0x7f6d6406bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:22.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.692+0000 7f6d63e00640 1 -- 172.21.15.120:0/1301513223 >> v1:172.21.15.120:6789/0 conn(0x7f6d640c7280 legacy=0x7f6d6415e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:22.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.692+0000 7f6d63e00640 1 -- 172.21.15.120:0/1301513223 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d640c02f0 con 0x7f6d640c0a40 2024-04-18T04:45:22.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.692+0000 7f6d62000640 1 -- 172.21.15.120:0/1301513223 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3260322859 0 0) 0x7f6d64150400 con 0x7f6d640c7280 2024-04-18T04:45:22.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.696+0000 7f6d63e00640 1 --2- 172.21.15.120:0/1301513223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d640c0a40 0x7f6d6406f910 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c009870 tx=0x7f6d5c01ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=477bc94f01ccedc2 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:22.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.696+0000 7f6d62000640 1 -- 172.21.15.120:0/1301513223 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c0a8a50 con 0x7f6d640c0a40 2024-04-18T04:45:22.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.696+0000 7f6d62000640 1 -- 172.21.15.120:0/1301513223 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d5c0a8bb0 con 0x7f6d640c0a40 2024-04-18T04:45:22.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.696+0000 7f6d62000640 1 -- 172.21.15.120:0/1301513223 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c0b0440 con 0x7f6d640c0a40 2024-04-18T04:45:22.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.696+0000 7f6d6a600640 1 -- 172.21.15.120:0/1301513223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d640c0a40 msgr2=0x7f6d6406f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:22.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.696+0000 7f6d6a600640 1 --2- 172.21.15.120:0/1301513223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d640c0a40 0x7f6d6406f910 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c009870 tx=0x7f6d5c01ed50 comp rx=0 tx=0).stop 2024-04-18T04:45:22.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.696+0000 7f6d6a600640 1 -- 172.21.15.120:0/1301513223 shutdown_connections 2024-04-18T04:45:22.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.696+0000 7f6d6a600640 1 --2- 172.21.15.120:0/1301513223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d640c0a40 0x7f6d6406f910 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:22.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.696+0000 7f6d6a600640 1 -- 172.21.15.120:0/1301513223 >> 172.21.15.120:0/1301513223 conn(0x7f6d640c78c0 msgr2=0x7f6d640c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:22.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.696+0000 7f6d6a600640 1 -- 172.21.15.120:0/1301513223 shutdown_connections 2024-04-18T04:45:22.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.696+0000 7f6d6a600640 1 -- 172.21.15.120:0/1301513223 wait complete. 2024-04-18T04:45:22.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.696+0000 7f6d6a600640 1 Processor -- start 2024-04-18T04:45:22.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.696+0000 7f6d6a600640 1 -- start start 2024-04-18T04:45:22.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.696+0000 7f6d6a600640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d640c0a40 0x7f6d640c4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:22.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.696+0000 7f6d6a600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d640c7280 0x7f6d641e1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:22.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.696+0000 7f6d6a600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6d64150020 0x7f6d640c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:22.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.696+0000 7f6d6a600640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d64071450 con 0x7f6d640c7280 2024-04-18T04:45:22.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.696+0000 7f6d6a600640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d640c8fc0 con 0x7f6d640c0a40 2024-04-18T04:45:22.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.696+0000 7f6d6a600640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d640ae080 con 0x7f6d64150020 2024-04-18T04:45:22.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.696+0000 7f6d62a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d640c7280 0x7f6d641e1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:22.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.700+0000 7f6d62a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d640c7280 0x7f6d641e1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35534/0 (socket says 172.21.15.120:35534) 2024-04-18T04:45:22.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.700+0000 7f6d62a00640 1 -- 172.21.15.120:0/3543257634 learned_addr learned my addr 172.21.15.120:0/3543257634 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:22.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.700+0000 7f6d63e00640 1 --2- 172.21.15.120:0/3543257634 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6d64150020 0x7f6d640c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:22.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.700+0000 7f6d63400640 1 --2- 172.21.15.120:0/3543257634 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d640c0a40 0x7f6d640c4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:22.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.700+0000 7f6d62a00640 1 -- 172.21.15.120:0/3543257634 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6d64150020 msgr2=0x7f6d640c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:22.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.700+0000 7f6d62a00640 1 --2- 172.21.15.120:0/3543257634 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6d64150020 0x7f6d640c9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:22.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.700+0000 7f6d62a00640 1 -- 172.21.15.120:0/3543257634 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d640c0a40 msgr2=0x7f6d640c4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:22.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.700+0000 7f6d62a00640 1 --2- 172.21.15.120:0/3543257634 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d640c0a40 0x7f6d640c4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:22.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.700+0000 7f6d62a00640 1 -- 172.21.15.120:0/3543257634 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d5c0094d0 con 0x7f6d640c7280 2024-04-18T04:45:22.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.700+0000 7f6d63e00640 1 --2- 172.21.15.120:0/3543257634 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6d64150020 0x7f6d640c9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:22.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.700+0000 7f6d62a00640 1 --2- 172.21.15.120:0/3543257634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d640c7280 0x7f6d641e1470 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6d5000c510 tx=0x7f6d5000c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:22.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.700+0000 7f6d5b400640 1 -- 172.21.15.120:0/3543257634 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d50005d10 con 0x7f6d640c7280 2024-04-18T04:45:22.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.700+0000 7f6d5b400640 1 -- 172.21.15.120:0/3543257634 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d50005e90 con 0x7f6d640c7280 2024-04-18T04:45:22.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.700+0000 7f6d5b400640 1 -- 172.21.15.120:0/3543257634 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d500072b0 con 0x7f6d640c7280 2024-04-18T04:45:22.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.700+0000 7f6d6a600640 1 -- 172.21.15.120:0/3543257634 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d641e1e40 con 0x7f6d640c7280 2024-04-18T04:45:22.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.700+0000 7f6d6a600640 1 -- 172.21.15.120:0/3543257634 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d640c94f0 con 0x7f6d640c7280 2024-04-18T04:45:22.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.700+0000 7f6d6a600640 1 -- 172.21.15.120:0/3543257634 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d64073e10 con 0x7f6d640c7280 2024-04-18T04:45:22.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.700+0000 7f6d5b400640 1 -- 172.21.15.120:0/3543257634 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6d50007410 con 0x7f6d640c7280 2024-04-18T04:45:22.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.700+0000 7f6d5b400640 1 --2- 172.21.15.120:0/3543257634 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6d440666c0 0x7f6d44068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:22.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.700+0000 7f6d5b400640 1 -- 172.21.15.120:0/3543257634 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6d50084130 con 0x7f6d640c7280 2024-04-18T04:45:22.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.704+0000 7f6d63400640 1 --2- 172.21.15.120:0/3543257634 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6d440666c0 0x7f6d44068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:22.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.704+0000 7f6d63400640 1 --2- 172.21.15.120:0/3543257634 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6d440666c0 0x7f6d44068b80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6d540012f0 tx=0x7f6d54009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:22.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.704+0000 7f6d5b400640 1 -- 172.21.15.120:0/3543257634 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f6d50051100 con 0x7f6d640c7280 2024-04-18T04:45:22.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.891+0000 7f6d6a600640 1 -- 172.21.15.120:0/3543257634 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6d64072a70 con 0x7f6d640c7280 2024-04-18T04:45:22.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.891+0000 7f6d5b400640 1 -- 172.21.15.120:0/3543257634 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6289 (secure 0 0 0) 0x7f6d50054720 con 0x7f6d640c7280 2024-04-18T04:45:22.893 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:45:22.893 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/1552155328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1552155328},{"type":"v1","addr":"172.21.15.132:6835","nonce":1552155328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:45:08.005139+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.120:6833/2564667113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2564667113},{"type":"v1","addr":"172.21.15.120:6833","nonce":2564667113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:45:22.893 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 15 2024-04-18T04:45:22.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.891+0000 7f6d6a600640 1 -- 172.21.15.120:0/3543257634 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6d440666c0 msgr2=0x7f6d44068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:22.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.891+0000 7f6d6a600640 1 --2- 172.21.15.120:0/3543257634 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6d440666c0 0x7f6d44068b80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6d540012f0 tx=0x7f6d54009040 comp rx=0 tx=0).stop 2024-04-18T04:45:22.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.891+0000 7f6d6a600640 1 -- 172.21.15.120:0/3543257634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d640c7280 msgr2=0x7f6d641e1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:22.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.891+0000 7f6d6a600640 1 --2- 172.21.15.120:0/3543257634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d640c7280 0x7f6d641e1470 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6d5000c510 tx=0x7f6d5000c9d0 comp rx=0 tx=0).stop 2024-04-18T04:45:22.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.891+0000 7f6d6a600640 1 -- 172.21.15.120:0/3543257634 shutdown_connections 2024-04-18T04:45:22.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.891+0000 7f6d6a600640 1 --2- 172.21.15.120:0/3543257634 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6d440666c0 0x7f6d44068b80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:22.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.891+0000 7f6d6a600640 1 --2- 172.21.15.120:0/3543257634 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6d64150020 0x7f6d640c9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:22.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.891+0000 7f6d6a600640 1 --2- 172.21.15.120:0/3543257634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d640c7280 0x7f6d641e1470 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:22.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.891+0000 7f6d6a600640 1 --2- 172.21.15.120:0/3543257634 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d640c0a40 0x7f6d640c4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:22.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.891+0000 7f6d6a600640 1 -- 172.21.15.120:0/3543257634 >> 172.21.15.120:0/3543257634 conn(0x7f6d640c78c0 msgr2=0x7f6d6414f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:22.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.891+0000 7f6d6a600640 1 -- 172.21.15.120:0/3543257634 shutdown_connections 2024-04-18T04:45:22.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:22.891+0000 7f6d6a600640 1 -- 172.21.15.120:0/3543257634 wait complete. 2024-04-18T04:45:22.913 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T04:45:23.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.047+0000 7f0eb2800640 1 Processor -- start 2024-04-18T04:45:23.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.047+0000 7f0eb2800640 1 -- start start 2024-04-18T04:45:23.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.047+0000 7f0eb2800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0eac070750 0x7f0eac070be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:23.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.047+0000 7f0eb2800640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eac071120 con 0x7f0eac06b8c0 2024-04-18T04:45:23.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.047+0000 7f0eb2800640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eac1576f0 con 0x7f0eac0c7200 2024-04-18T04:45:23.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.047+0000 7f0eb2800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac158610 con 0x7f0eac070750 2024-04-18T04:45:23.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.047+0000 7f0eab400640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f0eac06b8c0 0x7f0eac06bca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:56152/0 (socket says 172.21.15.120:56152) 2024-04-18T04:45:23.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.047+0000 7f0eab400640 1 -- 172.21.15.120:0/2032499459 learned_addr learned my addr 172.21.15.120:0/2032499459 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:45:23.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.047+0000 7f0eabe00640 1 --2- 172.21.15.120:0/2032499459 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0eac070750 0x7f0eac070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:23.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.051+0000 7f0eaa000640 1 -- 172.21.15.120:0/2032499459 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2906524256 0 0) 0x7f0eac071120 con 0x7f0eac06b8c0 2024-04-18T04:45:23.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.051+0000 7f0eaa000640 1 -- 172.21.15.120:0/2032499459 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e90003530 con 0x7f0eac06b8c0 2024-04-18T04:45:23.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.051+0000 7f0eaa000640 1 -- 172.21.15.120:0/2032499459 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 48962089 0 0) 0x7f0e90003530 con 0x7f0eac06b8c0 2024-04-18T04:45:23.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.051+0000 7f0eaa000640 1 -- 172.21.15.120:0/2032499459 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0eac070750 msgr2=0x7f0eac070be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:23.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.051+0000 7f0eaa000640 1 --2- 172.21.15.120:0/2032499459 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0eac070750 0x7f0eac070be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:23.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.051+0000 7f0eaa000640 1 -- 172.21.15.120:0/2032499459 >> v1:172.21.15.132:6789/0 conn(0x7f0eac0c7200 legacy=0x7f0eac151440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:23.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.051+0000 7f0eaa000640 1 -- 172.21.15.120:0/2032499459 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eac157990 con 0x7f0eac06b8c0 2024-04-18T04:45:23.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.051+0000 7f0eaa000640 1 -- 172.21.15.120:0/2032499459 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7f0e9c001680 con 0x7f0eac06b8c0 2024-04-18T04:45:23.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.051+0000 7f0eaa000640 1 -- 172.21.15.120:0/2032499459 >> v1:172.21.15.120:6789/0 conn(0x7f0eac06b8c0 legacy=0x7f0eac06bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:23.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.051+0000 7f0eaa000640 1 --2- 172.21.15.120:0/2032499459 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0eac070750 0x7f0e900039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:23.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.051+0000 7f0eaa000640 1 --2- 172.21.15.120:0/2032499459 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e90003f30 0x7f0e900047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:23.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.051+0000 7f0eaa000640 1 --2- 172.21.15.120:0/2032499459 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e90004d10 0x7f0e90005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:23.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.051+0000 7f0eaa000640 1 -- 172.21.15.120:0/2032499459 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac158610 con 0x7f0e90003f30 2024-04-18T04:45:23.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.051+0000 7f0eaa000640 1 -- 172.21.15.120:0/2032499459 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9000bb00 con 0x7f0e90004d10 2024-04-18T04:45:23.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.051+0000 7f0eaa000640 1 -- 172.21.15.120:0/2032499459 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9000bcc0 con 0x7f0eac070750 2024-04-18T04:45:23.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.051+0000 7f0eaaa00640 1 --2- 172.21.15.120:0/2032499459 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e90003f30 0x7f0e900047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:23.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.051+0000 7f0eab400640 1 --2- 172.21.15.120:0/2032499459 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0eac070750 0x7f0e900039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:23.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.051+0000 7f0eabe00640 1 --2- 172.21.15.120:0/2032499459 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e90004d10 0x7f0e90005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:23.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.051+0000 7f0eaaa00640 1 -- 172.21.15.120:0/2032499459 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0eac070750 msgr2=0x7f0e900039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:23.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.051+0000 7f0eaaa00640 1 --2- 172.21.15.120:0/2032499459 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0eac070750 0x7f0e900039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:23.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.051+0000 7f0eaaa00640 1 -- 172.21.15.120:0/2032499459 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e90004d10 msgr2=0x7f0e90005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:45:23.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.051+0000 7f0eaaa00640 1 --2- 172.21.15.120:0/2032499459 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e90004d10 0x7f0e90005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:23.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.051+0000 7f0eaaa00640 1 -- 172.21.15.120:0/2032499459 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e90003530 con 0x7f0e90003f30 2024-04-18T04:45:23.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.051+0000 7f0eabe00640 1 --2- 172.21.15.120:0/2032499459 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e90004d10 0x7f0e90005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:45:23.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.055+0000 7f0eaaa00640 1 --2- 172.21.15.120:0/2032499459 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e90003f30 0x7f0e900047d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0e98001780 tx=0x7f0e9801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=954d2a56a4fae531 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:23.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.055+0000 7f0eaa000640 1 -- 172.21.15.120:0/2032499459 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e980052d0 con 0x7f0e90003f30 2024-04-18T04:45:23.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.055+0000 7f0eaa000640 1 -- 172.21.15.120:0/2032499459 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e98005450 con 0x7f0e90003f30 2024-04-18T04:45:23.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.055+0000 7f0eaa000640 1 -- 172.21.15.120:0/2032499459 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e98003840 con 0x7f0e90003f30 2024-04-18T04:45:23.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.055+0000 7f0eb2800640 1 -- 172.21.15.120:0/2032499459 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e90003f30 msgr2=0x7f0e900047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:23.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.055+0000 7f0eb2800640 1 --2- 172.21.15.120:0/2032499459 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e90003f30 0x7f0e900047d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0e98001780 tx=0x7f0e9801c420 comp rx=0 tx=0).stop 2024-04-18T04:45:23.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.055+0000 7f0eabe00640 1 -- 172.21.15.120:0/2032499459 reap_dead start 2024-04-18T04:45:23.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.055+0000 7f0eb2800640 1 -- 172.21.15.120:0/2032499459 shutdown_connections 2024-04-18T04:45:23.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.055+0000 7f0eb2800640 1 -- 172.21.15.120:0/2032499459 >> 172.21.15.120:0/2032499459 conn(0x7f0eac0c78c0 msgr2=0x7f0eac0c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:23.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.055+0000 7f0eb2800640 1 -- 172.21.15.120:0/2032499459 shutdown_connections 2024-04-18T04:45:23.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.055+0000 7f0eb2800640 1 -- 172.21.15.120:0/2032499459 wait complete. 2024-04-18T04:45:23.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.055+0000 7f0eb2800640 1 Processor -- start 2024-04-18T04:45:23.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.055+0000 7f0eb2800640 1 -- start start 2024-04-18T04:45:23.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.055+0000 7f0eb2800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e90003f30 0x7f0eac155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:23.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.055+0000 7f0eb2800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0eac154ad0 0x7f0eac1506c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:23.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.055+0000 7f0eb2800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0eac0c1860 0x7f0eac150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:23.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.055+0000 7f0eb2800640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac151140 con 0x7f0e90003f30 2024-04-18T04:45:23.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.055+0000 7f0eb2800640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac1f2080 con 0x7f0eac0c1860 2024-04-18T04:45:23.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.055+0000 7f0eb2800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac152480 con 0x7f0eac154ad0 2024-04-18T04:45:23.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.055+0000 7f0eab400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e90003f30 0x7f0eac155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:23.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.055+0000 7f0eab400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e90003f30 0x7f0eac155f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35546/0 (socket says 172.21.15.120:35546) 2024-04-18T04:45:23.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.055+0000 7f0eab400640 1 -- 172.21.15.120:0/573951917 learned_addr learned my addr 172.21.15.120:0/573951917 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:45:23.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.059+0000 7f0eabe00640 1 --2- 172.21.15.120:0/573951917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0eac0c1860 0x7f0eac150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:23.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.059+0000 7f0eaaa00640 1 --2- 172.21.15.120:0/573951917 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0eac154ad0 0x7f0eac1506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:23.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.059+0000 7f0eab400640 1 -- 172.21.15.120:0/573951917 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0eac154ad0 msgr2=0x7f0eac1506c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:23.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.059+0000 7f0eab400640 1 --2- 172.21.15.120:0/573951917 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0eac154ad0 0x7f0eac1506c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:23.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.059+0000 7f0eab400640 1 -- 172.21.15.120:0/573951917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0eac0c1860 msgr2=0x7f0eac150c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:23.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.059+0000 7f0eab400640 1 --2- 172.21.15.120:0/573951917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0eac0c1860 0x7f0eac150c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:23.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.059+0000 7f0eab400640 1 -- 172.21.15.120:0/573951917 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eac1f22f0 con 0x7f0e90003f30 2024-04-18T04:45:23.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.059+0000 7f0eabe00640 1 --2- 172.21.15.120:0/573951917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0eac0c1860 0x7f0eac150c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:45:23.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.059+0000 7f0eab400640 1 --2- 172.21.15.120:0/573951917 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e90003f30 0x7f0eac155f00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c0072c0 tx=0x7f0e9c007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:23.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.059+0000 7f0ea3400640 1 -- 172.21.15.120:0/573951917 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c00f940 con 0x7f0e90003f30 2024-04-18T04:45:23.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.059+0000 7f0ea3400640 1 -- 172.21.15.120:0/573951917 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e9c00faa0 con 0x7f0e90003f30 2024-04-18T04:45:23.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.059+0000 7f0ea3400640 1 -- 172.21.15.120:0/573951917 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c00fe30 con 0x7f0e90003f30 2024-04-18T04:45:23.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.059+0000 7f0eb2800640 1 -- 172.21.15.120:0/573951917 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eac1f25d0 con 0x7f0e90003f30 2024-04-18T04:45:23.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.059+0000 7f0eb2800640 1 -- 172.21.15.120:0/573951917 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eac0ca910 con 0x7f0e90003f30 2024-04-18T04:45:23.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.059+0000 7f0eb2800640 1 -- 172.21.15.120:0/573951917 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eac072a70 con 0x7f0e90003f30 2024-04-18T04:45:23.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.059+0000 7f0ea3400640 1 -- 172.21.15.120:0/573951917 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0e9c01d460 con 0x7f0e90003f30 2024-04-18T04:45:23.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.063+0000 7f0ea3400640 1 --2- 172.21.15.120:0/573951917 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0e8c0666c0 0x7f0e8c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:45:23.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.063+0000 7f0ea3400640 1 -- 172.21.15.120:0/573951917 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0e9c084710 con 0x7f0e90003f30 2024-04-18T04:45:23.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.063+0000 7f0eaaa00640 1 --2- 172.21.15.120:0/573951917 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0e8c0666c0 0x7f0e8c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:45:23.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.063+0000 7f0eaaa00640 1 --2- 172.21.15.120:0/573951917 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0e8c0666c0 0x7f0e8c068b80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0e98001750 tx=0x7f0e980011a0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:45:23.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.067+0000 7f0ea3400640 1 -- 172.21.15.120:0/573951917 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f0e9c0516c0 con 0x7f0e90003f30 2024-04-18T04:45:23.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.223+0000 7f0eb2800640 1 -- 172.21.15.120:0/573951917 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0eac1f2a80 con 0x7f0e90003f30 2024-04-18T04:45:23.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.223+0000 7f0ea3400640 1 -- 172.21.15.120:0/573951917 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18257 (secure 0 0 0) 0x7f0e9c054ce0 con 0x7f0e90003f30 2024-04-18T04:45:23.227 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:45:23.227 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":27,"fsid":"8e73592f-08e2-4957-a98f-9d044cec4ba5","created":"2024-04-18T04:44:06.139983+0000","modified":"2024-04-18T04:45:12.029792+0000","last_up_change":"2024-04-18T04:44:17.410146+0000","last_in_change":"2024-04-18T04:44:08.470250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T04:44:16.864728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T04:44:28.825773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T04:44:29.245857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-18T04:44:32.314302+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a80903bd-d9be-4fb9-af99-6125cb26bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":27468},{"type":"v1","addr":"172.21.15.120:6801","nonce":27468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":27468},{"type":"v1","addr":"172.21.15.120:6803","nonce":27468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":27468},{"type":"v1","addr":"172.21.15.120:6807","nonce":27468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":27468},{"type":"v1","addr":"172.21.15.120:6805","nonce":27468}]},"public_addr":"172.21.15.120:6801/27468","cluster_addr":"172.21.15.120:6803/27468","heartbeat_back_addr":"172.21.15.120:6807/27468","heartbeat_front_addr":"172.21.15.120:6805/27468","state":["exists","up"]},{"osd":1,"uuid":"8f5f004b-6870-4c78-8d50-9622e631ec25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":27470},{"type":"v1","addr":"172.21.15.120:6823","nonce":27470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":27470},{"type":"v1","addr":"172.21.15.120:6827","nonce":27470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":27470},{"type":"v1","addr":"172.21.15.120:6831","nonce":27470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":27470},{"type":"v1","addr":"172.21.15.120:6829","nonce":27470}]},"public_addr":"172.21.15.120:6823/27470","cluster_addr":"172.21.15.120:6827/27470","heartbeat_back_addr":"172.21.15.120:6831/27470","heartbeat_front_addr":"172.21.15.120:6829/27470","state":["exists","up"]},{"osd":2,"uuid":"6e228a2b-6103-4301-a8b5-ee81dbb1f920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":27471},{"type":"v1","addr":"172.21.15.120:6817","nonce":27471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":27471},{"type":"v1","addr":"172.21.15.120:6819","nonce":27471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":27471},{"type":"v1","addr":"172.21.15.120:6826","nonce":27471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":27471},{"type":"v1","addr":"172.21.15.120:6822","nonce":27471}]},"public_addr":"172.21.15.120:6817/27471","cluster_addr":"172.21.15.120:6819/27471","heartbeat_back_addr":"172.21.15.120:6826/27471","heartbeat_front_addr":"172.21.15.120:6822/27471","state":["exists","up"]},{"osd":3,"uuid":"7a5cabd7-d898-4e32-a03c-25b46e790134","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":27469},{"type":"v1","addr":"172.21.15.120:6809","nonce":27469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":27469},{"type":"v1","addr":"172.21.15.120:6811","nonce":27469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":27469},{"type":"v1","addr":"172.21.15.120:6815","nonce":27469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":27469},{"type":"v1","addr":"172.21.15.120:6813","nonce":27469}]},"public_addr":"172.21.15.120:6809/27469","cluster_addr":"172.21.15.120:6811/27469","heartbeat_back_addr":"172.21.15.120:6815/27469","heartbeat_front_addr":"172.21.15.120:6813/27469","state":["exists","up"]},{"osd":4,"uuid":"8e9f530f-6bab-4b23-a1a3-a71362fefcc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":28102},{"type":"v1","addr":"172.21.15.132:6825","nonce":28102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":28102},{"type":"v1","addr":"172.21.15.132:6827","nonce":28102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":28102},{"type":"v1","addr":"172.21.15.132:6831","nonce":28102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":28102},{"type":"v1","addr":"172.21.15.132:6829","nonce":28102}]},"public_addr":"172.21.15.132:6825/28102","cluster_addr":"172.21.15.132:6827/28102","heartbeat_back_addr":"172.21.15.132:6831/28102","heartbeat_front_addr":"172.21.15.132:6829/28102","state":["exists","up"]},{"osd":5,"uuid":"2243fabe-cc81-40cf-91bc-f106fe275a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":28104},{"type":"v1","addr":"172.21.15.132:6809","nonce":28104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":28104},{"type":"v1","addr":"172.21.15.132:6811","nonce":28104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":28104},{"type":"v1","addr":"172.21.15.132:6815","nonce":28104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":28104},{"type":"v1","addr":"172.21.15.132:6813","nonce":28104}]},"public_addr":"172.21.15.132:6809/28104","cluster_addr":"172.21.15.132:6811/28104","heartbeat_back_addr":"172.21.15.132:6815/28104","heartbeat_front_addr":"172.21.15.132:6813/28104","state":["exists","up"]},{"osd":6,"uuid":"c093a5ed-25c8-41a7-a20d-606a1a1661e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":28103},{"type":"v1","addr":"172.21.15.132:6801","nonce":28103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":28103},{"type":"v1","addr":"172.21.15.132:6803","nonce":28103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":28103},{"type":"v1","addr":"172.21.15.132:6807","nonce":28103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":28103},{"type":"v1","addr":"172.21.15.132:6805","nonce":28103}]},"public_addr":"172.21.15.132:6801/28103","cluster_addr":"172.21.15.132:6803/28103","heartbeat_back_addr":"172.21.15.132:6807/28103","heartbeat_front_addr":"172.21.15.132:6805/28103","state":["exists","up"]},{"osd":7,"uuid":"c37426b7-1080-4434-9f3e-a3afbbdc0fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":28129},{"type":"v1","addr":"172.21.15.132:6817","nonce":28129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":28129},{"type":"v1","addr":"172.21.15.132:6819","nonce":28129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":28129},{"type":"v1","addr":"172.21.15.132:6823","nonce":28129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":28129},{"type":"v1","addr":"172.21.15.132:6821","nonce":28129}]},"public_addr":"172.21.15.132:6817/28129","cluster_addr":"172.21.15.132:6819/28129","heartbeat_back_addr":"172.21.15.132:6823/28129","heartbeat_front_addr":"172.21.15.132:6821/28129","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.053825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.289753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.274645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.146361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.943883+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.701955+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.851076+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.800782+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":1}]},{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T04:45:23.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.227+0000 7f0eb2800640 1 -- 172.21.15.120:0/573951917 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0e8c0666c0 msgr2=0x7f0e8c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:23.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.227+0000 7f0eb2800640 1 --2- 172.21.15.120:0/573951917 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0e8c0666c0 0x7f0e8c068b80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0e98001750 tx=0x7f0e980011a0 comp rx=0 tx=0).stop 2024-04-18T04:45:23.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.227+0000 7f0eb2800640 1 -- 172.21.15.120:0/573951917 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e90003f30 msgr2=0x7f0eac155f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:45:23.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.227+0000 7f0eb2800640 1 --2- 172.21.15.120:0/573951917 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e90003f30 0x7f0eac155f00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c0072c0 tx=0x7f0e9c007780 comp rx=0 tx=0).stop 2024-04-18T04:45:23.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.227+0000 7f0eb2800640 1 -- 172.21.15.120:0/573951917 shutdown_connections 2024-04-18T04:45:23.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.227+0000 7f0eb2800640 1 --2- 172.21.15.120:0/573951917 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0e8c0666c0 0x7f0e8c068b80 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:23.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.227+0000 7f0eb2800640 1 --2- 172.21.15.120:0/573951917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0eac0c1860 0x7f0eac150c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:23.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.227+0000 7f0eb2800640 1 --2- 172.21.15.120:0/573951917 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0eac154ad0 0x7f0eac1506c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:23.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.227+0000 7f0eb2800640 1 --2- 172.21.15.120:0/573951917 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e90003f30 0x7f0eac155f00 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:45:23.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.227+0000 7f0eb2800640 1 -- 172.21.15.120:0/573951917 >> 172.21.15.120:0/573951917 conn(0x7f0eac0c78c0 msgr2=0x7f0eac0c9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:45:23.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.227+0000 7f0eb2800640 1 -- 172.21.15.120:0/573951917 shutdown_connections 2024-04-18T04:45:23.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:45:23.227+0000 7f0eb2800640 1 -- 172.21.15.120:0/573951917 wait complete. 2024-04-18T04:45:23.248 DEBUG:tasks.mds_thrash:Yielding 2024-04-18T04:45:23.248 INFO:teuthology.run_tasks:Running task workunit... 2024-04-18T04:45:23.260 INFO:tasks.workunit:Pulling workunits from ref 646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-18T04:45:23.261 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-18T04:45:23.261 INFO:tasks.workunit:timeout=3h 2024-04-18T04:45:23.261 INFO:tasks.workunit:cleanup=True 2024-04-18T04:45:23.261 DEBUG:teuthology.orchestra.run.smithi120:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-18T04:45:23.262 INFO:tasks.mds_thrash.fs.[cephfs]:starting mds_do_thrash for fs cephfs 2024-04-18T04:45:23.262 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 82 secs before thrashing 2024-04-18T04:45:23.270 INFO:teuthology.orchestra.run.smithi120.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-18T04:45:23.270 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-04-18T04:45:23.270 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 2ch/44d Inode: 1 Links: 2 2024-04-18T04:45:23.270 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T04:45:23.270 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-18T04:45:23.270 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-04-18 04:44:35.256926650 +0000 2024-04-18T04:45:23.270 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-04-18 04:44:44.307918058 +0000 2024-04-18T04:45:23.270 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-04-18 04:44:35.256926650 +0000 2024-04-18T04:45:23.271 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-18T04:45:23.271 DEBUG:teuthology.orchestra.run.smithi120:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-18T04:45:24.119 DEBUG:teuthology.orchestra.run.smithi120:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-18T04:45:24.131 INFO:tasks.workunit.client.0.smithi120.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-18T04:45:29.496 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:45:29.500 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:45:59.619 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:45:59.624 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:46:29.724 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:46:29.730 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:46:35.321 INFO:tasks.workunit.client.0.smithi120.stderr:Updating files: 71% (8970/12484) Updating files: 72% (8989/12484) Updating files: 73% (9114/12484) Updating files: 74% (9239/12484) Updating files: 75% (9363/12484) Updating files: 76% (9488/12484) Updating files: 77% (9613/12484) Updating files: 78% (9738/12484) Updating files: 79% (9863/12484) Updating files: 80% (9988/12484) Updating files: 81% (10113/12484) Updating files: 82% (10237/12484) Updating files: 83% (10362/12484) Updating files: 84% (10487/12484) Updating files: 85% (10612/12484) Updating files: 86% (10737/12484) Updating files: 87% (10862/12484) Updating files: 88% (10986/12484) Updating files: 89% (11111/12484) Updating files: 90% (11236/12484) Updating files: 91% (11361/12484) Updating files: 92% (11486/12484) Updating files: 93% (11611/12484) Updating files: 94% (11735/12484) Updating files: 95% (11860/12484) Updating files: 96% (11985/12484) Updating files: 97% (12110/12484) Updating files: 98% (12235/12484) Updating files: 99% (12360/12484) Updating files: 100% (12484/12484) Updating files: 100% (12484/12484), done. 2024-04-18T04:46:36.158 INFO:tasks.workunit.client.0.smithi120.stderr:Note: switching to '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'. 2024-04-18T04:46:36.158 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-04-18T04:46:36.158 INFO:tasks.workunit.client.0.smithi120.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-18T04:46:36.158 INFO:tasks.workunit.client.0.smithi120.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-18T04:46:36.159 INFO:tasks.workunit.client.0.smithi120.stderr:state without impacting any branches by switching back to a branch. 2024-04-18T04:46:36.159 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-04-18T04:46:36.159 INFO:tasks.workunit.client.0.smithi120.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-18T04:46:36.159 INFO:tasks.workunit.client.0.smithi120.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-18T04:46:36.159 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-04-18T04:46:36.159 INFO:tasks.workunit.client.0.smithi120.stderr: git switch -c 2024-04-18T04:46:36.159 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-04-18T04:46:36.159 INFO:tasks.workunit.client.0.smithi120.stderr:Or undo this operation with: 2024-04-18T04:46:36.159 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-04-18T04:46:36.159 INFO:tasks.workunit.client.0.smithi120.stderr: git switch - 2024-04-18T04:46:36.159 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-04-18T04:46:36.159 INFO:tasks.workunit.client.0.smithi120.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-18T04:46:36.159 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-04-18T04:46:36.160 INFO:tasks.workunit.client.0.smithi120.stderr:HEAD is now at 646b8c7d293 Merge pull request #56968 from zdover23/wip-doc-2024-04-18-backport-56879-to-reef 2024-04-18T04:46:36.173 DEBUG:teuthology.orchestra.run.smithi120:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-18T04:46:36.182 INFO:tasks.workunit.client.0.smithi120.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-18T04:46:36.184 INFO:tasks.workunit.client.0.smithi120.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-18T04:46:36.185 INFO:tasks.workunit.client.0.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-18T04:46:36.970 INFO:tasks.workunit.client.0.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-18T04:46:37.067 INFO:tasks.workunit.client.0.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-18T04:46:37.130 INFO:tasks.workunit.client.0.smithi120.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-18T04:46:37.132 INFO:tasks.workunit.client.0.smithi120.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-18T04:46:37.132 INFO:tasks.workunit.client.0.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-18T04:46:37.185 INFO:tasks.workunit.client.0.smithi120.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-18T04:46:37.190 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-18T04:46:37.190 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-18T04:46:37.244 INFO:tasks.workunit:Running workunits matching suites/ffsb.sh on client.0... 2024-04-18T04:46:37.245 INFO:tasks.workunit:Running workunit suites/ffsb.sh... 2024-04-18T04:46:37.245 DEBUG:teuthology.orchestra.run.smithi120:workunit test suites/ffsb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=646b8c7d293d8ec31a40c69f7b3237b19c1be24d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-04-18T04:46:37.317 INFO:tasks.workunit.client.0.smithi120.stderr:Cloning into 'ffsb'... 2024-04-18T04:46:44.782 INFO:tasks.workunit.client.0.smithi120.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-04-18T04:46:45.263 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:46:45.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.401+0000 7fc3b7e00640 1 Processor -- start 2024-04-18T04:46:45.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.401+0000 7fc3b7e00640 1 -- start start 2024-04-18T04:46:45.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.405+0000 7fc3b7e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc3b0150340 0x7fc3b0156430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:46:45.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.405+0000 7fc3b7e00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc3b0156970 0x7fc3b00c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:46:45.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.405+0000 7fc3b7e00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3b006f9b0 con 0x7fc3b00c7480 2024-04-18T04:46:45.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.405+0000 7fc3b7e00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3b00c0520 con 0x7fc3b0156970 2024-04-18T04:46:45.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.405+0000 7fc3b7e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b00c0800 con 0x7fc3b0150340 2024-04-18T04:46:45.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.405+0000 7fc3b4a00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc3b0156970 0x7fc3b00c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:46:45.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.405+0000 7fc3b4a00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc3b0156970 0x7fc3b00c68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:33152/0 (socket says 172.21.15.120:33152) 2024-04-18T04:46:45.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.405+0000 7fc3b4a00640 1 -- 172.21.15.120:0/2437506825 learned_addr learned my addr 172.21.15.120:0/2437506825 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:46:45.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.405+0000 7fc3b5400640 1 --2- 172.21.15.120:0/2437506825 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc3b0150340 0x7fc3b0156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:46:45.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.405+0000 7fc3b4a00640 1 -- 172.21.15.120:0/2437506825 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc3b0150340 msgr2=0x7fc3b0156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:46:45.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.405+0000 7fc3b4a00640 1 --2- 172.21.15.120:0/2437506825 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc3b0150340 0x7fc3b0156430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:45.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.405+0000 7fc3b4a00640 1 -- 172.21.15.120:0/2437506825 >> v1:172.21.15.132:6789/0 conn(0x7fc3b00c7480 legacy=0x7fc3b0159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:46:45.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.405+0000 7fc3b4a00640 1 -- 172.21.15.120:0/2437506825 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b006fc20 con 0x7fc3b0156970 2024-04-18T04:46:45.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.409+0000 7fc3b4a00640 1 --2- 172.21.15.120:0/2437506825 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3b0156970 0x7fc3b00c68d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc39c009870 tx=0x7fc39c01ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ff56dccf42258c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:46:45.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.409+0000 7fc3afe00640 1 -- 172.21.15.120:0/2437506825 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c0a8a50 con 0x7fc3b0156970 2024-04-18T04:46:45.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.409+0000 7fc3afe00640 1 -- 172.21.15.120:0/2437506825 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc39c0a8bb0 con 0x7fc3b0156970 2024-04-18T04:46:45.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.409+0000 7fc3afe00640 1 -- 172.21.15.120:0/2437506825 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c0b0440 con 0x7fc3b0156970 2024-04-18T04:46:45.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.409+0000 7fc3b7e00640 1 -- 172.21.15.120:0/2437506825 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3b0156970 msgr2=0x7fc3b00c68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:46:45.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.409+0000 7fc3b7e00640 1 --2- 172.21.15.120:0/2437506825 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3b0156970 0x7fc3b00c68d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc39c009870 tx=0x7fc39c01ed50 comp rx=0 tx=0).stop 2024-04-18T04:46:45.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.409+0000 7fc3b7e00640 1 -- 172.21.15.120:0/2437506825 shutdown_connections 2024-04-18T04:46:45.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.409+0000 7fc3b7e00640 1 --2- 172.21.15.120:0/2437506825 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3b0156970 0x7fc3b00c68d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:45.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.409+0000 7fc3b7e00640 1 --2- 172.21.15.120:0/2437506825 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc3b0150340 0x7fc3b0156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:45.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.409+0000 7fc3b7e00640 1 -- 172.21.15.120:0/2437506825 >> 172.21.15.120:0/2437506825 conn(0x7fc3b00c78c0 msgr2=0x7fc3b00c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:46:45.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.409+0000 7fc3b7e00640 1 -- 172.21.15.120:0/2437506825 shutdown_connections 2024-04-18T04:46:45.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.409+0000 7fc3b7e00640 1 -- 172.21.15.120:0/2437506825 wait complete. 2024-04-18T04:46:45.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.409+0000 7fc3b7e00640 1 Processor -- start 2024-04-18T04:46:45.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.409+0000 7fc3b7e00640 1 -- start start 2024-04-18T04:46:45.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.413+0000 7fc3b7e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3b00c7480 0x7fc3b01eec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:46:45.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.413+0000 7fc3b7e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3b0150340 0x7fc3b01f2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:46:45.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.413+0000 7fc3b7e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc3b00c9ae0 0x7fc3b0153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:46:45.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.413+0000 7fc3b7e00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b0152140 con 0x7fc3b00c7480 2024-04-18T04:46:45.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.413+0000 7fc3b7e00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b01f21e0 con 0x7fc3b0150340 2024-04-18T04:46:45.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.413+0000 7fc3b7e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b014a040 con 0x7fc3b00c9ae0 2024-04-18T04:46:45.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.413+0000 7fc3b5400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3b00c7480 0x7fc3b01eec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:46:45.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.413+0000 7fc3b5400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3b00c7480 0x7fc3b01eec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36064/0 (socket says 172.21.15.120:36064) 2024-04-18T04:46:45.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.413+0000 7fc3b5400640 1 -- 172.21.15.120:0/645671567 learned_addr learned my addr 172.21.15.120:0/645671567 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:46:45.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.413+0000 7fc3b4a00640 1 --2- 172.21.15.120:0/645671567 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3b0150340 0x7fc3b01f2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:46:45.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.413+0000 7fc3b5e00640 1 --2- 172.21.15.120:0/645671567 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc3b00c9ae0 0x7fc3b0153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:46:45.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.413+0000 7fc3b5400640 1 -- 172.21.15.120:0/645671567 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc3b00c9ae0 msgr2=0x7fc3b0153510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:46:45.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.413+0000 7fc3b5400640 1 --2- 172.21.15.120:0/645671567 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc3b00c9ae0 0x7fc3b0153510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:45.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.413+0000 7fc3b5400640 1 -- 172.21.15.120:0/645671567 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3b0150340 msgr2=0x7fc3b01f2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:46:45.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.413+0000 7fc3b5400640 1 --2- 172.21.15.120:0/645671567 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3b0150340 0x7fc3b01f2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:45.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.413+0000 7fc3b5400640 1 -- 172.21.15.120:0/645671567 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc39c0094d0 con 0x7fc3b00c7480 2024-04-18T04:46:45.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.413+0000 7fc3b4a00640 1 --2- 172.21.15.120:0/645671567 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3b0150340 0x7fc3b01f2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:46:45.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.413+0000 7fc3b5400640 1 --2- 172.21.15.120:0/645671567 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3b00c7480 0x7fc3b01eec70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4009db0 tx=0x7fc3a400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:46:45.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.413+0000 7fc3ad600640 1 -- 172.21.15.120:0/645671567 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a4014480 con 0x7fc3b00c7480 2024-04-18T04:46:45.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.413+0000 7fc3ad600640 1 -- 172.21.15.120:0/645671567 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a400f040 con 0x7fc3b00c7480 2024-04-18T04:46:45.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.413+0000 7fc3ad600640 1 -- 172.21.15.120:0/645671567 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a4014800 con 0x7fc3b00c7480 2024-04-18T04:46:45.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.413+0000 7fc3b7e00640 1 -- 172.21.15.120:0/645671567 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3b0154340 con 0x7fc3b00c7480 2024-04-18T04:46:45.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.413+0000 7fc3b7e00640 1 -- 172.21.15.120:0/645671567 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3b0154900 con 0x7fc3b00c7480 2024-04-18T04:46:45.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.413+0000 7fc3b7e00640 1 -- 172.21.15.120:0/645671567 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3b00726d0 con 0x7fc3b00c7480 2024-04-18T04:46:45.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.413+0000 7fc3ad600640 1 -- 172.21.15.120:0/645671567 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc3a4014960 con 0x7fc3b00c7480 2024-04-18T04:46:45.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.417+0000 7fc3ad600640 1 --2- 172.21.15.120:0/645671567 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc3900666c0 0x7fc390068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:46:45.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.417+0000 7fc3ad600640 1 -- 172.21.15.120:0/645671567 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc3a4085160 con 0x7fc3b00c7480 2024-04-18T04:46:45.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.417+0000 7fc3b4a00640 1 --2- 172.21.15.120:0/645671567 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc3900666c0 0x7fc390068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:46:45.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.417+0000 7fc3b4a00640 1 --2- 172.21.15.120:0/645671567 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc3900666c0 0x7fc390068b80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc39c0b2000 tx=0x7fc39c0aa070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:46:45.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.421+0000 7fc3ad600640 1 -- 172.21.15.120:0/645671567 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fc3a40521b0 con 0x7fc3b00c7480 2024-04-18T04:46:45.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.605+0000 7fc3b7e00640 1 -- 172.21.15.120:0/645671567 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc3b0073e10 con 0x7fc3b00c7480 2024-04-18T04:46:45.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.605+0000 7fc3ad600640 1 -- 172.21.15.120:0/645671567 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6289 (secure 0 0 0) 0x7fc3a40557d0 con 0x7fc3b00c7480 2024-04-18T04:46:45.608 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:46:45.608 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/1552155328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1552155328},{"type":"v1","addr":"172.21.15.132:6835","nonce":1552155328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:45:08.005139+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.120:6833/2564667113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2564667113},{"type":"v1","addr":"172.21.15.120:6833","nonce":2564667113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:46:45.608 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 15 2024-04-18T04:46:45.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.609+0000 7fc3b7e00640 1 -- 172.21.15.120:0/645671567 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc3900666c0 msgr2=0x7fc390068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:46:45.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.609+0000 7fc3b7e00640 1 --2- 172.21.15.120:0/645671567 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc3900666c0 0x7fc390068b80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc39c0b2000 tx=0x7fc39c0aa070 comp rx=0 tx=0).stop 2024-04-18T04:46:45.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.609+0000 7fc3b7e00640 1 -- 172.21.15.120:0/645671567 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3b00c7480 msgr2=0x7fc3b01eec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:46:45.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.609+0000 7fc3b7e00640 1 --2- 172.21.15.120:0/645671567 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3b00c7480 0x7fc3b01eec70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4009db0 tx=0x7fc3a400c490 comp rx=0 tx=0).stop 2024-04-18T04:46:45.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.609+0000 7fc3b7e00640 1 -- 172.21.15.120:0/645671567 shutdown_connections 2024-04-18T04:46:45.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.609+0000 7fc3b7e00640 1 --2- 172.21.15.120:0/645671567 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc3900666c0 0x7fc390068b80 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:45.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.609+0000 7fc3b7e00640 1 --2- 172.21.15.120:0/645671567 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc3b00c9ae0 0x7fc3b0153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:45.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.609+0000 7fc3b7e00640 1 --2- 172.21.15.120:0/645671567 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3b0150340 0x7fc3b01f2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:45.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.609+0000 7fc3b7e00640 1 --2- 172.21.15.120:0/645671567 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3b00c7480 0x7fc3b01eec70 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:45.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.609+0000 7fc3b7e00640 1 -- 172.21.15.120:0/645671567 >> 172.21.15.120:0/645671567 conn(0x7fc3b00c78c0 msgr2=0x7fc3b01496c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:46:45.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.609+0000 7fc3b7e00640 1 -- 172.21.15.120:0/645671567 shutdown_connections 2024-04-18T04:46:45.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.609+0000 7fc3b7e00640 1 -- 172.21.15.120:0/645671567 wait complete. 2024-04-18T04:46:45.628 INFO:tasks.mds_thrash.fs.[cephfs]:kill mds.c (rank=2) 2024-04-18T04:46:45.628 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-18T04:46:45.628 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T04:46:45.641 INFO:tasks.ceph.mds.c:Stopped 2024-04-18T04:46:45.641 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:46:45.793 INFO:tasks.workunit.client.0.smithi120.stdout:checking whether build environment is sane... yes 2024-04-18T04:46:45.808 INFO:tasks.workunit.client.0.smithi120.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-04-18T04:46:45.808 INFO:tasks.workunit.client.0.smithi120.stdout:checking for gawk... gawk 2024-04-18T04:46:45.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.825+0000 7f074c800640 1 Processor -- start 2024-04-18T04:46:45.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.825+0000 7f074c800640 1 -- start start 2024-04-18T04:46:45.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.825+0000 7f074c800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07441573c0 0x7f074406fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:46:45.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.825+0000 7f074c800640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f07440ccee0 0x7f07440cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:46:45.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.825+0000 7f074c800640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07441577f0 con 0x7f07441515e0 2024-04-18T04:46:45.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.825+0000 7f074c800640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07440cd830 con 0x7f07440ccee0 2024-04-18T04:46:45.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.825+0000 7f074c800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07440c3120 con 0x7f07441573c0 2024-04-18T04:46:45.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.825+0000 7f0749e00640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f07441515e0 0x7f07440ca280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:37298/0 (socket says 172.21.15.120:37298) 2024-04-18T04:46:45.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.825+0000 7f0749e00640 1 -- 172.21.15.120:0/1250976015 learned_addr learned my addr 172.21.15.120:0/1250976015 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:46:45.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.825+0000 7f074a800640 1 --2- 172.21.15.120:0/1250976015 >> v2:172.21.15.120:3300/0 conn(0x7f07440ccee0 0x7f07440cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:46:45.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.825+0000 7f0749400640 1 --2- 172.21.15.120:0/1250976015 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07441573c0 0x7f074406fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:46:45.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.825+0000 7f074a800640 1 -- 172.21.15.120:0/1250976015 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07441573c0 msgr2=0x7f074406fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:46:45.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.825+0000 7f074a800640 1 --2- 172.21.15.120:0/1250976015 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07441573c0 0x7f074406fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:45.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.825+0000 7f074a800640 1 -- 172.21.15.120:0/1250976015 >> v1:172.21.15.120:6789/0 conn(0x7f07441515e0 legacy=0x7f07440ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:46:45.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.825+0000 7f074a800640 1 -- 172.21.15.120:0/1250976015 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0744157a50 con 0x7f07440ccee0 2024-04-18T04:46:45.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.825+0000 7f0748a00640 1 -- 172.21.15.120:0/1250976015 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2854353482 0 0) 0x7f07441577f0 con 0x7f07441515e0 2024-04-18T04:46:45.829 INFO:tasks.workunit.client.0.smithi120.stdout:checking whether make sets $(MAKE)... yes 2024-04-18T04:46:45.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.829+0000 7f074a800640 1 --2- 172.21.15.120:0/1250976015 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07440ccee0 0x7f07440cd2f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0740009d90 tx=0x7f074001f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beb6eb9fbb75cd11 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:46:45.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.829+0000 7f0748a00640 1 -- 172.21.15.120:0/1250976015 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07400af600 con 0x7f07440ccee0 2024-04-18T04:46:45.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.829+0000 7f0748a00640 1 -- 172.21.15.120:0/1250976015 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07400ab050 con 0x7f07440ccee0 2024-04-18T04:46:45.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.829+0000 7f0748a00640 1 -- 172.21.15.120:0/1250976015 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07400af980 con 0x7f07440ccee0 2024-04-18T04:46:45.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.829+0000 7f074c800640 1 -- 172.21.15.120:0/1250976015 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07440ccee0 msgr2=0x7f07440cd2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:46:45.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.829+0000 7f074c800640 1 --2- 172.21.15.120:0/1250976015 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07440ccee0 0x7f07440cd2f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0740009d90 tx=0x7f074001f150 comp rx=0 tx=0).stop 2024-04-18T04:46:45.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.829+0000 7f074c800640 1 -- 172.21.15.120:0/1250976015 shutdown_connections 2024-04-18T04:46:45.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.829+0000 7f074c800640 1 --2- 172.21.15.120:0/1250976015 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07440ccee0 0x7f07440cd2f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:45.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.829+0000 7f074c800640 1 --2- 172.21.15.120:0/1250976015 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07441573c0 0x7f074406fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:45.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.829+0000 7f074c800640 1 -- 172.21.15.120:0/1250976015 >> 172.21.15.120:0/1250976015 conn(0x7f074406e0f0 msgr2=0x7f0744071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:46:45.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.829+0000 7f074c800640 1 -- 172.21.15.120:0/1250976015 shutdown_connections 2024-04-18T04:46:45.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.829+0000 7f074c800640 1 -- 172.21.15.120:0/1250976015 wait complete. 2024-04-18T04:46:45.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.833+0000 7f074c800640 1 Processor -- start 2024-04-18T04:46:45.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.833+0000 7f074c800640 1 -- start start 2024-04-18T04:46:45.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.833+0000 7f074c800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07440ccee0 0x7f07441565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:46:45.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.833+0000 7f074c800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07441515e0 0x7f074415abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:46:45.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.833+0000 7f074c800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07441573c0 0x7f07441ee440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:46:45.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.833+0000 7f074c800640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07440b21c0 con 0x7f07441515e0 2024-04-18T04:46:45.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.833+0000 7f074c800640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0744155210 con 0x7f07441573c0 2024-04-18T04:46:45.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.833+0000 7f074c800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07441554b0 con 0x7f07440ccee0 2024-04-18T04:46:45.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.833+0000 7f0749400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07441515e0 0x7f074415abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:46:45.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.833+0000 7f0749400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07441515e0 0x7f074415abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36074/0 (socket says 172.21.15.120:36074) 2024-04-18T04:46:45.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.833+0000 7f0749400640 1 -- 172.21.15.120:0/2922989556 learned_addr learned my addr 172.21.15.120:0/2922989556 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:46:45.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.833+0000 7f0749e00640 1 --2- 172.21.15.120:0/2922989556 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07440ccee0 0x7f07441565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:46:45.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.833+0000 7f074a800640 1 --2- 172.21.15.120:0/2922989556 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07441573c0 0x7f07441ee440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:46:45.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.833+0000 7f0749400640 1 -- 172.21.15.120:0/2922989556 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07440ccee0 msgr2=0x7f07441565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:46:45.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.833+0000 7f0749400640 1 --2- 172.21.15.120:0/2922989556 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07440ccee0 0x7f07441565b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:45.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.833+0000 7f0749400640 1 -- 172.21.15.120:0/2922989556 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07441573c0 msgr2=0x7f07441ee440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:46:45.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.833+0000 7f0749400640 1 --2- 172.21.15.120:0/2922989556 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07441573c0 0x7f07441ee440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:45.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.833+0000 7f0749400640 1 -- 172.21.15.120:0/2922989556 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0740009a70 con 0x7f07441515e0 2024-04-18T04:46:45.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.833+0000 7f0749400640 1 --2- 172.21.15.120:0/2922989556 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07441515e0 0x7f074415abc0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f073400e870 tx=0x7f073400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:46:45.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.833+0000 7f073e000640 1 -- 172.21.15.120:0/2922989556 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0734009510 con 0x7f07441515e0 2024-04-18T04:46:45.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.833+0000 7f073e000640 1 -- 172.21.15.120:0/2922989556 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f073400eec0 con 0x7f07441515e0 2024-04-18T04:46:45.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.833+0000 7f074c800640 1 -- 172.21.15.120:0/2922989556 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0744155790 con 0x7f07441515e0 2024-04-18T04:46:45.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.833+0000 7f073e000640 1 -- 172.21.15.120:0/2922989556 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073400cb40 con 0x7f07441515e0 2024-04-18T04:46:45.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.833+0000 7f074c800640 1 -- 172.21.15.120:0/2922989556 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07440b1e50 con 0x7f07441515e0 2024-04-18T04:46:45.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.833+0000 7f074c800640 1 -- 172.21.15.120:0/2922989556 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0744072a70 con 0x7f07441515e0 2024-04-18T04:46:45.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.837+0000 7f073e000640 1 -- 172.21.15.120:0/2922989556 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f073400cca0 con 0x7f07441515e0 2024-04-18T04:46:45.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.837+0000 7f073e000640 1 --2- 172.21.15.120:0/2922989556 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f07280666c0 0x7f0728068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:46:45.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.837+0000 7f073e000640 1 -- 172.21.15.120:0/2922989556 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0734084a10 con 0x7f07441515e0 2024-04-18T04:46:45.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.837+0000 7f0749e00640 1 --2- 172.21.15.120:0/2922989556 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f07280666c0 0x7f0728068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:46:45.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.837+0000 7f0749e00640 1 --2- 172.21.15.120:0/2922989556 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f07280666c0 0x7f0728068b80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0738007fd0 tx=0x7f0738009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:46:45.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:45.841+0000 7f073e000640 1 -- 172.21.15.120:0/2922989556 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f0734051940 con 0x7f07441515e0 2024-04-18T04:46:45.898 INFO:tasks.workunit.client.0.smithi120.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-04-18T04:46:45.899 INFO:tasks.workunit.client.0.smithi120.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-04-18T04:46:45.913 INFO:tasks.workunit.client.0.smithi120.stdout:checking for style of include used by make... GNU 2024-04-18T04:46:45.919 INFO:tasks.workunit.client.0.smithi120.stdout:checking for gcc... gcc 2024-04-18T04:46:46.004 INFO:tasks.workunit.client.0.smithi120.stdout:checking for C compiler default output file name... a.out 2024-04-18T04:46:46.008 INFO:tasks.workunit.client.0.smithi120.stdout:checking whether the C compiler works... yes 2024-04-18T04:46:46.012 INFO:tasks.workunit.client.0.smithi120.stdout:checking whether we are cross compiling... no 2024-04-18T04:46:46.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:46.041+0000 7f074c800640 1 -- 172.21.15.120:0/2922989556 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07440b2300 con 0x7f07441515e0 2024-04-18T04:46:46.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:46.041+0000 7f073e000640 1 -- 172.21.15.120:0/2922989556 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6289 (secure 0 0 0) 0x7f0734017090 con 0x7f07441515e0 2024-04-18T04:46:46.043 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:46:46.043 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/1552155328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1552155328},{"type":"v1","addr":"172.21.15.132:6835","nonce":1552155328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:45:08.005139+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.120:6833/2564667113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2564667113},{"type":"v1","addr":"172.21.15.120:6833","nonce":2564667113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:46:46.044 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 15 2024-04-18T04:46:46.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:46.045+0000 7f074c800640 1 -- 172.21.15.120:0/2922989556 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f07280666c0 msgr2=0x7f0728068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:46:46.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:46.045+0000 7f074c800640 1 --2- 172.21.15.120:0/2922989556 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f07280666c0 0x7f0728068b80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0738007fd0 tx=0x7f0738009040 comp rx=0 tx=0).stop 2024-04-18T04:46:46.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:46.045+0000 7f074c800640 1 -- 172.21.15.120:0/2922989556 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07441515e0 msgr2=0x7f074415abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:46:46.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:46.045+0000 7f074c800640 1 --2- 172.21.15.120:0/2922989556 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07441515e0 0x7f074415abc0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f073400e870 tx=0x7f073400ec70 comp rx=0 tx=0).stop 2024-04-18T04:46:46.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:46.045+0000 7f074c800640 1 -- 172.21.15.120:0/2922989556 shutdown_connections 2024-04-18T04:46:46.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:46.045+0000 7f074c800640 1 --2- 172.21.15.120:0/2922989556 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f07280666c0 0x7f0728068b80 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:46.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:46.045+0000 7f074c800640 1 --2- 172.21.15.120:0/2922989556 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07441573c0 0x7f07441ee440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:46.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:46.045+0000 7f074c800640 1 --2- 172.21.15.120:0/2922989556 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07441515e0 0x7f074415abc0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:46.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:46.045+0000 7f074c800640 1 --2- 172.21.15.120:0/2922989556 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07440ccee0 0x7f07441565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:46.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:46.045+0000 7f074c800640 1 -- 172.21.15.120:0/2922989556 >> 172.21.15.120:0/2922989556 conn(0x7f074406e0f0 msgr2=0x7f074414f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:46:46.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:46.045+0000 7f074c800640 1 -- 172.21.15.120:0/2922989556 shutdown_connections 2024-04-18T04:46:46.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:46.045+0000 7f074c800640 1 -- 172.21.15.120:0/2922989556 wait complete. 2024-04-18T04:46:46.065 INFO:tasks.workunit.client.0.smithi120.stdout:checking for suffix of executables... 2024-04-18T04:46:46.067 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-18T04:46:46.108 INFO:tasks.workunit.client.0.smithi120.stdout:checking for suffix of object files... o 2024-04-18T04:46:46.147 INFO:tasks.workunit.client.0.smithi120.stdout:checking whether we are using the GNU C compiler... yes 2024-04-18T04:46:46.187 INFO:tasks.workunit.client.0.smithi120.stdout:checking whether gcc accepts -g... yes 2024-04-18T04:46:46.317 INFO:tasks.workunit.client.0.smithi120.stdout:checking for gcc option to accept ISO C89... none needed 2024-04-18T04:46:46.435 INFO:tasks.workunit.client.0.smithi120.stdout:checking dependency style of gcc... gcc3 2024-04-18T04:46:46.531 INFO:tasks.workunit.client.0.smithi120.stdout:checking how to run the C preprocessor... gcc -E 2024-04-18T04:46:46.592 INFO:tasks.workunit.client.0.smithi120.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-04-18T04:46:46.594 INFO:tasks.workunit.client.0.smithi120.stdout:checking for egrep... /usr/bin/grep -E 2024-04-18T04:46:46.609 INFO:tasks.workunit.client.0.smithi120.stdout:checking for AIX... no 2024-04-18T04:46:46.634 INFO:tasks.workunit.client.0.smithi120.stdout:checking for gcc... (cached) gcc 2024-04-18T04:46:46.651 INFO:tasks.workunit.client.0.smithi120.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-04-18T04:46:46.653 INFO:tasks.workunit.client.0.smithi120.stdout:checking whether gcc accepts -g... (cached) yes 2024-04-18T04:46:46.653 INFO:tasks.workunit.client.0.smithi120.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-04-18T04:46:46.653 INFO:tasks.workunit.client.0.smithi120.stdout:checking dependency style of gcc... (cached) gcc3 2024-04-18T04:46:46.737 INFO:tasks.workunit.client.0.smithi120.stdout:checking for main in -lm... yes 2024-04-18T04:46:46.813 INFO:tasks.workunit.client.0.smithi120.stdout:checking for main in -lpthread... yes 2024-04-18T04:46:47.043 INFO:tasks.workunit.client.0.smithi120.stdout:checking for ANSI C header files... yes 2024-04-18T04:46:47.124 INFO:tasks.workunit.client.0.smithi120.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-04-18T04:46:47.189 INFO:tasks.workunit.client.0.smithi120.stdout:checking for sys/types.h... yes 2024-04-18T04:46:47.258 INFO:tasks.workunit.client.0.smithi120.stdout:checking for sys/stat.h... yes 2024-04-18T04:46:47.326 INFO:tasks.workunit.client.0.smithi120.stdout:checking for stdlib.h... yes 2024-04-18T04:46:47.395 INFO:tasks.workunit.client.0.smithi120.stdout:checking for string.h... yes 2024-04-18T04:46:47.478 INFO:tasks.workunit.client.0.smithi120.stdout:checking for memory.h... yes 2024-04-18T04:46:47.546 INFO:tasks.workunit.client.0.smithi120.stdout:checking for strings.h... yes 2024-04-18T04:46:47.614 INFO:tasks.workunit.client.0.smithi120.stdout:checking for inttypes.h... yes 2024-04-18T04:46:47.683 INFO:tasks.workunit.client.0.smithi120.stdout:checking for stdint.h... yes 2024-04-18T04:46:47.759 INFO:tasks.workunit.client.0.smithi120.stdout:checking for unistd.h... yes 2024-04-18T04:46:47.839 INFO:tasks.workunit.client.0.smithi120.stdout:checking pthread.h usability... yes 2024-04-18T04:46:48.067 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:46:48.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.205+0000 7f200fe00640 1 Processor -- start 2024-04-18T04:46:48.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.205+0000 7f200fe00640 1 -- start start 2024-04-18T04:46:48.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.205+0000 7f200fe00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2010151510 0x7f20100718e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:46:48.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.205+0000 7f200fe00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f20100c3670 0x7f20100c3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:46:48.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.205+0000 7f200fe00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f201006f7b0 con 0x7f201015b260 2024-04-18T04:46:48.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.205+0000 7f200fe00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2010071fa0 con 0x7f20100c3670 2024-04-18T04:46:48.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.205+0000 7f200fe00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20101573a0 con 0x7f2010151510 2024-04-18T04:46:48.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.205+0000 7f200f400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f20100c3670 0x7f20100c3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:46:48.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.205+0000 7f200f400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f20100c3670 0x7f20100c3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:33178/0 (socket says 172.21.15.120:33178) 2024-04-18T04:46:48.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.205+0000 7f200f400640 1 -- 172.21.15.120:0/2695779114 learned_addr learned my addr 172.21.15.120:0/2695779114 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:46:48.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.205+0000 7f200ea00640 1 --2- 172.21.15.120:0/2695779114 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2010151510 0x7f20100718e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:46:48.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.205+0000 7f200f400640 1 -- 172.21.15.120:0/2695779114 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2010151510 msgr2=0x7f20100718e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:46:48.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.205+0000 7f200f400640 1 --2- 172.21.15.120:0/2695779114 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2010151510 0x7f20100718e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:48.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.205+0000 7f200f400640 1 -- 172.21.15.120:0/2695779114 >> v1:172.21.15.132:6789/0 conn(0x7f201015b260 legacy=0x7f201006f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:46:48.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.205+0000 7f200f400640 1 -- 172.21.15.120:0/2695779114 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2010157680 con 0x7f20100c3670 2024-04-18T04:46:48.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.209+0000 7f200f400640 1 --2- 172.21.15.120:0/2695779114 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f20100c3670 0x7f20100c3ac0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2008009e50 tx=0x7f200801ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98a6987de032f68c server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:46:48.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.209+0000 7f200d600640 1 -- 172.21.15.120:0/2695779114 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20080a5900 con 0x7f20100c3670 2024-04-18T04:46:48.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.209+0000 7f200d600640 1 -- 172.21.15.120:0/2695779114 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20080a5a60 con 0x7f20100c3670 2024-04-18T04:46:48.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.209+0000 7f200d600640 1 -- 172.21.15.120:0/2695779114 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20080a5df0 con 0x7f20100c3670 2024-04-18T04:46:48.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.209+0000 7f200fe00640 1 -- 172.21.15.120:0/2695779114 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f20100c3670 msgr2=0x7f20100c3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:46:48.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.209+0000 7f200fe00640 1 --2- 172.21.15.120:0/2695779114 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f20100c3670 0x7f20100c3ac0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2008009e50 tx=0x7f200801ca30 comp rx=0 tx=0).stop 2024-04-18T04:46:48.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.209+0000 7f200fe00640 1 -- 172.21.15.120:0/2695779114 shutdown_connections 2024-04-18T04:46:48.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.209+0000 7f200fe00640 1 --2- 172.21.15.120:0/2695779114 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f20100c3670 0x7f20100c3ac0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:48.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.209+0000 7f200fe00640 1 --2- 172.21.15.120:0/2695779114 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2010151510 0x7f20100718e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:48.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.209+0000 7f200fe00640 1 -- 172.21.15.120:0/2695779114 >> 172.21.15.120:0/2695779114 conn(0x7f201006df20 msgr2=0x7f2010069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:46:48.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.209+0000 7f200fe00640 1 -- 172.21.15.120:0/2695779114 shutdown_connections 2024-04-18T04:46:48.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.209+0000 7f200fe00640 1 -- 172.21.15.120:0/2695779114 wait complete. 2024-04-18T04:46:48.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.213+0000 7f200fe00640 1 Processor -- start 2024-04-18T04:46:48.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.213+0000 7f200fe00640 1 -- start start 2024-04-18T04:46:48.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.213+0000 7f200fe00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f20100c3670 0x7f20101456c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:46:48.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.213+0000 7f200fe00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2010151510 0x7f20100cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:46:48.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.213+0000 7f200fe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f201015b260 0x7f20100cb120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:46:48.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.213+0000 7f200fe00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f201006baf0 con 0x7f201015b260 2024-04-18T04:46:48.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.213+0000 7f200fe00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f201006cfb0 con 0x7f20100c3670 2024-04-18T04:46:48.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.213+0000 7f200fe00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2010141090 con 0x7f2010151510 2024-04-18T04:46:48.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.213+0000 7f200f400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f201015b260 0x7f20100cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:46:48.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.213+0000 7f200ea00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f20100c3670 0x7f20101456c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:46:48.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.213+0000 7f200f400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f201015b260 0x7f20100cb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36090/0 (socket says 172.21.15.120:36090) 2024-04-18T04:46:48.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.213+0000 7f200f400640 1 -- 172.21.15.120:0/1002830358 learned_addr learned my addr 172.21.15.120:0/1002830358 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:46:48.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.213+0000 7f200e000640 1 --2- 172.21.15.120:0/1002830358 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2010151510 0x7f20100cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:46:48.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.213+0000 7f200f400640 1 -- 172.21.15.120:0/1002830358 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2010151510 msgr2=0x7f20100cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:46:48.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.213+0000 7f200f400640 1 --2- 172.21.15.120:0/1002830358 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2010151510 0x7f20100cabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:48.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.213+0000 7f200f400640 1 -- 172.21.15.120:0/1002830358 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f20100c3670 msgr2=0x7f20101456c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:46:48.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.213+0000 7f200f400640 1 --2- 172.21.15.120:0/1002830358 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f20100c3670 0x7f20101456c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:48.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.213+0000 7f200f400640 1 -- 172.21.15.120:0/1002830358 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2008009b30 con 0x7f201015b260 2024-04-18T04:46:48.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.213+0000 7f200f400640 1 --2- 172.21.15.120:0/1002830358 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f201015b260 0x7f20100cb120 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f200801a660 tx=0x7f20080197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:46:48.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.213+0000 7f2006a00640 1 -- 172.21.15.120:0/1002830358 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20080b8670 con 0x7f201015b260 2024-04-18T04:46:48.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.213+0000 7f2006a00640 1 -- 172.21.15.120:0/1002830358 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20080b87d0 con 0x7f201015b260 2024-04-18T04:46:48.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.213+0000 7f200fe00640 1 -- 172.21.15.120:0/1002830358 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f201006b150 con 0x7f201015b260 2024-04-18T04:46:48.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.213+0000 7f2006a00640 1 -- 172.21.15.120:0/1002830358 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20080b8b80 con 0x7f201015b260 2024-04-18T04:46:48.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.213+0000 7f200fe00640 1 -- 172.21.15.120:0/1002830358 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f201006b710 con 0x7f201015b260 2024-04-18T04:46:48.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.217+0000 7f200fe00640 1 -- 172.21.15.120:0/1002830358 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f201006bc30 con 0x7f201015b260 2024-04-18T04:46:48.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.217+0000 7f2006a00640 1 -- 172.21.15.120:0/1002830358 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f20080b8ce0 con 0x7f201015b260 2024-04-18T04:46:48.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.217+0000 7f2006a00640 1 --2- 172.21.15.120:0/1002830358 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1ff0066690 0x7f1ff0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:46:48.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.217+0000 7f2006a00640 1 -- 172.21.15.120:0/1002830358 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f200811f990 con 0x7f201015b260 2024-04-18T04:46:48.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.217+0000 7f200ea00640 1 --2- 172.21.15.120:0/1002830358 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1ff0066690 0x7f1ff0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:46:48.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.217+0000 7f200ea00640 1 --2- 172.21.15.120:0/1002830358 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1ff0066690 0x7f1ff0068b50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2000009b60 tx=0x7f2000009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:46:48.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.221+0000 7f2006a00640 1 -- 172.21.15.120:0/1002830358 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f201006bc30 con 0x7f201015b260 2024-04-18T04:46:48.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.405+0000 7f200fe00640 1 -- 172.21.15.120:0/1002830358 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f201006bc30 con 0x7f201015b260 2024-04-18T04:46:48.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.409+0000 7f2006a00640 1 -- 172.21.15.120:0/1002830358 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6289 (secure 0 0 0) 0x7f201006bc30 con 0x7f201015b260 2024-04-18T04:46:48.409 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:46:48.409 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/1552155328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1552155328},{"type":"v1","addr":"172.21.15.132:6835","nonce":1552155328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:45:08.005139+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.120:6833/2564667113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2564667113},{"type":"v1","addr":"172.21.15.120:6833","nonce":2564667113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:46:48.409 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 15 2024-04-18T04:46:48.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.409+0000 7f200fe00640 1 -- 172.21.15.120:0/1002830358 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1ff0066690 msgr2=0x7f1ff0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:46:48.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.409+0000 7f200fe00640 1 --2- 172.21.15.120:0/1002830358 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1ff0066690 0x7f1ff0068b50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2000009b60 tx=0x7f2000009190 comp rx=0 tx=0).stop 2024-04-18T04:46:48.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.409+0000 7f200fe00640 1 -- 172.21.15.120:0/1002830358 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f201015b260 msgr2=0x7f20100cb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:46:48.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.409+0000 7f200fe00640 1 --2- 172.21.15.120:0/1002830358 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f201015b260 0x7f20100cb120 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f200801a660 tx=0x7f20080197d0 comp rx=0 tx=0).stop 2024-04-18T04:46:48.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.409+0000 7f200fe00640 1 -- 172.21.15.120:0/1002830358 shutdown_connections 2024-04-18T04:46:48.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.409+0000 7f200fe00640 1 --2- 172.21.15.120:0/1002830358 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1ff0066690 0x7f1ff0068b50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:48.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.409+0000 7f200fe00640 1 --2- 172.21.15.120:0/1002830358 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f201015b260 0x7f20100cb120 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:48.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.409+0000 7f200fe00640 1 --2- 172.21.15.120:0/1002830358 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2010151510 0x7f20100cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:48.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.409+0000 7f200fe00640 1 --2- 172.21.15.120:0/1002830358 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f20100c3670 0x7f20101456c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:48.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.409+0000 7f200fe00640 1 -- 172.21.15.120:0/1002830358 >> 172.21.15.120:0/1002830358 conn(0x7f201006df20 msgr2=0x7f2010069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:46:48.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.409+0000 7f200fe00640 1 -- 172.21.15.120:0/1002830358 shutdown_connections 2024-04-18T04:46:48.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:48.409+0000 7f200fe00640 1 -- 172.21.15.120:0/1002830358 wait complete. 2024-04-18T04:46:48.430 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-18T04:46:48.819 INFO:tasks.workunit.client.0.smithi120.stdout:checking pthread.h presence... yes 2024-04-18T04:46:48.820 INFO:tasks.workunit.client.0.smithi120.stdout:checking for pthread.h... yes 2024-04-18T04:46:48.923 INFO:tasks.workunit.client.0.smithi120.stdout:checking fcntl.h usability... yes 2024-04-18T04:46:48.951 INFO:tasks.workunit.client.0.smithi120.stdout:checking fcntl.h presence... yes 2024-04-18T04:46:48.951 INFO:tasks.workunit.client.0.smithi120.stdout:checking for fcntl.h... yes 2024-04-18T04:46:49.027 INFO:tasks.workunit.client.0.smithi120.stdout:checking limits.h usability... yes 2024-04-18T04:46:49.054 INFO:tasks.workunit.client.0.smithi120.stdout:checking limits.h presence... yes 2024-04-18T04:46:49.055 INFO:tasks.workunit.client.0.smithi120.stdout:checking for limits.h... yes 2024-04-18T04:46:49.077 INFO:tasks.workunit.client.0.smithi120.stdout:checking for stdint.h... (cached) yes 2024-04-18T04:46:49.156 INFO:tasks.workunit.client.0.smithi120.stdout:checking sys/time.h usability... yes 2024-04-18T04:46:49.184 INFO:tasks.workunit.client.0.smithi120.stdout:checking sys/time.h presence... yes 2024-04-18T04:46:49.185 INFO:tasks.workunit.client.0.smithi120.stdout:checking for sys/time.h... yes 2024-04-18T04:46:49.456 INFO:tasks.workunit.client.0.smithi120.stdout:checking for unistd.h... (cached) yes 2024-04-18T04:46:49.531 INFO:tasks.workunit.client.0.smithi120.stdout:checking sys/vfs.h usability... yes 2024-04-18T04:46:49.558 INFO:tasks.workunit.client.0.smithi120.stdout:checking sys/vfs.h presence... yes 2024-04-18T04:46:49.559 INFO:tasks.workunit.client.0.smithi120.stdout:checking for sys/vfs.h... yes 2024-04-18T04:46:49.645 INFO:tasks.workunit.client.0.smithi120.stdout:checking sys/limits.h usability... no 2024-04-18T04:46:49.673 INFO:tasks.workunit.client.0.smithi120.stdout:checking sys/limits.h presence... no 2024-04-18T04:46:49.674 INFO:tasks.workunit.client.0.smithi120.stdout:checking for sys/limits.h... no 2024-04-18T04:46:49.717 INFO:tasks.workunit.client.0.smithi120.stdout:checking for an ANSI C-conforming const... yes 2024-04-18T04:46:49.761 INFO:tasks.workunit.client.0.smithi120.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-04-18T04:46:49.762 INFO:tasks.workunit.client.0.smithi120.stdout:checking for function prototypes... yes 2024-04-18T04:46:49.808 INFO:tasks.workunit.client.0.smithi120.stdout:checking whether setvbuf arguments are reversed... no 2024-04-18T04:46:49.900 INFO:tasks.workunit.client.0.smithi120.stdout:checking for system... yes 2024-04-18T04:46:49.989 INFO:tasks.workunit.client.0.smithi120.stdout:checking for gettimeofday... yes 2024-04-18T04:46:50.081 INFO:tasks.workunit.client.0.smithi120.stdout:checking for mkdir... yes 2024-04-18T04:46:50.172 INFO:tasks.workunit.client.0.smithi120.stdout:checking for strerror... yes 2024-04-18T04:46:50.260 INFO:tasks.workunit.client.0.smithi120.stdout:checking for open64... yes 2024-04-18T04:46:50.351 INFO:tasks.workunit.client.0.smithi120.stdout:checking for stat64... yes 2024-04-18T04:46:50.431 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:46:50.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.565+0000 7f1d81c00640 1 Processor -- start 2024-04-18T04:46:50.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.565+0000 7f1d81c00640 1 -- start start 2024-04-18T04:46:50.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.565+0000 7f1d81c00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1d7c150340 0x7f1d7c156430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:46:50.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.565+0000 7f1d81c00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1d7c156970 0x7f1d7c0c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:46:50.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.565+0000 7f1d81c00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d7c06f9b0 con 0x7f1d7c0c7480 2024-04-18T04:46:50.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.565+0000 7f1d81c00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d7c0c0520 con 0x7f1d7c150340 2024-04-18T04:46:50.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.565+0000 7f1d81c00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c0c0800 con 0x7f1d7c156970 2024-04-18T04:46:50.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.565+0000 7f1d7aa00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1d7c150340 0x7f1d7c156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:46:50.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.565+0000 7f1d7aa00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1d7c150340 0x7f1d7c156430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36102/0 (socket says 172.21.15.120:36102) 2024-04-18T04:46:50.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.565+0000 7f1d7aa00640 1 -- 172.21.15.120:0/818364338 learned_addr learned my addr 172.21.15.120:0/818364338 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:46:50.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.565+0000 7f1d72000640 1 --2- 172.21.15.120:0/818364338 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1d7c156970 0x7f1d7c0c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:46:50.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.565+0000 7f1d7aa00640 1 -- 172.21.15.120:0/818364338 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1d7c156970 msgr2=0x7f1d7c0c68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:46:50.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.565+0000 7f1d7aa00640 1 --2- 172.21.15.120:0/818364338 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1d7c156970 0x7f1d7c0c68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:50.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.565+0000 7f1d7aa00640 1 -- 172.21.15.120:0/818364338 >> v1:172.21.15.132:6789/0 conn(0x7f1d7c0c7480 legacy=0x7f1d7c159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:46:50.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.569+0000 7f1d7aa00640 1 -- 172.21.15.120:0/818364338 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7c06fc20 con 0x7f1d7c150340 2024-04-18T04:46:50.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.569+0000 7f1d7aa00640 1 --2- 172.21.15.120:0/818364338 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d7c150340 0x7f1d7c156430 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c009870 tx=0x7f1d6c01ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b831e35cc5c71a03 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:46:50.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.569+0000 7f1d7a000640 1 -- 172.21.15.120:0/818364338 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c0a8a50 con 0x7f1d7c150340 2024-04-18T04:46:50.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.569+0000 7f1d7a000640 1 -- 172.21.15.120:0/818364338 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6c0a8bb0 con 0x7f1d7c150340 2024-04-18T04:46:50.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.569+0000 7f1d7a000640 1 -- 172.21.15.120:0/818364338 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c0b0440 con 0x7f1d7c150340 2024-04-18T04:46:50.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.569+0000 7f1d81c00640 1 -- 172.21.15.120:0/818364338 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d7c150340 msgr2=0x7f1d7c156430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:46:50.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.569+0000 7f1d81c00640 1 --2- 172.21.15.120:0/818364338 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d7c150340 0x7f1d7c156430 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c009870 tx=0x7f1d6c01ed50 comp rx=0 tx=0).stop 2024-04-18T04:46:50.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.569+0000 7f1d81c00640 1 -- 172.21.15.120:0/818364338 shutdown_connections 2024-04-18T04:46:50.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.569+0000 7f1d81c00640 1 --2- 172.21.15.120:0/818364338 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1d7c156970 0x7f1d7c0c68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:50.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.569+0000 7f1d81c00640 1 --2- 172.21.15.120:0/818364338 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d7c150340 0x7f1d7c156430 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:50.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.569+0000 7f1d81c00640 1 -- 172.21.15.120:0/818364338 >> 172.21.15.120:0/818364338 conn(0x7f1d7c0c78c0 msgr2=0x7f1d7c0c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:46:50.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.569+0000 7f1d81c00640 1 -- 172.21.15.120:0/818364338 shutdown_connections 2024-04-18T04:46:50.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.569+0000 7f1d81c00640 1 -- 172.21.15.120:0/818364338 wait complete. 2024-04-18T04:46:50.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.573+0000 7f1d81c00640 1 Processor -- start 2024-04-18T04:46:50.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.573+0000 7f1d81c00640 1 -- start start 2024-04-18T04:46:50.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.573+0000 7f1d81c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d7c0c7480 0x7f1d7c157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:46:50.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.573+0000 7f1d81c00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1d7c150340 0x7f1d7c157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:46:50.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.573+0000 7f1d81c00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d7c14eef0 0x7f1d7c147050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:46:50.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.573+0000 7f1d81c00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c145800 con 0x7f1d7c0c7480 2024-04-18T04:46:50.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.573+0000 7f1d81c00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c146c00 con 0x7f1d7c14eef0 2024-04-18T04:46:50.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.573+0000 7f1d81c00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c15a650 con 0x7f1d7c150340 2024-04-18T04:46:50.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.573+0000 7f1d7aa00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d7c0c7480 0x7f1d7c157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:46:50.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.573+0000 7f1d7aa00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d7c0c7480 0x7f1d7c157850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36118/0 (socket says 172.21.15.120:36118) 2024-04-18T04:46:50.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.573+0000 7f1d7aa00640 1 -- 172.21.15.120:0/2284274399 learned_addr learned my addr 172.21.15.120:0/2284274399 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:46:50.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.573+0000 7f1d72000640 1 --2- 172.21.15.120:0/2284274399 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1d7c150340 0x7f1d7c157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:46:50.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.573+0000 7f1d7b400640 1 --2- 172.21.15.120:0/2284274399 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d7c14eef0 0x7f1d7c147050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:46:50.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.573+0000 7f1d7aa00640 1 -- 172.21.15.120:0/2284274399 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1d7c150340 msgr2=0x7f1d7c157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:46:50.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.573+0000 7f1d7aa00640 1 --2- 172.21.15.120:0/2284274399 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1d7c150340 0x7f1d7c157d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:50.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.573+0000 7f1d7aa00640 1 -- 172.21.15.120:0/2284274399 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d7c14eef0 msgr2=0x7f1d7c147050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:46:50.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.573+0000 7f1d7aa00640 1 --2- 172.21.15.120:0/2284274399 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d7c14eef0 0x7f1d7c147050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:50.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.573+0000 7f1d7aa00640 1 -- 172.21.15.120:0/2284274399 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d6c0094d0 con 0x7f1d7c0c7480 2024-04-18T04:46:50.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.573+0000 7f1d7b400640 1 --2- 172.21.15.120:0/2284274399 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d7c14eef0 0x7f1d7c147050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:46:50.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.573+0000 7f1d7aa00640 1 --2- 172.21.15.120:0/2284274399 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d7c0c7480 0x7f1d7c157850 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c0b3040 tx=0x7f1d6c01baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:46:50.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.573+0000 7f1d73400640 1 -- 172.21.15.120:0/2284274399 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c0be070 con 0x7f1d7c0c7480 2024-04-18T04:46:50.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.573+0000 7f1d73400640 1 -- 172.21.15.120:0/2284274399 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6c0ba400 con 0x7f1d7c0c7480 2024-04-18T04:46:50.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.573+0000 7f1d81c00640 1 -- 172.21.15.120:0/2284274399 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d7c1467c0 con 0x7f1d7c0c7480 2024-04-18T04:46:50.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.573+0000 7f1d73400640 1 -- 172.21.15.120:0/2284274399 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c0ba7d0 con 0x7f1d7c0c7480 2024-04-18T04:46:50.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.573+0000 7f1d81c00640 1 -- 172.21.15.120:0/2284274399 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d7c159d20 con 0x7f1d7c0c7480 2024-04-18T04:46:50.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.577+0000 7f1d81c00640 1 -- 172.21.15.120:0/2284274399 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d7c0726d0 con 0x7f1d7c0c7480 2024-04-18T04:46:50.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.577+0000 7f1d73400640 1 -- 172.21.15.120:0/2284274399 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1d6c0c3410 con 0x7f1d7c0c7480 2024-04-18T04:46:50.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.577+0000 7f1d73400640 1 --2- 172.21.15.120:0/2284274399 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1d58066690 0x7f1d58068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:46:50.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.577+0000 7f1d73400640 1 -- 172.21.15.120:0/2284274399 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1d6c1221c0 con 0x7f1d7c0c7480 2024-04-18T04:46:50.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.577+0000 7f1d72000640 1 --2- 172.21.15.120:0/2284274399 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1d58066690 0x7f1d58068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:46:50.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.577+0000 7f1d72000640 1 --2- 172.21.15.120:0/2284274399 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1d58066690 0x7f1d58068b50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c0c5400 tx=0x7f1d64008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:46:50.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.581+0000 7f1d73400640 1 -- 172.21.15.120:0/2284274399 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f1d6c0ef170 con 0x7f1d7c0c7480 2024-04-18T04:46:50.691 INFO:tasks.workunit.client.0.smithi120.stdout:checking for fseeko64... yes 2024-04-18T04:46:50.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.777+0000 7f1d81c00640 1 -- 172.21.15.120:0/2284274399 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d7c073e10 con 0x7f1d7c0c7480 2024-04-18T04:46:50.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.777+0000 7f1d73400640 1 -- 172.21.15.120:0/2284274399 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6289 (secure 0 0 0) 0x7f1d6c0f2790 con 0x7f1d7c0c7480 2024-04-18T04:46:50.778 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:46:50.778 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/1552155328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1552155328},{"type":"v1","addr":"172.21.15.132:6835","nonce":1552155328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:45:08.005139+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.120:6833/2564667113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2564667113},{"type":"v1","addr":"172.21.15.120:6833","nonce":2564667113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:46:50.778 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 15 2024-04-18T04:46:50.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.777+0000 7f1d81c00640 1 -- 172.21.15.120:0/2284274399 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1d58066690 msgr2=0x7f1d58068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:46:50.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.777+0000 7f1d81c00640 1 --2- 172.21.15.120:0/2284274399 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1d58066690 0x7f1d58068b50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c0c5400 tx=0x7f1d64008040 comp rx=0 tx=0).stop 2024-04-18T04:46:50.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.777+0000 7f1d81c00640 1 -- 172.21.15.120:0/2284274399 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d7c0c7480 msgr2=0x7f1d7c157850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:46:50.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.777+0000 7f1d81c00640 1 --2- 172.21.15.120:0/2284274399 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d7c0c7480 0x7f1d7c157850 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c0b3040 tx=0x7f1d6c01baf0 comp rx=0 tx=0).stop 2024-04-18T04:46:50.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.777+0000 7f1d81c00640 1 -- 172.21.15.120:0/2284274399 shutdown_connections 2024-04-18T04:46:50.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.777+0000 7f1d81c00640 1 --2- 172.21.15.120:0/2284274399 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1d58066690 0x7f1d58068b50 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:50.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.777+0000 7f1d81c00640 1 --2- 172.21.15.120:0/2284274399 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d7c14eef0 0x7f1d7c147050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:50.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.777+0000 7f1d81c00640 1 --2- 172.21.15.120:0/2284274399 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1d7c150340 0x7f1d7c157d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:50.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.777+0000 7f1d81c00640 1 --2- 172.21.15.120:0/2284274399 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d7c0c7480 0x7f1d7c157850 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:50.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.777+0000 7f1d81c00640 1 -- 172.21.15.120:0/2284274399 >> 172.21.15.120:0/2284274399 conn(0x7f1d7c0c78c0 msgr2=0x7f1d7c0c7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:46:50.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.777+0000 7f1d81c00640 1 -- 172.21.15.120:0/2284274399 shutdown_connections 2024-04-18T04:46:50.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:50.777+0000 7f1d81c00640 1 -- 172.21.15.120:0/2284274399 wait complete. 2024-04-18T04:46:50.784 INFO:tasks.workunit.client.0.smithi120.stdout:checking for lrand48_r... yes 2024-04-18T04:46:50.801 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-18T04:46:50.874 INFO:tasks.workunit.client.0.smithi120.stdout:checking for srand48_r... yes 2024-04-18T04:46:50.919 INFO:tasks.workunit.client.0.smithi120.stdout:configure: creating ./config.status 2024-04-18T04:46:51.108 INFO:tasks.workunit.client.0.smithi120.stdout:config.status: creating Makefile 2024-04-18T04:46:51.136 INFO:tasks.workunit.client.0.smithi120.stdout:config.status: creating config.h 2024-04-18T04:46:51.165 INFO:tasks.workunit.client.0.smithi120.stdout:config.status: executing depfiles commands 2024-04-18T04:46:51.243 INFO:tasks.workunit.client.0.smithi120.stdout:config.status: executing default commands 2024-04-18T04:46:52.211 INFO:tasks.workunit.client.0.smithi120.stdout:cd . && /bin/bash /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run aclocal-1.10 2024-04-18T04:46:52.214 INFO:tasks.workunit.client.0.smithi120.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: aclocal-1.10: command not found 2024-04-18T04:46:52.216 INFO:tasks.workunit.client.0.smithi120.stderr:WARNING: `aclocal-1.10' is missing on your system. You should only need it if 2024-04-18T04:46:52.216 INFO:tasks.workunit.client.0.smithi120.stderr: you modified `acinclude.m4' or `configure.in'. You might want 2024-04-18T04:46:52.216 INFO:tasks.workunit.client.0.smithi120.stderr: to install the `Automake' and `Perl' packages. Grab them from 2024-04-18T04:46:52.217 INFO:tasks.workunit.client.0.smithi120.stderr: any GNU archive site. 2024-04-18T04:46:52.224 INFO:tasks.workunit.client.0.smithi120.stdout: cd . && /bin/bash /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run automake-1.10 --gnu 2024-04-18T04:46:52.227 INFO:tasks.workunit.client.0.smithi120.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: automake-1.10: command not found 2024-04-18T04:46:52.229 INFO:tasks.workunit.client.0.smithi120.stderr:WARNING: `automake-1.10' is missing on your system. You should only need it if 2024-04-18T04:46:52.229 INFO:tasks.workunit.client.0.smithi120.stderr: you modified `Makefile.am', `acinclude.m4' or `configure.in'. 2024-04-18T04:46:52.229 INFO:tasks.workunit.client.0.smithi120.stderr: You might want to install the `Automake' and `Perl' packages. 2024-04-18T04:46:52.229 INFO:tasks.workunit.client.0.smithi120.stderr: Grab them from any GNU archive site. 2024-04-18T04:46:52.298 INFO:tasks.workunit.client.0.smithi120.stdout:cd . && /bin/bash /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoconf 2024-04-18T04:46:52.475 INFO:tasks.workunit.client.0.smithi120.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2024-04-18T04:46:52.475 INFO:tasks.workunit.client.0.smithi120.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2024-04-18T04:46:52.475 INFO:tasks.workunit.client.0.smithi120.stderr:If you have problems, you may need to regenerate the build system entirely. 2024-04-18T04:46:52.475 INFO:tasks.workunit.client.0.smithi120.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2024-04-18T04:46:52.563 INFO:tasks.workunit.client.0.smithi120.stderr:configure.in:4: warning: The macro `AC_FOREACH' is obsolete. 2024-04-18T04:46:52.564 INFO:tasks.workunit.client.0.smithi120.stderr:configure.in:4: You should run autoupdate. 2024-04-18T04:46:52.564 INFO:tasks.workunit.client.0.smithi120.stderr:./lib/autoconf/general.m4:191: AC_FOREACH is expanded from... 2024-04-18T04:46:52.564 INFO:tasks.workunit.client.0.smithi120.stderr:aclocal.m4:684: _AM_SET_OPTIONS is expanded from... 2024-04-18T04:46:52.564 INFO:tasks.workunit.client.0.smithi120.stderr:aclocal.m4:410: AM_INIT_AUTOMAKE is expanded from... 2024-04-18T04:46:52.564 INFO:tasks.workunit.client.0.smithi120.stderr:configure.in:4: the top level 2024-04-18T04:46:52.564 INFO:tasks.workunit.client.0.smithi120.stderr:configure.in:6: warning: The macro `AM_CONFIG_HEADER' is obsolete. 2024-04-18T04:46:52.564 INFO:tasks.workunit.client.0.smithi120.stderr:configure.in:6: You should run autoupdate. 2024-04-18T04:46:52.564 INFO:tasks.workunit.client.0.smithi120.stderr:aclocal.m4:383: AM_CONFIG_HEADER is expanded from... 2024-04-18T04:46:52.564 INFO:tasks.workunit.client.0.smithi120.stderr:configure.in:6: the top level 2024-04-18T04:46:52.564 INFO:tasks.workunit.client.0.smithi120.stderr:configure.in:10: warning: The macro `AC_AIX' is obsolete. 2024-04-18T04:46:52.564 INFO:tasks.workunit.client.0.smithi120.stderr:configure.in:10: You should run autoupdate. 2024-04-18T04:46:52.564 INFO:tasks.workunit.client.0.smithi120.stderr:./lib/autoconf/specific.m4:540: AC_AIX is expanded from... 2024-04-18T04:46:52.565 INFO:tasks.workunit.client.0.smithi120.stderr:configure.in:10: the top level 2024-04-18T04:46:52.565 INFO:tasks.workunit.client.0.smithi120.stderr:configure.in:36: warning: The macro `AC_HEADER_STDC' is obsolete. 2024-04-18T04:46:52.565 INFO:tasks.workunit.client.0.smithi120.stderr:configure.in:36: You should run autoupdate. 2024-04-18T04:46:52.565 INFO:tasks.workunit.client.0.smithi120.stderr:./lib/autoconf/headers.m4:704: AC_HEADER_STDC is expanded from... 2024-04-18T04:46:52.565 INFO:tasks.workunit.client.0.smithi120.stderr:configure.in:36: the top level 2024-04-18T04:46:52.565 INFO:tasks.workunit.client.0.smithi120.stderr:configure.in:42: warning: The macro `AC_HEADER_TIME' is obsolete. 2024-04-18T04:46:52.565 INFO:tasks.workunit.client.0.smithi120.stderr:configure.in:42: You should run autoupdate. 2024-04-18T04:46:52.565 INFO:tasks.workunit.client.0.smithi120.stderr:./lib/autoconf/headers.m4:743: AC_HEADER_TIME is expanded from... 2024-04-18T04:46:52.565 INFO:tasks.workunit.client.0.smithi120.stderr:configure.in:42: the top level 2024-04-18T04:46:52.565 INFO:tasks.workunit.client.0.smithi120.stderr:configure.in:45: warning: The macro `AC_FUNC_SETVBUF_REVERSED' is obsolete. Remove it and all references to SETVBUF_REVERSED. 2024-04-18T04:46:52.565 INFO:tasks.workunit.client.0.smithi120.stderr:./lib/autoconf/functions.m4:1766: AC_FUNC_SETVBUF_REVERSED is expanded from... 2024-04-18T04:46:52.565 INFO:tasks.workunit.client.0.smithi120.stderr:configure.in:45: the top level 2024-04-18T04:46:52.565 INFO:tasks.workunit.client.0.smithi120.stderr:configure.in:50: warning: AC_OUTPUT should be used without arguments. 2024-04-18T04:46:52.566 INFO:tasks.workunit.client.0.smithi120.stderr:configure.in:50: You should run autoupdate. 2024-04-18T04:46:52.617 INFO:tasks.workunit.client.0.smithi120.stdout:/bin/bash ./config.status --recheck 2024-04-18T04:46:52.723 INFO:tasks.workunit.client.0.smithi120.stdout:running CONFIG_SHELL=/bin/bash /bin/bash ./configure --no-create --no-recursion 2024-04-18T04:46:52.801 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:46:52.890 INFO:tasks.workunit.client.0.smithi120.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-04-18T04:46:52.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.945+0000 7f8d91200640 1 Processor -- start 2024-04-18T04:46:52.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.945+0000 7f8d91200640 1 -- start start 2024-04-18T04:46:52.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.945+0000 7f8d91200640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8d8c06b8c0 0x7f8d8c0c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:46:52.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.945+0000 7f8d91200640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8d8c06c0f0 0x7f8d8c070750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:46:52.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.945+0000 7f8d91200640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d8c06c560 con 0x7f8d8c06bca0 2024-04-18T04:46:52.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.945+0000 7f8d91200640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d8c158610 con 0x7f8d8c06b8c0 2024-04-18T04:46:52.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.945+0000 7f8d91200640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d8c0c7740 con 0x7f8d8c06c0f0 2024-04-18T04:46:52.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.945+0000 7f8d89e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8d8c06b8c0 0x7f8d8c0c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:46:52.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.945+0000 7f8d89e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8d8c06b8c0 0x7f8d8c0c7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60538/0 (socket says 172.21.15.120:60538) 2024-04-18T04:46:52.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.945+0000 7f8d89e00640 1 -- 172.21.15.120:0/1713321104 learned_addr learned my addr 172.21.15.120:0/1713321104 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:46:52.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.945+0000 7f8d8a800640 1 --2- 172.21.15.120:0/1713321104 >> v2:172.21.15.132:3300/0 conn(0x7f8d8c06c0f0 0x7f8d8c070750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:46:52.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.945+0000 7f8d89e00640 1 -- 172.21.15.120:0/1713321104 >> v2:172.21.15.132:3300/0 conn(0x7f8d8c06c0f0 msgr2=0x7f8d8c070750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:46:52.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.945+0000 7f8d89e00640 1 --2- 172.21.15.120:0/1713321104 >> v2:172.21.15.132:3300/0 conn(0x7f8d8c06c0f0 0x7f8d8c070750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:52.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.945+0000 7f8d89e00640 1 -- 172.21.15.120:0/1713321104 >> v1:172.21.15.120:6789/0 conn(0x7f8d8c06bca0 legacy=0x7f8d8c151440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:46:52.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.945+0000 7f8d89e00640 1 -- 172.21.15.120:0/1713321104 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d8c1576f0 con 0x7f8d8c06b8c0 2024-04-18T04:46:52.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.949+0000 7f8d89e00640 1 --2- 172.21.15.120:0/1713321104 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d8c06b8c0 0x7f8d8c0c7200 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c15bc70 tx=0x7f8d7c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9483594724a98767 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:46:52.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.949+0000 7f8d88a00640 1 -- 172.21.15.120:0/1713321104 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c0a8a10 con 0x7f8d8c06b8c0 2024-04-18T04:46:52.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.949+0000 7f8d88a00640 1 -- 172.21.15.120:0/1713321104 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d7c0a8b70 con 0x7f8d8c06b8c0 2024-04-18T04:46:52.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.949+0000 7f8d88a00640 1 -- 172.21.15.120:0/1713321104 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c0b0440 con 0x7f8d8c06b8c0 2024-04-18T04:46:52.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.949+0000 7f8d91200640 1 -- 172.21.15.120:0/1713321104 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d8c06b8c0 msgr2=0x7f8d8c0c7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:46:52.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.949+0000 7f8d91200640 1 --2- 172.21.15.120:0/1713321104 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d8c06b8c0 0x7f8d8c0c7200 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c15bc70 tx=0x7f8d7c01ed10 comp rx=0 tx=0).stop 2024-04-18T04:46:52.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.949+0000 7f8d91200640 1 -- 172.21.15.120:0/1713321104 shutdown_connections 2024-04-18T04:46:52.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.949+0000 7f8d91200640 1 --2- 172.21.15.120:0/1713321104 >> v2:172.21.15.132:3300/0 conn(0x7f8d8c06c0f0 0x7f8d8c070750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:52.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.949+0000 7f8d91200640 1 --2- 172.21.15.120:0/1713321104 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d8c06b8c0 0x7f8d8c0c7200 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:52.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.949+0000 7f8d91200640 1 -- 172.21.15.120:0/1713321104 >> 172.21.15.120:0/1713321104 conn(0x7f8d8c0c78c0 msgr2=0x7f8d8c0c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:46:52.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.949+0000 7f8d91200640 1 -- 172.21.15.120:0/1713321104 shutdown_connections 2024-04-18T04:46:52.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.949+0000 7f8d91200640 1 -- 172.21.15.120:0/1713321104 wait complete. 2024-04-18T04:46:52.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.949+0000 7f8d91200640 1 Processor -- start 2024-04-18T04:46:52.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.949+0000 7f8d91200640 1 -- start start 2024-04-18T04:46:52.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.953+0000 7f8d91200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8d8c06b8c0 0x7f8d8c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:46:52.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.953+0000 7f8d91200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d8c06bca0 0x7f8d8c15aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:46:52.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.953+0000 7f8d91200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d8c06c0f0 0x7f8d8c0c3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:46:52.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.953+0000 7f8d91200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c14f750 con 0x7f8d8c06bca0 2024-04-18T04:46:52.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.953+0000 7f8d91200640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c1f2370 con 0x7f8d8c06c0f0 2024-04-18T04:46:52.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.953+0000 7f8d91200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c1f2ef0 con 0x7f8d8c06b8c0 2024-04-18T04:46:52.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.953+0000 7f8d89400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d8c06bca0 0x7f8d8c15aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:46:52.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.953+0000 7f8d89400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d8c06bca0 0x7f8d8c15aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60552/0 (socket says 172.21.15.120:60552) 2024-04-18T04:46:52.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.953+0000 7f8d89400640 1 -- 172.21.15.120:0/1393023708 learned_addr learned my addr 172.21.15.120:0/1393023708 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:46:52.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.953+0000 7f8d8a800640 1 --2- 172.21.15.120:0/1393023708 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d8c06c0f0 0x7f8d8c0c3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:46:52.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.953+0000 7f8d89e00640 1 --2- 172.21.15.120:0/1393023708 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8d8c06b8c0 0x7f8d8c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:46:52.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.953+0000 7f8d89400640 1 -- 172.21.15.120:0/1393023708 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8d8c06b8c0 msgr2=0x7f8d8c06d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:46:52.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.953+0000 7f8d89400640 1 --2- 172.21.15.120:0/1393023708 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8d8c06b8c0 0x7f8d8c06d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:52.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.953+0000 7f8d89400640 1 -- 172.21.15.120:0/1393023708 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d8c06c0f0 msgr2=0x7f8d8c0c3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:46:52.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.953+0000 7f8d89400640 1 --2- 172.21.15.120:0/1393023708 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d8c06c0f0 0x7f8d8c0c3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:52.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.953+0000 7f8d89400640 1 -- 172.21.15.120:0/1393023708 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d7c0094d0 con 0x7f8d8c06bca0 2024-04-18T04:46:52.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.953+0000 7f8d89400640 1 --2- 172.21.15.120:0/1393023708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d8c06bca0 0x7f8d8c15aa80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8d7800c530 tx=0x7f8d7800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:46:52.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.953+0000 7f8d82000640 1 -- 172.21.15.120:0/1393023708 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d78005220 con 0x7f8d8c06bca0 2024-04-18T04:46:52.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.953+0000 7f8d82000640 1 -- 172.21.15.120:0/1393023708 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d78005380 con 0x7f8d8c06bca0 2024-04-18T04:46:52.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.953+0000 7f8d91200640 1 -- 172.21.15.120:0/1393023708 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d8c14c7e0 con 0x7f8d8c06bca0 2024-04-18T04:46:52.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.953+0000 7f8d82000640 1 -- 172.21.15.120:0/1393023708 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d78007270 con 0x7f8d8c06bca0 2024-04-18T04:46:52.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.953+0000 7f8d91200640 1 -- 172.21.15.120:0/1393023708 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d8c15ba20 con 0x7f8d8c06bca0 2024-04-18T04:46:52.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.953+0000 7f8d91200640 1 -- 172.21.15.120:0/1393023708 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d8c072a70 con 0x7f8d8c06bca0 2024-04-18T04:46:52.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.953+0000 7f8d82000640 1 -- 172.21.15.120:0/1393023708 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8d780073d0 con 0x7f8d8c06bca0 2024-04-18T04:46:52.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.957+0000 7f8d82000640 1 --2- 172.21.15.120:0/1393023708 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8d6c066690 0x7f8d6c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:46:52.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.957+0000 7f8d82000640 1 -- 172.21.15.120:0/1393023708 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8d78083e70 con 0x7f8d8c06bca0 2024-04-18T04:46:52.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.957+0000 7f8d89e00640 1 --2- 172.21.15.120:0/1393023708 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8d6c066690 0x7f8d6c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:46:52.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.957+0000 7f8d89e00640 1 --2- 172.21.15.120:0/1393023708 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8d6c066690 0x7f8d6c068b50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c0b2000 tx=0x7f8d7c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:46:52.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:52.961+0000 7f8d82000640 1 -- 172.21.15.120:0/1393023708 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f8d78050e10 con 0x7f8d8c06bca0 2024-04-18T04:46:53.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:53.149+0000 7f8d91200640 1 -- 172.21.15.120:0/1393023708 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d8c1f3030 con 0x7f8d8c06bca0 2024-04-18T04:46:53.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:53.149+0000 7f8d82000640 1 -- 172.21.15.120:0/1393023708 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6289 (secure 0 0 0) 0x7f8d78054430 con 0x7f8d8c06bca0 2024-04-18T04:46:53.152 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:46:53.152 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/1552155328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1552155328},{"type":"v1","addr":"172.21.15.132:6835","nonce":1552155328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:45:08.005139+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.120:6833/2564667113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2564667113},{"type":"v1","addr":"172.21.15.120:6833","nonce":2564667113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:46:53.152 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 15 2024-04-18T04:46:53.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:53.153+0000 7f8d91200640 1 -- 172.21.15.120:0/1393023708 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8d6c066690 msgr2=0x7f8d6c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:46:53.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:53.153+0000 7f8d91200640 1 --2- 172.21.15.120:0/1393023708 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8d6c066690 0x7f8d6c068b50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c0b2000 tx=0x7f8d7c008040 comp rx=0 tx=0).stop 2024-04-18T04:46:53.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:53.153+0000 7f8d91200640 1 -- 172.21.15.120:0/1393023708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d8c06bca0 msgr2=0x7f8d8c15aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:46:53.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:53.153+0000 7f8d91200640 1 --2- 172.21.15.120:0/1393023708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d8c06bca0 0x7f8d8c15aa80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8d7800c530 tx=0x7f8d7800c9f0 comp rx=0 tx=0).stop 2024-04-18T04:46:53.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:53.153+0000 7f8d91200640 1 -- 172.21.15.120:0/1393023708 shutdown_connections 2024-04-18T04:46:53.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:53.153+0000 7f8d91200640 1 --2- 172.21.15.120:0/1393023708 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8d6c066690 0x7f8d6c068b50 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:53.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:53.153+0000 7f8d91200640 1 --2- 172.21.15.120:0/1393023708 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d8c06c0f0 0x7f8d8c0c3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:53.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:53.153+0000 7f8d91200640 1 --2- 172.21.15.120:0/1393023708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d8c06bca0 0x7f8d8c15aa80 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:53.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:53.153+0000 7f8d91200640 1 --2- 172.21.15.120:0/1393023708 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8d8c06b8c0 0x7f8d8c06d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:53.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:53.153+0000 7f8d91200640 1 -- 172.21.15.120:0/1393023708 >> 172.21.15.120:0/1393023708 conn(0x7f8d8c0c78c0 msgr2=0x7f8d8c0c9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:46:53.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:53.153+0000 7f8d91200640 1 -- 172.21.15.120:0/1393023708 shutdown_connections 2024-04-18T04:46:53.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:53.153+0000 7f8d91200640 1 -- 172.21.15.120:0/1393023708 wait complete. 2024-04-18T04:46:53.173 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-18T04:46:53.903 INFO:tasks.workunit.client.0.smithi120.stdout:checking whether build environment is sane... yes 2024-04-18T04:46:53.918 INFO:tasks.workunit.client.0.smithi120.stdout:checking for a race-free mkdir -p... /usr/bin/mkdir -p 2024-04-18T04:46:53.918 INFO:tasks.workunit.client.0.smithi120.stdout:checking for gawk... gawk 2024-04-18T04:46:53.948 INFO:tasks.workunit.client.0.smithi120.stdout:checking whether make sets $(MAKE)... yes 2024-04-18T04:46:54.007 INFO:tasks.workunit.client.0.smithi120.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-04-18T04:46:54.007 INFO:tasks.workunit.client.0.smithi120.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-04-18T04:46:54.023 INFO:tasks.workunit.client.0.smithi120.stdout:checking for style of include used by make... GNU 2024-04-18T04:46:54.027 INFO:tasks.workunit.client.0.smithi120.stdout:checking for gcc... gcc 2024-04-18T04:46:54.431 INFO:tasks.workunit.client.0.smithi120.stdout:checking whether the C compiler works... yes 2024-04-18T04:46:54.431 INFO:tasks.workunit.client.0.smithi120.stdout:checking for C compiler default output file name... a.out 2024-04-18T04:46:54.485 INFO:tasks.workunit.client.0.smithi120.stdout:checking for suffix of executables... 2024-04-18T04:46:54.537 INFO:tasks.workunit.client.0.smithi120.stdout:checking whether we are cross compiling... no 2024-04-18T04:46:54.582 INFO:tasks.workunit.client.0.smithi120.stdout:checking for suffix of object files... o 2024-04-18T04:46:54.609 INFO:tasks.workunit.client.0.smithi120.stdout:checking whether the compiler supports GNU C... yes 2024-04-18T04:46:54.636 INFO:tasks.workunit.client.0.smithi120.stdout:checking whether gcc accepts -g... yes 2024-04-18T04:46:54.707 INFO:tasks.workunit.client.0.smithi120.stdout:checking for gcc option to enable C11 features... none needed 2024-04-18T04:46:54.811 INFO:tasks.workunit.client.0.smithi120.stdout:checking dependency style of gcc... gcc3 2024-04-18T04:46:54.839 INFO:tasks.workunit.client.0.smithi120.stdout:checking for stdio.h... yes 2024-04-18T04:46:54.873 INFO:tasks.workunit.client.0.smithi120.stdout:checking for stdlib.h... yes 2024-04-18T04:46:54.910 INFO:tasks.workunit.client.0.smithi120.stdout:checking for string.h... yes 2024-04-18T04:46:54.944 INFO:tasks.workunit.client.0.smithi120.stdout:checking for inttypes.h... yes 2024-04-18T04:46:54.980 INFO:tasks.workunit.client.0.smithi120.stdout:checking for stdint.h... yes 2024-04-18T04:46:55.017 INFO:tasks.workunit.client.0.smithi120.stdout:checking for strings.h... yes 2024-04-18T04:46:55.053 INFO:tasks.workunit.client.0.smithi120.stdout:checking for sys/stat.h... yes 2024-04-18T04:46:55.092 INFO:tasks.workunit.client.0.smithi120.stdout:checking for sys/types.h... yes 2024-04-18T04:46:55.134 INFO:tasks.workunit.client.0.smithi120.stdout:checking for unistd.h... yes 2024-04-18T04:46:55.174 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:46:55.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.309+0000 7f6bfec00640 1 Processor -- start 2024-04-18T04:46:55.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.309+0000 7f6bfec00640 1 -- start start 2024-04-18T04:46:55.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.309+0000 7f6bfec00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6bf80c7480 0x7f6bf80c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:46:55.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.309+0000 7f6bfec00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bf806f9b0 con 0x7f6bf80bfe70 2024-04-18T04:46:55.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.309+0000 7f6bfec00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bf8156b40 con 0x7f6bf8150340 2024-04-18T04:46:55.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.309+0000 7f6bfec00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bf80c0520 con 0x7f6bf80c7480 2024-04-18T04:46:55.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.309+0000 7f6bf7400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6bf80c7480 0x7f6bf80c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:46:55.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.313+0000 7f6bf7400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6bf80c7480 0x7f6bf80c68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60556/0 (socket says 172.21.15.120:60556) 2024-04-18T04:46:55.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.313+0000 7f6bf7400640 1 -- 172.21.15.120:0/1283970358 learned_addr learned my addr 172.21.15.120:0/1283970358 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:46:55.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.313+0000 7f6bf7400640 1 -- 172.21.15.120:0/1283970358 >> v1:172.21.15.132:6789/0 conn(0x7f6bf8150340 legacy=0x7f6bf8156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:46:55.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.313+0000 7f6bf7400640 1 -- 172.21.15.120:0/1283970358 >> v1:172.21.15.120:6789/0 conn(0x7f6bf80bfe70 legacy=0x7f6bf8160db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:46:55.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.313+0000 7f6bf7400640 1 -- 172.21.15.120:0/1283970358 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf80c0800 con 0x7f6bf80c7480 2024-04-18T04:46:55.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.313+0000 7f6bf7400640 1 --2- 172.21.15.120:0/1283970358 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6bf80c7480 0x7f6bf80c68d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6be400bb10 tx=0x7f6be4021420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5611a431e8206b56 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:46:55.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.313+0000 7f6bf6a00640 1 -- 172.21.15.120:0/1283970358 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be40b1600 con 0x7f6bf80c7480 2024-04-18T04:46:55.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.313+0000 7f6bf6a00640 1 -- 172.21.15.120:0/1283970358 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be40ad050 con 0x7f6bf80c7480 2024-04-18T04:46:55.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.313+0000 7f6bf6a00640 1 -- 172.21.15.120:0/1283970358 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be40b1980 con 0x7f6bf80c7480 2024-04-18T04:46:55.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.317+0000 7f6bfec00640 1 -- 172.21.15.120:0/1283970358 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6bf80c7480 msgr2=0x7f6bf80c68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:46:55.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.317+0000 7f6bfec00640 1 --2- 172.21.15.120:0/1283970358 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6bf80c7480 0x7f6bf80c68d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6be400bb10 tx=0x7f6be4021420 comp rx=0 tx=0).stop 2024-04-18T04:46:55.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.317+0000 7f6bfec00640 1 -- 172.21.15.120:0/1283970358 shutdown_connections 2024-04-18T04:46:55.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.317+0000 7f6bfec00640 1 --2- 172.21.15.120:0/1283970358 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6bf80c7480 0x7f6bf80c68d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:55.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.317+0000 7f6bfec00640 1 -- 172.21.15.120:0/1283970358 >> 172.21.15.120:0/1283970358 conn(0x7f6bf80c78c0 msgr2=0x7f6bf80c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:46:55.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.317+0000 7f6bfec00640 1 -- 172.21.15.120:0/1283970358 shutdown_connections 2024-04-18T04:46:55.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.317+0000 7f6bfec00640 1 -- 172.21.15.120:0/1283970358 wait complete. 2024-04-18T04:46:55.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.317+0000 7f6bfec00640 1 Processor -- start 2024-04-18T04:46:55.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.317+0000 7f6bfec00640 1 -- start start 2024-04-18T04:46:55.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.317+0000 7f6bfec00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6bf80bfe70 0x7f6bf81e0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:46:55.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.317+0000 7f6bfec00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6bf80c7480 0x7f6bf81dfc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:46:55.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.317+0000 7f6bfec00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6bf8150340 0x7f6bf814eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:46:55.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.317+0000 7f6bfec00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf8151dc0 con 0x7f6bf80bfe70 2024-04-18T04:46:55.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.317+0000 7f6bfec00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf81e1450 con 0x7f6bf8150340 2024-04-18T04:46:55.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.317+0000 7f6bfec00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf8152cf0 con 0x7f6bf80c7480 2024-04-18T04:46:55.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.317+0000 7f6bf7e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6bf80bfe70 0x7f6bf81e0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:46:55.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.317+0000 7f6bf7e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6bf80bfe70 0x7f6bf81e0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60560/0 (socket says 172.21.15.120:60560) 2024-04-18T04:46:55.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.317+0000 7f6bf7e00640 1 -- 172.21.15.120:0/2625498418 learned_addr learned my addr 172.21.15.120:0/2625498418 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:46:55.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.317+0000 7f6bfcc00640 1 --2- 172.21.15.120:0/2625498418 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6bf8150340 0x7f6bf814eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:46:55.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.317+0000 7f6bf7400640 1 --2- 172.21.15.120:0/2625498418 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6bf80c7480 0x7f6bf81dfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:46:55.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.317+0000 7f6bf7e00640 1 -- 172.21.15.120:0/2625498418 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6bf80c7480 msgr2=0x7f6bf81dfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:46:55.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.317+0000 7f6bf7e00640 1 --2- 172.21.15.120:0/2625498418 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6bf80c7480 0x7f6bf81dfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:55.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.317+0000 7f6bf7e00640 1 -- 172.21.15.120:0/2625498418 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6bf8150340 msgr2=0x7f6bf814eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:46:55.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.317+0000 7f6bf7e00640 1 --2- 172.21.15.120:0/2625498418 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6bf8150340 0x7f6bf814eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:55.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.317+0000 7f6bf7e00640 1 -- 172.21.15.120:0/2625498418 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be400b770 con 0x7f6bf80bfe70 2024-04-18T04:46:55.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.317+0000 7f6bf7e00640 1 --2- 172.21.15.120:0/2625498418 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6bf80bfe70 0x7f6bf81e0f10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6be800c3c0 tx=0x7f6be800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:46:55.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.321+0000 7f6befe00640 1 -- 172.21.15.120:0/2625498418 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be80052d0 con 0x7f6bf80bfe70 2024-04-18T04:46:55.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.321+0000 7f6befe00640 1 -- 172.21.15.120:0/2625498418 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be8005430 con 0x7f6bf80bfe70 2024-04-18T04:46:55.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.321+0000 7f6befe00640 1 -- 172.21.15.120:0/2625498418 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be8003840 con 0x7f6bf80bfe70 2024-04-18T04:46:55.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.321+0000 7f6bfec00640 1 -- 172.21.15.120:0/2625498418 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bf8152fd0 con 0x7f6bf80bfe70 2024-04-18T04:46:55.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.321+0000 7f6bfec00640 1 -- 172.21.15.120:0/2625498418 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bf8153590 con 0x7f6bf80bfe70 2024-04-18T04:46:55.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.321+0000 7f6bfec00640 1 -- 172.21.15.120:0/2625498418 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bf80726d0 con 0x7f6bf80bfe70 2024-04-18T04:46:55.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.321+0000 7f6befe00640 1 -- 172.21.15.120:0/2625498418 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6be80039a0 con 0x7f6bf80bfe70 2024-04-18T04:46:55.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.321+0000 7f6befe00640 1 --2- 172.21.15.120:0/2625498418 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6bd8066690 0x7f6bd8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:46:55.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.321+0000 7f6befe00640 1 -- 172.21.15.120:0/2625498418 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6be8083bc0 con 0x7f6bf80bfe70 2024-04-18T04:46:55.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.321+0000 7f6bf7400640 1 --2- 172.21.15.120:0/2625498418 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6bd8066690 0x7f6bd8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:46:55.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.325+0000 7f6bf7400640 1 --2- 172.21.15.120:0/2625498418 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6bd8066690 0x7f6bd8068b50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6be40b3000 tx=0x7f6be4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:46:55.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.325+0000 7f6befe00640 1 -- 172.21.15.120:0/2625498418 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f6be8050a40 con 0x7f6bf80bfe70 2024-04-18T04:46:55.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.509+0000 7f6bfec00640 1 -- 172.21.15.120:0/2625498418 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6bf81f2250 con 0x7f6bf80bfe70 2024-04-18T04:46:55.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.513+0000 7f6befe00640 1 -- 172.21.15.120:0/2625498418 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6289 (secure 0 0 0) 0x7f6be8017020 con 0x7f6bf80bfe70 2024-04-18T04:46:55.512 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:46:55.513 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/1552155328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1552155328},{"type":"v1","addr":"172.21.15.132:6835","nonce":1552155328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:45:08.005139+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.120:6833/2564667113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2564667113},{"type":"v1","addr":"172.21.15.120:6833","nonce":2564667113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:46:55.513 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 15 2024-04-18T04:46:55.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.513+0000 7f6bfec00640 1 -- 172.21.15.120:0/2625498418 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6bd8066690 msgr2=0x7f6bd8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:46:55.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.513+0000 7f6bfec00640 1 --2- 172.21.15.120:0/2625498418 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6bd8066690 0x7f6bd8068b50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6be40b3000 tx=0x7f6be4008040 comp rx=0 tx=0).stop 2024-04-18T04:46:55.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.513+0000 7f6bfec00640 1 -- 172.21.15.120:0/2625498418 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6bf80bfe70 msgr2=0x7f6bf81e0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:46:55.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.513+0000 7f6bfec00640 1 --2- 172.21.15.120:0/2625498418 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6bf80bfe70 0x7f6bf81e0f10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6be800c3c0 tx=0x7f6be800c880 comp rx=0 tx=0).stop 2024-04-18T04:46:55.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.513+0000 7f6bfec00640 1 -- 172.21.15.120:0/2625498418 shutdown_connections 2024-04-18T04:46:55.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.513+0000 7f6bfec00640 1 --2- 172.21.15.120:0/2625498418 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6bd8066690 0x7f6bd8068b50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:55.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.513+0000 7f6bfec00640 1 --2- 172.21.15.120:0/2625498418 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6bf8150340 0x7f6bf814eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:55.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.513+0000 7f6bfec00640 1 --2- 172.21.15.120:0/2625498418 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6bf80c7480 0x7f6bf81dfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:55.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.513+0000 7f6bfec00640 1 --2- 172.21.15.120:0/2625498418 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6bf80bfe70 0x7f6bf81e0f10 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:55.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.513+0000 7f6bfec00640 1 -- 172.21.15.120:0/2625498418 >> 172.21.15.120:0/2625498418 conn(0x7f6bf80c78c0 msgr2=0x7f6bf806dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:46:55.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.513+0000 7f6bfec00640 1 -- 172.21.15.120:0/2625498418 shutdown_connections 2024-04-18T04:46:55.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:55.513+0000 7f6bfec00640 1 -- 172.21.15.120:0/2625498418 wait complete. 2024-04-18T04:46:55.534 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-18T04:46:55.664 INFO:tasks.workunit.client.0.smithi120.stdout:checking for wchar.h... yes 2024-04-18T04:46:55.990 INFO:tasks.workunit.client.0.smithi120.stdout:checking for minix/config.h... no 2024-04-18T04:46:56.031 INFO:tasks.workunit.client.0.smithi120.stdout:checking for sys/time.h... yes 2024-04-18T04:46:56.078 INFO:tasks.workunit.client.0.smithi120.stdout:checking whether it is safe to define __EXTENSIONS__... yes 2024-04-18T04:46:56.113 INFO:tasks.workunit.client.0.smithi120.stdout:checking whether _XOPEN_SOURCE should be defined... no 2024-04-18T04:46:56.114 INFO:tasks.workunit.client.0.smithi120.stdout:checking for gcc... (cached) gcc 2024-04-18T04:46:56.167 INFO:tasks.workunit.client.0.smithi120.stdout:checking whether the compiler supports GNU C... (cached) yes 2024-04-18T04:46:56.168 INFO:tasks.workunit.client.0.smithi120.stdout:checking whether gcc accepts -g... (cached) yes 2024-04-18T04:46:56.168 INFO:tasks.workunit.client.0.smithi120.stdout:checking for gcc option to enable C11 features... (cached) none needed 2024-04-18T04:46:56.168 INFO:tasks.workunit.client.0.smithi120.stdout:checking dependency style of gcc... (cached) gcc3 2024-04-18T04:46:56.222 INFO:tasks.workunit.client.0.smithi120.stdout:checking for main in -lm... yes 2024-04-18T04:46:56.751 INFO:tasks.workunit.client.0.smithi120.stdout:checking for main in -lpthread... yes 2024-04-18T04:46:56.754 INFO:tasks.workunit.client.0.smithi120.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-04-18T04:46:56.757 INFO:tasks.workunit.client.0.smithi120.stdout:checking for egrep... /usr/bin/grep -E 2024-04-18T04:46:56.801 INFO:tasks.workunit.client.0.smithi120.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-04-18T04:46:56.847 INFO:tasks.workunit.client.0.smithi120.stdout:checking for pthread.h... yes 2024-04-18T04:46:56.892 INFO:tasks.workunit.client.0.smithi120.stdout:checking for fcntl.h... yes 2024-04-18T04:46:56.937 INFO:tasks.workunit.client.0.smithi120.stdout:checking for limits.h... yes 2024-04-18T04:46:56.937 INFO:tasks.workunit.client.0.smithi120.stdout:checking for stdint.h... (cached) yes 2024-04-18T04:46:56.938 INFO:tasks.workunit.client.0.smithi120.stdout:checking for sys/time.h... (cached) yes 2024-04-18T04:46:56.938 INFO:tasks.workunit.client.0.smithi120.stdout:checking for unistd.h... (cached) yes 2024-04-18T04:46:56.980 INFO:tasks.workunit.client.0.smithi120.stdout:checking for sys/vfs.h... yes 2024-04-18T04:46:57.315 INFO:tasks.workunit.client.0.smithi120.stdout:checking for sys/limits.h... no 2024-04-18T04:46:57.345 INFO:tasks.workunit.client.0.smithi120.stdout:checking for an ANSI C-conforming const... yes 2024-04-18T04:46:57.403 INFO:tasks.workunit.client.0.smithi120.stdout:checking for system... yes 2024-04-18T04:46:57.459 INFO:tasks.workunit.client.0.smithi120.stdout:checking for gettimeofday... yes 2024-04-18T04:46:57.516 INFO:tasks.workunit.client.0.smithi120.stdout:checking for mkdir... yes 2024-04-18T04:46:57.536 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:46:57.575 INFO:tasks.workunit.client.0.smithi120.stdout:checking for strerror... yes 2024-04-18T04:46:57.635 INFO:tasks.workunit.client.0.smithi120.stdout:checking for open64... yes 2024-04-18T04:46:57.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.677+0000 7f6eafe00640 1 Processor -- start 2024-04-18T04:46:57.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.677+0000 7f6eafe00640 1 -- start start 2024-04-18T04:46:57.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.677+0000 7f6eafe00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6ea806b8c0 0x7f6ea80c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:46:57.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.677+0000 7f6eafe00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6ea806bca0 0x7f6ea806c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:46:57.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.677+0000 7f6eafe00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6ea8151440 0x7f6ea81518d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:46:57.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.677+0000 7f6eafe00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ea8158610 con 0x7f6ea806bca0 2024-04-18T04:46:57.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.677+0000 7f6eafe00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ea80c7740 con 0x7f6ea8151440 2024-04-18T04:46:57.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.677+0000 7f6eafe00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea81576f0 con 0x7f6ea806b8c0 2024-04-18T04:46:57.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.677+0000 7f6eaca00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6ea806bca0 0x7f6ea806c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:46:57.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.677+0000 7f6eaca00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6ea806bca0 0x7f6ea806c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60572/0 (socket says 172.21.15.120:60572) 2024-04-18T04:46:57.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.677+0000 7f6eaca00640 1 -- 172.21.15.120:0/3253213235 learned_addr learned my addr 172.21.15.120:0/3253213235 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:46:57.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.677+0000 7f6ead400640 1 --2- 172.21.15.120:0/3253213235 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6ea806b8c0 0x7f6ea80c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:46:57.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.677+0000 7f6eade00640 1 --2- 172.21.15.120:0/3253213235 >> v2:172.21.15.132:3300/0 conn(0x7f6ea8151440 0x7f6ea81518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:46:57.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.677+0000 7f6eaca00640 1 -- 172.21.15.120:0/3253213235 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6ea806b8c0 msgr2=0x7f6ea80c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:46:57.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.677+0000 7f6eaca00640 1 --2- 172.21.15.120:0/3253213235 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6ea806b8c0 0x7f6ea80c7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:57.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.677+0000 7f6eaca00640 1 -- 172.21.15.120:0/3253213235 >> v2:172.21.15.132:3300/0 conn(0x7f6ea8151440 msgr2=0x7f6ea81518d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:46:57.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.677+0000 7f6eaca00640 1 --2- 172.21.15.120:0/3253213235 >> v2:172.21.15.132:3300/0 conn(0x7f6ea8151440 0x7f6ea81518d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:57.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.677+0000 7f6eaca00640 1 -- 172.21.15.120:0/3253213235 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea8157990 con 0x7f6ea806bca0 2024-04-18T04:46:57.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.677+0000 7f6eade00640 1 --2- 172.21.15.120:0/3253213235 >> v2:172.21.15.132:3300/0 conn(0x7f6ea8151440 0x7f6ea81518d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:46:57.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.681+0000 7f6eaca00640 1 --2- 172.21.15.120:0/3253213235 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ea806bca0 0x7f6ea806c0c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6ea80c88b0 tx=0x7f6e9401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c72a9cb0608a692 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:46:57.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.681+0000 7f6ea7e00640 1 -- 172.21.15.120:0/3253213235 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e940a89d0 con 0x7f6ea806bca0 2024-04-18T04:46:57.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.681+0000 7f6ea7e00640 1 -- 172.21.15.120:0/3253213235 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e940a8b30 con 0x7f6ea806bca0 2024-04-18T04:46:57.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.681+0000 7f6ea7e00640 1 -- 172.21.15.120:0/3253213235 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e940b0440 con 0x7f6ea806bca0 2024-04-18T04:46:57.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.681+0000 7f6eafe00640 1 -- 172.21.15.120:0/3253213235 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ea806bca0 msgr2=0x7f6ea806c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:46:57.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.681+0000 7f6eafe00640 1 --2- 172.21.15.120:0/3253213235 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ea806bca0 0x7f6ea806c0c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6ea80c88b0 tx=0x7f6e9401ed10 comp rx=0 tx=0).stop 2024-04-18T04:46:57.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.681+0000 7f6eafe00640 1 -- 172.21.15.120:0/3253213235 shutdown_connections 2024-04-18T04:46:57.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.681+0000 7f6eafe00640 1 --2- 172.21.15.120:0/3253213235 >> v2:172.21.15.132:3300/0 conn(0x7f6ea8151440 0x7f6ea81518d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:57.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.681+0000 7f6eafe00640 1 --2- 172.21.15.120:0/3253213235 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ea806bca0 0x7f6ea806c0c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:57.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.681+0000 7f6eafe00640 1 --2- 172.21.15.120:0/3253213235 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6ea806b8c0 0x7f6ea80c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:57.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.681+0000 7f6eafe00640 1 -- 172.21.15.120:0/3253213235 >> 172.21.15.120:0/3253213235 conn(0x7f6ea80c78c0 msgr2=0x7f6ea80c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:46:57.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.681+0000 7f6eafe00640 1 -- 172.21.15.120:0/3253213235 shutdown_connections 2024-04-18T04:46:57.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.681+0000 7f6eafe00640 1 -- 172.21.15.120:0/3253213235 wait complete. 2024-04-18T04:46:57.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.685+0000 7f6eafe00640 1 Processor -- start 2024-04-18T04:46:57.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.685+0000 7f6eafe00640 1 -- start start 2024-04-18T04:46:57.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.685+0000 7f6eafe00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6ea806b8c0 0x7f6ea81556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:46:57.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.685+0000 7f6eafe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ea806bca0 0x7f6ea80adf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:46:57.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.685+0000 7f6eafe00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ea8151440 0x7f6ea80ae480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:46:57.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.685+0000 7f6eafe00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea81f00b0 con 0x7f6ea806bca0 2024-04-18T04:46:57.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.685+0000 7f6eafe00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea80adab0 con 0x7f6ea8151440 2024-04-18T04:46:57.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.685+0000 7f6eafe00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea81ef530 con 0x7f6ea806b8c0 2024-04-18T04:46:57.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.685+0000 7f6eaca00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ea806bca0 0x7f6ea80adf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:46:57.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.685+0000 7f6eaca00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ea806bca0 0x7f6ea80adf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60574/0 (socket says 172.21.15.120:60574) 2024-04-18T04:46:57.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.685+0000 7f6eaca00640 1 -- 172.21.15.120:0/2865828486 learned_addr learned my addr 172.21.15.120:0/2865828486 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:46:57.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.685+0000 7f6ead400640 1 --2- 172.21.15.120:0/2865828486 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6ea806b8c0 0x7f6ea81556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:46:57.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.685+0000 7f6eade00640 1 --2- 172.21.15.120:0/2865828486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ea8151440 0x7f6ea80ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:46:57.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.685+0000 7f6eaca00640 1 -- 172.21.15.120:0/2865828486 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6ea806b8c0 msgr2=0x7f6ea81556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:46:57.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.685+0000 7f6eaca00640 1 --2- 172.21.15.120:0/2865828486 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6ea806b8c0 0x7f6ea81556b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:57.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.685+0000 7f6eaca00640 1 -- 172.21.15.120:0/2865828486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ea8151440 msgr2=0x7f6ea80ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:46:57.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.685+0000 7f6eaca00640 1 --2- 172.21.15.120:0/2865828486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ea8151440 0x7f6ea80ae480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:57.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.685+0000 7f6eaca00640 1 -- 172.21.15.120:0/2865828486 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e940094d0 con 0x7f6ea806bca0 2024-04-18T04:46:57.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.685+0000 7f6eade00640 1 --2- 172.21.15.120:0/2865828486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ea8151440 0x7f6ea80ae480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:46:57.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.685+0000 7f6eaca00640 1 --2- 172.21.15.120:0/2865828486 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ea806bca0 0x7f6ea80adf40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6e940b3040 tx=0x7f6e9401bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:46:57.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.685+0000 7f6ea5600640 1 -- 172.21.15.120:0/2865828486 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e940b0e10 con 0x7f6ea806bca0 2024-04-18T04:46:57.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.685+0000 7f6ea5600640 1 -- 172.21.15.120:0/2865828486 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e940bb480 con 0x7f6ea806bca0 2024-04-18T04:46:57.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.685+0000 7f6ea5600640 1 -- 172.21.15.120:0/2865828486 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e940bb830 con 0x7f6ea806bca0 2024-04-18T04:46:57.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.685+0000 7f6eafe00640 1 -- 172.21.15.120:0/2865828486 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ea81ef810 con 0x7f6ea806bca0 2024-04-18T04:46:57.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.685+0000 7f6eafe00640 1 -- 172.21.15.120:0/2865828486 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ea81efdd0 con 0x7f6ea806bca0 2024-04-18T04:46:57.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.689+0000 7f6eafe00640 1 -- 172.21.15.120:0/2865828486 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ea80adc20 con 0x7f6ea806bca0 2024-04-18T04:46:57.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.689+0000 7f6ea5600640 1 -- 172.21.15.120:0/2865828486 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6e940bb990 con 0x7f6ea806bca0 2024-04-18T04:46:57.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.689+0000 7f6ea5600640 1 --2- 172.21.15.120:0/2865828486 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6e88066690 0x7f6e88068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:46:57.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.689+0000 7f6ea5600640 1 -- 172.21.15.120:0/2865828486 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6e94122ac0 con 0x7f6ea806bca0 2024-04-18T04:46:57.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.689+0000 7f6ead400640 1 --2- 172.21.15.120:0/2865828486 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6e88066690 0x7f6e88068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:46:57.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.689+0000 7f6ead400640 1 --2- 172.21.15.120:0/2865828486 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6e88066690 0x7f6e88068b50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c009a40 tx=0x7f6e9c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:46:57.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.693+0000 7f6ea5600640 1 -- 172.21.15.120:0/2865828486 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f6e940ef940 con 0x7f6ea806bca0 2024-04-18T04:46:57.695 INFO:tasks.workunit.client.0.smithi120.stdout:checking for stat64... yes 2024-04-18T04:46:57.753 INFO:tasks.workunit.client.0.smithi120.stdout:checking for fseeko64... yes 2024-04-18T04:46:57.813 INFO:tasks.workunit.client.0.smithi120.stdout:checking for lrand48_r... yes 2024-04-18T04:46:57.871 INFO:tasks.workunit.client.0.smithi120.stdout:checking for srand48_r... yes 2024-04-18T04:46:57.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.889+0000 7f6eafe00640 1 -- 172.21.15.120:0/2865828486 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ea80ad880 con 0x7f6ea806bca0 2024-04-18T04:46:57.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.893+0000 7f6ea5600640 1 -- 172.21.15.120:0/2865828486 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6289 (secure 0 0 0) 0x7f6e940b5020 con 0x7f6ea806bca0 2024-04-18T04:46:57.893 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:46:57.893 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/1552155328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1552155328},{"type":"v1","addr":"172.21.15.132:6835","nonce":1552155328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:45:08.005139+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.120:6833/2564667113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2564667113},{"type":"v1","addr":"172.21.15.120:6833","nonce":2564667113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:46:57.893 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 15 2024-04-18T04:46:57.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.893+0000 7f6eafe00640 1 -- 172.21.15.120:0/2865828486 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6e88066690 msgr2=0x7f6e88068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:46:57.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.893+0000 7f6eafe00640 1 --2- 172.21.15.120:0/2865828486 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6e88066690 0x7f6e88068b50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c009a40 tx=0x7f6e9c009190 comp rx=0 tx=0).stop 2024-04-18T04:46:57.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.893+0000 7f6eafe00640 1 -- 172.21.15.120:0/2865828486 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ea806bca0 msgr2=0x7f6ea80adf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:46:57.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.893+0000 7f6eafe00640 1 --2- 172.21.15.120:0/2865828486 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ea806bca0 0x7f6ea80adf40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6e940b3040 tx=0x7f6e9401bab0 comp rx=0 tx=0).stop 2024-04-18T04:46:57.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.893+0000 7f6eafe00640 1 -- 172.21.15.120:0/2865828486 shutdown_connections 2024-04-18T04:46:57.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.893+0000 7f6eafe00640 1 --2- 172.21.15.120:0/2865828486 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6e88066690 0x7f6e88068b50 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:57.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.893+0000 7f6eafe00640 1 --2- 172.21.15.120:0/2865828486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ea8151440 0x7f6ea80ae480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:57.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.893+0000 7f6eafe00640 1 --2- 172.21.15.120:0/2865828486 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ea806bca0 0x7f6ea80adf40 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:57.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.893+0000 7f6eafe00640 1 --2- 172.21.15.120:0/2865828486 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6ea806b8c0 0x7f6ea81556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:46:57.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.893+0000 7f6eafe00640 1 -- 172.21.15.120:0/2865828486 >> 172.21.15.120:0/2865828486 conn(0x7f6ea80c78c0 msgr2=0x7f6ea8156f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:46:57.896 INFO:tasks.workunit.client.0.smithi120.stdout:configure: creating ./config.status 2024-04-18T04:46:57.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.893+0000 7f6eafe00640 1 -- 172.21.15.120:0/2865828486 shutdown_connections 2024-04-18T04:46:57.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:46:57.893+0000 7f6eafe00640 1 -- 172.21.15.120:0/2865828486 wait complete. 2024-04-18T04:46:57.915 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-18T04:46:59.475 INFO:tasks.workunit.client.0.smithi120.stdout: /bin/bash ./config.status 2024-04-18T04:46:59.559 INFO:tasks.workunit.client.0.smithi120.stdout:config.status: creating Makefile 2024-04-18T04:46:59.581 INFO:tasks.workunit.client.0.smithi120.stdout:config.status: creating config.h 2024-04-18T04:46:59.616 INFO:tasks.workunit.client.0.smithi120.stdout:config.status: executing depfiles commands 2024-04-18T04:46:59.644 INFO:tasks.workunit.client.0.smithi120.stdout:config.status: executing default commands 2024-04-18T04:46:59.677 INFO:tasks.workunit.client.0.smithi120.stdout:cd . && /bin/bash /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoheader 2024-04-18T04:46:59.731 INFO:tasks.workunit.client.0.smithi120.stderr:autoheader: warning: autoconf input should be named 'configure.ac', not 'configure.in' 2024-04-18T04:46:59.814 INFO:tasks.workunit.client.0.smithi120.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2024-04-18T04:46:59.815 INFO:tasks.workunit.client.0.smithi120.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2024-04-18T04:46:59.815 INFO:tasks.workunit.client.0.smithi120.stderr:If you have problems, you may need to regenerate the build system entirely. 2024-04-18T04:46:59.815 INFO:tasks.workunit.client.0.smithi120.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2024-04-18T04:46:59.821 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:46:59.826 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:46:59.916 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:46:59.964 INFO:tasks.workunit.client.0.smithi120.stdout:rm -f stamp-h1 2024-04-18T04:46:59.969 INFO:tasks.workunit.client.0.smithi120.stdout:touch config.h.in 2024-04-18T04:46:59.974 INFO:tasks.workunit.client.0.smithi120.stdout:cd . && /bin/bash ./config.status config.h 2024-04-18T04:47:00.051 INFO:tasks.workunit.client.0.smithi120.stdout:config.status: creating config.h 2024-04-18T04:47:00.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.061+0000 7fe9a2e00640 1 Processor -- start 2024-04-18T04:47:00.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.061+0000 7fe9a2e00640 1 -- start start 2024-04-18T04:47:00.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.061+0000 7fe9a2e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe99c15d3a0 0x7fe99c15d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:00.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.061+0000 7fe9a2e00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe99c06b660 con 0x7fe99c15cfc0 2024-04-18T04:47:00.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.061+0000 7fe9a2e00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe99c0c0e00 con 0x7fe99c0c1290 2024-04-18T04:47:00.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.061+0000 7fe9a2e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c070060 con 0x7fe99c15d3a0 2024-04-18T04:47:00.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.061+0000 7fe99be00640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fe99c15cfc0 0x7fe99c15a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:52694/0 (socket says 172.21.15.120:52694) 2024-04-18T04:47:00.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.061+0000 7fe99be00640 1 -- 172.21.15.120:0/1915134165 learned_addr learned my addr 172.21.15.120:0/1915134165 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:47:00.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.061+0000 7fe99b400640 1 --2- 172.21.15.120:0/1915134165 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe99c15d3a0 0x7fe99c15d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:00.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.065+0000 7fe99aa00640 1 -- 172.21.15.120:0/1915134165 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4198260560 0 0) 0x7fe99c06b660 con 0x7fe99c15cfc0 2024-04-18T04:47:00.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.065+0000 7fe99aa00640 1 -- 172.21.15.120:0/1915134165 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe980003530 con 0x7fe99c15cfc0 2024-04-18T04:47:00.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.065+0000 7fe99aa00640 1 -- 172.21.15.120:0/1915134165 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1519824972 0 0) 0x7fe99c0c0e00 con 0x7fe99c0c1290 2024-04-18T04:47:00.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.065+0000 7fe99aa00640 1 -- 172.21.15.120:0/1915134165 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe99c06b660 con 0x7fe99c0c1290 2024-04-18T04:47:00.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.065+0000 7fe99aa00640 1 -- 172.21.15.120:0/1915134165 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1164889621 0 0) 0x7fe980003530 con 0x7fe99c15cfc0 2024-04-18T04:47:00.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.065+0000 7fe99aa00640 1 -- 172.21.15.120:0/1915134165 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe99c15d3a0 msgr2=0x7fe99c15d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:47:00.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.065+0000 7fe99aa00640 1 --2- 172.21.15.120:0/1915134165 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe99c15d3a0 0x7fe99c15d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:00.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.065+0000 7fe99aa00640 1 -- 172.21.15.120:0/1915134165 >> v1:172.21.15.132:6789/0 conn(0x7fe99c0c1290 legacy=0x7fe99c153580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:00.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.065+0000 7fe99aa00640 1 -- 172.21.15.120:0/1915134165 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe99c0c0420 con 0x7fe99c15cfc0 2024-04-18T04:47:00.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.065+0000 7fe99aa00640 1 -- 172.21.15.120:0/1915134165 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7fe98c001600 con 0x7fe99c15cfc0 2024-04-18T04:47:00.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.065+0000 7fe99b400640 1 --2- 172.21.15.120:0/1915134165 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe99c15d3a0 0x7fe99c15d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:47:00.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.065+0000 7fe99aa00640 1 -- 172.21.15.120:0/1915134165 >> v1:172.21.15.120:6789/0 conn(0x7fe99c15cfc0 legacy=0x7fe99c15a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:00.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.065+0000 7fe99aa00640 1 --2- 172.21.15.120:0/1915134165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe980003b40 0x7fe980003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:00.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.065+0000 7fe99aa00640 1 --2- 172.21.15.120:0/1915134165 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9800047d0 0x7fe980004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:00.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.065+0000 7fe99aa00640 1 --2- 172.21.15.120:0/1915134165 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe99c15d3a0 0x7fe980005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:00.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.065+0000 7fe99aa00640 1 -- 172.21.15.120:0/1915134165 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98000ba40 con 0x7fe980003b40 2024-04-18T04:47:00.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.065+0000 7fe99aa00640 1 -- 172.21.15.120:0/1915134165 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98000bb80 con 0x7fe9800047d0 2024-04-18T04:47:00.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.065+0000 7fe99aa00640 1 -- 172.21.15.120:0/1915134165 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe98000bd10 con 0x7fe99c15d3a0 2024-04-18T04:47:00.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.065+0000 7fe99be00640 1 --2- 172.21.15.120:0/1915134165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe980003b40 0x7fe980003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:00.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.065+0000 7fe99b400640 1 --2- 172.21.15.120:0/1915134165 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9800047d0 0x7fe980004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:00.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.065+0000 7fe9a0e00640 1 --2- 172.21.15.120:0/1915134165 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe99c15d3a0 0x7fe980005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:00.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.065+0000 7fe99be00640 1 -- 172.21.15.120:0/1915134165 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe99c15d3a0 msgr2=0x7fe980005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:47:00.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.065+0000 7fe99be00640 1 --2- 172.21.15.120:0/1915134165 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe99c15d3a0 0x7fe980005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:00.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.065+0000 7fe99be00640 1 -- 172.21.15.120:0/1915134165 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9800047d0 msgr2=0x7fe980004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:47:00.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.065+0000 7fe99be00640 1 --2- 172.21.15.120:0/1915134165 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9800047d0 0x7fe980004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:00.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.065+0000 7fe99be00640 1 -- 172.21.15.120:0/1915134165 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe988009420 con 0x7fe980003b40 2024-04-18T04:47:00.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.065+0000 7fe9a0e00640 1 --2- 172.21.15.120:0/1915134165 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe99c15d3a0 0x7fe980005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:47:00.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.069+0000 7fe99be00640 1 --2- 172.21.15.120:0/1915134165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe980003b40 0x7fe980003f40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe98c007f20 tx=0x7fe98c01ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cddfbc25000a32b server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:47:00.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.069+0000 7fe99aa00640 1 -- 172.21.15.120:0/1915134165 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98c005ba0 con 0x7fe980003b40 2024-04-18T04:47:00.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.069+0000 7fe99aa00640 1 -- 172.21.15.120:0/1915134165 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe98c005d20 con 0x7fe980003b40 2024-04-18T04:47:00.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.069+0000 7fe99aa00640 1 -- 172.21.15.120:0/1915134165 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98c0072b0 con 0x7fe980003b40 2024-04-18T04:47:00.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.069+0000 7fe9a2e00640 1 -- 172.21.15.120:0/1915134165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe980003b40 msgr2=0x7fe980003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:00.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.069+0000 7fe9a2e00640 1 --2- 172.21.15.120:0/1915134165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe980003b40 0x7fe980003f40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe98c007f20 tx=0x7fe98c01ca80 comp rx=0 tx=0).stop 2024-04-18T04:47:00.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.069+0000 7fe9a0e00640 1 -- 172.21.15.120:0/1915134165 reap_dead start 2024-04-18T04:47:00.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.069+0000 7fe9a2e00640 1 -- 172.21.15.120:0/1915134165 shutdown_connections 2024-04-18T04:47:00.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.069+0000 7fe9a2e00640 1 -- 172.21.15.120:0/1915134165 >> 172.21.15.120:0/1915134165 conn(0x7fe99c0c78c0 msgr2=0x7fe99c0c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:47:00.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.069+0000 7fe9a2e00640 1 -- 172.21.15.120:0/1915134165 shutdown_connections 2024-04-18T04:47:00.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.069+0000 7fe9a2e00640 1 -- 172.21.15.120:0/1915134165 wait complete. 2024-04-18T04:47:00.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.069+0000 7fe9a2e00640 1 Processor -- start 2024-04-18T04:47:00.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.069+0000 7fe9a2e00640 1 -- start start 2024-04-18T04:47:00.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.069+0000 7fe9a2e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe980003b40 0x7fe99c14c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:00.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.069+0000 7fe9a2e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe99c1e50c0 0x7fe99c14bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:00.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.069+0000 7fe9a2e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe99c0c9d90 0x7fe99c1496e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:00.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.069+0000 7fe9a2e00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c14f2d0 con 0x7fe99c1e50c0 2024-04-18T04:47:00.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.069+0000 7fe9a2e00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c1e2630 con 0x7fe980003b40 2024-04-18T04:47:00.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.069+0000 7fe9a2e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c14e9c0 con 0x7fe99c0c9d90 2024-04-18T04:47:00.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.073+0000 7fe99b400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe99c1e50c0 0x7fe99c14bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:00.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.073+0000 7fe99b400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe99c1e50c0 0x7fe99c14bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60584/0 (socket says 172.21.15.120:60584) 2024-04-18T04:47:00.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.073+0000 7fe99b400640 1 -- 172.21.15.120:0/2701339008 learned_addr learned my addr 172.21.15.120:0/2701339008 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:47:00.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.073+0000 7fe9a0e00640 1 --2- 172.21.15.120:0/2701339008 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe99c0c9d90 0x7fe99c1496e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:00.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.073+0000 7fe99be00640 1 --2- 172.21.15.120:0/2701339008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe980003b40 0x7fe99c14c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:00.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.073+0000 7fe99b400640 1 -- 172.21.15.120:0/2701339008 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe99c0c9d90 msgr2=0x7fe99c1496e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:00.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.073+0000 7fe99b400640 1 --2- 172.21.15.120:0/2701339008 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe99c0c9d90 0x7fe99c1496e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:00.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.073+0000 7fe99b400640 1 -- 172.21.15.120:0/2701339008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe980003b40 msgr2=0x7fe99c14c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:00.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.073+0000 7fe99b400640 1 --2- 172.21.15.120:0/2701339008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe980003b40 0x7fe99c14c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:00.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.073+0000 7fe99b400640 1 -- 172.21.15.120:0/2701339008 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe99c1e28d0 con 0x7fe99c1e50c0 2024-04-18T04:47:00.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.073+0000 7fe9a0e00640 1 --2- 172.21.15.120:0/2701339008 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe99c0c9d90 0x7fe99c1496e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:47:00.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.073+0000 7fe99b400640 1 --2- 172.21.15.120:0/2701339008 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe99c1e50c0 0x7fe99c14bc00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe988011ac0 tx=0x7fe988011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:47:00.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.073+0000 7fe993e00640 1 -- 172.21.15.120:0/2701339008 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98800fcd0 con 0x7fe99c1e50c0 2024-04-18T04:47:00.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.073+0000 7fe993e00640 1 -- 172.21.15.120:0/2701339008 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe98800fe30 con 0x7fe99c1e50c0 2024-04-18T04:47:00.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.073+0000 7fe993e00640 1 -- 172.21.15.120:0/2701339008 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe988014660 con 0x7fe99c1e50c0 2024-04-18T04:47:00.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.073+0000 7fe9a2e00640 1 -- 172.21.15.120:0/2701339008 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe99c14ec80 con 0x7fe99c1e50c0 2024-04-18T04:47:00.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.073+0000 7fe9a2e00640 1 -- 172.21.15.120:0/2701339008 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe99c14c140 con 0x7fe99c1e50c0 2024-04-18T04:47:00.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.073+0000 7fe9a2e00640 1 -- 172.21.15.120:0/2701339008 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe99c072a70 con 0x7fe99c1e50c0 2024-04-18T04:47:00.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.073+0000 7fe993e00640 1 -- 172.21.15.120:0/2701339008 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe9880147c0 con 0x7fe99c1e50c0 2024-04-18T04:47:00.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.073+0000 7fe993e00640 1 --2- 172.21.15.120:0/2701339008 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fe97c066690 0x7fe97c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:00.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.073+0000 7fe993e00640 1 -- 172.21.15.120:0/2701339008 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe988084f40 con 0x7fe99c1e50c0 2024-04-18T04:47:00.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.077+0000 7fe99be00640 1 --2- 172.21.15.120:0/2701339008 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fe97c066690 0x7fe97c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:00.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.077+0000 7fe99be00640 1 --2- 172.21.15.120:0/2701339008 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fe97c066690 0x7fe97c068b50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe9800057b0 tx=0x7fe98c0a7070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:47:00.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.077+0000 7fe993e00640 1 -- 172.21.15.120:0/2701339008 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fe988051ee0 con 0x7fe99c1e50c0 2024-04-18T04:47:00.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.265+0000 7fe9a2e00640 1 -- 172.21.15.120:0/2701339008 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe99c0b0c70 con 0x7fe99c1e50c0 2024-04-18T04:47:00.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.265+0000 7fe993e00640 1 -- 172.21.15.120:0/2701339008 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6289 (secure 0 0 0) 0x7fe988022020 con 0x7fe99c1e50c0 2024-04-18T04:47:00.267 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:47:00.267 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/1552155328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1552155328},{"type":"v1","addr":"172.21.15.132:6835","nonce":1552155328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:45:08.005139+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.120:6833/2564667113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2564667113},{"type":"v1","addr":"172.21.15.120:6833","nonce":2564667113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:47:00.267 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 15 2024-04-18T04:47:00.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.269+0000 7fe9a2e00640 1 -- 172.21.15.120:0/2701339008 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fe97c066690 msgr2=0x7fe97c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:00.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.269+0000 7fe9a2e00640 1 --2- 172.21.15.120:0/2701339008 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fe97c066690 0x7fe97c068b50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe9800057b0 tx=0x7fe98c0a7070 comp rx=0 tx=0).stop 2024-04-18T04:47:00.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.269+0000 7fe9a2e00640 1 -- 172.21.15.120:0/2701339008 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe99c1e50c0 msgr2=0x7fe99c14bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:00.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.269+0000 7fe9a2e00640 1 --2- 172.21.15.120:0/2701339008 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe99c1e50c0 0x7fe99c14bc00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe988011ac0 tx=0x7fe988011f80 comp rx=0 tx=0).stop 2024-04-18T04:47:00.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.269+0000 7fe9a2e00640 1 -- 172.21.15.120:0/2701339008 shutdown_connections 2024-04-18T04:47:00.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.269+0000 7fe9a2e00640 1 --2- 172.21.15.120:0/2701339008 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fe97c066690 0x7fe97c068b50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:00.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.269+0000 7fe9a2e00640 1 --2- 172.21.15.120:0/2701339008 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe99c0c9d90 0x7fe99c1496e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:00.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.269+0000 7fe9a2e00640 1 --2- 172.21.15.120:0/2701339008 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe99c1e50c0 0x7fe99c14bc00 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:00.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.269+0000 7fe9a2e00640 1 --2- 172.21.15.120:0/2701339008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe980003b40 0x7fe99c14c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:00.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.269+0000 7fe9a2e00640 1 -- 172.21.15.120:0/2701339008 >> 172.21.15.120:0/2701339008 conn(0x7fe99c0c78c0 msgr2=0x7fe99c0c90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:47:00.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.269+0000 7fe9a2e00640 1 -- 172.21.15.120:0/2701339008 shutdown_connections 2024-04-18T04:47:00.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:00.269+0000 7fe9a2e00640 1 -- 172.21.15.120:0/2701339008 wait complete. 2024-04-18T04:47:00.287 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-18T04:47:00.458 INFO:tasks.workunit.client.0.smithi120.stdout:make all-am 2024-04-18T04:47:00.467 INFO:tasks.workunit.client.0.smithi120.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-04-18T04:47:00.468 INFO:tasks.workunit.client.0.smithi120.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fileops.o -MD -MP -MF .deps/fileops.Tpo -c -o fileops.o fileops.c 2024-04-18T04:47:00.651 INFO:tasks.workunit.client.0.smithi120.stdout:mv -f .deps/fileops.Tpo .deps/fileops.Po 2024-04-18T04:47:00.656 INFO:tasks.workunit.client.0.smithi120.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rand.o -MD -MP -MF .deps/rand.Tpo -c -o rand.o rand.c 2024-04-18T04:47:00.764 INFO:tasks.workunit.client.0.smithi120.stdout:mv -f .deps/rand.Tpo .deps/rand.Po 2024-04-18T04:47:00.768 INFO:tasks.workunit.client.0.smithi120.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c 2024-04-18T04:47:00.872 INFO:tasks.workunit.client.0.smithi120.stdout:mv -f .deps/main.Tpo .deps/main.Po 2024-04-18T04:47:00.877 INFO:tasks.workunit.client.0.smithi120.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fh.o -MD -MP -MF .deps/fh.Tpo -c -o fh.o fh.c 2024-04-18T04:47:00.995 INFO:tasks.workunit.client.0.smithi120.stdout:mv -f .deps/fh.Tpo .deps/fh.Po 2024-04-18T04:47:01.000 INFO:tasks.workunit.client.0.smithi120.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT filelist.o -MD -MP -MF .deps/filelist.Tpo -c -o filelist.o filelist.c 2024-04-18T04:47:01.137 INFO:tasks.workunit.client.0.smithi120.stdout:mv -f .deps/filelist.Tpo .deps/filelist.Po 2024-04-18T04:47:01.174 INFO:tasks.workunit.client.0.smithi120.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT metaops.o -MD -MP -MF .deps/metaops.Tpo -c -o metaops.o metaops.c 2024-04-18T04:47:01.236 INFO:tasks.workunit.client.0.smithi120.stdout:mv -f .deps/metaops.Tpo .deps/metaops.Po 2024-04-18T04:47:01.240 INFO:tasks.workunit.client.0.smithi120.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rwlock.o -MD -MP -MF .deps/rwlock.Tpo -c -o rwlock.o rwlock.c 2024-04-18T04:47:01.290 INFO:tasks.workunit.client.0.smithi120.stdout:mv -f .deps/rwlock.Tpo .deps/rwlock.Po 2024-04-18T04:47:01.295 INFO:tasks.workunit.client.0.smithi120.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT cirlist.o -MD -MP -MF .deps/cirlist.Tpo -c -o cirlist.o cirlist.c 2024-04-18T04:47:01.351 INFO:tasks.workunit.client.0.smithi120.stdout:mv -f .deps/cirlist.Tpo .deps/cirlist.Po 2024-04-18T04:47:01.356 INFO:tasks.workunit.client.0.smithi120.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rbt.o -MD -MP -MF .deps/rbt.Tpo -c -o rbt.o rbt.c 2024-04-18T04:47:01.563 INFO:tasks.workunit.client.0.smithi120.stdout:mv -f .deps/rbt.Tpo .deps/rbt.Po 2024-04-18T04:47:01.568 INFO:tasks.workunit.client.0.smithi120.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_tg.o -MD -MP -MF .deps/ffsb_tg.Tpo -c -o ffsb_tg.o ffsb_tg.c 2024-04-18T04:47:01.702 INFO:tasks.workunit.client.0.smithi120.stdout:mv -f .deps/ffsb_tg.Tpo .deps/ffsb_tg.Po 2024-04-18T04:47:01.708 INFO:tasks.workunit.client.0.smithi120.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fs.o -MD -MP -MF .deps/ffsb_fs.Tpo -c -o ffsb_fs.o ffsb_fs.c 2024-04-18T04:47:01.886 INFO:tasks.workunit.client.0.smithi120.stdout:mv -f .deps/ffsb_fs.Tpo .deps/ffsb_fs.Po 2024-04-18T04:47:01.894 INFO:tasks.workunit.client.0.smithi120.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_thread.o -MD -MP -MF .deps/ffsb_thread.Tpo -c -o ffsb_thread.o ffsb_thread.c 2024-04-18T04:47:01.973 INFO:tasks.workunit.client.0.smithi120.stdout:mv -f .deps/ffsb_thread.Tpo .deps/ffsb_thread.Po 2024-04-18T04:47:01.980 INFO:tasks.workunit.client.0.smithi120.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_op.o -MD -MP -MF .deps/ffsb_op.Tpo -c -o ffsb_op.o ffsb_op.c 2024-04-18T04:47:02.014 INFO:tasks.workunit.client.0.smithi120.stderr:ffsb_op.c: In function 'print_op_results': 2024-04-18T04:47:02.015 INFO:tasks.workunit.client.0.smithi120.stderr:ffsb_op.c:83:37: warning: embedded '\0' in format [-Wformat-contains-nul] 2024-04-18T04:47:02.015 INFO:tasks.workunit.client.0.smithi120.stderr: 83 | sprintf(buf, "%s/sec\0", buf); 2024-04-18T04:47:02.015 INFO:tasks.workunit.client.0.smithi120.stderr: | ^~ 2024-04-18T04:47:02.015 INFO:tasks.workunit.client.0.smithi120.stderr:ffsb_op.c:86:33: warning: embedded '\0' in format [-Wformat-contains-nul] 2024-04-18T04:47:02.015 INFO:tasks.workunit.client.0.smithi120.stderr: 86 | sprintf(buf, "NA\0"); 2024-04-18T04:47:02.015 INFO:tasks.workunit.client.0.smithi120.stderr: | ^~ 2024-04-18T04:47:02.034 INFO:tasks.workunit.client.0.smithi120.stderr:ffsb_op.c: In function 'print_results': 2024-04-18T04:47:02.034 INFO:tasks.workunit.client.0.smithi120.stderr:ffsb_op.c:83:33: warning: '/sec' directive writing 4 bytes into a region of size between 1 and 256 [-Wformat-overflow=] 2024-04-18T04:47:02.034 INFO:tasks.workunit.client.0.smithi120.stderr: 83 | sprintf(buf, "%s/sec\0", buf); 2024-04-18T04:47:02.035 INFO:tasks.workunit.client.0.smithi120.stderr: | ^~~~ 2024-04-18T04:47:02.035 INFO:tasks.workunit.client.0.smithi120.stderr:In file included from /usr/include/stdio.h:894, 2024-04-18T04:47:02.035 INFO:tasks.workunit.client.0.smithi120.stderr: from ffsb_op.c:20: 2024-04-18T04:47:02.035 INFO:tasks.workunit.client.0.smithi120.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 5 and 260 bytes into a destination of size 256 2024-04-18T04:47:02.035 INFO:tasks.workunit.client.0.smithi120.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-04-18T04:47:02.035 INFO:tasks.workunit.client.0.smithi120.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-18T04:47:02.035 INFO:tasks.workunit.client.0.smithi120.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-04-18T04:47:02.035 INFO:tasks.workunit.client.0.smithi120.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-18T04:47:02.035 INFO:tasks.workunit.client.0.smithi120.stderr: 40 | __va_arg_pack ()); 2024-04-18T04:47:02.035 INFO:tasks.workunit.client.0.smithi120.stderr: | ~~~~~~~~~~~~~~~~~ 2024-04-18T04:47:02.071 INFO:tasks.workunit.client.0.smithi120.stdout:mv -f .deps/ffsb_op.Tpo .deps/ffsb_op.Po 2024-04-18T04:47:02.077 INFO:tasks.workunit.client.0.smithi120.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c 2024-04-18T04:47:02.199 INFO:tasks.workunit.client.0.smithi120.stdout:mv -f .deps/util.Tpo .deps/util.Po 2024-04-18T04:47:02.204 INFO:tasks.workunit.client.0.smithi120.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT parser.o -MD -MP -MF .deps/parser.Tpo -c -o parser.o parser.c 2024-04-18T04:47:02.244 INFO:tasks.workunit.client.0.smithi120.stderr:In file included from parser.h:22, 2024-04-18T04:47:02.244 INFO:tasks.workunit.client.0.smithi120.stderr: from parser.c:25: 2024-04-18T04:47:02.244 INFO:tasks.workunit.client.0.smithi120.stderr:parser.c: In function 'init_filesys': 2024-04-18T04:47:02.244 INFO:tasks.workunit.client.0.smithi120.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-04-18T04:47:02.244 INFO:tasks.workunit.client.0.smithi120.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-04-18T04:47:02.245 INFO:tasks.workunit.client.0.smithi120.stderr: | ^ 2024-04-18T04:47:02.245 INFO:tasks.workunit.client.0.smithi120.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-04-18T04:47:02.245 INFO:tasks.workunit.client.0.smithi120.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-04-18T04:47:02.245 INFO:tasks.workunit.client.0.smithi120.stderr: | ^~~~~~~~ 2024-04-18T04:47:02.245 INFO:tasks.workunit.client.0.smithi120.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-04-18T04:47:02.245 INFO:tasks.workunit.client.0.smithi120.stderr: 36 | container_of(ptr, type, member) 2024-04-18T04:47:02.245 INFO:tasks.workunit.client.0.smithi120.stderr: | ^~~~~~~~~~~~ 2024-04-18T04:47:02.245 INFO:tasks.workunit.client.0.smithi120.stderr:list.h:39:20: note: in expansion of macro 'list_entry' 2024-04-18T04:47:02.245 INFO:tasks.workunit.client.0.smithi120.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-04-18T04:47:02.245 INFO:tasks.workunit.client.0.smithi120.stderr: | ^~~~~~~~~~ 2024-04-18T04:47:02.245 INFO:tasks.workunit.client.0.smithi120.stderr:parser.c:934:17: note: in expansion of macro 'list_for_each_entry' 2024-04-18T04:47:02.245 INFO:tasks.workunit.client.0.smithi120.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-04-18T04:47:02.245 INFO:tasks.workunit.client.0.smithi120.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-18T04:47:02.245 INFO:tasks.workunit.client.0.smithi120.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-04-18T04:47:02.245 INFO:tasks.workunit.client.0.smithi120.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-04-18T04:47:02.246 INFO:tasks.workunit.client.0.smithi120.stderr: | ^ 2024-04-18T04:47:02.246 INFO:tasks.workunit.client.0.smithi120.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-04-18T04:47:02.246 INFO:tasks.workunit.client.0.smithi120.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-04-18T04:47:02.246 INFO:tasks.workunit.client.0.smithi120.stderr: | ^~~~~~~~ 2024-04-18T04:47:02.246 INFO:tasks.workunit.client.0.smithi120.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-04-18T04:47:02.246 INFO:tasks.workunit.client.0.smithi120.stderr: 36 | container_of(ptr, type, member) 2024-04-18T04:47:02.246 INFO:tasks.workunit.client.0.smithi120.stderr: | ^~~~~~~~~~~~ 2024-04-18T04:47:02.246 INFO:tasks.workunit.client.0.smithi120.stderr:list.h:41:20: note: in expansion of macro 'list_entry' 2024-04-18T04:47:02.246 INFO:tasks.workunit.client.0.smithi120.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-04-18T04:47:02.246 INFO:tasks.workunit.client.0.smithi120.stderr: | ^~~~~~~~~~ 2024-04-18T04:47:02.246 INFO:tasks.workunit.client.0.smithi120.stderr:parser.c:934:17: note: in expansion of macro 'list_for_each_entry' 2024-04-18T04:47:02.246 INFO:tasks.workunit.client.0.smithi120.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-04-18T04:47:02.246 INFO:tasks.workunit.client.0.smithi120.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-18T04:47:02.247 INFO:tasks.workunit.client.0.smithi120.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-04-18T04:47:02.247 INFO:tasks.workunit.client.0.smithi120.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-04-18T04:47:02.247 INFO:tasks.workunit.client.0.smithi120.stderr: | ^ 2024-04-18T04:47:02.247 INFO:tasks.workunit.client.0.smithi120.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-04-18T04:47:02.247 INFO:tasks.workunit.client.0.smithi120.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-04-18T04:47:02.247 INFO:tasks.workunit.client.0.smithi120.stderr: | ^~~~~~~~ 2024-04-18T04:47:02.247 INFO:tasks.workunit.client.0.smithi120.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-04-18T04:47:02.247 INFO:tasks.workunit.client.0.smithi120.stderr: 36 | container_of(ptr, type, member) 2024-04-18T04:47:02.247 INFO:tasks.workunit.client.0.smithi120.stderr: | ^~~~~~~~~~~~ 2024-04-18T04:47:02.247 INFO:tasks.workunit.client.0.smithi120.stderr:list.h:39:20: note: in expansion of macro 'list_entry' 2024-04-18T04:47:02.247 INFO:tasks.workunit.client.0.smithi120.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-04-18T04:47:02.247 INFO:tasks.workunit.client.0.smithi120.stderr: | ^~~~~~~~~~ 2024-04-18T04:47:02.247 INFO:tasks.workunit.client.0.smithi120.stderr:parser.c:941:17: note: in expansion of macro 'list_for_each_entry' 2024-04-18T04:47:02.247 INFO:tasks.workunit.client.0.smithi120.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-04-18T04:47:02.247 INFO:tasks.workunit.client.0.smithi120.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-18T04:47:02.247 INFO:tasks.workunit.client.0.smithi120.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-04-18T04:47:02.248 INFO:tasks.workunit.client.0.smithi120.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-04-18T04:47:02.248 INFO:tasks.workunit.client.0.smithi120.stderr: | ^ 2024-04-18T04:47:02.248 INFO:tasks.workunit.client.0.smithi120.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-04-18T04:47:02.248 INFO:tasks.workunit.client.0.smithi120.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-04-18T04:47:02.248 INFO:tasks.workunit.client.0.smithi120.stderr: | ^~~~~~~~ 2024-04-18T04:47:02.248 INFO:tasks.workunit.client.0.smithi120.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-04-18T04:47:02.248 INFO:tasks.workunit.client.0.smithi120.stderr: 36 | container_of(ptr, type, member) 2024-04-18T04:47:02.248 INFO:tasks.workunit.client.0.smithi120.stderr: | ^~~~~~~~~~~~ 2024-04-18T04:47:02.248 INFO:tasks.workunit.client.0.smithi120.stderr:list.h:41:20: note: in expansion of macro 'list_entry' 2024-04-18T04:47:02.248 INFO:tasks.workunit.client.0.smithi120.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-04-18T04:47:02.248 INFO:tasks.workunit.client.0.smithi120.stderr: | ^~~~~~~~~~ 2024-04-18T04:47:02.248 INFO:tasks.workunit.client.0.smithi120.stderr:parser.c:941:17: note: in expansion of macro 'list_for_each_entry' 2024-04-18T04:47:02.248 INFO:tasks.workunit.client.0.smithi120.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-04-18T04:47:02.248 INFO:tasks.workunit.client.0.smithi120.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-18T04:47:02.248 INFO:tasks.workunit.client.0.smithi120.stderr:parser.c: In function 'init_tg_stats': 2024-04-18T04:47:02.249 INFO:tasks.workunit.client.0.smithi120.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-04-18T04:47:02.249 INFO:tasks.workunit.client.0.smithi120.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-04-18T04:47:02.249 INFO:tasks.workunit.client.0.smithi120.stderr: | ^ 2024-04-18T04:47:02.249 INFO:tasks.workunit.client.0.smithi120.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-04-18T04:47:02.249 INFO:tasks.workunit.client.0.smithi120.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-04-18T04:47:02.249 INFO:tasks.workunit.client.0.smithi120.stderr: | ^~~~~~~~ 2024-04-18T04:47:02.249 INFO:tasks.workunit.client.0.smithi120.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-04-18T04:47:02.249 INFO:tasks.workunit.client.0.smithi120.stderr: 36 | container_of(ptr, type, member) 2024-04-18T04:47:02.249 INFO:tasks.workunit.client.0.smithi120.stderr: | ^~~~~~~~~~~~ 2024-04-18T04:47:02.249 INFO:tasks.workunit.client.0.smithi120.stderr:list.h:39:20: note: in expansion of macro 'list_entry' 2024-04-18T04:47:02.249 INFO:tasks.workunit.client.0.smithi120.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-04-18T04:47:02.249 INFO:tasks.workunit.client.0.smithi120.stderr: | ^~~~~~~~~~ 2024-04-18T04:47:02.249 INFO:tasks.workunit.client.0.smithi120.stderr:parser.c:971:41: note: in expansion of macro 'list_for_each_entry' 2024-04-18T04:47:02.249 INFO:tasks.workunit.client.0.smithi120.stderr: 971 | list_for_each_entry(tmp_list, 2024-04-18T04:47:02.250 INFO:tasks.workunit.client.0.smithi120.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-18T04:47:02.250 INFO:tasks.workunit.client.0.smithi120.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-04-18T04:47:02.250 INFO:tasks.workunit.client.0.smithi120.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-04-18T04:47:02.250 INFO:tasks.workunit.client.0.smithi120.stderr: | ^ 2024-04-18T04:47:02.250 INFO:tasks.workunit.client.0.smithi120.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-04-18T04:47:02.250 INFO:tasks.workunit.client.0.smithi120.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-04-18T04:47:02.250 INFO:tasks.workunit.client.0.smithi120.stderr: | ^~~~~~~~ 2024-04-18T04:47:02.250 INFO:tasks.workunit.client.0.smithi120.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-04-18T04:47:02.250 INFO:tasks.workunit.client.0.smithi120.stderr: 36 | container_of(ptr, type, member) 2024-04-18T04:47:02.250 INFO:tasks.workunit.client.0.smithi120.stderr: | ^~~~~~~~~~~~ 2024-04-18T04:47:02.250 INFO:tasks.workunit.client.0.smithi120.stderr:list.h:41:20: note: in expansion of macro 'list_entry' 2024-04-18T04:47:02.250 INFO:tasks.workunit.client.0.smithi120.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-04-18T04:47:02.250 INFO:tasks.workunit.client.0.smithi120.stderr: | ^~~~~~~~~~ 2024-04-18T04:47:02.251 INFO:tasks.workunit.client.0.smithi120.stderr:parser.c:971:41: note: in expansion of macro 'list_for_each_entry' 2024-04-18T04:47:02.251 INFO:tasks.workunit.client.0.smithi120.stderr: 971 | list_for_each_entry(tmp_list, 2024-04-18T04:47:02.251 INFO:tasks.workunit.client.0.smithi120.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-18T04:47:02.251 INFO:tasks.workunit.client.0.smithi120.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-04-18T04:47:02.251 INFO:tasks.workunit.client.0.smithi120.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-04-18T04:47:02.251 INFO:tasks.workunit.client.0.smithi120.stderr: | ^ 2024-04-18T04:47:02.251 INFO:tasks.workunit.client.0.smithi120.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-04-18T04:47:02.251 INFO:tasks.workunit.client.0.smithi120.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-04-18T04:47:02.251 INFO:tasks.workunit.client.0.smithi120.stderr: | ^~~~~~~~ 2024-04-18T04:47:02.251 INFO:tasks.workunit.client.0.smithi120.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-04-18T04:47:02.251 INFO:tasks.workunit.client.0.smithi120.stderr: 36 | container_of(ptr, type, member) 2024-04-18T04:47:02.251 INFO:tasks.workunit.client.0.smithi120.stderr: | ^~~~~~~~~~~~ 2024-04-18T04:47:02.251 INFO:tasks.workunit.client.0.smithi120.stderr:list.h:39:20: note: in expansion of macro 'list_entry' 2024-04-18T04:47:02.252 INFO:tasks.workunit.client.0.smithi120.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-04-18T04:47:02.252 INFO:tasks.workunit.client.0.smithi120.stderr: | ^~~~~~~~~~ 2024-04-18T04:47:02.252 INFO:tasks.workunit.client.0.smithi120.stderr:parser.c:980:41: note: in expansion of macro 'list_for_each_entry' 2024-04-18T04:47:02.252 INFO:tasks.workunit.client.0.smithi120.stderr: 980 | list_for_each_entry(tmp_list, 2024-04-18T04:47:02.252 INFO:tasks.workunit.client.0.smithi120.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-18T04:47:02.252 INFO:tasks.workunit.client.0.smithi120.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-04-18T04:47:02.252 INFO:tasks.workunit.client.0.smithi120.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-04-18T04:47:02.252 INFO:tasks.workunit.client.0.smithi120.stderr: | ^ 2024-04-18T04:47:02.252 INFO:tasks.workunit.client.0.smithi120.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-04-18T04:47:02.252 INFO:tasks.workunit.client.0.smithi120.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-04-18T04:47:02.252 INFO:tasks.workunit.client.0.smithi120.stderr: | ^~~~~~~~ 2024-04-18T04:47:02.252 INFO:tasks.workunit.client.0.smithi120.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-04-18T04:47:02.252 INFO:tasks.workunit.client.0.smithi120.stderr: 36 | container_of(ptr, type, member) 2024-04-18T04:47:02.253 INFO:tasks.workunit.client.0.smithi120.stderr: | ^~~~~~~~~~~~ 2024-04-18T04:47:02.253 INFO:tasks.workunit.client.0.smithi120.stderr:list.h:41:20: note: in expansion of macro 'list_entry' 2024-04-18T04:47:02.253 INFO:tasks.workunit.client.0.smithi120.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-04-18T04:47:02.253 INFO:tasks.workunit.client.0.smithi120.stderr: | ^~~~~~~~~~ 2024-04-18T04:47:02.253 INFO:tasks.workunit.client.0.smithi120.stderr:parser.c:980:41: note: in expansion of macro 'list_for_each_entry' 2024-04-18T04:47:02.253 INFO:tasks.workunit.client.0.smithi120.stderr: 980 | list_for_each_entry(tmp_list, 2024-04-18T04:47:02.253 INFO:tasks.workunit.client.0.smithi120.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-18T04:47:02.288 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:47:02.296 INFO:tasks.workunit.client.0.smithi120.stderr:parser.c: In function 'get_optstr': 2024-04-18T04:47:02.296 INFO:tasks.workunit.client.0.smithi120.stderr:parser.c:206:23: warning: 'strnlen' specified bound 4095 exceeds source size 1024 [-Wstringop-overread] 2024-04-18T04:47:02.296 INFO:tasks.workunit.client.0.smithi120.stderr: 206 | len = strnlen(temp, 4095) + 1; 2024-04-18T04:47:02.296 INFO:tasks.workunit.client.0.smithi120.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-18T04:47:02.296 INFO:tasks.workunit.client.0.smithi120.stderr:parser.c:200:14: note: source object declared here 2024-04-18T04:47:02.296 INFO:tasks.workunit.client.0.smithi120.stderr: 200 | char temp[BUFSIZE]; 2024-04-18T04:47:02.296 INFO:tasks.workunit.client.0.smithi120.stderr: | ^~~~ 2024-04-18T04:47:02.313 INFO:tasks.workunit.client.0.smithi120.stderr:In file included from /usr/include/string.h:535, 2024-04-18T04:47:02.313 INFO:tasks.workunit.client.0.smithi120.stderr: from parser.c:19: 2024-04-18T04:47:02.313 INFO:tasks.workunit.client.0.smithi120.stderr:In function 'memcpy', 2024-04-18T04:47:02.313 INFO:tasks.workunit.client.0.smithi120.stderr: inlined from 'size64_convert' at parser.c:119:2: 2024-04-18T04:47:02.314 INFO:tasks.workunit.client.0.smithi120.stderr:/usr/include/x86_64-linux-gnu/bits/string_fortified.h:29:10: warning: '__builtin_memcpy' reading 3 bytes from a region of size 2 [-Wstringop-overread] 2024-04-18T04:47:02.314 INFO:tasks.workunit.client.0.smithi120.stderr: 29 | return __builtin___memcpy_chk (__dest, __src, __len, 2024-04-18T04:47:02.314 INFO:tasks.workunit.client.0.smithi120.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-18T04:47:02.314 INFO:tasks.workunit.client.0.smithi120.stderr: 30 | __glibc_objsize0 (__dest)); 2024-04-18T04:47:02.314 INFO:tasks.workunit.client.0.smithi120.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-18T04:47:02.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.429+0000 7f4a17600640 1 Processor -- start 2024-04-18T04:47:02.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.429+0000 7f4a17600640 1 -- start start 2024-04-18T04:47:02.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.429+0000 7f4a17600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a1006b8c0 0x7f4a100c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:02.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.429+0000 7f4a17600640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4a1006bca0 0x7f4a1006c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:02.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.429+0000 7f4a17600640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4a10151440 0x7f4a101518d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:02.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.429+0000 7f4a17600640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a10158610 con 0x7f4a1006bca0 2024-04-18T04:47:02.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.429+0000 7f4a17600640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a100c7740 con 0x7f4a10151440 2024-04-18T04:47:02.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.429+0000 7f4a17600640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a101576f0 con 0x7f4a1006b8c0 2024-04-18T04:47:02.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.429+0000 7f4a07e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4a1006bca0 0x7f4a1006c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:02.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.429+0000 7f4a07e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4a1006bca0 0x7f4a1006c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:42296/0 (socket says 172.21.15.120:42296) 2024-04-18T04:47:02.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.429+0000 7f4a07e00640 1 -- 172.21.15.120:0/2499049812 learned_addr learned my addr 172.21.15.120:0/2499049812 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:47:02.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.429+0000 7f4a15600640 1 --2- 172.21.15.120:0/2499049812 >> v2:172.21.15.132:3300/0 conn(0x7f4a10151440 0x7f4a101518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:02.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.429+0000 7f4a14c00640 1 --2- 172.21.15.120:0/2499049812 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a1006b8c0 0x7f4a100c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:02.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.429+0000 7f4a07e00640 1 -- 172.21.15.120:0/2499049812 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a1006b8c0 msgr2=0x7f4a100c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:47:02.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.429+0000 7f4a07e00640 1 --2- 172.21.15.120:0/2499049812 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a1006b8c0 0x7f4a100c7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:02.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.429+0000 7f4a07e00640 1 -- 172.21.15.120:0/2499049812 >> v2:172.21.15.132:3300/0 conn(0x7f4a10151440 msgr2=0x7f4a101518d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:47:02.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.429+0000 7f4a07e00640 1 --2- 172.21.15.120:0/2499049812 >> v2:172.21.15.132:3300/0 conn(0x7f4a10151440 0x7f4a101518d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:02.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.429+0000 7f4a07e00640 1 -- 172.21.15.120:0/2499049812 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a10157990 con 0x7f4a1006bca0 2024-04-18T04:47:02.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.429+0000 7f4a15600640 1 --2- 172.21.15.120:0/2499049812 >> v2:172.21.15.132:3300/0 conn(0x7f4a10151440 0x7f4a101518d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:47:02.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.429+0000 7f4a14c00640 1 --2- 172.21.15.120:0/2499049812 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a1006b8c0 0x7f4a100c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:47:02.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.433+0000 7f4a07e00640 1 --2- 172.21.15.120:0/2499049812 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a1006bca0 0x7f4a1006c0c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4a100c88b0 tx=0x7f49f801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eb1aee60bdd45bd server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:47:02.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.433+0000 7f4a0fe00640 1 -- 172.21.15.120:0/2499049812 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f80a89d0 con 0x7f4a1006bca0 2024-04-18T04:47:02.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.433+0000 7f4a0fe00640 1 -- 172.21.15.120:0/2499049812 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49f80a8b30 con 0x7f4a1006bca0 2024-04-18T04:47:02.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.433+0000 7f4a0fe00640 1 -- 172.21.15.120:0/2499049812 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f80b0440 con 0x7f4a1006bca0 2024-04-18T04:47:02.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.433+0000 7f4a17600640 1 -- 172.21.15.120:0/2499049812 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a1006bca0 msgr2=0x7f4a1006c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:02.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.433+0000 7f4a17600640 1 --2- 172.21.15.120:0/2499049812 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a1006bca0 0x7f4a1006c0c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4a100c88b0 tx=0x7f49f801ed10 comp rx=0 tx=0).stop 2024-04-18T04:47:02.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.433+0000 7f4a17600640 1 -- 172.21.15.120:0/2499049812 shutdown_connections 2024-04-18T04:47:02.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.433+0000 7f4a17600640 1 --2- 172.21.15.120:0/2499049812 >> v2:172.21.15.132:3300/0 conn(0x7f4a10151440 0x7f4a101518d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:02.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.433+0000 7f4a17600640 1 --2- 172.21.15.120:0/2499049812 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a1006bca0 0x7f4a1006c0c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:02.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.433+0000 7f4a17600640 1 --2- 172.21.15.120:0/2499049812 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a1006b8c0 0x7f4a100c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:02.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.433+0000 7f4a17600640 1 -- 172.21.15.120:0/2499049812 >> 172.21.15.120:0/2499049812 conn(0x7f4a100c78c0 msgr2=0x7f4a100c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:47:02.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.433+0000 7f4a17600640 1 -- 172.21.15.120:0/2499049812 shutdown_connections 2024-04-18T04:47:02.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.433+0000 7f4a17600640 1 -- 172.21.15.120:0/2499049812 wait complete. 2024-04-18T04:47:02.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.437+0000 7f4a17600640 1 Processor -- start 2024-04-18T04:47:02.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.437+0000 7f4a17600640 1 -- start start 2024-04-18T04:47:02.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.437+0000 7f4a17600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a1006b8c0 0x7f4a100b0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:02.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.437+0000 7f4a17600640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a1006bca0 0x7f4a10159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:02.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.437+0000 7f4a17600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a10151440 0x7f4a101ecc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:02.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.437+0000 7f4a17600640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a101f0de0 con 0x7f4a1006b8c0 2024-04-18T04:47:02.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.437+0000 7f4a17600640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a100b0550 con 0x7f4a1006bca0 2024-04-18T04:47:02.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.437+0000 7f4a17600640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a101f0160 con 0x7f4a10151440 2024-04-18T04:47:02.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.437+0000 7f4a14c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a1006b8c0 0x7f4a100b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:02.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.437+0000 7f4a14c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a1006b8c0 0x7f4a100b0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:42308/0 (socket says 172.21.15.120:42308) 2024-04-18T04:47:02.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.437+0000 7f4a14c00640 1 -- 172.21.15.120:0/189966315 learned_addr learned my addr 172.21.15.120:0/189966315 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:47:02.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.437+0000 7f4a07e00640 1 --2- 172.21.15.120:0/189966315 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a1006bca0 0x7f4a10159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:02.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.437+0000 7f4a15600640 1 --2- 172.21.15.120:0/189966315 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a10151440 0x7f4a101ecc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:02.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.437+0000 7f4a14c00640 1 -- 172.21.15.120:0/189966315 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a10151440 msgr2=0x7f4a101ecc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:02.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.437+0000 7f4a14c00640 1 --2- 172.21.15.120:0/189966315 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a10151440 0x7f4a101ecc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:02.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.437+0000 7f4a14c00640 1 -- 172.21.15.120:0/189966315 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a1006bca0 msgr2=0x7f4a10159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:02.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.437+0000 7f4a14c00640 1 --2- 172.21.15.120:0/189966315 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a1006bca0 0x7f4a10159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:02.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.437+0000 7f4a14c00640 1 -- 172.21.15.120:0/189966315 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f80094d0 con 0x7f4a1006b8c0 2024-04-18T04:47:02.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.437+0000 7f4a14c00640 1 --2- 172.21.15.120:0/189966315 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a1006b8c0 0x7f4a100b0010 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4a0000c7f0 tx=0x7f4a0000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:47:02.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.437+0000 7f4a0d600640 1 -- 172.21.15.120:0/189966315 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a00007820 con 0x7f4a1006b8c0 2024-04-18T04:47:02.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.437+0000 7f4a0d600640 1 -- 172.21.15.120:0/189966315 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a00007980 con 0x7f4a1006b8c0 2024-04-18T04:47:02.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.437+0000 7f4a17600640 1 -- 172.21.15.120:0/189966315 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a101f0440 con 0x7f4a1006b8c0 2024-04-18T04:47:02.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.437+0000 7f4a0d600640 1 -- 172.21.15.120:0/189966315 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a00007d30 con 0x7f4a1006b8c0 2024-04-18T04:47:02.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.437+0000 7f4a17600640 1 -- 172.21.15.120:0/189966315 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a101f0a00 con 0x7f4a1006b8c0 2024-04-18T04:47:02.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.437+0000 7f4a17600640 1 -- 172.21.15.120:0/189966315 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a10072a70 con 0x7f4a1006b8c0 2024-04-18T04:47:02.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.441+0000 7f4a0d600640 1 -- 172.21.15.120:0/189966315 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4a000113f0 con 0x7f4a1006b8c0 2024-04-18T04:47:02.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.441+0000 7f4a0d600640 1 --2- 172.21.15.120:0/189966315 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f49ec066690 0x7f49ec068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:02.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.441+0000 7f4a0d600640 1 -- 172.21.15.120:0/189966315 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f4a000849e0 con 0x7f4a1006b8c0 2024-04-18T04:47:02.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.441+0000 7f4a07e00640 1 --2- 172.21.15.120:0/189966315 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f49ec066690 0x7f49ec068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:02.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.441+0000 7f4a07e00640 1 --2- 172.21.15.120:0/189966315 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f49ec066690 0x7f49ec068b50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f49f80b2000 tx=0x7f49f8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:47:02.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.445+0000 7f4a0d600640 1 -- 172.21.15.120:0/189966315 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f4a00051810 con 0x7f4a1006b8c0 2024-04-18T04:47:02.613 INFO:tasks.workunit.client.0.smithi120.stdout:mv -f .deps/parser.Tpo .deps/parser.Po 2024-04-18T04:47:02.618 INFO:tasks.workunit.client.0.smithi120.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fc.o -MD -MP -MF .deps/ffsb_fc.Tpo -c -o ffsb_fc.o ffsb_fc.c 2024-04-18T04:47:02.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.633+0000 7f4a17600640 1 -- 172.21.15.120:0/189966315 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a1006d9a0 con 0x7f4a1006b8c0 2024-04-18T04:47:02.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.633+0000 7f4a0d600640 1 -- 172.21.15.120:0/189966315 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+5530 (secure 0 0 0) 0x7f4a0001f090 con 0x7f4a1006b8c0 2024-04-18T04:47:02.636 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:47:02.636 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:47:00.848506+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"b","rank":2,"incarnation":16,"state":"up:replay","state_seq":1,"addr":"172.21.15.132:6835/1552155328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1552155328},{"type":"v1","addr":"172.21.15.132:6835","nonce":1552155328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:47:02.636 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 16 2024-04-18T04:47:02.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.637+0000 7f4a17600640 1 -- 172.21.15.120:0/189966315 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f49ec066690 msgr2=0x7f49ec068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:02.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.637+0000 7f4a17600640 1 --2- 172.21.15.120:0/189966315 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f49ec066690 0x7f49ec068b50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f49f80b2000 tx=0x7f49f8008040 comp rx=0 tx=0).stop 2024-04-18T04:47:02.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.637+0000 7f4a17600640 1 -- 172.21.15.120:0/189966315 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a1006b8c0 msgr2=0x7f4a100b0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:02.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.637+0000 7f4a17600640 1 --2- 172.21.15.120:0/189966315 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a1006b8c0 0x7f4a100b0010 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4a0000c7f0 tx=0x7f4a0000ccb0 comp rx=0 tx=0).stop 2024-04-18T04:47:02.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.637+0000 7f4a17600640 1 -- 172.21.15.120:0/189966315 shutdown_connections 2024-04-18T04:47:02.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.637+0000 7f4a17600640 1 --2- 172.21.15.120:0/189966315 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f49ec066690 0x7f49ec068b50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:02.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.637+0000 7f4a17600640 1 --2- 172.21.15.120:0/189966315 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a10151440 0x7f4a101ecc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:02.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.637+0000 7f4a17600640 1 --2- 172.21.15.120:0/189966315 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a1006bca0 0x7f4a10159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:02.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.637+0000 7f4a17600640 1 --2- 172.21.15.120:0/189966315 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a1006b8c0 0x7f4a100b0010 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:02.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.637+0000 7f4a17600640 1 -- 172.21.15.120:0/189966315 >> 172.21.15.120:0/189966315 conn(0x7f4a100c78c0 msgr2=0x7f4a100c4970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:47:02.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.637+0000 7f4a17600640 1 -- 172.21.15.120:0/189966315 shutdown_connections 2024-04-18T04:47:02.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.637+0000 7f4a17600640 1 -- 172.21.15.120:0/189966315 wait complete. 2024-04-18T04:47:02.657 INFO:tasks.mds_thrash.fs.[cephfs]:mds.c down, removed from mdsmap 2024-04-18T04:47:02.657 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for mds cluster to stabilize... 2024-04-18T04:47:02.657 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:47:02.690 INFO:tasks.workunit.client.0.smithi120.stdout:mv -f .deps/ffsb_fc.Tpo .deps/ffsb_fc.Po 2024-04-18T04:47:02.695 INFO:tasks.workunit.client.0.smithi120.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_stats.o -MD -MP -MF .deps/ffsb_stats.Tpo -c -o ffsb_stats.o ffsb_stats.c 2024-04-18T04:47:02.802 INFO:tasks.workunit.client.0.smithi120.stdout:mv -f .deps/ffsb_stats.Tpo .deps/ffsb_stats.Po 2024-04-18T04:47:02.807 INFO:tasks.workunit.client.0.smithi120.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c 2024-04-18T04:47:02.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.829+0000 7f1dc8a00640 1 Processor -- start 2024-04-18T04:47:02.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.829+0000 7f1dc8a00640 1 -- start start 2024-04-18T04:47:02.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.829+0000 7f1dc8a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1dc41518f0 0x7f1dc40c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:02.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.829+0000 7f1dc8a00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1dc4065e70 0x7f1dc40c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:02.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.829+0000 7f1dc8a00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dc4157b40 con 0x7f1dc4151510 2024-04-18T04:47:02.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.829+0000 7f1dc8a00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dc40c5220 con 0x7f1dc4065e70 2024-04-18T04:47:02.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.829+0000 7f1dc8a00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc40c54e0 con 0x7f1dc41518f0 2024-04-18T04:47:02.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.829+0000 7f1dbbe00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1dc41518f0 0x7f1dc40c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:02.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.829+0000 7f1dc2800640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1dc4065e70 0x7f1dc40c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:02.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.829+0000 7f1dc1e00640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f1dc4151510 0x7f1dc4157430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:56700/0 (socket says 172.21.15.120:56700) 2024-04-18T04:47:02.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.829+0000 7f1dc1e00640 1 -- 172.21.15.120:0/3545711536 learned_addr learned my addr 172.21.15.120:0/3545711536 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:47:02.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.829+0000 7f1dbbe00640 1 -- 172.21.15.120:0/3545711536 >> v2:172.21.15.132:3300/0 conn(0x7f1dc4065e70 msgr2=0x7f1dc40c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:47:02.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.829+0000 7f1dbbe00640 1 --2- 172.21.15.120:0/3545711536 >> v2:172.21.15.132:3300/0 conn(0x7f1dc4065e70 0x7f1dc40c5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:02.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.829+0000 7f1dbbe00640 1 -- 172.21.15.120:0/3545711536 >> v1:172.21.15.132:6789/0 conn(0x7f1dc4151510 legacy=0x7f1dc4157430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:02.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.829+0000 7f1dbbe00640 1 -- 172.21.15.120:0/3545711536 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc40c57a0 con 0x7f1dc41518f0 2024-04-18T04:47:02.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.829+0000 7f1dc2800640 1 --2- 172.21.15.120:0/3545711536 >> v2:172.21.15.132:3300/0 conn(0x7f1dc4065e70 0x7f1dc40c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:47:02.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.833+0000 7f1dbbe00640 1 --2- 172.21.15.120:0/3545711536 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1dc41518f0 0x7f1dc40c86a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1dac0097c0 tx=0x7f1dac01ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db809b1c428fdd62 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:47:02.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.833+0000 7f1dc1400640 1 -- 172.21.15.120:0/3545711536 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac0a8990 con 0x7f1dc41518f0 2024-04-18T04:47:02.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.833+0000 7f1dc1400640 1 -- 172.21.15.120:0/3545711536 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dac0a8af0 con 0x7f1dc41518f0 2024-04-18T04:47:02.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.833+0000 7f1dc1400640 1 -- 172.21.15.120:0/3545711536 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac0a8e80 con 0x7f1dc41518f0 2024-04-18T04:47:02.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.833+0000 7f1dc8a00640 1 -- 172.21.15.120:0/3545711536 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1dc41518f0 msgr2=0x7f1dc40c86a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:02.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.833+0000 7f1dc8a00640 1 --2- 172.21.15.120:0/3545711536 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1dc41518f0 0x7f1dc40c86a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1dac0097c0 tx=0x7f1dac01ec90 comp rx=0 tx=0).stop 2024-04-18T04:47:02.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.833+0000 7f1dc8a00640 1 -- 172.21.15.120:0/3545711536 shutdown_connections 2024-04-18T04:47:02.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.833+0000 7f1dc8a00640 1 --2- 172.21.15.120:0/3545711536 >> v2:172.21.15.132:3300/0 conn(0x7f1dc4065e70 0x7f1dc40c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:02.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.833+0000 7f1dc8a00640 1 --2- 172.21.15.120:0/3545711536 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1dc41518f0 0x7f1dc40c86a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:02.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.833+0000 7f1dc8a00640 1 -- 172.21.15.120:0/3545711536 >> 172.21.15.120:0/3545711536 conn(0x7f1dc4066a50 msgr2=0x7f1dc4069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:47:02.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.833+0000 7f1dc8a00640 1 -- 172.21.15.120:0/3545711536 shutdown_connections 2024-04-18T04:47:02.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.833+0000 7f1dc8a00640 1 -- 172.21.15.120:0/3545711536 wait complete. 2024-04-18T04:47:02.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.837+0000 7f1dc8a00640 1 Processor -- start 2024-04-18T04:47:02.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.837+0000 7f1dc8a00640 1 -- start start 2024-04-18T04:47:02.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.837+0000 7f1dc8a00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1dc4065e70 0x7f1dc41f0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:02.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.837+0000 7f1dc8a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1dc4151510 0x7f1dc4144a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:02.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.837+0000 7f1dc8a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1dc41518f0 0x7f1dc4155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:02.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.837+0000 7f1dc8a00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc4150650 con 0x7f1dc4151510 2024-04-18T04:47:02.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.837+0000 7f1dc8a00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc41f1260 con 0x7f1dc4065e70 2024-04-18T04:47:02.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.837+0000 7f1dc8a00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc41ed6b0 con 0x7f1dc41518f0 2024-04-18T04:47:02.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.837+0000 7f1dbbe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1dc4151510 0x7f1dc4144a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:02.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.837+0000 7f1dbbe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1dc4151510 0x7f1dc4144a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:42324/0 (socket says 172.21.15.120:42324) 2024-04-18T04:47:02.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.837+0000 7f1dbbe00640 1 -- 172.21.15.120:0/2514495901 learned_addr learned my addr 172.21.15.120:0/2514495901 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:47:02.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.837+0000 7f1dc1e00640 1 --2- 172.21.15.120:0/2514495901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1dc4065e70 0x7f1dc41f0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:02.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.837+0000 7f1dc2800640 1 --2- 172.21.15.120:0/2514495901 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1dc41518f0 0x7f1dc4155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:02.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.837+0000 7f1dbbe00640 1 -- 172.21.15.120:0/2514495901 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1dc41518f0 msgr2=0x7f1dc4155490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:02.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.837+0000 7f1dbbe00640 1 --2- 172.21.15.120:0/2514495901 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1dc41518f0 0x7f1dc4155490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:02.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.837+0000 7f1dbbe00640 1 -- 172.21.15.120:0/2514495901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1dc4065e70 msgr2=0x7f1dc41f0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:02.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.837+0000 7f1dbbe00640 1 --2- 172.21.15.120:0/2514495901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1dc4065e70 0x7f1dc41f0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:02.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.837+0000 7f1dbbe00640 1 -- 172.21.15.120:0/2514495901 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dbc009a70 con 0x7f1dc4151510 2024-04-18T04:47:02.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.837+0000 7f1dc2800640 1 --2- 172.21.15.120:0/2514495901 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1dc41518f0 0x7f1dc4155490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:47:02.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.837+0000 7f1dbbe00640 1 --2- 172.21.15.120:0/2514495901 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1dc4151510 0x7f1dc4144a20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1dac01d340 tx=0x7f1dac01ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:47:02.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.837+0000 7f1dba000640 1 -- 172.21.15.120:0/2514495901 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac0bb640 con 0x7f1dc4151510 2024-04-18T04:47:02.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.837+0000 7f1dba000640 1 -- 172.21.15.120:0/2514495901 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dac0bb7c0 con 0x7f1dc4151510 2024-04-18T04:47:02.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.837+0000 7f1dc8a00640 1 -- 172.21.15.120:0/2514495901 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dac009420 con 0x7f1dc4151510 2024-04-18T04:47:02.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.837+0000 7f1dba000640 1 -- 172.21.15.120:0/2514495901 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac0bbb70 con 0x7f1dc4151510 2024-04-18T04:47:02.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.837+0000 7f1dc8a00640 1 -- 172.21.15.120:0/2514495901 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dc40c63d0 con 0x7f1dc4151510 2024-04-18T04:47:02.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.841+0000 7f1dc8a00640 1 -- 172.21.15.120:0/2514495901 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dc4072a70 con 0x7f1dc4151510 2024-04-18T04:47:02.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.841+0000 7f1dba000640 1 -- 172.21.15.120:0/2514495901 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1dac0b7040 con 0x7f1dc4151510 2024-04-18T04:47:02.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.841+0000 7f1dba000640 1 --2- 172.21.15.120:0/2514495901 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1da0066690 0x7f1da0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:02.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.841+0000 7f1dba000640 1 -- 172.21.15.120:0/2514495901 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f1dac122810 con 0x7f1dc4151510 2024-04-18T04:47:02.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.841+0000 7f1dc1e00640 1 --2- 172.21.15.120:0/2514495901 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1da0066690 0x7f1da0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:02.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.845+0000 7f1dc1e00640 1 --2- 172.21.15.120:0/2514495901 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1da0066690 0x7f1da0068b50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1db4005890 tx=0x7f1db4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:47:02.847 INFO:tasks.workunit.client.0.smithi120.stdout:mv -f .deps/list.Tpo .deps/list.Po 2024-04-18T04:47:02.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:02.845+0000 7f1dba000640 1 -- 172.21.15.120:0/2514495901 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f1dac0ef760 con 0x7f1dc4151510 2024-04-18T04:47:02.855 INFO:tasks.workunit.client.0.smithi120.stdout:gcc -D_GNU_SOURCE -g -O2 -D_REENTRANT -o ffsb fileops.o rand.o main.o fh.o filelist.o metaops.o rwlock.o cirlist.o rbt.o ffsb_tg.o ffsb_fs.o ffsb_thread.o ffsb_op.o util.o parser.o ffsb_fc.o ffsb_stats.o list.o -lpthread -lm 2024-04-18T04:47:02.904 INFO:tasks.workunit.client.0.smithi120.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-04-18T04:47:02.910 INFO:tasks.workunit.client.0.smithi120.stdout:FFSB version 6.0-RC2 started 2024-04-18T04:47:02.910 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-04-18T04:47:02.919 INFO:tasks.workunit.client.0.smithi120.stdout:benchmark time = 300 2024-04-18T04:47:02.919 INFO:tasks.workunit.client.0.smithi120.stdout:ThreadGroup 0 2024-04-18T04:47:02.919 INFO:tasks.workunit.client.0.smithi120.stdout:================ 2024-04-18T04:47:02.919 INFO:tasks.workunit.client.0.smithi120.stdout: num_threads = 32 2024-04-18T04:47:02.919 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-04-18T04:47:02.919 INFO:tasks.workunit.client.0.smithi120.stdout: read_random = off 2024-04-18T04:47:02.919 INFO:tasks.workunit.client.0.smithi120.stdout: read_size = 0 (0B) 2024-04-18T04:47:02.919 INFO:tasks.workunit.client.0.smithi120.stdout: read_blocksize = 0 (0B) 2024-04-18T04:47:02.919 INFO:tasks.workunit.client.0.smithi120.stdout: read_skip = off 2024-04-18T04:47:02.919 INFO:tasks.workunit.client.0.smithi120.stdout: read_skipsize = 0 (0B) 2024-04-18T04:47:02.919 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-04-18T04:47:02.920 INFO:tasks.workunit.client.0.smithi120.stdout: write_random = on 2024-04-18T04:47:02.920 INFO:tasks.workunit.client.0.smithi120.stdout: write_size = 5242880 (5MB) 2024-04-18T04:47:02.920 INFO:tasks.workunit.client.0.smithi120.stdout: fsync_file = 0 2024-04-18T04:47:02.920 INFO:tasks.workunit.client.0.smithi120.stdout: write_blocksize = 4096 (4KB) 2024-04-18T04:47:02.920 INFO:tasks.workunit.client.0.smithi120.stdout: wait time = 0 2024-04-18T04:47:02.920 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-04-18T04:47:02.920 INFO:tasks.workunit.client.0.smithi120.stdout: op weights 2024-04-18T04:47:02.920 INFO:tasks.workunit.client.0.smithi120.stdout: read = 0 (0.00%) 2024-04-18T04:47:02.920 INFO:tasks.workunit.client.0.smithi120.stdout: readall = 0 (0.00%) 2024-04-18T04:47:02.920 INFO:tasks.workunit.client.0.smithi120.stdout: write = 1 (100.00%) 2024-04-18T04:47:02.920 INFO:tasks.workunit.client.0.smithi120.stdout: create = 0 (0.00%) 2024-04-18T04:47:02.920 INFO:tasks.workunit.client.0.smithi120.stdout: append = 0 (0.00%) 2024-04-18T04:47:02.920 INFO:tasks.workunit.client.0.smithi120.stdout: delete = 0 (0.00%) 2024-04-18T04:47:02.920 INFO:tasks.workunit.client.0.smithi120.stdout: metaop = 0 (0.00%) 2024-04-18T04:47:02.920 INFO:tasks.workunit.client.0.smithi120.stdout: createdir = 0 (0.00%) 2024-04-18T04:47:02.921 INFO:tasks.workunit.client.0.smithi120.stdout: stat = 0 (0.00%) 2024-04-18T04:47:02.921 INFO:tasks.workunit.client.0.smithi120.stdout: writeall = 0 (0.00%) 2024-04-18T04:47:02.921 INFO:tasks.workunit.client.0.smithi120.stdout: writeall_fsync = 0 (0.00%) 2024-04-18T04:47:02.921 INFO:tasks.workunit.client.0.smithi120.stdout: open_close = 0 (0.00%) 2024-04-18T04:47:02.921 INFO:tasks.workunit.client.0.smithi120.stdout: write_fsync = 0 (0.00%) 2024-04-18T04:47:02.921 INFO:tasks.workunit.client.0.smithi120.stdout: create_fsync = 0 (0.00%) 2024-04-18T04:47:02.921 INFO:tasks.workunit.client.0.smithi120.stdout: append_fsync = 0 (0.00%) 2024-04-18T04:47:02.921 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-04-18T04:47:02.921 INFO:tasks.workunit.client.0.smithi120.stdout:FileSystem . 2024-04-18T04:47:02.921 INFO:tasks.workunit.client.0.smithi120.stdout:========== 2024-04-18T04:47:02.921 INFO:tasks.workunit.client.0.smithi120.stdout: num_dirs = 0 2024-04-18T04:47:02.921 INFO:tasks.workunit.client.0.smithi120.stdout: starting files = 128 2024-04-18T04:47:02.921 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-04-18T04:47:02.921 INFO:tasks.workunit.client.0.smithi120.stdout: min file size = 104857600 (100MB) 2024-04-18T04:47:02.921 INFO:tasks.workunit.client.0.smithi120.stdout: max file size = 104857600 (100MB) 2024-04-18T04:47:02.921 INFO:tasks.workunit.client.0.smithi120.stdout: directio = off 2024-04-18T04:47:02.922 INFO:tasks.workunit.client.0.smithi120.stdout: alignedio = on 2024-04-18T04:47:02.922 INFO:tasks.workunit.client.0.smithi120.stdout: bufferedio = off 2024-04-18T04:47:02.922 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-04-18T04:47:02.922 INFO:tasks.workunit.client.0.smithi120.stdout: aging is off 2024-04-18T04:47:02.922 INFO:tasks.workunit.client.0.smithi120.stdout: current utilization = 0.03% 2024-04-18T04:47:02.922 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-04-18T04:47:02.922 INFO:tasks.workunit.client.0.smithi120.stdout:checking existing fs: . 2024-04-18T04:47:02.922 INFO:tasks.workunit.client.0.smithi120.stdout:recreating new fileset 2024-04-18T04:47:02.922 INFO:tasks.workunit.client.0.smithi120.stderr:opendir: No such file or directory 2024-04-18T04:47:03.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:03.041+0000 7f1dc8a00640 1 -- 172.21.15.120:0/2514495901 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1dc41456b0 con 0x7f1dc4151510 2024-04-18T04:47:03.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:03.041+0000 7f1dba000640 1 -- 172.21.15.120:0/2514495901 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+5530 (secure 0 0 0) 0x7f1dac0f9030 con 0x7f1dc4151510 2024-04-18T04:47:03.041 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:47:03.042 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:47:00.848506+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"b","rank":2,"incarnation":16,"state":"up:replay","state_seq":1,"addr":"172.21.15.132:6835/1552155328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1552155328},{"type":"v1","addr":"172.21.15.132:6835","nonce":1552155328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:47:03.042 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 16 2024-04-18T04:47:03.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:03.041+0000 7f1dc8a00640 1 -- 172.21.15.120:0/2514495901 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1da0066690 msgr2=0x7f1da0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:03.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:03.041+0000 7f1dc8a00640 1 --2- 172.21.15.120:0/2514495901 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1da0066690 0x7f1da0068b50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1db4005890 tx=0x7f1db4009040 comp rx=0 tx=0).stop 2024-04-18T04:47:03.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:03.041+0000 7f1dc8a00640 1 -- 172.21.15.120:0/2514495901 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1dc4151510 msgr2=0x7f1dc4144a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:03.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:03.041+0000 7f1dc8a00640 1 --2- 172.21.15.120:0/2514495901 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1dc4151510 0x7f1dc4144a20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1dac01d340 tx=0x7f1dac01ba30 comp rx=0 tx=0).stop 2024-04-18T04:47:03.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:03.041+0000 7f1dc8a00640 1 -- 172.21.15.120:0/2514495901 shutdown_connections 2024-04-18T04:47:03.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:03.041+0000 7f1dc8a00640 1 --2- 172.21.15.120:0/2514495901 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1da0066690 0x7f1da0068b50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:03.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:03.041+0000 7f1dc8a00640 1 --2- 172.21.15.120:0/2514495901 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1dc41518f0 0x7f1dc4155490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:03.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:03.041+0000 7f1dc8a00640 1 --2- 172.21.15.120:0/2514495901 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1dc4151510 0x7f1dc4144a20 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:03.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:03.041+0000 7f1dc8a00640 1 --2- 172.21.15.120:0/2514495901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1dc4065e70 0x7f1dc41f0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:03.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:03.041+0000 7f1dc8a00640 1 -- 172.21.15.120:0/2514495901 >> 172.21.15.120:0/2514495901 conn(0x7f1dc4066a50 msgr2=0x7f1dc4069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:47:03.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:03.041+0000 7f1dc8a00640 1 -- 172.21.15.120:0/2514495901 shutdown_connections 2024-04-18T04:47:03.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:03.041+0000 7f1dc8a00640 1 -- 172.21.15.120:0/2514495901 wait complete. 2024-04-18T04:47:03.064 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 16, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-18T04:44:30.251235+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 16, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1, 2 ], "info": { "gid_4255": { "addr": "172.21.15.132:6835/1552155328", "addrs": { "addrvec": [ { "addr": "172.21.15.132:6834", "nonce": 1552155328, "type": "v2" }, { "addr": "172.21.15.132:6835", "nonce": 1552155328, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4255, "incarnation": 16, "join_fscid": -1, "name": "b", "rank": 2, "state": "up:replay", "state_seq": 1 }, "gid_4275": { "addr": "172.21.15.120:6836/1079090700", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6834", "nonce": 1079090700, "type": "v2" }, { "addr": "172.21.15.120:6836", "nonce": 1079090700, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4275, "incarnation": 10, "join_fscid": -1, "name": "a", "rank": 1, "state": "up:active", "state_seq": 11 }, "gid_4288": { "addr": "172.21.15.120:6837/76856194", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6835", "nonce": 76856194, "type": "v2" }, { "addr": "172.21.15.120:6837", "nonce": 76856194, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4288, "incarnation": 4, "join_fscid": -1, "name": "e", "rank": 0, "state": "up:active", "state_seq": 4 } }, "last_failure": 0, "last_failure_osd_epoch": 28, "max_file_size": 1099511627776, "max_mds": 3, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-18T04:47:00.848506+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4288, "mds_1": 4275, "mds_2": 4255 } } } ], "standbys": [ { "addr": "172.21.15.132:6839/4292136288", "addrs": { "addrvec": [ { "addr": "172.21.15.132:6836", "nonce": 4292136288, "type": "v2" }, { "addr": "172.21.15.132:6839", "nonce": 4292136288, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4241, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.132:6838/1712856922", "addrs": { "addrvec": [ { "addr": "172.21.15.132:6837", "nonce": 1712856922, "type": "v2" }, { "addr": "172.21.15.132:6838", "nonce": 1712856922, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 2, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4244, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-18T04:47:05.065 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:47:05.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.201+0000 7fa1a7e00640 1 Processor -- start 2024-04-18T04:47:05.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.201+0000 7fa1a7e00640 1 -- start start 2024-04-18T04:47:05.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.201+0000 7fa1a7e00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa1a015cfc0 0x7fa1a015d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:05.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.201+0000 7fa1a7e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1a00c1290 0x7fa1a00c1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:05.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.201+0000 7fa1a7e00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1a006b660 con 0x7fa1a015d3a0 2024-04-18T04:47:05.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.201+0000 7fa1a7e00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1a0070060 con 0x7fa1a015cfc0 2024-04-18T04:47:05.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.201+0000 7fa1a7e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a00c7740 con 0x7fa1a00c1290 2024-04-18T04:47:05.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.201+0000 7fa1a5e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1a00c1290 0x7fa1a00c1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:05.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.201+0000 7fa1a5400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa1a015cfc0 0x7fa1a015d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:05.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.201+0000 7fa1a5e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1a00c1290 0x7fa1a00c1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:37498/0 (socket says 172.21.15.120:37498) 2024-04-18T04:47:05.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.201+0000 7fa1a5400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa1a015cfc0 0x7fa1a015d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:38354/0 (socket says 172.21.15.120:38354) 2024-04-18T04:47:05.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.201+0000 7fa1a5e00640 1 -- 172.21.15.120:0/1281054009 learned_addr learned my addr 172.21.15.120:0/1281054009 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:47:05.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.201+0000 7fa1a4a00640 1 --1- 172.21.15.120:0/1281054009 >> v1:172.21.15.132:6789/0 conn(0x7fa1a015d3a0 0x7fa1a015a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:56712/0 (socket says 172.21.15.120:56712) 2024-04-18T04:47:05.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.205+0000 7fa1a5e00640 1 -- 172.21.15.120:0/1281054009 >> v2:172.21.15.132:3300/0 conn(0x7fa1a015cfc0 msgr2=0x7fa1a015d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:47:05.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.205+0000 7fa1a5e00640 1 --2- 172.21.15.120:0/1281054009 >> v2:172.21.15.132:3300/0 conn(0x7fa1a015cfc0 0x7fa1a015d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:05.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.205+0000 7fa1a5e00640 1 -- 172.21.15.120:0/1281054009 >> v1:172.21.15.132:6789/0 conn(0x7fa1a015d3a0 legacy=0x7fa1a015a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:05.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.205+0000 7fa1a5e00640 1 -- 172.21.15.120:0/1281054009 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a00c0e00 con 0x7fa1a00c1290 2024-04-18T04:47:05.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.205+0000 7fa1a5400640 1 --2- 172.21.15.120:0/1281054009 >> v2:172.21.15.132:3300/0 conn(0x7fa1a015cfc0 0x7fa1a015d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:47:05.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.205+0000 7fa1a5e00640 1 --2- 172.21.15.120:0/1281054009 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1a00c1290 0x7fa1a00c1720 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa198009e50 tx=0x7fa19801f210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=412d994caca1bf11 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:47:05.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.205+0000 7fa19fe00640 1 -- 172.21.15.120:0/1281054009 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1980af400 con 0x7fa1a00c1290 2024-04-18T04:47:05.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.205+0000 7fa19fe00640 1 -- 172.21.15.120:0/1281054009 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1980ab050 con 0x7fa1a00c1290 2024-04-18T04:47:05.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.205+0000 7fa19fe00640 1 -- 172.21.15.120:0/1281054009 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1980af780 con 0x7fa1a00c1290 2024-04-18T04:47:05.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.205+0000 7fa1a7e00640 1 -- 172.21.15.120:0/1281054009 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1a00c1290 msgr2=0x7fa1a00c1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:05.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.205+0000 7fa1a7e00640 1 --2- 172.21.15.120:0/1281054009 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1a00c1290 0x7fa1a00c1720 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa198009e50 tx=0x7fa19801f210 comp rx=0 tx=0).stop 2024-04-18T04:47:05.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.209+0000 7fa1a7e00640 1 -- 172.21.15.120:0/1281054009 shutdown_connections 2024-04-18T04:47:05.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.209+0000 7fa1a7e00640 1 --2- 172.21.15.120:0/1281054009 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1a00c1290 0x7fa1a00c1720 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:05.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.209+0000 7fa1a7e00640 1 --2- 172.21.15.120:0/1281054009 >> v2:172.21.15.132:3300/0 conn(0x7fa1a015cfc0 0x7fa1a015d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:05.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.209+0000 7fa1a7e00640 1 -- 172.21.15.120:0/1281054009 >> 172.21.15.120:0/1281054009 conn(0x7fa1a00c78c0 msgr2=0x7fa1a00c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:47:05.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.209+0000 7fa1a7e00640 1 -- 172.21.15.120:0/1281054009 shutdown_connections 2024-04-18T04:47:05.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.209+0000 7fa1a7e00640 1 -- 172.21.15.120:0/1281054009 wait complete. 2024-04-18T04:47:05.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.209+0000 7fa1a7e00640 1 Processor -- start 2024-04-18T04:47:05.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.209+0000 7fa1a7e00640 1 -- start start 2024-04-18T04:47:05.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.209+0000 7fa1a7e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1a00c1290 0x7fa1a01513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:05.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.209+0000 7fa1a7e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1a015cfc0 0x7fa1a01497a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:05.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.209+0000 7fa1a7e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1a015d3a0 0x7fa1a0149ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:05.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.209+0000 7fa1a7e00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a01551a0 con 0x7fa1a015d3a0 2024-04-18T04:47:05.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.209+0000 7fa1a7e00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a006e100 con 0x7fa1a015cfc0 2024-04-18T04:47:05.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.209+0000 7fa1a7e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a0155a80 con 0x7fa1a00c1290 2024-04-18T04:47:05.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.209+0000 7fa1a5e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1a015d3a0 0x7fa1a0149ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:05.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.209+0000 7fa1a5e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1a015d3a0 0x7fa1a0149ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:42336/0 (socket says 172.21.15.120:42336) 2024-04-18T04:47:05.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.209+0000 7fa1a5e00640 1 -- 172.21.15.120:0/3668918586 learned_addr learned my addr 172.21.15.120:0/3668918586 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:47:05.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.209+0000 7fa1a5400640 1 --2- 172.21.15.120:0/3668918586 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1a00c1290 0x7fa1a01513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:05.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.209+0000 7fa1a4a00640 1 --2- 172.21.15.120:0/3668918586 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1a015cfc0 0x7fa1a01497a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:05.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.209+0000 7fa1a5e00640 1 -- 172.21.15.120:0/3668918586 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1a00c1290 msgr2=0x7fa1a01513c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:05.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.209+0000 7fa1a5e00640 1 --2- 172.21.15.120:0/3668918586 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1a00c1290 0x7fa1a01513c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:05.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.209+0000 7fa1a5e00640 1 -- 172.21.15.120:0/3668918586 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1a015cfc0 msgr2=0x7fa1a01497a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:05.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.209+0000 7fa1a5e00640 1 --2- 172.21.15.120:0/3668918586 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1a015cfc0 0x7fa1a01497a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:05.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.209+0000 7fa1a5e00640 1 -- 172.21.15.120:0/3668918586 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa194009420 con 0x7fa1a015d3a0 2024-04-18T04:47:05.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.209+0000 7fa1a5400640 1 --2- 172.21.15.120:0/3668918586 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1a00c1290 0x7fa1a01513c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:47:05.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.209+0000 7fa1a5e00640 1 --2- 172.21.15.120:0/3668918586 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1a015d3a0 0x7fa1a0149ce0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa1980b2040 tx=0x7fa19801bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:47:05.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.209+0000 7fa19d600640 1 -- 172.21.15.120:0/3668918586 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1980afc60 con 0x7fa1a015d3a0 2024-04-18T04:47:05.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.213+0000 7fa19d600640 1 -- 172.21.15.120:0/3668918586 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1980afde0 con 0x7fa1a015d3a0 2024-04-18T04:47:05.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.213+0000 7fa19d600640 1 -- 172.21.15.120:0/3668918586 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1980ba660 con 0x7fa1a015d3a0 2024-04-18T04:47:05.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.213+0000 7fa1a7e00640 1 -- 172.21.15.120:0/3668918586 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa198009b30 con 0x7fa1a015d3a0 2024-04-18T04:47:05.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.213+0000 7fa1a7e00640 1 -- 172.21.15.120:0/3668918586 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1a01545c0 con 0x7fa1a015d3a0 2024-04-18T04:47:05.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.213+0000 7fa1a7e00640 1 -- 172.21.15.120:0/3668918586 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1a0072a70 con 0x7fa1a015d3a0 2024-04-18T04:47:05.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.213+0000 7fa19d600640 1 -- 172.21.15.120:0/3668918586 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa1980b6040 con 0x7fa1a015d3a0 2024-04-18T04:47:05.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.213+0000 7fa19d600640 1 --2- 172.21.15.120:0/3668918586 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fa180066690 0x7fa180068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:05.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.213+0000 7fa19d600640 1 -- 172.21.15.120:0/3668918586 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fa198122510 con 0x7fa1a015d3a0 2024-04-18T04:47:05.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.213+0000 7fa1a5400640 1 --2- 172.21.15.120:0/3668918586 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fa180066690 0x7fa180068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:05.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.217+0000 7fa1a5400640 1 --2- 172.21.15.120:0/3668918586 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fa180066690 0x7fa180068b50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa1a00ca860 tx=0x7fa194008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:47:05.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.217+0000 7fa19d600640 1 -- 172.21.15.120:0/3668918586 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fa1980ef3d0 con 0x7fa1a015d3a0 2024-04-18T04:47:05.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.413+0000 7fa1a7e00640 1 -- 172.21.15.120:0/3668918586 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa1a00c1d40 con 0x7fa1a015d3a0 2024-04-18T04:47:05.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.413+0000 7fa19d600640 1 -- 172.21.15.120:0/3668918586 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+5530 (secure 0 0 0) 0x7fa198009510 con 0x7fa1a015d3a0 2024-04-18T04:47:05.414 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:47:05.414 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:47:00.848506+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"b","rank":2,"incarnation":16,"state":"up:replay","state_seq":1,"addr":"172.21.15.132:6835/1552155328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1552155328},{"type":"v1","addr":"172.21.15.132:6835","nonce":1552155328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:47:05.414 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 16 2024-04-18T04:47:05.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.413+0000 7fa1a7e00640 1 -- 172.21.15.120:0/3668918586 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fa180066690 msgr2=0x7fa180068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:05.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.413+0000 7fa1a7e00640 1 --2- 172.21.15.120:0/3668918586 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fa180066690 0x7fa180068b50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa1a00ca860 tx=0x7fa194008040 comp rx=0 tx=0).stop 2024-04-18T04:47:05.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.413+0000 7fa1a7e00640 1 -- 172.21.15.120:0/3668918586 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1a015d3a0 msgr2=0x7fa1a0149ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:05.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.413+0000 7fa1a7e00640 1 --2- 172.21.15.120:0/3668918586 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1a015d3a0 0x7fa1a0149ce0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa1980b2040 tx=0x7fa19801bfb0 comp rx=0 tx=0).stop 2024-04-18T04:47:05.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.413+0000 7fa1a7e00640 1 -- 172.21.15.120:0/3668918586 shutdown_connections 2024-04-18T04:47:05.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.413+0000 7fa1a7e00640 1 --2- 172.21.15.120:0/3668918586 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fa180066690 0x7fa180068b50 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:05.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.413+0000 7fa1a7e00640 1 --2- 172.21.15.120:0/3668918586 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1a015d3a0 0x7fa1a0149ce0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:05.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.413+0000 7fa1a7e00640 1 --2- 172.21.15.120:0/3668918586 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1a015cfc0 0x7fa1a01497a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:05.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.413+0000 7fa1a7e00640 1 --2- 172.21.15.120:0/3668918586 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1a00c1290 0x7fa1a01513c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:05.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.413+0000 7fa1a7e00640 1 -- 172.21.15.120:0/3668918586 >> 172.21.15.120:0/3668918586 conn(0x7fa1a00c78c0 msgr2=0x7fa1a006cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:47:05.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.413+0000 7fa1a7e00640 1 -- 172.21.15.120:0/3668918586 shutdown_connections 2024-04-18T04:47:05.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:05.413+0000 7fa1a7e00640 1 -- 172.21.15.120:0/3668918586 wait complete. 2024-04-18T04:47:05.435 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:47:07.436 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:47:07.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.577+0000 7fc453a00640 1 Processor -- start 2024-04-18T04:47:07.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.581+0000 7fc453a00640 1 -- start start 2024-04-18T04:47:07.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.581+0000 7fc453a00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc44c1595e0 0x7fc44c0ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:07.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.581+0000 7fc453a00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc44c159ab0 con 0x7fc44c1538c0 2024-04-18T04:47:07.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.581+0000 7fc453a00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc44c159d90 con 0x7fc44c0ca360 2024-04-18T04:47:07.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.581+0000 7fc453a00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc44c15a630 con 0x7fc44c1595e0 2024-04-18T04:47:07.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.581+0000 7fc451000640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fc44c1538c0 0x7fc44c15d5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:36424/0 (socket says 172.21.15.120:36424) 2024-04-18T04:47:07.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.581+0000 7fc451000640 1 -- 172.21.15.120:0/2314822133 learned_addr learned my addr 172.21.15.120:0/2314822133 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:47:07.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.581+0000 7fc44be00640 1 --2- 172.21.15.120:0/2314822133 >> v2:172.21.15.132:3300/0 conn(0x7fc44c1595e0 0x7fc44c0ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:07.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.581+0000 7fc44b400640 1 -- 172.21.15.120:0/2314822133 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1349528788 0 0) 0x7fc44c159ab0 con 0x7fc44c1538c0 2024-04-18T04:47:07.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.581+0000 7fc44b400640 1 -- 172.21.15.120:0/2314822133 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc434003530 con 0x7fc44c1538c0 2024-04-18T04:47:07.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.581+0000 7fc44b400640 1 -- 172.21.15.120:0/2314822133 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1224080994 0 0) 0x7fc44c159d90 con 0x7fc44c0ca360 2024-04-18T04:47:07.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.581+0000 7fc44b400640 1 -- 172.21.15.120:0/2314822133 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc44c159ab0 con 0x7fc44c0ca360 2024-04-18T04:47:07.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.585+0000 7fc44b400640 1 -- 172.21.15.120:0/2314822133 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3922567230 0 0) 0x7fc434003530 con 0x7fc44c1538c0 2024-04-18T04:47:07.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.585+0000 7fc44b400640 1 -- 172.21.15.120:0/2314822133 >> v2:172.21.15.132:3300/0 conn(0x7fc44c1595e0 msgr2=0x7fc44c0ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:47:07.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.585+0000 7fc44b400640 1 --2- 172.21.15.120:0/2314822133 >> v2:172.21.15.132:3300/0 conn(0x7fc44c1595e0 0x7fc44c0ccee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:07.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.585+0000 7fc44b400640 1 -- 172.21.15.120:0/2314822133 >> v1:172.21.15.132:6789/0 conn(0x7fc44c0ca360 legacy=0x7fc44c06b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:07.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.585+0000 7fc44b400640 1 -- 172.21.15.120:0/2314822133 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc44c15a070 con 0x7fc44c1538c0 2024-04-18T04:47:07.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.585+0000 7fc44b400640 1 -- 172.21.15.120:0/2314822133 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7fc440001680 con 0x7fc44c1538c0 2024-04-18T04:47:07.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.585+0000 7fc44b400640 1 -- 172.21.15.120:0/2314822133 >> v1:172.21.15.120:6789/0 conn(0x7fc44c1538c0 legacy=0x7fc44c15d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:07.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.585+0000 7fc44b400640 1 --2- 172.21.15.120:0/2314822133 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc434003b10 0x7fc434003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:07.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.585+0000 7fc44b400640 1 --2- 172.21.15.120:0/2314822133 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4340047d0 0x7fc434004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:07.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.585+0000 7fc44b400640 1 --2- 172.21.15.120:0/2314822133 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc434005190 0x7fc43400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:07.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.585+0000 7fc44b400640 1 -- 172.21.15.120:0/2314822133 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44c15a630 con 0x7fc434003b10 2024-04-18T04:47:07.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.585+0000 7fc44b400640 1 -- 172.21.15.120:0/2314822133 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43400bf80 con 0x7fc4340047d0 2024-04-18T04:47:07.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.585+0000 7fc44b400640 1 -- 172.21.15.120:0/2314822133 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43400c140 con 0x7fc434005190 2024-04-18T04:47:07.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.585+0000 7fc451000640 1 --2- 172.21.15.120:0/2314822133 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc434003b10 0x7fc434003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:07.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.585+0000 7fc44be00640 1 --2- 172.21.15.120:0/2314822133 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4340047d0 0x7fc434004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:07.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.585+0000 7fc451a00640 1 --2- 172.21.15.120:0/2314822133 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc434005190 0x7fc43400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:07.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.585+0000 7fc451000640 1 -- 172.21.15.120:0/2314822133 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc434005190 msgr2=0x7fc43400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:47:07.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.585+0000 7fc451000640 1 --2- 172.21.15.120:0/2314822133 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc434005190 0x7fc43400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:07.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.585+0000 7fc451000640 1 -- 172.21.15.120:0/2314822133 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4340047d0 msgr2=0x7fc434004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:47:07.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.585+0000 7fc451000640 1 --2- 172.21.15.120:0/2314822133 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4340047d0 0x7fc434004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:07.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.585+0000 7fc451000640 1 -- 172.21.15.120:0/2314822133 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc434003530 con 0x7fc434003b10 2024-04-18T04:47:07.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.585+0000 7fc451a00640 1 -- 172.21.15.120:0/2314822133 reap_dead start 2024-04-18T04:47:07.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.585+0000 7fc451000640 1 --2- 172.21.15.120:0/2314822133 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc434003b10 0x7fc434003f10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc440001ec0 tx=0x7fc44001cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8e1b443b080569d server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:47:07.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.589+0000 7fc44b400640 1 -- 172.21.15.120:0/2314822133 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4400058e0 con 0x7fc434003b10 2024-04-18T04:47:07.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.589+0000 7fc44b400640 1 -- 172.21.15.120:0/2314822133 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc440005a60 con 0x7fc434003b10 2024-04-18T04:47:07.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.589+0000 7fc44b400640 1 -- 172.21.15.120:0/2314822133 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc440005e10 con 0x7fc434003b10 2024-04-18T04:47:07.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.589+0000 7fc453a00640 1 -- 172.21.15.120:0/2314822133 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc434003b10 msgr2=0x7fc434003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:07.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.589+0000 7fc453a00640 1 --2- 172.21.15.120:0/2314822133 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc434003b10 0x7fc434003f10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc440001ec0 tx=0x7fc44001cba0 comp rx=0 tx=0).stop 2024-04-18T04:47:07.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.589+0000 7fc453a00640 1 -- 172.21.15.120:0/2314822133 shutdown_connections 2024-04-18T04:47:07.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.589+0000 7fc453a00640 1 --2- 172.21.15.120:0/2314822133 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc434003b10 0x7fc434003f10 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:07.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.589+0000 7fc453a00640 1 -- 172.21.15.120:0/2314822133 >> 172.21.15.120:0/2314822133 conn(0x7fc44c06e0f0 msgr2=0x7fc44c071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:47:07.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.589+0000 7fc453a00640 1 -- 172.21.15.120:0/2314822133 shutdown_connections 2024-04-18T04:47:07.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.589+0000 7fc453a00640 1 -- 172.21.15.120:0/2314822133 wait complete. 2024-04-18T04:47:07.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.589+0000 7fc453a00640 1 Processor -- start 2024-04-18T04:47:07.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.589+0000 7fc453a00640 1 -- start start 2024-04-18T04:47:07.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.589+0000 7fc453a00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc434003b10 0x7fc44c0c4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:07.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.589+0000 7fc453a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc44c1f1900 0x7fc44c1528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:07.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.589+0000 7fc453a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc44c0c4eb0 0x7fc44c152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:07.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.589+0000 7fc453a00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44c0c3a70 con 0x7fc44c0c4eb0 2024-04-18T04:47:07.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.589+0000 7fc453a00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44c1f1df0 con 0x7fc434003b10 2024-04-18T04:47:07.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.589+0000 7fc453a00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc44c1f20d0 con 0x7fc44c1f1900 2024-04-18T04:47:07.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.589+0000 7fc451a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc44c0c4eb0 0x7fc44c152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:07.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.589+0000 7fc451a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc44c0c4eb0 0x7fc44c152e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:42352/0 (socket says 172.21.15.120:42352) 2024-04-18T04:47:07.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.589+0000 7fc451a00640 1 -- 172.21.15.120:0/109917985 learned_addr learned my addr 172.21.15.120:0/109917985 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:47:07.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.589+0000 7fc44be00640 1 --2- 172.21.15.120:0/109917985 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc44c1f1900 0x7fc44c1528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:07.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.589+0000 7fc451000640 1 --2- 172.21.15.120:0/109917985 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc434003b10 0x7fc44c0c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:07.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.593+0000 7fc451a00640 1 -- 172.21.15.120:0/109917985 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc44c1f1900 msgr2=0x7fc44c1528e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:07.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.593+0000 7fc451a00640 1 --2- 172.21.15.120:0/109917985 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc44c1f1900 0x7fc44c1528e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:07.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.593+0000 7fc451a00640 1 -- 172.21.15.120:0/109917985 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc434003b10 msgr2=0x7fc44c0c4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:07.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.593+0000 7fc451a00640 1 --2- 172.21.15.120:0/109917985 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc434003b10 0x7fc44c0c4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:07.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.593+0000 7fc451a00640 1 -- 172.21.15.120:0/109917985 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc44c1f23b0 con 0x7fc44c0c4eb0 2024-04-18T04:47:07.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.593+0000 7fc44be00640 1 --2- 172.21.15.120:0/109917985 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc44c1f1900 0x7fc44c1528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:47:07.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.593+0000 7fc451000640 1 --2- 172.21.15.120:0/109917985 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc434003b10 0x7fc44c0c4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:47:07.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.593+0000 7fc451a00640 1 --2- 172.21.15.120:0/109917985 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc44c0c4eb0 0x7fc44c152e20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc44c06e630 tx=0x7fc44400f170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:47:07.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.593+0000 7fc448c00640 1 -- 172.21.15.120:0/109917985 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44400fd00 con 0x7fc44c0c4eb0 2024-04-18T04:47:07.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.593+0000 7fc448c00640 1 -- 172.21.15.120:0/109917985 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44400fe80 con 0x7fc44c0c4eb0 2024-04-18T04:47:07.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.593+0000 7fc448c00640 1 -- 172.21.15.120:0/109917985 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc444015650 con 0x7fc44c0c4eb0 2024-04-18T04:47:07.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.593+0000 7fc453a00640 1 -- 172.21.15.120:0/109917985 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc44c1f2690 con 0x7fc44c0c4eb0 2024-04-18T04:47:07.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.593+0000 7fc453a00640 1 -- 172.21.15.120:0/109917985 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc44c0c27d0 con 0x7fc44c0c4eb0 2024-04-18T04:47:07.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.593+0000 7fc453a00640 1 -- 172.21.15.120:0/109917985 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc44c1f2880 con 0x7fc44c0c4eb0 2024-04-18T04:47:07.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.593+0000 7fc448c00640 1 -- 172.21.15.120:0/109917985 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc4440157b0 con 0x7fc44c0c4eb0 2024-04-18T04:47:07.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.593+0000 7fc448c00640 1 --2- 172.21.15.120:0/109917985 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc42c0666c0 0x7fc42c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:07.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.593+0000 7fc448c00640 1 -- 172.21.15.120:0/109917985 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fc4440879f0 con 0x7fc44c0c4eb0 2024-04-18T04:47:07.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.597+0000 7fc451000640 1 --2- 172.21.15.120:0/109917985 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc42c0666c0 0x7fc42c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:07.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.597+0000 7fc451000640 1 --2- 172.21.15.120:0/109917985 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc42c0666c0 0x7fc42c068b80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc440001ec0 tx=0x7fc440001a00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:47:07.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.601+0000 7fc448c00640 1 -- 172.21.15.120:0/109917985 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fc444054940 con 0x7fc44c0c4eb0 2024-04-18T04:47:07.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.793+0000 7fc453a00640 1 -- 172.21.15.120:0/109917985 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc44c072a70 con 0x7fc44c0c4eb0 2024-04-18T04:47:07.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.797+0000 7fc448c00640 1 -- 172.21.15.120:0/109917985 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+5532 (secure 0 0 0) 0x7fc444057f60 con 0x7fc44c0c4eb0 2024-04-18T04:47:07.796 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:47:07.797 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:47:06.018430+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"b","rank":2,"incarnation":16,"state":"up:resolve","state_seq":42,"addr":"172.21.15.132:6835/1552155328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1552155328},{"type":"v1","addr":"172.21.15.132:6835","nonce":1552155328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:47:07.797 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 17 2024-04-18T04:47:07.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.797+0000 7fc453a00640 1 -- 172.21.15.120:0/109917985 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc42c0666c0 msgr2=0x7fc42c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:07.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.797+0000 7fc453a00640 1 --2- 172.21.15.120:0/109917985 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc42c0666c0 0x7fc42c068b80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc440001ec0 tx=0x7fc440001a00 comp rx=0 tx=0).stop 2024-04-18T04:47:07.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.797+0000 7fc453a00640 1 -- 172.21.15.120:0/109917985 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc44c0c4eb0 msgr2=0x7fc44c152e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:07.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.797+0000 7fc453a00640 1 --2- 172.21.15.120:0/109917985 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc44c0c4eb0 0x7fc44c152e20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc44c06e630 tx=0x7fc44400f170 comp rx=0 tx=0).stop 2024-04-18T04:47:07.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.797+0000 7fc453a00640 1 -- 172.21.15.120:0/109917985 shutdown_connections 2024-04-18T04:47:07.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.797+0000 7fc453a00640 1 --2- 172.21.15.120:0/109917985 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc42c0666c0 0x7fc42c068b80 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:07.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.797+0000 7fc453a00640 1 --2- 172.21.15.120:0/109917985 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc44c0c4eb0 0x7fc44c152e20 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:07.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.797+0000 7fc453a00640 1 --2- 172.21.15.120:0/109917985 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc44c1f1900 0x7fc44c1528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:07.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.797+0000 7fc453a00640 1 --2- 172.21.15.120:0/109917985 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc434003b10 0x7fc44c0c4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:07.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.797+0000 7fc453a00640 1 -- 172.21.15.120:0/109917985 >> 172.21.15.120:0/109917985 conn(0x7fc44c06e0f0 msgr2=0x7fc44c06fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:47:07.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.797+0000 7fc453a00640 1 -- 172.21.15.120:0/109917985 shutdown_connections 2024-04-18T04:47:07.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:07.797+0000 7fc453a00640 1 -- 172.21.15.120:0/109917985 wait complete. 2024-04-18T04:47:07.818 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:47:09.819 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:47:09.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:09.996+0000 7f868a000640 1 Processor -- start 2024-04-18T04:47:09.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:09.996+0000 7f868a000640 1 -- start start 2024-04-18T04:47:09.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:09.996+0000 7f868a000640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f868406b8c0 0x7f86840c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:09.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:09.996+0000 7f868a000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f868406c0f0 0x7f8684070750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:09.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:09.996+0000 7f868a000640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f868406c580 con 0x7f868406bca0 2024-04-18T04:47:09.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:09.996+0000 7f868a000640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8684158610 con 0x7f868406b8c0 2024-04-18T04:47:09.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:09.996+0000 7f868a000640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86840c7740 con 0x7f868406c0f0 2024-04-18T04:47:09.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:09.996+0000 7f8683400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f868406b8c0 0x7f86840c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:09.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:09.996+0000 7f8683400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f868406b8c0 0x7f86840c7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:42358/0 (socket says 172.21.15.120:42358) 2024-04-18T04:47:09.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:09.996+0000 7f8683400640 1 -- 172.21.15.120:0/3417285223 learned_addr learned my addr 172.21.15.120:0/3417285223 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:47:09.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:09.996+0000 7f8683e00640 1 --2- 172.21.15.120:0/3417285223 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f868406c0f0 0x7f8684070750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:10.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:09.996+0000 7f8683400640 1 -- 172.21.15.120:0/3417285223 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f868406c0f0 msgr2=0x7f8684070750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:47:10.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:09.996+0000 7f8683400640 1 --2- 172.21.15.120:0/3417285223 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f868406c0f0 0x7f8684070750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:10.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:09.996+0000 7f8683400640 1 -- 172.21.15.120:0/3417285223 >> v1:172.21.15.120:6789/0 conn(0x7f868406bca0 legacy=0x7f8684151440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:10.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:09.996+0000 7f8683400640 1 -- 172.21.15.120:0/3417285223 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86841576f0 con 0x7f868406b8c0 2024-04-18T04:47:10.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.000+0000 7f8683400640 1 --2- 172.21.15.120:0/3417285223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f868406b8c0 0x7f86840c7200 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f86740098a0 tx=0x7f867401ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1589e67bcad0373 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:47:10.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.004+0000 7f8682000640 1 -- 172.21.15.120:0/3417285223 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86740a8a30 con 0x7f868406b8c0 2024-04-18T04:47:10.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.004+0000 7f8682000640 1 -- 172.21.15.120:0/3417285223 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86740a8b90 con 0x7f868406b8c0 2024-04-18T04:47:10.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.004+0000 7f8682000640 1 -- 172.21.15.120:0/3417285223 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86740b0440 con 0x7f868406b8c0 2024-04-18T04:47:10.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.004+0000 7f868a000640 1 -- 172.21.15.120:0/3417285223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f868406b8c0 msgr2=0x7f86840c7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:10.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.004+0000 7f868a000640 1 --2- 172.21.15.120:0/3417285223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f868406b8c0 0x7f86840c7200 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f86740098a0 tx=0x7f867401ed30 comp rx=0 tx=0).stop 2024-04-18T04:47:10.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.004+0000 7f868a000640 1 -- 172.21.15.120:0/3417285223 shutdown_connections 2024-04-18T04:47:10.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.004+0000 7f868a000640 1 --2- 172.21.15.120:0/3417285223 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f868406c0f0 0x7f8684070750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:10.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.004+0000 7f868a000640 1 --2- 172.21.15.120:0/3417285223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f868406b8c0 0x7f86840c7200 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:10.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.004+0000 7f868a000640 1 -- 172.21.15.120:0/3417285223 >> 172.21.15.120:0/3417285223 conn(0x7f86840c78c0 msgr2=0x7f86840c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:47:10.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.004+0000 7f868a000640 1 -- 172.21.15.120:0/3417285223 shutdown_connections 2024-04-18T04:47:10.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.004+0000 7f868a000640 1 -- 172.21.15.120:0/3417285223 wait complete. 2024-04-18T04:47:10.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.008+0000 7f868a000640 1 Processor -- start 2024-04-18T04:47:10.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.008+0000 7f868a000640 1 -- start start 2024-04-18T04:47:10.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.008+0000 7f868a000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f868406b8c0 0x7f868414e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:10.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.008+0000 7f868a000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f868406bca0 0x7f86840c2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:10.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.008+0000 7f868a000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f868406c0f0 0x7f86841496e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:10.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.008+0000 7f868a000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86840c3bd0 con 0x7f868406b8c0 2024-04-18T04:47:10.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.008+0000 7f868a000640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86840c25a0 con 0x7f868406bca0 2024-04-18T04:47:10.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.008+0000 7f868a000640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8684150f90 con 0x7f868406c0f0 2024-04-18T04:47:10.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.008+0000 7f8682a00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f868406bca0 0x7f86840c2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:10.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.008+0000 7f8682a00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f868406bca0 0x7f86840c2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:38406/0 (socket says 172.21.15.120:38406) 2024-04-18T04:47:10.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.008+0000 7f8682a00640 1 -- 172.21.15.120:0/4010545582 learned_addr learned my addr 172.21.15.120:0/4010545582 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:47:10.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.008+0000 7f8683e00640 1 --2- 172.21.15.120:0/4010545582 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f868406c0f0 0x7f86841496e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:10.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.008+0000 7f8683400640 1 --2- 172.21.15.120:0/4010545582 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f868406b8c0 0x7f868414e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:10.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.008+0000 7f8682a00640 1 -- 172.21.15.120:0/4010545582 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f868406c0f0 msgr2=0x7f86841496e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:10.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.008+0000 7f8682a00640 1 --2- 172.21.15.120:0/4010545582 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f868406c0f0 0x7f86841496e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:10.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.008+0000 7f8682a00640 1 -- 172.21.15.120:0/4010545582 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f868406b8c0 msgr2=0x7f868414e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:10.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.008+0000 7f8682a00640 1 --2- 172.21.15.120:0/4010545582 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f868406b8c0 0x7f868414e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:10.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.008+0000 7f8682a00640 1 -- 172.21.15.120:0/4010545582 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86740094d0 con 0x7f868406bca0 2024-04-18T04:47:10.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.012+0000 7f8682a00640 1 --2- 172.21.15.120:0/4010545582 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f868406bca0 0x7f86840c2c10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f867000c530 tx=0x7f867000c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:47:10.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.012+0000 7f867b400640 1 -- 172.21.15.120:0/4010545582 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8670005220 con 0x7f868406bca0 2024-04-18T04:47:10.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.012+0000 7f867b400640 1 -- 172.21.15.120:0/4010545582 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8670005380 con 0x7f868406bca0 2024-04-18T04:47:10.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.012+0000 7f868a000640 1 -- 172.21.15.120:0/4010545582 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86840c27f0 con 0x7f868406bca0 2024-04-18T04:47:10.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.012+0000 7f867b400640 1 -- 172.21.15.120:0/4010545582 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8670007270 con 0x7f868406bca0 2024-04-18T04:47:10.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.012+0000 7f868a000640 1 -- 172.21.15.120:0/4010545582 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8684150c20 con 0x7f868406bca0 2024-04-18T04:47:10.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.012+0000 7f8678c00640 1 -- 172.21.15.120:0/4010545582 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8684072a70 con 0x7f868406bca0 2024-04-18T04:47:10.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.012+0000 7f867b400640 1 -- 172.21.15.120:0/4010545582 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f86700073d0 con 0x7f868406bca0 2024-04-18T04:47:10.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.016+0000 7f867b400640 1 --2- 172.21.15.120:0/4010545582 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8664066690 0x7f8664068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:10.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.016+0000 7f867b400640 1 -- 172.21.15.120:0/4010545582 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f8670084420 con 0x7f868406bca0 2024-04-18T04:47:10.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.016+0000 7f8683400640 1 --2- 172.21.15.120:0/4010545582 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8664066690 0x7f8664068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:10.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.016+0000 7f8683400640 1 --2- 172.21.15.120:0/4010545582 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8664066690 0x7f8664068b50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f86740b2000 tx=0x7f8674009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:47:10.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.024+0000 7f867b400640 1 -- 172.21.15.120:0/4010545582 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f86700514a0 con 0x7f868406bca0 2024-04-18T04:47:10.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.244+0000 7f8678c00640 1 -- 172.21.15.120:0/4010545582 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8684155000 con 0x7f868406bca0 2024-04-18T04:47:10.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.244+0000 7f867b400640 1 -- 172.21.15.120:0/4010545582 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+5532 (secure 0 0 0) 0x7f8670054ac0 con 0x7f868406bca0 2024-04-18T04:47:10.245 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:47:10.246 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:47:06.018430+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"b","rank":2,"incarnation":16,"state":"up:resolve","state_seq":42,"addr":"172.21.15.132:6835/1552155328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1552155328},{"type":"v1","addr":"172.21.15.132:6835","nonce":1552155328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:47:10.246 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 17 2024-04-18T04:47:10.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.244+0000 7f8678c00640 1 -- 172.21.15.120:0/4010545582 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8664066690 msgr2=0x7f8664068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:10.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.244+0000 7f8678c00640 1 --2- 172.21.15.120:0/4010545582 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8664066690 0x7f8664068b50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f86740b2000 tx=0x7f8674009040 comp rx=0 tx=0).stop 2024-04-18T04:47:10.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.244+0000 7f8678c00640 1 -- 172.21.15.120:0/4010545582 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f868406bca0 msgr2=0x7f86840c2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:10.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.244+0000 7f8678c00640 1 --2- 172.21.15.120:0/4010545582 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f868406bca0 0x7f86840c2c10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f867000c530 tx=0x7f867000c9f0 comp rx=0 tx=0).stop 2024-04-18T04:47:10.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.244+0000 7f8678c00640 1 -- 172.21.15.120:0/4010545582 shutdown_connections 2024-04-18T04:47:10.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.244+0000 7f8678c00640 1 --2- 172.21.15.120:0/4010545582 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8664066690 0x7f8664068b50 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:10.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.244+0000 7f8678c00640 1 --2- 172.21.15.120:0/4010545582 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f868406c0f0 0x7f86841496e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:10.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.244+0000 7f8678c00640 1 --2- 172.21.15.120:0/4010545582 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f868406bca0 0x7f86840c2c10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:10.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.244+0000 7f8678c00640 1 --2- 172.21.15.120:0/4010545582 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f868406b8c0 0x7f868414e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:10.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.244+0000 7f8678c00640 1 -- 172.21.15.120:0/4010545582 >> 172.21.15.120:0/4010545582 conn(0x7f86840c78c0 msgr2=0x7f868406d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:47:10.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.244+0000 7f8678c00640 1 -- 172.21.15.120:0/4010545582 shutdown_connections 2024-04-18T04:47:10.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:10.244+0000 7f8678c00640 1 -- 172.21.15.120:0/4010545582 wait complete. 2024-04-18T04:47:10.270 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:47:12.271 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:47:12.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.492+0000 7f253d800640 1 Processor -- start 2024-04-18T04:47:12.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.492+0000 7f253d800640 1 -- start start 2024-04-18T04:47:12.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.492+0000 7f253d800640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f25381515e0 0x7f25381573c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:12.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.492+0000 7f253d800640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f25380ca690 0x7f25380ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:12.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.492+0000 7f253d800640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2538070410 con 0x7f25380ca280 2024-04-18T04:47:12.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.492+0000 7f253d800640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25380c3120 con 0x7f25381515e0 2024-04-18T04:47:12.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.492+0000 7f253d800640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2538157a50 con 0x7f25380ca690 2024-04-18T04:47:12.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.496+0000 7f2536a00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f25381515e0 0x7f25381573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:12.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.496+0000 7f2537400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f25380ca690 0x7f25380ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:12.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.500+0000 7f2537400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f25380ca690 0x7f25380ccee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:43702/0 (socket says 172.21.15.120:43702) 2024-04-18T04:47:12.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.500+0000 7f2537400640 1 -- 172.21.15.120:0/3062724875 learned_addr learned my addr 172.21.15.120:0/3062724875 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:47:12.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.496+0000 7f2536a00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f25381515e0 0x7f25381573c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34786/0 (socket says 172.21.15.120:34786) 2024-04-18T04:47:12.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.500+0000 7f2537400640 1 -- 172.21.15.120:0/3062724875 >> v2:172.21.15.120:3300/0 conn(0x7f25381515e0 msgr2=0x7f25381573c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:47:12.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.500+0000 7f252fe00640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f25380ca280 0x7f253806fd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:52542/0 (socket says 172.21.15.120:52542) 2024-04-18T04:47:12.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.508+0000 7f2537400640 1 --2- 172.21.15.120:0/3062724875 >> v2:172.21.15.120:3300/0 conn(0x7f25381515e0 0x7f25381573c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:12.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.508+0000 7f2537400640 1 -- 172.21.15.120:0/3062724875 >> v1:172.21.15.132:6789/0 conn(0x7f25380ca280 legacy=0x7f253806fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:47:12.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.508+0000 7f2537400640 1 -- 172.21.15.120:0/3062724875 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2538157d10 con 0x7f25380ca690 2024-04-18T04:47:12.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.520+0000 7f2536a00640 1 --2- 172.21.15.120:0/3062724875 >> v2:172.21.15.120:3300/0 conn(0x7f25381515e0 0x7f25381573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:47:12.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.524+0000 7f2537400640 1 --2- 172.21.15.120:0/3062724875 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25380ca690 0x7f25380ccee0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2530009e50 tx=0x7f253001f1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ad3b6b397b14934 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:47:12.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.524+0000 7f2536000640 1 -- 172.21.15.120:0/3062724875 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25300af400 con 0x7f25380ca690 2024-04-18T04:47:12.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.524+0000 7f2536000640 1 -- 172.21.15.120:0/3062724875 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25300ab050 con 0x7f25380ca690 2024-04-18T04:47:12.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.524+0000 7f2536000640 1 -- 172.21.15.120:0/3062724875 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25300af780 con 0x7f25380ca690 2024-04-18T04:47:12.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.528+0000 7f253d800640 1 -- 172.21.15.120:0/3062724875 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25380ca690 msgr2=0x7f25380ccee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:12.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.528+0000 7f253d800640 1 --2- 172.21.15.120:0/3062724875 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25380ca690 0x7f25380ccee0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2530009e50 tx=0x7f253001f1c0 comp rx=0 tx=0).stop 2024-04-18T04:47:12.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.532+0000 7f253d800640 1 -- 172.21.15.120:0/3062724875 shutdown_connections 2024-04-18T04:47:12.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.532+0000 7f253d800640 1 --2- 172.21.15.120:0/3062724875 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25380ca690 0x7f25380ccee0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:12.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.532+0000 7f253d800640 1 --2- 172.21.15.120:0/3062724875 >> v2:172.21.15.120:3300/0 conn(0x7f25381515e0 0x7f25381573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:12.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.532+0000 7f253d800640 1 -- 172.21.15.120:0/3062724875 >> 172.21.15.120:0/3062724875 conn(0x7f253806e0f0 msgr2=0x7f2538071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:47:12.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.536+0000 7f253d800640 1 -- 172.21.15.120:0/3062724875 shutdown_connections 2024-04-18T04:47:12.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.536+0000 7f253d800640 1 -- 172.21.15.120:0/3062724875 wait complete. 2024-04-18T04:47:12.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.536+0000 7f253d800640 1 Processor -- start 2024-04-18T04:47:12.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.536+0000 7f253d800640 1 -- start start 2024-04-18T04:47:12.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.540+0000 7f253d800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25380ca280 0x7f25380aa7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:12.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.540+0000 7f253d800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25380ca690 0x7f25380a96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:12.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.540+0000 7f2536a00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25380ca280 0x7f25380aa7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:12.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.540+0000 7f2536a00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25380ca280 0x7f25380aa7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:43712/0 (socket says 172.21.15.120:43712) 2024-04-18T04:47:12.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.540+0000 7f2536a00640 1 -- 172.21.15.120:0/4180499077 learned_addr learned my addr 172.21.15.120:0/4180499077 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:47:12.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.540+0000 7f252fe00640 1 --2- 172.21.15.120:0/4180499077 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25380ca690 0x7f25380a96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:12.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.540+0000 7f253d800640 1 --2- 172.21.15.120:0/4180499077 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25381515e0 0x7f2538144770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:12.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.540+0000 7f253d800640 1 -- 172.21.15.120:0/4180499077 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25381544e0 con 0x7f25381515e0 2024-04-18T04:47:12.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.540+0000 7f253d800640 1 -- 172.21.15.120:0/4180499077 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2538154780 con 0x7f25380ca280 2024-04-18T04:47:12.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.540+0000 7f253d800640 1 -- 172.21.15.120:0/4180499077 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2538156220 con 0x7f25380ca690 2024-04-18T04:47:12.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.544+0000 7f252fe00640 1 -- 172.21.15.120:0/4180499077 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25380ca280 msgr2=0x7f25380aa7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:12.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.544+0000 7f252fe00640 1 --2- 172.21.15.120:0/4180499077 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25380ca280 0x7f25380aa7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:12.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.544+0000 7f252fe00640 1 -- 172.21.15.120:0/4180499077 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25381515e0 msgr2=0x7f2538144770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:12.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.544+0000 7f252fe00640 1 --2- 172.21.15.120:0/4180499077 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25381515e0 0x7f2538144770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:12.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.544+0000 7f252fe00640 1 -- 172.21.15.120:0/4180499077 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2530009b30 con 0x7f25380ca690 2024-04-18T04:47:12.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.544+0000 7f252fe00640 1 --2- 172.21.15.120:0/4180499077 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25380ca690 0x7f25380a96d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f252000c410 tx=0x7f2520005790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:47:12.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.544+0000 7f252ea00640 1 -- 172.21.15.120:0/4180499077 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25200074e0 con 0x7f25380ca690 2024-04-18T04:47:12.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.544+0000 7f252ea00640 1 -- 172.21.15.120:0/4180499077 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2520007640 con 0x7f25380ca690 2024-04-18T04:47:12.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.544+0000 7f252ea00640 1 -- 172.21.15.120:0/4180499077 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2520005a60 con 0x7f25380ca690 2024-04-18T04:47:12.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.544+0000 7f253d800640 1 -- 172.21.15.120:0/4180499077 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2538156500 con 0x7f25380ca690 2024-04-18T04:47:12.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.544+0000 7f253d800640 1 -- 172.21.15.120:0/4180499077 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2538156ac0 con 0x7f25380ca690 2024-04-18T04:47:12.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.548+0000 7f253d800640 1 -- 172.21.15.120:0/4180499077 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2538072a70 con 0x7f25380ca690 2024-04-18T04:47:12.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.548+0000 7f252ea00640 1 -- 172.21.15.120:0/4180499077 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2520005bc0 con 0x7f25380ca690 2024-04-18T04:47:12.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.552+0000 7f252ea00640 1 --2- 172.21.15.120:0/4180499077 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f25140666c0 0x7f2514068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:12.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.552+0000 7f252ea00640 1 -- 172.21.15.120:0/4180499077 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f2520083a10 con 0x7f25380ca690 2024-04-18T04:47:12.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.552+0000 7f2536a00640 1 --2- 172.21.15.120:0/4180499077 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f25140666c0 0x7f2514068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:12.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.552+0000 7f2536a00640 1 --2- 172.21.15.120:0/4180499077 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f25140666c0 0x7f2514068b80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f252800bb70 tx=0x7f2528008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:47:12.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:12.560+0000 7f252ea00640 1 -- 172.21.15.120:0/4180499077 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f2520050a30 con 0x7f25380ca690 2024-04-18T04:47:13.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:13.028+0000 7f253d800640 1 -- 172.21.15.120:0/4180499077 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25380c8d60 con 0x7f25380ca690 2024-04-18T04:47:13.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:13.032+0000 7f252ea00640 1 -- 172.21.15.120:0/4180499077 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+5534 (secure 0 0 0) 0x7f2520054050 con 0x7f25380ca690 2024-04-18T04:47:13.033 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:47:13.033 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:47:11.047803+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"b","rank":2,"incarnation":16,"state":"up:reconnect","state_seq":44,"addr":"172.21.15.132:6835/1552155328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1552155328},{"type":"v1","addr":"172.21.15.132:6835","nonce":1552155328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:47:13.034 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 18 2024-04-18T04:47:13.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:13.036+0000 7f253d800640 1 -- 172.21.15.120:0/4180499077 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f25140666c0 msgr2=0x7f2514068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:13.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:13.036+0000 7f253d800640 1 --2- 172.21.15.120:0/4180499077 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f25140666c0 0x7f2514068b80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f252800bb70 tx=0x7f2528008040 comp rx=0 tx=0).stop 2024-04-18T04:47:13.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:13.036+0000 7f253d800640 1 -- 172.21.15.120:0/4180499077 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25380ca690 msgr2=0x7f25380a96d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:13.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:13.036+0000 7f253d800640 1 --2- 172.21.15.120:0/4180499077 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25380ca690 0x7f25380a96d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f252000c410 tx=0x7f2520005790 comp rx=0 tx=0).stop 2024-04-18T04:47:13.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:13.036+0000 7f253d800640 1 -- 172.21.15.120:0/4180499077 shutdown_connections 2024-04-18T04:47:13.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:13.036+0000 7f253d800640 1 --2- 172.21.15.120:0/4180499077 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f25140666c0 0x7f2514068b80 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:13.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:13.036+0000 7f253d800640 1 --2- 172.21.15.120:0/4180499077 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25381515e0 0x7f2538144770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:13.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:13.036+0000 7f253d800640 1 --2- 172.21.15.120:0/4180499077 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25380ca690 0x7f25380a96d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:13.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:13.036+0000 7f253d800640 1 --2- 172.21.15.120:0/4180499077 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25380ca280 0x7f25380aa7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:13.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:13.036+0000 7f253d800640 1 -- 172.21.15.120:0/4180499077 >> 172.21.15.120:0/4180499077 conn(0x7f253806e0f0 msgr2=0x7f2538073370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:47:13.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:13.036+0000 7f253d800640 1 -- 172.21.15.120:0/4180499077 shutdown_connections 2024-04-18T04:47:13.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:13.036+0000 7f253d800640 1 -- 172.21.15.120:0/4180499077 wait complete. 2024-04-18T04:47:13.076 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:47:15.077 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:47:15.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.396+0000 7fdc2fe00640 1 Processor -- start 2024-04-18T04:47:15.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.396+0000 7fdc2fe00640 1 -- start start 2024-04-18T04:47:15.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.396+0000 7fdc2fe00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdc30151360 0x7fdc300c51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:15.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.396+0000 7fdc2fe00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fdc300b1cf0 0x7fdc300c5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:15.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.396+0000 7fdc2fe00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdc300b17a0 0x7fdc3015aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:15.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.396+0000 7fdc2fe00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc3006c810 con 0x7fdc300b1cf0 2024-04-18T04:47:15.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.396+0000 7fdc2fe00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc3006d3b0 con 0x7fdc30151360 2024-04-18T04:47:15.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.396+0000 7fdc2fe00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3006c530 con 0x7fdc300b17a0 2024-04-18T04:47:15.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.396+0000 7fdc2ea00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdc30151360 0x7fdc300c51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:15.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.396+0000 7fdc2f400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdc300b17a0 0x7fdc3015aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:15.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.396+0000 7fdc2ea00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdc30151360 0x7fdc300c51c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:43720/0 (socket says 172.21.15.120:43720) 2024-04-18T04:47:15.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.396+0000 7fdc2e000640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fdc300b1cf0 0x7fdc300c5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:15.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.396+0000 7fdc2ea00640 1 -- 172.21.15.120:0/2481055445 learned_addr learned my addr 172.21.15.120:0/2481055445 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:47:15.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.400+0000 7fdc2f400640 1 -- 172.21.15.120:0/2481055445 >> v2:172.21.15.132:3300/0 conn(0x7fdc30151360 msgr2=0x7fdc300c51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:47:15.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.400+0000 7fdc2f400640 1 --2- 172.21.15.120:0/2481055445 >> v2:172.21.15.132:3300/0 conn(0x7fdc30151360 0x7fdc300c51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:15.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.400+0000 7fdc2f400640 1 -- 172.21.15.120:0/2481055445 >> v2:172.21.15.120:3300/0 conn(0x7fdc300b1cf0 msgr2=0x7fdc300c5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:47:15.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.400+0000 7fdc2f400640 1 --2- 172.21.15.120:0/2481055445 >> v2:172.21.15.120:3300/0 conn(0x7fdc300b1cf0 0x7fdc300c5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:15.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.400+0000 7fdc2f400640 1 -- 172.21.15.120:0/2481055445 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc3006cd60 con 0x7fdc300b17a0 2024-04-18T04:47:15.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.404+0000 7fdc2f400640 1 --2- 172.21.15.120:0/2481055445 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdc300b17a0 0x7fdc3015aae0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdc300c5fc0 tx=0x7fdc2801c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cae6448afba651cb server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:47:15.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.404+0000 7fdc2d600640 1 -- 172.21.15.120:0/2481055445 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc280a5720 con 0x7fdc300b17a0 2024-04-18T04:47:15.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.404+0000 7fdc2d600640 1 -- 172.21.15.120:0/2481055445 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc280a5880 con 0x7fdc300b17a0 2024-04-18T04:47:15.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.404+0000 7fdc2d600640 1 -- 172.21.15.120:0/2481055445 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc280a5c10 con 0x7fdc300b17a0 2024-04-18T04:47:15.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.404+0000 7fdc2fe00640 1 -- 172.21.15.120:0/2481055445 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdc300b17a0 msgr2=0x7fdc3015aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:15.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.404+0000 7fdc2fe00640 1 --2- 172.21.15.120:0/2481055445 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdc300b17a0 0x7fdc3015aae0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdc300c5fc0 tx=0x7fdc2801c8a0 comp rx=0 tx=0).stop 2024-04-18T04:47:15.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.404+0000 7fdc2fe00640 1 -- 172.21.15.120:0/2481055445 shutdown_connections 2024-04-18T04:47:15.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.404+0000 7fdc2fe00640 1 --2- 172.21.15.120:0/2481055445 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdc300b17a0 0x7fdc3015aae0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:15.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.404+0000 7fdc2fe00640 1 --2- 172.21.15.120:0/2481055445 >> v2:172.21.15.120:3300/0 conn(0x7fdc300b1cf0 0x7fdc300c5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:15.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.404+0000 7fdc2fe00640 1 --2- 172.21.15.120:0/2481055445 >> v2:172.21.15.132:3300/0 conn(0x7fdc30151360 0x7fdc300c51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:15.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.404+0000 7fdc2fe00640 1 -- 172.21.15.120:0/2481055445 >> 172.21.15.120:0/2481055445 conn(0x7fdc300cbeb0 msgr2=0x7fdc300cc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:47:15.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.404+0000 7fdc2fe00640 1 -- 172.21.15.120:0/2481055445 shutdown_connections 2024-04-18T04:47:15.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.404+0000 7fdc2fe00640 1 -- 172.21.15.120:0/2481055445 wait complete. 2024-04-18T04:47:15.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.408+0000 7fdc2fe00640 1 Processor -- start 2024-04-18T04:47:15.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.408+0000 7fdc2fe00640 1 -- start start 2024-04-18T04:47:15.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.408+0000 7fdc2fe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdc300b17a0 0x7fdc3013d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:15.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.408+0000 7fdc2fe00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc300b1cf0 0x7fdc3013b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:15.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.408+0000 7fdc2fe00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdc30151360 0x7fdc3013ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:15.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.408+0000 7fdc2fe00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3013e840 con 0x7fdc300b17a0 2024-04-18T04:47:15.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.408+0000 7fdc2fe00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3013b080 con 0x7fdc300b1cf0 2024-04-18T04:47:15.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.408+0000 7fdc2fe00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc300c1000 con 0x7fdc30151360 2024-04-18T04:47:15.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.408+0000 7fdc2ea00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdc300b17a0 0x7fdc3013d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:15.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.408+0000 7fdc2ea00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdc300b17a0 0x7fdc3013d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34828/0 (socket says 172.21.15.120:34828) 2024-04-18T04:47:15.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.408+0000 7fdc2ea00640 1 -- 172.21.15.120:0/2892474332 learned_addr learned my addr 172.21.15.120:0/2892474332 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:47:15.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.408+0000 7fdc2e000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc300b1cf0 0x7fdc3013b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:15.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.408+0000 7fdc2f400640 1 --2- 172.21.15.120:0/2892474332 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdc30151360 0x7fdc3013ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:15.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.408+0000 7fdc2ea00640 1 -- 172.21.15.120:0/2892474332 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdc30151360 msgr2=0x7fdc3013ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:15.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.408+0000 7fdc2ea00640 1 --2- 172.21.15.120:0/2892474332 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdc30151360 0x7fdc3013ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:15.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.408+0000 7fdc2ea00640 1 -- 172.21.15.120:0/2892474332 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc300b1cf0 msgr2=0x7fdc3013b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:15.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.408+0000 7fdc2ea00640 1 --2- 172.21.15.120:0/2892474332 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc300b1cf0 0x7fdc3013b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:15.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.408+0000 7fdc2ea00640 1 -- 172.21.15.120:0/2892474332 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc28009a70 con 0x7fdc300b17a0 2024-04-18T04:47:15.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.412+0000 7fdc2ea00640 1 --2- 172.21.15.120:0/2892474332 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdc300b17a0 0x7fdc3013d0d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fdc2000e820 tx=0x7fdc2000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:47:15.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.412+0000 7fdc26a00640 1 -- 172.21.15.120:0/2892474332 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc20009580 con 0x7fdc300b17a0 2024-04-18T04:47:15.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.412+0000 7fdc26a00640 1 -- 172.21.15.120:0/2892474332 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc2000c940 con 0x7fdc300b17a0 2024-04-18T04:47:15.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.412+0000 7fdc26a00640 1 -- 172.21.15.120:0/2892474332 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2000ccf0 con 0x7fdc300b17a0 2024-04-18T04:47:15.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.412+0000 7fdc2fe00640 1 -- 172.21.15.120:0/2892474332 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc3013ea90 con 0x7fdc300b17a0 2024-04-18T04:47:15.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.412+0000 7fdc2fe00640 1 -- 172.21.15.120:0/2892474332 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc3013aa30 con 0x7fdc300b17a0 2024-04-18T04:47:15.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.412+0000 7fdc2fe00640 1 -- 172.21.15.120:0/2892474332 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc300728f0 con 0x7fdc300b17a0 2024-04-18T04:47:15.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.416+0000 7fdc26a00640 1 -- 172.21.15.120:0/2892474332 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdc20013470 con 0x7fdc300b17a0 2024-04-18T04:47:15.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.416+0000 7fdc26a00640 1 --2- 172.21.15.120:0/2892474332 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fdc100666e0 0x7fdc10068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:15.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.416+0000 7fdc26a00640 1 -- 172.21.15.120:0/2892474332 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fdc200845a0 con 0x7fdc300b17a0 2024-04-18T04:47:15.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.416+0000 7fdc2e000640 1 --2- 172.21.15.120:0/2892474332 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fdc100666e0 0x7fdc10068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:15.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.420+0000 7fdc2e000640 1 --2- 172.21.15.120:0/2892474332 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fdc100666e0 0x7fdc10068ba0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdc3013a400 tx=0x7fdc1c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:47:15.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.420+0000 7fdc26a00640 1 -- 172.21.15.120:0/2892474332 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fdc20051610 con 0x7fdc300b17a0 2024-04-18T04:47:15.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.732+0000 7fdc2fe00640 1 -- 172.21.15.120:0/2892474332 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdc300cb6a0 con 0x7fdc300b17a0 2024-04-18T04:47:15.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.732+0000 7fdc26a00640 1 -- 172.21.15.120:0/2892474332 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+5534 (secure 0 0 0) 0x7fdc20054c30 con 0x7fdc300b17a0 2024-04-18T04:47:15.734 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:47:15.734 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:47:11.047803+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"b","rank":2,"incarnation":16,"state":"up:reconnect","state_seq":44,"addr":"172.21.15.132:6835/1552155328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1552155328},{"type":"v1","addr":"172.21.15.132:6835","nonce":1552155328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:47:15.734 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 18 2024-04-18T04:47:15.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.736+0000 7fdc2fe00640 1 -- 172.21.15.120:0/2892474332 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fdc100666e0 msgr2=0x7fdc10068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:15.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.736+0000 7fdc2fe00640 1 --2- 172.21.15.120:0/2892474332 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fdc100666e0 0x7fdc10068ba0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdc3013a400 tx=0x7fdc1c009190 comp rx=0 tx=0).stop 2024-04-18T04:47:15.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.736+0000 7fdc2fe00640 1 -- 172.21.15.120:0/2892474332 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdc300b17a0 msgr2=0x7fdc3013d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:15.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.736+0000 7fdc2fe00640 1 --2- 172.21.15.120:0/2892474332 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdc300b17a0 0x7fdc3013d0d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fdc2000e820 tx=0x7fdc2000ece0 comp rx=0 tx=0).stop 2024-04-18T04:47:15.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.736+0000 7fdc2fe00640 1 -- 172.21.15.120:0/2892474332 shutdown_connections 2024-04-18T04:47:15.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.736+0000 7fdc2fe00640 1 --2- 172.21.15.120:0/2892474332 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fdc100666e0 0x7fdc10068ba0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:15.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.736+0000 7fdc2fe00640 1 --2- 172.21.15.120:0/2892474332 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdc30151360 0x7fdc3013ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:15.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.736+0000 7fdc2fe00640 1 --2- 172.21.15.120:0/2892474332 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc300b1cf0 0x7fdc3013b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:15.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.736+0000 7fdc2fe00640 1 --2- 172.21.15.120:0/2892474332 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdc300b17a0 0x7fdc3013d0d0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:15.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.736+0000 7fdc2fe00640 1 -- 172.21.15.120:0/2892474332 >> 172.21.15.120:0/2892474332 conn(0x7fdc300cbeb0 msgr2=0x7fdc300cc290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:47:15.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.736+0000 7fdc2fe00640 1 -- 172.21.15.120:0/2892474332 shutdown_connections 2024-04-18T04:47:15.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:15.736+0000 7fdc2fe00640 1 -- 172.21.15.120:0/2892474332 wait complete. 2024-04-18T04:47:15.762 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 18, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-18T04:44:30.251235+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 18, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1, 2 ], "info": { "gid_4255": { "addr": "172.21.15.132:6835/1552155328", "addrs": { "addrvec": [ { "addr": "172.21.15.132:6834", "nonce": 1552155328, "type": "v2" }, { "addr": "172.21.15.132:6835", "nonce": 1552155328, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4255, "incarnation": 16, "join_fscid": -1, "name": "b", "rank": 2, "state": "up:reconnect", "state_seq": 44 }, "gid_4275": { "addr": "172.21.15.120:6836/1079090700", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6834", "nonce": 1079090700, "type": "v2" }, { "addr": "172.21.15.120:6836", "nonce": 1079090700, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4275, "incarnation": 10, "join_fscid": -1, "name": "a", "rank": 1, "state": "up:active", "state_seq": 11 }, "gid_4288": { "addr": "172.21.15.120:6837/76856194", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6835", "nonce": 76856194, "type": "v2" }, { "addr": "172.21.15.120:6837", "nonce": 76856194, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4288, "incarnation": 4, "join_fscid": -1, "name": "e", "rank": 0, "state": "up:active", "state_seq": 4 } }, "last_failure": 0, "last_failure_osd_epoch": 28, "max_file_size": 1099511627776, "max_mds": 3, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-18T04:47:11.047803+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4288, "mds_1": 4275, "mds_2": 4255 } } } ], "standbys": [ { "addr": "172.21.15.132:6839/4292136288", "addrs": { "addrvec": [ { "addr": "172.21.15.132:6836", "nonce": 4292136288, "type": "v2" }, { "addr": "172.21.15.132:6839", "nonce": 4292136288, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4241, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.132:6838/1712856922", "addrs": { "addrvec": [ { "addr": "172.21.15.132:6837", "nonce": 1712856922, "type": "v2" }, { "addr": "172.21.15.132:6838", "nonce": 1712856922, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 2, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4244, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-18T04:47:17.763 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:47:17.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:17.992+0000 7f8e71400640 1 Processor -- start 2024-04-18T04:47:17.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:17.992+0000 7f8e71400640 1 -- start start 2024-04-18T04:47:17.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:17.992+0000 7f8e71400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8e6c0c68d0 0x7f8e6c06d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:17.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:17.992+0000 7f8e71400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e6c06d9e0 0x7f8e6c06c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:17.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:17.992+0000 7f8e71400640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e6c157340 con 0x7f8e6c156f60 2024-04-18T04:47:17.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:17.992+0000 7f8e71400640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e6c0c7400 con 0x7f8e6c0c68d0 2024-04-18T04:47:17.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:17.992+0000 7f8e71400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6c15a8d0 con 0x7f8e6c06d9e0 2024-04-18T04:47:17.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:17.992+0000 7f8e61e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8e6c0c68d0 0x7f8e6c06d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:17.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:17.992+0000 7f8e6a800640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f8e6c156f60 0x7f8e6c0c8280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:52546/0 (socket says 172.21.15.120:52546) 2024-04-18T04:47:17.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:17.992+0000 7f8e6a800640 1 -- 172.21.15.120:0/3598029070 learned_addr learned my addr 172.21.15.120:0/3598029070 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:47:17.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:17.992+0000 7f8e61e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8e6c0c68d0 0x7f8e6c06d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34838/0 (socket says 172.21.15.120:34838) 2024-04-18T04:47:17.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:17.992+0000 7f8e6b200640 1 --2- 172.21.15.120:0/3598029070 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e6c06d9e0 0x7f8e6c06c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:17.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:17.992+0000 7f8e61e00640 1 -- 172.21.15.120:0/3598029070 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e6c06d9e0 msgr2=0x7f8e6c06c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:47:17.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:17.992+0000 7f8e61e00640 1 --2- 172.21.15.120:0/3598029070 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e6c06d9e0 0x7f8e6c06c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:17.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:17.992+0000 7f8e61e00640 1 -- 172.21.15.120:0/3598029070 >> v1:172.21.15.132:6789/0 conn(0x7f8e6c156f60 legacy=0x7f8e6c0c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:17.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:17.992+0000 7f8e61e00640 1 -- 172.21.15.120:0/3598029070 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e6c1599e0 con 0x7f8e6c0c68d0 2024-04-18T04:47:17.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:17.996+0000 7f8e61e00640 1 --2- 172.21.15.120:0/3598029070 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e6c0c68d0 0x7f8e6c06d4a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8e540097c0 tx=0x7f8e5401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12037c9c7dc66ede server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:47:17.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:17.996+0000 7f8e69e00640 1 -- 172.21.15.120:0/3598029070 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e540ad680 con 0x7f8e6c0c68d0 2024-04-18T04:47:17.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:17.996+0000 7f8e69e00640 1 -- 172.21.15.120:0/3598029070 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e540ad7e0 con 0x7f8e6c0c68d0 2024-04-18T04:47:17.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:17.996+0000 7f8e69e00640 1 -- 172.21.15.120:0/3598029070 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e540adb70 con 0x7f8e6c0c68d0 2024-04-18T04:47:18.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:17.996+0000 7f8e71400640 1 -- 172.21.15.120:0/3598029070 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e6c0c68d0 msgr2=0x7f8e6c06d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:18.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:17.996+0000 7f8e71400640 1 --2- 172.21.15.120:0/3598029070 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e6c0c68d0 0x7f8e6c06d4a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8e540097c0 tx=0x7f8e5401c470 comp rx=0 tx=0).stop 2024-04-18T04:47:18.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:17.996+0000 7f8e71400640 1 -- 172.21.15.120:0/3598029070 shutdown_connections 2024-04-18T04:47:18.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:17.996+0000 7f8e71400640 1 --2- 172.21.15.120:0/3598029070 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e6c06d9e0 0x7f8e6c06c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:18.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:17.996+0000 7f8e71400640 1 --2- 172.21.15.120:0/3598029070 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e6c0c68d0 0x7f8e6c06d4a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:18.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:17.996+0000 7f8e71400640 1 -- 172.21.15.120:0/3598029070 >> 172.21.15.120:0/3598029070 conn(0x7f8e6c0c89d0 msgr2=0x7f8e6c0c8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:47:18.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:17.996+0000 7f8e71400640 1 -- 172.21.15.120:0/3598029070 shutdown_connections 2024-04-18T04:47:18.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:17.996+0000 7f8e71400640 1 -- 172.21.15.120:0/3598029070 wait complete. 2024-04-18T04:47:18.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.000+0000 7f8e71400640 1 Processor -- start 2024-04-18T04:47:18.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.000+0000 7f8e71400640 1 -- start start 2024-04-18T04:47:18.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.000+0000 7f8e71400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e6c06d9e0 0x7f8e6c1f5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:18.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.000+0000 7f8e71400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e6c0c68d0 0x7f8e6c1ebfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:18.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.000+0000 7f8e71400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e6c156f60 0x7f8e6c152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:18.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.000+0000 7f8e71400640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6c1f2ef0 con 0x7f8e6c156f60 2024-04-18T04:47:18.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.000+0000 7f8e71400640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6c1f63e0 con 0x7f8e6c06d9e0 2024-04-18T04:47:18.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.000+0000 7f8e71400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6c1f23b0 con 0x7f8e6c0c68d0 2024-04-18T04:47:18.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.000+0000 7f8e6b200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e6c156f60 0x7f8e6c152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:18.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.000+0000 7f8e6b200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e6c156f60 0x7f8e6c152d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34850/0 (socket says 172.21.15.120:34850) 2024-04-18T04:47:18.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.000+0000 7f8e6b200640 1 -- 172.21.15.120:0/1464636415 learned_addr learned my addr 172.21.15.120:0/1464636415 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:47:18.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.000+0000 7f8e6a800640 1 --2- 172.21.15.120:0/1464636415 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e6c06d9e0 0x7f8e6c1f5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:18.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.000+0000 7f8e61e00640 1 --2- 172.21.15.120:0/1464636415 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e6c0c68d0 0x7f8e6c1ebfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:18.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.000+0000 7f8e6b200640 1 -- 172.21.15.120:0/1464636415 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e6c0c68d0 msgr2=0x7f8e6c1ebfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:18.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.000+0000 7f8e6b200640 1 --2- 172.21.15.120:0/1464636415 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e6c0c68d0 0x7f8e6c1ebfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:18.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.000+0000 7f8e6b200640 1 -- 172.21.15.120:0/1464636415 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e6c06d9e0 msgr2=0x7f8e6c1f5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:18.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.000+0000 7f8e6b200640 1 --2- 172.21.15.120:0/1464636415 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e6c06d9e0 0x7f8e6c1f5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:18.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.000+0000 7f8e6b200640 1 -- 172.21.15.120:0/1464636415 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e54009420 con 0x7f8e6c156f60 2024-04-18T04:47:18.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.004+0000 7f8e6b200640 1 --2- 172.21.15.120:0/1464636415 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e6c156f60 0x7f8e6c152d50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8e6400efc0 tx=0x7f8e6400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:47:18.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.004+0000 7f8e63400640 1 -- 172.21.15.120:0/1464636415 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e64014480 con 0x7f8e6c156f60 2024-04-18T04:47:18.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.004+0000 7f8e63400640 1 -- 172.21.15.120:0/1464636415 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e6400f040 con 0x7f8e6c156f60 2024-04-18T04:47:18.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.004+0000 7f8e63400640 1 -- 172.21.15.120:0/1464636415 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e64014820 con 0x7f8e6c156f60 2024-04-18T04:47:18.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.004+0000 7f8e71400640 1 -- 172.21.15.120:0/1464636415 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e6c1f2650 con 0x7f8e6c156f60 2024-04-18T04:47:18.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.004+0000 7f8e71400640 1 -- 172.21.15.120:0/1464636415 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e6c1f2c10 con 0x7f8e6c156f60 2024-04-18T04:47:18.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.004+0000 7f8e71400640 1 -- 172.21.15.120:0/1464636415 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e6c067590 con 0x7f8e6c156f60 2024-04-18T04:47:18.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.008+0000 7f8e63400640 1 -- 172.21.15.120:0/1464636415 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8e64014980 con 0x7f8e6c156f60 2024-04-18T04:47:18.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.008+0000 7f8e63400640 1 --2- 172.21.15.120:0/1464636415 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8e48066710 0x7f8e48068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:18.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.008+0000 7f8e63400640 1 -- 172.21.15.120:0/1464636415 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f8e640850b0 con 0x7f8e6c156f60 2024-04-18T04:47:18.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.008+0000 7f8e6a800640 1 --2- 172.21.15.120:0/1464636415 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8e48066710 0x7f8e48068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:18.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.012+0000 7f8e6a800640 1 --2- 172.21.15.120:0/1464636415 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8e48066710 0x7f8e48068bd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c005890 tx=0x7f8e5c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:47:18.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.012+0000 7f8e63400640 1 -- 172.21.15.120:0/1464636415 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f8e64052090 con 0x7f8e6c156f60 2024-04-18T04:47:18.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.360+0000 7f8e71400640 1 -- 172.21.15.120:0/1464636415 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e6c072a70 con 0x7f8e6c156f60 2024-04-18T04:47:18.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.360+0000 7f8e63400640 1 -- 172.21.15.120:0/1464636415 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+5531 (secure 0 0 0) 0x7f8e64018090 con 0x7f8e6c156f60 2024-04-18T04:47:18.361 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:47:18.361 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:47:16.077673+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"b","rank":2,"incarnation":16,"state":"up:rejoin","state_seq":46,"addr":"172.21.15.132:6835/1552155328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1552155328},{"type":"v1","addr":"172.21.15.132:6835","nonce":1552155328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:47:18.362 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 19 2024-04-18T04:47:18.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.364+0000 7f8e71400640 1 -- 172.21.15.120:0/1464636415 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8e48066710 msgr2=0x7f8e48068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:18.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.368+0000 7f8e71400640 1 --2- 172.21.15.120:0/1464636415 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8e48066710 0x7f8e48068bd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c005890 tx=0x7f8e5c009040 comp rx=0 tx=0).stop 2024-04-18T04:47:18.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.368+0000 7f8e71400640 1 -- 172.21.15.120:0/1464636415 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e6c156f60 msgr2=0x7f8e6c152d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:18.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.368+0000 7f8e71400640 1 --2- 172.21.15.120:0/1464636415 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e6c156f60 0x7f8e6c152d50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8e6400efc0 tx=0x7f8e6400c490 comp rx=0 tx=0).stop 2024-04-18T04:47:18.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.368+0000 7f8e71400640 1 -- 172.21.15.120:0/1464636415 shutdown_connections 2024-04-18T04:47:18.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.368+0000 7f8e71400640 1 --2- 172.21.15.120:0/1464636415 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8e48066710 0x7f8e48068bd0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:18.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.368+0000 7f8e71400640 1 --2- 172.21.15.120:0/1464636415 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e6c156f60 0x7f8e6c152d50 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:18.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.368+0000 7f8e71400640 1 --2- 172.21.15.120:0/1464636415 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e6c0c68d0 0x7f8e6c1ebfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:18.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.368+0000 7f8e71400640 1 --2- 172.21.15.120:0/1464636415 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e6c06d9e0 0x7f8e6c1f5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:18.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.368+0000 7f8e71400640 1 -- 172.21.15.120:0/1464636415 >> 172.21.15.120:0/1464636415 conn(0x7f8e6c0c89d0 msgr2=0x7f8e6c070970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:47:18.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.368+0000 7f8e71400640 1 -- 172.21.15.120:0/1464636415 shutdown_connections 2024-04-18T04:47:18.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:18.368+0000 7f8e71400640 1 -- 172.21.15.120:0/1464636415 wait complete. 2024-04-18T04:47:18.398 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:47:20.399 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:47:20.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.616+0000 7fa7a2400640 1 Processor -- start 2024-04-18T04:47:20.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.616+0000 7fa7a2400640 1 -- start start 2024-04-18T04:47:20.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.620+0000 7fa7a2400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa79c153790 0x7fa79c0c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:20.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.620+0000 7fa7a2400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa79c159880 0x7fa79c0ced50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:20.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.620+0000 7fa7a2400640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa79c0c4970 con 0x7fa79c1594a0 2024-04-18T04:47:20.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.620+0000 7fa7a2400640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa79c0c5ad0 con 0x7fa79c159880 2024-04-18T04:47:20.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.620+0000 7fa7a2400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c159d60 con 0x7fa79c153790 2024-04-18T04:47:20.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.620+0000 7fa7a1a00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa79c159880 0x7fa79c0ced50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:20.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.620+0000 7fa7a1a00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa79c159880 0x7fa79c0ced50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:43748/0 (socket says 172.21.15.120:43748) 2024-04-18T04:47:20.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.620+0000 7fa7a1000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa79c153790 0x7fa79c0c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:20.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.620+0000 7fa7a1000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa79c153790 0x7fa79c0c9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:56886/0 (socket says 172.21.15.120:56886) 2024-04-18T04:47:20.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.620+0000 7fa7a1000640 1 -- 172.21.15.120:0/1395141719 learned_addr learned my addr 172.21.15.120:0/1395141719 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:47:20.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.620+0000 7fa7a1a00640 1 -- 172.21.15.120:0/1395141719 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa79c153790 msgr2=0x7fa79c0c9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:47:20.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.624+0000 7fa7a1a00640 1 --2- 172.21.15.120:0/1395141719 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa79c153790 0x7fa79c0c9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:20.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.624+0000 7fa7a1a00640 1 -- 172.21.15.120:0/1395141719 >> v1:172.21.15.120:6789/0 conn(0x7fa79c1594a0 legacy=0x7fa79c0c53c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:47:20.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.624+0000 7fa7a1a00640 1 -- 172.21.15.120:0/1395141719 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79c15a000 con 0x7fa79c159880 2024-04-18T04:47:20.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.624+0000 7fa7a1000640 1 --2- 172.21.15.120:0/1395141719 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa79c153790 0x7fa79c0c9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:47:20.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.628+0000 7fa7a1a00640 1 --2- 172.21.15.120:0/1395141719 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa79c159880 0x7fa79c0ced50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa78c0097c0 tx=0x7fa78c01ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e378d3d795583e42 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:47:20.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.628+0000 7fa79b400640 1 -- 172.21.15.120:0/1395141719 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78c0a8910 con 0x7fa79c159880 2024-04-18T04:47:20.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.632+0000 7fa79b400640 1 -- 172.21.15.120:0/1395141719 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78c0a8a70 con 0x7fa79c159880 2024-04-18T04:47:20.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.632+0000 7fa79b400640 1 -- 172.21.15.120:0/1395141719 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78c0a8e00 con 0x7fa79c159880 2024-04-18T04:47:20.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.632+0000 7fa7a2400640 1 -- 172.21.15.120:0/1395141719 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa79c159880 msgr2=0x7fa79c0ced50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:20.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.632+0000 7fa7a2400640 1 --2- 172.21.15.120:0/1395141719 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa79c159880 0x7fa79c0ced50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa78c0097c0 tx=0x7fa78c01ec70 comp rx=0 tx=0).stop 2024-04-18T04:47:20.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.632+0000 7fa7a2400640 1 -- 172.21.15.120:0/1395141719 shutdown_connections 2024-04-18T04:47:20.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.632+0000 7fa7a2400640 1 --2- 172.21.15.120:0/1395141719 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa79c159880 0x7fa79c0ced50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:20.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.632+0000 7fa7a2400640 1 --2- 172.21.15.120:0/1395141719 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa79c153790 0x7fa79c0c9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:20.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.632+0000 7fa7a2400640 1 -- 172.21.15.120:0/1395141719 >> 172.21.15.120:0/1395141719 conn(0x7fa79c065bc0 msgr2=0x7fa79c065fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:47:20.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.640+0000 7fa7a2400640 1 -- 172.21.15.120:0/1395141719 shutdown_connections 2024-04-18T04:47:20.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.640+0000 7fa7a2400640 1 -- 172.21.15.120:0/1395141719 wait complete. 2024-04-18T04:47:20.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.644+0000 7fa7a2400640 1 Processor -- start 2024-04-18T04:47:20.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.644+0000 7fa7a2400640 1 -- start start 2024-04-18T04:47:20.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.644+0000 7fa7a2400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa79c153790 0x7fa79c1567b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:20.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.644+0000 7fa7a2400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa79c1594a0 0x7fa79c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:20.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.648+0000 7fa7a1000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa79c153790 0x7fa79c1567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:20.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.648+0000 7fa7a1000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa79c153790 0x7fa79c1567b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:56898/0 (socket says 172.21.15.120:56898) 2024-04-18T04:47:20.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.648+0000 7fa7a1000640 1 -- 172.21.15.120:0/1200648610 learned_addr learned my addr 172.21.15.120:0/1200648610 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:47:20.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.648+0000 7fa79be00640 1 --2- 172.21.15.120:0/1200648610 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa79c1594a0 0x7fa79c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:20.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.648+0000 7fa7a2400640 1 --2- 172.21.15.120:0/1200648610 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa79c159880 0x7fa79c1481c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:20.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.648+0000 7fa7a2400640 1 -- 172.21.15.120:0/1200648610 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c155720 con 0x7fa79c159880 2024-04-18T04:47:20.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.648+0000 7fa7a2400640 1 -- 172.21.15.120:0/1200648610 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c147d30 con 0x7fa79c1594a0 2024-04-18T04:47:20.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.648+0000 7fa7a2400640 1 -- 172.21.15.120:0/1200648610 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c153da0 con 0x7fa79c153790 2024-04-18T04:47:20.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.648+0000 7fa79be00640 1 -- 172.21.15.120:0/1200648610 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa79c153790 msgr2=0x7fa79c1567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:20.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.648+0000 7fa79be00640 1 --2- 172.21.15.120:0/1200648610 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa79c153790 0x7fa79c1567b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:20.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.648+0000 7fa79be00640 1 -- 172.21.15.120:0/1200648610 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa79c159880 msgr2=0x7fa79c1481c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:20.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.648+0000 7fa79be00640 1 --2- 172.21.15.120:0/1200648610 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa79c159880 0x7fa79c1481c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:20.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.648+0000 7fa79be00640 1 -- 172.21.15.120:0/1200648610 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa794009b30 con 0x7fa79c1594a0 2024-04-18T04:47:20.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.648+0000 7fa7a1000640 1 --2- 172.21.15.120:0/1200648610 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa79c153790 0x7fa79c1567b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:47:20.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.648+0000 7fa79be00640 1 --2- 172.21.15.120:0/1200648610 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa79c1594a0 0x7fa79c0cf4f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa78800b3c0 tx=0x7fa78800b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:47:20.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.652+0000 7fa798c00640 1 -- 172.21.15.120:0/1200648610 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa788011830 con 0x7fa79c1594a0 2024-04-18T04:47:20.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.652+0000 7fa798c00640 1 -- 172.21.15.120:0/1200648610 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa788011990 con 0x7fa79c1594a0 2024-04-18T04:47:20.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.652+0000 7fa7a2400640 1 -- 172.21.15.120:0/1200648610 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa78c009420 con 0x7fa79c1594a0 2024-04-18T04:47:20.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.652+0000 7fa7a2400640 1 -- 172.21.15.120:0/1200648610 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa79c154000 con 0x7fa79c1594a0 2024-04-18T04:47:20.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.652+0000 7fa798c00640 1 -- 172.21.15.120:0/1200648610 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa788011d80 con 0x7fa79c1594a0 2024-04-18T04:47:20.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.660+0000 7fa798c00640 1 -- 172.21.15.120:0/1200648610 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa78801b460 con 0x7fa79c1594a0 2024-04-18T04:47:20.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.660+0000 7fa7a2400640 1 -- 172.21.15.120:0/1200648610 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa774005260 con 0x7fa79c1594a0 2024-04-18T04:47:20.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.664+0000 7fa798c00640 1 --2- 172.21.15.120:0/1200648610 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fa77c066760 0x7fa77c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:20.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.664+0000 7fa798c00640 1 -- 172.21.15.120:0/1200648610 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fa7880842c0 con 0x7fa79c1594a0 2024-04-18T04:47:20.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.664+0000 7fa7a1000640 1 --2- 172.21.15.120:0/1200648610 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fa77c066760 0x7fa77c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:20.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.668+0000 7fa7a1000640 1 --2- 172.21.15.120:0/1200648610 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fa77c066760 0x7fa77c068c20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa794009fd0 tx=0x7fa79400b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:47:20.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.680+0000 7fa798c00640 1 -- 172.21.15.120:0/1200648610 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fa788051170 con 0x7fa79c1594a0 2024-04-18T04:47:20.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.928+0000 7fa7a2400640 1 -- 172.21.15.120:0/1200648610 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa774005a90 con 0x7fa79c1594a0 2024-04-18T04:47:20.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.928+0000 7fa798c00640 1 -- 172.21.15.120:0/1200648610 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+5531 (secure 0 0 0) 0x7fa7880840c0 con 0x7fa79c1594a0 2024-04-18T04:47:20.931 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:47:20.931 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:47:16.077673+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"b","rank":2,"incarnation":16,"state":"up:rejoin","state_seq":46,"addr":"172.21.15.132:6835/1552155328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1552155328},{"type":"v1","addr":"172.21.15.132:6835","nonce":1552155328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:47:20.931 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 19 2024-04-18T04:47:20.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.932+0000 7fa7a2400640 1 -- 172.21.15.120:0/1200648610 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fa77c066760 msgr2=0x7fa77c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:20.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.932+0000 7fa7a2400640 1 --2- 172.21.15.120:0/1200648610 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fa77c066760 0x7fa77c068c20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa794009fd0 tx=0x7fa79400b040 comp rx=0 tx=0).stop 2024-04-18T04:47:20.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.932+0000 7fa7a2400640 1 -- 172.21.15.120:0/1200648610 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa79c1594a0 msgr2=0x7fa79c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:20.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.932+0000 7fa7a2400640 1 --2- 172.21.15.120:0/1200648610 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa79c1594a0 0x7fa79c0cf4f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa78800b3c0 tx=0x7fa78800b880 comp rx=0 tx=0).stop 2024-04-18T04:47:20.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.932+0000 7fa7a2400640 1 -- 172.21.15.120:0/1200648610 shutdown_connections 2024-04-18T04:47:20.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.932+0000 7fa7a2400640 1 --2- 172.21.15.120:0/1200648610 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fa77c066760 0x7fa77c068c20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:20.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.932+0000 7fa7a2400640 1 --2- 172.21.15.120:0/1200648610 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa79c159880 0x7fa79c1481c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:20.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.932+0000 7fa7a2400640 1 --2- 172.21.15.120:0/1200648610 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa79c1594a0 0x7fa79c0cf4f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:20.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.932+0000 7fa7a2400640 1 --2- 172.21.15.120:0/1200648610 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa79c153790 0x7fa79c1567b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:20.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.932+0000 7fa7a2400640 1 -- 172.21.15.120:0/1200648610 >> 172.21.15.120:0/1200648610 conn(0x7fa79c065bc0 msgr2=0x7fa79c0caa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:47:20.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.932+0000 7fa7a2400640 1 -- 172.21.15.120:0/1200648610 shutdown_connections 2024-04-18T04:47:20.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:20.932+0000 7fa7a2400640 1 -- 172.21.15.120:0/1200648610 wait complete. 2024-04-18T04:47:20.962 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:47:22.963 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:47:23.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.228+0000 7ffb5e600640 1 Processor -- start 2024-04-18T04:47:23.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.228+0000 7ffb5e600640 1 -- start start 2024-04-18T04:47:23.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.232+0000 7ffb5e600640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ffb5814fab0 0x7ffb5806c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:23.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.232+0000 7ffb5e600640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb580c6f00 con 0x7ffb581562a0 2024-04-18T04:47:23.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.232+0000 7ffb5e600640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb580c57c0 con 0x7ffb5806b660 2024-04-18T04:47:23.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.232+0000 7ffb5e600640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb5806cb30 con 0x7ffb5814fab0 2024-04-18T04:47:23.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.232+0000 7ffb57400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ffb5814fab0 0x7ffb5806c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:23.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.232+0000 7ffb57400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ffb5814fab0 0x7ffb5806c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:42474/0 (socket says 172.21.15.120:42474) 2024-04-18T04:47:23.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.232+0000 7ffb57400640 1 -- 172.21.15.120:0/1737528594 learned_addr learned my addr 172.21.15.120:0/1737528594 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:47:23.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.232+0000 7ffb57400640 1 -- 172.21.15.120:0/1737528594 >> v1:172.21.15.132:6789/0 conn(0x7ffb5806b660 legacy=0x7ffb581600c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-18T04:47:23.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.232+0000 7ffb57400640 1 -- 172.21.15.120:0/1737528594 >> v1:172.21.15.120:6789/0 conn(0x7ffb581562a0 legacy=0x7ffb580c6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:47:23.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.236+0000 7ffb57400640 1 -- 172.21.15.120:0/1737528594 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb580c5d80 con 0x7ffb5814fab0 2024-04-18T04:47:23.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.240+0000 7ffb57400640 1 --2- 172.21.15.120:0/1737528594 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb5814fab0 0x7ffb5806c5f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffb48009870 tx=0x7ffb4801ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed1a583904c670d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:47:23.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.244+0000 7ffb56000640 1 -- 172.21.15.120:0/1737528594 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb480a89d0 con 0x7ffb5814fab0 2024-04-18T04:47:23.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.244+0000 7ffb56000640 1 -- 172.21.15.120:0/1737528594 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb480a8b30 con 0x7ffb5814fab0 2024-04-18T04:47:23.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.244+0000 7ffb56000640 1 -- 172.21.15.120:0/1737528594 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb480b0440 con 0x7ffb5814fab0 2024-04-18T04:47:23.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.244+0000 7ffb5e600640 1 -- 172.21.15.120:0/1737528594 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb5814fab0 msgr2=0x7ffb5806c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:23.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.244+0000 7ffb5e600640 1 --2- 172.21.15.120:0/1737528594 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb5814fab0 0x7ffb5806c5f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffb48009870 tx=0x7ffb4801ecd0 comp rx=0 tx=0).stop 2024-04-18T04:47:23.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.244+0000 7ffb5e600640 1 -- 172.21.15.120:0/1737528594 shutdown_connections 2024-04-18T04:47:23.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.244+0000 7ffb5e600640 1 --2- 172.21.15.120:0/1737528594 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb5814fab0 0x7ffb5806c5f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:23.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.244+0000 7ffb5e600640 1 -- 172.21.15.120:0/1737528594 >> 172.21.15.120:0/1737528594 conn(0x7ffb580c78c0 msgr2=0x7ffb580c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:47:23.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.252+0000 7ffb5e600640 1 -- 172.21.15.120:0/1737528594 shutdown_connections 2024-04-18T04:47:23.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.252+0000 7ffb5e600640 1 -- 172.21.15.120:0/1737528594 wait complete. 2024-04-18T04:47:23.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.256+0000 7ffb5e600640 1 Processor -- start 2024-04-18T04:47:23.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.272+0000 7ffb5e600640 1 -- start start 2024-04-18T04:47:23.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.276+0000 7ffb5e600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb5806b660 0x7ffb58159880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:23.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.276+0000 7ffb5e600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb5814fab0 0x7ffb58152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:23.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.276+0000 7ffb5e600640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb581562a0 0x7ffb58146660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:23.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.276+0000 7ffb5e600640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb58153480 con 0x7ffb5806b660 2024-04-18T04:47:23.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.276+0000 7ffb5e600640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb581f3c90 con 0x7ffb581562a0 2024-04-18T04:47:23.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.276+0000 7ffb5e600640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb58147800 con 0x7ffb5814fab0 2024-04-18T04:47:23.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.280+0000 7ffb57e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb581562a0 0x7ffb58146660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:23.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.280+0000 7ffb57400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb5806b660 0x7ffb58159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:23.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.280+0000 7ffb57400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb5806b660 0x7ffb58159880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60738/0 (socket says 172.21.15.120:60738) 2024-04-18T04:47:23.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.280+0000 7ffb57400640 1 -- 172.21.15.120:0/1676743494 learned_addr learned my addr 172.21.15.120:0/1676743494 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:47:23.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.280+0000 7ffb56a00640 1 --2- 172.21.15.120:0/1676743494 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb5814fab0 0x7ffb58152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:23.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.280+0000 7ffb57e00640 1 -- 172.21.15.120:0/1676743494 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb5814fab0 msgr2=0x7ffb58152f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:23.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.280+0000 7ffb57e00640 1 --2- 172.21.15.120:0/1676743494 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb5814fab0 0x7ffb58152f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:23.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.280+0000 7ffb57e00640 1 -- 172.21.15.120:0/1676743494 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb5806b660 msgr2=0x7ffb58159880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:23.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.280+0000 7ffb57e00640 1 --2- 172.21.15.120:0/1676743494 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb5806b660 0x7ffb58159880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:23.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.280+0000 7ffb57e00640 1 -- 172.21.15.120:0/1676743494 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb480094d0 con 0x7ffb581562a0 2024-04-18T04:47:23.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.284+0000 7ffb57e00640 1 --2- 172.21.15.120:0/1676743494 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb581562a0 0x7ffb58146660 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ffb5000be50 tx=0x7ffb5000bf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:47:23.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.284+0000 7ffb4f400640 1 -- 172.21.15.120:0/1676743494 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5000cdf0 con 0x7ffb581562a0 2024-04-18T04:47:23.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.284+0000 7ffb5e600640 1 -- 172.21.15.120:0/1676743494 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb581f41a0 con 0x7ffb581562a0 2024-04-18T04:47:23.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.284+0000 7ffb4f400640 1 -- 172.21.15.120:0/1676743494 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb50014440 con 0x7ffb581562a0 2024-04-18T04:47:23.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.284+0000 7ffb5e600640 1 -- 172.21.15.120:0/1676743494 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb58158c80 con 0x7ffb581562a0 2024-04-18T04:47:23.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.284+0000 7ffb4f400640 1 -- 172.21.15.120:0/1676743494 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb500147f0 con 0x7ffb581562a0 2024-04-18T04:47:23.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.288+0000 7ffb4cc00640 1 -- 172.21.15.120:0/1676743494 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb2c005260 con 0x7ffb581562a0 2024-04-18T04:47:23.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.288+0000 7ffb4f400640 1 -- 172.21.15.120:0/1676743494 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ffb5001d3b0 con 0x7ffb581562a0 2024-04-18T04:47:23.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.288+0000 7ffb4f400640 1 --2- 172.21.15.120:0/1676743494 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ffb38066690 0x7ffb38068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:23.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.288+0000 7ffb4f400640 1 -- 172.21.15.120:0/1676743494 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7ffb50084630 con 0x7ffb581562a0 2024-04-18T04:47:23.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.292+0000 7ffb57400640 1 --2- 172.21.15.120:0/1676743494 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ffb38066690 0x7ffb38068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:23.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.296+0000 7ffb57400640 1 --2- 172.21.15.120:0/1676743494 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ffb38066690 0x7ffb38068b50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ffb48009870 tx=0x7ffb480aa070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:47:23.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.304+0000 7ffb4f400640 1 -- 172.21.15.120:0/1676743494 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7ffb50051630 con 0x7ffb581562a0 2024-04-18T04:47:23.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.620+0000 7ffb4cc00640 1 -- 172.21.15.120:0/1676743494 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb2c005a90 con 0x7ffb581562a0 2024-04-18T04:47:23.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.620+0000 7ffb4f400640 1 -- 172.21.15.120:0/1676743494 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+5531 (secure 0 0 0) 0x7ffb50054c50 con 0x7ffb581562a0 2024-04-18T04:47:23.624 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:47:23.624 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:47:21.123949+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":48,"addr":"172.21.15.132:6835/1552155328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1552155328},{"type":"v1","addr":"172.21.15.132:6835","nonce":1552155328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:47:23.626 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 20 2024-04-18T04:47:23.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.624+0000 7ffb4cc00640 1 -- 172.21.15.120:0/1676743494 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ffb38066690 msgr2=0x7ffb38068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:23.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.624+0000 7ffb4cc00640 1 --2- 172.21.15.120:0/1676743494 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ffb38066690 0x7ffb38068b50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ffb48009870 tx=0x7ffb480aa070 comp rx=0 tx=0).stop 2024-04-18T04:47:23.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.624+0000 7ffb4cc00640 1 -- 172.21.15.120:0/1676743494 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb581562a0 msgr2=0x7ffb58146660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:23.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.624+0000 7ffb4cc00640 1 --2- 172.21.15.120:0/1676743494 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb581562a0 0x7ffb58146660 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ffb5000be50 tx=0x7ffb5000bf40 comp rx=0 tx=0).stop 2024-04-18T04:47:23.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.632+0000 7ffb4cc00640 1 -- 172.21.15.120:0/1676743494 shutdown_connections 2024-04-18T04:47:23.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.632+0000 7ffb4cc00640 1 --2- 172.21.15.120:0/1676743494 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ffb38066690 0x7ffb38068b50 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:23.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.632+0000 7ffb4cc00640 1 --2- 172.21.15.120:0/1676743494 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb581562a0 0x7ffb58146660 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:23.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.632+0000 7ffb4cc00640 1 --2- 172.21.15.120:0/1676743494 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb5814fab0 0x7ffb58152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:23.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.632+0000 7ffb4cc00640 1 --2- 172.21.15.120:0/1676743494 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb5806b660 0x7ffb58159880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:23.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.632+0000 7ffb4cc00640 1 -- 172.21.15.120:0/1676743494 >> 172.21.15.120:0/1676743494 conn(0x7ffb580c78c0 msgr2=0x7ffb5814c840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:47:23.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.632+0000 7ffb4cc00640 1 -- 172.21.15.120:0/1676743494 shutdown_connections 2024-04-18T04:47:23.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:23.632+0000 7ffb4cc00640 1 -- 172.21.15.120:0/1676743494 wait complete. 2024-04-18T04:47:23.674 INFO:tasks.mds_thrash.fs.[cephfs]:mds.b has gained rank=2, replacing gid=4263 2024-04-18T04:47:23.674 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 9 secs before reviving mds.c 2024-04-18T04:47:25.189 INFO:tasks.ceph.mds.e.smithi120.stderr:2024-04-18T04:47:25.188+0000 7fbec2000640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-18T04:47:29.918 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:47:29.922 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:47:32.675 INFO:tasks.mds_thrash.fs.[cephfs]:reviving mds.c 2024-04-18T04:47:32.675 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-18T04:47:32.675 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-18T04:47:32.678 INFO:tasks.ceph.mds.c:Started 2024-04-18T04:47:32.678 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:47:32.780 INFO:tasks.ceph.mds.c.smithi120.stdout:starting mds.c at 2024-04-18T04:47:32.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.972+0000 7fd5c9800640 1 Processor -- start 2024-04-18T04:47:32.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.972+0000 7fd5c9800640 1 -- start start 2024-04-18T04:47:32.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.972+0000 7fd5c9800640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd5bc0e22c0 0x7fd5bc045100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:32.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.976+0000 7fd5c9800640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd5bc046d00 0x7fd5bc005e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:32.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.976+0000 7fd5c9800640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5bc045cf0 con 0x7fd5bc0457a0 2024-04-18T04:47:32.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.976+0000 7fd5c3400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd5bc046d00 0x7fd5bc005e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:32.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.976+0000 7fd5c8e00640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd5bc0457a0 0x7fd5bc0e26a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:37572/0 (socket says 172.21.15.120:37572) 2024-04-18T04:47:32.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.976+0000 7fd5c8e00640 1 -- 172.21.15.120:0/2412485811 learned_addr learned my addr 172.21.15.120:0/2412485811 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:47:32.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.976+0000 7fd5c3e00640 1 --2- 172.21.15.120:0/2412485811 >> v2:172.21.15.120:3300/0 conn(0x7fd5bc0e22c0 0x7fd5bc045100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:32.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.976+0000 7fd5c9800640 1 -- 172.21.15.120:0/2412485811 --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5bc0e3090 con 0x7fd5bc0e22c0 2024-04-18T04:47:32.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.976+0000 7fd5c9800640 1 -- 172.21.15.120:0/2412485811 --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5bc050da0 con 0x7fd5bc046d00 2024-04-18T04:47:32.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.976+0000 7fd5c2a00640 1 -- 172.21.15.120:0/2412485811 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4085833059 0 0) 0x7fd5bc045cf0 con 0x7fd5bc0457a0 2024-04-18T04:47:32.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.976+0000 7fd5c2a00640 1 -- 172.21.15.120:0/2412485811 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5ac003530 con 0x7fd5bc0457a0 2024-04-18T04:47:32.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.976+0000 7fd5c2a00640 1 -- 172.21.15.120:0/2412485811 <== mon.1 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2667583783 0 0) 0x7fd5ac003530 con 0x7fd5bc0457a0 2024-04-18T04:47:32.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.976+0000 7fd5c2a00640 1 -- 172.21.15.120:0/2412485811 >> v2:172.21.15.132:3300/0 conn(0x7fd5bc046d00 msgr2=0x7fd5bc005e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:47:32.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.976+0000 7fd5c2a00640 1 --2- 172.21.15.120:0/2412485811 >> v2:172.21.15.132:3300/0 conn(0x7fd5bc046d00 0x7fd5bc005e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:32.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.976+0000 7fd5c2a00640 1 -- 172.21.15.120:0/2412485811 >> v2:172.21.15.120:3300/0 conn(0x7fd5bc0e22c0 msgr2=0x7fd5bc045100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:47:32.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.976+0000 7fd5c2a00640 1 --2- 172.21.15.120:0/2412485811 >> v2:172.21.15.120:3300/0 conn(0x7fd5bc0e22c0 0x7fd5bc045100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:32.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.976+0000 7fd5c2a00640 1 -- 172.21.15.120:0/2412485811 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5bc045f40 con 0x7fd5bc0457a0 2024-04-18T04:47:32.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.976+0000 7fd5c2a00640 1 -- 172.21.15.120:0/2412485811 <== mon.1 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7fd5b8001680 con 0x7fd5bc0457a0 2024-04-18T04:47:32.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.976+0000 7fd5c2a00640 1 -- 172.21.15.120:0/2412485811 >> v1:172.21.15.132:6789/0 conn(0x7fd5bc0457a0 legacy=0x7fd5bc0e26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:32.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.976+0000 7fd5c2a00640 1 --2- 172.21.15.120:0/2412485811 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd5ac0039d0 0x7fd5ac003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:32.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.976+0000 7fd5c2a00640 1 --2- 172.21.15.120:0/2412485811 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5ac0047d0 0x7fd5ac004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:32.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.976+0000 7fd5c2a00640 1 --2- 172.21.15.120:0/2412485811 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5ac0052b0 0x7fd5ac00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:32.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.976+0000 7fd5c2a00640 1 -- 172.21.15.120:0/2412485811 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5bc0e3090 con 0x7fd5ac0052b0 2024-04-18T04:47:32.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.976+0000 7fd5c2a00640 1 -- 172.21.15.120:0/2412485811 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5bc050da0 con 0x7fd5ac0047d0 2024-04-18T04:47:32.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.976+0000 7fd5c2a00640 1 -- 172.21.15.120:0/2412485811 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ac00c280 con 0x7fd5ac0039d0 2024-04-18T04:47:32.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.976+0000 7fd5c8e00640 1 --2- 172.21.15.120:0/2412485811 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5ac0052b0 0x7fd5ac00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:32.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.976+0000 7fd5c3400640 1 --2- 172.21.15.120:0/2412485811 >> v2:172.21.15.132:3300/0 conn(0x7fd5bc046d00 0x7fd5bc005e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:47:32.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.976+0000 7fd5c3e00640 1 --2- 172.21.15.120:0/2412485811 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd5ac0039d0 0x7fd5ac003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:32.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.976+0000 7fd5c3400640 1 --2- 172.21.15.120:0/2412485811 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5ac0047d0 0x7fd5ac004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:32.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.980+0000 7fd5c3e00640 1 -- 172.21.15.120:0/2412485811 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5ac0047d0 msgr2=0x7fd5ac004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:47:32.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.980+0000 7fd5c3e00640 1 --2- 172.21.15.120:0/2412485811 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5ac0047d0 0x7fd5ac004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:32.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.980+0000 7fd5c3e00640 1 -- 172.21.15.120:0/2412485811 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5ac0052b0 msgr2=0x7fd5ac00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:47:32.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.980+0000 7fd5c3e00640 1 --2- 172.21.15.120:0/2412485811 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5ac0052b0 0x7fd5ac00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:32.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.980+0000 7fd5c3e00640 1 -- 172.21.15.120:0/2412485811 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5ac003530 con 0x7fd5ac0039d0 2024-04-18T04:47:32.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.980+0000 7fd5c3400640 1 --2- 172.21.15.120:0/2412485811 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5ac0047d0 0x7fd5ac004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:47:32.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.980+0000 7fd5c8e00640 1 --2- 172.21.15.120:0/2412485811 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5ac0052b0 0x7fd5ac00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:47:32.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.980+0000 7fd5c8e00640 1 -- 172.21.15.120:0/2412485811 reap_dead start 2024-04-18T04:47:32.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.984+0000 7fd5c3e00640 1 --2- 172.21.15.120:0/2412485811 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd5ac0039d0 0x7fd5ac003df0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd5c402c920 tx=0x7fd5c40974c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9dff33a6c335d0e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:47:32.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.984+0000 7fd5c2a00640 1 -- 172.21.15.120:0/2412485811 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c4126600 con 0x7fd5ac0039d0 2024-04-18T04:47:32.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.984+0000 7fd5c2a00640 1 -- 172.21.15.120:0/2412485811 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c4122050 con 0x7fd5ac0039d0 2024-04-18T04:47:32.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.984+0000 7fd5c9800640 1 -- 172.21.15.120:0/2412485811 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd5ac0039d0 msgr2=0x7fd5ac003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:32.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.984+0000 7fd5c9800640 1 --2- 172.21.15.120:0/2412485811 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd5ac0039d0 0x7fd5ac003df0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd5c402c920 tx=0x7fd5c40974c0 comp rx=0 tx=0).stop 2024-04-18T04:47:32.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.984+0000 7fd5c9800640 1 -- 172.21.15.120:0/2412485811 shutdown_connections 2024-04-18T04:47:32.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.984+0000 7fd5c9800640 1 --2- 172.21.15.120:0/2412485811 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd5ac0039d0 0x7fd5ac003df0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:32.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.984+0000 7fd5c9800640 1 -- 172.21.15.120:0/2412485811 >> 172.21.15.120:0/2412485811 conn(0x7fd5bc050160 msgr2=0x7fd5bc050570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:47:32.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.984+0000 7fd5c9800640 1 -- 172.21.15.120:0/2412485811 shutdown_connections 2024-04-18T04:47:32.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.984+0000 7fd5c9800640 1 -- 172.21.15.120:0/2412485811 wait complete. 2024-04-18T04:47:32.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.988+0000 7fd5c9800640 1 Processor -- start 2024-04-18T04:47:32.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.988+0000 7fd5c9800640 1 -- start start 2024-04-18T04:47:32.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.992+0000 7fd5c9800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd5ac0039d0 0x7fd5bc006460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:32.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.992+0000 7fd5c9800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5bc0e04d0 0x7fd5bc16e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:32.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.992+0000 7fd5c3e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd5ac0039d0 0x7fd5bc006460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:32.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.992+0000 7fd5c3e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd5ac0039d0 0x7fd5bc006460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:60910/0 (socket says 172.21.15.120:60910) 2024-04-18T04:47:32.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.992+0000 7fd5c3e00640 1 -- 172.21.15.120:0/481519293 learned_addr learned my addr 172.21.15.120:0/481519293 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:47:32.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.992+0000 7fd5c9800640 1 --2- 172.21.15.120:0/481519293 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5bc035860 0x7fd5bc178c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:32.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.992+0000 7fd5c9800640 1 -- 172.21.15.120:0/481519293 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5bc007510 con 0x7fd5bc035860 2024-04-18T04:47:32.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.992+0000 7fd5c9800640 1 -- 172.21.15.120:0/481519293 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5bc005d00 con 0x7fd5bc0e04d0 2024-04-18T04:47:32.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.992+0000 7fd5c9800640 1 -- 172.21.15.120:0/481519293 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5bc006f50 con 0x7fd5ac0039d0 2024-04-18T04:47:32.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.992+0000 7fd5c3400640 1 --2- 172.21.15.120:0/481519293 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5bc0e04d0 0x7fd5bc16e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:32.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.992+0000 7fd5c8e00640 1 --2- 172.21.15.120:0/481519293 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5bc035860 0x7fd5bc178c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:32.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.992+0000 7fd5c3e00640 1 -- 172.21.15.120:0/481519293 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5bc0e04d0 msgr2=0x7fd5bc16e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:32.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.992+0000 7fd5c3e00640 1 --2- 172.21.15.120:0/481519293 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5bc0e04d0 0x7fd5bc16e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:32.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.992+0000 7fd5c3e00640 1 -- 172.21.15.120:0/481519293 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5bc035860 msgr2=0x7fd5bc178c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:32.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.992+0000 7fd5c3e00640 1 --2- 172.21.15.120:0/481519293 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5bc035860 0x7fd5bc178c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:32.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.992+0000 7fd5c3e00640 1 -- 172.21.15.120:0/481519293 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5bc007230 con 0x7fd5ac0039d0 2024-04-18T04:47:32.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.992+0000 7fd5c8e00640 1 --2- 172.21.15.120:0/481519293 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5bc035860 0x7fd5bc178c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:47:32.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.996+0000 7fd5c3e00640 1 --2- 172.21.15.120:0/481519293 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd5ac0039d0 0x7fd5bc006460 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd5c4068f00 tx=0x7fd5c40618f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:47:32.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.996+0000 7fd5b3e00640 1 -- 172.21.15.120:0/481519293 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c4131620 con 0x7fd5ac0039d0 2024-04-18T04:47:32.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.996+0000 7fd5c9800640 1 -- 172.21.15.120:0/481519293 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5bc0056b0 con 0x7fd5ac0039d0 2024-04-18T04:47:32.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.996+0000 7fd5b3e00640 1 -- 172.21.15.120:0/481519293 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c4131780 con 0x7fd5ac0039d0 2024-04-18T04:47:32.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.996+0000 7fd5b3e00640 1 -- 172.21.15.120:0/481519293 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c4131af0 con 0x7fd5ac0039d0 2024-04-18T04:47:32.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.996+0000 7fd5c9800640 1 -- 172.21.15.120:0/481519293 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5bc006190 con 0x7fd5ac0039d0 2024-04-18T04:47:32.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.996+0000 7fd5c9800640 1 -- 172.21.15.120:0/481519293 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5bc005370 con 0x7fd5ac0039d0 2024-04-18T04:47:32.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:32.996+0000 7fd5b3e00640 1 -- 172.21.15.120:0/481519293 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd5c4130380 con 0x7fd5ac0039d0 2024-04-18T04:47:33.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:33.000+0000 7fd5b3e00640 1 --2- 172.21.15.120:0/481519293 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd5a80666c0 0x7fd5a8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:47:33.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:33.000+0000 7fd5b3e00640 1 -- 172.21.15.120:0/481519293 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fd5c4199540 con 0x7fd5ac0039d0 2024-04-18T04:47:33.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:33.000+0000 7fd5c3400640 1 --2- 172.21.15.120:0/481519293 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd5a80666c0 0x7fd5a8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:47:33.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:33.000+0000 7fd5c3400640 1 --2- 172.21.15.120:0/481519293 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd5a80666c0 0x7fd5a8068b80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc0e0a20 tx=0x7fd5b4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:47:33.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:33.008+0000 7fd5b3e00640 1 -- 172.21.15.120:0/481519293 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fd5c4166430 con 0x7fd5ac0039d0 2024-04-18T04:47:33.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:33.360+0000 7fd5c9800640 1 -- 172.21.15.120:0/481519293 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd5bc0dc6f0 con 0x7fd5ac0039d0 2024-04-18T04:47:33.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:33.364+0000 7fd5b3e00640 1 -- 172.21.15.120:0/481519293 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+6291 (secure 0 0 0) 0x7fd5c404e9c0 con 0x7fd5ac0039d0 2024-04-18T04:47:33.364 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:47:33.364 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5130,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:47:21.123949+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":48,"addr":"172.21.15.132:6835/1552155328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1552155328},{"type":"v1","addr":"172.21.15.132:6835","nonce":1552155328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:47:33.364 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 21 2024-04-18T04:47:33.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:33.364+0000 7fd5c9800640 1 -- 172.21.15.120:0/481519293 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd5a80666c0 msgr2=0x7fd5a8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:33.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:33.364+0000 7fd5c9800640 1 --2- 172.21.15.120:0/481519293 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd5a80666c0 0x7fd5a8068b80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc0e0a20 tx=0x7fd5b4008040 comp rx=0 tx=0).stop 2024-04-18T04:47:33.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:33.364+0000 7fd5c9800640 1 -- 172.21.15.120:0/481519293 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd5ac0039d0 msgr2=0x7fd5bc006460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:47:33.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:33.364+0000 7fd5c9800640 1 --2- 172.21.15.120:0/481519293 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd5ac0039d0 0x7fd5bc006460 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd5c4068f00 tx=0x7fd5c40618f0 comp rx=0 tx=0).stop 2024-04-18T04:47:33.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:33.364+0000 7fd5c9800640 1 -- 172.21.15.120:0/481519293 shutdown_connections 2024-04-18T04:47:33.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:33.364+0000 7fd5c9800640 1 --2- 172.21.15.120:0/481519293 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd5a80666c0 0x7fd5a8068b80 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:33.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:33.364+0000 7fd5c9800640 1 --2- 172.21.15.120:0/481519293 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5bc035860 0x7fd5bc178c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:33.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:33.364+0000 7fd5c9800640 1 --2- 172.21.15.120:0/481519293 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5bc0e04d0 0x7fd5bc16e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:33.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:33.364+0000 7fd5c9800640 1 --2- 172.21.15.120:0/481519293 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd5ac0039d0 0x7fd5bc006460 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:47:33.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:33.364+0000 7fd5c9800640 1 -- 172.21.15.120:0/481519293 >> 172.21.15.120:0/481519293 conn(0x7fd5bc050160 msgr2=0x7fd5bc04c240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:47:33.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:33.364+0000 7fd5c9800640 1 -- 172.21.15.120:0/481519293 shutdown_connections 2024-04-18T04:47:33.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:47:33.364+0000 7fd5c9800640 1 -- 172.21.15.120:0/481519293 wait complete. 2024-04-18T04:47:33.393 INFO:tasks.mds_thrash.fs.[cephfs]:mds.c reported in up:standby state 2024-04-18T04:47:33.394 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 41 secs before thrashing 2024-04-18T04:47:58.401 INFO:tasks.workunit.client.0.smithi120.stdout:fs setup took 55 secs 2024-04-18T04:48:00.124 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:48:00.127 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:48:14.395 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:48:14.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.540+0000 7fc1ffc00640 1 Processor -- start 2024-04-18T04:48:14.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.540+0000 7fc1ffc00640 1 -- start start 2024-04-18T04:48:14.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.540+0000 7fc1ffc00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc1f80c3780 0x7fc1f806f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:14.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.540+0000 7fc1ffc00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1f806afd0 0x7fc1f8164090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:14.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.540+0000 7fc1ffc00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f806b4f0 con 0x7fc1f80c7870 2024-04-18T04:48:14.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.540+0000 7fc1ffc00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f815a3f0 con 0x7fc1f80c3780 2024-04-18T04:48:14.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.540+0000 7fc1ffc00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f806cad0 con 0x7fc1f806afd0 2024-04-18T04:48:14.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.540+0000 7fc1fd200640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc1f80c3780 0x7fc1f806f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:14.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.540+0000 7fc1fd200640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc1f80c3780 0x7fc1f806f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48986/0 (socket says 172.21.15.120:48986) 2024-04-18T04:48:14.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.540+0000 7fc1efe00640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fc1f80c7870 0x7fc1f80c9900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:52164/0 (socket says 172.21.15.120:52164) 2024-04-18T04:48:14.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.540+0000 7fc1fd200640 1 -- 172.21.15.120:0/1236679469 learned_addr learned my addr 172.21.15.120:0/1236679469 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:48:14.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.540+0000 7fc1fdc00640 1 --2- 172.21.15.120:0/1236679469 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1f806afd0 0x7fc1f8164090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:14.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.540+0000 7fc1fd200640 1 -- 172.21.15.120:0/1236679469 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1f806afd0 msgr2=0x7fc1f8164090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:48:14.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.540+0000 7fc1fd200640 1 --2- 172.21.15.120:0/1236679469 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1f806afd0 0x7fc1f8164090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:14.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.540+0000 7fc1fd200640 1 -- 172.21.15.120:0/1236679469 >> v1:172.21.15.120:6789/0 conn(0x7fc1f80c7870 legacy=0x7fc1f80c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:14.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.540+0000 7fc1fd200640 1 -- 172.21.15.120:0/1236679469 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f806cdb0 con 0x7fc1f80c3780 2024-04-18T04:48:14.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.540+0000 7fc1f7e00640 1 -- 172.21.15.120:0/1236679469 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1414968500 0 0) 0x7fc1f806b4f0 con 0x7fc1f80c7870 2024-04-18T04:48:14.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.544+0000 7fc1fd200640 1 --2- 172.21.15.120:0/1236679469 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1f80c3780 0x7fc1f806f3b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8009870 tx=0x7fc1e801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18d16008d0aab8b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:14.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.544+0000 7fc1f7e00640 1 -- 172.21.15.120:0/1236679469 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e80ab610 con 0x7fc1f80c3780 2024-04-18T04:48:14.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.544+0000 7fc1f7e00640 1 -- 172.21.15.120:0/1236679469 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e80ab770 con 0x7fc1f80c3780 2024-04-18T04:48:14.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.544+0000 7fc1f7e00640 1 -- 172.21.15.120:0/1236679469 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e80abb00 con 0x7fc1f80c3780 2024-04-18T04:48:14.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.548+0000 7fc1ffc00640 1 -- 172.21.15.120:0/1236679469 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1f80c3780 msgr2=0x7fc1f806f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:14.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.548+0000 7fc1ffc00640 1 --2- 172.21.15.120:0/1236679469 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1f80c3780 0x7fc1f806f3b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8009870 tx=0x7fc1e801c500 comp rx=0 tx=0).stop 2024-04-18T04:48:14.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.548+0000 7fc1ffc00640 1 -- 172.21.15.120:0/1236679469 shutdown_connections 2024-04-18T04:48:14.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.548+0000 7fc1ffc00640 1 --2- 172.21.15.120:0/1236679469 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1f806afd0 0x7fc1f8164090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:14.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.548+0000 7fc1ffc00640 1 --2- 172.21.15.120:0/1236679469 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1f80c3780 0x7fc1f806f3b0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:14.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.548+0000 7fc1ffc00640 1 -- 172.21.15.120:0/1236679469 >> 172.21.15.120:0/1236679469 conn(0x7fc1f80720e0 msgr2=0x7fc1f8065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:48:14.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.548+0000 7fc1ffc00640 1 -- 172.21.15.120:0/1236679469 shutdown_connections 2024-04-18T04:48:14.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.548+0000 7fc1ffc00640 1 -- 172.21.15.120:0/1236679469 wait complete. 2024-04-18T04:48:14.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.548+0000 7fc1ffc00640 1 Processor -- start 2024-04-18T04:48:14.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.548+0000 7fc1ffc00640 1 -- start start 2024-04-18T04:48:14.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.548+0000 7fc1ffc00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1f806afd0 0x7fc1f81592a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:14.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.548+0000 7fc1ffc00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1f80c3780 0x7fc1f814c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:14.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.548+0000 7fc1ffc00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1f80c7870 0x7fc1f81f1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:14.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.548+0000 7fc1ffc00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f80c6960 con 0x7fc1f806afd0 2024-04-18T04:48:14.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.548+0000 7fc1ffc00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f80c53a0 con 0x7fc1f80c3780 2024-04-18T04:48:14.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.548+0000 7fc1ffc00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f81597e0 con 0x7fc1f80c7870 2024-04-18T04:48:14.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.548+0000 7fc1fd200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1f806afd0 0x7fc1f81592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:14.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.548+0000 7fc1fd200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1f806afd0 0x7fc1f81592a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49000/0 (socket says 172.21.15.120:49000) 2024-04-18T04:48:14.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.548+0000 7fc1fd200640 1 -- 172.21.15.120:0/2297108250 learned_addr learned my addr 172.21.15.120:0/2297108250 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:48:14.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.548+0000 7fc1fdc00640 1 --2- 172.21.15.120:0/2297108250 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1f80c7870 0x7fc1f81f1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:14.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.548+0000 7fc1efe00640 1 --2- 172.21.15.120:0/2297108250 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1f80c3780 0x7fc1f814c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:14.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.548+0000 7fc1fd200640 1 -- 172.21.15.120:0/2297108250 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1f80c7870 msgr2=0x7fc1f81f1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:14.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.548+0000 7fc1fd200640 1 --2- 172.21.15.120:0/2297108250 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1f80c7870 0x7fc1f81f1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:14.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.548+0000 7fc1fd200640 1 -- 172.21.15.120:0/2297108250 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1f80c3780 msgr2=0x7fc1f814c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:14.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.548+0000 7fc1fd200640 1 --2- 172.21.15.120:0/2297108250 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1f80c3780 0x7fc1f814c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:14.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.548+0000 7fc1fd200640 1 -- 172.21.15.120:0/2297108250 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e80094d0 con 0x7fc1f806afd0 2024-04-18T04:48:14.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.552+0000 7fc1fd200640 1 --2- 172.21.15.120:0/2297108250 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1f806afd0 0x7fc1f81592a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc1e80ad040 tx=0x7fc1e801ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:14.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.552+0000 7fc1f5600640 1 -- 172.21.15.120:0/2297108250 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e80ab610 con 0x7fc1f806afd0 2024-04-18T04:48:14.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.552+0000 7fc1f5600640 1 -- 172.21.15.120:0/2297108250 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e80b4800 con 0x7fc1f806afd0 2024-04-18T04:48:14.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.552+0000 7fc1f5600640 1 -- 172.21.15.120:0/2297108250 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e80b4bb0 con 0x7fc1f806afd0 2024-04-18T04:48:14.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.552+0000 7fc1ffc00640 1 -- 172.21.15.120:0/2297108250 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1f80c6000 con 0x7fc1f806afd0 2024-04-18T04:48:14.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.552+0000 7fc1ffc00640 1 -- 172.21.15.120:0/2297108250 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1f80c62a0 con 0x7fc1f806afd0 2024-04-18T04:48:14.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.552+0000 7fc1ffc00640 1 -- 172.21.15.120:0/2297108250 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1f80c7e00 con 0x7fc1f806afd0 2024-04-18T04:48:14.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.552+0000 7fc1f5600640 1 -- 172.21.15.120:0/2297108250 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc1e80b4d10 con 0x7fc1f806afd0 2024-04-18T04:48:14.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.552+0000 7fc1f5600640 1 --2- 172.21.15.120:0/2297108250 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc1d4066690 0x7fc1d4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:14.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.552+0000 7fc1f5600640 1 -- 172.21.15.120:0/2297108250 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fc1e811ef10 con 0x7fc1f806afd0 2024-04-18T04:48:14.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.552+0000 7fc1efe00640 1 --2- 172.21.15.120:0/2297108250 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc1d4066690 0x7fc1d4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:14.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.556+0000 7fc1efe00640 1 --2- 172.21.15.120:0/2297108250 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc1d4066690 0x7fc1d4068b50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc1f814d1b0 tx=0x7fc1e0007df0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:14.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.560+0000 7fc1f5600640 1 -- 172.21.15.120:0/2297108250 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fc1e80ebe80 con 0x7fc1f806afd0 2024-04-18T04:48:14.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.920+0000 7fc1ffc00640 1 -- 172.21.15.120:0/2297108250 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1f8072a70 con 0x7fc1f806afd0 2024-04-18T04:48:14.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.920+0000 7fc1f5600640 1 -- 172.21.15.120:0/2297108250 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+6291 (secure 0 0 0) 0x7fc1e80c4090 con 0x7fc1f806afd0 2024-04-18T04:48:14.922 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:48:14.922 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5130,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:47:21.123949+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":48,"addr":"172.21.15.132:6835/1552155328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1552155328},{"type":"v1","addr":"172.21.15.132:6835","nonce":1552155328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:48:14.922 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 21 2024-04-18T04:48:14.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.924+0000 7fc1ffc00640 1 -- 172.21.15.120:0/2297108250 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc1d4066690 msgr2=0x7fc1d4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:14.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.924+0000 7fc1ffc00640 1 --2- 172.21.15.120:0/2297108250 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc1d4066690 0x7fc1d4068b50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc1f814d1b0 tx=0x7fc1e0007df0 comp rx=0 tx=0).stop 2024-04-18T04:48:14.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.924+0000 7fc1ffc00640 1 -- 172.21.15.120:0/2297108250 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1f806afd0 msgr2=0x7fc1f81592a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:14.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.924+0000 7fc1ffc00640 1 --2- 172.21.15.120:0/2297108250 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1f806afd0 0x7fc1f81592a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc1e80ad040 tx=0x7fc1e801ada0 comp rx=0 tx=0).stop 2024-04-18T04:48:14.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.924+0000 7fc1ffc00640 1 -- 172.21.15.120:0/2297108250 shutdown_connections 2024-04-18T04:48:14.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.924+0000 7fc1ffc00640 1 --2- 172.21.15.120:0/2297108250 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc1d4066690 0x7fc1d4068b50 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:14.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.924+0000 7fc1ffc00640 1 --2- 172.21.15.120:0/2297108250 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1f80c7870 0x7fc1f81f1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:14.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.924+0000 7fc1ffc00640 1 --2- 172.21.15.120:0/2297108250 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1f80c3780 0x7fc1f814c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:14.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.924+0000 7fc1ffc00640 1 --2- 172.21.15.120:0/2297108250 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1f806afd0 0x7fc1f81592a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:14.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.924+0000 7fc1ffc00640 1 -- 172.21.15.120:0/2297108250 >> 172.21.15.120:0/2297108250 conn(0x7fc1f80720e0 msgr2=0x7fc1f80c9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:48:14.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.924+0000 7fc1ffc00640 1 -- 172.21.15.120:0/2297108250 shutdown_connections 2024-04-18T04:48:14.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:14.924+0000 7fc1ffc00640 1 -- 172.21.15.120:0/2297108250 wait complete. 2024-04-18T04:48:14.946 INFO:tasks.mds_thrash.fs.[cephfs]:kill mds.b (rank=2) 2024-04-18T04:48:14.946 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-18T04:48:14.946 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T04:48:14.961 INFO:tasks.ceph.mds.b:Stopped 2024-04-18T04:48:14.962 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:48:15.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.172+0000 7fcc8f400640 1 Processor -- start 2024-04-18T04:48:15.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.176+0000 7fcc8f400640 1 -- start start 2024-04-18T04:48:15.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.176+0000 7fcc8f400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcc88156ff0 0x7fcc8806d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:15.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.176+0000 7fcc8f400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcc880c8470 0x7fcc8806dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:15.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.176+0000 7fcc8f400640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc880c8c80 con 0x7fcc88070050 2024-04-18T04:48:15.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.176+0000 7fcc8f400640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc880c9520 con 0x7fcc880c8470 2024-04-18T04:48:15.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.176+0000 7fcc8f400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc88072610 con 0x7fcc88156ff0 2024-04-18T04:48:15.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.176+0000 7fcc8d400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcc880c8470 0x7fcc8806dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:15.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.176+0000 7fcc8d400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcc880c8470 0x7fcc8806dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49010/0 (socket says 172.21.15.120:49010) 2024-04-18T04:48:15.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.176+0000 7fcc8d400640 1 -- 172.21.15.120:0/969773963 learned_addr learned my addr 172.21.15.120:0/969773963 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:48:15.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.176+0000 7fcc87e00640 1 --1- 172.21.15.120:0/969773963 >> v1:172.21.15.132:6789/0 conn(0x7fcc88070050 0x7fcc880c7d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:53180/0 (socket says 172.21.15.120:53180) 2024-04-18T04:48:15.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.176+0000 7fcc8ca00640 1 --2- 172.21.15.120:0/969773963 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcc88156ff0 0x7fcc8806d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:15.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.176+0000 7fcc8d400640 1 -- 172.21.15.120:0/969773963 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcc88156ff0 msgr2=0x7fcc8806d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:48:15.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.176+0000 7fcc8d400640 1 --2- 172.21.15.120:0/969773963 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcc88156ff0 0x7fcc8806d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:15.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.176+0000 7fcc8d400640 1 -- 172.21.15.120:0/969773963 >> v1:172.21.15.132:6789/0 conn(0x7fcc88070050 legacy=0x7fcc880c7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:15.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.176+0000 7fcc8d400640 1 -- 172.21.15.120:0/969773963 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc8806cb90 con 0x7fcc880c8470 2024-04-18T04:48:15.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.176+0000 7fcc87400640 1 -- 172.21.15.120:0/969773963 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 876312989 0 0) 0x7fcc880c8c80 con 0x7fcc88070050 2024-04-18T04:48:15.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.180+0000 7fcc8d400640 1 --2- 172.21.15.120:0/969773963 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc880c8470 0x7fcc8806dec0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fcc80009e50 tx=0x7fcc8001ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1b2e800ca7204b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:15.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.180+0000 7fcc87400640 1 -- 172.21.15.120:0/969773963 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc800a58d0 con 0x7fcc880c8470 2024-04-18T04:48:15.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.180+0000 7fcc87400640 1 -- 172.21.15.120:0/969773963 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc800a5a30 con 0x7fcc880c8470 2024-04-18T04:48:15.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.180+0000 7fcc87400640 1 -- 172.21.15.120:0/969773963 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc800a5dc0 con 0x7fcc880c8470 2024-04-18T04:48:15.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.180+0000 7fcc8f400640 1 -- 172.21.15.120:0/969773963 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc880c8470 msgr2=0x7fcc8806dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:15.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.180+0000 7fcc8f400640 1 --2- 172.21.15.120:0/969773963 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc880c8470 0x7fcc8806dec0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fcc80009e50 tx=0x7fcc8001ca00 comp rx=0 tx=0).stop 2024-04-18T04:48:15.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.180+0000 7fcc8f400640 1 -- 172.21.15.120:0/969773963 shutdown_connections 2024-04-18T04:48:15.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.180+0000 7fcc8f400640 1 --2- 172.21.15.120:0/969773963 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc880c8470 0x7fcc8806dec0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:15.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.180+0000 7fcc8f400640 1 --2- 172.21.15.120:0/969773963 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcc88156ff0 0x7fcc8806d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:15.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.180+0000 7fcc8f400640 1 -- 172.21.15.120:0/969773963 >> 172.21.15.120:0/969773963 conn(0x7fcc88069ec0 msgr2=0x7fcc8806a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:48:15.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.180+0000 7fcc8f400640 1 -- 172.21.15.120:0/969773963 shutdown_connections 2024-04-18T04:48:15.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.180+0000 7fcc8f400640 1 -- 172.21.15.120:0/969773963 wait complete. 2024-04-18T04:48:15.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.180+0000 7fcc8f400640 1 Processor -- start 2024-04-18T04:48:15.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.180+0000 7fcc8f400640 1 -- start start 2024-04-18T04:48:15.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.184+0000 7fcc8f400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcc88070050 0x7fcc88148df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:15.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.184+0000 7fcc8f400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcc880c8470 0x7fcc8815c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:15.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.184+0000 7fcc8f400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc881548f0 0x7fcc8815cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:15.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.184+0000 7fcc8f400640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc88144ca0 con 0x7fcc881548f0 2024-04-18T04:48:15.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.184+0000 7fcc8f400640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8814d410 con 0x7fcc88070050 2024-04-18T04:48:15.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.184+0000 7fcc8f400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc881465e0 con 0x7fcc880c8470 2024-04-18T04:48:15.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.184+0000 7fcc8d400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc881548f0 0x7fcc8815cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:15.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.184+0000 7fcc8ca00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcc88070050 0x7fcc88148df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:15.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.184+0000 7fcc8d400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc881548f0 0x7fcc8815cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49014/0 (socket says 172.21.15.120:49014) 2024-04-18T04:48:15.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.184+0000 7fcc8d400640 1 -- 172.21.15.120:0/2556567952 learned_addr learned my addr 172.21.15.120:0/2556567952 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:48:15.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.184+0000 7fcc87e00640 1 --2- 172.21.15.120:0/2556567952 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcc880c8470 0x7fcc8815c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:15.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.184+0000 7fcc8d400640 1 -- 172.21.15.120:0/2556567952 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcc880c8470 msgr2=0x7fcc8815c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:15.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.184+0000 7fcc8d400640 1 --2- 172.21.15.120:0/2556567952 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcc880c8470 0x7fcc8815c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:15.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.184+0000 7fcc8d400640 1 -- 172.21.15.120:0/2556567952 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcc88070050 msgr2=0x7fcc88148df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:15.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.184+0000 7fcc8d400640 1 --2- 172.21.15.120:0/2556567952 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcc88070050 0x7fcc88148df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:15.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.184+0000 7fcc8d400640 1 -- 172.21.15.120:0/2556567952 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc80009b30 con 0x7fcc881548f0 2024-04-18T04:48:15.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.184+0000 7fcc8d400640 1 --2- 172.21.15.120:0/2556567952 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc881548f0 0x7fcc8815cf00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fcc800af040 tx=0x7fcc800197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:15.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.184+0000 7fcc84c00640 1 -- 172.21.15.120:0/2556567952 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc800b8670 con 0x7fcc881548f0 2024-04-18T04:48:15.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.184+0000 7fcc84c00640 1 -- 172.21.15.120:0/2556567952 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc800b87d0 con 0x7fcc881548f0 2024-04-18T04:48:15.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.184+0000 7fcc84c00640 1 -- 172.21.15.120:0/2556567952 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc800b8b80 con 0x7fcc881548f0 2024-04-18T04:48:15.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.184+0000 7fcc8f400640 1 -- 172.21.15.120:0/2556567952 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc8815be10 con 0x7fcc881548f0 2024-04-18T04:48:15.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.184+0000 7fcc8f400640 1 -- 172.21.15.120:0/2556567952 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc8815bad0 con 0x7fcc881548f0 2024-04-18T04:48:15.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.184+0000 7fcc8f400640 1 -- 172.21.15.120:0/2556567952 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc880ca460 con 0x7fcc881548f0 2024-04-18T04:48:15.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.188+0000 7fcc84c00640 1 -- 172.21.15.120:0/2556567952 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcc800b8ce0 con 0x7fcc881548f0 2024-04-18T04:48:15.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.188+0000 7fcc84c00640 1 --2- 172.21.15.120:0/2556567952 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fcc680666c0 0x7fcc68068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:15.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.188+0000 7fcc84c00640 1 -- 172.21.15.120:0/2556567952 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fcc8011f690 con 0x7fcc881548f0 2024-04-18T04:48:15.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.188+0000 7fcc8ca00640 1 --2- 172.21.15.120:0/2556567952 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fcc680666c0 0x7fcc68068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:15.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.188+0000 7fcc8ca00640 1 --2- 172.21.15.120:0/2556567952 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fcc680666c0 0x7fcc68068b80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c009ac0 tx=0x7fcc7c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:15.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.192+0000 7fcc84c00640 1 -- 172.21.15.120:0/2556567952 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fcc800ec6a0 con 0x7fcc881548f0 2024-04-18T04:48:15.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.392+0000 7fcc8f400640 1 -- 172.21.15.120:0/2556567952 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc88072a70 con 0x7fcc881548f0 2024-04-18T04:48:15.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.392+0000 7fcc84c00640 1 -- 172.21.15.120:0/2556567952 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+6291 (secure 0 0 0) 0x7fcc800efcc0 con 0x7fcc881548f0 2024-04-18T04:48:15.396 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:48:15.396 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5130,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:47:21.123949+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":48,"addr":"172.21.15.132:6835/1552155328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1552155328},{"type":"v1","addr":"172.21.15.132:6835","nonce":1552155328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:48:15.396 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 21 2024-04-18T04:48:15.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.396+0000 7fcc8f400640 1 -- 172.21.15.120:0/2556567952 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fcc680666c0 msgr2=0x7fcc68068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:15.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.396+0000 7fcc8f400640 1 --2- 172.21.15.120:0/2556567952 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fcc680666c0 0x7fcc68068b80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c009ac0 tx=0x7fcc7c009190 comp rx=0 tx=0).stop 2024-04-18T04:48:15.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.396+0000 7fcc8f400640 1 -- 172.21.15.120:0/2556567952 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc881548f0 msgr2=0x7fcc8815cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:15.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.396+0000 7fcc8f400640 1 --2- 172.21.15.120:0/2556567952 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc881548f0 0x7fcc8815cf00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fcc800af040 tx=0x7fcc800197a0 comp rx=0 tx=0).stop 2024-04-18T04:48:15.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.396+0000 7fcc8f400640 1 -- 172.21.15.120:0/2556567952 shutdown_connections 2024-04-18T04:48:15.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.396+0000 7fcc8f400640 1 --2- 172.21.15.120:0/2556567952 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fcc680666c0 0x7fcc68068b80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:15.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.396+0000 7fcc8f400640 1 --2- 172.21.15.120:0/2556567952 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc881548f0 0x7fcc8815cf00 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:15.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.396+0000 7fcc8f400640 1 --2- 172.21.15.120:0/2556567952 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcc880c8470 0x7fcc8815c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:15.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.396+0000 7fcc8f400640 1 --2- 172.21.15.120:0/2556567952 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcc88070050 0x7fcc88148df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:15.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.396+0000 7fcc8f400640 1 -- 172.21.15.120:0/2556567952 >> 172.21.15.120:0/2556567952 conn(0x7fcc88069ec0 msgr2=0x7fcc88154fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:48:15.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.396+0000 7fcc8f400640 1 -- 172.21.15.120:0/2556567952 shutdown_connections 2024-04-18T04:48:15.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:15.396+0000 7fcc8f400640 1 -- 172.21.15.120:0/2556567952 wait complete. 2024-04-18T04:48:15.431 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-18T04:48:15.623 INFO:tasks.workunit.client.0.smithi120.stdout:Syncing()...17 sec 2024-04-18T04:48:15.624 INFO:tasks.workunit.client.0.smithi120.stdout:Starting Actual Benchmark At: Thu Apr 18 04:48:15 2024 2024-04-18T04:48:15.625 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-04-18T04:48:17.431 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:48:18.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.080+0000 7eff53e00640 1 Processor -- start 2024-04-18T04:48:18.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.080+0000 7eff53e00640 1 -- start start 2024-04-18T04:48:18.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.080+0000 7eff53e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7eff4c007680 0x7eff4c0452d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:18.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.080+0000 7eff53e00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff4c0071f0 con 0x7eff4c0dd440 2024-04-18T04:48:18.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.080+0000 7eff53e00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff4c04c520 con 0x7eff4c04c7b0 2024-04-18T04:48:18.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.088+0000 7eff52a00640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7eff4c04c7b0 0x7eff4c04b1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:53182/0 (socket says 172.21.15.120:53182) 2024-04-18T04:48:18.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.088+0000 7eff52a00640 1 -- 172.21.15.120:0/553293928 learned_addr learned my addr 172.21.15.120:0/553293928 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:48:18.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.088+0000 7eff53e00640 1 -- 172.21.15.120:0/553293928 --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff4c045810 con 0x7eff4c007680 2024-04-18T04:48:18.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.088+0000 7eff59a00640 1 -- 172.21.15.120:0/553293928 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 216675556 0 0) 0x7eff4c04c520 con 0x7eff4c04c7b0 2024-04-18T04:48:18.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.088+0000 7eff59a00640 1 -- 172.21.15.120:0/553293928 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff38003530 con 0x7eff4c04c7b0 2024-04-18T04:48:18.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.088+0000 7eff59a00640 1 -- 172.21.15.120:0/553293928 <== mon.1 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 631990007 0 0) 0x7eff38003530 con 0x7eff4c04c7b0 2024-04-18T04:48:18.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.088+0000 7eff59a00640 1 -- 172.21.15.120:0/553293928 >> v2:172.21.15.120:3300/0 conn(0x7eff4c007680 msgr2=0x7eff4c0452d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:48:18.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.088+0000 7eff59a00640 1 --2- 172.21.15.120:0/553293928 >> v2:172.21.15.120:3300/0 conn(0x7eff4c007680 0x7eff4c0452d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:18.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.088+0000 7eff59a00640 1 -- 172.21.15.120:0/553293928 >> v1:172.21.15.120:6789/0 conn(0x7eff4c0dd440 legacy=0x7eff4c0e70d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:48:18.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.088+0000 7eff59a00640 1 -- 172.21.15.120:0/553293928 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff4c006040 con 0x7eff4c04c7b0 2024-04-18T04:48:18.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.088+0000 7eff59a00640 1 -- 172.21.15.120:0/553293928 <== mon.1 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7eff40001680 con 0x7eff4c04c7b0 2024-04-18T04:48:18.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.088+0000 7eff59a00640 1 -- 172.21.15.120:0/553293928 >> v1:172.21.15.132:6789/0 conn(0x7eff4c04c7b0 legacy=0x7eff4c04b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:18.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.088+0000 7eff59a00640 1 --2- 172.21.15.120:0/553293928 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff38003980 0x7eff38003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:18.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.088+0000 7eff59a00640 1 --2- 172.21.15.120:0/553293928 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff380047d0 0x7eff38004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:18.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.088+0000 7eff59a00640 1 --2- 172.21.15.120:0/553293928 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff380052b0 0x7eff3800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:18.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.088+0000 7eff59a00640 1 -- 172.21.15.120:0/553293928 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c045810 con 0x7eff380052b0 2024-04-18T04:48:18.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.088+0000 7eff59a00640 1 -- 172.21.15.120:0/553293928 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3800c1a0 con 0x7eff38003980 2024-04-18T04:48:18.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.088+0000 7eff59a00640 1 -- 172.21.15.120:0/553293928 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff3800c360 con 0x7eff380047d0 2024-04-18T04:48:18.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.088+0000 7eff52000640 1 --2- 172.21.15.120:0/553293928 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff38003980 0x7eff38003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:18.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.088+0000 7eff51600640 1 --2- 172.21.15.120:0/553293928 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff380047d0 0x7eff38004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:18.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.088+0000 7eff52a00640 1 --2- 172.21.15.120:0/553293928 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff380052b0 0x7eff3800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:18.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.088+0000 7eff52a00640 1 -- 172.21.15.120:0/553293928 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff380047d0 msgr2=0x7eff38004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:48:18.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.088+0000 7eff52a00640 1 --2- 172.21.15.120:0/553293928 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff380047d0 0x7eff38004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:18.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.088+0000 7eff52a00640 1 -- 172.21.15.120:0/553293928 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff38003980 msgr2=0x7eff38003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:48:18.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.088+0000 7eff52a00640 1 --2- 172.21.15.120:0/553293928 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff38003980 0x7eff38003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:18.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.088+0000 7eff52a00640 1 -- 172.21.15.120:0/553293928 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff4c006040 con 0x7eff380052b0 2024-04-18T04:48:18.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.116+0000 7eff52a00640 1 -- 172.21.15.120:0/553293928 reap_dead start 2024-04-18T04:48:18.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.116+0000 7eff52a00640 1 --2- 172.21.15.120:0/553293928 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff380052b0 0x7eff3800b990 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7eff4000c260 tx=0x7eff4001cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1a6473db08877d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:18.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.124+0000 7eff59a00640 1 -- 172.21.15.120:0/553293928 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff400a5ba0 con 0x7eff380052b0 2024-04-18T04:48:18.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.124+0000 7eff59a00640 1 -- 172.21.15.120:0/553293928 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff400a5d20 con 0x7eff380052b0 2024-04-18T04:48:18.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.124+0000 7eff59a00640 1 -- 172.21.15.120:0/553293928 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff40005b20 con 0x7eff380052b0 2024-04-18T04:48:18.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.124+0000 7eff53e00640 1 -- 172.21.15.120:0/553293928 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff380052b0 msgr2=0x7eff3800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:18.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.124+0000 7eff53e00640 1 --2- 172.21.15.120:0/553293928 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff380052b0 0x7eff3800b990 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7eff4000c260 tx=0x7eff4001cce0 comp rx=0 tx=0).stop 2024-04-18T04:48:18.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.128+0000 7eff53e00640 1 -- 172.21.15.120:0/553293928 shutdown_connections 2024-04-18T04:48:18.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.128+0000 7eff53e00640 1 --2- 172.21.15.120:0/553293928 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff380052b0 0x7eff3800b990 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:18.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.128+0000 7eff53e00640 1 -- 172.21.15.120:0/553293928 >> 172.21.15.120:0/553293928 conn(0x7eff4c050330 msgr2=0x7eff4c050740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:48:18.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.128+0000 7eff53e00640 1 -- 172.21.15.120:0/553293928 shutdown_connections 2024-04-18T04:48:18.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.128+0000 7eff53e00640 1 -- 172.21.15.120:0/553293928 wait complete. 2024-04-18T04:48:18.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.132+0000 7eff53e00640 1 Processor -- start 2024-04-18T04:48:18.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.140+0000 7eff53e00640 1 -- start start 2024-04-18T04:48:18.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.140+0000 7eff53e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff380052b0 0x7eff4c0d9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:18.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.140+0000 7eff53e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff4c0c22d0 0x7eff4c0d9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:18.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.140+0000 7eff53e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff4c0e0f80 0x7eff4c0c5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:18.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.140+0000 7eff53e00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c0e3890 con 0x7eff380052b0 2024-04-18T04:48:18.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.140+0000 7eff53e00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c0e3c40 con 0x7eff4c0e0f80 2024-04-18T04:48:18.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.140+0000 7eff53e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c0c4a00 con 0x7eff4c0c22d0 2024-04-18T04:48:18.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.140+0000 7eff52000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff380052b0 0x7eff4c0d9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:18.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.140+0000 7eff52000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff380052b0 0x7eff4c0d9220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49036/0 (socket says 172.21.15.120:49036) 2024-04-18T04:48:18.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.140+0000 7eff52000640 1 -- 172.21.15.120:0/3946948026 learned_addr learned my addr 172.21.15.120:0/3946948026 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:48:18.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.140+0000 7eff52a00640 1 --2- 172.21.15.120:0/3946948026 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff4c0e0f80 0x7eff4c0c5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:18.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.140+0000 7eff51600640 1 --2- 172.21.15.120:0/3946948026 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff4c0c22d0 0x7eff4c0d9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:18.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.140+0000 7eff51600640 1 -- 172.21.15.120:0/3946948026 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff4c0e0f80 msgr2=0x7eff4c0c5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:18.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.140+0000 7eff51600640 1 --2- 172.21.15.120:0/3946948026 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff4c0e0f80 0x7eff4c0c5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:18.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.140+0000 7eff51600640 1 -- 172.21.15.120:0/3946948026 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff380052b0 msgr2=0x7eff4c0d9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:18.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.140+0000 7eff51600640 1 --2- 172.21.15.120:0/3946948026 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff380052b0 0x7eff4c0d9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:18.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.140+0000 7eff51600640 1 -- 172.21.15.120:0/3946948026 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff4c0e1fb0 con 0x7eff4c0c22d0 2024-04-18T04:48:18.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.144+0000 7eff51600640 1 --2- 172.21.15.120:0/3946948026 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff4c0c22d0 0x7eff4c0d9760 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7eff4400e640 tx=0x7eff4400eb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:18.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.144+0000 7eff4aa00640 1 -- 172.21.15.120:0/3946948026 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff44013680 con 0x7eff4c0c22d0 2024-04-18T04:48:18.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.144+0000 7eff4aa00640 1 -- 172.21.15.120:0/3946948026 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff44013800 con 0x7eff4c0c22d0 2024-04-18T04:48:18.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.144+0000 7eff4aa00640 1 -- 172.21.15.120:0/3946948026 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff44013bb0 con 0x7eff4c0c22d0 2024-04-18T04:48:18.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.148+0000 7eff53e00640 1 -- 172.21.15.120:0/3946948026 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff4c0e2290 con 0x7eff4c0c22d0 2024-04-18T04:48:18.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.148+0000 7eff53e00640 1 -- 172.21.15.120:0/3946948026 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff4c0c4c70 con 0x7eff4c0c22d0 2024-04-18T04:48:18.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.160+0000 7eff53e00640 1 -- 172.21.15.120:0/3946948026 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff4c033640 con 0x7eff4c0c22d0 2024-04-18T04:48:18.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.160+0000 7eff4aa00640 1 -- 172.21.15.120:0/3946948026 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7eff44013d10 con 0x7eff4c0c22d0 2024-04-18T04:48:18.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.160+0000 7eff4aa00640 1 --2- 172.21.15.120:0/3946948026 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7eff3806ab20 0x7eff3806cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:18.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.172+0000 7eff52000640 1 --2- 172.21.15.120:0/3946948026 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7eff3806ab20 0x7eff3806cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:18.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.172+0000 7eff4aa00640 1 -- 172.21.15.120:0/3946948026 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7eff44084350 con 0x7eff4c0c22d0 2024-04-18T04:48:18.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.172+0000 7eff52000640 1 --2- 172.21.15.120:0/3946948026 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7eff3806ab20 0x7eff3806cfe0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7eff54067df0 tx=0x7eff5408e040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:18.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:18.188+0000 7eff4aa00640 1 -- 172.21.15.120:0/3946948026 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7eff44051340 con 0x7eff4c0c22d0 2024-04-18T04:48:19.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:19.012+0000 7eff53e00640 1 -- 172.21.15.120:0/3946948026 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7eff4c0c4e90 con 0x7eff4c0c22d0 2024-04-18T04:48:19.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:19.020+0000 7eff4aa00640 1 -- 172.21.15.120:0/3946948026 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+6291 (secure 0 0 0) 0x7eff44054960 con 0x7eff4c0c22d0 2024-04-18T04:48:19.025 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:48:19.025 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5130,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:47:21.123949+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":48,"addr":"172.21.15.132:6835/1552155328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1552155328},{"type":"v1","addr":"172.21.15.132:6835","nonce":1552155328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:48:19.026 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 21 2024-04-18T04:48:19.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:19.028+0000 7eff53e00640 1 -- 172.21.15.120:0/3946948026 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7eff3806ab20 msgr2=0x7eff3806cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:19.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:19.028+0000 7eff53e00640 1 --2- 172.21.15.120:0/3946948026 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7eff3806ab20 0x7eff3806cfe0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7eff54067df0 tx=0x7eff5408e040 comp rx=0 tx=0).stop 2024-04-18T04:48:19.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:19.028+0000 7eff53e00640 1 -- 172.21.15.120:0/3946948026 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff4c0c22d0 msgr2=0x7eff4c0d9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:19.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:19.028+0000 7eff53e00640 1 --2- 172.21.15.120:0/3946948026 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff4c0c22d0 0x7eff4c0d9760 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7eff4400e640 tx=0x7eff4400eb00 comp rx=0 tx=0).stop 2024-04-18T04:48:19.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:19.028+0000 7eff53e00640 1 -- 172.21.15.120:0/3946948026 shutdown_connections 2024-04-18T04:48:19.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:19.028+0000 7eff53e00640 1 --2- 172.21.15.120:0/3946948026 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7eff3806ab20 0x7eff3806cfe0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:19.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:19.028+0000 7eff53e00640 1 --2- 172.21.15.120:0/3946948026 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff4c0e0f80 0x7eff4c0c5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:19.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:19.028+0000 7eff53e00640 1 --2- 172.21.15.120:0/3946948026 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff4c0c22d0 0x7eff4c0d9760 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:19.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:19.028+0000 7eff53e00640 1 --2- 172.21.15.120:0/3946948026 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff380052b0 0x7eff4c0d9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:19.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:19.028+0000 7eff53e00640 1 -- 172.21.15.120:0/3946948026 >> 172.21.15.120:0/3946948026 conn(0x7eff4c050330 msgr2=0x7eff4c0459e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:48:19.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:19.028+0000 7eff53e00640 1 -- 172.21.15.120:0/3946948026 shutdown_connections 2024-04-18T04:48:19.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:19.028+0000 7eff53e00640 1 -- 172.21.15.120:0/3946948026 wait complete. 2024-04-18T04:48:19.095 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-18T04:48:21.096 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:48:21.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.416+0000 7f9f49600640 1 Processor -- start 2024-04-18T04:48:21.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.420+0000 7f9f49600640 1 -- start start 2024-04-18T04:48:21.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.424+0000 7f9f49600640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9f44153900 0x7f9f440c3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:21.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.424+0000 7f9f49600640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f44153ce0 con 0x7f9f440cc3c0 2024-04-18T04:48:21.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.424+0000 7f9f49600640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f440cc810 con 0x7f9f440caea0 2024-04-18T04:48:21.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.424+0000 7f9f49600640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f4415a170 con 0x7f9f44153900 2024-04-18T04:48:21.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.424+0000 7f9f42000640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f9f440caea0 0x7f9f440c9d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:38414/0 (socket says 172.21.15.120:38414) 2024-04-18T04:48:21.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.424+0000 7f9f42000640 1 -- 172.21.15.120:0/3395558651 learned_addr learned my addr 172.21.15.120:0/3395558651 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:48:21.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.424+0000 7f9f42a00640 1 --2- 172.21.15.120:0/3395558651 >> v2:172.21.15.132:3300/0 conn(0x7f9f44153900 0x7f9f440c3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:21.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.428+0000 7f9f42a00640 1 -- 172.21.15.120:0/3395558651 >> v1:172.21.15.132:6789/0 conn(0x7f9f440caea0 legacy=0x7f9f440c9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:21.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.428+0000 7f9f42a00640 1 -- 172.21.15.120:0/3395558651 >> v1:172.21.15.120:6789/0 conn(0x7f9f440cc3c0 legacy=0x7f9f44159590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:48:21.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.428+0000 7f9f42a00640 1 -- 172.21.15.120:0/3395558651 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f4415a450 con 0x7f9f44153900 2024-04-18T04:48:21.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.440+0000 7f9f42a00640 1 --2- 172.21.15.120:0/3395558651 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f44153900 0x7f9f440c3e30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9f300097c0 tx=0x7f9f3001c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=762dddf621d8cc93 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:21.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.444+0000 7f9f41600640 1 -- 172.21.15.120:0/3395558651 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f300ab5f0 con 0x7f9f44153900 2024-04-18T04:48:21.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.444+0000 7f9f41600640 1 -- 172.21.15.120:0/3395558651 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f300ab750 con 0x7f9f44153900 2024-04-18T04:48:21.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.444+0000 7f9f41600640 1 -- 172.21.15.120:0/3395558651 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f300abae0 con 0x7f9f44153900 2024-04-18T04:48:21.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.448+0000 7f9f49600640 1 -- 172.21.15.120:0/3395558651 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f44153900 msgr2=0x7f9f440c3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:21.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.448+0000 7f9f49600640 1 --2- 172.21.15.120:0/3395558651 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f44153900 0x7f9f440c3e30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9f300097c0 tx=0x7f9f3001c3f0 comp rx=0 tx=0).stop 2024-04-18T04:48:21.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.456+0000 7f9f49600640 1 -- 172.21.15.120:0/3395558651 shutdown_connections 2024-04-18T04:48:21.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.456+0000 7f9f49600640 1 --2- 172.21.15.120:0/3395558651 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f44153900 0x7f9f440c3e30 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:21.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.456+0000 7f9f49600640 1 -- 172.21.15.120:0/3395558651 >> 172.21.15.120:0/3395558651 conn(0x7f9f4406c1d0 msgr2=0x7f9f4406c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:48:21.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.456+0000 7f9f49600640 1 -- 172.21.15.120:0/3395558651 shutdown_connections 2024-04-18T04:48:21.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.456+0000 7f9f49600640 1 -- 172.21.15.120:0/3395558651 wait complete. 2024-04-18T04:48:21.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.464+0000 7f9f49600640 1 Processor -- start 2024-04-18T04:48:21.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.464+0000 7f9f49600640 1 -- start start 2024-04-18T04:48:21.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.468+0000 7f9f49600640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f440caea0 0x7f9f440b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:21.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.468+0000 7f9f49600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9f440cc3c0 0x7f9f440cd850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:21.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.468+0000 7f9f49600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f44153900 0x7f9f440cdd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:21.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.468+0000 7f9f49600640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f440b51c0 con 0x7f9f44153900 2024-04-18T04:48:21.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.468+0000 7f9f49600640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f441584b0 con 0x7f9f440caea0 2024-04-18T04:48:21.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.468+0000 7f9f49600640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f44158790 con 0x7f9f440cc3c0 2024-04-18T04:48:21.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.468+0000 7f9f42000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9f440cc3c0 0x7f9f440cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:21.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.468+0000 7f9f42000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9f440cc3c0 0x7f9f440cd850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:43092/0 (socket says 172.21.15.120:43092) 2024-04-18T04:48:21.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.468+0000 7f9f42000640 1 -- 172.21.15.120:0/3218146190 learned_addr learned my addr 172.21.15.120:0/3218146190 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:48:21.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.468+0000 7f9f42a00640 1 --2- 172.21.15.120:0/3218146190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f440caea0 0x7f9f440b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:21.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.468+0000 7f9f42000640 1 -- 172.21.15.120:0/3218146190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f440caea0 msgr2=0x7f9f440b35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:21.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.468+0000 7f9f42000640 1 --2- 172.21.15.120:0/3218146190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f440caea0 0x7f9f440b35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:21.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.468+0000 7f9f42000640 1 -- 172.21.15.120:0/3218146190 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f44153900 msgr2=0x7f9f440cdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:21.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.468+0000 7f9f42000640 1 --2- 172.21.15.120:0/3218146190 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f44153900 0x7f9f440cdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:21.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.468+0000 7f9f42000640 1 -- 172.21.15.120:0/3218146190 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f30009420 con 0x7f9f440cc3c0 2024-04-18T04:48:21.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.472+0000 7f9f42000640 1 --2- 172.21.15.120:0/3218146190 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9f440cc3c0 0x7f9f440cd850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9f34001ba0 tx=0x7f9f34014420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:21.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.476+0000 7f9f3aa00640 1 -- 172.21.15.120:0/3218146190 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f34017070 con 0x7f9f440cc3c0 2024-04-18T04:48:21.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.476+0000 7f9f3aa00640 1 -- 172.21.15.120:0/3218146190 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f34001cf0 con 0x7f9f440cc3c0 2024-04-18T04:48:21.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.476+0000 7f9f3aa00640 1 -- 172.21.15.120:0/3218146190 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f340058e0 con 0x7f9f440cc3c0 2024-04-18T04:48:21.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.476+0000 7f9f49600640 1 -- 172.21.15.120:0/3218146190 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f44158a70 con 0x7f9f440cc3c0 2024-04-18T04:48:21.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.476+0000 7f9f49600640 1 -- 172.21.15.120:0/3218146190 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f440cd050 con 0x7f9f440cc3c0 2024-04-18T04:48:21.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.484+0000 7f9f49600640 1 -- 172.21.15.120:0/3218146190 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f44072a70 con 0x7f9f440cc3c0 2024-04-18T04:48:21.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.492+0000 7f9f3aa00640 1 -- 172.21.15.120:0/3218146190 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9f34005a40 con 0x7f9f440cc3c0 2024-04-18T04:48:21.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.496+0000 7f9f3aa00640 1 --2- 172.21.15.120:0/3218146190 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9f24066790 0x7f9f24068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:21.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.496+0000 7f9f3aa00640 1 -- 172.21.15.120:0/3218146190 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f9f3408c350 con 0x7f9f440cc3c0 2024-04-18T04:48:21.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.496+0000 7f9f42a00640 1 --2- 172.21.15.120:0/3218146190 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9f24066790 0x7f9f24068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:21.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.500+0000 7f9f42a00640 1 --2- 172.21.15.120:0/3218146190 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9f24066790 0x7f9f24068c50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9f300af000 tx=0x7f9f300a7000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:21.704 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:48:21.705 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5130,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:47:21.123949+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":48,"addr":"172.21.15.132:6835/1552155328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1552155328},{"type":"v1","addr":"172.21.15.132:6835","nonce":1552155328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:48:21.705 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 21 2024-04-18T04:48:21.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.508+0000 7f9f3aa00640 1 -- 172.21.15.120:0/3218146190 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f9f34059200 con 0x7f9f440cc3c0 2024-04-18T04:48:21.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.700+0000 7f9f49600640 1 -- 172.21.15.120:0/3218146190 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9f440ca8a0 con 0x7f9f440cc3c0 2024-04-18T04:48:21.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.704+0000 7f9f3aa00640 1 -- 172.21.15.120:0/3218146190 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+6291 (secure 0 0 0) 0x7f9f3405c820 con 0x7f9f440cc3c0 2024-04-18T04:48:21.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.704+0000 7f9f49600640 1 -- 172.21.15.120:0/3218146190 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9f24066790 msgr2=0x7f9f24068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:21.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.704+0000 7f9f49600640 1 --2- 172.21.15.120:0/3218146190 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9f24066790 0x7f9f24068c50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9f300af000 tx=0x7f9f300a7000 comp rx=0 tx=0).stop 2024-04-18T04:48:21.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.704+0000 7f9f49600640 1 -- 172.21.15.120:0/3218146190 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9f440cc3c0 msgr2=0x7f9f440cd850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:21.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.704+0000 7f9f49600640 1 --2- 172.21.15.120:0/3218146190 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9f440cc3c0 0x7f9f440cd850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9f34001ba0 tx=0x7f9f34014420 comp rx=0 tx=0).stop 2024-04-18T04:48:21.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.704+0000 7f9f49600640 1 -- 172.21.15.120:0/3218146190 shutdown_connections 2024-04-18T04:48:21.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.704+0000 7f9f49600640 1 --2- 172.21.15.120:0/3218146190 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9f24066790 0x7f9f24068c50 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:21.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.704+0000 7f9f49600640 1 --2- 172.21.15.120:0/3218146190 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f44153900 0x7f9f440cdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:21.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.704+0000 7f9f49600640 1 --2- 172.21.15.120:0/3218146190 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9f440cc3c0 0x7f9f440cd850 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:21.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.704+0000 7f9f49600640 1 --2- 172.21.15.120:0/3218146190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f440caea0 0x7f9f440b35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:21.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.704+0000 7f9f49600640 1 -- 172.21.15.120:0/3218146190 >> 172.21.15.120:0/3218146190 conn(0x7f9f4406c1d0 msgr2=0x7f9f44149b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:48:21.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.704+0000 7f9f49600640 1 -- 172.21.15.120:0/3218146190 shutdown_connections 2024-04-18T04:48:21.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:21.704+0000 7f9f49600640 1 -- 172.21.15.120:0/3218146190 wait complete. 2024-04-18T04:48:21.763 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-18T04:48:23.764 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:48:24.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:23.960+0000 7f1396e00640 1 Processor -- start 2024-04-18T04:48:24.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:23.960+0000 7f1396e00640 1 -- start start 2024-04-18T04:48:24.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:23.960+0000 7f1396e00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1390165990 0x7f139006c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:24.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:23.960+0000 7f1396e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f13900c73d0 0x7f13900c65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:24.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:23.960+0000 7f1396e00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13900c6150 con 0x7f13901696c0 2024-04-18T04:48:24.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:23.960+0000 7f1396e00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f139006fe60 con 0x7f1390165990 2024-04-18T04:48:24.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:23.960+0000 7f1396e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13900c5860 con 0x7f13900c73d0 2024-04-18T04:48:24.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:23.960+0000 7f1396400640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f13901696c0 0x7f1390169af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:42322/0 (socket says 172.21.15.120:42322) 2024-04-18T04:48:24.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:23.960+0000 7f1396400640 1 -- 172.21.15.120:0/1564265314 learned_addr learned my addr 172.21.15.120:0/1564265314 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:48:24.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:23.960+0000 7f1395a00640 1 --2- 172.21.15.120:0/1564265314 >> v2:172.21.15.132:3300/0 conn(0x7f1390165990 0x7f139006c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:24.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:23.960+0000 7f1395000640 1 --2- 172.21.15.120:0/1564265314 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f13900c73d0 0x7f13900c65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:24.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.104+0000 7f1395000640 1 -- 172.21.15.120:0/1564265314 >> v2:172.21.15.132:3300/0 conn(0x7f1390165990 msgr2=0x7f139006c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:48:24.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.104+0000 7f1395000640 1 --2- 172.21.15.120:0/1564265314 >> v2:172.21.15.132:3300/0 conn(0x7f1390165990 0x7f139006c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:24.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.104+0000 7f1395000640 1 -- 172.21.15.120:0/1564265314 >> v1:172.21.15.120:6789/0 conn(0x7f13901696c0 legacy=0x7f1390169af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:24.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.104+0000 7f1395000640 1 -- 172.21.15.120:0/1564265314 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f139006c670 con 0x7f13900c73d0 2024-04-18T04:48:24.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:23.960+0000 7f138fe00640 1 -- 172.21.15.120:0/1564265314 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 366656114 0 0) 0x7f13900c6150 con 0x7f13901696c0 2024-04-18T04:48:24.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.108+0000 7f1395a00640 1 --2- 172.21.15.120:0/1564265314 >> v2:172.21.15.132:3300/0 conn(0x7f1390165990 0x7f139006c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:48:24.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.116+0000 7f1395000640 1 --2- 172.21.15.120:0/1564265314 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f13900c73d0 0x7f13900c65e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f137c0077b0 tx=0x7f137c01ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b84337f5a92e84c server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:24.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.116+0000 7f138fe00640 1 -- 172.21.15.120:0/1564265314 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137c0a8b40 con 0x7f13900c73d0 2024-04-18T04:48:24.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.116+0000 7f138fe00640 1 -- 172.21.15.120:0/1564265314 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137c0a8ca0 con 0x7f13900c73d0 2024-04-18T04:48:24.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.116+0000 7f138fe00640 1 -- 172.21.15.120:0/1564265314 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137c0b0610 con 0x7f13900c73d0 2024-04-18T04:48:24.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.116+0000 7f1396e00640 1 -- 172.21.15.120:0/1564265314 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f13900c73d0 msgr2=0x7f13900c65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:24.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.116+0000 7f1396e00640 1 --2- 172.21.15.120:0/1564265314 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f13900c73d0 0x7f13900c65e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f137c0077b0 tx=0x7f137c01ed70 comp rx=0 tx=0).stop 2024-04-18T04:48:24.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.116+0000 7f1396e00640 1 -- 172.21.15.120:0/1564265314 shutdown_connections 2024-04-18T04:48:24.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.116+0000 7f1396e00640 1 --2- 172.21.15.120:0/1564265314 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f13900c73d0 0x7f13900c65e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:24.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.116+0000 7f1396e00640 1 --2- 172.21.15.120:0/1564265314 >> v2:172.21.15.132:3300/0 conn(0x7f1390165990 0x7f139006c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:24.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.116+0000 7f1396e00640 1 -- 172.21.15.120:0/1564265314 >> 172.21.15.120:0/1564265314 conn(0x7f139006d000 msgr2=0x7f139006d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:48:24.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.120+0000 7f1396e00640 1 -- 172.21.15.120:0/1564265314 shutdown_connections 2024-04-18T04:48:24.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.120+0000 7f1396e00640 1 -- 172.21.15.120:0/1564265314 wait complete. 2024-04-18T04:48:24.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.124+0000 7f1396e00640 1 Processor -- start 2024-04-18T04:48:24.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.124+0000 7f1396e00640 1 -- start start 2024-04-18T04:48:24.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.132+0000 7f1396e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13900c73d0 0x7f139015ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:24.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.132+0000 7f1396e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1390165990 0x7f139015e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:24.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.136+0000 7f1395a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13900c73d0 0x7f139015ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:24.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.136+0000 7f1395000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1390165990 0x7f139015e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:24.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.136+0000 7f1395000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1390165990 0x7f139015e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:43108/0 (socket says 172.21.15.120:43108) 2024-04-18T04:48:24.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.136+0000 7f1395a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13900c73d0 0x7f139015ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48166/0 (socket says 172.21.15.120:48166) 2024-04-18T04:48:24.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.136+0000 7f1395000640 1 -- 172.21.15.120:0/2254541918 learned_addr learned my addr 172.21.15.120:0/2254541918 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:48:24.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.136+0000 7f1396e00640 1 --2- 172.21.15.120:0/2254541918 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13901696c0 0x7f1390168f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:24.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.136+0000 7f1396e00640 1 -- 172.21.15.120:0/2254541918 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139015c100 con 0x7f13900c73d0 2024-04-18T04:48:24.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.136+0000 7f1396e00640 1 -- 172.21.15.120:0/2254541918 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1390169440 con 0x7f13901696c0 2024-04-18T04:48:24.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.136+0000 7f1396e00640 1 -- 172.21.15.120:0/2254541918 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13901604d0 con 0x7f1390165990 2024-04-18T04:48:24.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.136+0000 7f1396400640 1 --2- 172.21.15.120:0/2254541918 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13901696c0 0x7f1390168f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:24.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.136+0000 7f1395a00640 1 -- 172.21.15.120:0/2254541918 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1390165990 msgr2=0x7f139015e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:24.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.136+0000 7f1395a00640 1 --2- 172.21.15.120:0/2254541918 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1390165990 0x7f139015e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:24.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.136+0000 7f1395a00640 1 -- 172.21.15.120:0/2254541918 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13901696c0 msgr2=0x7f1390168f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:24.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.136+0000 7f1395a00640 1 --2- 172.21.15.120:0/2254541918 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13901696c0 0x7f1390168f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:24.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.136+0000 7f1395a00640 1 -- 172.21.15.120:0/2254541918 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f137c007490 con 0x7f13900c73d0 2024-04-18T04:48:24.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.136+0000 7f1395000640 1 --2- 172.21.15.120:0/2254541918 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1390165990 0x7f139015e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:48:24.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.136+0000 7f1396400640 1 --2- 172.21.15.120:0/2254541918 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13901696c0 0x7f1390168f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:48:24.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.140+0000 7f1395a00640 1 --2- 172.21.15.120:0/2254541918 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13900c73d0 0x7f139015ebe0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f138400ced0 tx=0x7f138400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:24.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.140+0000 7f138d600640 1 -- 172.21.15.120:0/2254541918 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138400d840 con 0x7f13900c73d0 2024-04-18T04:48:24.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.140+0000 7f138d600640 1 -- 172.21.15.120:0/2254541918 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f138400d9a0 con 0x7f13900c73d0 2024-04-18T04:48:24.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.140+0000 7f138d600640 1 -- 172.21.15.120:0/2254541918 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138400dd30 con 0x7f13900c73d0 2024-04-18T04:48:24.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.144+0000 7f1396e00640 1 -- 172.21.15.120:0/2254541918 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f139015db90 con 0x7f13900c73d0 2024-04-18T04:48:24.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.148+0000 7f1396e00640 1 -- 172.21.15.120:0/2254541918 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1390160a00 con 0x7f13900c73d0 2024-04-18T04:48:24.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.148+0000 7f1396e00640 1 -- 172.21.15.120:0/2254541918 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13900728f0 con 0x7f13900c73d0 2024-04-18T04:48:24.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.152+0000 7f138d600640 1 -- 172.21.15.120:0/2254541918 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1384015440 con 0x7f13900c73d0 2024-04-18T04:48:24.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.156+0000 7f138d600640 1 --2- 172.21.15.120:0/2254541918 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1370066690 0x7f1370068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:24.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.156+0000 7f138d600640 1 -- 172.21.15.120:0/2254541918 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f13840856a0 con 0x7f13900c73d0 2024-04-18T04:48:24.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.156+0000 7f1395000640 1 --2- 172.21.15.120:0/2254541918 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1370066690 0x7f1370068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:24.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.160+0000 7f1395000640 1 --2- 172.21.15.120:0/2254541918 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1370066690 0x7f1370068b50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f137c000c10 tx=0x7f137c0aa070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:24.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.180+0000 7f138d600640 1 -- 172.21.15.120:0/2254541918 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f13840527c0 con 0x7f13900c73d0 2024-04-18T04:48:24.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.692+0000 7f1396e00640 1 -- 172.21.15.120:0/2254541918 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f139008b430 con 0x7f13900c73d0 2024-04-18T04:48:24.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.692+0000 7f138d600640 1 -- 172.21.15.120:0/2254541918 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+6291 (secure 0 0 0) 0x7f1384024090 con 0x7f13900c73d0 2024-04-18T04:48:24.701 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:48:24.701 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5130,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:47:21.123949+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":48,"addr":"172.21.15.132:6835/1552155328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1552155328},{"type":"v1","addr":"172.21.15.132:6835","nonce":1552155328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:48:24.701 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 21 2024-04-18T04:48:24.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.704+0000 7f1396e00640 1 -- 172.21.15.120:0/2254541918 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1370066690 msgr2=0x7f1370068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:24.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.704+0000 7f1396e00640 1 --2- 172.21.15.120:0/2254541918 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1370066690 0x7f1370068b50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f137c000c10 tx=0x7f137c0aa070 comp rx=0 tx=0).stop 2024-04-18T04:48:24.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.704+0000 7f1396e00640 1 -- 172.21.15.120:0/2254541918 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13900c73d0 msgr2=0x7f139015ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:24.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.704+0000 7f1396e00640 1 --2- 172.21.15.120:0/2254541918 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13900c73d0 0x7f139015ebe0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f138400ced0 tx=0x7f138400a710 comp rx=0 tx=0).stop 2024-04-18T04:48:24.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.704+0000 7f1396e00640 1 -- 172.21.15.120:0/2254541918 shutdown_connections 2024-04-18T04:48:24.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.704+0000 7f1396e00640 1 --2- 172.21.15.120:0/2254541918 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1370066690 0x7f1370068b50 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:24.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.704+0000 7f1396e00640 1 --2- 172.21.15.120:0/2254541918 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13901696c0 0x7f1390168f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:24.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.704+0000 7f1396e00640 1 --2- 172.21.15.120:0/2254541918 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1390165990 0x7f139015e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:24.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.704+0000 7f1396e00640 1 --2- 172.21.15.120:0/2254541918 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13900c73d0 0x7f139015ebe0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:24.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.704+0000 7f1396e00640 1 -- 172.21.15.120:0/2254541918 >> 172.21.15.120:0/2254541918 conn(0x7f139006d000 msgr2=0x7f1390163700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:48:24.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.704+0000 7f1396e00640 1 -- 172.21.15.120:0/2254541918 shutdown_connections 2024-04-18T04:48:24.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:24.704+0000 7f1396e00640 1 -- 172.21.15.120:0/2254541918 wait complete. 2024-04-18T04:48:24.793 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-18T04:48:26.794 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:48:27.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.108+0000 7f4a4ac00640 1 Processor -- start 2024-04-18T04:48:27.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.108+0000 7f4a4ac00640 1 -- start start 2024-04-18T04:48:27.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.112+0000 7f4a4ac00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a4406c6d0 0x7f4a440c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:27.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.112+0000 7f4a4ac00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4a441699d0 0x7f4a44169e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:27.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.112+0000 7f4a4ac00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a4406b800 con 0x7f4a44163a90 2024-04-18T04:48:27.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.112+0000 7f4a4ac00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a44070130 con 0x7f4a441699d0 2024-04-18T04:48:27.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.112+0000 7f4a4ac00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a440c72e0 con 0x7f4a4406c6d0 2024-04-18T04:48:27.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.112+0000 7f4a43e00640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f4a44163a90 0x7f4a4406bfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:42324/0 (socket says 172.21.15.120:42324) 2024-04-18T04:48:27.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.112+0000 7f4a43e00640 1 -- 172.21.15.120:0/2890825449 learned_addr learned my addr 172.21.15.120:0/2890825449 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:48:27.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.112+0000 7f4a3be00640 1 --2- 172.21.15.120:0/2890825449 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a4406c6d0 0x7f4a440c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:27.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.112+0000 7f4a43400640 1 -- 172.21.15.120:0/2890825449 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 863386022 0 0) 0x7f4a4406b800 con 0x7f4a44163a90 2024-04-18T04:48:27.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.112+0000 7f4a48c00640 1 --2- 172.21.15.120:0/2890825449 >> v2:172.21.15.132:3300/0 conn(0x7f4a441699d0 0x7f4a44169e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:27.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.240+0000 7f4a43400640 1 -- 172.21.15.120:0/2890825449 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a28003980 con 0x7f4a44163a90 2024-04-18T04:48:27.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.240+0000 7f4a3be00640 1 -- 172.21.15.120:0/2890825449 >> v2:172.21.15.132:3300/0 conn(0x7f4a441699d0 msgr2=0x7f4a44169e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:48:27.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.240+0000 7f4a3be00640 1 --2- 172.21.15.120:0/2890825449 >> v2:172.21.15.132:3300/0 conn(0x7f4a441699d0 0x7f4a44169e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:27.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.240+0000 7f4a3be00640 1 -- 172.21.15.120:0/2890825449 >> v1:172.21.15.120:6789/0 conn(0x7f4a44163a90 legacy=0x7f4a4406bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:27.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.240+0000 7f4a3be00640 1 -- 172.21.15.120:0/2890825449 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a440c6d20 con 0x7f4a4406c6d0 2024-04-18T04:48:27.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.244+0000 7f4a48c00640 1 --2- 172.21.15.120:0/2890825449 >> v2:172.21.15.132:3300/0 conn(0x7f4a441699d0 0x7f4a44169e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:48:27.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.252+0000 7f4a3be00640 1 --2- 172.21.15.120:0/2890825449 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a4406c6d0 0x7f4a440c61d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0097c0 tx=0x7f4a2c01ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80fd5573ebf71dbd server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:27.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.256+0000 7f4a43400640 1 -- 172.21.15.120:0/2890825449 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c0a8910 con 0x7f4a4406c6d0 2024-04-18T04:48:27.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.256+0000 7f4a43400640 1 -- 172.21.15.120:0/2890825449 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a2c0a8a70 con 0x7f4a4406c6d0 2024-04-18T04:48:27.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.256+0000 7f4a43400640 1 -- 172.21.15.120:0/2890825449 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c0a8e00 con 0x7f4a4406c6d0 2024-04-18T04:48:27.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.256+0000 7f4a4ac00640 1 -- 172.21.15.120:0/2890825449 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a4406c6d0 msgr2=0x7f4a440c61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:27.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.256+0000 7f4a4ac00640 1 --2- 172.21.15.120:0/2890825449 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a4406c6d0 0x7f4a440c61d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0097c0 tx=0x7f4a2c01ec70 comp rx=0 tx=0).stop 2024-04-18T04:48:27.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.256+0000 7f4a4ac00640 1 -- 172.21.15.120:0/2890825449 shutdown_connections 2024-04-18T04:48:27.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.256+0000 7f4a4ac00640 1 --2- 172.21.15.120:0/2890825449 >> v2:172.21.15.132:3300/0 conn(0x7f4a441699d0 0x7f4a44169e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:27.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.256+0000 7f4a4ac00640 1 --2- 172.21.15.120:0/2890825449 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a4406c6d0 0x7f4a440c61d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:27.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.256+0000 7f4a4ac00640 1 -- 172.21.15.120:0/2890825449 >> 172.21.15.120:0/2890825449 conn(0x7f4a440c78c0 msgr2=0x7f4a440c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:48:27.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.260+0000 7f4a4ac00640 1 -- 172.21.15.120:0/2890825449 shutdown_connections 2024-04-18T04:48:27.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.260+0000 7f4a4ac00640 1 -- 172.21.15.120:0/2890825449 wait complete. 2024-04-18T04:48:27.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.268+0000 7f4a4ac00640 1 Processor -- start 2024-04-18T04:48:27.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.272+0000 7f4a4ac00640 1 -- start start 2024-04-18T04:48:27.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.272+0000 7f4a4ac00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a4406c6d0 0x7f4a4415ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:27.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.272+0000 7f4a4ac00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a44163a90 0x7f4a4420d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:27.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.272+0000 7f4a4ac00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a441699d0 0x7f4a4420d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:27.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.276+0000 7f4a43e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a4406c6d0 0x7f4a4415ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:27.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.276+0000 7f4a43e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a4406c6d0 0x7f4a4415ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48174/0 (socket says 172.21.15.120:48174) 2024-04-18T04:48:27.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.276+0000 7f4a3be00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a44163a90 0x7f4a4420d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:27.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.276+0000 7f4a3be00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a44163a90 0x7f4a4420d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:43120/0 (socket says 172.21.15.120:43120) 2024-04-18T04:48:27.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.276+0000 7f4a4ac00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a44166e90 con 0x7f4a4406c6d0 2024-04-18T04:48:27.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.276+0000 7f4a4ac00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a44166820 con 0x7f4a441699d0 2024-04-18T04:48:27.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.276+0000 7f4a4ac00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a44167130 con 0x7f4a44163a90 2024-04-18T04:48:27.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.276+0000 7f4a43e00640 1 -- 172.21.15.120:0/1051382345 learned_addr learned my addr 172.21.15.120:0/1051382345 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:48:27.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.280+0000 7f4a48c00640 1 --2- 172.21.15.120:0/1051382345 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a441699d0 0x7f4a4420d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:27.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.280+0000 7f4a3be00640 1 -- 172.21.15.120:0/1051382345 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a441699d0 msgr2=0x7f4a4420d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:27.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.280+0000 7f4a3be00640 1 --2- 172.21.15.120:0/1051382345 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a441699d0 0x7f4a4420d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:27.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.280+0000 7f4a3be00640 1 -- 172.21.15.120:0/1051382345 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a4406c6d0 msgr2=0x7f4a4415ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:27.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.280+0000 7f4a3be00640 1 --2- 172.21.15.120:0/1051382345 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a4406c6d0 0x7f4a4415ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:27.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.280+0000 7f4a3be00640 1 -- 172.21.15.120:0/1051382345 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a2c009420 con 0x7f4a44163a90 2024-04-18T04:48:27.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.280+0000 7f4a3be00640 1 --2- 172.21.15.120:0/1051382345 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a44163a90 0x7f4a4420d0c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4a440c8900 tx=0x7f4a2c01ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:27.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.288+0000 7f4a40c00640 1 -- 172.21.15.120:0/1051382345 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c0b0910 con 0x7f4a44163a90 2024-04-18T04:48:27.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.288+0000 7f4a40c00640 1 -- 172.21.15.120:0/1051382345 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a2c0b0a90 con 0x7f4a44163a90 2024-04-18T04:48:27.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.288+0000 7f4a40c00640 1 -- 172.21.15.120:0/1051382345 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c0b0e40 con 0x7f4a44163a90 2024-04-18T04:48:27.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.288+0000 7f4a4ac00640 1 -- 172.21.15.120:0/1051382345 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a44166260 con 0x7f4a44163a90 2024-04-18T04:48:27.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.288+0000 7f4a4ac00640 1 -- 172.21.15.120:0/1051382345 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a4420cba0 con 0x7f4a44163a90 2024-04-18T04:48:27.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.304+0000 7f4a4ac00640 1 -- 172.21.15.120:0/1051382345 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a1c005260 con 0x7f4a44163a90 2024-04-18T04:48:27.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.316+0000 7f4a40c00640 1 -- 172.21.15.120:0/1051382345 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4a2c0b7040 con 0x7f4a44163a90 2024-04-18T04:48:27.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.316+0000 7f4a40c00640 1 --2- 172.21.15.120:0/1051382345 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4a200666e0 0x7f4a20068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:27.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.316+0000 7f4a40c00640 1 -- 172.21.15.120:0/1051382345 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f4a2c1218d0 con 0x7f4a44163a90 2024-04-18T04:48:27.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.320+0000 7f4a43e00640 1 --2- 172.21.15.120:0/1051382345 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4a200666e0 0x7f4a20068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:27.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.320+0000 7f4a43e00640 1 --2- 172.21.15.120:0/1051382345 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4a200666e0 0x7f4a20068ba0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4a340011f0 tx=0x7f4a34007c90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:27.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.332+0000 7f4a40c00640 1 -- 172.21.15.120:0/1051382345 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f4a2c0ee880 con 0x7f4a44163a90 2024-04-18T04:48:27.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.768+0000 7f4a4ac00640 1 -- 172.21.15.120:0/1051382345 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a1c005550 con 0x7f4a44163a90 2024-04-18T04:48:27.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.772+0000 7f4a40c00640 1 -- 172.21.15.120:0/1051382345 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+6291 (secure 0 0 0) 0x7f4a2c0b5090 con 0x7f4a44163a90 2024-04-18T04:48:27.775 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:48:27.775 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5130,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:47:21.123949+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":48,"addr":"172.21.15.132:6835/1552155328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1552155328},{"type":"v1","addr":"172.21.15.132:6835","nonce":1552155328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:48:27.775 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 21 2024-04-18T04:48:27.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.780+0000 7f4a4ac00640 1 -- 172.21.15.120:0/1051382345 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4a200666e0 msgr2=0x7f4a20068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:27.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.780+0000 7f4a4ac00640 1 --2- 172.21.15.120:0/1051382345 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4a200666e0 0x7f4a20068ba0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4a340011f0 tx=0x7f4a34007c90 comp rx=0 tx=0).stop 2024-04-18T04:48:27.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.780+0000 7f4a4ac00640 1 -- 172.21.15.120:0/1051382345 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a44163a90 msgr2=0x7f4a4420d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:27.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.780+0000 7f4a4ac00640 1 --2- 172.21.15.120:0/1051382345 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a44163a90 0x7f4a4420d0c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4a440c8900 tx=0x7f4a2c01ba10 comp rx=0 tx=0).stop 2024-04-18T04:48:27.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.780+0000 7f4a4ac00640 1 -- 172.21.15.120:0/1051382345 shutdown_connections 2024-04-18T04:48:27.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.780+0000 7f4a4ac00640 1 --2- 172.21.15.120:0/1051382345 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4a200666e0 0x7f4a20068ba0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:27.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.780+0000 7f4a4ac00640 1 --2- 172.21.15.120:0/1051382345 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a441699d0 0x7f4a4420d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:27.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.780+0000 7f4a4ac00640 1 --2- 172.21.15.120:0/1051382345 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a44163a90 0x7f4a4420d0c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:27.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.780+0000 7f4a4ac00640 1 --2- 172.21.15.120:0/1051382345 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a4406c6d0 0x7f4a4415ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:27.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.780+0000 7f4a4ac00640 1 -- 172.21.15.120:0/1051382345 >> 172.21.15.120:0/1051382345 conn(0x7f4a440c78c0 msgr2=0x7f4a4406cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:48:27.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.784+0000 7f4a4ac00640 1 -- 172.21.15.120:0/1051382345 shutdown_connections 2024-04-18T04:48:27.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:27.784+0000 7f4a4ac00640 1 -- 172.21.15.120:0/1051382345 wait complete. 2024-04-18T04:48:27.841 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-18T04:48:29.842 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:48:30.274 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:48:30.279 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:48:30.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.140+0000 7f681aa00640 1 Processor -- start 2024-04-18T04:48:30.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.140+0000 7f681aa00640 1 -- start start 2024-04-18T04:48:30.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.144+0000 7f681aa00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f680c045420 0x7f680c0fd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:30.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.144+0000 7f681aa00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f680c046c20 0x7f680c005e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:30.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.144+0000 7f681aa00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f680c050e40 con 0x7f680c0f6b90 2024-04-18T04:48:30.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.144+0000 7f681aa00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f680c045970 con 0x7f680c045420 2024-04-18T04:48:30.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.144+0000 7f681aa00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f680c046790 con 0x7f680c046c20 2024-04-18T04:48:30.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.144+0000 7f6819600640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f680c0f6b90 0x7f680c04b070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:42330/0 (socket says 172.21.15.120:42330) 2024-04-18T04:48:30.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.144+0000 7f6819600640 1 -- 172.21.15.120:0/3521008684 learned_addr learned my addr 172.21.15.120:0/3521008684 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:48:30.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.144+0000 7f681a000640 1 --2- 172.21.15.120:0/3521008684 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f680c046c20 0x7f680c005e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:30.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.144+0000 7f6813e00640 1 -- 172.21.15.120:0/3521008684 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3304636494 0 0) 0x7f680c050e40 con 0x7f680c0f6b90 2024-04-18T04:48:30.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.308+0000 7f6813e00640 1 -- 172.21.15.120:0/3521008684 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67fc003530 con 0x7f680c0f6b90 2024-04-18T04:48:30.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.144+0000 7f6818c00640 1 --2- 172.21.15.120:0/3521008684 >> v2:172.21.15.120:3300/0 conn(0x7f680c045420 0x7f680c0fd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:30.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.308+0000 7f681a000640 1 -- 172.21.15.120:0/3521008684 >> v2:172.21.15.120:3300/0 conn(0x7f680c045420 msgr2=0x7f680c0fd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:48:30.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.308+0000 7f681a000640 1 --2- 172.21.15.120:0/3521008684 >> v2:172.21.15.120:3300/0 conn(0x7f680c045420 0x7f680c0fd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:30.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.308+0000 7f681a000640 1 -- 172.21.15.120:0/3521008684 >> v1:172.21.15.120:6789/0 conn(0x7f680c0f6b90 legacy=0x7f680c04b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:30.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.308+0000 7f681a000640 1 -- 172.21.15.120:0/3521008684 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f680c045b80 con 0x7f680c046c20 2024-04-18T04:48:30.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.328+0000 7f681a000640 1 --2- 172.21.15.120:0/3521008684 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f680c046c20 0x7f680c005e70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f681402c920 tx=0x7f6814088de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e88ba142ac06387 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:30.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.328+0000 7f6813e00640 1 -- 172.21.15.120:0/3521008684 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68141129d0 con 0x7f680c046c20 2024-04-18T04:48:30.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.328+0000 7f6813e00640 1 -- 172.21.15.120:0/3521008684 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6814112b30 con 0x7f680c046c20 2024-04-18T04:48:30.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.328+0000 7f6813e00640 1 -- 172.21.15.120:0/3521008684 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681411a440 con 0x7f680c046c20 2024-04-18T04:48:30.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.332+0000 7f681aa00640 1 -- 172.21.15.120:0/3521008684 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f680c046c20 msgr2=0x7f680c005e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:30.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.332+0000 7f681aa00640 1 --2- 172.21.15.120:0/3521008684 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f680c046c20 0x7f680c005e70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f681402c920 tx=0x7f6814088de0 comp rx=0 tx=0).stop 2024-04-18T04:48:30.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.332+0000 7f681aa00640 1 -- 172.21.15.120:0/3521008684 shutdown_connections 2024-04-18T04:48:30.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.332+0000 7f681aa00640 1 --2- 172.21.15.120:0/3521008684 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f680c046c20 0x7f680c005e70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:30.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.332+0000 7f681aa00640 1 --2- 172.21.15.120:0/3521008684 >> v2:172.21.15.120:3300/0 conn(0x7f680c045420 0x7f680c0fd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:30.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.332+0000 7f681aa00640 1 -- 172.21.15.120:0/3521008684 >> 172.21.15.120:0/3521008684 conn(0x7f680c050160 msgr2=0x7f680c050570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:48:30.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.336+0000 7f681aa00640 1 -- 172.21.15.120:0/3521008684 shutdown_connections 2024-04-18T04:48:30.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.336+0000 7f681aa00640 1 -- 172.21.15.120:0/3521008684 wait complete. 2024-04-18T04:48:30.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.344+0000 7f681aa00640 1 Processor -- start 2024-04-18T04:48:30.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.348+0000 7f681aa00640 1 -- start start 2024-04-18T04:48:30.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.356+0000 7f681aa00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f680c045420 0x7f680c048200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:30.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.356+0000 7f681aa00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f680c046c20 0x7f680c048740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:30.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.356+0000 7f681aa00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f680c0f6b90 0x7f680c049060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:30.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.356+0000 7f681aa00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680c006070 con 0x7f680c0f6b90 2024-04-18T04:48:30.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.356+0000 7f681aa00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680c1906c0 con 0x7f680c045420 2024-04-18T04:48:30.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.356+0000 7f681aa00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f680c047e20 con 0x7f680c046c20 2024-04-18T04:48:30.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.356+0000 7f681a000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f680c0f6b90 0x7f680c049060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:30.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.356+0000 7f681a000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f680c0f6b90 0x7f680c049060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48186/0 (socket says 172.21.15.120:48186) 2024-04-18T04:48:30.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.356+0000 7f681a000640 1 -- 172.21.15.120:0/465573631 learned_addr learned my addr 172.21.15.120:0/465573631 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:48:30.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.356+0000 7f6818c00640 1 --2- 172.21.15.120:0/465573631 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f680c046c20 0x7f680c048740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:30.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.356+0000 7f681a000640 1 -- 172.21.15.120:0/465573631 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f680c046c20 msgr2=0x7f680c048740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:30.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.356+0000 7f681a000640 1 --2- 172.21.15.120:0/465573631 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f680c046c20 0x7f680c048740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:30.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.356+0000 7f681a000640 1 -- 172.21.15.120:0/465573631 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f680c045420 msgr2=0x7f680c048200 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:48:30.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.356+0000 7f681a000640 1 --2- 172.21.15.120:0/465573631 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f680c045420 0x7f680c048200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:30.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.356+0000 7f681a000640 1 -- 172.21.15.120:0/465573631 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f681404f100 con 0x7f680c0f6b90 2024-04-18T04:48:30.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.356+0000 7f681a000640 1 --2- 172.21.15.120:0/465573631 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f680c0f6b90 0x7f680c049060 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f681407ac90 tx=0x7f6814087670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:30.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.368+0000 7f6811600640 1 -- 172.21.15.120:0/465573631 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681411ac70 con 0x7f680c0f6b90 2024-04-18T04:48:30.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.368+0000 7f6811600640 1 -- 172.21.15.120:0/465573631 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f681411add0 con 0x7f680c0f6b90 2024-04-18T04:48:30.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.368+0000 7f6811600640 1 -- 172.21.15.120:0/465573631 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6814123640 con 0x7f680c0f6b90 2024-04-18T04:48:30.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.368+0000 7f681aa00640 1 -- 172.21.15.120:0/465573631 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f680c18fa40 con 0x7f680c0f6b90 2024-04-18T04:48:30.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.368+0000 7f681aa00640 1 -- 172.21.15.120:0/465573631 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f680c190000 con 0x7f680c0f6b90 2024-04-18T04:48:30.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.372+0000 7f681aa00640 1 -- 172.21.15.120:0/465573631 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f680c005370 con 0x7f680c0f6b90 2024-04-18T04:48:30.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.372+0000 7f6811600640 1 -- 172.21.15.120:0/465573631 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6814121070 con 0x7f680c0f6b90 2024-04-18T04:48:30.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.372+0000 7f6811600640 1 --2- 172.21.15.120:0/465573631 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f67f40666e0 0x7f67f4068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:30.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.372+0000 7f6811600640 1 -- 172.21.15.120:0/465573631 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f681418be10 con 0x7f680c0f6b90 2024-04-18T04:48:30.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.372+0000 7f6819600640 1 --2- 172.21.15.120:0/465573631 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f67f40666e0 0x7f67f4068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:30.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.372+0000 7f6819600640 1 --2- 172.21.15.120:0/465573631 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f67f40666e0 0x7f67f4068ba0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6808007fd0 tx=0x7f6808007900 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:30.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.376+0000 7f6811600640 1 -- 172.21.15.120:0/465573631 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f6814158ee0 con 0x7f680c0f6b90 2024-04-18T04:48:30.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.636+0000 7f681aa00640 1 -- 172.21.15.120:0/465573631 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f680c04a240 con 0x7f680c0f6b90 2024-04-18T04:48:30.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.640+0000 7f6811600640 1 -- 172.21.15.120:0/465573631 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+6291 (secure 0 0 0) 0x7f681411f070 con 0x7f680c0f6b90 2024-04-18T04:48:30.642 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:48:30.642 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5130,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:47:21.123949+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":48,"addr":"172.21.15.132:6835/1552155328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1552155328},{"type":"v1","addr":"172.21.15.132:6835","nonce":1552155328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:48:30.642 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 21 2024-04-18T04:48:30.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.648+0000 7f681aa00640 1 -- 172.21.15.120:0/465573631 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f67f40666e0 msgr2=0x7f67f4068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:30.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.648+0000 7f681aa00640 1 --2- 172.21.15.120:0/465573631 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f67f40666e0 0x7f67f4068ba0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6808007fd0 tx=0x7f6808007900 comp rx=0 tx=0).stop 2024-04-18T04:48:30.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.648+0000 7f681aa00640 1 -- 172.21.15.120:0/465573631 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f680c0f6b90 msgr2=0x7f680c049060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:30.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.648+0000 7f681aa00640 1 --2- 172.21.15.120:0/465573631 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f680c0f6b90 0x7f680c049060 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f681407ac90 tx=0x7f6814087670 comp rx=0 tx=0).stop 2024-04-18T04:48:30.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.648+0000 7f681aa00640 1 -- 172.21.15.120:0/465573631 shutdown_connections 2024-04-18T04:48:30.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.648+0000 7f681aa00640 1 --2- 172.21.15.120:0/465573631 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f67f40666e0 0x7f67f4068ba0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:30.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.648+0000 7f681aa00640 1 --2- 172.21.15.120:0/465573631 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f680c0f6b90 0x7f680c049060 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:30.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.648+0000 7f681aa00640 1 --2- 172.21.15.120:0/465573631 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f680c046c20 0x7f680c048740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:30.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.648+0000 7f681aa00640 1 --2- 172.21.15.120:0/465573631 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f680c045420 0x7f680c048200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:30.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.648+0000 7f681aa00640 1 -- 172.21.15.120:0/465573631 >> 172.21.15.120:0/465573631 conn(0x7f680c050160 msgr2=0x7f680c0f54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:48:30.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.652+0000 7f681aa00640 1 -- 172.21.15.120:0/465573631 shutdown_connections 2024-04-18T04:48:30.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:30.652+0000 7f681aa00640 1 -- 172.21.15.120:0/465573631 wait complete. 2024-04-18T04:48:30.744 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-18T04:48:32.746 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:48:33.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.240+0000 7f105f200640 1 Processor -- start 2024-04-18T04:48:33.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.240+0000 7f105f200640 1 -- start start 2024-04-18T04:48:33.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.244+0000 7f105f200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1060153790 0x7f10600c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:33.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.244+0000 7f105f200640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f10601594a0 0x7f10600c53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:33.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.244+0000 7f105f200640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10600c4970 con 0x7f1060159880 2024-04-18T04:48:33.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.244+0000 7f105f200640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1060159d60 con 0x7f10601594a0 2024-04-18T04:48:33.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.244+0000 7f105f200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f106015a000 con 0x7f1060153790 2024-04-18T04:48:33.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.244+0000 7f105de00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1060153790 0x7f10600c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:33.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.244+0000 7f105de00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1060153790 0x7f10600c9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:40834/0 (socket says 172.21.15.120:40834) 2024-04-18T04:48:33.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.248+0000 7f105de00640 1 -- 172.21.15.120:0/1384403686 learned_addr learned my addr 172.21.15.120:0/1384403686 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:48:33.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.244+0000 7f105d400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f10601594a0 0x7f10600c53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:33.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.244+0000 7f105e800640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f1060159880 0x7f10600ced50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:56156/0 (socket says 172.21.15.120:56156) 2024-04-18T04:48:33.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.248+0000 7f105d400640 1 -- 172.21.15.120:0/1384403686 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1060153790 msgr2=0x7f10600c9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:48:33.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.248+0000 7f105d400640 1 --2- 172.21.15.120:0/1384403686 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1060153790 0x7f10600c9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:33.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.248+0000 7f105d400640 1 -- 172.21.15.120:0/1384403686 >> v1:172.21.15.132:6789/0 conn(0x7f1060159880 legacy=0x7f10600ced50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:33.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.248+0000 7f105d400640 1 -- 172.21.15.120:0/1384403686 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106015a2e0 con 0x7f10601594a0 2024-04-18T04:48:33.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.256+0000 7f105d400640 1 --2- 172.21.15.120:0/1384403686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f10601594a0 0x7f10600c53c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f104c0097c0 tx=0x7f104c01ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=addcbc45b628bc1e server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:33.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.260+0000 7f105ca00640 1 -- 172.21.15.120:0/1384403686 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104c0a89b0 con 0x7f10601594a0 2024-04-18T04:48:33.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.260+0000 7f105ca00640 1 -- 172.21.15.120:0/1384403686 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f104c0a8b10 con 0x7f10601594a0 2024-04-18T04:48:33.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.260+0000 7f105ca00640 1 -- 172.21.15.120:0/1384403686 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104c0b0440 con 0x7f10601594a0 2024-04-18T04:48:33.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.260+0000 7f105f200640 1 -- 172.21.15.120:0/1384403686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f10601594a0 msgr2=0x7f10600c53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:33.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.260+0000 7f105f200640 1 --2- 172.21.15.120:0/1384403686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f10601594a0 0x7f10600c53c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f104c0097c0 tx=0x7f104c01ecd0 comp rx=0 tx=0).stop 2024-04-18T04:48:33.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.260+0000 7f105f200640 1 -- 172.21.15.120:0/1384403686 shutdown_connections 2024-04-18T04:48:33.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.260+0000 7f105f200640 1 --2- 172.21.15.120:0/1384403686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f10601594a0 0x7f10600c53c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:33.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.260+0000 7f105f200640 1 --2- 172.21.15.120:0/1384403686 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1060153790 0x7f10600c9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:33.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.260+0000 7f105f200640 1 -- 172.21.15.120:0/1384403686 >> 172.21.15.120:0/1384403686 conn(0x7f1060065bc0 msgr2=0x7f1060065fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:48:33.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.260+0000 7f105f200640 1 -- 172.21.15.120:0/1384403686 shutdown_connections 2024-04-18T04:48:33.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.260+0000 7f105f200640 1 -- 172.21.15.120:0/1384403686 wait complete. 2024-04-18T04:48:33.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.264+0000 7f105f200640 1 Processor -- start 2024-04-18T04:48:33.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.264+0000 7f105f200640 1 -- start start 2024-04-18T04:48:33.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.264+0000 7f105f200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1060153790 0x7f10600c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:33.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.264+0000 7f105f200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f10601594a0 0x7f10600c8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:33.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.264+0000 7f105f200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1060159880 0x7f10601f2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:33.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.264+0000 7f105f200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10600ce620 con 0x7f1060159880 2024-04-18T04:48:33.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.264+0000 7f105f200640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10600ce900 con 0x7f1060153790 2024-04-18T04:48:33.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.264+0000 7f105f200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10600ccdd0 con 0x7f10601594a0 2024-04-18T04:48:33.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.264+0000 7f105de00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1060153790 0x7f10600c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:33.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.264+0000 7f105de00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1060153790 0x7f10600c7e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:57048/0 (socket says 172.21.15.120:57048) 2024-04-18T04:48:33.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.264+0000 7f105de00640 1 -- 172.21.15.120:0/1448240810 learned_addr learned my addr 172.21.15.120:0/1448240810 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:48:33.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.264+0000 7f105de00640 1 -- 172.21.15.120:0/1448240810 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f10601594a0 msgr2=0x7f10600c8390 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-18T04:48:33.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.264+0000 7f105de00640 1 --2- 172.21.15.120:0/1448240810 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f10601594a0 0x7f10600c8390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:33.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.264+0000 7f105de00640 1 -- 172.21.15.120:0/1448240810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1060159880 msgr2=0x7f10601f2440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:48:33.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.268+0000 7f105e800640 1 --2- 172.21.15.120:0/1448240810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1060159880 0x7f10601f2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:33.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.268+0000 7f105de00640 1 --2- 172.21.15.120:0/1448240810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1060159880 0x7f10601f2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:33.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.268+0000 7f105de00640 1 -- 172.21.15.120:0/1448240810 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f104c009420 con 0x7f1060153790 2024-04-18T04:48:33.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.268+0000 7f105de00640 1 --2- 172.21.15.120:0/1448240810 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1060153790 0x7f10600c7e50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f105000e7e0 tx=0x7f105000eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:33.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.268+0000 7f1056000640 1 -- 172.21.15.120:0/1448240810 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105000c8d0 con 0x7f1060153790 2024-04-18T04:48:33.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.268+0000 7f1056000640 1 -- 172.21.15.120:0/1448240810 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105000ee90 con 0x7f1060153790 2024-04-18T04:48:33.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.268+0000 7f1056000640 1 -- 172.21.15.120:0/1448240810 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105000cc70 con 0x7f1060153790 2024-04-18T04:48:33.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.268+0000 7f105f200640 1 -- 172.21.15.120:0/1448240810 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10600cd0b0 con 0x7f1060153790 2024-04-18T04:48:33.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.268+0000 7f105f200640 1 -- 172.21.15.120:0/1448240810 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10600cebe0 con 0x7f1060153790 2024-04-18T04:48:33.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.272+0000 7f104b400640 1 -- 172.21.15.120:0/1448240810 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1034005260 con 0x7f1060153790 2024-04-18T04:48:33.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.272+0000 7f1056000640 1 -- 172.21.15.120:0/1448240810 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1050013410 con 0x7f1060153790 2024-04-18T04:48:33.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.272+0000 7f1056000640 1 --2- 172.21.15.120:0/1448240810 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1040066690 0x7f1040068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:33.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.272+0000 7f1056000640 1 -- 172.21.15.120:0/1448240810 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f1050084510 con 0x7f1060153790 2024-04-18T04:48:33.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.272+0000 7f105d400640 1 --2- 172.21.15.120:0/1448240810 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1040066690 0x7f1040068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:33.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.276+0000 7f105d400640 1 --2- 172.21.15.120:0/1448240810 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1040066690 0x7f1040068b50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f104c0b2000 tx=0x7f104c0aa070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:33.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.280+0000 7f1056000640 1 -- 172.21.15.120:0/1448240810 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f1050051370 con 0x7f1060153790 2024-04-18T04:48:33.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.660+0000 7f104b400640 1 -- 172.21.15.120:0/1448240810 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1034005a90 con 0x7f1060153790 2024-04-18T04:48:33.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.664+0000 7f1056000640 1 -- 172.21.15.120:0/1448240810 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+5530 (secure 0 0 0) 0x7f1050054990 con 0x7f1060153790 2024-04-18T04:48:33.664 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:48:33.664 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:48:30.878326+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5130":{"gid":5130,"name":"c","rank":2,"incarnation":22,"state":"up:replay","state_seq":1,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:48:33.665 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 22 2024-04-18T04:48:33.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.704+0000 7f104b400640 1 -- 172.21.15.120:0/1448240810 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1040066690 msgr2=0x7f1040068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:33.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.704+0000 7f104b400640 1 --2- 172.21.15.120:0/1448240810 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1040066690 0x7f1040068b50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f104c0b2000 tx=0x7f104c0aa070 comp rx=0 tx=0).stop 2024-04-18T04:48:33.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.704+0000 7f104b400640 1 -- 172.21.15.120:0/1448240810 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1060153790 msgr2=0x7f10600c7e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:33.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.704+0000 7f104b400640 1 --2- 172.21.15.120:0/1448240810 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1060153790 0x7f10600c7e50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f105000e7e0 tx=0x7f105000eca0 comp rx=0 tx=0).stop 2024-04-18T04:48:33.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.704+0000 7f104b400640 1 -- 172.21.15.120:0/1448240810 shutdown_connections 2024-04-18T04:48:33.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.704+0000 7f104b400640 1 --2- 172.21.15.120:0/1448240810 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1040066690 0x7f1040068b50 secure :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f104c0b2000 tx=0x7f104c0aa070 comp rx=0 tx=0).stop 2024-04-18T04:48:33.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.704+0000 7f104b400640 1 --2- 172.21.15.120:0/1448240810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1060159880 0x7f10601f2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:33.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.704+0000 7f104b400640 1 --2- 172.21.15.120:0/1448240810 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f10601594a0 0x7f10600c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:33.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.704+0000 7f104b400640 1 --2- 172.21.15.120:0/1448240810 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1060153790 0x7f10600c7e50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:33.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.704+0000 7f104b400640 1 -- 172.21.15.120:0/1448240810 >> 172.21.15.120:0/1448240810 conn(0x7f1060065bc0 msgr2=0x7f10601e57f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:48:33.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.708+0000 7f104b400640 1 -- 172.21.15.120:0/1448240810 shutdown_connections 2024-04-18T04:48:33.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:33.708+0000 7f104b400640 1 -- 172.21.15.120:0/1448240810 wait complete. 2024-04-18T04:48:33.762 INFO:tasks.mds_thrash.fs.[cephfs]:mds.b down, removed from mdsmap 2024-04-18T04:48:33.762 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for mds cluster to stabilize... 2024-04-18T04:48:33.762 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:48:34.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.076+0000 7f710c000640 1 Processor -- start 2024-04-18T04:48:34.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.076+0000 7f710c000640 1 -- start start 2024-04-18T04:48:34.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.080+0000 7f710c000640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f71040c8850 0x7f710406fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:34.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.080+0000 7f710c000640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71040703b0 con 0x7f7104153830 2024-04-18T04:48:34.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.080+0000 7f710c000640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71040c9520 con 0x7f710415d090 2024-04-18T04:48:34.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.080+0000 7f710c000640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71040c4200 con 0x7f71040c8850 2024-04-18T04:48:34.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.080+0000 7f710a000640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f710415d090 0x7f710415d4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:56168/0 (socket says 172.21.15.120:56168) 2024-04-18T04:48:34.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.080+0000 7f710a000640 1 -- 172.21.15.120:0/2326330386 learned_addr learned my addr 172.21.15.120:0/2326330386 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:48:34.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.080+0000 7f7103e00640 1 -- 172.21.15.120:0/2326330386 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2461099312 0 0) 0x7f71040c9520 con 0x7f710415d090 2024-04-18T04:48:34.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.080+0000 7f7103e00640 1 -- 172.21.15.120:0/2326330386 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70ec003530 con 0x7f710415d090 2024-04-18T04:48:34.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.080+0000 7f7108c00640 1 --2- 172.21.15.120:0/2326330386 >> v2:172.21.15.120:3300/0 conn(0x7f71040c8850 0x7f710406fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:34.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.080+0000 7f7108c00640 1 -- 172.21.15.120:0/2326330386 >> v1:172.21.15.132:6789/0 conn(0x7f710415d090 legacy=0x7f710415d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:34.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.080+0000 7f7108c00640 1 -- 172.21.15.120:0/2326330386 >> v1:172.21.15.120:6789/0 conn(0x7f7104153830 legacy=0x7f71040ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:48:34.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.084+0000 7f7108c00640 1 -- 172.21.15.120:0/2326330386 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f710415cc00 con 0x7f71040c8850 2024-04-18T04:48:34.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.088+0000 7f7108c00640 1 --2- 172.21.15.120:0/2326330386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71040c8850 0x7f710406fe70 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f70f8009740 tx=0x7f70f801c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=295416cff9fbb5d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:34.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.088+0000 7f7103e00640 1 -- 172.21.15.120:0/2326330386 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc001a00 con 0x7f71040c8850 2024-04-18T04:48:34.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.088+0000 7f7103e00640 1 -- 172.21.15.120:0/2326330386 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f80a7050 con 0x7f71040c8850 2024-04-18T04:48:34.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.088+0000 7f7103e00640 1 -- 172.21.15.120:0/2326330386 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f80ab620 con 0x7f71040c8850 2024-04-18T04:48:34.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.092+0000 7f710c000640 1 -- 172.21.15.120:0/2326330386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71040c8850 msgr2=0x7f710406fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:34.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.092+0000 7f710c000640 1 --2- 172.21.15.120:0/2326330386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71040c8850 0x7f710406fe70 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f70f8009740 tx=0x7f70f801c270 comp rx=0 tx=0).stop 2024-04-18T04:48:34.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.096+0000 7f710c000640 1 -- 172.21.15.120:0/2326330386 shutdown_connections 2024-04-18T04:48:34.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.096+0000 7f710c000640 1 --2- 172.21.15.120:0/2326330386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71040c8850 0x7f710406fe70 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:34.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.096+0000 7f710c000640 1 -- 172.21.15.120:0/2326330386 >> 172.21.15.120:0/2326330386 conn(0x7f710406e0f0 msgr2=0x7f7104071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:48:34.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.100+0000 7f710c000640 1 -- 172.21.15.120:0/2326330386 shutdown_connections 2024-04-18T04:48:34.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.100+0000 7f710c000640 1 -- 172.21.15.120:0/2326330386 wait complete. 2024-04-18T04:48:34.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.112+0000 7f710c000640 1 Processor -- start 2024-04-18T04:48:34.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.112+0000 7f710c000640 1 -- start start 2024-04-18T04:48:34.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.112+0000 7f710c000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71040c8850 0x7f7104149c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:34.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.112+0000 7f710c000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7104153830 0x7f710415ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:34.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.112+0000 7f710c000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f710415d090 0x7f71041f5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:34.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.112+0000 7f710c000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7104147d00 con 0x7f7104153830 2024-04-18T04:48:34.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.112+0000 7f710c000640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71041f2700 con 0x7f71040c8850 2024-04-18T04:48:34.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.112+0000 7f710c000640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71041f4da0 con 0x7f710415d090 2024-04-18T04:48:34.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.112+0000 7f710a000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f710415d090 0x7f71041f5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:34.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.112+0000 7f710a000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f710415d090 0x7f71041f5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:40866/0 (socket says 172.21.15.120:40866) 2024-04-18T04:48:34.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.112+0000 7f710a000640 1 -- 172.21.15.120:0/2721187136 learned_addr learned my addr 172.21.15.120:0/2721187136 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:48:34.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.112+0000 7f710a000640 1 -- 172.21.15.120:0/2721187136 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71040c8850 msgr2=0x7f7104149c20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:48:34.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.112+0000 7f710a000640 1 --2- 172.21.15.120:0/2721187136 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71040c8850 0x7f7104149c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:34.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.112+0000 7f710a000640 1 -- 172.21.15.120:0/2721187136 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7104153830 msgr2=0x7f710415ac90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:48:34.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.116+0000 7f710a000640 1 --2- 172.21.15.120:0/2721187136 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7104153830 0x7f710415ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:34.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.116+0000 7f710a000640 1 -- 172.21.15.120:0/2721187136 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f8009420 con 0x7f710415d090 2024-04-18T04:48:34.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.116+0000 7f710a000640 1 --2- 172.21.15.120:0/2721187136 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f710415d090 0x7f71041f5080 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f70fc00caf0 tx=0x7f70fc0021a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:34.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.116+0000 7f7101600640 1 -- 172.21.15.120:0/2721187136 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc00a7c0 con 0x7f710415d090 2024-04-18T04:48:34.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.116+0000 7f7101600640 1 -- 172.21.15.120:0/2721187136 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70fc00a940 con 0x7f710415d090 2024-04-18T04:48:34.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.116+0000 7f7101600640 1 -- 172.21.15.120:0/2721187136 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc00acf0 con 0x7f710415d090 2024-04-18T04:48:34.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.116+0000 7f710c000640 1 -- 172.21.15.120:0/2721187136 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71041f1940 con 0x7f710415d090 2024-04-18T04:48:34.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.116+0000 7f710c000640 1 -- 172.21.15.120:0/2721187136 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71041f1f00 con 0x7f710415d090 2024-04-18T04:48:34.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.116+0000 7f710c000640 1 -- 172.21.15.120:0/2721187136 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7104067590 con 0x7f710415d090 2024-04-18T04:48:34.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.128+0000 7f7101600640 1 -- 172.21.15.120:0/2721187136 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f70fc0070d0 con 0x7f710415d090 2024-04-18T04:48:34.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.128+0000 7f7101600640 1 --2- 172.21.15.120:0/2721187136 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f70e406eed0 0x7f70e4071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:34.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.128+0000 7f7101600640 1 -- 172.21.15.120:0/2721187136 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f70fc083f10 con 0x7f710415d090 2024-04-18T04:48:34.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.132+0000 7f7109600640 1 --2- 172.21.15.120:0/2721187136 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f70e406eed0 0x7f70e4071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:34.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.140+0000 7f7101600640 1 -- 172.21.15.120:0/2721187136 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f70fc050ce0 con 0x7f710415d090 2024-04-18T04:48:34.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.148+0000 7f7109600640 1 --2- 172.21.15.120:0/2721187136 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f70e406eed0 0x7f70e4071390 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f70f0000f70 tx=0x7f70f00079c0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:34.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.624+0000 7f710c000640 1 -- 172.21.15.120:0/2721187136 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71040c7b40 con 0x7f710415d090 2024-04-18T04:48:34.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.624+0000 7f7101600640 1 -- 172.21.15.120:0/2721187136 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+5530 (secure 0 0 0) 0x7f70fc018070 con 0x7f710415d090 2024-04-18T04:48:34.627 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:48:34.627 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:48:30.878326+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5130":{"gid":5130,"name":"c","rank":2,"incarnation":22,"state":"up:replay","state_seq":1,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:48:34.627 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 22 2024-04-18T04:48:34.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.628+0000 7f710c000640 1 -- 172.21.15.120:0/2721187136 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f70e406eed0 msgr2=0x7f70e4071390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:34.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.628+0000 7f710c000640 1 --2- 172.21.15.120:0/2721187136 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f70e406eed0 0x7f70e4071390 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f70f0000f70 tx=0x7f70f00079c0 comp rx=0 tx=0).stop 2024-04-18T04:48:34.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.628+0000 7f710c000640 1 -- 172.21.15.120:0/2721187136 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f710415d090 msgr2=0x7f71041f5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:34.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.628+0000 7f710c000640 1 --2- 172.21.15.120:0/2721187136 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f710415d090 0x7f71041f5080 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f70fc00caf0 tx=0x7f70fc0021a0 comp rx=0 tx=0).stop 2024-04-18T04:48:34.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.636+0000 7f710c000640 1 -- 172.21.15.120:0/2721187136 shutdown_connections 2024-04-18T04:48:34.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.636+0000 7f710c000640 1 --2- 172.21.15.120:0/2721187136 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f70e406eed0 0x7f70e4071390 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:34.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.636+0000 7f710c000640 1 --2- 172.21.15.120:0/2721187136 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f710415d090 0x7f71041f5080 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:34.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.636+0000 7f710c000640 1 --2- 172.21.15.120:0/2721187136 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7104153830 0x7f710415ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:34.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.636+0000 7f710c000640 1 --2- 172.21.15.120:0/2721187136 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71040c8850 0x7f7104149c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:34.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.636+0000 7f710c000640 1 -- 172.21.15.120:0/2721187136 >> 172.21.15.120:0/2721187136 conn(0x7f710406e0f0 msgr2=0x7f710414a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:48:34.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.640+0000 7f710c000640 1 -- 172.21.15.120:0/2721187136 shutdown_connections 2024-04-18T04:48:34.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:34.640+0000 7f710c000640 1 -- 172.21.15.120:0/2721187136 wait complete. 2024-04-18T04:48:34.687 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 22, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-18T04:44:30.251235+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 22, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1, 2 ], "info": { "gid_4275": { "addr": "172.21.15.120:6836/1079090700", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6834", "nonce": 1079090700, "type": "v2" }, { "addr": "172.21.15.120:6836", "nonce": 1079090700, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4275, "incarnation": 10, "join_fscid": -1, "name": "a", "rank": 1, "state": "up:active", "state_seq": 11 }, "gid_4288": { "addr": "172.21.15.120:6837/76856194", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6835", "nonce": 76856194, "type": "v2" }, { "addr": "172.21.15.120:6837", "nonce": 76856194, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4288, "incarnation": 4, "join_fscid": -1, "name": "e", "rank": 0, "state": "up:active", "state_seq": 4 }, "gid_5130": { "addr": "172.21.15.120:6833/4067927368", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6832", "nonce": 4067927368, "type": "v2" }, { "addr": "172.21.15.120:6833", "nonce": 4067927368, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5130, "incarnation": 22, "join_fscid": -1, "name": "c", "rank": 2, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 29, "max_file_size": 1099511627776, "max_mds": 3, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-18T04:48:30.878326+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4288, "mds_1": 4275, "mds_2": 5130 } } } ], "standbys": [ { "addr": "172.21.15.132:6839/4292136288", "addrs": { "addrvec": [ { "addr": "172.21.15.132:6836", "nonce": 4292136288, "type": "v2" }, { "addr": "172.21.15.132:6839", "nonce": 4292136288, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4241, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.132:6838/1712856922", "addrs": { "addrvec": [ { "addr": "172.21.15.132:6837", "nonce": 1712856922, "type": "v2" }, { "addr": "172.21.15.132:6838", "nonce": 1712856922, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 2, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4244, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-18T04:48:36.688 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:48:37.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.036+0000 7f26f7e00640 1 Processor -- start 2024-04-18T04:48:37.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.036+0000 7f26f7e00640 1 -- start start 2024-04-18T04:48:37.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.040+0000 7f26f7e00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f26f8165990 0x7f26f806c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:37.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.040+0000 7f26f7e00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26f80c6150 con 0x7f26f8166d80 2024-04-18T04:48:37.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.040+0000 7f26f7e00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26f80c5860 con 0x7f26f80c73d0 2024-04-18T04:48:37.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.040+0000 7f26f7e00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26f806fe60 con 0x7f26f8165990 2024-04-18T04:48:37.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.040+0000 7f26f6000640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f26f80c73d0 0x7f26f80c65e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:56174/0 (socket says 172.21.15.120:56174) 2024-04-18T04:48:37.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.040+0000 7f26f6000640 1 -- 172.21.15.120:0/695863743 learned_addr learned my addr 172.21.15.120:0/695863743 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:48:37.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.040+0000 7f26f6a00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f26f8165990 0x7f26f806c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:37.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.040+0000 7f26f5600640 1 -- 172.21.15.120:0/695863743 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3363661475 0 0) 0x7f26f80c6150 con 0x7f26f8166d80 2024-04-18T04:48:37.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.356+0000 7f26f5600640 1 -- 172.21.15.120:0/695863743 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26dc003530 con 0x7f26f8166d80 2024-04-18T04:48:37.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.356+0000 7f26f5600640 1 -- 172.21.15.120:0/695863743 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3146328713 0 0) 0x7f26f80c5860 con 0x7f26f80c73d0 2024-04-18T04:48:37.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.356+0000 7f26f5600640 1 -- 172.21.15.120:0/695863743 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26f80c6150 con 0x7f26f80c73d0 2024-04-18T04:48:37.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.356+0000 7f26f6a00640 1 -- 172.21.15.120:0/695863743 >> v1:172.21.15.132:6789/0 conn(0x7f26f80c73d0 legacy=0x7f26f80c65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:37.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.356+0000 7f26f6a00640 1 -- 172.21.15.120:0/695863743 >> v1:172.21.15.120:6789/0 conn(0x7f26f8166d80 legacy=0x7f26f81696c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:37.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.356+0000 7f26f6a00640 1 -- 172.21.15.120:0/695863743 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f806c670 con 0x7f26f8165990 2024-04-18T04:48:37.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.360+0000 7f26f6a00640 1 --2- 172.21.15.120:0/695863743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26f8165990 0x7f26f806c030 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f26e0009c20 tx=0x7f26e001ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94a7686922d44d60 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:37.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.360+0000 7f26f5600640 1 -- 172.21.15.120:0/695863743 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e8001680 con 0x7f26f8165990 2024-04-18T04:48:37.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.360+0000 7f26f5600640 1 -- 172.21.15.120:0/695863743 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e00090d0 con 0x7f26f8165990 2024-04-18T04:48:37.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.360+0000 7f26f5600640 1 -- 172.21.15.120:0/695863743 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e00a8a10 con 0x7f26f8165990 2024-04-18T04:48:37.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.360+0000 7f26f7e00640 1 -- 172.21.15.120:0/695863743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26f8165990 msgr2=0x7f26f806c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:37.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.360+0000 7f26f7e00640 1 --2- 172.21.15.120:0/695863743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26f8165990 0x7f26f806c030 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f26e0009c20 tx=0x7f26e001ee40 comp rx=0 tx=0).stop 2024-04-18T04:48:37.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.364+0000 7f26f7e00640 1 -- 172.21.15.120:0/695863743 shutdown_connections 2024-04-18T04:48:37.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.364+0000 7f26f7e00640 1 --2- 172.21.15.120:0/695863743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26f8165990 0x7f26f806c030 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:37.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.364+0000 7f26f7e00640 1 -- 172.21.15.120:0/695863743 >> 172.21.15.120:0/695863743 conn(0x7f26f806d000 msgr2=0x7f26f806d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:48:37.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.364+0000 7f26f7e00640 1 -- 172.21.15.120:0/695863743 shutdown_connections 2024-04-18T04:48:37.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.364+0000 7f26f7e00640 1 -- 172.21.15.120:0/695863743 wait complete. 2024-04-18T04:48:37.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.364+0000 7f26f7e00640 1 Processor -- start 2024-04-18T04:48:37.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.364+0000 7f26f7e00640 1 -- start start 2024-04-18T04:48:37.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.368+0000 7f26f7e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26f80c73d0 0x7f26f8159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:37.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.368+0000 7f26f7e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f26f8165990 0x7f26f8071ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:37.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.368+0000 7f26f7e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26f8166d80 0x7f26f8200460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:37.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.368+0000 7f26f7e00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f8168740 con 0x7f26f8165990 2024-04-18T04:48:37.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.368+0000 7f26f7e00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f815a000 con 0x7f26f80c73d0 2024-04-18T04:48:37.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.368+0000 7f26f7e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26f81fff60 con 0x7f26f8166d80 2024-04-18T04:48:37.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.368+0000 7f26f7400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26f8166d80 0x7f26f8200460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:37.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.368+0000 7f26f6a00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26f80c73d0 0x7f26f8159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:37.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.368+0000 7f26f7400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26f8166d80 0x7f26f8200460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:40868/0 (socket says 172.21.15.120:40868) 2024-04-18T04:48:37.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.368+0000 7f26f7400640 1 -- 172.21.15.120:0/3815645264 learned_addr learned my addr 172.21.15.120:0/3815645264 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:48:37.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.368+0000 7f26f7400640 1 -- 172.21.15.120:0/3815645264 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26f80c73d0 msgr2=0x7f26f8159a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:37.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.368+0000 7f26f7400640 1 --2- 172.21.15.120:0/3815645264 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26f80c73d0 0x7f26f8159a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:37.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.368+0000 7f26f7400640 1 -- 172.21.15.120:0/3815645264 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f26f8165990 msgr2=0x7f26f8071ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:37.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.368+0000 7f26f7400640 1 --2- 172.21.15.120:0/3815645264 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f26f8165990 0x7f26f8071ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:37.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.368+0000 7f26f7400640 1 -- 172.21.15.120:0/3815645264 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e0009900 con 0x7f26f8166d80 2024-04-18T04:48:37.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.368+0000 7f26f7400640 1 --2- 172.21.15.120:0/3815645264 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26f8166d80 0x7f26f8200460 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f26f0001570 tx=0x7f26f000cd20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:37.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.372+0000 7f26ef400640 1 -- 172.21.15.120:0/3815645264 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f0003db0 con 0x7f26f8166d80 2024-04-18T04:48:37.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.372+0000 7f26ef400640 1 -- 172.21.15.120:0/3815645264 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f0005070 con 0x7f26f8166d80 2024-04-18T04:48:37.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.372+0000 7f26ef400640 1 -- 172.21.15.120:0/3815645264 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f0005420 con 0x7f26f8166d80 2024-04-18T04:48:37.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.372+0000 7f26f7e00640 1 -- 172.21.15.120:0/3815645264 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26f81672b0 con 0x7f26f8166d80 2024-04-18T04:48:37.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.372+0000 7f26f7e00640 1 -- 172.21.15.120:0/3815645264 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26f8167870 con 0x7f26f8166d80 2024-04-18T04:48:37.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.372+0000 7f26f7e00640 1 -- 172.21.15.120:0/3815645264 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26f8200160 con 0x7f26f8166d80 2024-04-18T04:48:37.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.372+0000 7f26ef400640 1 -- 172.21.15.120:0/3815645264 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f26f0005580 con 0x7f26f8166d80 2024-04-18T04:48:37.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.376+0000 7f26ef400640 1 --2- 172.21.15.120:0/3815645264 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f26d4066690 0x7f26d4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:37.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.376+0000 7f26ef400640 1 -- 172.21.15.120:0/3815645264 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f26f0084070 con 0x7f26f8166d80 2024-04-18T04:48:37.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.376+0000 7f26f6a00640 1 --2- 172.21.15.120:0/3815645264 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f26d4066690 0x7f26d4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:37.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.380+0000 7f26f6a00640 1 --2- 172.21.15.120:0/3815645264 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f26d4066690 0x7f26d4068b50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f26e00b1000 tx=0x7f26e0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:37.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.384+0000 7f26ef400640 1 -- 172.21.15.120:0/3815645264 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f26f00b5be0 con 0x7f26f8166d80 2024-04-18T04:48:37.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.868+0000 7f26f7e00640 1 -- 172.21.15.120:0/3815645264 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f26f80728f0 con 0x7f26f8166d80 2024-04-18T04:48:37.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.872+0000 7f26ef400640 1 -- 172.21.15.120:0/3815645264 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+5532 (secure 0 0 0) 0x7f26f0017030 con 0x7f26f8166d80 2024-04-18T04:48:37.886 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:48:37.886 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:48:36.078278+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5130":{"gid":5130,"name":"c","rank":2,"incarnation":22,"state":"up:resolve","state_seq":17,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:48:37.887 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 23 2024-04-18T04:48:37.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.900+0000 7f26f7e00640 1 -- 172.21.15.120:0/3815645264 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f26d4066690 msgr2=0x7f26d4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:37.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.900+0000 7f26f7e00640 1 --2- 172.21.15.120:0/3815645264 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f26d4066690 0x7f26d4068b50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f26e00b1000 tx=0x7f26e0008040 comp rx=0 tx=0).stop 2024-04-18T04:48:37.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.900+0000 7f26f7e00640 1 -- 172.21.15.120:0/3815645264 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26f8166d80 msgr2=0x7f26f8200460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:37.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.900+0000 7f26f7e00640 1 --2- 172.21.15.120:0/3815645264 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26f8166d80 0x7f26f8200460 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f26f0001570 tx=0x7f26f000cd20 comp rx=0 tx=0).stop 2024-04-18T04:48:37.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.904+0000 7f26f7e00640 1 -- 172.21.15.120:0/3815645264 shutdown_connections 2024-04-18T04:48:37.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.904+0000 7f26f7e00640 1 --2- 172.21.15.120:0/3815645264 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f26d4066690 0x7f26d4068b50 secure :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f26e00b1000 tx=0x7f26e0008040 comp rx=0 tx=0).stop 2024-04-18T04:48:37.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.904+0000 7f26f7e00640 1 --2- 172.21.15.120:0/3815645264 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26f8166d80 0x7f26f8200460 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:37.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.904+0000 7f26f7e00640 1 --2- 172.21.15.120:0/3815645264 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f26f8165990 0x7f26f8071ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:37.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.904+0000 7f26f7e00640 1 --2- 172.21.15.120:0/3815645264 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26f80c73d0 0x7f26f8159a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:37.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.904+0000 7f26f7e00640 1 -- 172.21.15.120:0/3815645264 >> 172.21.15.120:0/3815645264 conn(0x7f26f806d000 msgr2=0x7f26f80c9550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:48:37.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.904+0000 7f26f7e00640 1 -- 172.21.15.120:0/3815645264 shutdown_connections 2024-04-18T04:48:37.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:37.904+0000 7f26f7e00640 1 -- 172.21.15.120:0/3815645264 wait complete. 2024-04-18T04:48:37.949 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:48:39.951 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:48:40.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.212+0000 7f097ec00640 1 Processor -- start 2024-04-18T04:48:40.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.216+0000 7f097ec00640 1 -- start start 2024-04-18T04:48:40.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.216+0000 7f097ec00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0978153620 0x7f09780c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:40.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.216+0000 7f097ec00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09780c4820 con 0x7f09780c9ac0 2024-04-18T04:48:40.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.216+0000 7f097ec00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0978159da0 con 0x7f0978153a00 2024-04-18T04:48:40.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.216+0000 7f097ec00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0978159b90 con 0x7f0978153620 2024-04-18T04:48:40.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.216+0000 7f097ce00640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f0978153a00 0x7f0978159480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:56190/0 (socket says 172.21.15.120:56190) 2024-04-18T04:48:40.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.216+0000 7f097ce00640 1 -- 172.21.15.120:0/2283301654 learned_addr learned my addr 172.21.15.120:0/2283301654 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:48:40.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.220+0000 7f097d800640 1 --2- 172.21.15.120:0/2283301654 >> v2:172.21.15.120:3300/0 conn(0x7f0978153620 0x7f09780c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:40.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.220+0000 7f0977e00640 1 -- 172.21.15.120:0/2283301654 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 83928698 0 0) 0x7f0978159da0 con 0x7f0978153a00 2024-04-18T04:48:40.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.220+0000 7f0977e00640 1 -- 172.21.15.120:0/2283301654 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0960003530 con 0x7f0978153a00 2024-04-18T04:48:40.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.220+0000 7f097d800640 1 -- 172.21.15.120:0/2283301654 >> v1:172.21.15.132:6789/0 conn(0x7f0978153a00 legacy=0x7f0978159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:40.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.220+0000 7f097d800640 1 -- 172.21.15.120:0/2283301654 >> v1:172.21.15.120:6789/0 conn(0x7f09780c9ac0 legacy=0x7f09780cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:40.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.220+0000 7f097d800640 1 -- 172.21.15.120:0/2283301654 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097815a080 con 0x7f0978153620 2024-04-18T04:48:40.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.240+0000 7f097d800640 1 --2- 172.21.15.120:0/2283301654 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0978153620 0x7f09780c52c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f096c0097c0 tx=0x7f096c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7ff8cf5f50471a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:40.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.248+0000 7f0977e00640 1 -- 172.21.15.120:0/2283301654 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096c0ab670 con 0x7f0978153620 2024-04-18T04:48:40.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.248+0000 7f0977e00640 1 -- 172.21.15.120:0/2283301654 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f096c0ab7d0 con 0x7f0978153620 2024-04-18T04:48:40.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.248+0000 7f0977e00640 1 -- 172.21.15.120:0/2283301654 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096c0abb60 con 0x7f0978153620 2024-04-18T04:48:40.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.252+0000 7f097ec00640 1 -- 172.21.15.120:0/2283301654 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0978153620 msgr2=0x7f09780c52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:40.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.252+0000 7f097ec00640 1 --2- 172.21.15.120:0/2283301654 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0978153620 0x7f09780c52c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f096c0097c0 tx=0x7f096c01c4b0 comp rx=0 tx=0).stop 2024-04-18T04:48:40.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.252+0000 7f097ec00640 1 -- 172.21.15.120:0/2283301654 shutdown_connections 2024-04-18T04:48:40.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.252+0000 7f097ec00640 1 --2- 172.21.15.120:0/2283301654 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0978153620 0x7f09780c52c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:40.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.252+0000 7f097ec00640 1 -- 172.21.15.120:0/2283301654 >> 172.21.15.120:0/2283301654 conn(0x7f0978065d90 msgr2=0x7f09780661a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:48:40.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.260+0000 7f097ec00640 1 -- 172.21.15.120:0/2283301654 shutdown_connections 2024-04-18T04:48:40.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.260+0000 7f097ec00640 1 -- 172.21.15.120:0/2283301654 wait complete. 2024-04-18T04:48:40.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.264+0000 7f097ec00640 1 Processor -- start 2024-04-18T04:48:40.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.264+0000 7f097ec00640 1 -- start start 2024-04-18T04:48:40.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.264+0000 7f097ec00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09780c9ac0 0x7f0978149400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:40.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.264+0000 7f097ec00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0978153620 0x7f0978157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:40.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.264+0000 7f097ec00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f09780c8190 0x7f09780c6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:40.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.264+0000 7f097ec00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09781541d0 con 0x7f09780c8190 2024-04-18T04:48:40.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.264+0000 7f097ec00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0978149940 con 0x7f09780c9ac0 2024-04-18T04:48:40.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.264+0000 7f097ec00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09780c7410 con 0x7f0978153620 2024-04-18T04:48:40.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.268+0000 7f097ce00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0978153620 0x7f0978157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:40.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.268+0000 7f097ce00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0978153620 0x7f0978157150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:40870/0 (socket says 172.21.15.120:40870) 2024-04-18T04:48:40.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.268+0000 7f097ce00640 1 -- 172.21.15.120:0/3446802419 learned_addr learned my addr 172.21.15.120:0/3446802419 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:48:40.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.268+0000 7f097d800640 1 --2- 172.21.15.120:0/3446802419 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09780c9ac0 0x7f0978149400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:40.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.272+0000 7f097ce00640 1 -- 172.21.15.120:0/3446802419 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09780c9ac0 msgr2=0x7f0978149400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:40.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.272+0000 7f097ce00640 1 --2- 172.21.15.120:0/3446802419 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09780c9ac0 0x7f0978149400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:40.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.272+0000 7f097ce00640 1 -- 172.21.15.120:0/3446802419 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f09780c8190 msgr2=0x7f09780c6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:40.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.272+0000 7f097d800640 1 --2- 172.21.15.120:0/3446802419 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09780c9ac0 0x7f0978149400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:48:40.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.272+0000 7f097ce00640 1 --2- 172.21.15.120:0/3446802419 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f09780c8190 0x7f09780c6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:40.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.272+0000 7f097ce00640 1 -- 172.21.15.120:0/3446802419 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f096c009420 con 0x7f0978153620 2024-04-18T04:48:40.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.272+0000 7f097ce00640 1 --2- 172.21.15.120:0/3446802419 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0978153620 0x7f0978157150 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f096400c420 tx=0x7f096400c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:40.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.272+0000 7f0975600640 1 -- 172.21.15.120:0/3446802419 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0964005cf0 con 0x7f0978153620 2024-04-18T04:48:40.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.272+0000 7f0975600640 1 -- 172.21.15.120:0/3446802419 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0964005e50 con 0x7f0978153620 2024-04-18T04:48:40.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.272+0000 7f0975600640 1 -- 172.21.15.120:0/3446802419 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09640072d0 con 0x7f0978153620 2024-04-18T04:48:40.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.272+0000 7f097ec00640 1 -- 172.21.15.120:0/3446802419 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09780c6d00 con 0x7f0978153620 2024-04-18T04:48:40.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.272+0000 7f097ec00640 1 -- 172.21.15.120:0/3446802419 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09780c76b0 con 0x7f0978153620 2024-04-18T04:48:40.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.272+0000 7f097ec00640 1 -- 172.21.15.120:0/3446802419 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0978067070 con 0x7f0978153620 2024-04-18T04:48:40.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.276+0000 7f0975600640 1 -- 172.21.15.120:0/3446802419 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0964007430 con 0x7f0978153620 2024-04-18T04:48:40.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.280+0000 7f0975600640 1 --2- 172.21.15.120:0/3446802419 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0958066690 0x7f0958068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:40.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.284+0000 7f0975600640 1 -- 172.21.15.120:0/3446802419 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f0964083c30 con 0x7f0978153620 2024-04-18T04:48:40.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.288+0000 7f097d800640 1 --2- 172.21.15.120:0/3446802419 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0958066690 0x7f0958068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:40.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.288+0000 7f097d800640 1 --2- 172.21.15.120:0/3446802419 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0958066690 0x7f0958068b50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f096c0af000 tx=0x7f096c0a7000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:40.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.292+0000 7f0975600640 1 -- 172.21.15.120:0/3446802419 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f0964050ab0 con 0x7f0978153620 2024-04-18T04:48:40.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.688+0000 7f097ec00640 1 -- 172.21.15.120:0/3446802419 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f097814a090 con 0x7f0978153620 2024-04-18T04:48:40.692 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:48:40.692 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:48:36.078278+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5130":{"gid":5130,"name":"c","rank":2,"incarnation":22,"state":"up:resolve","state_seq":17,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:48:40.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.692+0000 7f0975600640 1 -- 172.21.15.120:0/3446802419 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+5532 (secure 0 0 0) 0x7f0964017070 con 0x7f0978153620 2024-04-18T04:48:40.692 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 23 2024-04-18T04:48:40.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.696+0000 7f097ec00640 1 -- 172.21.15.120:0/3446802419 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0958066690 msgr2=0x7f0958068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:40.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.696+0000 7f097ec00640 1 --2- 172.21.15.120:0/3446802419 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0958066690 0x7f0958068b50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f096c0af000 tx=0x7f096c0a7000 comp rx=0 tx=0).stop 2024-04-18T04:48:40.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.696+0000 7f097ec00640 1 -- 172.21.15.120:0/3446802419 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0978153620 msgr2=0x7f0978157150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:40.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.696+0000 7f097ec00640 1 --2- 172.21.15.120:0/3446802419 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0978153620 0x7f0978157150 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f096400c420 tx=0x7f096400c8e0 comp rx=0 tx=0).stop 2024-04-18T04:48:40.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.696+0000 7f097ec00640 1 -- 172.21.15.120:0/3446802419 shutdown_connections 2024-04-18T04:48:40.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.696+0000 7f097ec00640 1 --2- 172.21.15.120:0/3446802419 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0958066690 0x7f0958068b50 secure :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f096c0af000 tx=0x7f096c0a7000 comp rx=0 tx=0).stop 2024-04-18T04:48:40.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.696+0000 7f097ec00640 1 --2- 172.21.15.120:0/3446802419 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f09780c8190 0x7f09780c6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:40.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.696+0000 7f097ec00640 1 --2- 172.21.15.120:0/3446802419 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0978153620 0x7f0978157150 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:40.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.696+0000 7f097ec00640 1 --2- 172.21.15.120:0/3446802419 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09780c9ac0 0x7f0978149400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:40.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.696+0000 7f097ec00640 1 -- 172.21.15.120:0/3446802419 >> 172.21.15.120:0/3446802419 conn(0x7f0978065d90 msgr2=0x7f0978150e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:48:40.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.696+0000 7f097ec00640 1 -- 172.21.15.120:0/3446802419 shutdown_connections 2024-04-18T04:48:40.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:40.696+0000 7f097ec00640 1 -- 172.21.15.120:0/3446802419 wait complete. 2024-04-18T04:48:40.772 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:48:42.772 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:48:43.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.040+0000 7f527de00640 1 Processor -- start 2024-04-18T04:48:43.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.040+0000 7f527de00640 1 -- start start 2024-04-18T04:48:43.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.044+0000 7f527de00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f52780c83e0 0x7f527806c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:43.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.044+0000 7f527de00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f52781562a0 0x7f52780c6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:43.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.044+0000 7f527de00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f527814f850 0x7f527806b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:43.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.044+0000 7f527de00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f527806cb30 con 0x7f52781562a0 2024-04-18T04:48:43.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.044+0000 7f527de00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52780c6f00 con 0x7f52780c83e0 2024-04-18T04:48:43.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.044+0000 7f527de00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52780c57c0 con 0x7f527814f850 2024-04-18T04:48:43.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.044+0000 7f5276a00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f52780c83e0 0x7f527806c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:43.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.044+0000 7f5276a00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f52780c83e0 0x7f527806c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:50412/0 (socket says 172.21.15.120:50412) 2024-04-18T04:48:43.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.048+0000 7f5276a00640 1 -- 172.21.15.120:0/1440554057 learned_addr learned my addr 172.21.15.120:0/1440554057 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:48:43.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.048+0000 7f5277400640 1 --2- 172.21.15.120:0/1440554057 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f527814f850 0x7f527806b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:43.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.052+0000 7f5276a00640 1 -- 172.21.15.120:0/1440554057 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f527814f850 msgr2=0x7f527806b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:48:43.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.052+0000 7f5276a00640 1 --2- 172.21.15.120:0/1440554057 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f527814f850 0x7f527806b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:43.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.052+0000 7f5276a00640 1 -- 172.21.15.120:0/1440554057 >> v2:172.21.15.120:3300/0 conn(0x7f52781562a0 msgr2=0x7f52780c6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:48:43.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.052+0000 7f5276a00640 1 --2- 172.21.15.120:0/1440554057 >> v2:172.21.15.120:3300/0 conn(0x7f52781562a0 0x7f52780c6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:43.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.052+0000 7f5276a00640 1 -- 172.21.15.120:0/1440554057 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52780c5d80 con 0x7f52780c83e0 2024-04-18T04:48:43.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.072+0000 7f5276a00640 1 --2- 172.21.15.120:0/1440554057 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52780c83e0 0x7f527806c5f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5278073f20 tx=0x7f526801ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8518206fd1cfbdf server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:43.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.072+0000 7f5275600640 1 -- 172.21.15.120:0/1440554057 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52680a89d0 con 0x7f52780c83e0 2024-04-18T04:48:43.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.072+0000 7f5275600640 1 -- 172.21.15.120:0/1440554057 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52680a8b30 con 0x7f52780c83e0 2024-04-18T04:48:43.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.072+0000 7f5275600640 1 -- 172.21.15.120:0/1440554057 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52680b0440 con 0x7f52780c83e0 2024-04-18T04:48:43.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.072+0000 7f527de00640 1 -- 172.21.15.120:0/1440554057 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52780c83e0 msgr2=0x7f527806c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:43.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.072+0000 7f527de00640 1 --2- 172.21.15.120:0/1440554057 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52780c83e0 0x7f527806c5f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5278073f20 tx=0x7f526801ed30 comp rx=0 tx=0).stop 2024-04-18T04:48:43.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.072+0000 7f527de00640 1 -- 172.21.15.120:0/1440554057 shutdown_connections 2024-04-18T04:48:43.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.072+0000 7f527de00640 1 --2- 172.21.15.120:0/1440554057 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f527814f850 0x7f527806b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:43.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.072+0000 7f527de00640 1 --2- 172.21.15.120:0/1440554057 >> v2:172.21.15.120:3300/0 conn(0x7f52781562a0 0x7f52780c6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:43.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.072+0000 7f527de00640 1 --2- 172.21.15.120:0/1440554057 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52780c83e0 0x7f527806c5f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:43.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.072+0000 7f527de00640 1 -- 172.21.15.120:0/1440554057 >> 172.21.15.120:0/1440554057 conn(0x7f52780c78c0 msgr2=0x7f52780c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:48:43.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.072+0000 7f527de00640 1 -- 172.21.15.120:0/1440554057 shutdown_connections 2024-04-18T04:48:43.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.072+0000 7f527de00640 1 -- 172.21.15.120:0/1440554057 wait complete. 2024-04-18T04:48:43.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.076+0000 7f527de00640 1 Processor -- start 2024-04-18T04:48:43.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.076+0000 7f527de00640 1 -- start start 2024-04-18T04:48:43.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.076+0000 7f527de00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f52780c83e0 0x7f5278153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:43.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.076+0000 7f527de00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f527814f850 0x7f52781576b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:43.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.080+0000 7f527de00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52781562a0 0x7f5278157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:43.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.080+0000 7f527de00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5278156980 con 0x7f52781562a0 2024-04-18T04:48:43.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.080+0000 7f527de00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52781398e0 con 0x7f527814f850 2024-04-18T04:48:43.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.080+0000 7f527de00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5278139bc0 con 0x7f52780c83e0 2024-04-18T04:48:43.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.080+0000 7f5276a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f52780c83e0 0x7f5278153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:43.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.080+0000 7f5276a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f52780c83e0 0x7f5278153e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:42900/0 (socket says 172.21.15.120:42900) 2024-04-18T04:48:43.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.080+0000 7f5276a00640 1 -- 172.21.15.120:0/3341437479 learned_addr learned my addr 172.21.15.120:0/3341437479 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:48:43.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.080+0000 7f5276a00640 1 -- 172.21.15.120:0/3341437479 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f527814f850 msgr2=0x7f52781576b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-18T04:48:43.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.080+0000 7f5276a00640 1 --2- 172.21.15.120:0/3341437479 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f527814f850 0x7f52781576b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:43.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.080+0000 7f5276a00640 1 -- 172.21.15.120:0/3341437479 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52781562a0 msgr2=0x7f5278157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:43.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.080+0000 7f5276a00640 1 --2- 172.21.15.120:0/3341437479 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52781562a0 0x7f5278157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:43.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.080+0000 7f5276a00640 1 -- 172.21.15.120:0/3341437479 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52680094d0 con 0x7f52780c83e0 2024-04-18T04:48:43.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.084+0000 7f5276a00640 1 --2- 172.21.15.120:0/3341437479 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f52780c83e0 0x7f5278153e30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f526801c960 tx=0x7f526801bad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:43.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.084+0000 7f526f400640 1 -- 172.21.15.120:0/3341437479 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52680b0db0 con 0x7f52780c83e0 2024-04-18T04:48:43.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.084+0000 7f526f400640 1 -- 172.21.15.120:0/3341437479 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52680ba440 con 0x7f52780c83e0 2024-04-18T04:48:43.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.084+0000 7f526f400640 1 -- 172.21.15.120:0/3341437479 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52680ba7d0 con 0x7f52780c83e0 2024-04-18T04:48:43.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.084+0000 7f527de00640 1 -- 172.21.15.120:0/3341437479 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5278156bd0 con 0x7f52780c83e0 2024-04-18T04:48:43.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.088+0000 7f527de00640 1 -- 172.21.15.120:0/3341437479 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5278157190 con 0x7f52780c83e0 2024-04-18T04:48:43.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.096+0000 7f526f400640 1 -- 172.21.15.120:0/3341437479 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f52680ba930 con 0x7f52780c83e0 2024-04-18T04:48:43.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.100+0000 7f527de00640 1 -- 172.21.15.120:0/3341437479 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52781573b0 con 0x7f52780c83e0 2024-04-18T04:48:43.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.100+0000 7f526f400640 1 --2- 172.21.15.120:0/3341437479 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f5258066790 0x7f5258068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:43.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.100+0000 7f526f400640 1 -- 172.21.15.120:0/3341437479 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f52681221b0 con 0x7f52780c83e0 2024-04-18T04:48:43.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.100+0000 7f5276000640 1 --2- 172.21.15.120:0/3341437479 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f5258066790 0x7f5258068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:43.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.104+0000 7f5276000640 1 --2- 172.21.15.120:0/3341437479 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f5258066790 0x7f5258068c50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5278155200 tx=0x7f5264006c30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:43.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.120+0000 7f526f400640 1 -- 172.21.15.120:0/3341437479 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f52680ef120 con 0x7f52780c83e0 2024-04-18T04:48:43.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.619+0000 7f527de00640 1 -- 172.21.15.120:0/3341437479 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5278072a70 con 0x7f52780c83e0 2024-04-18T04:48:43.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.619+0000 7f526f400640 1 -- 172.21.15.120:0/3341437479 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+5534 (secure 0 0 0) 0x7f52680ef120 con 0x7f52780c83e0 2024-04-18T04:48:43.621 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:48:43.621 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:48:41.150321+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5130":{"gid":5130,"name":"c","rank":2,"incarnation":22,"state":"up:reconnect","state_seq":19,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:48:43.622 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 24 2024-04-18T04:48:43.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.623+0000 7f527de00640 1 -- 172.21.15.120:0/3341437479 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f5258066790 msgr2=0x7f5258068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:43.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.623+0000 7f527de00640 1 --2- 172.21.15.120:0/3341437479 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f5258066790 0x7f5258068c50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5278155200 tx=0x7f5264006c30 comp rx=0 tx=0).stop 2024-04-18T04:48:43.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.623+0000 7f527de00640 1 -- 172.21.15.120:0/3341437479 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f52780c83e0 msgr2=0x7f5278153e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:43.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.623+0000 7f527de00640 1 --2- 172.21.15.120:0/3341437479 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f52780c83e0 0x7f5278153e30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f526801c960 tx=0x7f526801bad0 comp rx=0 tx=0).stop 2024-04-18T04:48:43.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.623+0000 7f527de00640 1 -- 172.21.15.120:0/3341437479 shutdown_connections 2024-04-18T04:48:43.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.623+0000 7f527de00640 1 --2- 172.21.15.120:0/3341437479 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f5258066790 0x7f5258068c50 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:43.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.623+0000 7f527de00640 1 --2- 172.21.15.120:0/3341437479 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52781562a0 0x7f5278157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:43.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.623+0000 7f527de00640 1 --2- 172.21.15.120:0/3341437479 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f527814f850 0x7f52781576b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:43.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.623+0000 7f527de00640 1 --2- 172.21.15.120:0/3341437479 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f52780c83e0 0x7f5278153e30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:43.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.623+0000 7f527de00640 1 -- 172.21.15.120:0/3341437479 >> 172.21.15.120:0/3341437479 conn(0x7f52780c78c0 msgr2=0x7f527806b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:48:43.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.631+0000 7f527de00640 1 -- 172.21.15.120:0/3341437479 shutdown_connections 2024-04-18T04:48:43.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:43.631+0000 7f527de00640 1 -- 172.21.15.120:0/3341437479 wait complete. 2024-04-18T04:48:43.695 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:48:45.696 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:48:46.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.035+0000 7ff75b200640 1 Processor -- start 2024-04-18T04:48:46.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.035+0000 7ff75b200640 1 -- start start 2024-04-18T04:48:46.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.035+0000 7ff75b200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff75c165990 0x7ff75c06c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:46.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.035+0000 7ff75b200640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff75c0c73d0 0x7ff75c0c65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:46.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.035+0000 7ff75b200640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff75c0c6150 con 0x7ff75c1696c0 2024-04-18T04:48:46.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.035+0000 7ff75b200640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff75c06fe60 con 0x7ff75c0c73d0 2024-04-18T04:48:46.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.035+0000 7ff75b200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff75c0c5860 con 0x7ff75c165990 2024-04-18T04:48:46.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.039+0000 7ff759e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff75c165990 0x7ff75c06c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:46.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.039+0000 7ff759e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff75c165990 0x7ff75c06c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:42902/0 (socket says 172.21.15.120:42902) 2024-04-18T04:48:46.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.039+0000 7ff759e00640 1 -- 172.21.15.120:0/231191729 learned_addr learned my addr 172.21.15.120:0/231191729 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:48:46.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.047+0000 7ff758a00640 1 -- 172.21.15.120:0/231191729 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2492724042 0 0) 0x7ff75c0c6150 con 0x7ff75c1696c0 2024-04-18T04:48:46.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.339+0000 7ff758a00640 1 -- 172.21.15.120:0/231191729 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff740003980 con 0x7ff75c1696c0 2024-04-18T04:48:46.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.039+0000 7ff759400640 1 --2- 172.21.15.120:0/231191729 >> v2:172.21.15.132:3300/0 conn(0x7ff75c0c73d0 0x7ff75c0c65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:46.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.339+0000 7ff759e00640 1 -- 172.21.15.120:0/231191729 >> v2:172.21.15.132:3300/0 conn(0x7ff75c0c73d0 msgr2=0x7ff75c0c65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:48:46.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.339+0000 7ff759e00640 1 --2- 172.21.15.120:0/231191729 >> v2:172.21.15.132:3300/0 conn(0x7ff75c0c73d0 0x7ff75c0c65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:46.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.339+0000 7ff759e00640 1 -- 172.21.15.120:0/231191729 >> v1:172.21.15.120:6789/0 conn(0x7ff75c1696c0 legacy=0x7ff75c169af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:46.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.339+0000 7ff759e00640 1 -- 172.21.15.120:0/231191729 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff75c06c670 con 0x7ff75c165990 2024-04-18T04:48:46.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.351+0000 7ff759e00640 1 --2- 172.21.15.120:0/231191729 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff75c165990 0x7ff75c06c030 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff748009870 tx=0x7ff74801fe60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=625471472261c0a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:46.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.351+0000 7ff758a00640 1 -- 172.21.15.120:0/231191729 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7480a9b60 con 0x7ff75c165990 2024-04-18T04:48:46.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.351+0000 7ff758a00640 1 -- 172.21.15.120:0/231191729 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7480a9cc0 con 0x7ff75c165990 2024-04-18T04:48:46.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.351+0000 7ff758a00640 1 -- 172.21.15.120:0/231191729 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7480b1660 con 0x7ff75c165990 2024-04-18T04:48:46.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.355+0000 7ff75b200640 1 -- 172.21.15.120:0/231191729 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff75c165990 msgr2=0x7ff75c06c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:46.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.355+0000 7ff75b200640 1 --2- 172.21.15.120:0/231191729 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff75c165990 0x7ff75c06c030 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff748009870 tx=0x7ff74801fe60 comp rx=0 tx=0).stop 2024-04-18T04:48:46.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.355+0000 7ff75b200640 1 -- 172.21.15.120:0/231191729 shutdown_connections 2024-04-18T04:48:46.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.355+0000 7ff75b200640 1 --2- 172.21.15.120:0/231191729 >> v2:172.21.15.132:3300/0 conn(0x7ff75c0c73d0 0x7ff75c0c65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:46.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.355+0000 7ff75b200640 1 --2- 172.21.15.120:0/231191729 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff75c165990 0x7ff75c06c030 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:46.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.355+0000 7ff75b200640 1 -- 172.21.15.120:0/231191729 >> 172.21.15.120:0/231191729 conn(0x7ff75c06d000 msgr2=0x7ff75c06d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:48:46.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.355+0000 7ff75b200640 1 -- 172.21.15.120:0/231191729 shutdown_connections 2024-04-18T04:48:46.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.355+0000 7ff75b200640 1 -- 172.21.15.120:0/231191729 wait complete. 2024-04-18T04:48:46.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.359+0000 7ff75b200640 1 Processor -- start 2024-04-18T04:48:46.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.359+0000 7ff75b200640 1 -- start start 2024-04-18T04:48:46.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.359+0000 7ff75b200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff75c0c73d0 0x7ff75c0c24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:46.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.359+0000 7ff75b200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff75c165990 0x7ff75c15da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:46.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.363+0000 7ff75b200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff75c1696c0 0x7ff75c1ff0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:46.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.363+0000 7ff75b200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff75c0c2a00 con 0x7ff75c0c73d0 2024-04-18T04:48:46.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.363+0000 7ff75b200640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff75c1fc350 con 0x7ff75c1696c0 2024-04-18T04:48:46.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.363+0000 7ff75b200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff75c1fe940 con 0x7ff75c165990 2024-04-18T04:48:46.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.363+0000 7ff759e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff75c0c73d0 0x7ff75c0c24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:46.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.363+0000 7ff759e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff75c0c73d0 0x7ff75c0c24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45064/0 (socket says 172.21.15.120:45064) 2024-04-18T04:48:46.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.363+0000 7ff759e00640 1 -- 172.21.15.120:0/647245771 learned_addr learned my addr 172.21.15.120:0/647245771 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:48:46.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.363+0000 7ff759e00640 1 -- 172.21.15.120:0/647245771 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff75c165990 msgr2=0x7ff75c15da30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-18T04:48:46.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.363+0000 7ff759e00640 1 --2- 172.21.15.120:0/647245771 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff75c165990 0x7ff75c15da30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:46.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.363+0000 7ff759e00640 1 -- 172.21.15.120:0/647245771 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff75c1696c0 msgr2=0x7ff75c1ff0b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-18T04:48:46.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.363+0000 7ff759e00640 1 --2- 172.21.15.120:0/647245771 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff75c1696c0 0x7ff75c1ff0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:46.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.363+0000 7ff759e00640 1 -- 172.21.15.120:0/647245771 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7480094d0 con 0x7ff75c0c73d0 2024-04-18T04:48:46.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.367+0000 7ff759e00640 1 --2- 172.21.15.120:0/647245771 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff75c0c73d0 0x7ff75c0c24c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff7480b4040 tx=0x7ff74801cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:46.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.367+0000 7ff752000640 1 -- 172.21.15.120:0/647245771 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7480c0070 con 0x7ff75c0c73d0 2024-04-18T04:48:46.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.367+0000 7ff752000640 1 -- 172.21.15.120:0/647245771 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7480b2be0 con 0x7ff75c0c73d0 2024-04-18T04:48:46.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.367+0000 7ff75b200640 1 -- 172.21.15.120:0/647245771 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff75c1fbdf0 con 0x7ff75c0c73d0 2024-04-18T04:48:46.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.371+0000 7ff752000640 1 -- 172.21.15.120:0/647245771 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7480bc480 con 0x7ff75c0c73d0 2024-04-18T04:48:46.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.371+0000 7ff75b200640 1 -- 172.21.15.120:0/647245771 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff75c167720 con 0x7ff75c0c73d0 2024-04-18T04:48:46.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.375+0000 7ff752000640 1 -- 172.21.15.120:0/647245771 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff7480c5410 con 0x7ff75c0c73d0 2024-04-18T04:48:46.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.375+0000 7ff747400640 1 -- 172.21.15.120:0/647245771 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff75c0728f0 con 0x7ff75c0c73d0 2024-04-18T04:48:46.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.375+0000 7ff752000640 1 --2- 172.21.15.120:0/647245771 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff73c066710 0x7ff73c068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:46.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.383+0000 7ff752000640 1 -- 172.21.15.120:0/647245771 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6835+0+0 (secure 0 0 0) 0x7ff748122110 con 0x7ff75c0c73d0 2024-04-18T04:48:46.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.383+0000 7ff759400640 1 --2- 172.21.15.120:0/647245771 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff73c066710 0x7ff73c068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:46.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.383+0000 7ff759400640 1 --2- 172.21.15.120:0/647245771 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff73c066710 0x7ff73c068bd0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff75c1614e0 tx=0x7ff754009790 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:46.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.391+0000 7ff752000640 1 -- 172.21.15.120:0/647245771 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7ff7480ef000 con 0x7ff75c0c73d0 2024-04-18T04:48:46.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.963+0000 7ff747400640 1 -- 172.21.15.120:0/647245771 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff75c06aed0 con 0x7ff75c0c73d0 2024-04-18T04:48:46.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.971+0000 7ff752000640 1 -- 172.21.15.120:0/647245771 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+5531 (secure 0 0 0) 0x7ff7480ef000 con 0x7ff75c0c73d0 2024-04-18T04:48:46.976 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:48:46.976 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:48:46.242654+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5130":{"gid":5130,"name":"c","rank":2,"incarnation":22,"state":"up:rejoin","state_seq":21,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:48:46.976 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 25 2024-04-18T04:48:46.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.979+0000 7ff747400640 1 -- 172.21.15.120:0/647245771 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff73c066710 msgr2=0x7ff73c068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:46.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.979+0000 7ff747400640 1 --2- 172.21.15.120:0/647245771 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff73c066710 0x7ff73c068bd0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff75c1614e0 tx=0x7ff754009790 comp rx=0 tx=0).stop 2024-04-18T04:48:46.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.979+0000 7ff747400640 1 -- 172.21.15.120:0/647245771 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff75c0c73d0 msgr2=0x7ff75c0c24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:46.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.979+0000 7ff747400640 1 --2- 172.21.15.120:0/647245771 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff75c0c73d0 0x7ff75c0c24c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff7480b4040 tx=0x7ff74801cc00 comp rx=0 tx=0).stop 2024-04-18T04:48:46.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.979+0000 7ff747400640 1 -- 172.21.15.120:0/647245771 shutdown_connections 2024-04-18T04:48:46.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.979+0000 7ff747400640 1 --2- 172.21.15.120:0/647245771 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff73c066710 0x7ff73c068bd0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:46.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.979+0000 7ff747400640 1 --2- 172.21.15.120:0/647245771 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff75c1696c0 0x7ff75c1ff0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:46.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.979+0000 7ff747400640 1 --2- 172.21.15.120:0/647245771 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff75c165990 0x7ff75c15da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:46.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.979+0000 7ff747400640 1 --2- 172.21.15.120:0/647245771 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff75c0c73d0 0x7ff75c0c24c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:46.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.979+0000 7ff747400640 1 -- 172.21.15.120:0/647245771 >> 172.21.15.120:0/647245771 conn(0x7ff75c06d000 msgr2=0x7ff75c0c9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:48:46.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.979+0000 7ff747400640 1 -- 172.21.15.120:0/647245771 shutdown_connections 2024-04-18T04:48:46.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:46.979+0000 7ff747400640 1 -- 172.21.15.120:0/647245771 wait complete. 2024-04-18T04:48:47.031 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:48:49.032 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:48:49.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.287+0000 7f544c800640 1 Processor -- start 2024-04-18T04:48:49.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.287+0000 7f544c800640 1 -- start start 2024-04-18T04:48:49.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.291+0000 7f544c800640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f54440c7430 0x7f5444070e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:49.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.291+0000 7f544c800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f544406be60 0x7f544406c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:49.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.291+0000 7f544c800640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5444071510 con 0x7f544415ae00 2024-04-18T04:48:49.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.291+0000 7f544c800640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5444070300 con 0x7f54440c7430 2024-04-18T04:48:49.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.291+0000 7f544c800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f544406b9d0 con 0x7f544406be60 2024-04-18T04:48:49.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.291+0000 7f544a800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f544406be60 0x7f544406c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:49.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.291+0000 7f5449e00640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f544415ae00 0x7f544415b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:58234/0 (socket says 172.21.15.120:58234) 2024-04-18T04:48:49.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.291+0000 7f5449e00640 1 -- 172.21.15.120:0/1149944380 learned_addr learned my addr 172.21.15.120:0/1149944380 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:48:49.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.291+0000 7f544a800640 1 -- 172.21.15.120:0/1149944380 >> v2:172.21.15.120:3300/0 conn(0x7f54440c7430 msgr2=0x7f5444070e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:48:49.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.291+0000 7f544a800640 1 --2- 172.21.15.120:0/1149944380 >> v2:172.21.15.120:3300/0 conn(0x7f54440c7430 0x7f5444070e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:49.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.291+0000 7f544a800640 1 -- 172.21.15.120:0/1149944380 >> v1:172.21.15.132:6789/0 conn(0x7f544415ae00 legacy=0x7f544415b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:49.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.291+0000 7f544a800640 1 -- 172.21.15.120:0/1149944380 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f544406c850 con 0x7f544406be60 2024-04-18T04:48:49.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.299+0000 7f544a800640 1 --2- 172.21.15.120:0/1149944380 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f544406be60 0x7f544406c310 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5440009d90 tx=0x7f544001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b70281812f0e0da server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:49.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.299+0000 7f5448a00640 1 -- 172.21.15.120:0/1149944380 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54400a5940 con 0x7f544406be60 2024-04-18T04:48:49.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.299+0000 7f5448a00640 1 -- 172.21.15.120:0/1149944380 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54400a5aa0 con 0x7f544406be60 2024-04-18T04:48:49.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.299+0000 7f5448a00640 1 -- 172.21.15.120:0/1149944380 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54400a5e30 con 0x7f544406be60 2024-04-18T04:48:49.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.311+0000 7f544c800640 1 -- 172.21.15.120:0/1149944380 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f544406be60 msgr2=0x7f544406c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:49.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.311+0000 7f544c800640 1 --2- 172.21.15.120:0/1149944380 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f544406be60 0x7f544406c310 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5440009d90 tx=0x7f544001c970 comp rx=0 tx=0).stop 2024-04-18T04:48:49.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.311+0000 7f544c800640 1 -- 172.21.15.120:0/1149944380 shutdown_connections 2024-04-18T04:48:49.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.311+0000 7f544c800640 1 --2- 172.21.15.120:0/1149944380 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f544406be60 0x7f544406c310 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:49.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.311+0000 7f544c800640 1 --2- 172.21.15.120:0/1149944380 >> v2:172.21.15.120:3300/0 conn(0x7f54440c7430 0x7f5444070e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:49.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.311+0000 7f544c800640 1 -- 172.21.15.120:0/1149944380 >> 172.21.15.120:0/1149944380 conn(0x7f54440c78c0 msgr2=0x7f54440c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:48:49.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.315+0000 7f544c800640 1 -- 172.21.15.120:0/1149944380 shutdown_connections 2024-04-18T04:48:49.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.315+0000 7f544c800640 1 -- 172.21.15.120:0/1149944380 wait complete. 2024-04-18T04:48:49.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.327+0000 7f544c800640 1 Processor -- start 2024-04-18T04:48:49.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.327+0000 7f544c800640 1 -- start start 2024-04-18T04:48:49.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.335+0000 7f544c800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f544406be60 0x7f5444156900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:49.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.335+0000 7f544c800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54440c7430 0x7f544414b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:49.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.335+0000 7f544c800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f544415ae00 0x7f544414b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:49.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.335+0000 7f544c800640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5444155a90 con 0x7f54440c7430 2024-04-18T04:48:49.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.335+0000 7f544c800640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544414d230 con 0x7f544415ae00 2024-04-18T04:48:49.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.335+0000 7f544c800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54440c9b80 con 0x7f544406be60 2024-04-18T04:48:49.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.335+0000 7f5449e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f544406be60 0x7f5444156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:49.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.335+0000 7f5449e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f544406be60 0x7f5444156900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:42920/0 (socket says 172.21.15.120:42920) 2024-04-18T04:48:49.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.335+0000 7f5449e00640 1 -- 172.21.15.120:0/2673739732 learned_addr learned my addr 172.21.15.120:0/2673739732 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:48:49.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.335+0000 7f5449e00640 1 -- 172.21.15.120:0/2673739732 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f544415ae00 msgr2=0x7f544414b710 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:48:49.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.335+0000 7f5449e00640 1 --2- 172.21.15.120:0/2673739732 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f544415ae00 0x7f544414b710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:49.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.335+0000 7f5449e00640 1 -- 172.21.15.120:0/2673739732 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54440c7430 msgr2=0x7f544414b1d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:48:49.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.339+0000 7f5449e00640 1 --2- 172.21.15.120:0/2673739732 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54440c7430 0x7f544414b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:49.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.339+0000 7f5449e00640 1 -- 172.21.15.120:0/2673739732 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5440009a70 con 0x7f544406be60 2024-04-18T04:48:49.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.339+0000 7f5449e00640 1 --2- 172.21.15.120:0/2673739732 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f544406be60 0x7f5444156900 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f543800c400 tx=0x7f543800c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:49.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.339+0000 7f543e000640 1 -- 172.21.15.120:0/2673739732 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5438005cf0 con 0x7f544406be60 2024-04-18T04:48:49.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.339+0000 7f543e000640 1 -- 172.21.15.120:0/2673739732 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5438005e50 con 0x7f544406be60 2024-04-18T04:48:49.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.343+0000 7f543e000640 1 -- 172.21.15.120:0/2673739732 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54380072d0 con 0x7f544406be60 2024-04-18T04:48:49.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.343+0000 7f544c800640 1 -- 172.21.15.120:0/2673739732 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54440c9e40 con 0x7f544406be60 2024-04-18T04:48:49.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.343+0000 7f544c800640 1 -- 172.21.15.120:0/2673739732 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f544414cbe0 con 0x7f544406be60 2024-04-18T04:48:49.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.351+0000 7f544c800640 1 -- 172.21.15.120:0/2673739732 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f544414c9f0 con 0x7f544406be60 2024-04-18T04:48:49.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.359+0000 7f543e000640 1 -- 172.21.15.120:0/2673739732 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5438007430 con 0x7f544406be60 2024-04-18T04:48:49.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.359+0000 7f543e000640 1 --2- 172.21.15.120:0/2673739732 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f5428066760 0x7f5428068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:49.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.359+0000 7f543e000640 1 -- 172.21.15.120:0/2673739732 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f5438083af0 con 0x7f544406be60 2024-04-18T04:48:49.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.363+0000 7f5449400640 1 --2- 172.21.15.120:0/2673739732 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f5428066760 0x7f5428068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:49.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.367+0000 7f5449400640 1 --2- 172.21.15.120:0/2673739732 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f5428066760 0x7f5428068c20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f54440c91e0 tx=0x7f5434006ca0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:49.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.367+0000 7f543e000640 1 -- 172.21.15.120:0/2673739732 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f5438054510 con 0x7f544406be60 2024-04-18T04:48:49.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.911+0000 7f544c800640 1 -- 172.21.15.120:0/2673739732 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5444072a70 con 0x7f544406be60 2024-04-18T04:48:49.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.911+0000 7f543e000640 1 -- 172.21.15.120:0/2673739732 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+5531 (secure 0 0 0) 0x7f54380540a0 con 0x7f544406be60 2024-04-18T04:48:49.915 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:48:49.915 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:48:46.242654+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5130":{"gid":5130,"name":"c","rank":2,"incarnation":22,"state":"up:rejoin","state_seq":21,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:48:49.915 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 25 2024-04-18T04:48:49.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.915+0000 7f544c800640 1 -- 172.21.15.120:0/2673739732 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f5428066760 msgr2=0x7f5428068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:49.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.915+0000 7f544c800640 1 --2- 172.21.15.120:0/2673739732 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f5428066760 0x7f5428068c20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f54440c91e0 tx=0x7f5434006ca0 comp rx=0 tx=0).stop 2024-04-18T04:48:49.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.915+0000 7f544c800640 1 -- 172.21.15.120:0/2673739732 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f544406be60 msgr2=0x7f5444156900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:49.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.915+0000 7f544c800640 1 --2- 172.21.15.120:0/2673739732 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f544406be60 0x7f5444156900 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f543800c400 tx=0x7f543800c8c0 comp rx=0 tx=0).stop 2024-04-18T04:48:49.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.915+0000 7f544c800640 1 -- 172.21.15.120:0/2673739732 shutdown_connections 2024-04-18T04:48:49.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.915+0000 7f544c800640 1 --2- 172.21.15.120:0/2673739732 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f5428066760 0x7f5428068c20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:49.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.915+0000 7f544c800640 1 --2- 172.21.15.120:0/2673739732 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f544415ae00 0x7f544414b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:49.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.915+0000 7f544c800640 1 --2- 172.21.15.120:0/2673739732 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54440c7430 0x7f544414b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:49.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.915+0000 7f544c800640 1 --2- 172.21.15.120:0/2673739732 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f544406be60 0x7f5444156900 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:49.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.915+0000 7f544c800640 1 -- 172.21.15.120:0/2673739732 >> 172.21.15.120:0/2673739732 conn(0x7f54440c78c0 msgr2=0x7f544415b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:48:49.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.915+0000 7f544c800640 1 -- 172.21.15.120:0/2673739732 shutdown_connections 2024-04-18T04:48:49.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:49.915+0000 7f544c800640 1 -- 172.21.15.120:0/2673739732 wait complete. 2024-04-18T04:48:49.948 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 25, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-18T04:44:30.251235+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 25, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1, 2 ], "info": { "gid_4275": { "addr": "172.21.15.120:6836/1079090700", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6834", "nonce": 1079090700, "type": "v2" }, { "addr": "172.21.15.120:6836", "nonce": 1079090700, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4275, "incarnation": 10, "join_fscid": -1, "name": "a", "rank": 1, "state": "up:active", "state_seq": 11 }, "gid_4288": { "addr": "172.21.15.120:6837/76856194", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6835", "nonce": 76856194, "type": "v2" }, { "addr": "172.21.15.120:6837", "nonce": 76856194, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4288, "incarnation": 4, "join_fscid": -1, "name": "e", "rank": 0, "state": "up:active", "state_seq": 4 }, "gid_5130": { "addr": "172.21.15.120:6833/4067927368", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6832", "nonce": 4067927368, "type": "v2" }, { "addr": "172.21.15.120:6833", "nonce": 4067927368, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5130, "incarnation": 22, "join_fscid": -1, "name": "c", "rank": 2, "state": "up:rejoin", "state_seq": 21 } }, "last_failure": 0, "last_failure_osd_epoch": 29, "max_file_size": 1099511627776, "max_mds": 3, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-18T04:48:46.242654+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4288, "mds_1": 4275, "mds_2": 5130 } } } ], "standbys": [ { "addr": "172.21.15.132:6839/4292136288", "addrs": { "addrvec": [ { "addr": "172.21.15.132:6836", "nonce": 4292136288, "type": "v2" }, { "addr": "172.21.15.132:6839", "nonce": 4292136288, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4241, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.132:6838/1712856922", "addrs": { "addrvec": [ { "addr": "172.21.15.132:6837", "nonce": 1712856922, "type": "v2" }, { "addr": "172.21.15.132:6838", "nonce": 1712856922, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 2, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4244, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-18T04:48:51.950 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:48:52.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.363+0000 7ff14b200640 1 Processor -- start 2024-04-18T04:48:52.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.363+0000 7ff14b200640 1 -- start start 2024-04-18T04:48:52.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.375+0000 7ff14b200640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff14c156270 0x7ff14c1566a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:52.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.375+0000 7ff14b200640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff14c156be0 con 0x7ff14c0b0c40 2024-04-18T04:48:52.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.375+0000 7ff14b200640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff14c0c0880 con 0x7ff14c150670 2024-04-18T04:48:52.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.375+0000 7ff14b200640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff14c150a50 con 0x7ff14c156270 2024-04-18T04:48:52.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.375+0000 7ff149e00640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff14c150670 0x7ff14c06db20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:41100/0 (socket says 172.21.15.120:41100) 2024-04-18T04:48:52.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.375+0000 7ff149e00640 1 -- 172.21.15.120:0/2427683717 learned_addr learned my addr 172.21.15.120:0/2427683717 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:48:52.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.375+0000 7ff14a800640 1 --2- 172.21.15.120:0/2427683717 >> v2:172.21.15.132:3300/0 conn(0x7ff14c156270 0x7ff14c1566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:52.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.379+0000 7ff148a00640 1 -- 172.21.15.120:0/2427683717 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1342886616 0 0) 0x7ff13c001120 con 0x7ff14c150670 2024-04-18T04:48:52.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.379+0000 7ff148a00640 1 -- 172.21.15.120:0/2427683717 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff130003530 con 0x7ff14c150670 2024-04-18T04:48:52.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.379+0000 7ff148a00640 1 -- 172.21.15.120:0/2427683717 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2010439929 0 0) 0x7ff14c156be0 con 0x7ff14c0b0c40 2024-04-18T04:48:52.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.379+0000 7ff148a00640 1 -- 172.21.15.120:0/2427683717 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff13c001120 con 0x7ff14c0b0c40 2024-04-18T04:48:52.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.379+0000 7ff148a00640 1 -- 172.21.15.120:0/2427683717 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1525655804 0 0) 0x7ff13c001120 con 0x7ff14c0b0c40 2024-04-18T04:48:52.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.379+0000 7ff148a00640 1 -- 172.21.15.120:0/2427683717 >> v2:172.21.15.132:3300/0 conn(0x7ff14c156270 msgr2=0x7ff14c1566a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:48:52.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.379+0000 7ff148a00640 1 --2- 172.21.15.120:0/2427683717 >> v2:172.21.15.132:3300/0 conn(0x7ff14c156270 0x7ff14c1566a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:52.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.379+0000 7ff148a00640 1 -- 172.21.15.120:0/2427683717 >> v1:172.21.15.132:6789/0 conn(0x7ff14c150670 legacy=0x7ff14c06db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:52.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.379+0000 7ff148a00640 1 -- 172.21.15.120:0/2427683717 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14c0c05a0 con 0x7ff14c0b0c40 2024-04-18T04:48:52.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.379+0000 7ff148a00640 1 -- 172.21.15.120:0/2427683717 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7ff138001680 con 0x7ff14c0b0c40 2024-04-18T04:48:52.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.379+0000 7ff148a00640 1 -- 172.21.15.120:0/2427683717 >> v1:172.21.15.120:6789/0 conn(0x7ff14c0b0c40 legacy=0x7ff14c0c68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:52.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.383+0000 7ff148a00640 1 --2- 172.21.15.120:0/2427683717 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff130004b70 0x7ff130004f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:52.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.383+0000 7ff148a00640 1 --2- 172.21.15.120:0/2427683717 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff130003770 0x7ff130003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:52.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.383+0000 7ff148a00640 1 --2- 172.21.15.120:0/2427683717 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff130004130 0x7ff13000fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:52.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.383+0000 7ff148a00640 1 -- 172.21.15.120:0/2427683717 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff130010310 con 0x7ff130003770 2024-04-18T04:48:52.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.383+0000 7ff148a00640 1 -- 172.21.15.120:0/2427683717 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff130010480 con 0x7ff130004130 2024-04-18T04:48:52.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.383+0000 7ff148a00640 1 -- 172.21.15.120:0/2427683717 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff130010640 con 0x7ff130004b70 2024-04-18T04:48:52.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.383+0000 7ff149e00640 1 --2- 172.21.15.120:0/2427683717 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff130004b70 0x7ff130004f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:52.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.383+0000 7ff14a800640 1 --2- 172.21.15.120:0/2427683717 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff130004130 0x7ff13000fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:52.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.383+0000 7ff149e00640 1 -- 172.21.15.120:0/2427683717 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff130004130 msgr2=0x7ff13000fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:48:52.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.383+0000 7ff149e00640 1 --2- 172.21.15.120:0/2427683717 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff130004130 0x7ff13000fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:52.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.383+0000 7ff149e00640 1 -- 172.21.15.120:0/2427683717 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff130003770 msgr2=0x7ff130003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:48:52.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.383+0000 7ff149e00640 1 --2- 172.21.15.120:0/2427683717 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff130003770 0x7ff130003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:52.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.383+0000 7ff149e00640 1 -- 172.21.15.120:0/2427683717 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13c001120 con 0x7ff130004b70 2024-04-18T04:48:52.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.387+0000 7ff14a800640 1 -- 172.21.15.120:0/2427683717 reap_dead start 2024-04-18T04:48:52.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.399+0000 7ff149e00640 1 --2- 172.21.15.120:0/2427683717 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff130004b70 0x7ff130004f50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0019d0 tx=0x7ff13c01edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3abe4fe25de4be87 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:52.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.407+0000 7ff148a00640 1 -- 172.21.15.120:0/2427683717 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13c0058e0 con 0x7ff130004b70 2024-04-18T04:48:52.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.407+0000 7ff148a00640 1 -- 172.21.15.120:0/2427683717 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13c005a40 con 0x7ff130004b70 2024-04-18T04:48:52.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.407+0000 7ff148a00640 1 -- 172.21.15.120:0/2427683717 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13c005e30 con 0x7ff130004b70 2024-04-18T04:48:52.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.407+0000 7ff14b200640 1 -- 172.21.15.120:0/2427683717 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff130004b70 msgr2=0x7ff130004f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:52.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.407+0000 7ff14b200640 1 --2- 172.21.15.120:0/2427683717 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff130004b70 0x7ff130004f50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0019d0 tx=0x7ff13c01edf0 comp rx=0 tx=0).stop 2024-04-18T04:48:52.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.411+0000 7ff14b200640 1 -- 172.21.15.120:0/2427683717 shutdown_connections 2024-04-18T04:48:52.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.411+0000 7ff14b200640 1 --2- 172.21.15.120:0/2427683717 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff130004b70 0x7ff130004f50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:52.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.411+0000 7ff14b200640 1 -- 172.21.15.120:0/2427683717 >> 172.21.15.120:0/2427683717 conn(0x7ff14c06d000 msgr2=0x7ff14c06d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:48:52.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.419+0000 7ff14b200640 1 -- 172.21.15.120:0/2427683717 shutdown_connections 2024-04-18T04:48:52.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.419+0000 7ff14b200640 1 -- 172.21.15.120:0/2427683717 wait complete. 2024-04-18T04:48:52.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.423+0000 7ff14b200640 1 Processor -- start 2024-04-18T04:48:52.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.423+0000 7ff14b200640 1 -- start start 2024-04-18T04:48:52.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.427+0000 7ff14b200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff130004b70 0x7ff14c153530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:52.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.427+0000 7ff14b200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff14c0c6c60 0x7ff14c1f54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:52.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.427+0000 7ff14b200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff14c1f5a20 0x7ff14c1fbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:52.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.427+0000 7ff14b200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c1fb590 con 0x7ff14c0c6c60 2024-04-18T04:48:52.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.427+0000 7ff14b200640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c1fca80 con 0x7ff14c1f5a20 2024-04-18T04:48:52.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.427+0000 7ff14b200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c14a270 con 0x7ff130004b70 2024-04-18T04:48:52.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.427+0000 7ff149e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff130004b70 0x7ff14c153530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:52.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.427+0000 7ff149e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff130004b70 0x7ff14c153530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:39394/0 (socket says 172.21.15.120:39394) 2024-04-18T04:48:52.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.427+0000 7ff149e00640 1 -- 172.21.15.120:0/3517124960 learned_addr learned my addr 172.21.15.120:0/3517124960 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:48:52.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.427+0000 7ff14a800640 1 --2- 172.21.15.120:0/3517124960 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff14c1f5a20 0x7ff14c1fbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:52.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.427+0000 7ff14a800640 1 -- 172.21.15.120:0/3517124960 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff130004b70 msgr2=0x7ff14c153530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:52.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.427+0000 7ff14a800640 1 --2- 172.21.15.120:0/3517124960 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff130004b70 0x7ff14c153530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:52.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.427+0000 7ff14a800640 1 -- 172.21.15.120:0/3517124960 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff14c0c6c60 msgr2=0x7ff14c1f54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:52.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.427+0000 7ff14a800640 1 --2- 172.21.15.120:0/3517124960 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff14c0c6c60 0x7ff14c1f54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:52.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.427+0000 7ff14a800640 1 -- 172.21.15.120:0/3517124960 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14c149730 con 0x7ff14c1f5a20 2024-04-18T04:48:52.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.427+0000 7ff14a800640 1 --2- 172.21.15.120:0/3517124960 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff14c1f5a20 0x7ff14c1fbcc0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff14c0b10d0 tx=0x7ff14400f580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:52.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.439+0000 7ff142000640 1 -- 172.21.15.120:0/3517124960 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14400e040 con 0x7ff14c1f5a20 2024-04-18T04:48:52.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.439+0000 7ff142000640 1 -- 172.21.15.120:0/3517124960 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14400f040 con 0x7ff14c1f5a20 2024-04-18T04:48:52.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.439+0000 7ff142000640 1 -- 172.21.15.120:0/3517124960 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff144015430 con 0x7ff14c1f5a20 2024-04-18T04:48:52.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.439+0000 7ff14b200640 1 -- 172.21.15.120:0/3517124960 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff14c1499d0 con 0x7ff14c1f5a20 2024-04-18T04:48:52.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.439+0000 7ff14b200640 1 -- 172.21.15.120:0/3517124960 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff14c149f90 con 0x7ff14c1f5a20 2024-04-18T04:48:52.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.439+0000 7ff14b200640 1 -- 172.21.15.120:0/3517124960 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff14c0701e0 con 0x7ff14c1f5a20 2024-04-18T04:48:52.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.443+0000 7ff142000640 1 -- 172.21.15.120:0/3517124960 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff144015590 con 0x7ff14c1f5a20 2024-04-18T04:48:52.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.447+0000 7ff142000640 1 --2- 172.21.15.120:0/3517124960 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff12c066710 0x7ff12c068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:52.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.447+0000 7ff142000640 1 -- 172.21.15.120:0/3517124960 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6835+0+0 (secure 0 0 0) 0x7ff1440854c0 con 0x7ff14c1f5a20 2024-04-18T04:48:52.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.447+0000 7ff149e00640 1 --2- 172.21.15.120:0/3517124960 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff12c066710 0x7ff12c068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:52.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.451+0000 7ff142000640 1 -- 172.21.15.120:0/3517124960 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7ff144052410 con 0x7ff14c1f5a20 2024-04-18T04:48:52.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.455+0000 7ff149e00640 1 --2- 172.21.15.120:0/3517124960 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff12c066710 0x7ff12c068bd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff13c000fe0 tx=0x7ff13c0014c0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:52.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.907+0000 7ff14b200640 1 -- 172.21.15.120:0/3517124960 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff14c0728f0 con 0x7ff14c1f5a20 2024-04-18T04:48:52.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.911+0000 7ff142000640 1 -- 172.21.15.120:0/3517124960 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+5531 (secure 0 0 0) 0x7ff144055a30 con 0x7ff14c1f5a20 2024-04-18T04:48:52.912 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:48:52.912 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:48:52.020151+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5130":{"gid":5130,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":23,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:48:52.913 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 26 2024-04-18T04:48:52.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.923+0000 7ff14b200640 1 -- 172.21.15.120:0/3517124960 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff12c066710 msgr2=0x7ff12c068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:52.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.923+0000 7ff14b200640 1 --2- 172.21.15.120:0/3517124960 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff12c066710 0x7ff12c068bd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff13c000fe0 tx=0x7ff13c0014c0 comp rx=0 tx=0).stop 2024-04-18T04:48:52.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.923+0000 7ff14b200640 1 -- 172.21.15.120:0/3517124960 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff14c1f5a20 msgr2=0x7ff14c1fbcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:52.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.923+0000 7ff14b200640 1 --2- 172.21.15.120:0/3517124960 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff14c1f5a20 0x7ff14c1fbcc0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff14c0b10d0 tx=0x7ff14400f580 comp rx=0 tx=0).stop 2024-04-18T04:48:52.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.923+0000 7ff14b200640 1 -- 172.21.15.120:0/3517124960 shutdown_connections 2024-04-18T04:48:52.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.923+0000 7ff14b200640 1 --2- 172.21.15.120:0/3517124960 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff12c066710 0x7ff12c068bd0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:52.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.923+0000 7ff14b200640 1 --2- 172.21.15.120:0/3517124960 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff14c1f5a20 0x7ff14c1fbcc0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:52.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.923+0000 7ff14b200640 1 --2- 172.21.15.120:0/3517124960 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff14c0c6c60 0x7ff14c1f54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:52.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.923+0000 7ff14b200640 1 --2- 172.21.15.120:0/3517124960 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff130004b70 0x7ff14c153530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:52.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.923+0000 7ff14b200640 1 -- 172.21.15.120:0/3517124960 >> 172.21.15.120:0/3517124960 conn(0x7ff14c06d000 msgr2=0x7ff14c06d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:48:52.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.923+0000 7ff14b200640 1 -- 172.21.15.120:0/3517124960 shutdown_connections 2024-04-18T04:48:52.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:52.923+0000 7ff14b200640 1 -- 172.21.15.120:0/3517124960 wait complete. 2024-04-18T04:48:53.021 INFO:tasks.mds_thrash.fs.[cephfs]:mds.c has gained rank=2, replacing gid=4255 2024-04-18T04:48:53.021 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 5 secs before reviving mds.b 2024-04-18T04:48:55.214 INFO:tasks.ceph.mds.e.smithi120.stderr:2024-04-18T04:48:55.211+0000 7fbec2000640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-18T04:48:58.021 INFO:tasks.mds_thrash.fs.[cephfs]:reviving mds.b 2024-04-18T04:48:58.022 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-18T04:48:58.022 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-18T04:48:58.024 INFO:tasks.ceph.mds.b:Started 2024-04-18T04:48:58.024 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:48:58.095 INFO:tasks.ceph.mds.b.smithi132.stdout:starting mds.b at 2024-04-18T04:48:58.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.251+0000 7fb4cec00640 1 Processor -- start 2024-04-18T04:48:58.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.251+0000 7fb4cec00640 1 -- start start 2024-04-18T04:48:58.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.255+0000 7fb4cec00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb4c806c6d0 0x7fb4c80c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:58.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.255+0000 7fb4cec00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4c806b800 con 0x7fb4c8163a90 2024-04-18T04:48:58.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.255+0000 7fb4cec00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4c80c6d20 con 0x7fb4c81699d0 2024-04-18T04:48:58.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.255+0000 7fb4cec00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4c8070130 con 0x7fb4c806c6d0 2024-04-18T04:48:58.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.255+0000 7fb4c7400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb4c806c6d0 0x7fb4c80c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:58.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.255+0000 7fb4c7400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb4c806c6d0 0x7fb4c80c61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:44760/0 (socket says 172.21.15.120:44760) 2024-04-18T04:48:58.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.255+0000 7fb4c7400640 1 -- 172.21.15.120:0/2138884256 learned_addr learned my addr 172.21.15.120:0/2138884256 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:48:58.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.263+0000 7fb4c7400640 1 -- 172.21.15.120:0/2138884256 >> v1:172.21.15.132:6789/0 conn(0x7fb4c81699d0 legacy=0x7fb4c8169de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:48:58.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.263+0000 7fb4c7400640 1 -- 172.21.15.120:0/2138884256 >> v1:172.21.15.120:6789/0 conn(0x7fb4c8163a90 legacy=0x7fb4c806bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:48:58.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.263+0000 7fb4c7400640 1 -- 172.21.15.120:0/2138884256 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c80c7000 con 0x7fb4c806c6d0 2024-04-18T04:48:58.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.267+0000 7fb4c7400640 1 --2- 172.21.15.120:0/2138884256 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4c806c6d0 0x7fb4c80c61d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8009cd0 tx=0x7fb4b801fcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7f1d0ea29d1d148 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:58.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.271+0000 7fb4c6a00640 1 -- 172.21.15.120:0/2138884256 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b80092d0 con 0x7fb4c806c6d0 2024-04-18T04:48:58.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.271+0000 7fb4c6a00640 1 -- 172.21.15.120:0/2138884256 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b80a9900 con 0x7fb4c806c6d0 2024-04-18T04:48:58.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.271+0000 7fb4c6a00640 1 -- 172.21.15.120:0/2138884256 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b80a9c90 con 0x7fb4c806c6d0 2024-04-18T04:48:58.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.271+0000 7fb4cec00640 1 -- 172.21.15.120:0/2138884256 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4c806c6d0 msgr2=0x7fb4c80c61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:58.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.271+0000 7fb4cec00640 1 --2- 172.21.15.120:0/2138884256 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4c806c6d0 0x7fb4c80c61d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8009cd0 tx=0x7fb4b801fcf0 comp rx=0 tx=0).stop 2024-04-18T04:48:58.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.275+0000 7fb4cec00640 1 -- 172.21.15.120:0/2138884256 shutdown_connections 2024-04-18T04:48:58.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.275+0000 7fb4cec00640 1 --2- 172.21.15.120:0/2138884256 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4c806c6d0 0x7fb4c80c61d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:58.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.275+0000 7fb4cec00640 1 -- 172.21.15.120:0/2138884256 >> 172.21.15.120:0/2138884256 conn(0x7fb4c80c78c0 msgr2=0x7fb4c80c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:48:58.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.275+0000 7fb4cec00640 1 -- 172.21.15.120:0/2138884256 shutdown_connections 2024-04-18T04:48:58.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.275+0000 7fb4cec00640 1 -- 172.21.15.120:0/2138884256 wait complete. 2024-04-18T04:48:58.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.275+0000 7fb4cec00640 1 Processor -- start 2024-04-18T04:48:58.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.275+0000 7fb4cec00640 1 -- start start 2024-04-18T04:48:58.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.279+0000 7fb4cec00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb4c806c6d0 0x7fb4c81f2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:58.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.279+0000 7fb4cec00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4c8163a90 0x7fb4c81f30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:58.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.279+0000 7fb4cec00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb4c81699d0 0x7fb4c8165b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:58.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.279+0000 7fb4c7e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb4c806c6d0 0x7fb4c81f2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:58.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.279+0000 7fb4c7e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb4c806c6d0 0x7fb4c81f2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:39398/0 (socket says 172.21.15.120:39398) 2024-04-18T04:48:58.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.279+0000 7fb4c7400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4c8163a90 0x7fb4c81f30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:58.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.279+0000 7fb4c7400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4c8163a90 0x7fb4c81f30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:44764/0 (socket says 172.21.15.120:44764) 2024-04-18T04:48:58.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.279+0000 7fb4cec00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c81ef890 con 0x7fb4c81699d0 2024-04-18T04:48:58.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.279+0000 7fb4cec00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c81fcf30 con 0x7fb4c8163a90 2024-04-18T04:48:58.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.279+0000 7fb4cec00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c8165390 con 0x7fb4c806c6d0 2024-04-18T04:48:58.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.279+0000 7fb4c7e00640 1 -- 172.21.15.120:0/1893121269 learned_addr learned my addr 172.21.15.120:0/1893121269 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:48:58.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.279+0000 7fb4c7400640 1 -- 172.21.15.120:0/1893121269 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb4c806c6d0 msgr2=0x7fb4c81f2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:58.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.279+0000 7fb4c7400640 1 --2- 172.21.15.120:0/1893121269 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb4c806c6d0 0x7fb4c81f2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:58.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.279+0000 7fb4c7400640 1 -- 172.21.15.120:0/1893121269 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb4c81699d0 msgr2=0x7fb4c8165b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:58.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.279+0000 7fb4c7400640 1 --2- 172.21.15.120:0/1893121269 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb4c81699d0 0x7fb4c8165b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:58.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.279+0000 7fb4c7400640 1 -- 172.21.15.120:0/1893121269 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b80099b0 con 0x7fb4c8163a90 2024-04-18T04:48:58.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.279+0000 7fb4c7400640 1 --2- 172.21.15.120:0/1893121269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4c8163a90 0x7fb4c81f30e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb4c806ef20 tx=0x7fb4b801e530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:58.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.283+0000 7fb4bfe00640 1 -- 172.21.15.120:0/1893121269 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b80078a0 con 0x7fb4c8163a90 2024-04-18T04:48:58.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.283+0000 7fb4bfe00640 1 -- 172.21.15.120:0/1893121269 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b8007a20 con 0x7fb4c8163a90 2024-04-18T04:48:58.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.283+0000 7fb4bfe00640 1 -- 172.21.15.120:0/1893121269 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b8007dd0 con 0x7fb4c8163a90 2024-04-18T04:48:58.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.283+0000 7fb4cec00640 1 -- 172.21.15.120:0/1893121269 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4c8165670 con 0x7fb4c8163a90 2024-04-18T04:48:58.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.283+0000 7fb4cec00640 1 -- 172.21.15.120:0/1893121269 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4c81eec60 con 0x7fb4c8163a90 2024-04-18T04:48:58.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.283+0000 7fb4cec00640 1 -- 172.21.15.120:0/1893121269 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4c8072a70 con 0x7fb4c8163a90 2024-04-18T04:48:58.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.287+0000 7fb4bfe00640 1 -- 172.21.15.120:0/1893121269 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb4b80bb400 con 0x7fb4c8163a90 2024-04-18T04:48:58.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.287+0000 7fb4bfe00640 1 --2- 172.21.15.120:0/1893121269 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb4a8066690 0x7fb4a8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:48:58.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.287+0000 7fb4bfe00640 1 -- 172.21.15.120:0/1893121269 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6835+0+0 (secure 0 0 0) 0x7fb4b8121a30 con 0x7fb4c8163a90 2024-04-18T04:48:58.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.295+0000 7fb4c7e00640 1 --2- 172.21.15.120:0/1893121269 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb4a8066690 0x7fb4a8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:48:58.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.295+0000 7fb4c7e00640 1 --2- 172.21.15.120:0/1893121269 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb4a8066690 0x7fb4a8068b50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb4b40098b0 tx=0x7fb4b4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:48:58.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.295+0000 7fb4bfe00640 1 -- 172.21.15.120:0/1893121269 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fb4b80ee950 con 0x7fb4c8163a90 2024-04-18T04:48:58.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.743+0000 7fb4cec00640 1 -- 172.21.15.120:0/1893121269 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4c8072a70 con 0x7fb4c8163a90 2024-04-18T04:48:58.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.747+0000 7fb4bfe00640 1 -- 172.21.15.120:0/1893121269 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+6288 (secure 0 0 0) 0x7fb4b80f1f70 con 0x7fb4c8163a90 2024-04-18T04:48:58.749 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:48:58.749 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4967,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:48:52.020151+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5130":{"gid":5130,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":23,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:48:58.750 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 27 2024-04-18T04:48:58.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.751+0000 7fb4cec00640 1 -- 172.21.15.120:0/1893121269 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb4a8066690 msgr2=0x7fb4a8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:58.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.751+0000 7fb4cec00640 1 --2- 172.21.15.120:0/1893121269 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb4a8066690 0x7fb4a8068b50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb4b40098b0 tx=0x7fb4b4008040 comp rx=0 tx=0).stop 2024-04-18T04:48:58.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.751+0000 7fb4cec00640 1 -- 172.21.15.120:0/1893121269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4c8163a90 msgr2=0x7fb4c81f30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:48:58.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.751+0000 7fb4cec00640 1 --2- 172.21.15.120:0/1893121269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4c8163a90 0x7fb4c81f30e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb4c806ef20 tx=0x7fb4b801e530 comp rx=0 tx=0).stop 2024-04-18T04:48:58.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.751+0000 7fb4cec00640 1 -- 172.21.15.120:0/1893121269 shutdown_connections 2024-04-18T04:48:58.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.751+0000 7fb4cec00640 1 --2- 172.21.15.120:0/1893121269 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb4a8066690 0x7fb4a8068b50 secure :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb4b40098b0 tx=0x7fb4b4008040 comp rx=0 tx=0).stop 2024-04-18T04:48:58.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.751+0000 7fb4cec00640 1 --2- 172.21.15.120:0/1893121269 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb4c81699d0 0x7fb4c8165b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:58.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.751+0000 7fb4cec00640 1 --2- 172.21.15.120:0/1893121269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4c8163a90 0x7fb4c81f30e0 secure :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb4c806ef20 tx=0x7fb4b801e530 comp rx=0 tx=0).stop 2024-04-18T04:48:58.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.751+0000 7fb4cec00640 1 --2- 172.21.15.120:0/1893121269 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb4c806c6d0 0x7fb4c81f2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:48:58.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.751+0000 7fb4cec00640 1 -- 172.21.15.120:0/1893121269 >> 172.21.15.120:0/1893121269 conn(0x7fb4c80c78c0 msgr2=0x7fb4c80c0620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:48:58.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.751+0000 7fb4cec00640 1 -- 172.21.15.120:0/1893121269 shutdown_connections 2024-04-18T04:48:58.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:48:58.751+0000 7fb4cec00640 1 -- 172.21.15.120:0/1893121269 wait complete. 2024-04-18T04:48:58.792 INFO:tasks.mds_thrash.fs.[cephfs]:mds.b reported in up:standby state 2024-04-18T04:48:58.793 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 62 secs before thrashing 2024-04-18T04:49:01.256 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:49:01.261 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:49:32.111 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:49:32.120 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:50:00.794 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:50:03.114 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:50:03.809 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:50:05.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.302+0000 7f138de00640 1 Processor -- start 2024-04-18T04:50:05.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.302+0000 7f138de00640 1 -- start start 2024-04-18T04:50:05.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.306+0000 7f138de00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1388163a90 0x7f13880c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:05.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.306+0000 7f138de00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f138806bfc0 0x7f138806c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:05.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.306+0000 7f138de00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f138806b800 con 0x7f1388166460 2024-04-18T04:50:05.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.306+0000 7f138de00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1388070130 con 0x7f1388163a90 2024-04-18T04:50:05.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.306+0000 7f138de00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13880c72e0 con 0x7f138806bfc0 2024-04-18T04:50:05.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.306+0000 7f1387400640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f1388166460 0x7f1388166870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:33014/0 (socket says 172.21.15.120:33014) 2024-04-18T04:50:05.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.306+0000 7f1387400640 1 -- 172.21.15.120:0/859903175 learned_addr learned my addr 172.21.15.120:0/859903175 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:50:05.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.306+0000 7f1386000640 1 --2- 172.21.15.120:0/859903175 >> v2:172.21.15.132:3300/0 conn(0x7f138806bfc0 0x7f138806c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:05.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.306+0000 7f1386a00640 1 --2- 172.21.15.120:0/859903175 >> v2:172.21.15.120:3300/0 conn(0x7f1388163a90 0x7f13880c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:05.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.314+0000 7f1386a00640 1 -- 172.21.15.120:0/859903175 >> v2:172.21.15.132:3300/0 conn(0x7f138806bfc0 msgr2=0x7f138806c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:50:05.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.314+0000 7f1386a00640 1 --2- 172.21.15.120:0/859903175 >> v2:172.21.15.132:3300/0 conn(0x7f138806bfc0 0x7f138806c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:05.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.314+0000 7f1386a00640 1 -- 172.21.15.120:0/859903175 >> v1:172.21.15.132:6789/0 conn(0x7f1388166460 legacy=0x7f1388166870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:05.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.314+0000 7f1386a00640 1 -- 172.21.15.120:0/859903175 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13880c6d20 con 0x7f1388163a90 2024-04-18T04:50:05.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.318+0000 7f1386a00640 1 --2- 172.21.15.120:0/859903175 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1388163a90 0x7f13880c61d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f138806ebc0 tx=0x7f137801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fc5ff7640f64078 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:05.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.318+0000 7f1385600640 1 -- 172.21.15.120:0/859903175 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13780a58f0 con 0x7f1388163a90 2024-04-18T04:50:05.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.318+0000 7f1385600640 1 -- 172.21.15.120:0/859903175 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13780a5a50 con 0x7f1388163a90 2024-04-18T04:50:05.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.318+0000 7f1385600640 1 -- 172.21.15.120:0/859903175 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13780a5de0 con 0x7f1388163a90 2024-04-18T04:50:05.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.318+0000 7f138de00640 1 -- 172.21.15.120:0/859903175 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1388163a90 msgr2=0x7f13880c61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:05.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.318+0000 7f138de00640 1 --2- 172.21.15.120:0/859903175 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1388163a90 0x7f13880c61d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f138806ebc0 tx=0x7f137801c850 comp rx=0 tx=0).stop 2024-04-18T04:50:05.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.322+0000 7f138de00640 1 -- 172.21.15.120:0/859903175 shutdown_connections 2024-04-18T04:50:05.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.322+0000 7f138de00640 1 --2- 172.21.15.120:0/859903175 >> v2:172.21.15.132:3300/0 conn(0x7f138806bfc0 0x7f138806c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:05.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.322+0000 7f138de00640 1 --2- 172.21.15.120:0/859903175 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1388163a90 0x7f13880c61d0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:05.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.322+0000 7f138de00640 1 -- 172.21.15.120:0/859903175 >> 172.21.15.120:0/859903175 conn(0x7f13880c78c0 msgr2=0x7f13880c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:50:05.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.326+0000 7f138de00640 1 -- 172.21.15.120:0/859903175 shutdown_connections 2024-04-18T04:50:05.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.326+0000 7f138de00640 1 -- 172.21.15.120:0/859903175 wait complete. 2024-04-18T04:50:05.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.326+0000 7f138de00640 1 Processor -- start 2024-04-18T04:50:05.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.330+0000 7f138de00640 1 -- start start 2024-04-18T04:50:05.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.330+0000 7f138de00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f138806bfc0 0x7f1388070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:05.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.330+0000 7f138de00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1388163a90 0x7f138815ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:05.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.330+0000 7f138de00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1388166460 0x7f13880c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:05.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.330+0000 7f1386000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1388163a90 0x7f138815ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:05.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.330+0000 7f1386000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1388163a90 0x7f138815ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:43906/0 (socket says 172.21.15.120:43906) 2024-04-18T04:50:05.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.330+0000 7f138de00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138808b3b0 con 0x7f1388166460 2024-04-18T04:50:05.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.330+0000 7f138de00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138816a400 con 0x7f1388163a90 2024-04-18T04:50:05.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.330+0000 7f138de00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1388168b30 con 0x7f138806bfc0 2024-04-18T04:50:05.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.330+0000 7f1386000640 1 -- 172.21.15.120:0/195842786 learned_addr learned my addr 172.21.15.120:0/195842786 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:50:05.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.330+0000 7f1387400640 1 --2- 172.21.15.120:0/195842786 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1388166460 0x7f13880c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:05.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.330+0000 7f1386000640 1 -- 172.21.15.120:0/195842786 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f138806bfc0 msgr2=0x7f1388070c70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-18T04:50:05.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.330+0000 7f1386000640 1 --2- 172.21.15.120:0/195842786 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f138806bfc0 0x7f1388070c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:05.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.330+0000 7f1386000640 1 -- 172.21.15.120:0/195842786 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1388166460 msgr2=0x7f13880c9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:05.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.330+0000 7f1386000640 1 --2- 172.21.15.120:0/195842786 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1388166460 0x7f13880c9cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:05.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.330+0000 7f1386000640 1 -- 172.21.15.120:0/195842786 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1378009a70 con 0x7f1388163a90 2024-04-18T04:50:05.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.338+0000 7f1386000640 1 --2- 172.21.15.120:0/195842786 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1388163a90 0x7f138815ce20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f137400d5f0 tx=0x7f137400dab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:05.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.346+0000 7f137f400640 1 -- 172.21.15.120:0/195842786 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13740125f0 con 0x7f1388163a90 2024-04-18T04:50:05.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.346+0000 7f137f400640 1 -- 172.21.15.120:0/195842786 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1374012750 con 0x7f1388163a90 2024-04-18T04:50:05.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.346+0000 7f137f400640 1 -- 172.21.15.120:0/195842786 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1374012b00 con 0x7f1388163a90 2024-04-18T04:50:05.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.350+0000 7f138de00640 1 -- 172.21.15.120:0/195842786 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f138816a6a0 con 0x7f1388163a90 2024-04-18T04:50:05.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.350+0000 7f138de00640 1 -- 172.21.15.120:0/195842786 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13881678a0 con 0x7f1388163a90 2024-04-18T04:50:05.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.350+0000 7f138de00640 1 -- 172.21.15.120:0/195842786 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1388073e10 con 0x7f1388163a90 2024-04-18T04:50:05.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.366+0000 7f137f400640 1 -- 172.21.15.120:0/195842786 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1374012c60 con 0x7f1388163a90 2024-04-18T04:50:05.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.366+0000 7f137f400640 1 --2- 172.21.15.120:0/195842786 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1368066790 0x7f1368068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:05.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.374+0000 7f137f400640 1 -- 172.21.15.120:0/195842786 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f1374085660 con 0x7f1388163a90 2024-04-18T04:50:05.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.378+0000 7f1386a00640 1 --2- 172.21.15.120:0/195842786 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1368066790 0x7f1368068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:05.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.390+0000 7f1386a00640 1 --2- 172.21.15.120:0/195842786 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1368066790 0x7f1368068c50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f13780af000 tx=0x7f13780a7070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:05.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.394+0000 7f137f400640 1 -- 172.21.15.120:0/195842786 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f13740525d0 con 0x7f1388163a90 2024-04-18T04:50:05.827 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:50:05.827 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4967,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:48:52.020151+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5130":{"gid":5130,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":23,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:50:05.827 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 27 2024-04-18T04:50:05.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.822+0000 7f138de00640 1 -- 172.21.15.120:0/195842786 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f138816a830 con 0x7f1388163a90 2024-04-18T04:50:05.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.822+0000 7f137f400640 1 -- 172.21.15.120:0/195842786 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+6288 (secure 0 0 0) 0x7f1374055bf0 con 0x7f1388163a90 2024-04-18T04:50:05.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.826+0000 7f138de00640 1 -- 172.21.15.120:0/195842786 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1368066790 msgr2=0x7f1368068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:05.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.826+0000 7f138de00640 1 --2- 172.21.15.120:0/195842786 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1368066790 0x7f1368068c50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f13780af000 tx=0x7f13780a7070 comp rx=0 tx=0).stop 2024-04-18T04:50:05.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.826+0000 7f138de00640 1 -- 172.21.15.120:0/195842786 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1388163a90 msgr2=0x7f138815ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:05.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.826+0000 7f138de00640 1 --2- 172.21.15.120:0/195842786 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1388163a90 0x7f138815ce20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f137400d5f0 tx=0x7f137400dab0 comp rx=0 tx=0).stop 2024-04-18T04:50:05.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.826+0000 7f138de00640 1 -- 172.21.15.120:0/195842786 shutdown_connections 2024-04-18T04:50:05.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.826+0000 7f138de00640 1 --2- 172.21.15.120:0/195842786 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1368066790 0x7f1368068c50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:05.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.826+0000 7f138de00640 1 --2- 172.21.15.120:0/195842786 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1388166460 0x7f13880c9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:05.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.826+0000 7f138de00640 1 --2- 172.21.15.120:0/195842786 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1388163a90 0x7f138815ce20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:05.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.826+0000 7f138de00640 1 --2- 172.21.15.120:0/195842786 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f138806bfc0 0x7f1388070c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:05.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.826+0000 7f138de00640 1 -- 172.21.15.120:0/195842786 >> 172.21.15.120:0/195842786 conn(0x7f13880c78c0 msgr2=0x7f13881642f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:50:05.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.830+0000 7f138de00640 1 -- 172.21.15.120:0/195842786 shutdown_connections 2024-04-18T04:50:05.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:05.830+0000 7f138de00640 1 -- 172.21.15.120:0/195842786 wait complete. 2024-04-18T04:50:07.217 INFO:tasks.mds_thrash.fs.[cephfs]:kill mds.a (rank=1) 2024-04-18T04:50:07.217 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-18T04:50:07.217 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T04:50:07.255 INFO:tasks.ceph.mds.a:Stopped 2024-04-18T04:50:07.255 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:50:09.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.618+0000 7f464a400640 1 Processor -- start 2024-04-18T04:50:09.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.618+0000 7f464a400640 1 -- start start 2024-04-18T04:50:09.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.622+0000 7f464a400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f463c04b2d0 0x7f463c005e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:09.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.622+0000 7f464a400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f463c04b6b0 0x7f463c0d4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:09.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.622+0000 7f464a400640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f463c0dbd20 con 0x7f463c046d50 2024-04-18T04:50:09.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.622+0000 7f464a400640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f463c0468c0 con 0x7f463c04b6b0 2024-04-18T04:50:09.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.622+0000 7f464a400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f463c0dba80 con 0x7f463c04b2d0 2024-04-18T04:50:09.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.622+0000 7f4649a00640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f463c046d50 0x7f463c0dad10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:33018/0 (socket says 172.21.15.120:33018) 2024-04-18T04:50:09.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.622+0000 7f4649a00640 1 -- 172.21.15.120:0/831096518 learned_addr learned my addr 172.21.15.120:0/831096518 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:50:09.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.622+0000 7f4649000640 1 --2- 172.21.15.120:0/831096518 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f463c04b2d0 0x7f463c005e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:09.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.626+0000 7f4643400640 1 -- 172.21.15.120:0/831096518 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3522473871 0 0) 0x7f463c0dbd20 con 0x7f463c046d50 2024-04-18T04:50:09.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.626+0000 7f4643e00640 1 --2- 172.21.15.120:0/831096518 >> v2:172.21.15.120:3300/0 conn(0x7f463c04b6b0 0x7f463c0d4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:09.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.626+0000 7f4643400640 1 -- 172.21.15.120:0/831096518 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f462c003530 con 0x7f463c046d50 2024-04-18T04:50:09.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.626+0000 7f4643400640 1 -- 172.21.15.120:0/831096518 <== mon.1 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4016770429 0 0) 0x7f462c003530 con 0x7f463c046d50 2024-04-18T04:50:09.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.626+0000 7f4643400640 1 -- 172.21.15.120:0/831096518 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f463c04b2d0 msgr2=0x7f463c005e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:50:09.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.626+0000 7f4643400640 1 --2- 172.21.15.120:0/831096518 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f463c04b2d0 0x7f463c005e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:09.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.626+0000 7f4643400640 1 -- 172.21.15.120:0/831096518 >> v2:172.21.15.120:3300/0 conn(0x7f463c04b6b0 msgr2=0x7f463c0d4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:50:09.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.626+0000 7f4643400640 1 --2- 172.21.15.120:0/831096518 >> v2:172.21.15.120:3300/0 conn(0x7f463c04b6b0 0x7f463c0d4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:09.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.626+0000 7f4643400640 1 -- 172.21.15.120:0/831096518 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f463c045f90 con 0x7f463c046d50 2024-04-18T04:50:09.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.626+0000 7f4643400640 1 -- 172.21.15.120:0/831096518 <== mon.1 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7f4644066d40 con 0x7f463c046d50 2024-04-18T04:50:09.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.626+0000 7f4643400640 1 -- 172.21.15.120:0/831096518 >> v1:172.21.15.132:6789/0 conn(0x7f463c046d50 legacy=0x7f463c0dad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:09.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.626+0000 7f4643400640 1 --2- 172.21.15.120:0/831096518 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f462c003980 0x7f462c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:09.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.626+0000 7f4643400640 1 --2- 172.21.15.120:0/831096518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f462c0047d0 0x7f462c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:09.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.626+0000 7f4643400640 1 --2- 172.21.15.120:0/831096518 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f463c04b2d0 0x7f462c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:09.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.630+0000 7f4643400640 1 -- 172.21.15.120:0/831096518 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463c0468c0 con 0x7f462c003980 2024-04-18T04:50:09.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.630+0000 7f4643400640 1 -- 172.21.15.120:0/831096518 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463c0dba80 con 0x7f462c0047d0 2024-04-18T04:50:09.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.630+0000 7f4643400640 1 -- 172.21.15.120:0/831096518 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f462c00b990 con 0x7f463c04b2d0 2024-04-18T04:50:09.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.630+0000 7f4649a00640 1 --2- 172.21.15.120:0/831096518 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f463c04b2d0 0x7f462c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:09.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.630+0000 7f4643e00640 1 --2- 172.21.15.120:0/831096518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f462c0047d0 0x7f462c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:09.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.630+0000 7f4649a00640 1 -- 172.21.15.120:0/831096518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f462c0047d0 msgr2=0x7f462c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:50:09.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.630+0000 7f4649a00640 1 --2- 172.21.15.120:0/831096518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f462c0047d0 0x7f462c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:09.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.630+0000 7f4649a00640 1 -- 172.21.15.120:0/831096518 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f462c003980 msgr2=0x7f462c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:50:09.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.630+0000 7f4649a00640 1 --2- 172.21.15.120:0/831096518 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f462c003980 0x7f462c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:09.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.630+0000 7f4649a00640 1 -- 172.21.15.120:0/831096518 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f463c045f90 con 0x7f463c04b2d0 2024-04-18T04:50:09.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.634+0000 7f4649a00640 1 --2- 172.21.15.120:0/831096518 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f463c04b2d0 0x7f462c005190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4644074b60 tx=0x7f464409c090 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c6db6eb3c537c84 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:09.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.638+0000 7f4643400640 1 -- 172.21.15.120:0/831096518 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464412b5f0 con 0x7f463c04b2d0 2024-04-18T04:50:09.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.638+0000 7f4643400640 1 -- 172.21.15.120:0/831096518 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4644127050 con 0x7f463c04b2d0 2024-04-18T04:50:09.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.638+0000 7f4643400640 1 -- 172.21.15.120:0/831096518 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464412b9f0 con 0x7f463c04b2d0 2024-04-18T04:50:09.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.638+0000 7f464a400640 1 -- 172.21.15.120:0/831096518 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f463c04b2d0 msgr2=0x7f462c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:09.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.638+0000 7f464a400640 1 --2- 172.21.15.120:0/831096518 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f463c04b2d0 0x7f462c005190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4644074b60 tx=0x7f464409c090 comp rx=0 tx=0).stop 2024-04-18T04:50:09.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.642+0000 7f4649a00640 1 -- 172.21.15.120:0/831096518 reap_dead start 2024-04-18T04:50:09.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.642+0000 7f464a400640 1 -- 172.21.15.120:0/831096518 shutdown_connections 2024-04-18T04:50:09.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.642+0000 7f464a400640 1 -- 172.21.15.120:0/831096518 >> 172.21.15.120:0/831096518 conn(0x7f463c050160 msgr2=0x7f463c050570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:50:09.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.642+0000 7f464a400640 1 -- 172.21.15.120:0/831096518 shutdown_connections 2024-04-18T04:50:09.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.642+0000 7f464a400640 1 -- 172.21.15.120:0/831096518 wait complete. 2024-04-18T04:50:09.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.646+0000 7f464a400640 1 Processor -- start 2024-04-18T04:50:09.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.646+0000 7f464a400640 1 -- start start 2024-04-18T04:50:09.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.654+0000 7f464a400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f463c04b2d0 0x7f463c0d8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:09.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.654+0000 7f464a400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f463c047900 0x7f463c049a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:09.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.654+0000 7f464a400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f463c0ce940 0x7f463c0cc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:09.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.654+0000 7f464a400640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463c0cbab0 con 0x7f463c04b2d0 2024-04-18T04:50:09.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.654+0000 7f464a400640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463c0472b0 con 0x7f463c0ce940 2024-04-18T04:50:09.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.654+0000 7f464a400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f463c0e50c0 con 0x7f463c047900 2024-04-18T04:50:09.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.654+0000 7f4643e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f463c047900 0x7f463c049a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:09.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.654+0000 7f4643e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f463c047900 0x7f463c049a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:40864/0 (socket says 172.21.15.120:40864) 2024-04-18T04:50:09.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.654+0000 7f4643e00640 1 -- 172.21.15.120:0/3704255321 learned_addr learned my addr 172.21.15.120:0/3704255321 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:50:09.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.654+0000 7f4649a00640 1 --2- 172.21.15.120:0/3704255321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f463c0ce940 0x7f463c0cc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:09.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.654+0000 7f4643e00640 1 -- 172.21.15.120:0/3704255321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f463c0ce940 msgr2=0x7f463c0cc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:09.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.654+0000 7f4643e00640 1 --2- 172.21.15.120:0/3704255321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f463c0ce940 0x7f463c0cc750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:09.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.654+0000 7f4643e00640 1 -- 172.21.15.120:0/3704255321 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f463c04b2d0 msgr2=0x7f463c0d8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:09.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.654+0000 7f4643e00640 1 --2- 172.21.15.120:0/3704255321 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f463c04b2d0 0x7f463c0d8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:09.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.654+0000 7f4643e00640 1 -- 172.21.15.120:0/3704255321 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f463c0d5470 con 0x7f463c047900 2024-04-18T04:50:09.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.654+0000 7f4643e00640 1 --2- 172.21.15.120:0/3704255321 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f463c047900 0x7f463c049a00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f463800b7f0 tx=0x7f463800bcb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:09.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.654+0000 7f4640c00640 1 -- 172.21.15.120:0/3704255321 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46380041f0 con 0x7f463c047900 2024-04-18T04:50:09.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.654+0000 7f4640c00640 1 -- 172.21.15.120:0/3704255321 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4638010a40 con 0x7f463c047900 2024-04-18T04:50:09.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.654+0000 7f4640c00640 1 -- 172.21.15.120:0/3704255321 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4638010dd0 con 0x7f463c047900 2024-04-18T04:50:09.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.658+0000 7f464a400640 1 -- 172.21.15.120:0/3704255321 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f463c0e53a0 con 0x7f463c047900 2024-04-18T04:50:09.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.658+0000 7f464a400640 1 -- 172.21.15.120:0/3704255321 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f463c0cbd00 con 0x7f463c047900 2024-04-18T04:50:09.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.662+0000 7f4636000640 1 -- 172.21.15.120:0/3704255321 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f463c0db3b0 con 0x7f463c047900 2024-04-18T04:50:09.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.666+0000 7f4640c00640 1 -- 172.21.15.120:0/3704255321 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4638014430 con 0x7f463c047900 2024-04-18T04:50:09.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.666+0000 7f4640c00640 1 --2- 172.21.15.120:0/3704255321 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f46240666c0 0x7f4624068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:09.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.666+0000 7f4640c00640 1 -- 172.21.15.120:0/3704255321 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f4638084b10 con 0x7f463c047900 2024-04-18T04:50:09.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.666+0000 7f4649000640 1 --2- 172.21.15.120:0/3704255321 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f46240666c0 0x7f4624068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:09.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.670+0000 7f4649000640 1 --2- 172.21.15.120:0/3704255321 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f46240666c0 0x7f4624068b80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f463000b7d0 tx=0x7f4630008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:09.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:09.682+0000 7f4640c00640 1 -- 172.21.15.120:0/3704255321 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f4638051b50 con 0x7f463c047900 2024-04-18T04:50:10.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:10.178+0000 7f4636000640 1 -- 172.21.15.120:0/3704255321 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f463c0e5200 con 0x7f463c047900 2024-04-18T04:50:10.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:10.178+0000 7f4640c00640 1 -- 172.21.15.120:0/3704255321 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+6288 (secure 0 0 0) 0x7f463c0e5200 con 0x7f463c047900 2024-04-18T04:50:10.184 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:50:10.185 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4967,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:48:52.020151+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5130":{"gid":5130,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":23,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:50:10.185 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 27 2024-04-18T04:50:10.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:10.186+0000 7f4636000640 1 -- 172.21.15.120:0/3704255321 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f46240666c0 msgr2=0x7f4624068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:10.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:10.186+0000 7f4636000640 1 --2- 172.21.15.120:0/3704255321 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f46240666c0 0x7f4624068b80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f463000b7d0 tx=0x7f4630008040 comp rx=0 tx=0).stop 2024-04-18T04:50:10.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:10.190+0000 7f4636000640 1 -- 172.21.15.120:0/3704255321 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f463c047900 msgr2=0x7f463c049a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:10.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:10.190+0000 7f4636000640 1 --2- 172.21.15.120:0/3704255321 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f463c047900 0x7f463c049a00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f463800b7f0 tx=0x7f463800bcb0 comp rx=0 tx=0).stop 2024-04-18T04:50:10.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:10.198+0000 7f4636000640 1 -- 172.21.15.120:0/3704255321 shutdown_connections 2024-04-18T04:50:10.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:10.198+0000 7f4636000640 1 --2- 172.21.15.120:0/3704255321 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f46240666c0 0x7f4624068b80 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:10.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:10.198+0000 7f4636000640 1 --2- 172.21.15.120:0/3704255321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f463c0ce940 0x7f463c0cc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:10.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:10.198+0000 7f4636000640 1 --2- 172.21.15.120:0/3704255321 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f463c047900 0x7f463c049a00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:10.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:10.198+0000 7f4636000640 1 --2- 172.21.15.120:0/3704255321 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f463c04b2d0 0x7f463c0d8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:10.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:10.198+0000 7f4636000640 1 -- 172.21.15.120:0/3704255321 >> 172.21.15.120:0/3704255321 conn(0x7f463c050160 msgr2=0x7f463c0d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:50:10.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:10.206+0000 7f4636000640 1 -- 172.21.15.120:0/3704255321 shutdown_connections 2024-04-18T04:50:10.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:10.210+0000 7f4636000640 1 -- 172.21.15.120:0/3704255321 wait complete. 2024-04-18T04:50:10.248 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-18T04:50:12.250 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:50:12.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.674+0000 7ff286000640 1 Processor -- start 2024-04-18T04:50:12.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.674+0000 7ff286000640 1 -- start start 2024-04-18T04:50:12.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.678+0000 7ff286000640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff28006db20 0x7ff28006b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:12.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.678+0000 7ff286000640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2800712c0 con 0x7ff280070b60 2024-04-18T04:50:12.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.678+0000 7ff286000640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2800715a0 con 0x7ff280072360 2024-04-18T04:50:12.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.678+0000 7ff286000640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff280071880 con 0x7ff28006db20 2024-04-18T04:50:12.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.678+0000 7ff27f400640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7ff280070b60 0x7ff280155fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:42340/0 (socket says 172.21.15.120:42340) 2024-04-18T04:50:12.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.678+0000 7ff27f400640 1 -- 172.21.15.120:0/2682797190 learned_addr learned my addr 172.21.15.120:0/2682797190 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:50:12.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.678+0000 7ff27fe00640 1 --2- 172.21.15.120:0/2682797190 >> v2:172.21.15.120:3300/0 conn(0x7ff28006db20 0x7ff28006b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:12.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.678+0000 7ff27e000640 1 -- 172.21.15.120:0/2682797190 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1204011467 0 0) 0x7ff2800715a0 con 0x7ff280072360 2024-04-18T04:50:12.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.678+0000 7ff27e000640 1 -- 172.21.15.120:0/2682797190 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff264003530 con 0x7ff280072360 2024-04-18T04:50:12.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.678+0000 7ff27e000640 1 -- 172.21.15.120:0/2682797190 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2213751156 0 0) 0x7ff2800712c0 con 0x7ff280070b60 2024-04-18T04:50:12.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.678+0000 7ff27e000640 1 -- 172.21.15.120:0/2682797190 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2800715a0 con 0x7ff280070b60 2024-04-18T04:50:12.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.678+0000 7ff27fe00640 1 -- 172.21.15.120:0/2682797190 >> v1:172.21.15.132:6789/0 conn(0x7ff280072360 legacy=0x7ff2800c57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:12.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.678+0000 7ff27fe00640 1 -- 172.21.15.120:0/2682797190 >> v1:172.21.15.120:6789/0 conn(0x7ff280070b60 legacy=0x7ff280155fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:12.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.678+0000 7ff27fe00640 1 -- 172.21.15.120:0/2682797190 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff280071b60 con 0x7ff28006db20 2024-04-18T04:50:12.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.682+0000 7ff27fe00640 1 --2- 172.21.15.120:0/2682797190 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff28006db20 0x7ff28006b280 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff278009d90 tx=0x7ff27801f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1c793bfe44f6d95 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:12.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.682+0000 7ff27e000640 1 -- 172.21.15.120:0/2682797190 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2780af600 con 0x7ff28006db20 2024-04-18T04:50:12.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.682+0000 7ff27e000640 1 -- 172.21.15.120:0/2682797190 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2780ab050 con 0x7ff28006db20 2024-04-18T04:50:12.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.682+0000 7ff27e000640 1 -- 172.21.15.120:0/2682797190 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2780af600 con 0x7ff28006db20 2024-04-18T04:50:12.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.686+0000 7ff286000640 1 -- 172.21.15.120:0/2682797190 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff28006db20 msgr2=0x7ff28006b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:12.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.686+0000 7ff286000640 1 --2- 172.21.15.120:0/2682797190 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff28006db20 0x7ff28006b280 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff278009d90 tx=0x7ff27801f150 comp rx=0 tx=0).stop 2024-04-18T04:50:12.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.686+0000 7ff286000640 1 -- 172.21.15.120:0/2682797190 shutdown_connections 2024-04-18T04:50:12.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.686+0000 7ff286000640 1 --2- 172.21.15.120:0/2682797190 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff28006db20 0x7ff28006b280 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:12.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.686+0000 7ff286000640 1 -- 172.21.15.120:0/2682797190 >> 172.21.15.120:0/2682797190 conn(0x7ff28006d000 msgr2=0x7ff28006d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:50:12.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.686+0000 7ff286000640 1 -- 172.21.15.120:0/2682797190 shutdown_connections 2024-04-18T04:50:12.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.686+0000 7ff286000640 1 -- 172.21.15.120:0/2682797190 wait complete. 2024-04-18T04:50:12.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.690+0000 7ff286000640 1 Processor -- start 2024-04-18T04:50:12.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.690+0000 7ff286000640 1 -- start start 2024-04-18T04:50:12.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.690+0000 7ff286000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff28006db20 0x7ff28006b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:12.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.694+0000 7ff286000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff280070b60 0x7ff2801534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:12.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.694+0000 7ff27f400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff28006db20 0x7ff28006b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:12.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.694+0000 7ff27f400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff28006db20 0x7ff28006b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:33884/0 (socket says 172.21.15.120:33884) 2024-04-18T04:50:12.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.694+0000 7ff286000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff280072360 0x7ff28014ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:12.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.694+0000 7ff286000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff280162ca0 con 0x7ff280070b60 2024-04-18T04:50:12.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.694+0000 7ff286000640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff280154660 con 0x7ff280072360 2024-04-18T04:50:12.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.694+0000 7ff286000640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2801ef230 con 0x7ff28006db20 2024-04-18T04:50:12.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.694+0000 7ff27f400640 1 -- 172.21.15.120:0/129329223 learned_addr learned my addr 172.21.15.120:0/129329223 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:50:12.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.694+0000 7ff27fe00640 1 --2- 172.21.15.120:0/129329223 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff280072360 0x7ff28014ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:12.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.694+0000 7ff27ea00640 1 --2- 172.21.15.120:0/129329223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff280070b60 0x7ff2801534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:12.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.694+0000 7ff27fe00640 1 -- 172.21.15.120:0/129329223 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff28006db20 msgr2=0x7ff28006b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:12.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.694+0000 7ff27fe00640 1 --2- 172.21.15.120:0/129329223 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff28006db20 0x7ff28006b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:12.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.694+0000 7ff27fe00640 1 -- 172.21.15.120:0/129329223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff280070b60 msgr2=0x7ff2801534c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:12.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.694+0000 7ff27fe00640 1 --2- 172.21.15.120:0/129329223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff280070b60 0x7ff2801534c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:12.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.694+0000 7ff27fe00640 1 -- 172.21.15.120:0/129329223 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff278009a70 con 0x7ff280072360 2024-04-18T04:50:12.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.694+0000 7ff27ea00640 1 --2- 172.21.15.120:0/129329223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff280070b60 0x7ff2801534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:50:12.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.698+0000 7ff27fe00640 1 --2- 172.21.15.120:0/129329223 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff280072360 0x7ff28014ac70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff28006aed0 tx=0x7ff27801bef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:12.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.698+0000 7ff277400640 1 -- 172.21.15.120:0/129329223 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2780bf070 con 0x7ff280072360 2024-04-18T04:50:12.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.698+0000 7ff277400640 1 -- 172.21.15.120:0/129329223 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff278004210 con 0x7ff280072360 2024-04-18T04:50:12.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.698+0000 7ff277400640 1 -- 172.21.15.120:0/129329223 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2780045a0 con 0x7ff280072360 2024-04-18T04:50:12.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.698+0000 7ff286000640 1 -- 172.21.15.120:0/129329223 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2801ef6c0 con 0x7ff280072360 2024-04-18T04:50:12.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.702+0000 7ff286000640 1 -- 172.21.15.120:0/129329223 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff28014a790 con 0x7ff280072360 2024-04-18T04:50:12.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.702+0000 7ff274c00640 1 -- 172.21.15.120:0/129329223 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff250005260 con 0x7ff280072360 2024-04-18T04:50:12.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.706+0000 7ff277400640 1 -- 172.21.15.120:0/129329223 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff2780b6070 con 0x7ff280072360 2024-04-18T04:50:12.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.706+0000 7ff277400640 1 --2- 172.21.15.120:0/129329223 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff25c066760 0x7ff25c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:12.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.706+0000 7ff277400640 1 -- 172.21.15.120:0/129329223 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6835+0+0 (secure 0 0 0) 0x7ff278121ff0 con 0x7ff280072360 2024-04-18T04:50:12.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.706+0000 7ff27f400640 1 --2- 172.21.15.120:0/129329223 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff25c066760 0x7ff25c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:12.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.706+0000 7ff27f400640 1 --2- 172.21.15.120:0/129329223 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff25c066760 0x7ff25c068c20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff2700011f0 tx=0x7ff270009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:12.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:12.722+0000 7ff277400640 1 -- 172.21.15.120:0/129329223 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7ff2780f28d0 con 0x7ff280072360 2024-04-18T04:50:13.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:13.198+0000 7ff274c00640 1 -- 172.21.15.120:0/129329223 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff250005a90 con 0x7ff280072360 2024-04-18T04:50:13.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:13.198+0000 7ff277400640 1 -- 172.21.15.120:0/129329223 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+6288 (secure 0 0 0) 0x7ff2780b4020 con 0x7ff280072360 2024-04-18T04:50:13.201 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:50:13.202 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4967,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:48:52.020151+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5130":{"gid":5130,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":23,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:50:13.202 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 27 2024-04-18T04:50:13.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:13.202+0000 7ff274c00640 1 -- 172.21.15.120:0/129329223 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff25c066760 msgr2=0x7ff25c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:13.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:13.202+0000 7ff274c00640 1 --2- 172.21.15.120:0/129329223 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff25c066760 0x7ff25c068c20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff2700011f0 tx=0x7ff270009040 comp rx=0 tx=0).stop 2024-04-18T04:50:13.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:13.202+0000 7ff274c00640 1 -- 172.21.15.120:0/129329223 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff280072360 msgr2=0x7ff28014ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:13.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:13.202+0000 7ff274c00640 1 --2- 172.21.15.120:0/129329223 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff280072360 0x7ff28014ac70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff28006aed0 tx=0x7ff27801bef0 comp rx=0 tx=0).stop 2024-04-18T04:50:13.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:13.206+0000 7ff274c00640 1 -- 172.21.15.120:0/129329223 shutdown_connections 2024-04-18T04:50:13.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:13.206+0000 7ff274c00640 1 --2- 172.21.15.120:0/129329223 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff25c066760 0x7ff25c068c20 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:13.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:13.206+0000 7ff274c00640 1 --2- 172.21.15.120:0/129329223 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff280072360 0x7ff28014ac70 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:13.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:13.206+0000 7ff274c00640 1 --2- 172.21.15.120:0/129329223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff280070b60 0x7ff2801534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:13.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:13.206+0000 7ff274c00640 1 --2- 172.21.15.120:0/129329223 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff28006db20 0x7ff28006b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:13.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:13.206+0000 7ff274c00640 1 -- 172.21.15.120:0/129329223 >> 172.21.15.120:0/129329223 conn(0x7ff28006d000 msgr2=0x7ff28006d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:50:13.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:13.206+0000 7ff274c00640 1 -- 172.21.15.120:0/129329223 shutdown_connections 2024-04-18T04:50:13.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:13.206+0000 7ff274c00640 1 -- 172.21.15.120:0/129329223 wait complete. 2024-04-18T04:50:13.249 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-18T04:50:15.250 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:50:15.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.650+0000 7ff240e00640 1 Processor -- start 2024-04-18T04:50:15.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.650+0000 7ff240e00640 1 -- start start 2024-04-18T04:50:15.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.650+0000 7ff240e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff23c0c9890 0x7ff23c15e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:15.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.650+0000 7ff240e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff23c0c3fe0 0x7ff23c0c4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:15.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.650+0000 7ff240e00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff23c0c9cf0 con 0x7ff23c157c40 2024-04-18T04:50:15.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.650+0000 7ff240e00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff23c15e900 con 0x7ff23c0c3fe0 2024-04-18T04:50:15.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.650+0000 7ff240e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c0c49b0 con 0x7ff23c0c9890 2024-04-18T04:50:15.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.654+0000 7ff239e00640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff23c157c40 0x7ff23c0cf310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:51808/0 (socket says 172.21.15.120:51808) 2024-04-18T04:50:15.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.654+0000 7ff239e00640 1 -- 172.21.15.120:0/1966610645 learned_addr learned my addr 172.21.15.120:0/1966610645 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:50:15.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.654+0000 7ff239400640 1 --2- 172.21.15.120:0/1966610645 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff23c0c9890 0x7ff23c15e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:15.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.654+0000 7ff23a800640 1 --2- 172.21.15.120:0/1966610645 >> v2:172.21.15.120:3300/0 conn(0x7ff23c0c3fe0 0x7ff23c0c4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:15.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.658+0000 7ff238a00640 1 -- 172.21.15.120:0/1966610645 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 690760673 0 0) 0x7ff23c0c9cf0 con 0x7ff23c157c40 2024-04-18T04:50:15.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.658+0000 7ff238a00640 1 -- 172.21.15.120:0/1966610645 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff220003530 con 0x7ff23c157c40 2024-04-18T04:50:15.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.658+0000 7ff239400640 1 -- 172.21.15.120:0/1966610645 >> v2:172.21.15.120:3300/0 conn(0x7ff23c0c3fe0 msgr2=0x7ff23c0c4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:50:15.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.658+0000 7ff239400640 1 --2- 172.21.15.120:0/1966610645 >> v2:172.21.15.120:3300/0 conn(0x7ff23c0c3fe0 0x7ff23c0c4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:15.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.658+0000 7ff239400640 1 -- 172.21.15.120:0/1966610645 >> v1:172.21.15.132:6789/0 conn(0x7ff23c157c40 legacy=0x7ff23c0cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:15.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.658+0000 7ff239400640 1 -- 172.21.15.120:0/1966610645 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff23c158020 con 0x7ff23c0c9890 2024-04-18T04:50:15.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.694+0000 7ff239400640 1 --2- 172.21.15.120:0/1966610645 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff23c0c9890 0x7ff23c15e3c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff22c0097c0 tx=0x7ff22c01c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d87288e72d3671a server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:15.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.694+0000 7ff238a00640 1 -- 172.21.15.120:0/1966610645 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c0aa5f0 con 0x7ff23c0c9890 2024-04-18T04:50:15.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.694+0000 7ff238a00640 1 -- 172.21.15.120:0/1966610645 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22c0aa750 con 0x7ff23c0c9890 2024-04-18T04:50:15.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.694+0000 7ff238a00640 1 -- 172.21.15.120:0/1966610645 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c0aab20 con 0x7ff23c0c9890 2024-04-18T04:50:15.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.694+0000 7ff240e00640 1 -- 172.21.15.120:0/1966610645 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff23c0c9890 msgr2=0x7ff23c15e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:15.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.694+0000 7ff240e00640 1 --2- 172.21.15.120:0/1966610645 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff23c0c9890 0x7ff23c15e3c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff22c0097c0 tx=0x7ff22c01c490 comp rx=0 tx=0).stop 2024-04-18T04:50:15.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.694+0000 7ff240e00640 1 -- 172.21.15.120:0/1966610645 shutdown_connections 2024-04-18T04:50:15.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.694+0000 7ff240e00640 1 --2- 172.21.15.120:0/1966610645 >> v2:172.21.15.120:3300/0 conn(0x7ff23c0c3fe0 0x7ff23c0c4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:15.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.694+0000 7ff240e00640 1 --2- 172.21.15.120:0/1966610645 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff23c0c9890 0x7ff23c15e3c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:15.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.694+0000 7ff240e00640 1 -- 172.21.15.120:0/1966610645 >> 172.21.15.120:0/1966610645 conn(0x7ff23c065fc0 msgr2=0x7ff23c0663d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:50:15.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.698+0000 7ff240e00640 1 -- 172.21.15.120:0/1966610645 shutdown_connections 2024-04-18T04:50:15.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.698+0000 7ff240e00640 1 -- 172.21.15.120:0/1966610645 wait complete. 2024-04-18T04:50:15.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.698+0000 7ff240e00640 1 Processor -- start 2024-04-18T04:50:15.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.702+0000 7ff240e00640 1 -- start start 2024-04-18T04:50:15.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.702+0000 7ff240e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff23c0c3fe0 0x7ff23c15aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:15.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.702+0000 7ff240e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff23c0c9890 0x7ff23c1596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:15.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.702+0000 7ff240e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff23c157c40 0x7ff23c0c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:15.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.702+0000 7ff240e00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c15a3f0 con 0x7ff23c0c3fe0 2024-04-18T04:50:15.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.702+0000 7ff240e00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c158210 con 0x7ff23c157c40 2024-04-18T04:50:15.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.702+0000 7ff240e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c158700 con 0x7ff23c0c9890 2024-04-18T04:50:15.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.702+0000 7ff239e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff23c0c3fe0 0x7ff23c15aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:15.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.702+0000 7ff239e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff23c0c3fe0 0x7ff23c15aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35578/0 (socket says 172.21.15.120:35578) 2024-04-18T04:50:15.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.702+0000 7ff239e00640 1 -- 172.21.15.120:0/3823790379 learned_addr learned my addr 172.21.15.120:0/3823790379 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:50:15.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.702+0000 7ff239400640 1 --2- 172.21.15.120:0/3823790379 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff23c0c9890 0x7ff23c1596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:15.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.702+0000 7ff23a800640 1 --2- 172.21.15.120:0/3823790379 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff23c157c40 0x7ff23c0c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:15.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.702+0000 7ff239400640 1 -- 172.21.15.120:0/3823790379 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff23c157c40 msgr2=0x7ff23c0c6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:15.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.702+0000 7ff239400640 1 --2- 172.21.15.120:0/3823790379 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff23c157c40 0x7ff23c0c6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:15.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.702+0000 7ff239400640 1 -- 172.21.15.120:0/3823790379 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff23c0c3fe0 msgr2=0x7ff23c15aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:15.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.702+0000 7ff239400640 1 --2- 172.21.15.120:0/3823790379 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff23c0c3fe0 0x7ff23c15aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:15.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.702+0000 7ff239400640 1 -- 172.21.15.120:0/3823790379 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff22c009420 con 0x7ff23c0c9890 2024-04-18T04:50:15.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.702+0000 7ff239400640 1 --2- 172.21.15.120:0/3823790379 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff23c0c9890 0x7ff23c1596d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff22c0ab000 tx=0x7ff22c01acd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:15.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.706+0000 7ff232000640 1 -- 172.21.15.120:0/3823790379 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c0be610 con 0x7ff23c0c9890 2024-04-18T04:50:15.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.706+0000 7ff240e00640 1 -- 172.21.15.120:0/3823790379 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff23c15afe0 con 0x7ff23c0c9890 2024-04-18T04:50:15.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.706+0000 7ff240e00640 1 -- 172.21.15.120:0/3823790379 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff23c158420 con 0x7ff23c0c9890 2024-04-18T04:50:15.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.706+0000 7ff240e00640 1 -- 172.21.15.120:0/3823790379 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff23c0c6ab0 con 0x7ff23c0c9890 2024-04-18T04:50:15.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.710+0000 7ff232000640 1 -- 172.21.15.120:0/3823790379 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22c0be770 con 0x7ff23c0c9890 2024-04-18T04:50:15.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.710+0000 7ff232000640 1 -- 172.21.15.120:0/3823790379 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c0be610 con 0x7ff23c0c9890 2024-04-18T04:50:15.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.718+0000 7ff232000640 1 -- 172.21.15.120:0/3823790379 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff22c0be8e0 con 0x7ff23c0c9890 2024-04-18T04:50:15.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.718+0000 7ff232000640 1 --2- 172.21.15.120:0/3823790379 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff21c066720 0x7ff21c068be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:15.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.722+0000 7ff239e00640 1 --2- 172.21.15.120:0/3823790379 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff21c066720 0x7ff21c068be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:15.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.722+0000 7ff232000640 1 -- 172.21.15.120:0/3823790379 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6835+0+0 (secure 0 0 0) 0x7ff22c0a7070 con 0x7ff23c0c9890 2024-04-18T04:50:15.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.730+0000 7ff239e00640 1 --2- 172.21.15.120:0/3823790379 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff21c066720 0x7ff21c068be0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff2280011f0 tx=0x7ff228009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:15.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:15.730+0000 7ff232000640 1 -- 172.21.15.120:0/3823790379 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7ff22c0ebca0 con 0x7ff23c0c9890 2024-04-18T04:50:16.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:16.246+0000 7ff240e00640 1 -- 172.21.15.120:0/3823790379 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff23c072a70 con 0x7ff23c0c9890 2024-04-18T04:50:16.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:16.250+0000 7ff232000640 1 -- 172.21.15.120:0/3823790379 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+6288 (secure 0 0 0) 0x7ff22c0ef2c0 con 0x7ff23c0c9890 2024-04-18T04:50:16.251 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:50:16.251 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4967,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:48:52.020151+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5130":{"gid":5130,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":23,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:50:16.252 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 27 2024-04-18T04:50:16.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:16.254+0000 7ff240e00640 1 -- 172.21.15.120:0/3823790379 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff21c066720 msgr2=0x7ff21c068be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:16.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:16.254+0000 7ff240e00640 1 --2- 172.21.15.120:0/3823790379 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff21c066720 0x7ff21c068be0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff2280011f0 tx=0x7ff228009040 comp rx=0 tx=0).stop 2024-04-18T04:50:16.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:16.254+0000 7ff240e00640 1 -- 172.21.15.120:0/3823790379 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff23c0c9890 msgr2=0x7ff23c1596d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:16.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:16.254+0000 7ff240e00640 1 --2- 172.21.15.120:0/3823790379 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff23c0c9890 0x7ff23c1596d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff22c0ab000 tx=0x7ff22c01acd0 comp rx=0 tx=0).stop 2024-04-18T04:50:16.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:16.258+0000 7ff240e00640 1 -- 172.21.15.120:0/3823790379 shutdown_connections 2024-04-18T04:50:16.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:16.258+0000 7ff240e00640 1 --2- 172.21.15.120:0/3823790379 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff21c066720 0x7ff21c068be0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:16.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:16.258+0000 7ff240e00640 1 --2- 172.21.15.120:0/3823790379 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff23c157c40 0x7ff23c0c6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:16.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:16.258+0000 7ff240e00640 1 --2- 172.21.15.120:0/3823790379 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff23c0c9890 0x7ff23c1596d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:16.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:16.258+0000 7ff240e00640 1 --2- 172.21.15.120:0/3823790379 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff23c0c3fe0 0x7ff23c15aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:16.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:16.258+0000 7ff240e00640 1 -- 172.21.15.120:0/3823790379 >> 172.21.15.120:0/3823790379 conn(0x7ff23c065fc0 msgr2=0x7ff23c0cce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:50:16.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:16.258+0000 7ff240e00640 1 -- 172.21.15.120:0/3823790379 shutdown_connections 2024-04-18T04:50:16.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:16.258+0000 7ff240e00640 1 -- 172.21.15.120:0/3823790379 wait complete. 2024-04-18T04:50:16.301 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-18T04:50:18.302 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:50:18.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.586+0000 7f9b8ae00640 1 Processor -- start 2024-04-18T04:50:18.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.590+0000 7f9b8ae00640 1 -- start start 2024-04-18T04:50:18.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.590+0000 7f9b8ae00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9b8414fab0 0x7f9b8406c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:18.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.590+0000 7f9b8ae00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9b841562a0 0x7f9b840c6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:18.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.590+0000 7f9b8ae00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b840c6f00 con 0x7f9b8406b660 2024-04-18T04:50:18.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.590+0000 7f9b8ae00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b8406cb30 con 0x7f9b841562a0 2024-04-18T04:50:18.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.590+0000 7f9b8ae00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b840c57c0 con 0x7f9b8414fab0 2024-04-18T04:50:18.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.594+0000 7f9b83e00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9b8414fab0 0x7f9b8406c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:18.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.594+0000 7f9b83e00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9b8414fab0 0x7f9b8406c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:39320/0 (socket says 172.21.15.120:39320) 2024-04-18T04:50:18.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.594+0000 7f9b83e00640 1 -- 172.21.15.120:0/3922888945 learned_addr learned my addr 172.21.15.120:0/3922888945 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:50:18.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.594+0000 7f9b83400640 1 --2- 172.21.15.120:0/3922888945 >> v2:172.21.15.120:3300/0 conn(0x7f9b841562a0 0x7f9b840c6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:18.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.598+0000 7f9b83e00640 1 -- 172.21.15.120:0/3922888945 >> v2:172.21.15.120:3300/0 conn(0x7f9b841562a0 msgr2=0x7f9b840c6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:50:18.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.598+0000 7f9b83e00640 1 --2- 172.21.15.120:0/3922888945 >> v2:172.21.15.120:3300/0 conn(0x7f9b841562a0 0x7f9b840c6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:18.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.598+0000 7f9b83e00640 1 -- 172.21.15.120:0/3922888945 >> v1:172.21.15.120:6789/0 conn(0x7f9b8406b660 legacy=0x7f9b84158d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:50:18.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.598+0000 7f9b83e00640 1 -- 172.21.15.120:0/3922888945 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b840c5d80 con 0x7f9b8414fab0 2024-04-18T04:50:18.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.614+0000 7f9b83e00640 1 --2- 172.21.15.120:0/3922888945 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b8414fab0 0x7f9b8406c5f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9b84073f20 tx=0x7f9b740211e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d339d0f024a49e87 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:18.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.614+0000 7f9b82a00640 1 -- 172.21.15.120:0/3922888945 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b740b3410 con 0x7f9b8414fab0 2024-04-18T04:50:18.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.614+0000 7f9b82a00640 1 -- 172.21.15.120:0/3922888945 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b740ad030 con 0x7f9b8414fab0 2024-04-18T04:50:18.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.614+0000 7f9b82a00640 1 -- 172.21.15.120:0/3922888945 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b740b3790 con 0x7f9b8414fab0 2024-04-18T04:50:18.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.618+0000 7f9b8ae00640 1 -- 172.21.15.120:0/3922888945 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b8414fab0 msgr2=0x7f9b8406c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:18.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.618+0000 7f9b8ae00640 1 --2- 172.21.15.120:0/3922888945 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b8414fab0 0x7f9b8406c5f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9b84073f20 tx=0x7f9b740211e0 comp rx=0 tx=0).stop 2024-04-18T04:50:18.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.618+0000 7f9b8ae00640 1 -- 172.21.15.120:0/3922888945 shutdown_connections 2024-04-18T04:50:18.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.618+0000 7f9b8ae00640 1 --2- 172.21.15.120:0/3922888945 >> v2:172.21.15.120:3300/0 conn(0x7f9b841562a0 0x7f9b840c6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:18.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.618+0000 7f9b8ae00640 1 --2- 172.21.15.120:0/3922888945 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b8414fab0 0x7f9b8406c5f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:18.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.618+0000 7f9b8ae00640 1 -- 172.21.15.120:0/3922888945 >> 172.21.15.120:0/3922888945 conn(0x7f9b840c78c0 msgr2=0x7f9b840c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:50:18.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.618+0000 7f9b8ae00640 1 -- 172.21.15.120:0/3922888945 shutdown_connections 2024-04-18T04:50:18.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.618+0000 7f9b8ae00640 1 -- 172.21.15.120:0/3922888945 wait complete. 2024-04-18T04:50:18.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.622+0000 7f9b8ae00640 1 Processor -- start 2024-04-18T04:50:18.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.622+0000 7f9b8ae00640 1 -- start start 2024-04-18T04:50:18.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.622+0000 7f9b8ae00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b8406b660 0x7f9b841e20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:18.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.622+0000 7f9b8ae00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9b841562a0 0x7f9b84156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:18.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.622+0000 7f9b83400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9b841562a0 0x7f9b84156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:18.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.622+0000 7f9b83400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9b841562a0 0x7f9b84156cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35606/0 (socket says 172.21.15.120:35606) 2024-04-18T04:50:18.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.622+0000 7f9b8ae00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b84073400 0x7f9b841571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:18.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.622+0000 7f9b8ae00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b84158cb0 con 0x7f9b841562a0 2024-04-18T04:50:18.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.622+0000 7f9b8ae00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b841f3250 con 0x7f9b84073400 2024-04-18T04:50:18.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.622+0000 7f9b8ae00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b841f23f0 con 0x7f9b8406b660 2024-04-18T04:50:18.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.622+0000 7f9b83e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b8406b660 0x7f9b841e20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:18.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.622+0000 7f9b83e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b8406b660 0x7f9b841e20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:33916/0 (socket says 172.21.15.120:33916) 2024-04-18T04:50:18.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.622+0000 7f9b83e00640 1 -- 172.21.15.120:0/2479903639 learned_addr learned my addr 172.21.15.120:0/2479903639 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:50:18.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.622+0000 7f9b88e00640 1 --2- 172.21.15.120:0/2479903639 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b84073400 0x7f9b841571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:18.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.626+0000 7f9b88e00640 1 -- 172.21.15.120:0/2479903639 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b8406b660 msgr2=0x7f9b841e20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:18.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.626+0000 7f9b88e00640 1 --2- 172.21.15.120:0/2479903639 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b8406b660 0x7f9b841e20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:18.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.626+0000 7f9b88e00640 1 -- 172.21.15.120:0/2479903639 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9b841562a0 msgr2=0x7f9b84156cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:18.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.626+0000 7f9b88e00640 1 --2- 172.21.15.120:0/2479903639 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9b841562a0 0x7f9b84156cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:18.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.626+0000 7f9b88e00640 1 -- 172.21.15.120:0/2479903639 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b74008550 con 0x7f9b84073400 2024-04-18T04:50:18.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.626+0000 7f9b88e00640 1 --2- 172.21.15.120:0/2479903639 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b84073400 0x7f9b841571f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c00c780 tx=0x7f9b7c00cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:18.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.626+0000 7f9b83400640 1 --2- 172.21.15.120:0/2479903639 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9b841562a0 0x7f9b84156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-04-18T04:50:18.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.626+0000 7f9b7be00640 1 -- 172.21.15.120:0/2479903639 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c00a840 con 0x7f9b84073400 2024-04-18T04:50:18.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.626+0000 7f9b8ae00640 1 -- 172.21.15.120:0/2479903639 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b841f26d0 con 0x7f9b84073400 2024-04-18T04:50:18.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.626+0000 7f9b8ae00640 1 -- 172.21.15.120:0/2479903639 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b841f2c90 con 0x7f9b84073400 2024-04-18T04:50:18.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.626+0000 7f9b7be00640 1 -- 172.21.15.120:0/2479903639 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b7c00a9a0 con 0x7f9b84073400 2024-04-18T04:50:18.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.626+0000 7f9b7be00640 1 -- 172.21.15.120:0/2479903639 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c00a840 con 0x7f9b84073400 2024-04-18T04:50:18.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.630+0000 7f9b8ae00640 1 -- 172.21.15.120:0/2479903639 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b5c005260 con 0x7f9b84073400 2024-04-18T04:50:18.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.630+0000 7f9b7be00640 1 -- 172.21.15.120:0/2479903639 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9b7c00ab50 con 0x7f9b84073400 2024-04-18T04:50:18.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.654+0000 7f9b7be00640 1 --2- 172.21.15.120:0/2479903639 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9b640666f0 0x7f9b64068bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:18.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.654+0000 7f9b7be00640 1 -- 172.21.15.120:0/2479903639 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f9b7c0845d0 con 0x7f9b84073400 2024-04-18T04:50:18.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.654+0000 7f9b83e00640 1 --2- 172.21.15.120:0/2479903639 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9b640666f0 0x7f9b64068bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:18.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.658+0000 7f9b83e00640 1 --2- 172.21.15.120:0/2479903639 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9b640666f0 0x7f9b64068bb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9b74021220 tx=0x7f9b7400b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:18.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:18.662+0000 7f9b7be00640 1 -- 172.21.15.120:0/2479903639 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f9b7c0513b0 con 0x7f9b84073400 2024-04-18T04:50:19.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:19.094+0000 7f9b8ae00640 1 -- 172.21.15.120:0/2479903639 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b5c005a90 con 0x7f9b84073400 2024-04-18T04:50:19.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:19.102+0000 7f9b7be00640 1 -- 172.21.15.120:0/2479903639 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+6288 (secure 0 0 0) 0x7f9b7c0549d0 con 0x7f9b84073400 2024-04-18T04:50:19.104 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:50:19.104 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4967,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:48:52.020151+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5130":{"gid":5130,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":23,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:50:19.104 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 27 2024-04-18T04:50:19.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:19.106+0000 7f9b8ae00640 1 -- 172.21.15.120:0/2479903639 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9b640666f0 msgr2=0x7f9b64068bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:19.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:19.106+0000 7f9b8ae00640 1 --2- 172.21.15.120:0/2479903639 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9b640666f0 0x7f9b64068bb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9b74021220 tx=0x7f9b7400b040 comp rx=0 tx=0).stop 2024-04-18T04:50:19.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:19.106+0000 7f9b8ae00640 1 -- 172.21.15.120:0/2479903639 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b84073400 msgr2=0x7f9b841571f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:19.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:19.106+0000 7f9b8ae00640 1 --2- 172.21.15.120:0/2479903639 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b84073400 0x7f9b841571f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c00c780 tx=0x7f9b7c00cc40 comp rx=0 tx=0).stop 2024-04-18T04:50:19.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:19.106+0000 7f9b8ae00640 1 -- 172.21.15.120:0/2479903639 shutdown_connections 2024-04-18T04:50:19.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:19.106+0000 7f9b8ae00640 1 --2- 172.21.15.120:0/2479903639 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9b640666f0 0x7f9b64068bb0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:19.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:19.106+0000 7f9b8ae00640 1 --2- 172.21.15.120:0/2479903639 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b84073400 0x7f9b841571f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:19.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:19.106+0000 7f9b8ae00640 1 --2- 172.21.15.120:0/2479903639 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9b841562a0 0x7f9b84156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:19.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:19.106+0000 7f9b8ae00640 1 --2- 172.21.15.120:0/2479903639 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b8406b660 0x7f9b841e20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:19.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:19.106+0000 7f9b8ae00640 1 -- 172.21.15.120:0/2479903639 >> 172.21.15.120:0/2479903639 conn(0x7f9b840c78c0 msgr2=0x7f9b840c7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:50:19.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:19.106+0000 7f9b8ae00640 1 -- 172.21.15.120:0/2479903639 shutdown_connections 2024-04-18T04:50:19.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:19.106+0000 7f9b8ae00640 1 -- 172.21.15.120:0/2479903639 wait complete. 2024-04-18T04:50:19.149 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-18T04:50:21.151 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:50:21.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.454+0000 7f4a51a00640 1 Processor -- start 2024-04-18T04:50:21.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.454+0000 7f4a51a00640 1 -- start start 2024-04-18T04:50:21.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.454+0000 7f4a51a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a4c06c6d0 0x7f4a4c0c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:21.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.454+0000 7f4a51a00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4a4c1699d0 0x7f4a4c169e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:21.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.454+0000 7f4a51a00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a4c06b800 con 0x7f4a4c163a90 2024-04-18T04:50:21.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.454+0000 7f4a51a00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a4c070130 con 0x7f4a4c1699d0 2024-04-18T04:50:21.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.454+0000 7f4a51a00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c0c72e0 con 0x7f4a4c06c6d0 2024-04-18T04:50:21.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.454+0000 7f4a4a000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a4c06c6d0 0x7f4a4c0c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:21.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.454+0000 7f4a4b400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4a4c1699d0 0x7f4a4c169e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:21.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.454+0000 7f4a4a000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a4c06c6d0 0x7f4a4c0c61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:37168/0 (socket says 172.21.15.120:37168) 2024-04-18T04:50:21.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.454+0000 7f4a4a000640 1 -- 172.21.15.120:0/500641607 learned_addr learned my addr 172.21.15.120:0/500641607 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:50:21.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.458+0000 7f4a4b400640 1 -- 172.21.15.120:0/500641607 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a4c06c6d0 msgr2=0x7f4a4c0c61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:50:21.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.458+0000 7f4a4b400640 1 --2- 172.21.15.120:0/500641607 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a4c06c6d0 0x7f4a4c0c61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:21.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.458+0000 7f4a4b400640 1 -- 172.21.15.120:0/500641607 >> v1:172.21.15.132:6789/0 conn(0x7f4a4c163a90 legacy=0x7f4a4c06bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:50:21.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.458+0000 7f4a4b400640 1 -- 172.21.15.120:0/500641607 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a4c0c6d20 con 0x7f4a4c1699d0 2024-04-18T04:50:21.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.462+0000 7f4a4b400640 1 --2- 172.21.15.120:0/500641607 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a4c1699d0 0x7f4a4c169e40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c00eb90 tx=0x7f4a3c027640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a62543ba9870bb06 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:21.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.462+0000 7f4a49600640 1 -- 172.21.15.120:0/500641607 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c00e3d0 con 0x7f4a4c1699d0 2024-04-18T04:50:21.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.462+0000 7f4a49600640 1 -- 172.21.15.120:0/500641607 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a3c00e530 con 0x7f4a4c1699d0 2024-04-18T04:50:21.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.462+0000 7f4a49600640 1 -- 172.21.15.120:0/500641607 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c00e6e0 con 0x7f4a4c1699d0 2024-04-18T04:50:21.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.466+0000 7f4a51a00640 1 -- 172.21.15.120:0/500641607 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a4c1699d0 msgr2=0x7f4a4c169e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:21.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.466+0000 7f4a51a00640 1 --2- 172.21.15.120:0/500641607 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a4c1699d0 0x7f4a4c169e40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c00eb90 tx=0x7f4a3c027640 comp rx=0 tx=0).stop 2024-04-18T04:50:21.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.466+0000 7f4a51a00640 1 -- 172.21.15.120:0/500641607 shutdown_connections 2024-04-18T04:50:21.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.466+0000 7f4a51a00640 1 --2- 172.21.15.120:0/500641607 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a4c1699d0 0x7f4a4c169e40 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:21.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.466+0000 7f4a51a00640 1 --2- 172.21.15.120:0/500641607 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a4c06c6d0 0x7f4a4c0c61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:21.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.466+0000 7f4a51a00640 1 -- 172.21.15.120:0/500641607 >> 172.21.15.120:0/500641607 conn(0x7f4a4c0c78c0 msgr2=0x7f4a4c0c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:50:21.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.470+0000 7f4a51a00640 1 -- 172.21.15.120:0/500641607 shutdown_connections 2024-04-18T04:50:21.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.470+0000 7f4a51a00640 1 -- 172.21.15.120:0/500641607 wait complete. 2024-04-18T04:50:21.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.474+0000 7f4a51a00640 1 Processor -- start 2024-04-18T04:50:21.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.478+0000 7f4a51a00640 1 -- start start 2024-04-18T04:50:21.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.482+0000 7f4a51a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a4c06c6d0 0x7f4a4c162270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:21.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.482+0000 7f4a51a00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a4c163a90 0x7f4a4c166af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:21.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.482+0000 7f4a51a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a4c1699d0 0x7f4a4c167030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:21.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.482+0000 7f4a51a00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c0aad60 con 0x7f4a4c06c6d0 2024-04-18T04:50:21.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.482+0000 7f4a51a00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c1fc190 con 0x7f4a4c163a90 2024-04-18T04:50:21.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.482+0000 7f4a51a00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c1fc430 con 0x7f4a4c1699d0 2024-04-18T04:50:21.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.482+0000 7f4a4aa00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a4c06c6d0 0x7f4a4c162270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:21.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.482+0000 7f4a4b400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a4c1699d0 0x7f4a4c167030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:21.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.482+0000 7f4a4b400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a4c1699d0 0x7f4a4c167030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:37174/0 (socket says 172.21.15.120:37174) 2024-04-18T04:50:21.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.482+0000 7f4a4b400640 1 -- 172.21.15.120:0/2636771206 learned_addr learned my addr 172.21.15.120:0/2636771206 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:50:21.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.486+0000 7f4a4b400640 1 -- 172.21.15.120:0/2636771206 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a4c163a90 msgr2=0x7f4a4c166af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:21.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.486+0000 7f4a4b400640 1 --2- 172.21.15.120:0/2636771206 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a4c163a90 0x7f4a4c166af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:21.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.486+0000 7f4a4b400640 1 -- 172.21.15.120:0/2636771206 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a4c06c6d0 msgr2=0x7f4a4c162270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:21.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.486+0000 7f4a4b400640 1 --2- 172.21.15.120:0/2636771206 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a4c06c6d0 0x7f4a4c162270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:21.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.486+0000 7f4a4b400640 1 -- 172.21.15.120:0/2636771206 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a3c00e840 con 0x7f4a4c1699d0 2024-04-18T04:50:21.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.490+0000 7f4a4b400640 1 --2- 172.21.15.120:0/2636771206 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a4c1699d0 0x7f4a4c167030 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c0ba040 tx=0x7f4a3c0243e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:21.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.490+0000 7f4a42a00640 1 -- 172.21.15.120:0/2636771206 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c0c3650 con 0x7f4a4c1699d0 2024-04-18T04:50:21.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.490+0000 7f4a42a00640 1 -- 172.21.15.120:0/2636771206 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a3c0c37b0 con 0x7f4a4c1699d0 2024-04-18T04:50:21.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.490+0000 7f4a42a00640 1 -- 172.21.15.120:0/2636771206 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c0c3b60 con 0x7f4a4c1699d0 2024-04-18T04:50:21.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.494+0000 7f4a51a00640 1 -- 172.21.15.120:0/2636771206 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a4c1fc710 con 0x7f4a4c1699d0 2024-04-18T04:50:21.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.494+0000 7f4a51a00640 1 -- 172.21.15.120:0/2636771206 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a4c1fccd0 con 0x7f4a4c1699d0 2024-04-18T04:50:21.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.498+0000 7f4a42a00640 1 -- 172.21.15.120:0/2636771206 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4a3c0c3cc0 con 0x7f4a4c1699d0 2024-04-18T04:50:21.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.498+0000 7f4a42a00640 1 --2- 172.21.15.120:0/2636771206 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4a2c0666e0 0x7f4a2c068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:21.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.502+0000 7f4a4aa00640 1 --2- 172.21.15.120:0/2636771206 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4a2c0666e0 0x7f4a2c068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:21.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.502+0000 7f4a51a00640 1 -- 172.21.15.120:0/2636771206 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a4c073e10 con 0x7f4a4c1699d0 2024-04-18T04:50:21.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.514+0000 7f4a42a00640 1 -- 172.21.15.120:0/2636771206 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f4a3c0fbbc0 con 0x7f4a4c1699d0 2024-04-18T04:50:21.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.518+0000 7f4a4aa00640 1 --2- 172.21.15.120:0/2636771206 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4a2c0666e0 0x7f4a2c068ba0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4a44001f20 tx=0x7f4a44009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:21.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:21.522+0000 7f4a42a00640 1 -- 172.21.15.120:0/2636771206 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f4a3c0bc020 con 0x7f4a4c1699d0 2024-04-18T04:50:22.007 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:50:22.008 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4967,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:48:52.020151+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5130":{"gid":5130,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":23,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:50:22.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:22.002+0000 7f4a51a00640 1 -- 172.21.15.120:0/2636771206 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a4c072a70 con 0x7f4a4c1699d0 2024-04-18T04:50:22.008 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 27 2024-04-18T04:50:22.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:22.002+0000 7f4a42a00640 1 -- 172.21.15.120:0/2636771206 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+6288 (secure 0 0 0) 0x7f4a3c0f7800 con 0x7f4a4c1699d0 2024-04-18T04:50:22.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:22.014+0000 7f4a51a00640 1 -- 172.21.15.120:0/2636771206 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4a2c0666e0 msgr2=0x7f4a2c068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:22.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:22.014+0000 7f4a51a00640 1 --2- 172.21.15.120:0/2636771206 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4a2c0666e0 0x7f4a2c068ba0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4a44001f20 tx=0x7f4a44009040 comp rx=0 tx=0).stop 2024-04-18T04:50:22.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:22.014+0000 7f4a51a00640 1 -- 172.21.15.120:0/2636771206 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a4c1699d0 msgr2=0x7f4a4c167030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:22.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:22.014+0000 7f4a51a00640 1 --2- 172.21.15.120:0/2636771206 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a4c1699d0 0x7f4a4c167030 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c0ba040 tx=0x7f4a3c0243e0 comp rx=0 tx=0).stop 2024-04-18T04:50:22.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:22.022+0000 7f4a51a00640 1 -- 172.21.15.120:0/2636771206 shutdown_connections 2024-04-18T04:50:22.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:22.022+0000 7f4a51a00640 1 --2- 172.21.15.120:0/2636771206 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4a2c0666e0 0x7f4a2c068ba0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:22.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:22.022+0000 7f4a51a00640 1 --2- 172.21.15.120:0/2636771206 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a4c1699d0 0x7f4a4c167030 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:22.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:22.022+0000 7f4a51a00640 1 --2- 172.21.15.120:0/2636771206 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a4c163a90 0x7f4a4c166af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:22.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:22.022+0000 7f4a51a00640 1 --2- 172.21.15.120:0/2636771206 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a4c06c6d0 0x7f4a4c162270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:22.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:22.022+0000 7f4a51a00640 1 -- 172.21.15.120:0/2636771206 >> 172.21.15.120:0/2636771206 conn(0x7f4a4c0c78c0 msgr2=0x7f4a4c0c0910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:50:22.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:22.022+0000 7f4a51a00640 1 -- 172.21.15.120:0/2636771206 shutdown_connections 2024-04-18T04:50:22.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:22.022+0000 7f4a51a00640 1 -- 172.21.15.120:0/2636771206 wait complete. 2024-04-18T04:50:22.100 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-18T04:50:24.101 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:50:24.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.350+0000 7ff427e00640 1 Processor -- start 2024-04-18T04:50:24.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.354+0000 7ff427e00640 1 -- start start 2024-04-18T04:50:24.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.354+0000 7ff427e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff420156440 0x7ff4200c9560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:24.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.354+0000 7ff427e00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff4200c6940 0x7ff4200c76e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:24.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.354+0000 7ff427e00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4200c6db0 con 0x7ff4200c7300 2024-04-18T04:50:24.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.354+0000 7ff427e00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4200c8520 con 0x7ff420156440 2024-04-18T04:50:24.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.354+0000 7ff427e00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff420159fb0 con 0x7ff4200c6940 2024-04-18T04:50:24.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.358+0000 7ff425400640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7ff4200c7300 0x7ff42015a3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:57550/0 (socket says 172.21.15.120:57550) 2024-04-18T04:50:24.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.358+0000 7ff425400640 1 -- 172.21.15.120:0/3899249699 learned_addr learned my addr 172.21.15.120:0/3899249699 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:50:24.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.358+0000 7ff424a00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff420156440 0x7ff4200c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:24.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.358+0000 7ff425e00640 1 --2- 172.21.15.120:0/3899249699 >> v2:172.21.15.132:3300/0 conn(0x7ff4200c6940 0x7ff4200c76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:24.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.358+0000 7ff424a00640 1 -- 172.21.15.120:0/3899249699 >> v2:172.21.15.132:3300/0 conn(0x7ff4200c6940 msgr2=0x7ff4200c76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:50:24.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.358+0000 7ff424a00640 1 --2- 172.21.15.120:0/3899249699 >> v2:172.21.15.132:3300/0 conn(0x7ff4200c6940 0x7ff4200c76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:24.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.358+0000 7ff424a00640 1 -- 172.21.15.120:0/3899249699 >> v1:172.21.15.120:6789/0 conn(0x7ff4200c7300 legacy=0x7ff42015a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:24.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.358+0000 7ff424a00640 1 -- 172.21.15.120:0/3899249699 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff420070ce0 con 0x7ff420156440 2024-04-18T04:50:24.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.366+0000 7ff424a00640 1 --2- 172.21.15.120:0/3899249699 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff420156440 0x7ff4200c9560 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff420070800 tx=0x7ff40c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16eccc124ce0ce04 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:24.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.366+0000 7ff41fe00640 1 -- 172.21.15.120:0/3899249699 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c0ab600 con 0x7ff420156440 2024-04-18T04:50:24.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.366+0000 7ff41fe00640 1 -- 172.21.15.120:0/3899249699 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40c0a7050 con 0x7ff420156440 2024-04-18T04:50:24.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.366+0000 7ff41fe00640 1 -- 172.21.15.120:0/3899249699 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c0ab980 con 0x7ff420156440 2024-04-18T04:50:24.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.366+0000 7ff427e00640 1 -- 172.21.15.120:0/3899249699 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff420156440 msgr2=0x7ff4200c9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:24.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.366+0000 7ff427e00640 1 --2- 172.21.15.120:0/3899249699 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff420156440 0x7ff4200c9560 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff420070800 tx=0x7ff40c01c480 comp rx=0 tx=0).stop 2024-04-18T04:50:24.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.366+0000 7ff427e00640 1 -- 172.21.15.120:0/3899249699 shutdown_connections 2024-04-18T04:50:24.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.366+0000 7ff427e00640 1 --2- 172.21.15.120:0/3899249699 >> v2:172.21.15.132:3300/0 conn(0x7ff4200c6940 0x7ff4200c76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:24.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.366+0000 7ff427e00640 1 --2- 172.21.15.120:0/3899249699 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff420156440 0x7ff4200c9560 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:24.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.366+0000 7ff427e00640 1 -- 172.21.15.120:0/3899249699 >> 172.21.15.120:0/3899249699 conn(0x7ff4200c8a40 msgr2=0x7ff4200c8e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:50:24.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.366+0000 7ff427e00640 1 -- 172.21.15.120:0/3899249699 shutdown_connections 2024-04-18T04:50:24.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.366+0000 7ff427e00640 1 -- 172.21.15.120:0/3899249699 wait complete. 2024-04-18T04:50:24.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.370+0000 7ff427e00640 1 Processor -- start 2024-04-18T04:50:24.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.370+0000 7ff427e00640 1 -- start start 2024-04-18T04:50:24.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.370+0000 7ff427e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4200c6940 0x7ff42013e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:24.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.370+0000 7ff427e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4200c7300 0x7ff4200cb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:24.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.370+0000 7ff427e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff420156440 0x7ff4201f9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:24.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.370+0000 7ff424a00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4200c7300 0x7ff4200cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:24.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.370+0000 7ff425400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4200c6940 0x7ff42013e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:24.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.370+0000 7ff424a00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4200c7300 0x7ff4200cb650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:37776/0 (socket says 172.21.15.120:37776) 2024-04-18T04:50:24.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.370+0000 7ff425400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4200c6940 0x7ff42013e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38998/0 (socket says 172.21.15.120:38998) 2024-04-18T04:50:24.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.370+0000 7ff425e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff420156440 0x7ff4201f9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:24.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.370+0000 7ff425e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff420156440 0x7ff4201f9470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:37176/0 (socket says 172.21.15.120:37176) 2024-04-18T04:50:24.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.374+0000 7ff427e00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42013f990 con 0x7ff4200c6940 2024-04-18T04:50:24.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.374+0000 7ff427e00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff420158320 con 0x7ff4200c7300 2024-04-18T04:50:24.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.374+0000 7ff427e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff42013dc00 con 0x7ff420156440 2024-04-18T04:50:24.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.374+0000 7ff424a00640 1 -- 172.21.15.120:0/549804698 learned_addr learned my addr 172.21.15.120:0/549804698 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:50:24.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.374+0000 7ff425e00640 1 -- 172.21.15.120:0/549804698 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4200c7300 msgr2=0x7ff4200cb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:24.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.374+0000 7ff425e00640 1 --2- 172.21.15.120:0/549804698 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4200c7300 0x7ff4200cb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:24.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.374+0000 7ff425e00640 1 -- 172.21.15.120:0/549804698 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4200c6940 msgr2=0x7ff42013e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:24.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.374+0000 7ff425e00640 1 --2- 172.21.15.120:0/549804698 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4200c6940 0x7ff42013e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:24.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.374+0000 7ff425e00640 1 -- 172.21.15.120:0/549804698 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40c009420 con 0x7ff420156440 2024-04-18T04:50:24.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.374+0000 7ff425e00640 1 --2- 172.21.15.120:0/549804698 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff420156440 0x7ff4201f9470 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff418007cf0 tx=0x7ff41800e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:24.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.374+0000 7ff41d600640 1 -- 172.21.15.120:0/549804698 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff418018070 con 0x7ff420156440 2024-04-18T04:50:24.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.374+0000 7ff41d600640 1 -- 172.21.15.120:0/549804698 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41800edd0 con 0x7ff420156440 2024-04-18T04:50:24.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.374+0000 7ff41d600640 1 -- 172.21.15.120:0/549804698 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff418003be0 con 0x7ff420156440 2024-04-18T04:50:24.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.374+0000 7ff427e00640 1 -- 172.21.15.120:0/549804698 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff42013d920 con 0x7ff420156440 2024-04-18T04:50:24.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.374+0000 7ff427e00640 1 -- 172.21.15.120:0/549804698 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff420157cd0 con 0x7ff420156440 2024-04-18T04:50:24.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.378+0000 7ff412a00640 1 -- 172.21.15.120:0/549804698 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff420158490 con 0x7ff420156440 2024-04-18T04:50:24.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.382+0000 7ff41d600640 1 -- 172.21.15.120:0/549804698 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff418003d40 con 0x7ff420156440 2024-04-18T04:50:24.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.386+0000 7ff41d600640 1 --2- 172.21.15.120:0/549804698 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff400066690 0x7ff400068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:24.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.386+0000 7ff41d600640 1 -- 172.21.15.120:0/549804698 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6835+0+0 (secure 0 0 0) 0x7ff418084770 con 0x7ff420156440 2024-04-18T04:50:24.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.386+0000 7ff425400640 1 --2- 172.21.15.120:0/549804698 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff400066690 0x7ff400068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:24.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.390+0000 7ff41d600640 1 -- 172.21.15.120:0/549804698 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7ff418051660 con 0x7ff420156440 2024-04-18T04:50:24.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.390+0000 7ff425400640 1 --2- 172.21.15.120:0/549804698 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff400066690 0x7ff400068b50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff414005890 tx=0x7ff414009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:24.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.882+0000 7ff412a00640 1 -- 172.21.15.120:0/549804698 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff420072a70 con 0x7ff420156440 2024-04-18T04:50:24.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.882+0000 7ff41d600640 1 -- 172.21.15.120:0/549804698 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+6288 (secure 0 0 0) 0x7ff418054c80 con 0x7ff420156440 2024-04-18T04:50:24.886 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:50:24.886 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4967,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:48:52.020151+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4275,"mds_2":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.120:6836/1079090700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1079090700},{"type":"v1","addr":"172.21.15.120:6836","nonce":1079090700}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5130":{"gid":5130,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":23,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:50:24.886 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 27 2024-04-18T04:50:24.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.886+0000 7ff412a00640 1 -- 172.21.15.120:0/549804698 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff400066690 msgr2=0x7ff400068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:24.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.886+0000 7ff412a00640 1 --2- 172.21.15.120:0/549804698 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff400066690 0x7ff400068b50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff414005890 tx=0x7ff414009040 comp rx=0 tx=0).stop 2024-04-18T04:50:24.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.886+0000 7ff412a00640 1 -- 172.21.15.120:0/549804698 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff420156440 msgr2=0x7ff4201f9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:24.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.886+0000 7ff412a00640 1 --2- 172.21.15.120:0/549804698 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff420156440 0x7ff4201f9470 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff418007cf0 tx=0x7ff41800e4b0 comp rx=0 tx=0).stop 2024-04-18T04:50:24.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.894+0000 7ff412a00640 1 -- 172.21.15.120:0/549804698 shutdown_connections 2024-04-18T04:50:24.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.894+0000 7ff412a00640 1 --2- 172.21.15.120:0/549804698 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff400066690 0x7ff400068b50 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:24.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.894+0000 7ff412a00640 1 --2- 172.21.15.120:0/549804698 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff420156440 0x7ff4201f9470 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:24.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.894+0000 7ff412a00640 1 --2- 172.21.15.120:0/549804698 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4200c7300 0x7ff4200cb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:24.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.894+0000 7ff412a00640 1 --2- 172.21.15.120:0/549804698 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4200c6940 0x7ff42013e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:24.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.894+0000 7ff412a00640 1 -- 172.21.15.120:0/549804698 >> 172.21.15.120:0/549804698 conn(0x7ff4200c8a40 msgr2=0x7ff42006c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:50:24.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.894+0000 7ff412a00640 1 -- 172.21.15.120:0/549804698 shutdown_connections 2024-04-18T04:50:24.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:24.894+0000 7ff412a00640 1 -- 172.21.15.120:0/549804698 wait complete. 2024-04-18T04:50:24.951 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-18T04:50:26.952 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:50:27.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.278+0000 7f0df9800640 1 Processor -- start 2024-04-18T04:50:27.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.278+0000 7f0df9800640 1 -- start start 2024-04-18T04:50:27.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.282+0000 7f0df9800640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0df414fab0 0x7f0df406c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:27.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.282+0000 7f0df9800640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0df41562a0 0x7f0df40c6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:27.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.282+0000 7f0df9800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0df406b660 0x7f0df406baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:27.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.282+0000 7f0df9800640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0df406cb30 con 0x7f0df41562a0 2024-04-18T04:50:27.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.282+0000 7f0df9800640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0df40c6f00 con 0x7f0df414fab0 2024-04-18T04:50:27.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.282+0000 7f0df9800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df40c57c0 con 0x7f0df406b660 2024-04-18T04:50:27.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.282+0000 7f0df3400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0df406b660 0x7f0df406baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:27.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.282+0000 7f0df3400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0df406b660 0x7f0df406baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:37190/0 (socket says 172.21.15.120:37190) 2024-04-18T04:50:27.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.294+0000 7f0df3400640 1 -- 172.21.15.120:0/1085791760 learned_addr learned my addr 172.21.15.120:0/1085791760 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:50:27.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.286+0000 7f0df2a00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0df414fab0 0x7f0df406c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:27.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.294+0000 7f0df2a00640 1 -- 172.21.15.120:0/1085791760 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0df406b660 msgr2=0x7f0df406baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:50:27.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.294+0000 7f0df2a00640 1 --2- 172.21.15.120:0/1085791760 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0df406b660 0x7f0df406baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:27.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.294+0000 7f0df2a00640 1 -- 172.21.15.120:0/1085791760 >> v2:172.21.15.120:3300/0 conn(0x7f0df41562a0 msgr2=0x7f0df40c6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:50:27.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.286+0000 7f0df2000640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0df41562a0 0x7f0df40c6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:27.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.298+0000 7f0df2a00640 1 --2- 172.21.15.120:0/1085791760 >> v2:172.21.15.120:3300/0 conn(0x7f0df41562a0 0x7f0df40c6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:27.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.298+0000 7f0df2a00640 1 -- 172.21.15.120:0/1085791760 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df40c5d80 con 0x7f0df414fab0 2024-04-18T04:50:27.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.298+0000 7f0df2000640 1 --2- 172.21.15.120:0/1085791760 >> v2:172.21.15.120:3300/0 conn(0x7f0df41562a0 0x7f0df40c6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:50:27.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.314+0000 7f0df2a00640 1 --2- 172.21.15.120:0/1085791760 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0df414fab0 0x7f0df406c5f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0df4073f20 tx=0x7f0dec023530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ae4055e94a9981c server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:27.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.318+0000 7f0df1600640 1 -- 172.21.15.120:0/1085791760 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec00d2d0 con 0x7f0df414fab0 2024-04-18T04:50:27.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.318+0000 7f0df1600640 1 -- 172.21.15.120:0/1085791760 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dec00d430 con 0x7f0df414fab0 2024-04-18T04:50:27.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.322+0000 7f0df9800640 1 -- 172.21.15.120:0/1085791760 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0df414fab0 msgr2=0x7f0df406c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:27.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.322+0000 7f0df9800640 1 --2- 172.21.15.120:0/1085791760 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0df414fab0 0x7f0df406c5f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0df4073f20 tx=0x7f0dec023530 comp rx=0 tx=0).stop 2024-04-18T04:50:27.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.326+0000 7f0df9800640 1 -- 172.21.15.120:0/1085791760 shutdown_connections 2024-04-18T04:50:27.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.326+0000 7f0df9800640 1 --2- 172.21.15.120:0/1085791760 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0df406b660 0x7f0df406baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:27.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.326+0000 7f0df9800640 1 --2- 172.21.15.120:0/1085791760 >> v2:172.21.15.120:3300/0 conn(0x7f0df41562a0 0x7f0df40c6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:27.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.326+0000 7f0df9800640 1 --2- 172.21.15.120:0/1085791760 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0df414fab0 0x7f0df406c5f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:27.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.326+0000 7f0df9800640 1 -- 172.21.15.120:0/1085791760 >> 172.21.15.120:0/1085791760 conn(0x7f0df40c78c0 msgr2=0x7f0df40c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:50:27.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.330+0000 7f0df9800640 1 -- 172.21.15.120:0/1085791760 shutdown_connections 2024-04-18T04:50:27.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.330+0000 7f0df9800640 1 -- 172.21.15.120:0/1085791760 wait complete. 2024-04-18T04:50:27.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.334+0000 7f0df9800640 1 Processor -- start 2024-04-18T04:50:27.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.334+0000 7f0df9800640 1 -- start start 2024-04-18T04:50:27.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.338+0000 7f0df9800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0df406b660 0x7f0df4148250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:27.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.338+0000 7f0df9800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0df414fab0 0x7f0df4158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:27.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.338+0000 7f0df9800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0df41562a0 0x7f0df4145630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:27.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.338+0000 7f0df9800640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df41466b0 con 0x7f0df41562a0 2024-04-18T04:50:27.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.338+0000 7f0df9800640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df40c1ec0 con 0x7f0df414fab0 2024-04-18T04:50:27.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.338+0000 7f0df9800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df4146930 con 0x7f0df406b660 2024-04-18T04:50:27.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.338+0000 7f0df2a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0df406b660 0x7f0df4148250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:27.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.338+0000 7f0df2a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0df406b660 0x7f0df4148250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:37206/0 (socket says 172.21.15.120:37206) 2024-04-18T04:50:27.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.338+0000 7f0df2a00640 1 -- 172.21.15.120:0/2973612505 learned_addr learned my addr 172.21.15.120:0/2973612505 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:50:27.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.338+0000 7f0df2a00640 1 -- 172.21.15.120:0/2973612505 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0df414fab0 msgr2=0x7f0df4158fc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-18T04:50:27.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.338+0000 7f0df2a00640 1 --2- 172.21.15.120:0/2973612505 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0df414fab0 0x7f0df4158fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:27.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.338+0000 7f0df2a00640 1 -- 172.21.15.120:0/2973612505 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0df41562a0 msgr2=0x7f0df4145630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:27.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.338+0000 7f0df2a00640 1 --2- 172.21.15.120:0/2973612505 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0df41562a0 0x7f0df4145630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:27.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.338+0000 7f0df2a00640 1 -- 172.21.15.120:0/2973612505 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dec00f050 con 0x7f0df406b660 2024-04-18T04:50:27.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.338+0000 7f0df2a00640 1 --2- 172.21.15.120:0/2973612505 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0df406b660 0x7f0df4148250 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0dec021be0 tx=0x7f0dec0202f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:27.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.338+0000 7f0deaa00640 1 -- 172.21.15.120:0/2973612505 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec00d860 con 0x7f0df406b660 2024-04-18T04:50:27.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.342+0000 7f0deaa00640 1 -- 172.21.15.120:0/2973612505 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dec0bf410 con 0x7f0df406b660 2024-04-18T04:50:27.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.342+0000 7f0df9800640 1 -- 172.21.15.120:0/2973612505 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0df4146c10 con 0x7f0df406b660 2024-04-18T04:50:27.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.342+0000 7f0df9800640 1 -- 172.21.15.120:0/2973612505 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0df41471d0 con 0x7f0df406b660 2024-04-18T04:50:27.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.342+0000 7f0deaa00640 1 -- 172.21.15.120:0/2973612505 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec0bf7a0 con 0x7f0df406b660 2024-04-18T04:50:27.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.346+0000 7f0df9800640 1 -- 172.21.15.120:0/2973612505 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dcc005260 con 0x7f0df406b660 2024-04-18T04:50:27.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.350+0000 7f0deaa00640 1 -- 172.21.15.120:0/2973612505 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0dec0bf900 con 0x7f0df406b660 2024-04-18T04:50:27.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.350+0000 7f0deaa00640 1 --2- 172.21.15.120:0/2973612505 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0dd4066760 0x7f0dd4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:27.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.350+0000 7f0deaa00640 1 -- 172.21.15.120:0/2973612505 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f0dec122db0 con 0x7f0df406b660 2024-04-18T04:50:27.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.350+0000 7f0df2000640 1 --2- 172.21.15.120:0/2973612505 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0dd4066760 0x7f0dd4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:27.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.350+0000 7f0df2000640 1 --2- 172.21.15.120:0/2973612505 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0dd4066760 0x7f0dd4068c20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0df406c620 tx=0x7f0de4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:27.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.358+0000 7f0deaa00640 1 -- 172.21.15.120:0/2973612505 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f0dec0efc40 con 0x7f0df406b660 2024-04-18T04:50:27.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.786+0000 7f0df9800640 1 -- 172.21.15.120:0/2973612505 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0dcc005a90 con 0x7f0df406b660 2024-04-18T04:50:27.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.786+0000 7f0deaa00640 1 -- 172.21.15.120:0/2973612505 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+5527 (secure 0 0 0) 0x7f0dec0f3260 con 0x7f0df406b660 2024-04-18T04:50:27.790 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:50:27.790 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:50:25.929308+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4967,"mds_2":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:replay","state_seq":1,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5130":{"gid":5130,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":23,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:50:27.790 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 28 2024-04-18T04:50:27.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.790+0000 7f0df9800640 1 -- 172.21.15.120:0/2973612505 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0dd4066760 msgr2=0x7f0dd4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:27.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.790+0000 7f0df9800640 1 --2- 172.21.15.120:0/2973612505 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0dd4066760 0x7f0dd4068c20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0df406c620 tx=0x7f0de4008040 comp rx=0 tx=0).stop 2024-04-18T04:50:27.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.790+0000 7f0df9800640 1 -- 172.21.15.120:0/2973612505 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0df406b660 msgr2=0x7f0df4148250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:27.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.790+0000 7f0df9800640 1 --2- 172.21.15.120:0/2973612505 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0df406b660 0x7f0df4148250 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0dec021be0 tx=0x7f0dec0202f0 comp rx=0 tx=0).stop 2024-04-18T04:50:27.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.790+0000 7f0df9800640 1 -- 172.21.15.120:0/2973612505 shutdown_connections 2024-04-18T04:50:27.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.790+0000 7f0df9800640 1 --2- 172.21.15.120:0/2973612505 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0dd4066760 0x7f0dd4068c20 secure :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0df406c620 tx=0x7f0de4008040 comp rx=0 tx=0).stop 2024-04-18T04:50:27.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.790+0000 7f0df9800640 1 --2- 172.21.15.120:0/2973612505 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0df41562a0 0x7f0df4145630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:27.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.790+0000 7f0df9800640 1 --2- 172.21.15.120:0/2973612505 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0df414fab0 0x7f0df4158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:27.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.790+0000 7f0df9800640 1 --2- 172.21.15.120:0/2973612505 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0df406b660 0x7f0df4148250 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0dec021be0 tx=0x7f0dec0202f0 comp rx=0 tx=0).stop 2024-04-18T04:50:27.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.790+0000 7f0df9800640 1 -- 172.21.15.120:0/2973612505 >> 172.21.15.120:0/2973612505 conn(0x7f0df40c78c0 msgr2=0x7f0df40ca640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:50:27.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.790+0000 7f0df9800640 1 -- 172.21.15.120:0/2973612505 shutdown_connections 2024-04-18T04:50:27.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:27.790+0000 7f0df9800640 1 -- 172.21.15.120:0/2973612505 wait complete. 2024-04-18T04:50:27.837 INFO:tasks.mds_thrash.fs.[cephfs]:mds.a down, removed from mdsmap 2024-04-18T04:50:27.838 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for mds cluster to stabilize... 2024-04-18T04:50:27.838 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:50:28.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.074+0000 7f4fe5400640 1 Processor -- start 2024-04-18T04:50:28.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.074+0000 7f4fe5400640 1 -- start start 2024-04-18T04:50:28.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.074+0000 7f4fe5400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4fe00c6b60 0x7f4fe00c6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:28.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.074+0000 7f4fe5400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4fe0155430 0x7f4fe0155880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:28.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.074+0000 7f4fe5400640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fe01561a0 con 0x7f4fe014f680 2024-04-18T04:50:28.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.074+0000 7f4fe5400640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fe00c1030 con 0x7f4fe0155430 2024-04-18T04:50:28.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.074+0000 7f4fe5400640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fe00c1310 con 0x7f4fe00c6b60 2024-04-18T04:50:28.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.074+0000 7f4fdf400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4fe00c6b60 0x7f4fe00c6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:28.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.074+0000 7f4fdf400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4fe00c6b60 0x7f4fe00c6fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:37796/0 (socket says 172.21.15.120:37796) 2024-04-18T04:50:28.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.074+0000 7f4fdf400640 1 -- 172.21.15.120:0/864731417 learned_addr learned my addr 172.21.15.120:0/864731417 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:50:28.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.074+0000 7f4fdf400640 1 -- 172.21.15.120:0/864731417 >> v2:172.21.15.120:3300/0 conn(0x7f4fe0155430 msgr2=0x7f4fe0155880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:50:28.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.074+0000 7f4fdf400640 1 --2- 172.21.15.120:0/864731417 >> v2:172.21.15.120:3300/0 conn(0x7f4fe0155430 0x7f4fe0155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:28.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.074+0000 7f4fdf400640 1 -- 172.21.15.120:0/864731417 >> v1:172.21.15.132:6789/0 conn(0x7f4fe014f680 legacy=0x7f4fe00c57c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-18T04:50:28.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.074+0000 7f4fdf400640 1 -- 172.21.15.120:0/864731417 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe00c15f0 con 0x7f4fe00c6b60 2024-04-18T04:50:28.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.078+0000 7f4fdf400640 1 --2- 172.21.15.120:0/864731417 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4fe00c6b60 0x7f4fe00c6fd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4fe006ea10 tx=0x7f4fcc01d4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12cfd505ca16bfb server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:28.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.078+0000 7f4fdea00640 1 -- 172.21.15.120:0/864731417 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc008be0 con 0x7f4fe00c6b60 2024-04-18T04:50:28.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.078+0000 7f4fdea00640 1 -- 172.21.15.120:0/864731417 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fcc008d40 con 0x7f4fe00c6b60 2024-04-18T04:50:28.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.078+0000 7f4fdea00640 1 -- 172.21.15.120:0/864731417 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc00a2f0 con 0x7f4fe00c6b60 2024-04-18T04:50:28.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.082+0000 7f4fe5400640 1 -- 172.21.15.120:0/864731417 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4fe00c6b60 msgr2=0x7f4fe00c6fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:28.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.082+0000 7f4fe5400640 1 --2- 172.21.15.120:0/864731417 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4fe00c6b60 0x7f4fe00c6fd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4fe006ea10 tx=0x7f4fcc01d4f0 comp rx=0 tx=0).stop 2024-04-18T04:50:28.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.082+0000 7f4fe5400640 1 -- 172.21.15.120:0/864731417 shutdown_connections 2024-04-18T04:50:28.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.082+0000 7f4fe5400640 1 --2- 172.21.15.120:0/864731417 >> v2:172.21.15.120:3300/0 conn(0x7f4fe0155430 0x7f4fe0155880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:28.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.082+0000 7f4fe5400640 1 --2- 172.21.15.120:0/864731417 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4fe00c6b60 0x7f4fe00c6fd0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:28.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.082+0000 7f4fe5400640 1 -- 172.21.15.120:0/864731417 >> 172.21.15.120:0/864731417 conn(0x7f4fe006d000 msgr2=0x7f4fe006d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:50:28.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.082+0000 7f4fe5400640 1 -- 172.21.15.120:0/864731417 shutdown_connections 2024-04-18T04:50:28.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.082+0000 7f4fe5400640 1 -- 172.21.15.120:0/864731417 wait complete. 2024-04-18T04:50:28.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.086+0000 7f4fe5400640 1 Processor -- start 2024-04-18T04:50:28.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.086+0000 7f4fe5400640 1 -- start start 2024-04-18T04:50:28.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.086+0000 7f4fe5400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4fe00c6b60 0x7f4fe014d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:28.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.086+0000 7f4fe5400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4fe014f680 0x7f4fe0152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:28.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.086+0000 7f4fe5400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4fe0155430 0x7f4fe01fe850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:28.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.090+0000 7f4fe5400640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe0201dc0 con 0x7f4fe014f680 2024-04-18T04:50:28.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.090+0000 7f4fe5400640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe014dcf0 con 0x7f4fe00c6b60 2024-04-18T04:50:28.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.090+0000 7f4fe5400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe014df80 con 0x7f4fe0155430 2024-04-18T04:50:28.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.090+0000 7f4fdf400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4fe014f680 0x7f4fe0152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:28.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.090+0000 7f4fe4a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4fe0155430 0x7f4fe01fe850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:28.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.090+0000 7f4fe4a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4fe0155430 0x7f4fe01fe850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:37218/0 (socket says 172.21.15.120:37218) 2024-04-18T04:50:28.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.090+0000 7f4fe4a00640 1 -- 172.21.15.120:0/3099338576 learned_addr learned my addr 172.21.15.120:0/3099338576 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:50:28.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.090+0000 7f4fdf400640 1 -- 172.21.15.120:0/3099338576 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4fe0155430 msgr2=0x7f4fe01fe850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:28.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.090+0000 7f4fdf400640 1 --2- 172.21.15.120:0/3099338576 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4fe0155430 0x7f4fe01fe850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:28.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.090+0000 7f4fdf400640 1 -- 172.21.15.120:0/3099338576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4fe00c6b60 msgr2=0x7f4fe014d7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-18T04:50:28.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.090+0000 7f4fdf400640 1 --2- 172.21.15.120:0/3099338576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4fe00c6b60 0x7f4fe014d7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:28.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.090+0000 7f4fdf400640 1 -- 172.21.15.120:0/3099338576 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fcc007040 con 0x7f4fe014f680 2024-04-18T04:50:28.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.090+0000 7f4fdf400640 1 --2- 172.21.15.120:0/3099338576 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4fe014f680 0x7f4fe0152660 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc0ac000 tx=0x7f4fcc01a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:28.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.090+0000 7f4fd7e00640 1 -- 172.21.15.120:0/3099338576 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc00a6a0 con 0x7f4fe014f680 2024-04-18T04:50:28.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.090+0000 7f4fe5400640 1 -- 172.21.15.120:0/3099338576 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fe0201fd0 con 0x7f4fe014f680 2024-04-18T04:50:28.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.090+0000 7f4fe5400640 1 -- 172.21.15.120:0/3099338576 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fe0202590 con 0x7f4fe014f680 2024-04-18T04:50:28.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.090+0000 7f4fd7e00640 1 -- 172.21.15.120:0/3099338576 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fcc00a800 con 0x7f4fe014f680 2024-04-18T04:50:28.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.090+0000 7f4fd7e00640 1 -- 172.21.15.120:0/3099338576 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc0ab6c0 con 0x7f4fe014f680 2024-04-18T04:50:28.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.094+0000 7f4fe5400640 1 -- 172.21.15.120:0/3099338576 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fb8005260 con 0x7f4fe014f680 2024-04-18T04:50:28.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.106+0000 7f4fd7e00640 1 -- 172.21.15.120:0/3099338576 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4fcc0ab820 con 0x7f4fe014f680 2024-04-18T04:50:28.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.110+0000 7f4fd7e00640 1 --2- 172.21.15.120:0/3099338576 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4fc00666c0 0x7f4fc0068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:28.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.110+0000 7f4fd7e00640 1 -- 172.21.15.120:0/3099338576 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f4fcc11f300 con 0x7f4fe014f680 2024-04-18T04:50:28.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.114+0000 7f4fd7e00640 1 -- 172.21.15.120:0/3099338576 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f4fcc0ec240 con 0x7f4fe014f680 2024-04-18T04:50:28.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.114+0000 7f4fdfe00640 1 --2- 172.21.15.120:0/3099338576 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4fc00666c0 0x7f4fc0068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:28.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.118+0000 7f4fdfe00640 1 --2- 172.21.15.120:0/3099338576 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4fc00666c0 0x7f4fc0068b80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0009690 tx=0x7f4fd0006be0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:28.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.566+0000 7f4fe5400640 1 -- 172.21.15.120:0/3099338576 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4fb80057e0 con 0x7f4fe014f680 2024-04-18T04:50:28.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.570+0000 7f4fd7e00640 1 -- 172.21.15.120:0/3099338576 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+5527 (secure 0 0 0) 0x7f4fcc0f0e60 con 0x7f4fe014f680 2024-04-18T04:50:28.577 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:50:28.577 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:50:25.929308+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4967,"mds_2":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:replay","state_seq":1,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5130":{"gid":5130,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":23,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:50:28.577 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 28 2024-04-18T04:50:28.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.578+0000 7f4fe5400640 1 -- 172.21.15.120:0/3099338576 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4fc00666c0 msgr2=0x7f4fc0068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:28.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.578+0000 7f4fe5400640 1 --2- 172.21.15.120:0/3099338576 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4fc00666c0 0x7f4fc0068b80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0009690 tx=0x7f4fd0006be0 comp rx=0 tx=0).stop 2024-04-18T04:50:28.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.578+0000 7f4fe5400640 1 -- 172.21.15.120:0/3099338576 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4fe014f680 msgr2=0x7f4fe0152660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:28.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.578+0000 7f4fe5400640 1 --2- 172.21.15.120:0/3099338576 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4fe014f680 0x7f4fe0152660 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc0ac000 tx=0x7f4fcc01a290 comp rx=0 tx=0).stop 2024-04-18T04:50:28.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.582+0000 7f4fe5400640 1 -- 172.21.15.120:0/3099338576 shutdown_connections 2024-04-18T04:50:28.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.582+0000 7f4fe5400640 1 --2- 172.21.15.120:0/3099338576 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4fc00666c0 0x7f4fc0068b80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:28.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.582+0000 7f4fe5400640 1 --2- 172.21.15.120:0/3099338576 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4fe0155430 0x7f4fe01fe850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:28.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.582+0000 7f4fe5400640 1 --2- 172.21.15.120:0/3099338576 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4fe014f680 0x7f4fe0152660 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:28.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.582+0000 7f4fe5400640 1 --2- 172.21.15.120:0/3099338576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4fe00c6b60 0x7f4fe014d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:28.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.582+0000 7f4fe5400640 1 -- 172.21.15.120:0/3099338576 >> 172.21.15.120:0/3099338576 conn(0x7f4fe006d000 msgr2=0x7f4fe015e690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:50:28.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.582+0000 7f4fe5400640 1 -- 172.21.15.120:0/3099338576 shutdown_connections 2024-04-18T04:50:28.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:28.582+0000 7f4fe5400640 1 -- 172.21.15.120:0/3099338576 wait complete. 2024-04-18T04:50:28.678 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 28, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-18T04:44:30.251235+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 28, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1, 2 ], "info": { "gid_4288": { "addr": "172.21.15.120:6837/76856194", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6835", "nonce": 76856194, "type": "v2" }, { "addr": "172.21.15.120:6837", "nonce": 76856194, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4288, "incarnation": 4, "join_fscid": -1, "name": "e", "rank": 0, "state": "up:active", "state_seq": 4 }, "gid_4967": { "addr": "172.21.15.132:6835/396956733", "addrs": { "addrvec": [ { "addr": "172.21.15.132:6834", "nonce": 396956733, "type": "v2" }, { "addr": "172.21.15.132:6835", "nonce": 396956733, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4967, "incarnation": 28, "join_fscid": -1, "name": "b", "rank": 1, "state": "up:replay", "state_seq": 1 }, "gid_5130": { "addr": "172.21.15.120:6833/4067927368", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6832", "nonce": 4067927368, "type": "v2" }, { "addr": "172.21.15.120:6833", "nonce": 4067927368, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5130, "incarnation": 22, "join_fscid": -1, "name": "c", "rank": 2, "state": "up:active", "state_seq": 23 } }, "last_failure": 0, "last_failure_osd_epoch": 30, "max_file_size": 1099511627776, "max_mds": 3, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-18T04:50:25.929308+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4288, "mds_1": 4967, "mds_2": 5130 } } } ], "standbys": [ { "addr": "172.21.15.132:6839/4292136288", "addrs": { "addrvec": [ { "addr": "172.21.15.132:6836", "nonce": 4292136288, "type": "v2" }, { "addr": "172.21.15.132:6839", "nonce": 4292136288, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4241, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.132:6838/1712856922", "addrs": { "addrvec": [ { "addr": "172.21.15.132:6837", "nonce": 1712856922, "type": "v2" }, { "addr": "172.21.15.132:6838", "nonce": 1712856922, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 2, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4244, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-18T04:50:30.679 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:50:30.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.958+0000 7fba38400640 1 Processor -- start 2024-04-18T04:50:30.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.958+0000 7fba38400640 1 -- start start 2024-04-18T04:50:30.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.962+0000 7fba38400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fba30157a00 0x7fba300c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:30.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.962+0000 7fba38400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fba300c0330 0x7fba30157de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:30.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.962+0000 7fba38400640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba3015e970 con 0x7fba3006b660 2024-04-18T04:50:30.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.962+0000 7fba38400640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba30158320 con 0x7fba300c0330 2024-04-18T04:50:30.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.962+0000 7fba38400640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba30162170 con 0x7fba30157a00 2024-04-18T04:50:30.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.962+0000 7fba35a00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fba30157a00 0x7fba300c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:30.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.962+0000 7fba35a00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fba30157a00 0x7fba300c69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:52962/0 (socket says 172.21.15.120:52962) 2024-04-18T04:50:30.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.962+0000 7fba35a00640 1 -- 172.21.15.120:0/877093476 learned_addr learned my addr 172.21.15.120:0/877093476 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:50:30.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.962+0000 7fba35a00640 1 -- 172.21.15.120:0/877093476 >> v2:172.21.15.120:3300/0 conn(0x7fba300c0330 msgr2=0x7fba30157de0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:50:30.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.962+0000 7fba35a00640 1 --2- 172.21.15.120:0/877093476 >> v2:172.21.15.120:3300/0 conn(0x7fba300c0330 0x7fba30157de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:30.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.962+0000 7fba35a00640 1 -- 172.21.15.120:0/877093476 >> v1:172.21.15.120:6789/0 conn(0x7fba3006b660 legacy=0x7fba3006bad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:50:30.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.962+0000 7fba35a00640 1 -- 172.21.15.120:0/877093476 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba300c0780 con 0x7fba30157a00 2024-04-18T04:50:30.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.970+0000 7fba35a00640 1 --2- 172.21.15.120:0/877093476 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba30157a00 0x7fba300c69e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fba30074050 tx=0x7fba2401ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1f15040ebd64019 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:30.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.970+0000 7fba2fe00640 1 -- 172.21.15.120:0/877093476 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba240a89f0 con 0x7fba30157a00 2024-04-18T04:50:30.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.970+0000 7fba2fe00640 1 -- 172.21.15.120:0/877093476 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba240a8b50 con 0x7fba30157a00 2024-04-18T04:50:30.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.970+0000 7fba2fe00640 1 -- 172.21.15.120:0/877093476 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba240b0440 con 0x7fba30157a00 2024-04-18T04:50:30.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.974+0000 7fba38400640 1 -- 172.21.15.120:0/877093476 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba30157a00 msgr2=0x7fba300c69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:30.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.974+0000 7fba38400640 1 --2- 172.21.15.120:0/877093476 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba30157a00 0x7fba300c69e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fba30074050 tx=0x7fba2401ecf0 comp rx=0 tx=0).stop 2024-04-18T04:50:30.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.974+0000 7fba38400640 1 -- 172.21.15.120:0/877093476 shutdown_connections 2024-04-18T04:50:30.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.974+0000 7fba38400640 1 --2- 172.21.15.120:0/877093476 >> v2:172.21.15.120:3300/0 conn(0x7fba300c0330 0x7fba30157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:30.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.974+0000 7fba38400640 1 --2- 172.21.15.120:0/877093476 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba30157a00 0x7fba300c69e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:30.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.974+0000 7fba38400640 1 -- 172.21.15.120:0/877093476 >> 172.21.15.120:0/877093476 conn(0x7fba300c78c0 msgr2=0x7fba300c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:50:30.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.978+0000 7fba38400640 1 -- 172.21.15.120:0/877093476 shutdown_connections 2024-04-18T04:50:30.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.978+0000 7fba38400640 1 -- 172.21.15.120:0/877093476 wait complete. 2024-04-18T04:50:30.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.982+0000 7fba38400640 1 Processor -- start 2024-04-18T04:50:30.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.982+0000 7fba38400640 1 -- start start 2024-04-18T04:50:30.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.982+0000 7fba38400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba3006b660 0x7fba30146400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:30.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.982+0000 7fba38400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba300c0330 0x7fba301ffc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:30.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.982+0000 7fba38400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba30157a00 0x7fba3006bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:30.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.982+0000 7fba38400640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba301417f0 con 0x7fba300c0330 2024-04-18T04:50:30.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.982+0000 7fba38400640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba30140980 con 0x7fba3006b660 2024-04-18T04:50:30.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.982+0000 7fba38400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba300c48b0 con 0x7fba30157a00 2024-04-18T04:50:30.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.982+0000 7fba36400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba30157a00 0x7fba3006bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:30.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.982+0000 7fba36400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba30157a00 0x7fba3006bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:52162/0 (socket says 172.21.15.120:52162) 2024-04-18T04:50:30.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.982+0000 7fba36400640 1 -- 172.21.15.120:0/2183842696 learned_addr learned my addr 172.21.15.120:0/2183842696 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:50:30.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.986+0000 7fba35000640 1 --2- 172.21.15.120:0/2183842696 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba300c0330 0x7fba301ffc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:30.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.986+0000 7fba36400640 1 -- 172.21.15.120:0/2183842696 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba3006b660 msgr2=0x7fba30146400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:30.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.986+0000 7fba36400640 1 --2- 172.21.15.120:0/2183842696 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba3006b660 0x7fba30146400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:30.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.986+0000 7fba36400640 1 -- 172.21.15.120:0/2183842696 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba300c0330 msgr2=0x7fba301ffc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:30.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.986+0000 7fba36400640 1 --2- 172.21.15.120:0/2183842696 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba300c0330 0x7fba301ffc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:30.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.986+0000 7fba36400640 1 -- 172.21.15.120:0/2183842696 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba240094d0 con 0x7fba30157a00 2024-04-18T04:50:30.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.986+0000 7fba36400640 1 --2- 172.21.15.120:0/2183842696 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba30157a00 0x7fba3006bd10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fba2800ba10 tx=0x7fba2800bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:30.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.986+0000 7fba2d600640 1 -- 172.21.15.120:0/2183842696 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2800cb20 con 0x7fba30157a00 2024-04-18T04:50:30.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.986+0000 7fba38400640 1 -- 172.21.15.120:0/2183842696 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba30140b70 con 0x7fba30157a00 2024-04-18T04:50:30.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.986+0000 7fba38400640 1 -- 172.21.15.120:0/2183842696 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba30141130 con 0x7fba30157a00 2024-04-18T04:50:30.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.986+0000 7fba2d600640 1 -- 172.21.15.120:0/2183842696 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba2800cc80 con 0x7fba30157a00 2024-04-18T04:50:30.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.986+0000 7fba2d600640 1 -- 172.21.15.120:0/2183842696 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2800cb20 con 0x7fba30157a00 2024-04-18T04:50:30.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.990+0000 7fba38400640 1 -- 172.21.15.120:0/2183842696 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba0c005260 con 0x7fba30157a00 2024-04-18T04:50:30.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.990+0000 7fba2d600640 1 -- 172.21.15.120:0/2183842696 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fba2801d3b0 con 0x7fba30157a00 2024-04-18T04:50:30.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.994+0000 7fba2d600640 1 --2- 172.21.15.120:0/2183842696 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fba100666f0 0x7fba10068bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:30.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.994+0000 7fba35a00640 1 --2- 172.21.15.120:0/2183842696 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fba100666f0 0x7fba10068bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:30.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.994+0000 7fba2d600640 1 -- 172.21.15.120:0/2183842696 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7fba28084240 con 0x7fba30157a00 2024-04-18T04:50:30.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.994+0000 7fba35a00640 1 --2- 172.21.15.120:0/2183842696 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fba100666f0 0x7fba10068bb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fba240b2000 tx=0x7fba24004740 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:31.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:30.998+0000 7fba2d600640 1 -- 172.21.15.120:0/2183842696 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fba28050fd0 con 0x7fba30157a00 2024-04-18T04:50:31.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:31.398+0000 7fba38400640 1 -- 172.21.15.120:0/2183842696 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba0c005a90 con 0x7fba30157a00 2024-04-18T04:50:31.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:31.402+0000 7fba2d600640 1 -- 172.21.15.120:0/2183842696 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+5527 (secure 0 0 0) 0x7fba280545f0 con 0x7fba30157a00 2024-04-18T04:50:31.404 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:50:31.404 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:50:25.929308+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4967,"mds_2":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:replay","state_seq":1,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5130":{"gid":5130,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":23,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:50:31.405 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 28 2024-04-18T04:50:31.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:31.406+0000 7fba38400640 1 -- 172.21.15.120:0/2183842696 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fba100666f0 msgr2=0x7fba10068bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:31.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:31.406+0000 7fba38400640 1 --2- 172.21.15.120:0/2183842696 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fba100666f0 0x7fba10068bb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fba240b2000 tx=0x7fba24004740 comp rx=0 tx=0).stop 2024-04-18T04:50:31.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:31.406+0000 7fba38400640 1 -- 172.21.15.120:0/2183842696 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba30157a00 msgr2=0x7fba3006bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:31.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:31.406+0000 7fba38400640 1 --2- 172.21.15.120:0/2183842696 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba30157a00 0x7fba3006bd10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fba2800ba10 tx=0x7fba2800bed0 comp rx=0 tx=0).stop 2024-04-18T04:50:31.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:31.406+0000 7fba38400640 1 -- 172.21.15.120:0/2183842696 shutdown_connections 2024-04-18T04:50:31.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:31.406+0000 7fba38400640 1 --2- 172.21.15.120:0/2183842696 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fba100666f0 0x7fba10068bb0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:31.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:31.406+0000 7fba38400640 1 --2- 172.21.15.120:0/2183842696 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba30157a00 0x7fba3006bd10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:31.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:31.406+0000 7fba38400640 1 --2- 172.21.15.120:0/2183842696 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba300c0330 0x7fba301ffc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:31.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:31.406+0000 7fba38400640 1 --2- 172.21.15.120:0/2183842696 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba3006b660 0x7fba30146400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:31.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:31.406+0000 7fba38400640 1 -- 172.21.15.120:0/2183842696 >> 172.21.15.120:0/2183842696 conn(0x7fba300c78c0 msgr2=0x7fba3015b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:50:31.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:31.406+0000 7fba38400640 1 -- 172.21.15.120:0/2183842696 shutdown_connections 2024-04-18T04:50:31.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:31.406+0000 7fba38400640 1 -- 172.21.15.120:0/2183842696 wait complete. 2024-04-18T04:50:31.494 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:50:33.495 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:50:33.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.778+0000 7fc844200640 1 Processor -- start 2024-04-18T04:50:33.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.778+0000 7fc844200640 1 -- start start 2024-04-18T04:50:33.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.782+0000 7fc844200640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc83c070b60 0x7fc83c0c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:33.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.782+0000 7fc844200640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc83c070fe0 con 0x7fc83c06b4e0 2024-04-18T04:50:33.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.782+0000 7fc844200640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc83c0712c0 con 0x7fc83c072360 2024-04-18T04:50:33.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.782+0000 7fc844200640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc83c0715a0 con 0x7fc83c070b60 2024-04-18T04:50:33.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.786+0000 7fc842200640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fc83c072360 0x7fc83c14f300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:34316/0 (socket says 172.21.15.120:34316) 2024-04-18T04:50:33.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.786+0000 7fc842200640 1 -- 172.21.15.120:0/3984494723 learned_addr learned my addr 172.21.15.120:0/3984494723 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:50:33.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.786+0000 7fc840e00640 1 --2- 172.21.15.120:0/3984494723 >> v2:172.21.15.132:3300/0 conn(0x7fc83c070b60 0x7fc83c0c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:33.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.786+0000 7fc83be00640 1 -- 172.21.15.120:0/3984494723 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1446454125 0 0) 0x7fc83c070fe0 con 0x7fc83c06b4e0 2024-04-18T04:50:33.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.786+0000 7fc83be00640 1 -- 172.21.15.120:0/3984494723 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc824003530 con 0x7fc83c06b4e0 2024-04-18T04:50:33.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.786+0000 7fc83be00640 1 -- 172.21.15.120:0/3984494723 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2837280786 0 0) 0x7fc824003530 con 0x7fc83c06b4e0 2024-04-18T04:50:33.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.786+0000 7fc83be00640 1 -- 172.21.15.120:0/3984494723 >> v2:172.21.15.132:3300/0 conn(0x7fc83c070b60 msgr2=0x7fc83c0c57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:50:33.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.786+0000 7fc83be00640 1 --2- 172.21.15.120:0/3984494723 >> v2:172.21.15.132:3300/0 conn(0x7fc83c070b60 0x7fc83c0c57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:33.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.786+0000 7fc83be00640 1 -- 172.21.15.120:0/3984494723 >> v1:172.21.15.132:6789/0 conn(0x7fc83c072360 legacy=0x7fc83c14f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:33.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.786+0000 7fc83be00640 1 -- 172.21.15.120:0/3984494723 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83c071880 con 0x7fc83c06b4e0 2024-04-18T04:50:33.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.786+0000 7fc83be00640 1 -- 172.21.15.120:0/3984494723 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7fc828001680 con 0x7fc83c06b4e0 2024-04-18T04:50:33.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.786+0000 7fc83be00640 1 -- 172.21.15.120:0/3984494723 >> v1:172.21.15.120:6789/0 conn(0x7fc83c06b4e0 legacy=0x7fc83c155fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:33.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.786+0000 7fc83be00640 1 --2- 172.21.15.120:0/3984494723 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8240039a0 0x7fc824003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:33.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.786+0000 7fc83be00640 1 --2- 172.21.15.120:0/3984494723 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc8240047d0 0x7fc824004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:33.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.786+0000 7fc83be00640 1 --2- 172.21.15.120:0/3984494723 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc824005190 0x7fc82400fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:33.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.786+0000 7fc83be00640 1 -- 172.21.15.120:0/3984494723 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c0715a0 con 0x7fc8240047d0 2024-04-18T04:50:33.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.786+0000 7fc83be00640 1 -- 172.21.15.120:0/3984494723 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc824010480 con 0x7fc8240039a0 2024-04-18T04:50:33.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.786+0000 7fc83be00640 1 -- 172.21.15.120:0/3984494723 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc824010640 con 0x7fc824005190 2024-04-18T04:50:33.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.790+0000 7fc840e00640 1 --2- 172.21.15.120:0/3984494723 >> v2:172.21.15.132:3300/0 conn(0x7fc83c070b60 0x7fc83c0c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:50:33.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.790+0000 7fc841800640 1 --2- 172.21.15.120:0/3984494723 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8240039a0 0x7fc824003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:33.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.790+0000 7fc840e00640 1 --2- 172.21.15.120:0/3984494723 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc8240047d0 0x7fc824004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:33.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.790+0000 7fc841800640 1 -- 172.21.15.120:0/3984494723 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc824005190 msgr2=0x7fc82400fda0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:50:33.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.790+0000 7fc841800640 1 --2- 172.21.15.120:0/3984494723 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc824005190 0x7fc82400fda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:33.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.790+0000 7fc841800640 1 -- 172.21.15.120:0/3984494723 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc8240047d0 msgr2=0x7fc824004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:50:33.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.790+0000 7fc841800640 1 --2- 172.21.15.120:0/3984494723 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc8240047d0 0x7fc824004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:33.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.790+0000 7fc841800640 1 -- 172.21.15.120:0/3984494723 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83c070fe0 con 0x7fc8240039a0 2024-04-18T04:50:33.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.790+0000 7fc842200640 1 -- 172.21.15.120:0/3984494723 reap_dead start 2024-04-18T04:50:33.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.802+0000 7fc841800640 1 --2- 172.21.15.120:0/3984494723 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8240039a0 0x7fc824003de0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc82800c110 tx=0x7fc82801cb40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19d6f380f6bdc272 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:33.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.802+0000 7fc83be00640 1 -- 172.21.15.120:0/3984494723 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc828005270 con 0x7fc8240039a0 2024-04-18T04:50:33.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.806+0000 7fc83be00640 1 -- 172.21.15.120:0/3984494723 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8280053f0 con 0x7fc8240039a0 2024-04-18T04:50:33.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.806+0000 7fc83be00640 1 -- 172.21.15.120:0/3984494723 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8280a5a80 con 0x7fc8240039a0 2024-04-18T04:50:33.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.806+0000 7fc844200640 1 -- 172.21.15.120:0/3984494723 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8240039a0 msgr2=0x7fc824003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:33.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.806+0000 7fc844200640 1 --2- 172.21.15.120:0/3984494723 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8240039a0 0x7fc824003de0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc82800c110 tx=0x7fc82801cb40 comp rx=0 tx=0).stop 2024-04-18T04:50:33.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.806+0000 7fc844200640 1 -- 172.21.15.120:0/3984494723 shutdown_connections 2024-04-18T04:50:33.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.806+0000 7fc844200640 1 --2- 172.21.15.120:0/3984494723 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8240039a0 0x7fc824003de0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:33.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.806+0000 7fc844200640 1 -- 172.21.15.120:0/3984494723 >> 172.21.15.120:0/3984494723 conn(0x7fc83c06d000 msgr2=0x7fc83c06d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:50:33.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.810+0000 7fc844200640 1 -- 172.21.15.120:0/3984494723 shutdown_connections 2024-04-18T04:50:33.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.810+0000 7fc844200640 1 -- 172.21.15.120:0/3984494723 wait complete. 2024-04-18T04:50:33.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.814+0000 7fc844200640 1 Processor -- start 2024-04-18T04:50:33.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.814+0000 7fc844200640 1 -- start start 2024-04-18T04:50:33.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.818+0000 7fc844200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8240039a0 0x7fc83c1f33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:33.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.818+0000 7fc844200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc83c0ca730 0x7fc83c0c9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:33.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.818+0000 7fc844200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc83c0c71b0 0x7fc83c142bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:33.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.818+0000 7fc844200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c1f3920 con 0x7fc83c0c71b0 2024-04-18T04:50:33.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.818+0000 7fc844200640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c1f43a0 con 0x7fc8240039a0 2024-04-18T04:50:33.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.818+0000 7fc844200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c1f3b00 con 0x7fc83c0ca730 2024-04-18T04:50:33.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.818+0000 7fc840e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc83c0ca730 0x7fc83c0c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:33.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.818+0000 7fc841800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8240039a0 0x7fc83c1f33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:33.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.818+0000 7fc842200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc83c0c71b0 0x7fc83c142bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:33.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.818+0000 7fc841800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8240039a0 0x7fc83c1f33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:52998/0 (socket says 172.21.15.120:52998) 2024-04-18T04:50:33.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.818+0000 7fc841800640 1 -- 172.21.15.120:0/1433633063 learned_addr learned my addr 172.21.15.120:0/1433633063 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:50:33.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.822+0000 7fc840e00640 1 -- 172.21.15.120:0/1433633063 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8240039a0 msgr2=0x7fc83c1f33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:33.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.822+0000 7fc840e00640 1 --2- 172.21.15.120:0/1433633063 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8240039a0 0x7fc83c1f33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:33.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.822+0000 7fc840e00640 1 -- 172.21.15.120:0/1433633063 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc83c0c71b0 msgr2=0x7fc83c142bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:33.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.822+0000 7fc840e00640 1 --2- 172.21.15.120:0/1433633063 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc83c0c71b0 0x7fc83c142bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:33.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.822+0000 7fc840e00640 1 -- 172.21.15.120:0/1433633063 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83c1f3de0 con 0x7fc83c0ca730 2024-04-18T04:50:33.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.826+0000 7fc840e00640 1 --2- 172.21.15.120:0/1433633063 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc83c0ca730 0x7fc83c0c9650 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc8300038d0 tx=0x7fc830003d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:33.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.826+0000 7fc839600640 1 -- 172.21.15.120:0/1433633063 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83000a4e0 con 0x7fc83c0ca730 2024-04-18T04:50:33.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.826+0000 7fc839600640 1 -- 172.21.15.120:0/1433633063 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc830011040 con 0x7fc83c0ca730 2024-04-18T04:50:33.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.826+0000 7fc839600640 1 -- 172.21.15.120:0/1433633063 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83000b7e0 con 0x7fc83c0ca730 2024-04-18T04:50:33.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.826+0000 7fc844200640 1 -- 172.21.15.120:0/1433633063 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc83c1f40c0 con 0x7fc83c0ca730 2024-04-18T04:50:33.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.826+0000 7fc844200640 1 -- 172.21.15.120:0/1433633063 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc83c1426a0 con 0x7fc83c0ca730 2024-04-18T04:50:33.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.826+0000 7fc844200640 1 -- 172.21.15.120:0/1433633063 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc83c142220 con 0x7fc83c0ca730 2024-04-18T04:50:33.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.830+0000 7fc839600640 1 -- 172.21.15.120:0/1433633063 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc83000b940 con 0x7fc83c0ca730 2024-04-18T04:50:33.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.834+0000 7fc839600640 1 --2- 172.21.15.120:0/1433633063 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc81c0666c0 0x7fc81c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:33.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.834+0000 7fc839600640 1 -- 172.21.15.120:0/1433633063 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7fc830084af0 con 0x7fc83c0ca730 2024-04-18T04:50:33.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.834+0000 7fc841800640 1 --2- 172.21.15.120:0/1433633063 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc81c0666c0 0x7fc81c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:33.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.834+0000 7fc841800640 1 --2- 172.21.15.120:0/1433633063 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc81c0666c0 0x7fc81c068b80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc828005630 tx=0x7fc8280a7070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:33.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:33.838+0000 7fc839600640 1 -- 172.21.15.120:0/1433633063 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fc830051a30 con 0x7fc83c0ca730 2024-04-18T04:50:34.223 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:50:34.223 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:50:33.312065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4967,"mds_2":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:resolve","state_seq":25,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5130":{"gid":5130,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":23,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:50:34.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:34.218+0000 7fc844200640 1 -- 172.21.15.120:0/1433633063 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc83c142220 con 0x7fc83c0ca730 2024-04-18T04:50:34.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:34.218+0000 7fc839600640 1 -- 172.21.15.120:0/1433633063 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+5529 (secure 0 0 0) 0x7fc83c142220 con 0x7fc83c0ca730 2024-04-18T04:50:34.224 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 29 2024-04-18T04:50:34.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:34.222+0000 7fc844200640 1 -- 172.21.15.120:0/1433633063 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc81c0666c0 msgr2=0x7fc81c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:34.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:34.222+0000 7fc844200640 1 --2- 172.21.15.120:0/1433633063 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc81c0666c0 0x7fc81c068b80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc828005630 tx=0x7fc8280a7070 comp rx=0 tx=0).stop 2024-04-18T04:50:34.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:34.222+0000 7fc844200640 1 -- 172.21.15.120:0/1433633063 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc83c0ca730 msgr2=0x7fc83c0c9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:34.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:34.222+0000 7fc844200640 1 --2- 172.21.15.120:0/1433633063 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc83c0ca730 0x7fc83c0c9650 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc8300038d0 tx=0x7fc830003d90 comp rx=0 tx=0).stop 2024-04-18T04:50:34.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:34.222+0000 7fc844200640 1 -- 172.21.15.120:0/1433633063 shutdown_connections 2024-04-18T04:50:34.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:34.222+0000 7fc844200640 1 --2- 172.21.15.120:0/1433633063 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc81c0666c0 0x7fc81c068b80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:34.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:34.222+0000 7fc844200640 1 --2- 172.21.15.120:0/1433633063 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc83c0c71b0 0x7fc83c142bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:34.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:34.222+0000 7fc844200640 1 --2- 172.21.15.120:0/1433633063 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc83c0ca730 0x7fc83c0c9650 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:34.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:34.222+0000 7fc844200640 1 --2- 172.21.15.120:0/1433633063 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8240039a0 0x7fc83c1f33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:34.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:34.222+0000 7fc844200640 1 -- 172.21.15.120:0/1433633063 >> 172.21.15.120:0/1433633063 conn(0x7fc83c06d000 msgr2=0x7fc83c0b08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:50:34.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:34.222+0000 7fc844200640 1 -- 172.21.15.120:0/1433633063 shutdown_connections 2024-04-18T04:50:34.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:34.222+0000 7fc844200640 1 -- 172.21.15.120:0/1433633063 wait complete. 2024-04-18T04:50:34.282 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:50:36.283 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:50:36.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.562+0000 7faf53200640 1 Processor -- start 2024-04-18T04:50:36.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.562+0000 7faf53200640 1 -- start start 2024-04-18T04:50:36.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.566+0000 7faf53200640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7faf4c157e40 0x7faf4c06d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:36.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.566+0000 7faf53200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faf4c071a20 0x7faf4c071ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:36.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.566+0000 7faf53200640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf4c15e1b0 con 0x7faf4c0c2c80 2024-04-18T04:50:36.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.566+0000 7faf53200640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf4c158220 con 0x7faf4c157e40 2024-04-18T04:50:36.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.566+0000 7faf53200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c0c6cf0 con 0x7faf4c071a20 2024-04-18T04:50:36.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.566+0000 7faf4be00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7faf4c157e40 0x7faf4c06d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:36.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.566+0000 7faf51200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faf4c071a20 0x7faf4c071ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:36.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.566+0000 7faf4be00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7faf4c157e40 0x7faf4c06d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:53010/0 (socket says 172.21.15.120:53010) 2024-04-18T04:50:36.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.566+0000 7faf4be00640 1 -- 172.21.15.120:0/2957402334 learned_addr learned my addr 172.21.15.120:0/2957402334 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:50:36.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.566+0000 7faf51200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faf4c071a20 0x7faf4c071ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:52176/0 (socket says 172.21.15.120:52176) 2024-04-18T04:50:36.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.566+0000 7faf4be00640 1 -- 172.21.15.120:0/2957402334 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faf4c071a20 msgr2=0x7faf4c071ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:50:36.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.566+0000 7faf4be00640 1 --2- 172.21.15.120:0/2957402334 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faf4c071a20 0x7faf4c071ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:36.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.566+0000 7faf4be00640 1 -- 172.21.15.120:0/2957402334 >> v1:172.21.15.132:6789/0 conn(0x7faf4c0c2c80 legacy=0x7faf4c15daa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-18T04:50:36.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.566+0000 7faf4be00640 1 -- 172.21.15.120:0/2957402334 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf4c0c6fd0 con 0x7faf4c157e40 2024-04-18T04:50:36.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.566+0000 7faf51200640 1 --2- 172.21.15.120:0/2957402334 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faf4c071a20 0x7faf4c071ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:50:36.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.570+0000 7faf4be00640 1 --2- 172.21.15.120:0/2957402334 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf4c157e40 0x7faf4c06d9b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7faf44009e50 tx=0x7faf4401c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28ebb2a2708b77bf server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:36.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.574+0000 7faf4aa00640 1 -- 172.21.15.120:0/2957402334 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf440a5840 con 0x7faf4c157e40 2024-04-18T04:50:36.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.574+0000 7faf4aa00640 1 -- 172.21.15.120:0/2957402334 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf440a59a0 con 0x7faf4c157e40 2024-04-18T04:50:36.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.574+0000 7faf53200640 1 -- 172.21.15.120:0/2957402334 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf4c157e40 msgr2=0x7faf4c06d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:36.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.574+0000 7faf4aa00640 1 -- 172.21.15.120:0/2957402334 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf440a5840 con 0x7faf4c157e40 2024-04-18T04:50:36.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.574+0000 7faf53200640 1 --2- 172.21.15.120:0/2957402334 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf4c157e40 0x7faf4c06d9b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7faf44009e50 tx=0x7faf4401c9c0 comp rx=0 tx=0).stop 2024-04-18T04:50:36.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.578+0000 7faf53200640 1 -- 172.21.15.120:0/2957402334 shutdown_connections 2024-04-18T04:50:36.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.578+0000 7faf53200640 1 --2- 172.21.15.120:0/2957402334 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faf4c071a20 0x7faf4c071ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:36.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.578+0000 7faf53200640 1 --2- 172.21.15.120:0/2957402334 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf4c157e40 0x7faf4c06d9b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:36.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.578+0000 7faf53200640 1 -- 172.21.15.120:0/2957402334 >> 172.21.15.120:0/2957402334 conn(0x7faf4c0cbfb0 msgr2=0x7faf4c0cc3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:50:36.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.578+0000 7faf53200640 1 -- 172.21.15.120:0/2957402334 shutdown_connections 2024-04-18T04:50:36.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.578+0000 7faf53200640 1 -- 172.21.15.120:0/2957402334 wait complete. 2024-04-18T04:50:36.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.582+0000 7faf53200640 1 Processor -- start 2024-04-18T04:50:36.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.582+0000 7faf53200640 1 -- start start 2024-04-18T04:50:36.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.582+0000 7faf53200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf4c071a20 0x7faf4c160870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:36.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.582+0000 7faf53200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faf4c0c2c80 0x7faf4c1fa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:36.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.582+0000 7faf53200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf4c157e40 0x7faf4c15f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:36.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.582+0000 7faf53200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c1fa040 con 0x7faf4c157e40 2024-04-18T04:50:36.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.582+0000 7faf53200640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c15eca0 con 0x7faf4c071a20 2024-04-18T04:50:36.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.582+0000 7faf53200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c15ef60 con 0x7faf4c0c2c80 2024-04-18T04:50:36.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.582+0000 7faf4b400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faf4c0c2c80 0x7faf4c1fa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:36.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.582+0000 7faf4b400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faf4c0c2c80 0x7faf4c1fa4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:52178/0 (socket says 172.21.15.120:52178) 2024-04-18T04:50:36.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.582+0000 7faf4b400640 1 -- 172.21.15.120:0/2476426638 learned_addr learned my addr 172.21.15.120:0/2476426638 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:50:36.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.586+0000 7faf51200640 1 --2- 172.21.15.120:0/2476426638 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf4c157e40 0x7faf4c15f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:36.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.586+0000 7faf4be00640 1 --2- 172.21.15.120:0/2476426638 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf4c071a20 0x7faf4c160870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:36.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.586+0000 7faf4b400640 1 -- 172.21.15.120:0/2476426638 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf4c071a20 msgr2=0x7faf4c160870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:36.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.586+0000 7faf4b400640 1 --2- 172.21.15.120:0/2476426638 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf4c071a20 0x7faf4c160870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:36.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.586+0000 7faf4b400640 1 -- 172.21.15.120:0/2476426638 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf4c157e40 msgr2=0x7faf4c15f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:36.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.586+0000 7faf4b400640 1 --2- 172.21.15.120:0/2476426638 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf4c157e40 0x7faf4c15f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:36.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.586+0000 7faf4b400640 1 -- 172.21.15.120:0/2476426638 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3c009420 con 0x7faf4c0c2c80 2024-04-18T04:50:36.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.586+0000 7faf51200640 1 --2- 172.21.15.120:0/2476426638 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf4c157e40 0x7faf4c15f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:50:36.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.586+0000 7faf4b400640 1 --2- 172.21.15.120:0/2476426638 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faf4c0c2c80 0x7faf4c1fa4d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faf3800b450 tx=0x7faf3800b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:36.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.586+0000 7faf43e00640 1 -- 172.21.15.120:0/2476426638 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf38011890 con 0x7faf4c0c2c80 2024-04-18T04:50:36.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.586+0000 7faf43e00640 1 -- 172.21.15.120:0/2476426638 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf380119f0 con 0x7faf4c0c2c80 2024-04-18T04:50:36.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.586+0000 7faf43e00640 1 -- 172.21.15.120:0/2476426638 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf38011dc0 con 0x7faf4c0c2c80 2024-04-18T04:50:36.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.590+0000 7faf53200640 1 -- 172.21.15.120:0/2476426638 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf44009b30 con 0x7faf4c0c2c80 2024-04-18T04:50:36.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.590+0000 7faf53200640 1 -- 172.21.15.120:0/2476426638 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf4c1f99f0 con 0x7faf4c0c2c80 2024-04-18T04:50:36.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.594+0000 7faf53200640 1 -- 172.21.15.120:0/2476426638 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf4c067590 con 0x7faf4c0c2c80 2024-04-18T04:50:36.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.598+0000 7faf43e00640 1 -- 172.21.15.120:0/2476426638 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7faf3801a400 con 0x7faf4c0c2c80 2024-04-18T04:50:36.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.602+0000 7faf43e00640 1 --2- 172.21.15.120:0/2476426638 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7faf2c066790 0x7faf2c068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:36.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.602+0000 7faf43e00640 1 -- 172.21.15.120:0/2476426638 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7faf380849d0 con 0x7faf4c0c2c80 2024-04-18T04:50:36.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.602+0000 7faf4be00640 1 --2- 172.21.15.120:0/2476426638 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7faf2c066790 0x7faf2c068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:36.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.602+0000 7faf4be00640 1 --2- 172.21.15.120:0/2476426638 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7faf2c066790 0x7faf2c068c50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7faf440ae000 tx=0x7faf440a7070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:36.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:36.606+0000 7faf43e00640 1 -- 172.21.15.120:0/2476426638 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7faf380518f0 con 0x7faf4c0c2c80 2024-04-18T04:50:37.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:37.058+0000 7faf53200640 1 -- 172.21.15.120:0/2476426638 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf4c1fa1f0 con 0x7faf4c0c2c80 2024-04-18T04:50:37.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:37.062+0000 7faf43e00640 1 -- 172.21.15.120:0/2476426638 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+5529 (secure 0 0 0) 0x7faf4c1fa1f0 con 0x7faf4c0c2c80 2024-04-18T04:50:37.068 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:50:37.069 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:50:33.312065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4967,"mds_2":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:resolve","state_seq":25,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5130":{"gid":5130,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":23,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:50:37.069 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 29 2024-04-18T04:50:37.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:37.074+0000 7faf53200640 1 -- 172.21.15.120:0/2476426638 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7faf2c066790 msgr2=0x7faf2c068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:37.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:37.074+0000 7faf53200640 1 --2- 172.21.15.120:0/2476426638 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7faf2c066790 0x7faf2c068c50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7faf440ae000 tx=0x7faf440a7070 comp rx=0 tx=0).stop 2024-04-18T04:50:37.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:37.074+0000 7faf53200640 1 -- 172.21.15.120:0/2476426638 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faf4c0c2c80 msgr2=0x7faf4c1fa4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:37.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:37.074+0000 7faf53200640 1 --2- 172.21.15.120:0/2476426638 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faf4c0c2c80 0x7faf4c1fa4d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faf3800b450 tx=0x7faf3800b910 comp rx=0 tx=0).stop 2024-04-18T04:50:37.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:37.074+0000 7faf53200640 1 -- 172.21.15.120:0/2476426638 shutdown_connections 2024-04-18T04:50:37.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:37.074+0000 7faf53200640 1 --2- 172.21.15.120:0/2476426638 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7faf2c066790 0x7faf2c068c50 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:37.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:37.074+0000 7faf53200640 1 --2- 172.21.15.120:0/2476426638 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf4c157e40 0x7faf4c15f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:37.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:37.074+0000 7faf53200640 1 --2- 172.21.15.120:0/2476426638 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faf4c0c2c80 0x7faf4c1fa4d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:37.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:37.074+0000 7faf53200640 1 --2- 172.21.15.120:0/2476426638 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf4c071a20 0x7faf4c160870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:37.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:37.074+0000 7faf53200640 1 -- 172.21.15.120:0/2476426638 >> 172.21.15.120:0/2476426638 conn(0x7faf4c0cbfb0 msgr2=0x7faf4c150d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:50:37.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:37.074+0000 7faf53200640 1 -- 172.21.15.120:0/2476426638 shutdown_connections 2024-04-18T04:50:37.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:37.074+0000 7faf53200640 1 -- 172.21.15.120:0/2476426638 wait complete. 2024-04-18T04:50:37.128 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:50:39.129 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:50:39.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.402+0000 7fc18ae00640 1 Processor -- start 2024-04-18T04:50:39.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.406+0000 7fc18ae00640 1 -- start start 2024-04-18T04:50:39.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.406+0000 7fc18ae00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc18415e1f0 0x7fc1840c0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:39.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.406+0000 7fc18ae00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc1840c05c0 0x7fc18406b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:39.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.406+0000 7fc18ae00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc184161ca0 con 0x7fc184157c40 2024-04-18T04:50:39.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.406+0000 7fc18ae00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc184160d00 con 0x7fc1840c05c0 2024-04-18T04:50:39.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.406+0000 7fc18ae00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1840c7750 con 0x7fc18415e1f0 2024-04-18T04:50:39.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.406+0000 7fc18a400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc1840c05c0 0x7fc18406b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:39.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.406+0000 7fc18a400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc1840c05c0 0x7fc18406b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41920/0 (socket says 172.21.15.120:41920) 2024-04-18T04:50:39.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.406+0000 7fc189a00640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fc184157c40 0x7fc18406bf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:34322/0 (socket says 172.21.15.120:34322) 2024-04-18T04:50:39.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.406+0000 7fc189a00640 1 -- 172.21.15.120:0/236360709 learned_addr learned my addr 172.21.15.120:0/236360709 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:50:39.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.406+0000 7fc189000640 1 --2- 172.21.15.120:0/236360709 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc18415e1f0 0x7fc1840c0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:39.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.406+0000 7fc183e00640 1 -- 172.21.15.120:0/236360709 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1574887240 0 0) 0x7fc184161ca0 con 0x7fc184157c40 2024-04-18T04:50:39.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.406+0000 7fc183e00640 1 -- 172.21.15.120:0/236360709 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc16c003530 con 0x7fc184157c40 2024-04-18T04:50:39.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.410+0000 7fc189000640 1 -- 172.21.15.120:0/236360709 >> v2:172.21.15.120:3300/0 conn(0x7fc1840c05c0 msgr2=0x7fc18406b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:50:39.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.410+0000 7fc183e00640 1 -- 172.21.15.120:0/236360709 <== mon.1 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3924999463 0 0) 0x7fc16c003530 con 0x7fc184157c40 2024-04-18T04:50:39.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.410+0000 7fc189000640 1 --2- 172.21.15.120:0/236360709 >> v2:172.21.15.120:3300/0 conn(0x7fc1840c05c0 0x7fc18406b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:39.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.410+0000 7fc189000640 1 -- 172.21.15.120:0/236360709 >> v1:172.21.15.132:6789/0 conn(0x7fc184157c40 legacy=0x7fc18406bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:39.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.410+0000 7fc189000640 1 -- 172.21.15.120:0/236360709 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc18406c7a0 con 0x7fc18415e1f0 2024-04-18T04:50:39.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.410+0000 7fc18a400640 1 --2- 172.21.15.120:0/236360709 >> v2:172.21.15.120:3300/0 conn(0x7fc1840c05c0 0x7fc18406b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:50:39.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.414+0000 7fc189000640 1 --2- 172.21.15.120:0/236360709 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc18415e1f0 0x7fc1840c0080 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc1700097c0 tx=0x7fc17001ebb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c4560762c6ae468 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:39.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.418+0000 7fc183e00640 1 -- 172.21.15.120:0/236360709 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc178001680 con 0x7fc18415e1f0 2024-04-18T04:50:39.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.418+0000 7fc183e00640 1 -- 172.21.15.120:0/236360709 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1700a85f0 con 0x7fc18415e1f0 2024-04-18T04:50:39.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.418+0000 7fc183e00640 1 -- 172.21.15.120:0/236360709 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc178001680 con 0x7fc18415e1f0 2024-04-18T04:50:39.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.418+0000 7fc18ae00640 1 -- 172.21.15.120:0/236360709 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc18415e1f0 msgr2=0x7fc1840c0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:39.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.418+0000 7fc18ae00640 1 --2- 172.21.15.120:0/236360709 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc18415e1f0 0x7fc1840c0080 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc1700097c0 tx=0x7fc17001ebb0 comp rx=0 tx=0).stop 2024-04-18T04:50:39.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.422+0000 7fc18ae00640 1 -- 172.21.15.120:0/236360709 shutdown_connections 2024-04-18T04:50:39.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.422+0000 7fc18ae00640 1 --2- 172.21.15.120:0/236360709 >> v2:172.21.15.120:3300/0 conn(0x7fc1840c05c0 0x7fc18406b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:39.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.422+0000 7fc18ae00640 1 --2- 172.21.15.120:0/236360709 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc18415e1f0 0x7fc1840c0080 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:39.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.422+0000 7fc18ae00640 1 -- 172.21.15.120:0/236360709 >> 172.21.15.120:0/236360709 conn(0x7fc18406d000 msgr2=0x7fc18406d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:50:39.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.422+0000 7fc18ae00640 1 -- 172.21.15.120:0/236360709 shutdown_connections 2024-04-18T04:50:39.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.422+0000 7fc18ae00640 1 -- 172.21.15.120:0/236360709 wait complete. 2024-04-18T04:50:39.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.426+0000 7fc18ae00640 1 Processor -- start 2024-04-18T04:50:39.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.430+0000 7fc18ae00640 1 -- start start 2024-04-18T04:50:39.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.430+0000 7fc18ae00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1840c05c0 0x7fc1841400d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:39.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.430+0000 7fc18ae00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc184157c40 0x7fc18413b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:39.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.430+0000 7fc189a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1840c05c0 0x7fc1841400d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:39.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.430+0000 7fc189a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1840c05c0 0x7fc1841400d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:52194/0 (socket says 172.21.15.120:52194) 2024-04-18T04:50:39.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.434+0000 7fc18ae00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc18415e1f0 0x7fc1840ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:39.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.434+0000 7fc18ae00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc18415f310 con 0x7fc18415e1f0 2024-04-18T04:50:39.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.434+0000 7fc18ae00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc18413f8f0 con 0x7fc184157c40 2024-04-18T04:50:39.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.434+0000 7fc18ae00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc18415ea70 con 0x7fc1840c05c0 2024-04-18T04:50:39.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.434+0000 7fc189a00640 1 -- 172.21.15.120:0/368951670 learned_addr learned my addr 172.21.15.120:0/368951670 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:50:39.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.434+0000 7fc189000640 1 --2- 172.21.15.120:0/368951670 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc184157c40 0x7fc18413b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:39.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.434+0000 7fc189a00640 1 -- 172.21.15.120:0/368951670 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc184157c40 msgr2=0x7fc18413b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:39.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.434+0000 7fc189a00640 1 --2- 172.21.15.120:0/368951670 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc184157c40 0x7fc18413b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:39.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.434+0000 7fc189a00640 1 -- 172.21.15.120:0/368951670 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc18415e1f0 msgr2=0x7fc1840ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:39.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.434+0000 7fc189a00640 1 --2- 172.21.15.120:0/368951670 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc18415e1f0 0x7fc1840ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:39.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.434+0000 7fc189a00640 1 -- 172.21.15.120:0/368951670 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17c009a70 con 0x7fc1840c05c0 2024-04-18T04:50:39.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.434+0000 7fc189000640 1 --2- 172.21.15.120:0/368951670 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc184157c40 0x7fc18413b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:50:39.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.434+0000 7fc189a00640 1 --2- 172.21.15.120:0/368951670 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1840c05c0 0x7fc1841400d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc17800c760 tx=0x7fc17800cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:39.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.438+0000 7fc181600640 1 -- 172.21.15.120:0/368951670 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc178005ae0 con 0x7fc1840c05c0 2024-04-18T04:50:39.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.438+0000 7fc181600640 1 -- 172.21.15.120:0/368951670 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc178005c40 con 0x7fc1840c05c0 2024-04-18T04:50:39.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.438+0000 7fc181600640 1 -- 172.21.15.120:0/368951670 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc178007070 con 0x7fc1840c05c0 2024-04-18T04:50:39.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.438+0000 7fc18ae00640 1 -- 172.21.15.120:0/368951670 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc170009420 con 0x7fc1840c05c0 2024-04-18T04:50:39.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.438+0000 7fc18ae00640 1 -- 172.21.15.120:0/368951670 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc18415f030 con 0x7fc1840c05c0 2024-04-18T04:50:39.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.442+0000 7fc18ae00640 1 -- 172.21.15.120:0/368951670 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1840728f0 con 0x7fc1840c05c0 2024-04-18T04:50:39.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.442+0000 7fc181600640 1 -- 172.21.15.120:0/368951670 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc1780071d0 con 0x7fc1840c05c0 2024-04-18T04:50:39.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.454+0000 7fc181600640 1 --2- 172.21.15.120:0/368951670 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc164066690 0x7fc164068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:39.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.454+0000 7fc181600640 1 -- 172.21.15.120:0/368951670 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7fc1780843d0 con 0x7fc1840c05c0 2024-04-18T04:50:39.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.454+0000 7fc181600640 1 -- 172.21.15.120:0/368951670 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fc1780869d0 con 0x7fc1840c05c0 2024-04-18T04:50:39.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.454+0000 7fc189000640 1 --2- 172.21.15.120:0/368951670 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc164066690 0x7fc164068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:39.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.458+0000 7fc189000640 1 --2- 172.21.15.120:0/368951670 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc164066690 0x7fc164068b50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc1700b2000 tx=0x7fc1700aa070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:39.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.826+0000 7fc18ae00640 1 -- 172.21.15.120:0/368951670 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc18413c990 con 0x7fc1840c05c0 2024-04-18T04:50:39.827 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:50:39.827 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:50:39.016006+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4967,"mds_2":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:reconnect","state_seq":27,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5130":{"gid":5130,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":23,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:50:39.827 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 30 2024-04-18T04:50:40.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.830+0000 7fc181600640 1 -- 172.21.15.120:0/368951670 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+5531 (secure 0 0 0) 0x7fc1780512f0 con 0x7fc1840c05c0 2024-04-18T04:50:40.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.830+0000 7fc18ae00640 1 -- 172.21.15.120:0/368951670 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc164066690 msgr2=0x7fc164068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:40.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.830+0000 7fc18ae00640 1 --2- 172.21.15.120:0/368951670 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc164066690 0x7fc164068b50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc1700b2000 tx=0x7fc1700aa070 comp rx=0 tx=0).stop 2024-04-18T04:50:40.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.830+0000 7fc18ae00640 1 -- 172.21.15.120:0/368951670 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1840c05c0 msgr2=0x7fc1841400d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:40.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.830+0000 7fc18ae00640 1 --2- 172.21.15.120:0/368951670 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1840c05c0 0x7fc1841400d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc17800c760 tx=0x7fc17800cc20 comp rx=0 tx=0).stop 2024-04-18T04:50:40.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.830+0000 7fc18ae00640 1 -- 172.21.15.120:0/368951670 shutdown_connections 2024-04-18T04:50:40.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.830+0000 7fc18ae00640 1 --2- 172.21.15.120:0/368951670 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc164066690 0x7fc164068b50 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:40.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.830+0000 7fc18ae00640 1 --2- 172.21.15.120:0/368951670 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc18415e1f0 0x7fc1840ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:40.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.830+0000 7fc18ae00640 1 --2- 172.21.15.120:0/368951670 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc184157c40 0x7fc18413b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:40.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.830+0000 7fc18ae00640 1 --2- 172.21.15.120:0/368951670 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1840c05c0 0x7fc1841400d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:40.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.830+0000 7fc18ae00640 1 -- 172.21.15.120:0/368951670 >> 172.21.15.120:0/368951670 conn(0x7fc18406d000 msgr2=0x7fc184155df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:50:40.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.830+0000 7fc18ae00640 1 -- 172.21.15.120:0/368951670 shutdown_connections 2024-04-18T04:50:40.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:39.830+0000 7fc18ae00640 1 -- 172.21.15.120:0/368951670 wait complete. 2024-04-18T04:50:40.130 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:50:40.364 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:50:40.373 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:50:42.130 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:50:42.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.390+0000 7fc536c00640 1 Processor -- start 2024-04-18T04:50:42.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.390+0000 7fc536c00640 1 -- start start 2024-04-18T04:50:42.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.394+0000 7fc536c00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc530163a90 0x7fc5300c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:42.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.394+0000 7fc536c00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc53006bfc0 0x7fc53006c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:42.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.394+0000 7fc536c00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc53006b800 con 0x7fc530166460 2024-04-18T04:50:42.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.394+0000 7fc536c00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc530070130 con 0x7fc53006bfc0 2024-04-18T04:50:42.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.394+0000 7fc536c00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5300c72e0 con 0x7fc530163a90 2024-04-18T04:50:42.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.394+0000 7fc52fe00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc530163a90 0x7fc5300c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:42.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.394+0000 7fc52fe00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc530163a90 0x7fc5300c61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:47304/0 (socket says 172.21.15.120:47304) 2024-04-18T04:50:42.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.394+0000 7fc52fe00640 1 -- 172.21.15.120:0/3179886124 learned_addr learned my addr 172.21.15.120:0/3179886124 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:50:42.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.398+0000 7fc52f400640 1 --2- 172.21.15.120:0/3179886124 >> v2:172.21.15.132:3300/0 conn(0x7fc53006bfc0 0x7fc53006c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:42.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.398+0000 7fc52ea00640 1 -- 172.21.15.120:0/3179886124 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4215893246 0 0) 0x7fc53006b800 con 0x7fc530166460 2024-04-18T04:50:42.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.454+0000 7fc52ea00640 1 -- 172.21.15.120:0/3179886124 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc514003530 con 0x7fc530166460 2024-04-18T04:50:42.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.454+0000 7fc52fe00640 1 -- 172.21.15.120:0/3179886124 >> v2:172.21.15.132:3300/0 conn(0x7fc53006bfc0 msgr2=0x7fc53006c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:50:42.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.454+0000 7fc52fe00640 1 --2- 172.21.15.120:0/3179886124 >> v2:172.21.15.132:3300/0 conn(0x7fc53006bfc0 0x7fc53006c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:42.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.454+0000 7fc52fe00640 1 -- 172.21.15.120:0/3179886124 >> v1:172.21.15.132:6789/0 conn(0x7fc530166460 legacy=0x7fc5301668d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:42.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.454+0000 7fc52fe00640 1 -- 172.21.15.120:0/3179886124 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5300c6d20 con 0x7fc530163a90 2024-04-18T04:50:42.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.458+0000 7fc52fe00640 1 --2- 172.21.15.120:0/3179886124 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc530163a90 0x7fc5300c61d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc520007860 tx=0x7fc520020fe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93d34e5ddc312459 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:42.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.462+0000 7fc52ea00640 1 -- 172.21.15.120:0/3179886124 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5200aad90 con 0x7fc530163a90 2024-04-18T04:50:42.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.462+0000 7fc52ea00640 1 -- 172.21.15.120:0/3179886124 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5200b23f0 con 0x7fc530163a90 2024-04-18T04:50:42.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.462+0000 7fc52ea00640 1 -- 172.21.15.120:0/3179886124 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5200b2780 con 0x7fc530163a90 2024-04-18T04:50:42.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.462+0000 7fc536c00640 1 -- 172.21.15.120:0/3179886124 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc530163a90 msgr2=0x7fc5300c61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:42.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.462+0000 7fc536c00640 1 --2- 172.21.15.120:0/3179886124 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc530163a90 0x7fc5300c61d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc520007860 tx=0x7fc520020fe0 comp rx=0 tx=0).stop 2024-04-18T04:50:42.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.466+0000 7fc536c00640 1 -- 172.21.15.120:0/3179886124 shutdown_connections 2024-04-18T04:50:42.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.466+0000 7fc536c00640 1 --2- 172.21.15.120:0/3179886124 >> v2:172.21.15.132:3300/0 conn(0x7fc53006bfc0 0x7fc53006c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:42.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.466+0000 7fc536c00640 1 --2- 172.21.15.120:0/3179886124 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc530163a90 0x7fc5300c61d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:42.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.466+0000 7fc536c00640 1 -- 172.21.15.120:0/3179886124 >> 172.21.15.120:0/3179886124 conn(0x7fc5300c78c0 msgr2=0x7fc5300c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:50:42.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.466+0000 7fc536c00640 1 -- 172.21.15.120:0/3179886124 shutdown_connections 2024-04-18T04:50:42.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.474+0000 7fc536c00640 1 -- 172.21.15.120:0/3179886124 wait complete. 2024-04-18T04:50:42.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.478+0000 7fc536c00640 1 Processor -- start 2024-04-18T04:50:42.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.482+0000 7fc536c00640 1 -- start start 2024-04-18T04:50:42.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.482+0000 7fc536c00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc53006bfc0 0x7fc5301f05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:42.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.482+0000 7fc536c00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc530163a90 0x7fc530167820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:42.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.482+0000 7fc536c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc530166460 0x7fc5300c4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:42.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.482+0000 7fc536c00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5300c43a0 con 0x7fc530166460 2024-04-18T04:50:42.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.482+0000 7fc536c00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5300b0f60 con 0x7fc530163a90 2024-04-18T04:50:42.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.482+0000 7fc536c00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5301f0af0 con 0x7fc53006bfc0 2024-04-18T04:50:42.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.482+0000 7fc52fe00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc53006bfc0 0x7fc5301f05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:42.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.482+0000 7fc52fe00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc53006bfc0 0x7fc5301f05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:47316/0 (socket says 172.21.15.120:47316) 2024-04-18T04:50:42.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.482+0000 7fc52fe00640 1 -- 172.21.15.120:0/2054877373 learned_addr learned my addr 172.21.15.120:0/2054877373 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:50:42.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.482+0000 7fc52fe00640 1 -- 172.21.15.120:0/2054877373 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc530163a90 msgr2=0x7fc530167820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:50:42.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.482+0000 7fc52fe00640 1 --2- 172.21.15.120:0/2054877373 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc530163a90 0x7fc530167820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:42.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.482+0000 7fc52fe00640 1 -- 172.21.15.120:0/2054877373 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc530166460 msgr2=0x7fc5300c4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:42.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.482+0000 7fc52fe00640 1 --2- 172.21.15.120:0/2054877373 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc530166460 0x7fc5300c4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:42.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.482+0000 7fc52fe00640 1 -- 172.21.15.120:0/2054877373 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc520007540 con 0x7fc53006bfc0 2024-04-18T04:50:42.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.486+0000 7fc52fe00640 1 --2- 172.21.15.120:0/2054877373 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc53006bfc0 0x7fc5301f05b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc520021880 tx=0x7fc52001dd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:42.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.486+0000 7fc527e00640 1 -- 172.21.15.120:0/2054877373 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5200b28f0 con 0x7fc53006bfc0 2024-04-18T04:50:42.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.486+0000 7fc527e00640 1 -- 172.21.15.120:0/2054877373 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5200b2a50 con 0x7fc53006bfc0 2024-04-18T04:50:42.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.486+0000 7fc527e00640 1 -- 172.21.15.120:0/2054877373 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5200b2de0 con 0x7fc53006bfc0 2024-04-18T04:50:42.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.486+0000 7fc536c00640 1 -- 172.21.15.120:0/2054877373 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5301682f0 con 0x7fc53006bfc0 2024-04-18T04:50:42.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.486+0000 7fc536c00640 1 -- 172.21.15.120:0/2054877373 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5300b0c80 con 0x7fc53006bfc0 2024-04-18T04:50:42.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.490+0000 7fc536c00640 1 -- 172.21.15.120:0/2054877373 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc530073e10 con 0x7fc53006bfc0 2024-04-18T04:50:42.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.490+0000 7fc527e00640 1 -- 172.21.15.120:0/2054877373 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc5200bc3f0 con 0x7fc53006bfc0 2024-04-18T04:50:42.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.494+0000 7fc527e00640 1 --2- 172.21.15.120:0/2054877373 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc5100666e0 0x7fc510068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:42.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.494+0000 7fc52f400640 1 --2- 172.21.15.120:0/2054877373 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc5100666e0 0x7fc510068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:42.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.494+0000 7fc52f400640 1 --2- 172.21.15.120:0/2054877373 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc5100666e0 0x7fc510068ba0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc530169520 tx=0x7fc51c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:42.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.498+0000 7fc527e00640 1 -- 172.21.15.120:0/2054877373 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7fc5200cb2a0 con 0x7fc53006bfc0 2024-04-18T04:50:42.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.498+0000 7fc527e00640 1 -- 172.21.15.120:0/2054877373 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fc5200ef2b0 con 0x7fc53006bfc0 2024-04-18T04:50:42.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.854+0000 7fc536c00640 1 -- 172.21.15.120:0/2054877373 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc530072a70 con 0x7fc53006bfc0 2024-04-18T04:50:42.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.854+0000 7fc527e00640 1 -- 172.21.15.120:0/2054877373 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+5531 (secure 0 0 0) 0x7fc5200f28d0 con 0x7fc53006bfc0 2024-04-18T04:50:42.854 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:50:42.854 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:50:39.016006+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4967,"mds_2":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:reconnect","state_seq":27,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5130":{"gid":5130,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":23,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:50:42.855 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 30 2024-04-18T04:50:42.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.858+0000 7fc536c00640 1 -- 172.21.15.120:0/2054877373 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc5100666e0 msgr2=0x7fc510068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:42.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.858+0000 7fc536c00640 1 --2- 172.21.15.120:0/2054877373 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc5100666e0 0x7fc510068ba0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc530169520 tx=0x7fc51c009190 comp rx=0 tx=0).stop 2024-04-18T04:50:42.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.858+0000 7fc536c00640 1 -- 172.21.15.120:0/2054877373 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc53006bfc0 msgr2=0x7fc5301f05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:42.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.858+0000 7fc536c00640 1 --2- 172.21.15.120:0/2054877373 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc53006bfc0 0x7fc5301f05b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc520021880 tx=0x7fc52001dd80 comp rx=0 tx=0).stop 2024-04-18T04:50:42.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.858+0000 7fc536c00640 1 -- 172.21.15.120:0/2054877373 shutdown_connections 2024-04-18T04:50:42.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.858+0000 7fc536c00640 1 --2- 172.21.15.120:0/2054877373 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc5100666e0 0x7fc510068ba0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:42.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.858+0000 7fc536c00640 1 --2- 172.21.15.120:0/2054877373 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc530166460 0x7fc5300c4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:42.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.858+0000 7fc536c00640 1 --2- 172.21.15.120:0/2054877373 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc530163a90 0x7fc530167820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:42.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.858+0000 7fc536c00640 1 --2- 172.21.15.120:0/2054877373 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc53006bfc0 0x7fc5301f05b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:42.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.858+0000 7fc536c00640 1 -- 172.21.15.120:0/2054877373 >> 172.21.15.120:0/2054877373 conn(0x7fc5300c78c0 msgr2=0x7fc530162920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:50:42.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.858+0000 7fc536c00640 1 -- 172.21.15.120:0/2054877373 shutdown_connections 2024-04-18T04:50:42.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:42.858+0000 7fc536c00640 1 -- 172.21.15.120:0/2054877373 wait complete. 2024-04-18T04:50:42.896 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 30, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-18T04:44:30.251235+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 30, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1, 2 ], "info": { "gid_4288": { "addr": "172.21.15.120:6837/76856194", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6835", "nonce": 76856194, "type": "v2" }, { "addr": "172.21.15.120:6837", "nonce": 76856194, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4288, "incarnation": 4, "join_fscid": -1, "name": "e", "rank": 0, "state": "up:active", "state_seq": 4 }, "gid_4967": { "addr": "172.21.15.132:6835/396956733", "addrs": { "addrvec": [ { "addr": "172.21.15.132:6834", "nonce": 396956733, "type": "v2" }, { "addr": "172.21.15.132:6835", "nonce": 396956733, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4967, "incarnation": 28, "join_fscid": -1, "name": "b", "rank": 1, "state": "up:reconnect", "state_seq": 27 }, "gid_5130": { "addr": "172.21.15.120:6833/4067927368", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6832", "nonce": 4067927368, "type": "v2" }, { "addr": "172.21.15.120:6833", "nonce": 4067927368, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5130, "incarnation": 22, "join_fscid": -1, "name": "c", "rank": 2, "state": "up:active", "state_seq": 23 } }, "last_failure": 0, "last_failure_osd_epoch": 30, "max_file_size": 1099511627776, "max_mds": 3, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-18T04:50:39.016006+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4288, "mds_1": 4967, "mds_2": 5130 } } } ], "standbys": [ { "addr": "172.21.15.132:6839/4292136288", "addrs": { "addrvec": [ { "addr": "172.21.15.132:6836", "nonce": 4292136288, "type": "v2" }, { "addr": "172.21.15.132:6839", "nonce": 4292136288, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4241, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.132:6838/1712856922", "addrs": { "addrvec": [ { "addr": "172.21.15.132:6837", "nonce": 1712856922, "type": "v2" }, { "addr": "172.21.15.132:6838", "nonce": 1712856922, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 2, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4244, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-18T04:50:44.897 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:50:45.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.146+0000 7f6411400640 1 Processor -- start 2024-04-18T04:50:45.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.146+0000 7f6411400640 1 -- start start 2024-04-18T04:50:45.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.150+0000 7f6411400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6404006670 0x7f64040360b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:45.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.150+0000 7f6411400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f64040dbc50 0x7f64040dc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:45.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.150+0000 7f6411400640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6404035c20 con 0x7f640404caf0 2024-04-18T04:50:45.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.150+0000 7f6411400640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64040470d0 con 0x7f64040dbc50 2024-04-18T04:50:45.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.150+0000 7f6411400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64040473b0 con 0x7f6404006670 2024-04-18T04:50:45.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.150+0000 7f640be00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6404006670 0x7f64040360b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:45.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.150+0000 7f6410a00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f64040dbc50 0x7f64040dc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:45.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.150+0000 7f640be00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6404006670 0x7f64040360b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:47324/0 (socket says 172.21.15.120:47324) 2024-04-18T04:50:45.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.150+0000 7f640be00640 1 -- 172.21.15.120:0/1367549218 learned_addr learned my addr 172.21.15.120:0/1367549218 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:50:45.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.150+0000 7f6410a00640 1 -- 172.21.15.120:0/1367549218 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6404006670 msgr2=0x7f64040360b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:50:45.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.150+0000 7f6410a00640 1 --2- 172.21.15.120:0/1367549218 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6404006670 0x7f64040360b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:45.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.150+0000 7f6410a00640 1 -- 172.21.15.120:0/1367549218 >> v1:172.21.15.132:6789/0 conn(0x7f640404caf0 legacy=0x7f64040d5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:50:45.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.150+0000 7f6410a00640 1 -- 172.21.15.120:0/1367549218 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6404047690 con 0x7f64040dbc50 2024-04-18T04:50:45.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.154+0000 7f6410a00640 1 --2- 172.21.15.120:0/1367549218 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f64040dbc50 0x7f64040dc0c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f640c02c920 tx=0x7f640c0999b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53e68cd5bab79485 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:45.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.154+0000 7f640aa00640 1 -- 172.21.15.120:0/1367549218 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640c12c070 con 0x7f64040dbc50 2024-04-18T04:50:45.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.154+0000 7f640aa00640 1 -- 172.21.15.120:0/1367549218 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f640c1264e0 con 0x7f64040dbc50 2024-04-18T04:50:45.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.154+0000 7f640aa00640 1 -- 172.21.15.120:0/1367549218 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640c126950 con 0x7f64040dbc50 2024-04-18T04:50:45.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.158+0000 7f6411400640 1 -- 172.21.15.120:0/1367549218 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f64040dbc50 msgr2=0x7f64040dc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:45.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.158+0000 7f6411400640 1 --2- 172.21.15.120:0/1367549218 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f64040dbc50 0x7f64040dc0c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f640c02c920 tx=0x7f640c0999b0 comp rx=0 tx=0).stop 2024-04-18T04:50:45.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.158+0000 7f6411400640 1 -- 172.21.15.120:0/1367549218 shutdown_connections 2024-04-18T04:50:45.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.158+0000 7f6411400640 1 --2- 172.21.15.120:0/1367549218 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f64040dbc50 0x7f64040dc0c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:45.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.158+0000 7f6411400640 1 --2- 172.21.15.120:0/1367549218 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6404006670 0x7f64040360b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:45.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.158+0000 7f6411400640 1 -- 172.21.15.120:0/1367549218 >> 172.21.15.120:0/1367549218 conn(0x7f64040505b0 msgr2=0x7f64040509c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:50:45.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.158+0000 7f6411400640 1 -- 172.21.15.120:0/1367549218 shutdown_connections 2024-04-18T04:50:45.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.158+0000 7f6411400640 1 -- 172.21.15.120:0/1367549218 wait complete. 2024-04-18T04:50:45.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.162+0000 7f6411400640 1 Processor -- start 2024-04-18T04:50:45.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.162+0000 7f6411400640 1 -- start start 2024-04-18T04:50:45.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.162+0000 7f6411400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6404006670 0x7f64040ddec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:45.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.162+0000 7f6411400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f640404caf0 0x7f64040d4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:45.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.162+0000 7f6411400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64040dbc50 0x7f64040c3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:45.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.162+0000 7f6411400640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64040dd330 con 0x7f64040dbc50 2024-04-18T04:50:45.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.162+0000 7f6411400640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64040de400 con 0x7f640404caf0 2024-04-18T04:50:45.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.162+0000 7f6411400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64040dcb20 con 0x7f6404006670 2024-04-18T04:50:45.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.166+0000 7f640be00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6404006670 0x7f64040ddec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:45.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.166+0000 7f640be00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6404006670 0x7f64040ddec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:47330/0 (socket says 172.21.15.120:47330) 2024-04-18T04:50:45.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.166+0000 7f640be00640 1 -- 172.21.15.120:0/371079139 learned_addr learned my addr 172.21.15.120:0/371079139 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:50:45.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.166+0000 7f6410a00640 1 --2- 172.21.15.120:0/371079139 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64040dbc50 0x7f64040c3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:45.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.166+0000 7f640be00640 1 -- 172.21.15.120:0/371079139 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f640404caf0 msgr2=0x7f64040d4bf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:50:45.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.166+0000 7f640be00640 1 --2- 172.21.15.120:0/371079139 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f640404caf0 0x7f64040d4bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:45.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.166+0000 7f640be00640 1 -- 172.21.15.120:0/371079139 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64040dbc50 msgr2=0x7f64040c3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:45.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.166+0000 7f640be00640 1 --2- 172.21.15.120:0/371079139 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64040dbc50 0x7f64040c3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:45.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.166+0000 7f640be00640 1 -- 172.21.15.120:0/371079139 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f640c072040 con 0x7f6404006670 2024-04-18T04:50:45.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.166+0000 7f640be00640 1 --2- 172.21.15.120:0/371079139 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6404006670 0x7f64040ddec0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f640000d7d0 tx=0x7f640000dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:45.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.166+0000 7f63ffe00640 1 -- 172.21.15.120:0/371079139 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6400009640 con 0x7f6404006670 2024-04-18T04:50:45.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.166+0000 7f63ffe00640 1 -- 172.21.15.120:0/371079139 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64000097a0 con 0x7f6404006670 2024-04-18T04:50:45.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.166+0000 7f63ffe00640 1 -- 172.21.15.120:0/371079139 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6400009b50 con 0x7f6404006670 2024-04-18T04:50:45.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.166+0000 7f6411400640 1 -- 172.21.15.120:0/371079139 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64040c2bf0 con 0x7f6404006670 2024-04-18T04:50:45.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.170+0000 7f6411400640 1 -- 172.21.15.120:0/371079139 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64040c2350 con 0x7f6404006670 2024-04-18T04:50:45.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.170+0000 7f6411400640 1 -- 172.21.15.120:0/371079139 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64040057c0 con 0x7f6404006670 2024-04-18T04:50:45.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.170+0000 7f63ffe00640 1 -- 172.21.15.120:0/371079139 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6400009cb0 con 0x7f6404006670 2024-04-18T04:50:45.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.174+0000 7f63ffe00640 1 --2- 172.21.15.120:0/371079139 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f63ec0666e0 0x7f63ec068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:45.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.174+0000 7f63ffe00640 1 -- 172.21.15.120:0/371079139 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f6400084050 con 0x7f6404006670 2024-04-18T04:50:45.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.178+0000 7f640b400640 1 --2- 172.21.15.120:0/371079139 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f63ec0666e0 0x7f63ec068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:45.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.182+0000 7f640b400640 1 --2- 172.21.15.120:0/371079139 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f63ec0666e0 0x7f63ec068ba0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f64040d22d0 tx=0x7f63f8006b60 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:45.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.186+0000 7f63ffe00640 1 -- 172.21.15.120:0/371079139 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f6400089060 con 0x7f6404006670 2024-04-18T04:50:45.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.618+0000 7f6411400640 1 -- 172.21.15.120:0/371079139 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6404046630 con 0x7f6404006670 2024-04-18T04:50:45.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.618+0000 7f63ffe00640 1 -- 172.21.15.120:0/371079139 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+5528 (secure 0 0 0) 0x7f6400089060 con 0x7f6404006670 2024-04-18T04:50:45.621 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:50:45.621 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:50:44.046554+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4967,"mds_2":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:rejoin","state_seq":29,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5130":{"gid":5130,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":23,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:50:45.621 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 31 2024-04-18T04:50:45.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.622+0000 7f6411400640 1 -- 172.21.15.120:0/371079139 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f63ec0666e0 msgr2=0x7f63ec068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:45.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.622+0000 7f6411400640 1 --2- 172.21.15.120:0/371079139 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f63ec0666e0 0x7f63ec068ba0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f64040d22d0 tx=0x7f63f8006b60 comp rx=0 tx=0).stop 2024-04-18T04:50:45.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.622+0000 7f6411400640 1 -- 172.21.15.120:0/371079139 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6404006670 msgr2=0x7f64040ddec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:45.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.622+0000 7f6411400640 1 --2- 172.21.15.120:0/371079139 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6404006670 0x7f64040ddec0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f640000d7d0 tx=0x7f640000dc90 comp rx=0 tx=0).stop 2024-04-18T04:50:45.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.626+0000 7f6411400640 1 -- 172.21.15.120:0/371079139 shutdown_connections 2024-04-18T04:50:45.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.626+0000 7f6411400640 1 --2- 172.21.15.120:0/371079139 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f63ec0666e0 0x7f63ec068ba0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:45.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.626+0000 7f6411400640 1 --2- 172.21.15.120:0/371079139 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64040dbc50 0x7f64040c3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:45.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.626+0000 7f6411400640 1 --2- 172.21.15.120:0/371079139 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f640404caf0 0x7f64040d4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:45.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.626+0000 7f6411400640 1 --2- 172.21.15.120:0/371079139 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6404006670 0x7f64040ddec0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:45.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.626+0000 7f6411400640 1 -- 172.21.15.120:0/371079139 >> 172.21.15.120:0/371079139 conn(0x7f64040505b0 msgr2=0x7f6404046910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:50:45.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.626+0000 7f6411400640 1 -- 172.21.15.120:0/371079139 shutdown_connections 2024-04-18T04:50:45.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:45.634+0000 7f6411400640 1 -- 172.21.15.120:0/371079139 wait complete. 2024-04-18T04:50:45.674 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:50:47.678 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:50:48.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.022+0000 7fdc12000640 1 Processor -- start 2024-04-18T04:50:48.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.022+0000 7fdc12000640 1 -- start start 2024-04-18T04:50:48.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.026+0000 7fdc12000640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdc0c157a00 0x7fdc0c0c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:48.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.026+0000 7fdc12000640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fdc0c0c0330 0x7fdc0c157de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:48.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.026+0000 7fdc12000640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc0c15e970 con 0x7fdc0c06b660 2024-04-18T04:50:48.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.026+0000 7fdc12000640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc0c158320 con 0x7fdc0c0c0330 2024-04-18T04:50:48.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.026+0000 7fdc12000640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc0c162170 con 0x7fdc0c157a00 2024-04-18T04:50:48.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.026+0000 7fdc03e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fdc0c0c0330 0x7fdc0c157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:48.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.026+0000 7fdc03e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fdc0c0c0330 0x7fdc0c157de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50984/0 (socket says 172.21.15.120:50984) 2024-04-18T04:50:48.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.026+0000 7fdc03e00640 1 -- 172.21.15.120:0/1433993051 learned_addr learned my addr 172.21.15.120:0/1433993051 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:50:48.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.026+0000 7fdc03e00640 1 -- 172.21.15.120:0/1433993051 >> v2:172.21.15.132:3300/0 conn(0x7fdc0c157a00 msgr2=0x7fdc0c0c69e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-18T04:50:48.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.026+0000 7fdc03e00640 1 --2- 172.21.15.120:0/1433993051 >> v2:172.21.15.132:3300/0 conn(0x7fdc0c157a00 0x7fdc0c0c69e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:48.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.026+0000 7fdc03e00640 1 -- 172.21.15.120:0/1433993051 >> v1:172.21.15.132:6789/0 conn(0x7fdc0c06b660 legacy=0x7fdc0c06bad0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-18T04:50:48.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.026+0000 7fdc03e00640 1 -- 172.21.15.120:0/1433993051 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc0c0c0780 con 0x7fdc0c0c0330 2024-04-18T04:50:48.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.030+0000 7fdc03e00640 1 --2- 172.21.15.120:0/1433993051 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdc0c0c0330 0x7fdc0c157de0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c074050 tx=0x7fdbf401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a32bbb628b91331 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:48.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.030+0000 7fdc0aa00640 1 -- 172.21.15.120:0/1433993051 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf40a89f0 con 0x7fdc0c0c0330 2024-04-18T04:50:48.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.030+0000 7fdc0aa00640 1 -- 172.21.15.120:0/1433993051 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf40a8b50 con 0x7fdc0c0c0330 2024-04-18T04:50:48.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.030+0000 7fdc0aa00640 1 -- 172.21.15.120:0/1433993051 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf40b0440 con 0x7fdc0c0c0330 2024-04-18T04:50:48.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.030+0000 7fdc12000640 1 -- 172.21.15.120:0/1433993051 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdc0c0c0330 msgr2=0x7fdc0c157de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:48.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.030+0000 7fdc12000640 1 --2- 172.21.15.120:0/1433993051 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdc0c0c0330 0x7fdc0c157de0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c074050 tx=0x7fdbf401ecf0 comp rx=0 tx=0).stop 2024-04-18T04:50:48.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.034+0000 7fdc12000640 1 -- 172.21.15.120:0/1433993051 shutdown_connections 2024-04-18T04:50:48.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.034+0000 7fdc12000640 1 --2- 172.21.15.120:0/1433993051 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdc0c0c0330 0x7fdc0c157de0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:48.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.034+0000 7fdc12000640 1 --2- 172.21.15.120:0/1433993051 >> v2:172.21.15.132:3300/0 conn(0x7fdc0c157a00 0x7fdc0c0c69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:48.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.034+0000 7fdc12000640 1 -- 172.21.15.120:0/1433993051 >> 172.21.15.120:0/1433993051 conn(0x7fdc0c0c78c0 msgr2=0x7fdc0c0c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:50:48.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.042+0000 7fdc12000640 1 -- 172.21.15.120:0/1433993051 shutdown_connections 2024-04-18T04:50:48.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.046+0000 7fdc12000640 1 -- 172.21.15.120:0/1433993051 wait complete. 2024-04-18T04:50:48.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.046+0000 7fdc12000640 1 Processor -- start 2024-04-18T04:50:48.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.058+0000 7fdc12000640 1 -- start start 2024-04-18T04:50:48.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.058+0000 7fdc12000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdc0c06b660 0x7fdc0c149690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:48.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.058+0000 7fdc12000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdc0c0c0330 0x7fdc0c143720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:48.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.058+0000 7fdc12000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc0c157a00 0x7fdc0c145b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:48.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.058+0000 7fdc12000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c1486f0 con 0x7fdc0c0c0330 2024-04-18T04:50:48.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.058+0000 7fdc12000640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c14a0c0 con 0x7fdc0c157a00 2024-04-18T04:50:48.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.058+0000 7fdc12000640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c14a330 con 0x7fdc0c06b660 2024-04-18T04:50:48.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.062+0000 7fdc0b400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdc0c06b660 0x7fdc0c149690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:48.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.062+0000 7fdc0b400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdc0c06b660 0x7fdc0c149690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:47342/0 (socket says 172.21.15.120:47342) 2024-04-18T04:50:48.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.062+0000 7fdc0b400640 1 -- 172.21.15.120:0/1605929521 learned_addr learned my addr 172.21.15.120:0/1605929521 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:50:48.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.062+0000 7fdc0be00640 1 --2- 172.21.15.120:0/1605929521 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc0c157a00 0x7fdc0c145b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:48.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.062+0000 7fdc0be00640 1 -- 172.21.15.120:0/1605929521 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdc0c06b660 msgr2=0x7fdc0c149690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:48.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.062+0000 7fdc0be00640 1 --2- 172.21.15.120:0/1605929521 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdc0c06b660 0x7fdc0c149690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:48.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.062+0000 7fdc0be00640 1 -- 172.21.15.120:0/1605929521 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdc0c0c0330 msgr2=0x7fdc0c143720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:48.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.062+0000 7fdc0be00640 1 --2- 172.21.15.120:0/1605929521 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdc0c0c0330 0x7fdc0c143720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:48.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.062+0000 7fdc0be00640 1 -- 172.21.15.120:0/1605929521 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf40094d0 con 0x7fdc0c157a00 2024-04-18T04:50:48.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.066+0000 7fdc0be00640 1 --2- 172.21.15.120:0/1605929521 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc0c157a00 0x7fdc0c145b60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdc0400be20 tx=0x7fdc0400bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:48.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.074+0000 7fdc03400640 1 -- 172.21.15.120:0/1605929521 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0400cdf0 con 0x7fdc0c157a00 2024-04-18T04:50:48.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.074+0000 7fdc03400640 1 -- 172.21.15.120:0/1605929521 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc04014440 con 0x7fdc0c157a00 2024-04-18T04:50:48.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.074+0000 7fdc03400640 1 -- 172.21.15.120:0/1605929521 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc04014830 con 0x7fdc0c157a00 2024-04-18T04:50:48.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.078+0000 7fdc12000640 1 -- 172.21.15.120:0/1605929521 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc0c14a610 con 0x7fdc0c157a00 2024-04-18T04:50:48.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.078+0000 7fdc12000640 1 -- 172.21.15.120:0/1605929521 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc0c1460a0 con 0x7fdc0c157a00 2024-04-18T04:50:48.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.082+0000 7fdc03400640 1 -- 172.21.15.120:0/1605929521 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdc0401d3b0 con 0x7fdc0c157a00 2024-04-18T04:50:48.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.082+0000 7fdc03400640 1 --2- 172.21.15.120:0/1605929521 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fdbe8066790 0x7fdbe8068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:48.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.082+0000 7fdc03400640 1 -- 172.21.15.120:0/1605929521 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7fdc040847a0 con 0x7fdc0c157a00 2024-04-18T04:50:48.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.082+0000 7fdc0b400640 1 --2- 172.21.15.120:0/1605929521 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fdbe8066790 0x7fdbe8068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:48.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.090+0000 7fdc12000640 1 -- 172.21.15.120:0/1605929521 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc0c1481e0 con 0x7fdc0c157a00 2024-04-18T04:50:48.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.090+0000 7fdc0b400640 1 --2- 172.21.15.120:0/1605929521 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fdbe8066790 0x7fdbe8068c50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc009a50 tx=0x7fdbfc009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:48.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.102+0000 7fdc03400640 1 -- 172.21.15.120:0/1605929521 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fdc0c1481e0 con 0x7fdc0c157a00 2024-04-18T04:50:48.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.510+0000 7fdc12000640 1 -- 172.21.15.120:0/1605929521 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdc0c1481e0 con 0x7fdc0c157a00 2024-04-18T04:50:48.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.510+0000 7fdc03400640 1 -- 172.21.15.120:0/1605929521 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+5528 (secure 0 0 0) 0x7fdc0c1481e0 con 0x7fdc0c157a00 2024-04-18T04:50:48.510 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:50:48.510 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:50:44.046554+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4967,"mds_2":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:rejoin","state_seq":29,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5130":{"gid":5130,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":23,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:50:48.510 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 31 2024-04-18T04:50:48.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.522+0000 7fdc12000640 1 -- 172.21.15.120:0/1605929521 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fdbe8066790 msgr2=0x7fdbe8068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:48.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.522+0000 7fdc12000640 1 --2- 172.21.15.120:0/1605929521 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fdbe8066790 0x7fdbe8068c50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc009a50 tx=0x7fdbfc009190 comp rx=0 tx=0).stop 2024-04-18T04:50:48.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.522+0000 7fdc12000640 1 -- 172.21.15.120:0/1605929521 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc0c157a00 msgr2=0x7fdc0c145b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:48.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.522+0000 7fdc12000640 1 --2- 172.21.15.120:0/1605929521 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc0c157a00 0x7fdc0c145b60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdc0400be20 tx=0x7fdc0400bf10 comp rx=0 tx=0).stop 2024-04-18T04:50:48.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.522+0000 7fdc12000640 1 -- 172.21.15.120:0/1605929521 shutdown_connections 2024-04-18T04:50:48.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.522+0000 7fdc12000640 1 --2- 172.21.15.120:0/1605929521 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fdbe8066790 0x7fdbe8068c50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:48.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.522+0000 7fdc12000640 1 --2- 172.21.15.120:0/1605929521 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc0c157a00 0x7fdc0c145b60 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:48.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.522+0000 7fdc12000640 1 --2- 172.21.15.120:0/1605929521 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdc0c0c0330 0x7fdc0c143720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:48.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.522+0000 7fdc12000640 1 --2- 172.21.15.120:0/1605929521 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdc0c06b660 0x7fdc0c149690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:48.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.522+0000 7fdc12000640 1 -- 172.21.15.120:0/1605929521 >> 172.21.15.120:0/1605929521 conn(0x7fdc0c0c78c0 msgr2=0x7fdc0c06bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:50:48.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.530+0000 7fdc12000640 1 -- 172.21.15.120:0/1605929521 shutdown_connections 2024-04-18T04:50:48.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:48.530+0000 7fdc12000640 1 -- 172.21.15.120:0/1605929521 wait complete. 2024-04-18T04:50:48.586 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:50:50.530 INFO:tasks.ceph.mds.e.smithi120.stderr:2024-04-18T04:50:50.530+0000 7fbec2000640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-18T04:50:50.587 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:50:50.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.838+0000 7fa6de200640 1 Processor -- start 2024-04-18T04:50:50.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.838+0000 7fa6de200640 1 -- start start 2024-04-18T04:50:50.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.842+0000 7fa6de200640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa6d8153630 0x7fa6d80c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:50.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.842+0000 7fa6de200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa6d80c9e50 0x7fa6d80717c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:50.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.842+0000 7fa6dce00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa6d8153630 0x7fa6d80c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:50.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.842+0000 7fa6dce00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa6d8153630 0x7fa6d80c7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:56350/0 (socket says 172.21.15.120:56350) 2024-04-18T04:50:50.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.842+0000 7fa6dce00640 1 -- 172.21.15.120:0/2561932788 learned_addr learned my addr 172.21.15.120:0/2561932788 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:50:50.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.846+0000 7fa6de200640 1 -- 172.21.15.120:0/2561932788 --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6d80c9580 con 0x7fa6d80ca230 2024-04-18T04:50:50.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.846+0000 7fa6d7e00640 1 --2- 172.21.15.120:0/2561932788 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa6d80c9e50 0x7fa6d80717c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:50.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.846+0000 7fa6de200640 1 -- 172.21.15.120:0/2561932788 --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6d81595b0 con 0x7fa6d8153630 2024-04-18T04:50:50.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.846+0000 7fa6de200640 1 -- 172.21.15.120:0/2561932788 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d8159850 con 0x7fa6d80c9e50 2024-04-18T04:50:50.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.846+0000 7fa6dce00640 1 -- 172.21.15.120:0/2561932788 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa6d80c9e50 msgr2=0x7fa6d80717c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:50:50.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.846+0000 7fa6dce00640 1 --2- 172.21.15.120:0/2561932788 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa6d80c9e50 0x7fa6d80717c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:50.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.846+0000 7fa6dce00640 1 -- 172.21.15.120:0/2561932788 >> v1:172.21.15.132:6789/0 conn(0x7fa6d80ca230 legacy=0x7fa6d806b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:50.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.846+0000 7fa6dce00640 1 -- 172.21.15.120:0/2561932788 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d8159af0 con 0x7fa6d8153630 2024-04-18T04:50:50.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.846+0000 7fa6d7400640 1 -- 172.21.15.120:0/2561932788 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3206642743 0 0) 0x7fa6d80c9580 con 0x7fa6d80ca230 2024-04-18T04:50:50.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.846+0000 7fa6d7e00640 1 --2- 172.21.15.120:0/2561932788 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa6d80c9e50 0x7fa6d80717c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:50:50.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.850+0000 7fa6dce00640 1 --2- 172.21.15.120:0/2561932788 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6d8153630 0x7fa6d80c7ef0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4009870 tx=0x7fa6c401c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b9ec69afb8880da server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:50.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.850+0000 7fa6d7400640 1 -- 172.21.15.120:0/2561932788 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c40ab650 con 0x7fa6d8153630 2024-04-18T04:50:50.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.850+0000 7fa6d7400640 1 -- 172.21.15.120:0/2561932788 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c40ab7b0 con 0x7fa6d8153630 2024-04-18T04:50:50.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.850+0000 7fa6d7400640 1 -- 172.21.15.120:0/2561932788 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c40abb40 con 0x7fa6d8153630 2024-04-18T04:50:50.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.858+0000 7fa6de200640 1 -- 172.21.15.120:0/2561932788 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6d8153630 msgr2=0x7fa6d80c7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:50.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.858+0000 7fa6de200640 1 --2- 172.21.15.120:0/2561932788 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6d8153630 0x7fa6d80c7ef0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4009870 tx=0x7fa6c401c560 comp rx=0 tx=0).stop 2024-04-18T04:50:50.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.858+0000 7fa6de200640 1 -- 172.21.15.120:0/2561932788 shutdown_connections 2024-04-18T04:50:50.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.858+0000 7fa6de200640 1 --2- 172.21.15.120:0/2561932788 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa6d80c9e50 0x7fa6d80717c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:50.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.858+0000 7fa6de200640 1 --2- 172.21.15.120:0/2561932788 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6d8153630 0x7fa6d80c7ef0 secure :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4009870 tx=0x7fa6c401c560 comp rx=0 tx=0).stop 2024-04-18T04:50:50.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.858+0000 7fa6de200640 1 -- 172.21.15.120:0/2561932788 >> 172.21.15.120:0/2561932788 conn(0x7fa6d806da10 msgr2=0x7fa6d806f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:50:50.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.858+0000 7fa6de200640 1 -- 172.21.15.120:0/2561932788 shutdown_connections 2024-04-18T04:50:50.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.858+0000 7fa6de200640 1 -- 172.21.15.120:0/2561932788 wait complete. 2024-04-18T04:50:50.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.862+0000 7fa6de200640 1 Processor -- start 2024-04-18T04:50:50.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.862+0000 7fa6de200640 1 -- start start 2024-04-18T04:50:50.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.866+0000 7fa6de200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa6d80c9e50 0x7fa6d81f28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:50.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.866+0000 7fa6de200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6d80ca230 0x7fa6d815d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:50.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.866+0000 7fa6de200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa6d80cb610 0x7fa6d80cc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:50.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.866+0000 7fa6d7e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6d80ca230 0x7fa6d815d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:50.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.866+0000 7fa6d7e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6d80ca230 0x7fa6d815d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:34440/0 (socket says 172.21.15.120:34440) 2024-04-18T04:50:50.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.866+0000 7fa6d7e00640 1 -- 172.21.15.120:0/3118025547 learned_addr learned my addr 172.21.15.120:0/3118025547 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:50:50.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.866+0000 7fa6de200640 1 -- 172.21.15.120:0/3118025547 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d81f2e20 con 0x7fa6d80c9e50 2024-04-18T04:50:50.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.866+0000 7fa6de200640 1 -- 172.21.15.120:0/3118025547 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d80ccfb0 con 0x7fa6d80ca230 2024-04-18T04:50:50.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.866+0000 7fa6de200640 1 -- 172.21.15.120:0/3118025547 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d80cd270 con 0x7fa6d80cb610 2024-04-18T04:50:50.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.866+0000 7fa6dd800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa6d80cb610 0x7fa6d80cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:50.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.866+0000 7fa6dd800640 1 -- 172.21.15.120:0/3118025547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6d80ca230 msgr2=0x7fa6d815d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:50.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.866+0000 7fa6dd800640 1 --2- 172.21.15.120:0/3118025547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6d80ca230 0x7fa6d815d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:50.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.866+0000 7fa6dd800640 1 -- 172.21.15.120:0/3118025547 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa6d80c9e50 msgr2=0x7fa6d81f28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:50.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.866+0000 7fa6d7e00640 1 --2- 172.21.15.120:0/3118025547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6d80ca230 0x7fa6d815d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:50:50.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.866+0000 7fa6dce00640 1 --2- 172.21.15.120:0/3118025547 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa6d80c9e50 0x7fa6d81f28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:50.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.866+0000 7fa6dd800640 1 --2- 172.21.15.120:0/3118025547 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa6d80c9e50 0x7fa6d81f28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:50.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.866+0000 7fa6dd800640 1 -- 172.21.15.120:0/3118025547 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6cc009420 con 0x7fa6d80cb610 2024-04-18T04:50:50.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.870+0000 7fa6dd800640 1 --2- 172.21.15.120:0/3118025547 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa6d80cb610 0x7fa6d80cc480 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa6d000c700 tx=0x7fa6d000cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:50.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.870+0000 7fa6d4c00640 1 -- 172.21.15.120:0/3118025547 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0003db0 con 0x7fa6d80cb610 2024-04-18T04:50:50.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.870+0000 7fa6d4c00640 1 -- 172.21.15.120:0/3118025547 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d000ce10 con 0x7fa6d80cb610 2024-04-18T04:50:50.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.870+0000 7fa6d4c00640 1 -- 172.21.15.120:0/3118025547 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d00052b0 con 0x7fa6d80cb610 2024-04-18T04:50:50.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.870+0000 7fa6de200640 1 -- 172.21.15.120:0/3118025547 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6c40094d0 con 0x7fa6d80cb610 2024-04-18T04:50:50.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.870+0000 7fa6de200640 1 -- 172.21.15.120:0/3118025547 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6d80cd830 con 0x7fa6d80cb610 2024-04-18T04:50:50.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.874+0000 7fa6de200640 1 -- 172.21.15.120:0/3118025547 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6d80728f0 con 0x7fa6d80cb610 2024-04-18T04:50:50.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.874+0000 7fa6d4c00640 1 -- 172.21.15.120:0/3118025547 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa6d0005410 con 0x7fa6d80cb610 2024-04-18T04:50:50.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.878+0000 7fa6d4c00640 1 --2- 172.21.15.120:0/3118025547 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fa6b8066790 0x7fa6b8068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:50.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.878+0000 7fa6d4c00640 1 -- 172.21.15.120:0/3118025547 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7fa6d0083e50 con 0x7fa6d80cb610 2024-04-18T04:50:50.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.878+0000 7fa6dce00640 1 --2- 172.21.15.120:0/3118025547 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fa6b8066790 0x7fa6b8068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:50.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.878+0000 7fa6dce00640 1 --2- 172.21.15.120:0/3118025547 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fa6b8066790 0x7fa6b8068c50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa6c40af000 tx=0x7fa6c4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:50.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:50.894+0000 7fa6d4c00640 1 -- 172.21.15.120:0/3118025547 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fa6d0050d00 con 0x7fa6d80cb610 2024-04-18T04:50:51.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:51.350+0000 7fa6de200640 1 -- 172.21.15.120:0/3118025547 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6d80cab30 con 0x7fa6d80cb610 2024-04-18T04:50:51.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:51.350+0000 7fa6d4c00640 1 -- 172.21.15.120:0/3118025547 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+5528 (secure 0 0 0) 0x7fa6d0054320 con 0x7fa6d80cb610 2024-04-18T04:50:51.349 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:50:51.349 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:50:50.126101+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4967,"mds_2":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:active","state_seq":31,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5130":{"gid":5130,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":23,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:50:51.349 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 32 2024-04-18T04:50:51.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:51.358+0000 7fa6de200640 1 -- 172.21.15.120:0/3118025547 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fa6b8066790 msgr2=0x7fa6b8068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:51.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:51.358+0000 7fa6de200640 1 --2- 172.21.15.120:0/3118025547 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fa6b8066790 0x7fa6b8068c50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa6c40af000 tx=0x7fa6c4008040 comp rx=0 tx=0).stop 2024-04-18T04:50:51.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:51.358+0000 7fa6de200640 1 -- 172.21.15.120:0/3118025547 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa6d80cb610 msgr2=0x7fa6d80cc480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:51.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:51.358+0000 7fa6de200640 1 --2- 172.21.15.120:0/3118025547 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa6d80cb610 0x7fa6d80cc480 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa6d000c700 tx=0x7fa6d000cbc0 comp rx=0 tx=0).stop 2024-04-18T04:50:51.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:51.358+0000 7fa6de200640 1 -- 172.21.15.120:0/3118025547 shutdown_connections 2024-04-18T04:50:51.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:51.358+0000 7fa6de200640 1 --2- 172.21.15.120:0/3118025547 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fa6b8066790 0x7fa6b8068c50 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:51.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:51.358+0000 7fa6de200640 1 --2- 172.21.15.120:0/3118025547 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa6d80cb610 0x7fa6d80cc480 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:51.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:51.358+0000 7fa6de200640 1 --2- 172.21.15.120:0/3118025547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6d80ca230 0x7fa6d815d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:51.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:51.358+0000 7fa6de200640 1 --2- 172.21.15.120:0/3118025547 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa6d80c9e50 0x7fa6d81f28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:51.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:51.358+0000 7fa6de200640 1 -- 172.21.15.120:0/3118025547 >> 172.21.15.120:0/3118025547 conn(0x7fa6d806da10 msgr2=0x7fa6d814d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:50:51.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:51.366+0000 7fa6de200640 1 -- 172.21.15.120:0/3118025547 shutdown_connections 2024-04-18T04:50:51.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:51.366+0000 7fa6de200640 1 -- 172.21.15.120:0/3118025547 wait complete. 2024-04-18T04:50:51.414 INFO:tasks.mds_thrash.fs.[cephfs]:mds.b has gained rank=1, replacing gid=4275 2024-04-18T04:50:51.414 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 6 secs before reviving mds.a 2024-04-18T04:50:57.415 INFO:tasks.mds_thrash.fs.[cephfs]:reviving mds.a 2024-04-18T04:50:57.415 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-18T04:50:57.415 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-18T04:50:57.424 INFO:tasks.ceph.mds.a:Started 2024-04-18T04:50:57.424 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:50:57.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.766+0000 7f616d000640 1 Processor -- start 2024-04-18T04:50:57.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.766+0000 7f616d000640 1 -- start start 2024-04-18T04:50:57.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.770+0000 7f616d000640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f61680c69e0 0x7f61680c0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:57.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.770+0000 7f616d000640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f616806c480 con 0x7f6168157a00 2024-04-18T04:50:57.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.770+0000 7f616d000640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f616815e970 con 0x7f6168157de0 2024-04-18T04:50:57.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.770+0000 7f616d000640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6168162170 con 0x7f61680c69e0 2024-04-18T04:50:57.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.770+0000 7f6166800640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f6168157de0 0x7f616806bd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:45688/0 (socket says 172.21.15.120:45688) 2024-04-18T04:50:57.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.770+0000 7f6166800640 1 -- 172.21.15.120:0/3886701340 learned_addr learned my addr 172.21.15.120:0/3886701340 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:50:57.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.770+0000 7f6164a00640 1 -- 172.21.15.120:0/3886701340 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2149618772 0 0) 0x7f616815e970 con 0x7f6168157de0 2024-04-18T04:50:57.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.770+0000 7f6164a00640 1 -- 172.21.15.120:0/3886701340 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f614c003530 con 0x7f6168157de0 2024-04-18T04:50:57.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.770+0000 7f6164a00640 1 -- 172.21.15.120:0/3886701340 <== mon.1 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2250391141 0 0) 0x7f614c003530 con 0x7f6168157de0 2024-04-18T04:50:57.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.770+0000 7f6164a00640 1 -- 172.21.15.120:0/3886701340 >> v2:172.21.15.120:3300/0 conn(0x7f61680c69e0 msgr2=0x7f61680c0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:50:57.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.770+0000 7f6164a00640 1 --2- 172.21.15.120:0/3886701340 >> v2:172.21.15.120:3300/0 conn(0x7f61680c69e0 0x7f61680c0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:57.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.770+0000 7f6164a00640 1 -- 172.21.15.120:0/3886701340 >> v1:172.21.15.120:6789/0 conn(0x7f6168157a00 legacy=0x7f616806b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:50:57.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.770+0000 7f6164a00640 1 -- 172.21.15.120:0/3886701340 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6168158250 con 0x7f6168157de0 2024-04-18T04:50:57.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.770+0000 7f6164a00640 1 -- 172.21.15.120:0/3886701340 <== mon.1 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7f6160001a00 con 0x7f6168157de0 2024-04-18T04:50:57.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.770+0000 7f6164a00640 1 -- 172.21.15.120:0/3886701340 >> v1:172.21.15.132:6789/0 conn(0x7f6168157de0 legacy=0x7f616806bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:57.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.770+0000 7f6164a00640 1 --2- 172.21.15.120:0/3886701340 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f614c003980 0x7f614c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:57.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.770+0000 7f6164a00640 1 --2- 172.21.15.120:0/3886701340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f614c0047d0 0x7f614c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:57.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.770+0000 7f6164a00640 1 --2- 172.21.15.120:0/3886701340 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f614c0052b0 0x7f614c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:57.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.770+0000 7f6164a00640 1 -- 172.21.15.120:0/3886701340 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6168162170 con 0x7f614c0052b0 2024-04-18T04:50:57.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.770+0000 7f6164a00640 1 -- 172.21.15.120:0/3886701340 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614c00c1a0 con 0x7f614c0047d0 2024-04-18T04:50:57.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.770+0000 7f6164a00640 1 -- 172.21.15.120:0/3886701340 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f614c00c360 con 0x7f614c003980 2024-04-18T04:50:57.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.774+0000 7f6165e00640 1 --2- 172.21.15.120:0/3886701340 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f614c003980 0x7f614c003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:57.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.774+0000 7f6165400640 1 --2- 172.21.15.120:0/3886701340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f614c0047d0 0x7f614c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:57.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.778+0000 7f6165400640 1 -- 172.21.15.120:0/3886701340 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f614c003980 msgr2=0x7f614c003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:50:57.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.778+0000 7f6165400640 1 --2- 172.21.15.120:0/3886701340 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f614c003980 0x7f614c003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:57.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.778+0000 7f6165400640 1 -- 172.21.15.120:0/3886701340 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f614c0052b0 msgr2=0x7f614c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:50:57.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.778+0000 7f6165400640 1 --2- 172.21.15.120:0/3886701340 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f614c0052b0 0x7f614c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:57.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.778+0000 7f6165400640 1 -- 172.21.15.120:0/3886701340 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6168158250 con 0x7f614c0047d0 2024-04-18T04:50:57.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.778+0000 7f6166800640 1 -- 172.21.15.120:0/3886701340 reap_dead start 2024-04-18T04:50:57.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.782+0000 7f6165400640 1 --2- 172.21.15.120:0/3886701340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f614c0047d0 0x7f614c004c50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6158009860 tx=0x7f615801c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=939c7f10c044d0df server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:57.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.782+0000 7f6164a00640 1 -- 172.21.15.120:0/3886701340 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61580ab600 con 0x7f614c0047d0 2024-04-18T04:50:57.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.782+0000 7f6164a00640 1 -- 172.21.15.120:0/3886701340 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61580a7050 con 0x7f614c0047d0 2024-04-18T04:50:57.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.782+0000 7f6164a00640 1 -- 172.21.15.120:0/3886701340 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61580aba00 con 0x7f614c0047d0 2024-04-18T04:50:57.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.782+0000 7f616d000640 1 -- 172.21.15.120:0/3886701340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f614c0047d0 msgr2=0x7f614c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:57.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.782+0000 7f616d000640 1 --2- 172.21.15.120:0/3886701340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f614c0047d0 0x7f614c004c50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6158009860 tx=0x7f615801c3a0 comp rx=0 tx=0).stop 2024-04-18T04:50:57.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.782+0000 7f616d000640 1 -- 172.21.15.120:0/3886701340 shutdown_connections 2024-04-18T04:50:57.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.782+0000 7f616d000640 1 --2- 172.21.15.120:0/3886701340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f614c0047d0 0x7f614c004c50 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:57.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.782+0000 7f616d000640 1 -- 172.21.15.120:0/3886701340 >> 172.21.15.120:0/3886701340 conn(0x7f61680c78c0 msgr2=0x7f61680c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:50:57.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.786+0000 7f616d000640 1 -- 172.21.15.120:0/3886701340 shutdown_connections 2024-04-18T04:50:57.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.786+0000 7f616d000640 1 -- 172.21.15.120:0/3886701340 wait complete. 2024-04-18T04:50:57.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.790+0000 7f616d000640 1 Processor -- start 2024-04-18T04:50:57.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.790+0000 7f616d000640 1 -- start start 2024-04-18T04:50:57.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.790+0000 7f616d000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f614c0047d0 0x7f616815ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:57.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.790+0000 7f616d000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f616815d5d0 0x7f61680c1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:57.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.790+0000 7f616d000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f61681f3720 0x7f61681f3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:57.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.790+0000 7f616d000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61681f6580 con 0x7f616815d5d0 2024-04-18T04:50:57.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.790+0000 7f616d000640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61681f3010 con 0x7f61681f3720 2024-04-18T04:50:57.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.790+0000 7f616d000640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6168152300 con 0x7f614c0047d0 2024-04-18T04:50:57.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.790+0000 7f6166800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f61681f3720 0x7f61681f3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:57.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.790+0000 7f6165400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f616815d5d0 0x7f61680c1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:57.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.790+0000 7f6166800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f61681f3720 0x7f61681f3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:34454/0 (socket says 172.21.15.120:34454) 2024-04-18T04:50:57.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.790+0000 7f6166800640 1 -- 172.21.15.120:0/1520617879 learned_addr learned my addr 172.21.15.120:0/1520617879 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:50:57.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.790+0000 7f6165400640 1 -- 172.21.15.120:0/1520617879 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f614c0047d0 msgr2=0x7f616815ed30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-18T04:50:57.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.790+0000 7f6165400640 1 --2- 172.21.15.120:0/1520617879 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f614c0047d0 0x7f616815ed30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:57.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.790+0000 7f6165400640 1 -- 172.21.15.120:0/1520617879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f61681f3720 msgr2=0x7f61681f3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:57.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.790+0000 7f6165400640 1 --2- 172.21.15.120:0/1520617879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f61681f3720 0x7f61681f3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:57.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.790+0000 7f6165400640 1 -- 172.21.15.120:0/1520617879 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61681525e0 con 0x7f616815d5d0 2024-04-18T04:50:57.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.790+0000 7f6166800640 1 --2- 172.21.15.120:0/1520617879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f61681f3720 0x7f61681f3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:50:57.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.794+0000 7f6165400640 1 --2- 172.21.15.120:0/1520617879 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f616815d5d0 0x7f61680c1250 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f61580ab000 tx=0x7f614c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:57.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.794+0000 7f615e000640 1 -- 172.21.15.120:0/1520617879 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61580b4810 con 0x7f616815d5d0 2024-04-18T04:50:57.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.794+0000 7f615e000640 1 -- 172.21.15.120:0/1520617879 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61580b4970 con 0x7f616815d5d0 2024-04-18T04:50:57.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.794+0000 7f615e000640 1 -- 172.21.15.120:0/1520617879 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61580b4810 con 0x7f616815d5d0 2024-04-18T04:50:57.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.794+0000 7f616d000640 1 -- 172.21.15.120:0/1520617879 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61681528c0 con 0x7f616815d5d0 2024-04-18T04:50:57.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.794+0000 7f616d000640 1 -- 172.21.15.120:0/1520617879 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61681f3200 con 0x7f616815d5d0 2024-04-18T04:50:57.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.798+0000 7f616d000640 1 -- 172.21.15.120:0/1520617879 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6140005260 con 0x7f616815d5d0 2024-04-18T04:50:57.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.798+0000 7f615e000640 1 -- 172.21.15.120:0/1520617879 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f61580b2040 con 0x7f616815d5d0 2024-04-18T04:50:57.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.802+0000 7f615e000640 1 --2- 172.21.15.120:0/1520617879 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6144066720 0x7f6144068be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:50:57.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.802+0000 7f615e000640 1 -- 172.21.15.120:0/1520617879 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f615811de70 con 0x7f616815d5d0 2024-04-18T04:50:57.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.806+0000 7f6165e00640 1 --2- 172.21.15.120:0/1520617879 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6144066720 0x7f6144068be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:50:57.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.810+0000 7f615e000640 1 -- 172.21.15.120:0/1520617879 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f61580ee730 con 0x7f616815d5d0 2024-04-18T04:50:57.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:57.810+0000 7f6165e00640 1 --2- 172.21.15.120:0/1520617879 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6144066720 0x7f6144068be0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6168068f00 tx=0x7f6150009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:50:57.923 INFO:tasks.ceph.mds.a.smithi120.stdout:starting mds.a at 2024-04-18T04:50:58.286 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:50:58.286 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:50:50.126101+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4967,"mds_2":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:active","state_seq":31,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5130":{"gid":5130,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":23,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:50:58.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:58.282+0000 7f616d000640 1 -- 172.21.15.120:0/1520617879 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6140005a90 con 0x7f616815d5d0 2024-04-18T04:50:58.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:58.286+0000 7f615e000640 1 -- 172.21.15.120:0/1520617879 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+6288 (secure 0 0 0) 0x7f61580b0070 con 0x7f616815d5d0 2024-04-18T04:50:58.287 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 33 2024-04-18T04:50:58.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:58.290+0000 7f616d000640 1 -- 172.21.15.120:0/1520617879 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6144066720 msgr2=0x7f6144068be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:58.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:58.290+0000 7f616d000640 1 --2- 172.21.15.120:0/1520617879 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6144066720 0x7f6144068be0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6168068f00 tx=0x7f6150009040 comp rx=0 tx=0).stop 2024-04-18T04:50:58.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:58.290+0000 7f616d000640 1 -- 172.21.15.120:0/1520617879 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f616815d5d0 msgr2=0x7f61680c1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:50:58.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:58.290+0000 7f616d000640 1 --2- 172.21.15.120:0/1520617879 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f616815d5d0 0x7f61680c1250 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f61580ab000 tx=0x7f614c005800 comp rx=0 tx=0).stop 2024-04-18T04:50:58.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:58.290+0000 7f616d000640 1 -- 172.21.15.120:0/1520617879 shutdown_connections 2024-04-18T04:50:58.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:58.290+0000 7f616d000640 1 --2- 172.21.15.120:0/1520617879 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6144066720 0x7f6144068be0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:58.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:58.290+0000 7f616d000640 1 --2- 172.21.15.120:0/1520617879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f61681f3720 0x7f61681f3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:58.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:58.290+0000 7f616d000640 1 --2- 172.21.15.120:0/1520617879 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f616815d5d0 0x7f61680c1250 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:58.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:58.290+0000 7f616d000640 1 --2- 172.21.15.120:0/1520617879 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f614c0047d0 0x7f616815ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:50:58.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:58.290+0000 7f616d000640 1 -- 172.21.15.120:0/1520617879 >> 172.21.15.120:0/1520617879 conn(0x7f61680c78c0 msgr2=0x7f61680c91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:50:58.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:58.290+0000 7f616d000640 1 -- 172.21.15.120:0/1520617879 shutdown_connections 2024-04-18T04:50:58.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:50:58.290+0000 7f616d000640 1 -- 172.21.15.120:0/1520617879 wait complete. 2024-04-18T04:50:58.324 INFO:tasks.mds_thrash.fs.[cephfs]:mds.a reported in up:standby state 2024-04-18T04:50:58.324 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 24 secs before thrashing 2024-04-18T04:51:11.704 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:51:11.709 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:51:22.325 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:51:22.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.597+0000 7f7017200640 1 Processor -- start 2024-04-18T04:51:22.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.597+0000 7f7017200640 1 -- start start 2024-04-18T04:51:22.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.597+0000 7f7017200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f701814fa60 0x7f70181598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:22.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.597+0000 7f7017200640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7018071820 0x7f70180c33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:22.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.597+0000 7f7017200640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7018071390 con 0x7f70180c5e30 2024-04-18T04:51:22.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.597+0000 7f7017200640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7018159e10 con 0x7f7018071820 2024-04-18T04:51:22.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.597+0000 7f7017200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70180704c0 con 0x7f701814fa60 2024-04-18T04:51:22.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.601+0000 7f7015e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f701814fa60 0x7f70181598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:22.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.601+0000 7f7015e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f701814fa60 0x7f70181598d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:48178/0 (socket says 172.21.15.120:48178) 2024-04-18T04:51:22.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.601+0000 7f7015e00640 1 -- 172.21.15.120:0/1595272706 learned_addr learned my addr 172.21.15.120:0/1595272706 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:51:22.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.601+0000 7f700d400640 1 --2- 172.21.15.120:0/1595272706 >> v2:172.21.15.120:3300/0 conn(0x7f7018071820 0x7f70180c33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:22.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.601+0000 7f7015e00640 1 -- 172.21.15.120:0/1595272706 >> v2:172.21.15.120:3300/0 conn(0x7f7018071820 msgr2=0x7f70180c33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:51:22.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.601+0000 7f7015e00640 1 --2- 172.21.15.120:0/1595272706 >> v2:172.21.15.120:3300/0 conn(0x7f7018071820 0x7f70180c33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:22.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.601+0000 7f7015e00640 1 -- 172.21.15.120:0/1595272706 >> v1:172.21.15.120:6789/0 conn(0x7f70180c5e30 legacy=0x7f70180cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:22.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.601+0000 7f7015e00640 1 -- 172.21.15.120:0/1595272706 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7018070780 con 0x7f701814fa60 2024-04-18T04:51:22.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.601+0000 7f700d400640 1 --2- 172.21.15.120:0/1595272706 >> v2:172.21.15.120:3300/0 conn(0x7f7018071820 0x7f70180c33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:51:22.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.605+0000 7f7015e00640 1 --2- 172.21.15.120:0/1595272706 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f701814fa60 0x7f70181598d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7000009870 tx=0x7f700001d7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9503576748b39ed0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:22.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.605+0000 7f7015400640 1 -- 172.21.15.120:0/1595272706 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70000a76c0 con 0x7f701814fa60 2024-04-18T04:51:22.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.605+0000 7f7015400640 1 -- 172.21.15.120:0/1595272706 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70000a7820 con 0x7f701814fa60 2024-04-18T04:51:22.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.605+0000 7f7015400640 1 -- 172.21.15.120:0/1595272706 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70000a7bb0 con 0x7f701814fa60 2024-04-18T04:51:22.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.609+0000 7f7017200640 1 -- 172.21.15.120:0/1595272706 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f701814fa60 msgr2=0x7f70181598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:22.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.609+0000 7f7017200640 1 --2- 172.21.15.120:0/1595272706 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f701814fa60 0x7f70181598d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7000009870 tx=0x7f700001d7b0 comp rx=0 tx=0).stop 2024-04-18T04:51:22.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.609+0000 7f7017200640 1 -- 172.21.15.120:0/1595272706 shutdown_connections 2024-04-18T04:51:22.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.609+0000 7f7017200640 1 --2- 172.21.15.120:0/1595272706 >> v2:172.21.15.120:3300/0 conn(0x7f7018071820 0x7f70180c33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:22.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.609+0000 7f7017200640 1 --2- 172.21.15.120:0/1595272706 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f701814fa60 0x7f70181598d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:22.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.609+0000 7f7017200640 1 -- 172.21.15.120:0/1595272706 >> 172.21.15.120:0/1595272706 conn(0x7f7018069ec0 msgr2=0x7f701806a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:51:22.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.609+0000 7f7017200640 1 -- 172.21.15.120:0/1595272706 shutdown_connections 2024-04-18T04:51:22.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.609+0000 7f7017200640 1 -- 172.21.15.120:0/1595272706 wait complete. 2024-04-18T04:51:22.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.609+0000 7f7017200640 1 Processor -- start 2024-04-18T04:51:22.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.609+0000 7f7017200640 1 -- start start 2024-04-18T04:51:22.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.613+0000 7f7017200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7018071820 0x7f70180ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:22.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.613+0000 7f7017200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70180c5e30 0x7f7018151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:22.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.613+0000 7f7017200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f701814fa60 0x7f70181ff090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:22.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.613+0000 7f7017200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70181472e0 con 0x7f7018071820 2024-04-18T04:51:22.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.613+0000 7f7017200640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70181fec00 con 0x7f70180c5e30 2024-04-18T04:51:22.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.613+0000 7f7017200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7018150570 con 0x7f701814fa60 2024-04-18T04:51:22.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.613+0000 7f700d400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70180c5e30 0x7f7018151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:22.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.613+0000 7f700d400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70180c5e30 0x7f7018151220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:44690/0 (socket says 172.21.15.120:44690) 2024-04-18T04:51:22.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.613+0000 7f700d400640 1 -- 172.21.15.120:0/1443093307 learned_addr learned my addr 172.21.15.120:0/1443093307 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:51:22.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.613+0000 7f7016800640 1 --2- 172.21.15.120:0/1443093307 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f701814fa60 0x7f70181ff090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:22.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.613+0000 7f7015e00640 1 --2- 172.21.15.120:0/1443093307 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7018071820 0x7f70180ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:22.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.617+0000 7f700d400640 1 -- 172.21.15.120:0/1443093307 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f701814fa60 msgr2=0x7f70181ff090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:22.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.617+0000 7f700d400640 1 --2- 172.21.15.120:0/1443093307 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f701814fa60 0x7f70181ff090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:22.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.617+0000 7f700d400640 1 -- 172.21.15.120:0/1443093307 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7018071820 msgr2=0x7f70180ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:22.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.617+0000 7f700d400640 1 --2- 172.21.15.120:0/1443093307 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7018071820 0x7f70180ca1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:22.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.617+0000 7f700d400640 1 -- 172.21.15.120:0/1443093307 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70000094d0 con 0x7f70180c5e30 2024-04-18T04:51:22.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.617+0000 7f700d400640 1 --2- 172.21.15.120:0/1443093307 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70180c5e30 0x7f7018151220 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f700800c7f0 tx=0x7f700800ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:22.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.617+0000 7f700ea00640 1 -- 172.21.15.120:0/1443093307 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700800cea0 con 0x7f70180c5e30 2024-04-18T04:51:22.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.617+0000 7f700ea00640 1 -- 172.21.15.120:0/1443093307 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7008004230 con 0x7f70180c5e30 2024-04-18T04:51:22.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.617+0000 7f700ea00640 1 -- 172.21.15.120:0/1443093307 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7008007830 con 0x7f70180c5e30 2024-04-18T04:51:22.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.617+0000 7f7017200640 1 -- 172.21.15.120:0/1443093307 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7018150850 con 0x7f70180c5e30 2024-04-18T04:51:22.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.617+0000 7f7017200640 1 -- 172.21.15.120:0/1443093307 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7018150e10 con 0x7f70180c5e30 2024-04-18T04:51:22.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.617+0000 7f7017200640 1 -- 172.21.15.120:0/1443093307 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f701814d100 con 0x7f70180c5e30 2024-04-18T04:51:22.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.621+0000 7f700ea00640 1 -- 172.21.15.120:0/1443093307 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7008007990 con 0x7f70180c5e30 2024-04-18T04:51:22.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.621+0000 7f700ea00640 1 --2- 172.21.15.120:0/1443093307 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6ff4066690 0x7f6ff4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:22.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.621+0000 7f700ea00640 1 -- 172.21.15.120:0/1443093307 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f7008084570 con 0x7f70180c5e30 2024-04-18T04:51:22.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.621+0000 7f7015e00640 1 --2- 172.21.15.120:0/1443093307 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6ff4066690 0x7f6ff4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:22.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.625+0000 7f7015e00640 1 --2- 172.21.15.120:0/1443093307 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6ff4066690 0x7f6ff4068b50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f70000b0000 tx=0x7f70000a8000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:22.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:22.625+0000 7f700ea00640 1 -- 172.21.15.120:0/1443093307 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f7008051430 con 0x7f70180c5e30 2024-04-18T04:51:23.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.029+0000 7f7017200640 1 -- 172.21.15.120:0/1443093307 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70181fe9d0 con 0x7f70180c5e30 2024-04-18T04:51:23.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.029+0000 7f700ea00640 1 -- 172.21.15.120:0/1443093307 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+6288 (secure 0 0 0) 0x7f70181fe9d0 con 0x7f70180c5e30 2024-04-18T04:51:23.032 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:51:23.032 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:50:50.126101+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4967,"mds_2":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:active","state_seq":31,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5130":{"gid":5130,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":23,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:51:23.032 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 33 2024-04-18T04:51:23.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.037+0000 7f7017200640 1 -- 172.21.15.120:0/1443093307 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6ff4066690 msgr2=0x7f6ff4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:23.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.037+0000 7f7017200640 1 --2- 172.21.15.120:0/1443093307 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6ff4066690 0x7f6ff4068b50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f70000b0000 tx=0x7f70000a8000 comp rx=0 tx=0).stop 2024-04-18T04:51:23.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.037+0000 7f7017200640 1 -- 172.21.15.120:0/1443093307 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70180c5e30 msgr2=0x7f7018151220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:23.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.037+0000 7f7017200640 1 --2- 172.21.15.120:0/1443093307 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70180c5e30 0x7f7018151220 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f700800c7f0 tx=0x7f700800ccb0 comp rx=0 tx=0).stop 2024-04-18T04:51:23.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.037+0000 7f7017200640 1 -- 172.21.15.120:0/1443093307 shutdown_connections 2024-04-18T04:51:23.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.037+0000 7f7017200640 1 --2- 172.21.15.120:0/1443093307 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6ff4066690 0x7f6ff4068b50 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:23.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.037+0000 7f7017200640 1 --2- 172.21.15.120:0/1443093307 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f701814fa60 0x7f70181ff090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:23.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.037+0000 7f7017200640 1 --2- 172.21.15.120:0/1443093307 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70180c5e30 0x7f7018151220 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:23.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.037+0000 7f7017200640 1 --2- 172.21.15.120:0/1443093307 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7018071820 0x7f70180ca1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:23.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.037+0000 7f7017200640 1 -- 172.21.15.120:0/1443093307 >> 172.21.15.120:0/1443093307 conn(0x7f7018069ec0 msgr2=0x7f7018160a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:51:23.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.037+0000 7f7017200640 1 -- 172.21.15.120:0/1443093307 shutdown_connections 2024-04-18T04:51:23.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.037+0000 7f7017200640 1 -- 172.21.15.120:0/1443093307 wait complete. 2024-04-18T04:51:23.090 INFO:tasks.mds_thrash.fs.[cephfs]:thrashing max_mds: 3 -> 2 2024-04-18T04:51:23.091 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 2 2024-04-18T04:51:23.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.385+0000 7fd41ac00640 1 Processor -- start 2024-04-18T04:51:23.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.385+0000 7fd41ac00640 1 -- start start 2024-04-18T04:51:23.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.385+0000 7fd41ac00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd4140c1fe0 0x7fd414157db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:23.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.385+0000 7fd41ac00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd4140c79c0 0x7fd4140c23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:23.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.385+0000 7fd41ac00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4140c3ef0 0x7fd41415a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:23.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.385+0000 7fd41ac00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4141582f0 con 0x7fd4140c79c0 2024-04-18T04:51:23.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.385+0000 7fd41ac00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4140c2900 con 0x7fd4140c1fe0 2024-04-18T04:51:23.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.385+0000 7fd41ac00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd414157920 con 0x7fd4140c3ef0 2024-04-18T04:51:23.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.385+0000 7fd413e00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd4140c1fe0 0x7fd414157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:23.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.385+0000 7fd413e00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd4140c1fe0 0x7fd414157db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:44706/0 (socket says 172.21.15.120:44706) 2024-04-18T04:51:23.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.385+0000 7fd413e00640 1 -- 172.21.15.120:0/1063861312 learned_addr learned my addr 172.21.15.120:0/1063861312 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:51:23.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.385+0000 7fd418c00640 1 --2- 172.21.15.120:0/1063861312 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4140c3ef0 0x7fd41415a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:23.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.389+0000 7fd418c00640 1 -- 172.21.15.120:0/1063861312 >> v2:172.21.15.132:3300/0 conn(0x7fd4140c1fe0 msgr2=0x7fd414157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:51:23.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.389+0000 7fd418c00640 1 --2- 172.21.15.120:0/1063861312 >> v2:172.21.15.132:3300/0 conn(0x7fd4140c1fe0 0x7fd414157db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:23.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.389+0000 7fd418c00640 1 -- 172.21.15.120:0/1063861312 >> v2:172.21.15.120:3300/0 conn(0x7fd4140c79c0 msgr2=0x7fd4140c23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:51:23.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.389+0000 7fd418c00640 1 --2- 172.21.15.120:0/1063861312 >> v2:172.21.15.120:3300/0 conn(0x7fd4140c79c0 0x7fd4140c23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:23.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.389+0000 7fd418c00640 1 -- 172.21.15.120:0/1063861312 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd41406e9a0 con 0x7fd4140c3ef0 2024-04-18T04:51:23.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.393+0000 7fd418c00640 1 --2- 172.21.15.120:0/1063861312 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4140c3ef0 0x7fd41415a920 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd4140cdc90 tx=0x7fd40c01f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb4d3a180910d66f server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:23.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.397+0000 7fd413400640 1 -- 172.21.15.120:0/1063861312 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40c0b0440 con 0x7fd4140c3ef0 2024-04-18T04:51:23.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.397+0000 7fd413400640 1 -- 172.21.15.120:0/1063861312 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd40c0b05a0 con 0x7fd4140c3ef0 2024-04-18T04:51:23.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.397+0000 7fd413400640 1 -- 172.21.15.120:0/1063861312 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40c0b0930 con 0x7fd4140c3ef0 2024-04-18T04:51:23.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.397+0000 7fd41ac00640 1 -- 172.21.15.120:0/1063861312 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4140c3ef0 msgr2=0x7fd41415a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:23.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.397+0000 7fd41ac00640 1 --2- 172.21.15.120:0/1063861312 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4140c3ef0 0x7fd41415a920 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd4140cdc90 tx=0x7fd40c01f150 comp rx=0 tx=0).stop 2024-04-18T04:51:23.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.397+0000 7fd41ac00640 1 -- 172.21.15.120:0/1063861312 shutdown_connections 2024-04-18T04:51:23.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.397+0000 7fd41ac00640 1 --2- 172.21.15.120:0/1063861312 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4140c3ef0 0x7fd41415a920 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:23.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.397+0000 7fd41ac00640 1 --2- 172.21.15.120:0/1063861312 >> v2:172.21.15.120:3300/0 conn(0x7fd4140c79c0 0x7fd4140c23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:23.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.397+0000 7fd41ac00640 1 --2- 172.21.15.120:0/1063861312 >> v2:172.21.15.132:3300/0 conn(0x7fd4140c1fe0 0x7fd414157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:23.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.397+0000 7fd41ac00640 1 -- 172.21.15.120:0/1063861312 >> 172.21.15.120:0/1063861312 conn(0x7fd414072190 msgr2=0x7fd414065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:51:23.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.401+0000 7fd41ac00640 1 -- 172.21.15.120:0/1063861312 shutdown_connections 2024-04-18T04:51:23.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.401+0000 7fd41ac00640 1 -- 172.21.15.120:0/1063861312 wait complete. 2024-04-18T04:51:23.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.405+0000 7fd41ac00640 1 Processor -- start 2024-04-18T04:51:23.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.405+0000 7fd41ac00640 1 -- start start 2024-04-18T04:51:23.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.405+0000 7fd41ac00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4140c1fe0 0x7fd4140cc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:23.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.405+0000 7fd41ac00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4140c3ef0 0x7fd414140380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:23.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.405+0000 7fd41ac00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4140c79c0 0x7fd4141408c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:23.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.405+0000 7fd413e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4140c1fe0 0x7fd4140cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:23.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.405+0000 7fd413e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4140c1fe0 0x7fd4140cc190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:44716/0 (socket says 172.21.15.120:44716) 2024-04-18T04:51:23.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.405+0000 7fd413e00640 1 -- 172.21.15.120:0/290669467 learned_addr learned my addr 172.21.15.120:0/290669467 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:51:23.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.405+0000 7fd41ac00640 1 -- 172.21.15.120:0/290669467 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd41415a650 con 0x7fd4140c79c0 2024-04-18T04:51:23.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.405+0000 7fd41ac00640 1 -- 172.21.15.120:0/290669467 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd41415a3e0 con 0x7fd4140c1fe0 2024-04-18T04:51:23.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.405+0000 7fd41ac00640 1 -- 172.21.15.120:0/290669467 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4140ccaf0 con 0x7fd4140c3ef0 2024-04-18T04:51:23.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.405+0000 7fd40be00640 1 --2- 172.21.15.120:0/290669467 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4140c3ef0 0x7fd414140380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:23.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.405+0000 7fd418c00640 1 --2- 172.21.15.120:0/290669467 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4140c79c0 0x7fd4141408c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:23.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.405+0000 7fd413e00640 1 -- 172.21.15.120:0/290669467 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4140c3ef0 msgr2=0x7fd414140380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:23.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.405+0000 7fd413e00640 1 --2- 172.21.15.120:0/290669467 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4140c3ef0 0x7fd414140380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:23.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.405+0000 7fd413e00640 1 -- 172.21.15.120:0/290669467 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4140c79c0 msgr2=0x7fd4141408c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:23.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.405+0000 7fd413e00640 1 --2- 172.21.15.120:0/290669467 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4140c79c0 0x7fd4141408c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:23.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.405+0000 7fd413e00640 1 -- 172.21.15.120:0/290669467 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd40c009a70 con 0x7fd4140c1fe0 2024-04-18T04:51:23.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.405+0000 7fd418c00640 1 --2- 172.21.15.120:0/290669467 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4140c79c0 0x7fd4141408c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:51:23.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.405+0000 7fd40be00640 1 --2- 172.21.15.120:0/290669467 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4140c3ef0 0x7fd414140380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:51:23.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.409+0000 7fd413e00640 1 --2- 172.21.15.120:0/290669467 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4140c1fe0 0x7fd4140cc190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd40400e890 tx=0x7fd40400ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:23.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.409+0000 7fd410c00640 1 -- 172.21.15.120:0/290669467 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40400c940 con 0x7fd4140c1fe0 2024-04-18T04:51:23.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.409+0000 7fd41ac00640 1 -- 172.21.15.120:0/290669467 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd41413fb80 con 0x7fd4140c1fe0 2024-04-18T04:51:23.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.409+0000 7fd41ac00640 1 -- 172.21.15.120:0/290669467 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4140c8f60 con 0x7fd4140c1fe0 2024-04-18T04:51:23.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.409+0000 7fd410c00640 1 -- 172.21.15.120:0/290669467 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd40400caa0 con 0x7fd4140c1fe0 2024-04-18T04:51:23.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.409+0000 7fd410c00640 1 -- 172.21.15.120:0/290669467 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40400c940 con 0x7fd4140c1fe0 2024-04-18T04:51:23.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.409+0000 7fd41ac00640 1 -- 172.21.15.120:0/290669467 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3e8005260 con 0x7fd4140c1fe0 2024-04-18T04:51:23.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.409+0000 7fd410c00640 1 -- 172.21.15.120:0/290669467 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd40400cc10 con 0x7fd4140c1fe0 2024-04-18T04:51:23.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.413+0000 7fd410c00640 1 --2- 172.21.15.120:0/290669467 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd3f0066720 0x7fd3f0068be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:23.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.413+0000 7fd410c00640 1 -- 172.21.15.120:0/290669467 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7fd404084480 con 0x7fd4140c1fe0 2024-04-18T04:51:23.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.413+0000 7fd40be00640 1 --2- 172.21.15.120:0/290669467 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd3f0066720 0x7fd3f0068be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:23.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.413+0000 7fd40be00640 1 --2- 172.21.15.120:0/290669467 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd3f0066720 0x7fd3f0068be0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc006fd0 tx=0x7fd3fc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:23.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.417+0000 7fd410c00640 1 -- 172.21.15.120:0/290669467 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fd404051210 con 0x7fd4140c1fe0 2024-04-18T04:51:23.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:23.849+0000 7fd41ac00640 1 -- 172.21.15.120:0/290669467 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7fd3e8005a90 con 0x7fd4140c1fe0 2024-04-18T04:51:24.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.197+0000 7fd410c00640 1 -- 172.21.15.120:0/290669467 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v34) v1 ==== 105+0+0 (secure 0 0 0) 0x7fd404054830 con 0x7fd4140c1fe0 2024-04-18T04:51:24.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.201+0000 7fd41ac00640 1 -- 172.21.15.120:0/290669467 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd3f0066720 msgr2=0x7fd3f0068be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:24.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.201+0000 7fd41ac00640 1 --2- 172.21.15.120:0/290669467 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd3f0066720 0x7fd3f0068be0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc006fd0 tx=0x7fd3fc008040 comp rx=0 tx=0).stop 2024-04-18T04:51:24.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.201+0000 7fd41ac00640 1 -- 172.21.15.120:0/290669467 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4140c1fe0 msgr2=0x7fd4140cc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:24.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.201+0000 7fd41ac00640 1 --2- 172.21.15.120:0/290669467 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4140c1fe0 0x7fd4140cc190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd40400e890 tx=0x7fd40400ed50 comp rx=0 tx=0).stop 2024-04-18T04:51:24.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.205+0000 7fd41ac00640 1 -- 172.21.15.120:0/290669467 shutdown_connections 2024-04-18T04:51:24.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.205+0000 7fd41ac00640 1 --2- 172.21.15.120:0/290669467 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd3f0066720 0x7fd3f0068be0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:24.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.205+0000 7fd41ac00640 1 --2- 172.21.15.120:0/290669467 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4140c79c0 0x7fd4141408c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:24.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.205+0000 7fd41ac00640 1 --2- 172.21.15.120:0/290669467 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4140c3ef0 0x7fd414140380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:24.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.205+0000 7fd41ac00640 1 --2- 172.21.15.120:0/290669467 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4140c1fe0 0x7fd4140cc190 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:24.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.205+0000 7fd41ac00640 1 -- 172.21.15.120:0/290669467 >> 172.21.15.120:0/290669467 conn(0x7fd414072190 msgr2=0x7fd414158700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:51:24.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.205+0000 7fd41ac00640 1 -- 172.21.15.120:0/290669467 shutdown_connections 2024-04-18T04:51:24.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.205+0000 7fd41ac00640 1 -- 172.21.15.120:0/290669467 wait complete. 2024-04-18T04:51:24.260 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for mds cluster to stabilize... 2024-04-18T04:51:24.260 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:51:24.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.529+0000 7f3e6a400640 1 Processor -- start 2024-04-18T04:51:24.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.529+0000 7f3e6a400640 1 -- start start 2024-04-18T04:51:24.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.529+0000 7f3e6a400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3e64156440 0x7f3e640c9560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:24.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.529+0000 7f3e6a400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3e640c6940 0x7f3e640c76e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:24.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.529+0000 7f3e6a400640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e640c6dd0 con 0x7f3e640c7300 2024-04-18T04:51:24.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.529+0000 7f3e6a400640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e640c8520 con 0x7f3e64156440 2024-04-18T04:51:24.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.529+0000 7f3e6a400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e64159fb0 con 0x7f3e640c6940 2024-04-18T04:51:24.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.529+0000 7f3e63400640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f3e640c7300 0x7f3e6415a3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:53894/0 (socket says 172.21.15.120:53894) 2024-04-18T04:51:24.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.529+0000 7f3e63400640 1 -- 172.21.15.120:0/4023022961 learned_addr learned my addr 172.21.15.120:0/4023022961 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:51:24.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.529+0000 7f3e63e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3e640c6940 0x7f3e640c76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:24.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.529+0000 7f3e62a00640 1 --2- 172.21.15.120:0/4023022961 >> v2:172.21.15.120:3300/0 conn(0x7f3e64156440 0x7f3e640c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:24.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.533+0000 7f3e63e00640 1 -- 172.21.15.120:0/4023022961 >> v2:172.21.15.120:3300/0 conn(0x7f3e64156440 msgr2=0x7f3e640c9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:51:24.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.533+0000 7f3e63e00640 1 --2- 172.21.15.120:0/4023022961 >> v2:172.21.15.120:3300/0 conn(0x7f3e64156440 0x7f3e640c9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:24.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.533+0000 7f3e63e00640 1 -- 172.21.15.120:0/4023022961 >> v1:172.21.15.132:6789/0 conn(0x7f3e640c7300 legacy=0x7f3e6415a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:51:24.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.533+0000 7f3e63e00640 1 -- 172.21.15.120:0/4023022961 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e64070ce0 con 0x7f3e640c6940 2024-04-18T04:51:24.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.533+0000 7f3e63e00640 1 --2- 172.21.15.120:0/4023022961 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3e640c6940 0x7f3e640c76e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3e540097c0 tx=0x7f3e5401c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa5dd60a63ab117c server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:24.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.537+0000 7f3e62000640 1 -- 172.21.15.120:0/4023022961 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e540a4ea0 con 0x7f3e640c6940 2024-04-18T04:51:24.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.537+0000 7f3e62000640 1 -- 172.21.15.120:0/4023022961 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e540a7050 con 0x7f3e640c6940 2024-04-18T04:51:24.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.537+0000 7f3e62000640 1 -- 172.21.15.120:0/4023022961 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e540ab820 con 0x7f3e640c6940 2024-04-18T04:51:24.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.537+0000 7f3e6a400640 1 -- 172.21.15.120:0/4023022961 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3e640c6940 msgr2=0x7f3e640c76e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:24.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.537+0000 7f3e6a400640 1 --2- 172.21.15.120:0/4023022961 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3e640c6940 0x7f3e640c76e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3e540097c0 tx=0x7f3e5401c460 comp rx=0 tx=0).stop 2024-04-18T04:51:24.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.537+0000 7f3e6a400640 1 -- 172.21.15.120:0/4023022961 shutdown_connections 2024-04-18T04:51:24.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.537+0000 7f3e6a400640 1 --2- 172.21.15.120:0/4023022961 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3e640c6940 0x7f3e640c76e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:24.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.537+0000 7f3e6a400640 1 --2- 172.21.15.120:0/4023022961 >> v2:172.21.15.120:3300/0 conn(0x7f3e64156440 0x7f3e640c9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:24.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.537+0000 7f3e6a400640 1 -- 172.21.15.120:0/4023022961 >> 172.21.15.120:0/4023022961 conn(0x7f3e640c8a40 msgr2=0x7f3e640c8e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:51:24.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.541+0000 7f3e6a400640 1 -- 172.21.15.120:0/4023022961 shutdown_connections 2024-04-18T04:51:24.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.545+0000 7f3e6a400640 1 -- 172.21.15.120:0/4023022961 wait complete. 2024-04-18T04:51:24.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.549+0000 7f3e6a400640 1 Processor -- start 2024-04-18T04:51:24.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.553+0000 7f3e6a400640 1 -- start start 2024-04-18T04:51:24.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.557+0000 7f3e6a400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e640c6940 0x7f3e64158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:24.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.557+0000 7f3e6a400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3e640c7300 0x7f3e642000c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:24.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.557+0000 7f3e6a400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e64156440 0x7f3e640c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:24.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.557+0000 7f3e63400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e640c6940 0x7f3e64158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:24.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.557+0000 7f3e62a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3e640c7300 0x7f3e642000c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:24.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.557+0000 7f3e6a400640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e641f9420 con 0x7f3e640c6940 2024-04-18T04:51:24.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.557+0000 7f3e63e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e64156440 0x7f3e640c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:24.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.557+0000 7f3e6a400640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e64158010 con 0x7f3e64156440 2024-04-18T04:51:24.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.557+0000 7f3e63e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e64156440 0x7f3e640c5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:44726/0 (socket says 172.21.15.120:44726) 2024-04-18T04:51:24.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.557+0000 7f3e63e00640 1 -- 172.21.15.120:0/2862086867 learned_addr learned my addr 172.21.15.120:0/2862086867 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:51:24.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.557+0000 7f3e6a400640 1 -- 172.21.15.120:0/2862086867 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e641588b0 con 0x7f3e640c7300 2024-04-18T04:51:24.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.561+0000 7f3e63400640 1 -- 172.21.15.120:0/2862086867 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3e640c7300 msgr2=0x7f3e642000c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:24.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.561+0000 7f3e63400640 1 --2- 172.21.15.120:0/2862086867 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3e640c7300 0x7f3e642000c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:24.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.561+0000 7f3e63400640 1 -- 172.21.15.120:0/2862086867 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e64156440 msgr2=0x7f3e640c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:24.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.561+0000 7f3e63400640 1 --2- 172.21.15.120:0/2862086867 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e64156440 0x7f3e640c5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:24.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.561+0000 7f3e63400640 1 -- 172.21.15.120:0/2862086867 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e54009420 con 0x7f3e640c6940 2024-04-18T04:51:24.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.565+0000 7f3e63400640 1 --2- 172.21.15.120:0/2862086867 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e640c6940 0x7f3e64158d40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c00cb20 tx=0x7f3e5c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:24.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.565+0000 7f3e5b400640 1 -- 172.21.15.120:0/2862086867 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c00aca0 con 0x7f3e640c6940 2024-04-18T04:51:24.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.565+0000 7f3e5b400640 1 -- 172.21.15.120:0/2862086867 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5c00ae00 con 0x7f3e640c6940 2024-04-18T04:51:24.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.565+0000 7f3e5b400640 1 -- 172.21.15.120:0/2862086867 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c00aca0 con 0x7f3e640c6940 2024-04-18T04:51:24.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.565+0000 7f3e6a400640 1 -- 172.21.15.120:0/2862086867 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e64159550 con 0x7f3e640c6940 2024-04-18T04:51:24.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.565+0000 7f3e6a400640 1 -- 172.21.15.120:0/2862086867 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e64158260 con 0x7f3e640c6940 2024-04-18T04:51:24.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.573+0000 7f3e6a400640 1 -- 172.21.15.120:0/2862086867 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e3c005260 con 0x7f3e640c6940 2024-04-18T04:51:24.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.577+0000 7f3e5b400640 1 -- 172.21.15.120:0/2862086867 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3e5c01b400 con 0x7f3e640c6940 2024-04-18T04:51:24.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.577+0000 7f3e5b400640 1 --2- 172.21.15.120:0/2862086867 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3e400666f0 0x7f3e40068bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:24.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.577+0000 7f3e62a00640 1 --2- 172.21.15.120:0/2862086867 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3e400666f0 0x7f3e40068bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:24.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.581+0000 7f3e5b400640 1 -- 172.21.15.120:0/2862086867 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f3e5c0552f0 con 0x7f3e640c6940 2024-04-18T04:51:24.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.581+0000 7f3e62a00640 1 --2- 172.21.15.120:0/2862086867 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3e400666f0 0x7f3e40068bb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3e64202120 tx=0x7f3e4c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:24.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.589+0000 7f3e5b400640 1 -- 172.21.15.120:0/2862086867 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f3e5c051630 con 0x7f3e640c6940 2024-04-18T04:51:24.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.961+0000 7f3e6a400640 1 -- 172.21.15.120:0/2862086867 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e3c005a90 con 0x7f3e640c6940 2024-04-18T04:51:24.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.965+0000 7f3e5b400640 1 -- 172.21.15.120:0/2862086867 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+6290 (secure 0 0 0) 0x7f3e5c054c50 con 0x7f3e640c6940 2024-04-18T04:51:24.964 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:51:24.964 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:51:24.198712+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4967,"mds_2":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:active","state_seq":31,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5130":{"gid":5130,"name":"c","rank":2,"incarnation":22,"state":"up:stopping","state_seq":23,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:51:24.965 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 35 2024-04-18T04:51:24.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.977+0000 7f3e6a400640 1 -- 172.21.15.120:0/2862086867 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3e400666f0 msgr2=0x7f3e40068bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:24.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.977+0000 7f3e6a400640 1 --2- 172.21.15.120:0/2862086867 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3e400666f0 0x7f3e40068bb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3e64202120 tx=0x7f3e4c008040 comp rx=0 tx=0).stop 2024-04-18T04:51:24.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.977+0000 7f3e6a400640 1 -- 172.21.15.120:0/2862086867 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e640c6940 msgr2=0x7f3e64158d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:24.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.977+0000 7f3e6a400640 1 --2- 172.21.15.120:0/2862086867 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e640c6940 0x7f3e64158d40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c00cb20 tx=0x7f3e5c00a060 comp rx=0 tx=0).stop 2024-04-18T04:51:24.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.981+0000 7f3e6a400640 1 -- 172.21.15.120:0/2862086867 shutdown_connections 2024-04-18T04:51:24.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.981+0000 7f3e6a400640 1 --2- 172.21.15.120:0/2862086867 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3e400666f0 0x7f3e40068bb0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:24.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.981+0000 7f3e6a400640 1 --2- 172.21.15.120:0/2862086867 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e64156440 0x7f3e640c5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:24.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.981+0000 7f3e6a400640 1 --2- 172.21.15.120:0/2862086867 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3e640c7300 0x7f3e642000c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:24.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.981+0000 7f3e6a400640 1 --2- 172.21.15.120:0/2862086867 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e640c6940 0x7f3e64158d40 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:24.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.981+0000 7f3e6a400640 1 -- 172.21.15.120:0/2862086867 >> 172.21.15.120:0/2862086867 conn(0x7f3e640c8a40 msgr2=0x7f3e640c2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:51:24.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.989+0000 7f3e6a400640 1 -- 172.21.15.120:0/2862086867 shutdown_connections 2024-04-18T04:51:24.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:24.989+0000 7f3e6a400640 1 -- 172.21.15.120:0/2862086867 wait complete. 2024-04-18T04:51:25.029 INFO:tasks.mds_thrash.fs.[cephfs]:cluster is considered unstable while MDS are in up:stopping (!thrash_while_stopping) 2024-04-18T04:51:25.030 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 35, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-18T04:44:30.251235+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 35, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1, 2 ], "info": { "gid_4288": { "addr": "172.21.15.120:6837/76856194", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6835", "nonce": 76856194, "type": "v2" }, { "addr": "172.21.15.120:6837", "nonce": 76856194, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4288, "incarnation": 4, "join_fscid": -1, "name": "e", "rank": 0, "state": "up:active", "state_seq": 4 }, "gid_4967": { "addr": "172.21.15.132:6835/396956733", "addrs": { "addrvec": [ { "addr": "172.21.15.132:6834", "nonce": 396956733, "type": "v2" }, { "addr": "172.21.15.132:6835", "nonce": 396956733, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4967, "incarnation": 28, "join_fscid": -1, "name": "b", "rank": 1, "state": "up:active", "state_seq": 31 }, "gid_5130": { "addr": "172.21.15.120:6833/4067927368", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6832", "nonce": 4067927368, "type": "v2" }, { "addr": "172.21.15.120:6833", "nonce": 4067927368, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5130, "incarnation": 22, "join_fscid": -1, "name": "c", "rank": 2, "state": "up:stopping", "state_seq": 23 } }, "last_failure": 0, "last_failure_osd_epoch": 30, "max_file_size": 1099511627776, "max_mds": 2, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-18T04:51:24.198712+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4288, "mds_1": 4967, "mds_2": 5130 } } } ], "standbys": [ { "addr": "172.21.15.132:6839/4292136288", "addrs": { "addrvec": [ { "addr": "172.21.15.132:6836", "nonce": 4292136288, "type": "v2" }, { "addr": "172.21.15.132:6839", "nonce": 4292136288, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4241, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.132:6838/1712856922", "addrs": { "addrvec": [ { "addr": "172.21.15.132:6837", "nonce": 1712856922, "type": "v2" }, { "addr": "172.21.15.132:6838", "nonce": 1712856922, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 2, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4244, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.120:6836/2384594941", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6834", "nonce": 2384594941, "type": "v2" }, { "addr": "172.21.15.120:6836", "nonce": 2384594941, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 33, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5051, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-18T04:51:27.031 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:51:27.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.341+0000 7f84af200640 1 Processor -- start 2024-04-18T04:51:27.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.341+0000 7f84af200640 1 -- start start 2024-04-18T04:51:27.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.341+0000 7f84af200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84a80c7ae0 0x7f84a80c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:27.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.341+0000 7f84af200640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84a8162080 con 0x7f84a8072180 2024-04-18T04:51:27.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.341+0000 7f84af200640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84a815e170 con 0x7f84a815db00 2024-04-18T04:51:27.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.341+0000 7f84af200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a80c8470 con 0x7f84a80c7ae0 2024-04-18T04:51:27.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.341+0000 7f84ad200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84a80c7ae0 0x7f84a80c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:27.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.341+0000 7f84ad200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84a80c7ae0 0x7f84a80c7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:48236/0 (socket says 172.21.15.120:48236) 2024-04-18T04:51:27.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.341+0000 7f84ad200640 1 -- 172.21.15.120:0/1910660641 learned_addr learned my addr 172.21.15.120:0/1910660641 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:51:27.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.341+0000 7f84ad200640 1 -- 172.21.15.120:0/1910660641 >> v1:172.21.15.132:6789/0 conn(0x7f84a815db00 legacy=0x7f84a80c5d80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-18T04:51:27.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.341+0000 7f84ad200640 1 -- 172.21.15.120:0/1910660641 >> v1:172.21.15.120:6789/0 conn(0x7f84a8072180 legacy=0x7f84a8161970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:51:27.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.341+0000 7f84ad200640 1 -- 172.21.15.120:0/1910660641 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a815e450 con 0x7f84a80c7ae0 2024-04-18T04:51:27.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.349+0000 7f84ad200640 1 --2- 172.21.15.120:0/1910660641 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84a80c7ae0 0x7f84a80c7f30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f84a0009e80 tx=0x7f84a001f1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=385c56218ac4c74b server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:27.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.349+0000 7f84a6a00640 1 -- 172.21.15.120:0/1910660641 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a00af400 con 0x7f84a80c7ae0 2024-04-18T04:51:27.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.349+0000 7f84a6a00640 1 -- 172.21.15.120:0/1910660641 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a00ab050 con 0x7f84a80c7ae0 2024-04-18T04:51:27.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.349+0000 7f84a6a00640 1 -- 172.21.15.120:0/1910660641 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a00af780 con 0x7f84a80c7ae0 2024-04-18T04:51:27.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.349+0000 7f84af200640 1 -- 172.21.15.120:0/1910660641 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84a80c7ae0 msgr2=0x7f84a80c7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:27.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.349+0000 7f84af200640 1 --2- 172.21.15.120:0/1910660641 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84a80c7ae0 0x7f84a80c7f30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f84a0009e80 tx=0x7f84a001f1c0 comp rx=0 tx=0).stop 2024-04-18T04:51:27.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.349+0000 7f84af200640 1 -- 172.21.15.120:0/1910660641 shutdown_connections 2024-04-18T04:51:27.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.349+0000 7f84af200640 1 --2- 172.21.15.120:0/1910660641 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84a80c7ae0 0x7f84a80c7f30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:27.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.349+0000 7f84af200640 1 -- 172.21.15.120:0/1910660641 >> 172.21.15.120:0/1910660641 conn(0x7f84a80cb2e0 msgr2=0x7f84a80cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:51:27.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.353+0000 7f84af200640 1 -- 172.21.15.120:0/1910660641 shutdown_connections 2024-04-18T04:51:27.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.353+0000 7f84af200640 1 -- 172.21.15.120:0/1910660641 wait complete. 2024-04-18T04:51:27.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.357+0000 7f84af200640 1 Processor -- start 2024-04-18T04:51:27.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.357+0000 7f84af200640 1 -- start start 2024-04-18T04:51:27.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.357+0000 7f84af200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84a8072180 0x7f84a8160160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:27.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.357+0000 7f84af200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84a80c7ae0 0x7f84a814f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:27.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.357+0000 7f84af200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84a815db00 0x7f84a814fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:27.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.357+0000 7f84af200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a81f4390 con 0x7f84a8072180 2024-04-18T04:51:27.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.357+0000 7f84af200640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a80c9420 con 0x7f84a80c7ae0 2024-04-18T04:51:27.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.357+0000 7f84af200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a80cba70 con 0x7f84a815db00 2024-04-18T04:51:27.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.357+0000 7f84a7400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84a80c7ae0 0x7f84a814f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:27.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.357+0000 7f84a7400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84a80c7ae0 0x7f84a814f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:44742/0 (socket says 172.21.15.120:44742) 2024-04-18T04:51:27.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.357+0000 7f84a7400640 1 -- 172.21.15.120:0/4206784023 learned_addr learned my addr 172.21.15.120:0/4206784023 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:51:27.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.361+0000 7f84a7e00640 1 --2- 172.21.15.120:0/4206784023 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84a8072180 0x7f84a8160160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:27.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.361+0000 7f84ad200640 1 --2- 172.21.15.120:0/4206784023 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84a815db00 0x7f84a814fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:27.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.361+0000 7f84a7400640 1 -- 172.21.15.120:0/4206784023 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84a815db00 msgr2=0x7f84a814fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:27.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.361+0000 7f84a7400640 1 --2- 172.21.15.120:0/4206784023 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84a815db00 0x7f84a814fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:27.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.361+0000 7f84a7400640 1 -- 172.21.15.120:0/4206784023 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84a8072180 msgr2=0x7f84a8160160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:27.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.361+0000 7f84a7400640 1 --2- 172.21.15.120:0/4206784023 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84a8072180 0x7f84a8160160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:27.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.361+0000 7f84a7400640 1 -- 172.21.15.120:0/4206784023 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a0009b30 con 0x7f84a80c7ae0 2024-04-18T04:51:27.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.361+0000 7f84a7e00640 1 --2- 172.21.15.120:0/4206784023 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84a8072180 0x7f84a8160160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:51:27.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.365+0000 7f84a7400640 1 --2- 172.21.15.120:0/4206784023 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84a80c7ae0 0x7f84a814f760 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f849000b3e0 tx=0x7f849000b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:27.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.365+0000 7f849fe00640 1 -- 172.21.15.120:0/4206784023 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8490011830 con 0x7f84a80c7ae0 2024-04-18T04:51:27.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.365+0000 7f849fe00640 1 -- 172.21.15.120:0/4206784023 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84900119b0 con 0x7f84a80c7ae0 2024-04-18T04:51:27.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.365+0000 7f849fe00640 1 -- 172.21.15.120:0/4206784023 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8490011d60 con 0x7f84a80c7ae0 2024-04-18T04:51:27.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.365+0000 7f84af200640 1 -- 172.21.15.120:0/4206784023 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84a81f3df0 con 0x7f84a80c7ae0 2024-04-18T04:51:27.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.365+0000 7f84af200640 1 -- 172.21.15.120:0/4206784023 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84a80c90b0 con 0x7f84a80c7ae0 2024-04-18T04:51:27.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.365+0000 7f84af200640 1 -- 172.21.15.120:0/4206784023 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8480005260 con 0x7f84a80c7ae0 2024-04-18T04:51:27.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.369+0000 7f849fe00640 1 -- 172.21.15.120:0/4206784023 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f849001a400 con 0x7f84a80c7ae0 2024-04-18T04:51:27.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.369+0000 7f849fe00640 1 --2- 172.21.15.120:0/4206784023 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8484066710 0x7f8484068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:27.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.369+0000 7f849fe00640 1 -- 172.21.15.120:0/4206784023 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f8490084660 con 0x7f84a80c7ae0 2024-04-18T04:51:27.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.373+0000 7f84a7e00640 1 --2- 172.21.15.120:0/4206784023 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8484066710 0x7f8484068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:27.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.373+0000 7f84a7e00640 1 --2- 172.21.15.120:0/4206784023 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8484066710 0x7f8484068bd0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8498001760 tx=0x7f8498009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:27.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.385+0000 7f849fe00640 1 -- 172.21.15.120:0/4206784023 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f8490051600 con 0x7f84a80c7ae0 2024-04-18T04:51:27.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.793+0000 7f84af200640 1 -- 172.21.15.120:0/4206784023 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84800050d0 con 0x7f84a80c7ae0 2024-04-18T04:51:27.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.797+0000 7f849fe00640 1 -- 172.21.15.120:0/4206784023 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+6290 (secure 0 0 0) 0x7f84900091f0 con 0x7f84a80c7ae0 2024-04-18T04:51:27.795 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:51:27.797 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:51:24.198712+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4967,"mds_2":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:active","state_seq":31,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5130":{"gid":5130,"name":"c","rank":2,"incarnation":22,"state":"up:stopping","state_seq":23,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:51:27.798 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 35 2024-04-18T04:51:27.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.813+0000 7f84af200640 1 -- 172.21.15.120:0/4206784023 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8484066710 msgr2=0x7f8484068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:27.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.813+0000 7f84af200640 1 --2- 172.21.15.120:0/4206784023 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8484066710 0x7f8484068bd0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8498001760 tx=0x7f8498009040 comp rx=0 tx=0).stop 2024-04-18T04:51:27.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.813+0000 7f84af200640 1 -- 172.21.15.120:0/4206784023 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84a80c7ae0 msgr2=0x7f84a814f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:27.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.813+0000 7f84af200640 1 --2- 172.21.15.120:0/4206784023 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84a80c7ae0 0x7f84a814f760 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f849000b3e0 tx=0x7f849000b8a0 comp rx=0 tx=0).stop 2024-04-18T04:51:27.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.817+0000 7f84af200640 1 -- 172.21.15.120:0/4206784023 shutdown_connections 2024-04-18T04:51:27.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.817+0000 7f84af200640 1 --2- 172.21.15.120:0/4206784023 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8484066710 0x7f8484068bd0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:27.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.817+0000 7f84af200640 1 --2- 172.21.15.120:0/4206784023 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84a815db00 0x7f84a814fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:27.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.817+0000 7f84af200640 1 --2- 172.21.15.120:0/4206784023 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84a80c7ae0 0x7f84a814f760 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:27.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.817+0000 7f84af200640 1 --2- 172.21.15.120:0/4206784023 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84a8072180 0x7f84a8160160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:27.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.817+0000 7f84af200640 1 -- 172.21.15.120:0/4206784023 >> 172.21.15.120:0/4206784023 conn(0x7f84a80cb2e0 msgr2=0x7f84a8161970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:51:27.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.817+0000 7f84af200640 1 -- 172.21.15.120:0/4206784023 shutdown_connections 2024-04-18T04:51:27.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:27.817+0000 7f84af200640 1 -- 172.21.15.120:0/4206784023 wait complete. 2024-04-18T04:51:27.868 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:51:29.869 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:51:30.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.113+0000 7f627e200640 1 Processor -- start 2024-04-18T04:51:30.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.117+0000 7f627e200640 1 -- start start 2024-04-18T04:51:30.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.117+0000 7f627e200640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f62700343b0 0x7f62700e0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:30.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.117+0000 7f627e200640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f627004d760 0x7f627004c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:30.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.117+0000 7f627e200640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62700e05c0 con 0x7f62700d6c40 2024-04-18T04:51:30.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.117+0000 7f627e200640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62700356f0 con 0x7f62700343b0 2024-04-18T04:51:30.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.117+0000 7f627e200640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62700348f0 con 0x7f627004d760 2024-04-18T04:51:30.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.117+0000 7f627ce00640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f62700d6c40 0x7f6270004720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:53908/0 (socket says 172.21.15.120:53908) 2024-04-18T04:51:30.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.117+0000 7f627ce00640 1 -- 172.21.15.120:0/3276800522 learned_addr learned my addr 172.21.15.120:0/3276800522 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:51:30.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.117+0000 7f627d800640 1 --2- 172.21.15.120:0/3276800522 >> v2:172.21.15.132:3300/0 conn(0x7f627004d760 0x7f627004c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:30.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.117+0000 7f6277e00640 1 --2- 172.21.15.120:0/3276800522 >> v2:172.21.15.120:3300/0 conn(0x7f62700343b0 0x7f62700e0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:30.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.117+0000 7f627d800640 1 -- 172.21.15.120:0/3276800522 >> v2:172.21.15.120:3300/0 conn(0x7f62700343b0 msgr2=0x7f62700e0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:51:30.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.117+0000 7f627d800640 1 --2- 172.21.15.120:0/3276800522 >> v2:172.21.15.120:3300/0 conn(0x7f62700343b0 0x7f62700e0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:30.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.117+0000 7f627d800640 1 -- 172.21.15.120:0/3276800522 >> v1:172.21.15.132:6789/0 conn(0x7f62700d6c40 legacy=0x7f6270004720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:30.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.117+0000 7f627d800640 1 -- 172.21.15.120:0/3276800522 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6270034b90 con 0x7f627004d760 2024-04-18T04:51:30.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.121+0000 7f627d800640 1 --2- 172.21.15.120:0/3276800522 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f627004d760 0x7f627004c530 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f627802c920 tx=0x7f6278099a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb0013c19824c916 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:30.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.125+0000 7f6277400640 1 -- 172.21.15.120:0/3276800522 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62781246d0 con 0x7f627004d760 2024-04-18T04:51:30.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.125+0000 7f6277400640 1 -- 172.21.15.120:0/3276800522 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6278124870 con 0x7f627004d760 2024-04-18T04:51:30.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.125+0000 7f6277400640 1 -- 172.21.15.120:0/3276800522 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6278124ce0 con 0x7f627004d760 2024-04-18T04:51:30.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.125+0000 7f627e200640 1 -- 172.21.15.120:0/3276800522 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f627004d760 msgr2=0x7f627004c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:30.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.125+0000 7f627e200640 1 --2- 172.21.15.120:0/3276800522 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f627004d760 0x7f627004c530 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f627802c920 tx=0x7f6278099a20 comp rx=0 tx=0).stop 2024-04-18T04:51:30.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.125+0000 7f627e200640 1 -- 172.21.15.120:0/3276800522 shutdown_connections 2024-04-18T04:51:30.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.125+0000 7f627e200640 1 --2- 172.21.15.120:0/3276800522 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f627004d760 0x7f627004c530 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:30.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.125+0000 7f627e200640 1 --2- 172.21.15.120:0/3276800522 >> v2:172.21.15.120:3300/0 conn(0x7f62700343b0 0x7f62700e0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:30.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.125+0000 7f627e200640 1 -- 172.21.15.120:0/3276800522 >> 172.21.15.120:0/3276800522 conn(0x7f6270051280 msgr2=0x7f6270051690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:51:30.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.125+0000 7f627e200640 1 -- 172.21.15.120:0/3276800522 shutdown_connections 2024-04-18T04:51:30.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.125+0000 7f627e200640 1 -- 172.21.15.120:0/3276800522 wait complete. 2024-04-18T04:51:30.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.129+0000 7f627e200640 1 Processor -- start 2024-04-18T04:51:30.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.133+0000 7f627e200640 1 -- start start 2024-04-18T04:51:30.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.133+0000 7f627e200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f62700343b0 0x7f627004b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:30.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.133+0000 7f627e200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f627004d760 0x7f62700cf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:30.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.133+0000 7f627e200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62700d6c40 0x7f62700cd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:30.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.133+0000 7f627e200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627004b6b0 con 0x7f62700343b0 2024-04-18T04:51:30.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.133+0000 7f627e200640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62700cf080 con 0x7f62700d6c40 2024-04-18T04:51:30.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.133+0000 7f627e200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62700ce2b0 con 0x7f627004d760 2024-04-18T04:51:30.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.133+0000 7f6277e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f627004d760 0x7f62700cf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:30.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.133+0000 7f6277e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f627004d760 0x7f62700cf8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:48258/0 (socket says 172.21.15.120:48258) 2024-04-18T04:51:30.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.133+0000 7f6277e00640 1 -- 172.21.15.120:0/1848088423 learned_addr learned my addr 172.21.15.120:0/1848088423 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:51:30.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.133+0000 7f627ce00640 1 --2- 172.21.15.120:0/1848088423 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f62700343b0 0x7f627004b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:30.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.133+0000 7f627d800640 1 --2- 172.21.15.120:0/1848088423 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62700d6c40 0x7f62700cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:30.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.133+0000 7f627ce00640 1 -- 172.21.15.120:0/1848088423 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f627004d760 msgr2=0x7f62700cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:30.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.133+0000 7f627ce00640 1 --2- 172.21.15.120:0/1848088423 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f627004d760 0x7f62700cf8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:30.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.137+0000 7f627ce00640 1 -- 172.21.15.120:0/1848088423 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62700d6c40 msgr2=0x7f62700cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:30.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.137+0000 7f627ce00640 1 --2- 172.21.15.120:0/1848088423 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62700d6c40 0x7f62700cd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:30.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.137+0000 7f627ce00640 1 -- 172.21.15.120:0/1848088423 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6278072040 con 0x7f62700343b0 2024-04-18T04:51:30.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.137+0000 7f627ce00640 1 --2- 172.21.15.120:0/1848088423 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f62700343b0 0x7f627004b000 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f626c00c390 tx=0x7f626c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:30.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.137+0000 7f6274c00640 1 -- 172.21.15.120:0/1848088423 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c005cf0 con 0x7f62700343b0 2024-04-18T04:51:30.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.137+0000 7f6274c00640 1 -- 172.21.15.120:0/1848088423 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626c005e50 con 0x7f62700343b0 2024-04-18T04:51:30.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.137+0000 7f6274c00640 1 -- 172.21.15.120:0/1848088423 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c0072f0 con 0x7f62700343b0 2024-04-18T04:51:30.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.137+0000 7f627e200640 1 -- 172.21.15.120:0/1848088423 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62700ce500 con 0x7f62700343b0 2024-04-18T04:51:30.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.137+0000 7f627e200640 1 -- 172.21.15.120:0/1848088423 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62700ceac0 con 0x7f62700343b0 2024-04-18T04:51:30.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.137+0000 7f627e200640 1 -- 172.21.15.120:0/1848088423 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62700e0210 con 0x7f62700343b0 2024-04-18T04:51:30.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.145+0000 7f6274c00640 1 -- 172.21.15.120:0/1848088423 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f626c007450 con 0x7f62700343b0 2024-04-18T04:51:30.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.149+0000 7f6274c00640 1 --2- 172.21.15.120:0/1848088423 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6258066710 0x7f6258068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:30.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.149+0000 7f6277e00640 1 --2- 172.21.15.120:0/1848088423 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6258066710 0x7f6258068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:30.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.153+0000 7f6277e00640 1 --2- 172.21.15.120:0/1848088423 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6258066710 0x7f6258068bd0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f627004fe80 tx=0x7f6264008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:30.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.153+0000 7f6274c00640 1 -- 172.21.15.120:0/1848088423 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f626c054ab0 con 0x7f62700343b0 2024-04-18T04:51:30.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.153+0000 7f6274c00640 1 -- 172.21.15.120:0/1848088423 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f626c050df0 con 0x7f62700343b0 2024-04-18T04:51:30.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.557+0000 7f627e200640 1 -- 172.21.15.120:0/1848088423 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6270007630 con 0x7f62700343b0 2024-04-18T04:51:30.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.561+0000 7f6274c00640 1 -- 172.21.15.120:0/1848088423 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+6290 (secure 0 0 0) 0x7f626c017090 con 0x7f62700343b0 2024-04-18T04:51:30.562 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:51:30.562 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:51:24.198712+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4967,"mds_2":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:active","state_seq":31,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5130":{"gid":5130,"name":"c","rank":2,"incarnation":22,"state":"up:stopping","state_seq":23,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:51:30.562 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 35 2024-04-18T04:51:30.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.565+0000 7f627e200640 1 -- 172.21.15.120:0/1848088423 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6258066710 msgr2=0x7f6258068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:30.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.565+0000 7f627e200640 1 --2- 172.21.15.120:0/1848088423 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6258066710 0x7f6258068bd0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f627004fe80 tx=0x7f6264008040 comp rx=0 tx=0).stop 2024-04-18T04:51:30.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.565+0000 7f627e200640 1 -- 172.21.15.120:0/1848088423 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f62700343b0 msgr2=0x7f627004b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:30.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.565+0000 7f627e200640 1 --2- 172.21.15.120:0/1848088423 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f62700343b0 0x7f627004b000 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f626c00c390 tx=0x7f626c00c850 comp rx=0 tx=0).stop 2024-04-18T04:51:30.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.569+0000 7f627e200640 1 -- 172.21.15.120:0/1848088423 shutdown_connections 2024-04-18T04:51:30.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.569+0000 7f627e200640 1 --2- 172.21.15.120:0/1848088423 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6258066710 0x7f6258068bd0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:30.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.569+0000 7f627e200640 1 --2- 172.21.15.120:0/1848088423 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62700d6c40 0x7f62700cd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:30.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.569+0000 7f627e200640 1 --2- 172.21.15.120:0/1848088423 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f627004d760 0x7f62700cf8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:30.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.569+0000 7f627e200640 1 --2- 172.21.15.120:0/1848088423 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f62700343b0 0x7f627004b000 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:30.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.569+0000 7f627e200640 1 -- 172.21.15.120:0/1848088423 >> 172.21.15.120:0/1848088423 conn(0x7f6270051280 msgr2=0x7f6270050290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:51:30.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.569+0000 7f627e200640 1 -- 172.21.15.120:0/1848088423 shutdown_connections 2024-04-18T04:51:30.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:30.569+0000 7f627e200640 1 -- 172.21.15.120:0/1848088423 wait complete. 2024-04-18T04:51:30.620 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:51:32.621 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:51:33.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:32.877+0000 7fbd38e00640 1 Processor -- start 2024-04-18T04:51:33.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:32.877+0000 7fbd38e00640 1 -- start start 2024-04-18T04:51:33.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:32.877+0000 7fbd38e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fbd3406c6d0 0x7fbd340c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:33.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:32.881+0000 7fbd38e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbd341699d0 0x7fbd34169e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:33.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:32.881+0000 7fbd38e00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd3406b800 con 0x7fbd34163a90 2024-04-18T04:51:33.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:32.881+0000 7fbd38e00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd34070130 con 0x7fbd3406c6d0 2024-04-18T04:51:33.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:32.881+0000 7fbd38e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd340c72e0 con 0x7fbd341699d0 2024-04-18T04:51:33.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:32.881+0000 7fbd32800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbd341699d0 0x7fbd34169e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:33.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:32.881+0000 7fbd32800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbd341699d0 0x7fbd34169e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:48578/0 (socket says 172.21.15.120:48578) 2024-04-18T04:51:33.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:32.881+0000 7fbd32800640 1 -- 172.21.15.120:0/171967210 learned_addr learned my addr 172.21.15.120:0/171967210 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:51:33.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:32.881+0000 7fbd30a00640 1 -- 172.21.15.120:0/171967210 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3617489120 0 0) 0x7fbd3406b800 con 0x7fbd34163a90 2024-04-18T04:51:33.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.041+0000 7fbd30a00640 1 -- 172.21.15.120:0/171967210 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd18005740 con 0x7fbd34163a90 2024-04-18T04:51:33.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:32.881+0000 7fbd31400640 1 --2- 172.21.15.120:0/171967210 >> v2:172.21.15.120:3300/0 conn(0x7fbd3406c6d0 0x7fbd340c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:33.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.041+0000 7fbd32800640 1 -- 172.21.15.120:0/171967210 >> v2:172.21.15.120:3300/0 conn(0x7fbd3406c6d0 msgr2=0x7fbd340c61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:51:33.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.041+0000 7fbd32800640 1 --2- 172.21.15.120:0/171967210 >> v2:172.21.15.120:3300/0 conn(0x7fbd3406c6d0 0x7fbd340c61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:33.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.041+0000 7fbd32800640 1 -- 172.21.15.120:0/171967210 >> v1:172.21.15.120:6789/0 conn(0x7fbd34163a90 legacy=0x7fbd3406bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:33.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.041+0000 7fbd32800640 1 -- 172.21.15.120:0/171967210 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd340c6d20 con 0x7fbd341699d0 2024-04-18T04:51:33.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.045+0000 7fbd31400640 1 --2- 172.21.15.120:0/171967210 >> v2:172.21.15.120:3300/0 conn(0x7fbd3406c6d0 0x7fbd340c61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:51:33.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.073+0000 7fbd32800640 1 --2- 172.21.15.120:0/171967210 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbd341699d0 0x7fbd34169e20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c008ec0 tx=0x7fbd2c01f550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d1ea3a63899f190 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:33.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.077+0000 7fbd30a00640 1 -- 172.21.15.120:0/171967210 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c0b1680 con 0x7fbd341699d0 2024-04-18T04:51:33.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.077+0000 7fbd30a00640 1 -- 172.21.15.120:0/171967210 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd2c0b17e0 con 0x7fbd341699d0 2024-04-18T04:51:33.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.077+0000 7fbd30a00640 1 -- 172.21.15.120:0/171967210 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c0b1b70 con 0x7fbd341699d0 2024-04-18T04:51:33.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.081+0000 7fbd38e00640 1 -- 172.21.15.120:0/171967210 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbd341699d0 msgr2=0x7fbd34169e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:33.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.081+0000 7fbd38e00640 1 --2- 172.21.15.120:0/171967210 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbd341699d0 0x7fbd34169e20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c008ec0 tx=0x7fbd2c01f550 comp rx=0 tx=0).stop 2024-04-18T04:51:33.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.081+0000 7fbd38e00640 1 -- 172.21.15.120:0/171967210 shutdown_connections 2024-04-18T04:51:33.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.081+0000 7fbd38e00640 1 --2- 172.21.15.120:0/171967210 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbd341699d0 0x7fbd34169e20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:33.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.081+0000 7fbd38e00640 1 --2- 172.21.15.120:0/171967210 >> v2:172.21.15.120:3300/0 conn(0x7fbd3406c6d0 0x7fbd340c61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:33.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.081+0000 7fbd38e00640 1 -- 172.21.15.120:0/171967210 >> 172.21.15.120:0/171967210 conn(0x7fbd340c78c0 msgr2=0x7fbd340c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:51:33.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.081+0000 7fbd38e00640 1 -- 172.21.15.120:0/171967210 shutdown_connections 2024-04-18T04:51:33.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.081+0000 7fbd38e00640 1 -- 172.21.15.120:0/171967210 wait complete. 2024-04-18T04:51:33.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.085+0000 7fbd38e00640 1 Processor -- start 2024-04-18T04:51:33.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.089+0000 7fbd38e00640 1 -- start start 2024-04-18T04:51:33.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.089+0000 7fbd38e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd3406c6d0 0x7fbd34166fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:33.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.089+0000 7fbd38e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbd34163a90 0x7fbd3415d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:33.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.089+0000 7fbd38e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd341699d0 0x7fbd341627a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:33.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.089+0000 7fbd38e00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd340c3e00 con 0x7fbd3406c6d0 2024-04-18T04:51:33.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.089+0000 7fbd38e00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd340c49c0 con 0x7fbd341699d0 2024-04-18T04:51:33.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.089+0000 7fbd38e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd340c3640 con 0x7fbd34163a90 2024-04-18T04:51:33.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.093+0000 7fbd32800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd341699d0 0x7fbd341627a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:33.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.093+0000 7fbd32800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd341699d0 0x7fbd341627a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:40128/0 (socket says 172.21.15.120:40128) 2024-04-18T04:51:33.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.093+0000 7fbd32800640 1 -- 172.21.15.120:0/3452767807 learned_addr learned my addr 172.21.15.120:0/3452767807 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:51:33.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.093+0000 7fbd31400640 1 --2- 172.21.15.120:0/3452767807 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbd34163a90 0x7fbd3415d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:33.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.093+0000 7fbd32800640 1 -- 172.21.15.120:0/3452767807 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbd34163a90 msgr2=0x7fbd3415d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:33.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.097+0000 7fbd31e00640 1 --2- 172.21.15.120:0/3452767807 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd3406c6d0 0x7fbd34166fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:33.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.097+0000 7fbd32800640 1 --2- 172.21.15.120:0/3452767807 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbd34163a90 0x7fbd3415d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:33.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.097+0000 7fbd32800640 1 -- 172.21.15.120:0/3452767807 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd3406c6d0 msgr2=0x7fbd34166fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:33.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.097+0000 7fbd32800640 1 --2- 172.21.15.120:0/3452767807 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd3406c6d0 0x7fbd34166fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:33.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.097+0000 7fbd32800640 1 -- 172.21.15.120:0/3452767807 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2c008b20 con 0x7fbd341699d0 2024-04-18T04:51:33.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.097+0000 7fbd31400640 1 --2- 172.21.15.120:0/3452767807 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbd34163a90 0x7fbd3415d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:51:33.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.097+0000 7fbd32800640 1 --2- 172.21.15.120:0/3452767807 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd341699d0 0x7fbd341627a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c01c160 tx=0x7fbd2c01c2f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:33.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.097+0000 7fbd2a000640 1 -- 172.21.15.120:0/3452767807 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c0b1b50 con 0x7fbd341699d0 2024-04-18T04:51:33.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.097+0000 7fbd2a000640 1 -- 172.21.15.120:0/3452767807 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd2c0b1cf0 con 0x7fbd341699d0 2024-04-18T04:51:33.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.097+0000 7fbd2a000640 1 -- 172.21.15.120:0/3452767807 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c0bb650 con 0x7fbd341699d0 2024-04-18T04:51:33.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.101+0000 7fbd31e00640 1 --2- 172.21.15.120:0/3452767807 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd3406c6d0 0x7fbd34166fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:51:33.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.105+0000 7fbd38e00640 1 -- 172.21.15.120:0/3452767807 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd34165870 con 0x7fbd341699d0 2024-04-18T04:51:33.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.105+0000 7fbd38e00640 1 -- 172.21.15.120:0/3452767807 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd340c2d10 con 0x7fbd341699d0 2024-04-18T04:51:33.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.109+0000 7fbd38e00640 1 -- 172.21.15.120:0/3452767807 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd34073e10 con 0x7fbd341699d0 2024-04-18T04:51:33.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.117+0000 7fbd2a000640 1 -- 172.21.15.120:0/3452767807 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbd2c0b8050 con 0x7fbd341699d0 2024-04-18T04:51:33.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.121+0000 7fbd2a000640 1 --2- 172.21.15.120:0/3452767807 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fbd14066760 0x7fbd14068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:33.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.121+0000 7fbd2a000640 1 -- 172.21.15.120:0/3452767807 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7fbd2c00d040 con 0x7fbd341699d0 2024-04-18T04:51:33.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.129+0000 7fbd31e00640 1 --2- 172.21.15.120:0/3452767807 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fbd14066760 0x7fbd14068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:33.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.133+0000 7fbd2a000640 1 -- 172.21.15.120:0/3452767807 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fbd2c0ef500 con 0x7fbd341699d0 2024-04-18T04:51:33.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.133+0000 7fbd31e00640 1 --2- 172.21.15.120:0/3452767807 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fbd14066760 0x7fbd14068c20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbd240011f0 tx=0x7fbd24009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:33.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.729+0000 7fbd38e00640 1 -- 172.21.15.120:0/3452767807 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbd342076f0 con 0x7fbd341699d0 2024-04-18T04:51:33.729 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:51:33.729 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:51:24.198712+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4967,"mds_2":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:active","state_seq":31,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5130":{"gid":5130,"name":"c","rank":2,"incarnation":22,"state":"up:stopping","state_seq":23,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:51:33.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.729+0000 7fbd2a000640 1 -- 172.21.15.120:0/3452767807 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+6290 (secure 0 0 0) 0x7fbd342076f0 con 0x7fbd341699d0 2024-04-18T04:51:33.729 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 35 2024-04-18T04:51:33.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.733+0000 7fbd38e00640 1 -- 172.21.15.120:0/3452767807 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fbd14066760 msgr2=0x7fbd14068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:33.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.733+0000 7fbd38e00640 1 --2- 172.21.15.120:0/3452767807 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fbd14066760 0x7fbd14068c20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbd240011f0 tx=0x7fbd24009040 comp rx=0 tx=0).stop 2024-04-18T04:51:33.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.733+0000 7fbd38e00640 1 -- 172.21.15.120:0/3452767807 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd341699d0 msgr2=0x7fbd341627a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:33.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.733+0000 7fbd38e00640 1 --2- 172.21.15.120:0/3452767807 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd341699d0 0x7fbd341627a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c01c160 tx=0x7fbd2c01c2f0 comp rx=0 tx=0).stop 2024-04-18T04:51:33.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.733+0000 7fbd38e00640 1 -- 172.21.15.120:0/3452767807 shutdown_connections 2024-04-18T04:51:33.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.733+0000 7fbd38e00640 1 --2- 172.21.15.120:0/3452767807 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fbd14066760 0x7fbd14068c20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:33.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.733+0000 7fbd38e00640 1 --2- 172.21.15.120:0/3452767807 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd341699d0 0x7fbd341627a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:33.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.733+0000 7fbd38e00640 1 --2- 172.21.15.120:0/3452767807 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbd34163a90 0x7fbd3415d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:33.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.733+0000 7fbd38e00640 1 --2- 172.21.15.120:0/3452767807 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd3406c6d0 0x7fbd34166fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:33.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.733+0000 7fbd38e00640 1 -- 172.21.15.120:0/3452767807 >> 172.21.15.120:0/3452767807 conn(0x7fbd340c78c0 msgr2=0x7fbd340c7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:51:33.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.737+0000 7fbd38e00640 1 -- 172.21.15.120:0/3452767807 shutdown_connections 2024-04-18T04:51:33.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:33.737+0000 7fbd38e00640 1 -- 172.21.15.120:0/3452767807 wait complete. 2024-04-18T04:51:33.814 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:51:35.815 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:51:36.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.117+0000 7ffa37200640 1 Processor -- start 2024-04-18T04:51:36.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.117+0000 7ffa37200640 1 -- start start 2024-04-18T04:51:36.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.117+0000 7ffa37200640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ffa300c0bb0 0x7ffa3006c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:36.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.117+0000 7ffa37200640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa300c74f0 con 0x7ffa30155d40 2024-04-18T04:51:36.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.117+0000 7ffa37200640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa300c09c0 con 0x7ffa3014fcd0 2024-04-18T04:51:36.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.117+0000 7ffa37200640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa301500b0 con 0x7ffa300c0bb0 2024-04-18T04:51:36.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.117+0000 7ffa2fe00640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ffa3014fcd0 0x7ffa3006a750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:58470/0 (socket says 172.21.15.120:58470) 2024-04-18T04:51:36.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.117+0000 7ffa2fe00640 1 -- 172.21.15.120:0/2550718686 learned_addr learned my addr 172.21.15.120:0/2550718686 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:51:36.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.121+0000 7ffa2ea00640 1 -- 172.21.15.120:0/2550718686 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1729971340 0 0) 0x7ffa300c09c0 con 0x7ffa3014fcd0 2024-04-18T04:51:36.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.121+0000 7ffa2ea00640 1 -- 172.21.15.120:0/2550718686 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa18003450 con 0x7ffa3014fcd0 2024-04-18T04:51:36.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.121+0000 7ffa2ea00640 1 -- 172.21.15.120:0/2550718686 <== mon.1 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4280140903 0 0) 0x7ffa18003450 con 0x7ffa3014fcd0 2024-04-18T04:51:36.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.121+0000 7ffa2f400640 1 --2- 172.21.15.120:0/2550718686 >> v2:172.21.15.132:3300/0 conn(0x7ffa300c0bb0 0x7ffa3006c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:36.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.121+0000 7ffa2ea00640 1 -- 172.21.15.120:0/2550718686 >> v2:172.21.15.132:3300/0 conn(0x7ffa300c0bb0 msgr2=0x7ffa3006c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:51:36.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.121+0000 7ffa2ea00640 1 --2- 172.21.15.120:0/2550718686 >> v2:172.21.15.132:3300/0 conn(0x7ffa300c0bb0 0x7ffa3006c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:36.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.121+0000 7ffa2ea00640 1 -- 172.21.15.120:0/2550718686 >> v1:172.21.15.120:6789/0 conn(0x7ffa30155d40 legacy=0x7ffa30156190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:51:36.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.121+0000 7ffa2ea00640 1 -- 172.21.15.120:0/2550718686 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa30159ae0 con 0x7ffa3014fcd0 2024-04-18T04:51:36.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.121+0000 7ffa2ea00640 1 -- 172.21.15.120:0/2550718686 <== mon.1 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7ffa24001680 con 0x7ffa3014fcd0 2024-04-18T04:51:36.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.121+0000 7ffa2ea00640 1 -- 172.21.15.120:0/2550718686 >> v1:172.21.15.132:6789/0 conn(0x7ffa3014fcd0 legacy=0x7ffa3006a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:36.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.121+0000 7ffa2ea00640 1 --2- 172.21.15.120:0/2550718686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa18003a70 0x7ffa18003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:36.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.121+0000 7ffa2ea00640 1 --2- 172.21.15.120:0/2550718686 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa18006850 0x7ffa18008ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:36.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.121+0000 7ffa2ea00640 1 --2- 172.21.15.120:0/2550718686 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffa180094e0 0x7ffa18009990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:36.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.121+0000 7ffa2ea00640 1 -- 172.21.15.120:0/2550718686 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1800a240 con 0x7ffa18006850 2024-04-18T04:51:36.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.121+0000 7ffa2ea00640 1 -- 172.21.15.120:0/2550718686 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1800a3b0 con 0x7ffa18003a70 2024-04-18T04:51:36.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.121+0000 7ffa2ea00640 1 -- 172.21.15.120:0/2550718686 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1800a570 con 0x7ffa180094e0 2024-04-18T04:51:36.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.121+0000 7ffa2f400640 1 --2- 172.21.15.120:0/2550718686 >> v2:172.21.15.132:3300/0 conn(0x7ffa300c0bb0 0x7ffa3006c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:51:36.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.125+0000 7ffa35200640 1 --2- 172.21.15.120:0/2550718686 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffa180094e0 0x7ffa18009990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:36.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.125+0000 7ffa2fe00640 1 --2- 172.21.15.120:0/2550718686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa18003a70 0x7ffa18003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:36.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.125+0000 7ffa2f400640 1 --2- 172.21.15.120:0/2550718686 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa18006850 0x7ffa18008ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:36.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.125+0000 7ffa35200640 1 -- 172.21.15.120:0/2550718686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa18003a70 msgr2=0x7ffa18003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:51:36.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.125+0000 7ffa35200640 1 --2- 172.21.15.120:0/2550718686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa18003a70 0x7ffa18003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:36.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.125+0000 7ffa35200640 1 -- 172.21.15.120:0/2550718686 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa18006850 msgr2=0x7ffa18008ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:51:36.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.125+0000 7ffa35200640 1 --2- 172.21.15.120:0/2550718686 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa18006850 0x7ffa18008ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:36.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.125+0000 7ffa35200640 1 -- 172.21.15.120:0/2550718686 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa30159ae0 con 0x7ffa180094e0 2024-04-18T04:51:36.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.129+0000 7ffa2f400640 1 --2- 172.21.15.120:0/2550718686 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa18006850 0x7ffa18008ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:51:36.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.133+0000 7ffa35200640 1 -- 172.21.15.120:0/2550718686 reap_dead start 2024-04-18T04:51:36.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.133+0000 7ffa35200640 1 --2- 172.21.15.120:0/2550718686 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffa180094e0 0x7ffa18009990 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ffa28004530 tx=0x7ffa2801c6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=392b7e944859525e server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:36.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.133+0000 7ffa2ea00640 1 -- 172.21.15.120:0/2550718686 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa280a9610 con 0x7ffa180094e0 2024-04-18T04:51:36.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.133+0000 7ffa2ea00640 1 -- 172.21.15.120:0/2550718686 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa280a9770 con 0x7ffa180094e0 2024-04-18T04:51:36.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.133+0000 7ffa2ea00640 1 -- 172.21.15.120:0/2550718686 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa280a9b20 con 0x7ffa180094e0 2024-04-18T04:51:36.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.133+0000 7ffa37200640 1 -- 172.21.15.120:0/2550718686 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffa180094e0 msgr2=0x7ffa18009990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:36.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.133+0000 7ffa37200640 1 --2- 172.21.15.120:0/2550718686 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffa180094e0 0x7ffa18009990 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ffa28004530 tx=0x7ffa2801c6b0 comp rx=0 tx=0).stop 2024-04-18T04:51:36.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.133+0000 7ffa37200640 1 -- 172.21.15.120:0/2550718686 shutdown_connections 2024-04-18T04:51:36.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.133+0000 7ffa37200640 1 --2- 172.21.15.120:0/2550718686 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffa180094e0 0x7ffa18009990 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:36.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.133+0000 7ffa37200640 1 -- 172.21.15.120:0/2550718686 >> 172.21.15.120:0/2550718686 conn(0x7ffa3006b860 msgr2=0x7ffa3006bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:51:36.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.133+0000 7ffa37200640 1 -- 172.21.15.120:0/2550718686 shutdown_connections 2024-04-18T04:51:36.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.133+0000 7ffa37200640 1 -- 172.21.15.120:0/2550718686 wait complete. 2024-04-18T04:51:36.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.137+0000 7ffa37200640 1 Processor -- start 2024-04-18T04:51:36.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.137+0000 7ffa37200640 1 -- start start 2024-04-18T04:51:36.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.141+0000 7ffa37200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa180094e0 0x7ffa300c1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:36.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.141+0000 7ffa37200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffa30147630 0x7ffa3013e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:36.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.141+0000 7ffa37200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa30141c90 0x7ffa3013eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:36.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.141+0000 7ffa37200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa301544f0 con 0x7ffa180094e0 2024-04-18T04:51:36.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.141+0000 7ffa37200640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa30147b20 con 0x7ffa30141c90 2024-04-18T04:51:36.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.141+0000 7ffa37200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa30145b20 con 0x7ffa30147630 2024-04-18T04:51:36.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.141+0000 7ffa35200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa30141c90 0x7ffa3013eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:36.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.141+0000 7ffa35200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa30141c90 0x7ffa3013eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:40158/0 (socket says 172.21.15.120:40158) 2024-04-18T04:51:36.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.141+0000 7ffa35200640 1 -- 172.21.15.120:0/3165899065 learned_addr learned my addr 172.21.15.120:0/3165899065 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:51:36.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.141+0000 7ffa2fe00640 1 --2- 172.21.15.120:0/3165899065 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa180094e0 0x7ffa300c1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:36.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.141+0000 7ffa2f400640 1 --2- 172.21.15.120:0/3165899065 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffa30147630 0x7ffa3013e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:36.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.141+0000 7ffa2f400640 1 -- 172.21.15.120:0/3165899065 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa30141c90 msgr2=0x7ffa3013eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:36.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.141+0000 7ffa2f400640 1 --2- 172.21.15.120:0/3165899065 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa30141c90 0x7ffa3013eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:36.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.141+0000 7ffa2f400640 1 -- 172.21.15.120:0/3165899065 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa180094e0 msgr2=0x7ffa300c1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:36.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.141+0000 7ffa2f400640 1 --2- 172.21.15.120:0/3165899065 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa180094e0 0x7ffa300c1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:36.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.141+0000 7ffa2f400640 1 -- 172.21.15.120:0/3165899065 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa30145e00 con 0x7ffa30147630 2024-04-18T04:51:36.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.145+0000 7ffa2f400640 1 --2- 172.21.15.120:0/3165899065 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffa30147630 0x7ffa3013e630 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c00e610 tx=0x7ffa1c00ead0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:36.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.145+0000 7ffa23e00640 1 -- 172.21.15.120:0/3165899065 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c004020 con 0x7ffa30147630 2024-04-18T04:51:36.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.145+0000 7ffa23e00640 1 -- 172.21.15.120:0/3165899065 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa1c004180 con 0x7ffa30147630 2024-04-18T04:51:36.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.145+0000 7ffa23e00640 1 -- 172.21.15.120:0/3165899065 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c004310 con 0x7ffa30147630 2024-04-18T04:51:36.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.145+0000 7ffa37200640 1 -- 172.21.15.120:0/3165899065 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa30154110 con 0x7ffa30147630 2024-04-18T04:51:36.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.145+0000 7ffa37200640 1 -- 172.21.15.120:0/3165899065 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa3014e310 con 0x7ffa30147630 2024-04-18T04:51:36.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.149+0000 7ffa21600640 1 -- 172.21.15.120:0/3165899065 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa04005260 con 0x7ffa30147630 2024-04-18T04:51:36.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.149+0000 7ffa23e00640 1 -- 172.21.15.120:0/3165899065 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ffa1c015690 con 0x7ffa30147630 2024-04-18T04:51:36.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.149+0000 7ffa23e00640 1 --2- 172.21.15.120:0/3165899065 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ffa10066760 0x7ffa10068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:36.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.153+0000 7ffa23e00640 1 -- 172.21.15.120:0/3165899065 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7ffa1c084c10 con 0x7ffa30147630 2024-04-18T04:51:36.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.153+0000 7ffa2fe00640 1 --2- 172.21.15.120:0/3165899065 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ffa10066760 0x7ffa10068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:36.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.153+0000 7ffa2fe00640 1 --2- 172.21.15.120:0/3165899065 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ffa10066760 0x7ffa10068c20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ffa24000c10 tx=0x7ffa24009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:36.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.161+0000 7ffa23e00640 1 -- 172.21.15.120:0/3165899065 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7ffa1c051b30 con 0x7ffa30147630 2024-04-18T04:51:36.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.541+0000 7ffa21600640 1 -- 172.21.15.120:0/3165899065 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffa04005a90 con 0x7ffa30147630 2024-04-18T04:51:36.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.541+0000 7ffa23e00640 1 -- 172.21.15.120:0/3165899065 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+6290 (secure 0 0 0) 0x7ffa1c055150 con 0x7ffa30147630 2024-04-18T04:51:36.541 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:51:36.541 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:51:24.198712+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4967,"mds_2":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:active","state_seq":31,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5130":{"gid":5130,"name":"c","rank":2,"incarnation":22,"state":"up:stopping","state_seq":23,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:51:36.541 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 35 2024-04-18T04:51:36.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.553+0000 7ffa21600640 1 -- 172.21.15.120:0/3165899065 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ffa10066760 msgr2=0x7ffa10068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:36.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.553+0000 7ffa21600640 1 --2- 172.21.15.120:0/3165899065 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ffa10066760 0x7ffa10068c20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ffa24000c10 tx=0x7ffa24009040 comp rx=0 tx=0).stop 2024-04-18T04:51:36.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.553+0000 7ffa21600640 1 -- 172.21.15.120:0/3165899065 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffa30147630 msgr2=0x7ffa3013e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:36.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.553+0000 7ffa21600640 1 --2- 172.21.15.120:0/3165899065 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffa30147630 0x7ffa3013e630 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c00e610 tx=0x7ffa1c00ead0 comp rx=0 tx=0).stop 2024-04-18T04:51:36.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.557+0000 7ffa21600640 1 -- 172.21.15.120:0/3165899065 shutdown_connections 2024-04-18T04:51:36.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.557+0000 7ffa21600640 1 --2- 172.21.15.120:0/3165899065 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ffa10066760 0x7ffa10068c20 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:36.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.557+0000 7ffa21600640 1 --2- 172.21.15.120:0/3165899065 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa30141c90 0x7ffa3013eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:36.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.557+0000 7ffa21600640 1 --2- 172.21.15.120:0/3165899065 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffa30147630 0x7ffa3013e630 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:36.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.557+0000 7ffa21600640 1 --2- 172.21.15.120:0/3165899065 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa180094e0 0x7ffa300c1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:36.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.557+0000 7ffa21600640 1 -- 172.21.15.120:0/3165899065 >> 172.21.15.120:0/3165899065 conn(0x7ffa3006b860 msgr2=0x7ffa300c6770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:51:36.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.557+0000 7ffa21600640 1 -- 172.21.15.120:0/3165899065 shutdown_connections 2024-04-18T04:51:36.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:36.557+0000 7ffa21600640 1 -- 172.21.15.120:0/3165899065 wait complete. 2024-04-18T04:51:36.624 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:51:38.625 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:51:38.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.901+0000 7f29bba00640 1 Processor -- start 2024-04-18T04:51:38.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.901+0000 7f29bba00640 1 -- start start 2024-04-18T04:51:38.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.905+0000 7f29bba00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f29b4157a00 0x7f29b40c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:38.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.905+0000 7f29bba00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f29b40c0330 0x7f29b4157de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:38.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.905+0000 7f29bba00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b415e970 con 0x7f29b406b660 2024-04-18T04:51:38.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.905+0000 7f29bba00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29b4158320 con 0x7f29b40c0330 2024-04-18T04:51:38.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.905+0000 7f29bba00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b4162170 con 0x7f29b4157a00 2024-04-18T04:51:38.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.905+0000 7f29b9a00640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f29b406b660 0x7f29b406bad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:58478/0 (socket says 172.21.15.120:58478) 2024-04-18T04:51:38.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.905+0000 7f29b9a00640 1 -- 172.21.15.120:0/926604711 learned_addr learned my addr 172.21.15.120:0/926604711 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:51:38.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.905+0000 7f29b3e00640 1 -- 172.21.15.120:0/926604711 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3927978761 0 0) 0x7f29b415e970 con 0x7f29b406b660 2024-04-18T04:51:38.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.905+0000 7f29b3e00640 1 -- 172.21.15.120:0/926604711 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2998003530 con 0x7f29b406b660 2024-04-18T04:51:38.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.905+0000 7f29b3e00640 1 -- 172.21.15.120:0/926604711 <== mon.1 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2409382968 0 0) 0x7f2998003530 con 0x7f29b406b660 2024-04-18T04:51:38.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.905+0000 7f29b3e00640 1 -- 172.21.15.120:0/926604711 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f29b4157a00 msgr2=0x7f29b40c69e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-18T04:51:38.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.905+0000 7f29b3e00640 1 --2- 172.21.15.120:0/926604711 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f29b4157a00 0x7f29b40c69e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:38.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.905+0000 7f29b3e00640 1 -- 172.21.15.120:0/926604711 >> v2:172.21.15.120:3300/0 conn(0x7f29b40c0330 msgr2=0x7f29b4157de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:51:38.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.905+0000 7f29b3e00640 1 --2- 172.21.15.120:0/926604711 >> v2:172.21.15.120:3300/0 conn(0x7f29b40c0330 0x7f29b4157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:38.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.905+0000 7f29b3e00640 1 -- 172.21.15.120:0/926604711 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b40c5940 con 0x7f29b406b660 2024-04-18T04:51:38.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.905+0000 7f29b3e00640 1 -- 172.21.15.120:0/926604711 <== mon.1 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7f29ac001a00 con 0x7f29b406b660 2024-04-18T04:51:38.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.905+0000 7f29b3e00640 1 -- 172.21.15.120:0/926604711 >> v1:172.21.15.132:6789/0 conn(0x7f29b406b660 legacy=0x7f29b406bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:38.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.905+0000 7f29b3e00640 1 --2- 172.21.15.120:0/926604711 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2998003980 0x7f2998003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:38.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.905+0000 7f29b3e00640 1 --2- 172.21.15.120:0/926604711 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29980047d0 0x7f2998004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:38.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.905+0000 7f29b3e00640 1 --2- 172.21.15.120:0/926604711 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29980051e0 0x7f299800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:38.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.905+0000 7f29b3e00640 1 -- 172.21.15.120:0/926604711 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b4158320 con 0x7f29980047d0 2024-04-18T04:51:38.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.905+0000 7f29b3e00640 1 -- 172.21.15.120:0/926604711 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b4162170 con 0x7f29980051e0 2024-04-18T04:51:38.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.905+0000 7f29b3e00640 1 -- 172.21.15.120:0/926604711 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299800c170 con 0x7f2998003980 2024-04-18T04:51:38.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.909+0000 7f29b9a00640 1 --2- 172.21.15.120:0/926604711 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29980051e0 0x7f299800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:38.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.909+0000 7f29abe00640 1 --2- 172.21.15.120:0/926604711 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29980047d0 0x7f2998004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:38.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.909+0000 7f29b9a00640 1 -- 172.21.15.120:0/926604711 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2998003980 msgr2=0x7f2998003da0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-18T04:51:38.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.909+0000 7f29b9a00640 1 --2- 172.21.15.120:0/926604711 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2998003980 0x7f2998003da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:38.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.909+0000 7f29b9a00640 1 -- 172.21.15.120:0/926604711 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29980047d0 msgr2=0x7f2998004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:51:38.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.909+0000 7f29b9a00640 1 --2- 172.21.15.120:0/926604711 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29980047d0 0x7f2998004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:38.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.909+0000 7f29b9a00640 1 -- 172.21.15.120:0/926604711 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2998003530 con 0x7f29980051e0 2024-04-18T04:51:38.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.917+0000 7f29b9a00640 1 --2- 172.21.15.120:0/926604711 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29980051e0 0x7f299800b990 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f29ac00a860 tx=0x7f29ac01d360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3027bf4642864ed server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:38.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.921+0000 7f29b3e00640 1 -- 172.21.15.120:0/926604711 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac0ad630 con 0x7f29980051e0 2024-04-18T04:51:38.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.921+0000 7f29b3e00640 1 -- 172.21.15.120:0/926604711 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ac0a8070 con 0x7f29980051e0 2024-04-18T04:51:38.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.921+0000 7f29b3e00640 1 -- 172.21.15.120:0/926604711 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac0ada30 con 0x7f29980051e0 2024-04-18T04:51:38.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.921+0000 7f29bba00640 1 -- 172.21.15.120:0/926604711 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29980051e0 msgr2=0x7f299800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:38.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.921+0000 7f29bba00640 1 --2- 172.21.15.120:0/926604711 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29980051e0 0x7f299800b990 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f29ac00a860 tx=0x7f29ac01d360 comp rx=0 tx=0).stop 2024-04-18T04:51:38.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.921+0000 7f29b9a00640 1 -- 172.21.15.120:0/926604711 reap_dead start 2024-04-18T04:51:38.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.921+0000 7f29bba00640 1 -- 172.21.15.120:0/926604711 shutdown_connections 2024-04-18T04:51:38.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.921+0000 7f29bba00640 1 -- 172.21.15.120:0/926604711 >> 172.21.15.120:0/926604711 conn(0x7f29b40c78c0 msgr2=0x7f29b40c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:51:38.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.929+0000 7f29bba00640 1 -- 172.21.15.120:0/926604711 shutdown_connections 2024-04-18T04:51:38.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.929+0000 7f29bba00640 1 -- 172.21.15.120:0/926604711 wait complete. 2024-04-18T04:51:38.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.933+0000 7f29bba00640 1 Processor -- start 2024-04-18T04:51:38.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.933+0000 7f29bba00640 1 -- start start 2024-04-18T04:51:38.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.937+0000 7f29bba00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29980051e0 0x7f29b40ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:38.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.937+0000 7f29b9000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29980051e0 0x7f29b40ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:38.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.937+0000 7f29b9000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29980051e0 0x7f29b40ca3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50568/0 (socket says 172.21.15.120:50568) 2024-04-18T04:51:38.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.937+0000 7f29b9000640 1 -- 172.21.15.120:0/1436577908 learned_addr learned my addr 172.21.15.120:0/1436577908 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:51:38.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.937+0000 7f29bba00640 1 --2- 172.21.15.120:0/1436577908 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f29b4161c50 0x7f29b40c24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:38.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.937+0000 7f29bba00640 1 --2- 172.21.15.120:0/1436577908 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29b4160350 0x7f29b40c2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:38.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.937+0000 7f29abe00640 1 --2- 172.21.15.120:0/1436577908 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f29b4161c50 0x7f29b40c24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:38.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.937+0000 7f29bba00640 1 -- 172.21.15.120:0/1436577908 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b415f8e0 con 0x7f29980051e0 2024-04-18T04:51:38.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.937+0000 7f29b9a00640 1 --2- 172.21.15.120:0/1436577908 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29b4160350 0x7f29b40c2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:38.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.937+0000 7f29bba00640 1 -- 172.21.15.120:0/1436577908 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b415f150 con 0x7f29b4160350 2024-04-18T04:51:38.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.937+0000 7f29bba00640 1 -- 172.21.15.120:0/1436577908 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b4160af0 con 0x7f29b4161c50 2024-04-18T04:51:38.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.941+0000 7f29abe00640 1 -- 172.21.15.120:0/1436577908 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29b4160350 msgr2=0x7f29b40c2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:38.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.941+0000 7f29abe00640 1 --2- 172.21.15.120:0/1436577908 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29b4160350 0x7f29b40c2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:38.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.941+0000 7f29abe00640 1 -- 172.21.15.120:0/1436577908 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29980051e0 msgr2=0x7f29b40ca3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:38.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.941+0000 7f29abe00640 1 --2- 172.21.15.120:0/1436577908 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29980051e0 0x7f29b40ca3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:38.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.941+0000 7f29abe00640 1 -- 172.21.15.120:0/1436577908 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b4160dd0 con 0x7f29b4161c50 2024-04-18T04:51:38.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.941+0000 7f29abe00640 1 --2- 172.21.15.120:0/1436577908 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f29b4161c50 0x7f29b40c24f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f299c00d5a0 tx=0x7f299c00da60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:38.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.941+0000 7f29b1600640 1 -- 172.21.15.120:0/1436577908 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299c014620 con 0x7f29b4161c50 2024-04-18T04:51:38.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.941+0000 7f29b1600640 1 -- 172.21.15.120:0/1436577908 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f299c014780 con 0x7f29b4161c50 2024-04-18T04:51:38.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.941+0000 7f29b1600640 1 -- 172.21.15.120:0/1436577908 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299c014b10 con 0x7f29b4161c50 2024-04-18T04:51:38.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.945+0000 7f29bba00640 1 -- 172.21.15.120:0/1436577908 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b41610b0 con 0x7f29b4161c50 2024-04-18T04:51:38.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.945+0000 7f29bba00640 1 -- 172.21.15.120:0/1436577908 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b414ddd0 con 0x7f29b4161c50 2024-04-18T04:51:38.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.945+0000 7f29bba00640 1 -- 172.21.15.120:0/1436577908 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29b4072a70 con 0x7f29b4161c50 2024-04-18T04:51:38.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.957+0000 7f29b1600640 1 -- 172.21.15.120:0/1436577908 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f299c014c70 con 0x7f29b4161c50 2024-04-18T04:51:38.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.969+0000 7f29b1600640 1 --2- 172.21.15.120:0/1436577908 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2990066790 0x7f2990068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:38.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.969+0000 7f29b1600640 1 -- 172.21.15.120:0/1436577908 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f299c084b90 con 0x7f29b4161c50 2024-04-18T04:51:38.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.969+0000 7f29b9000640 1 --2- 172.21.15.120:0/1436577908 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2990066790 0x7f2990068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:38.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.969+0000 7f29b1600640 1 -- 172.21.15.120:0/1436577908 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f299c0afbe0 con 0x7f29b4161c50 2024-04-18T04:51:38.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:38.977+0000 7f29b9000640 1 --2- 172.21.15.120:0/1436577908 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2990066790 0x7f2990068c50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f29a4009870 tx=0x7f29a4009060 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:39.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:39.429+0000 7f29bba00640 1 -- 172.21.15.120:0/1436577908 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29b4160c30 con 0x7f29b4161c50 2024-04-18T04:51:39.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:39.433+0000 7f29b1600640 1 -- 172.21.15.120:0/1436577908 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+6290 (secure 0 0 0) 0x7f29b4160c30 con 0x7f29b4161c50 2024-04-18T04:51:39.430 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:51:39.430 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:51:24.198712+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4967,"mds_2":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:active","state_seq":31,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5130":{"gid":5130,"name":"c","rank":2,"incarnation":22,"state":"up:stopping","state_seq":23,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:51:39.431 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 35 2024-04-18T04:51:39.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:39.437+0000 7f29bba00640 1 -- 172.21.15.120:0/1436577908 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2990066790 msgr2=0x7f2990068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:39.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:39.437+0000 7f29bba00640 1 --2- 172.21.15.120:0/1436577908 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2990066790 0x7f2990068c50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f29a4009870 tx=0x7f29a4009060 comp rx=0 tx=0).stop 2024-04-18T04:51:39.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:39.437+0000 7f29bba00640 1 -- 172.21.15.120:0/1436577908 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f29b4161c50 msgr2=0x7f29b40c24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:39.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:39.437+0000 7f29bba00640 1 --2- 172.21.15.120:0/1436577908 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f29b4161c50 0x7f29b40c24f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f299c00d5a0 tx=0x7f299c00da60 comp rx=0 tx=0).stop 2024-04-18T04:51:39.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:39.437+0000 7f29bba00640 1 -- 172.21.15.120:0/1436577908 shutdown_connections 2024-04-18T04:51:39.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:39.437+0000 7f29bba00640 1 --2- 172.21.15.120:0/1436577908 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2990066790 0x7f2990068c50 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:39.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:39.437+0000 7f29bba00640 1 --2- 172.21.15.120:0/1436577908 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29b4160350 0x7f29b40c2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:39.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:39.437+0000 7f29bba00640 1 --2- 172.21.15.120:0/1436577908 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f29b4161c50 0x7f29b40c24f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:39.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:39.437+0000 7f29bba00640 1 --2- 172.21.15.120:0/1436577908 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29980051e0 0x7f29b40ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:39.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:39.437+0000 7f29bba00640 1 -- 172.21.15.120:0/1436577908 >> 172.21.15.120:0/1436577908 conn(0x7f29b40c78c0 msgr2=0x7f29b40c8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:51:39.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:39.437+0000 7f29bba00640 1 -- 172.21.15.120:0/1436577908 shutdown_connections 2024-04-18T04:51:39.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:39.437+0000 7f29bba00640 1 -- 172.21.15.120:0/1436577908 wait complete. 2024-04-18T04:51:39.485 INFO:tasks.mds_thrash.fs.[cephfs]:cluster is considered unstable while MDS are in up:stopping (!thrash_while_stopping) 2024-04-18T04:51:39.486 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 35, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-18T04:44:30.251235+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 35, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1, 2 ], "info": { "gid_4288": { "addr": "172.21.15.120:6837/76856194", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6835", "nonce": 76856194, "type": "v2" }, { "addr": "172.21.15.120:6837", "nonce": 76856194, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4288, "incarnation": 4, "join_fscid": -1, "name": "e", "rank": 0, "state": "up:active", "state_seq": 4 }, "gid_4967": { "addr": "172.21.15.132:6835/396956733", "addrs": { "addrvec": [ { "addr": "172.21.15.132:6834", "nonce": 396956733, "type": "v2" }, { "addr": "172.21.15.132:6835", "nonce": 396956733, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4967, "incarnation": 28, "join_fscid": -1, "name": "b", "rank": 1, "state": "up:active", "state_seq": 31 }, "gid_5130": { "addr": "172.21.15.120:6833/4067927368", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6832", "nonce": 4067927368, "type": "v2" }, { "addr": "172.21.15.120:6833", "nonce": 4067927368, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5130, "incarnation": 22, "join_fscid": -1, "name": "c", "rank": 2, "state": "up:stopping", "state_seq": 23 } }, "last_failure": 0, "last_failure_osd_epoch": 30, "max_file_size": 1099511627776, "max_mds": 2, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-18T04:51:24.198712+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4288, "mds_1": 4967, "mds_2": 5130 } } } ], "standbys": [ { "addr": "172.21.15.132:6839/4292136288", "addrs": { "addrvec": [ { "addr": "172.21.15.132:6836", "nonce": 4292136288, "type": "v2" }, { "addr": "172.21.15.132:6839", "nonce": 4292136288, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4241, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.132:6838/1712856922", "addrs": { "addrvec": [ { "addr": "172.21.15.132:6837", "nonce": 1712856922, "type": "v2" }, { "addr": "172.21.15.132:6838", "nonce": 1712856922, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 2, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4244, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.120:6836/2384594941", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6834", "nonce": 2384594941, "type": "v2" }, { "addr": "172.21.15.120:6836", "nonce": 2384594941, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 33, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5051, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-18T04:51:41.487 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:51:41.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.717+0000 7fb5a5a00640 1 Processor -- start 2024-04-18T04:51:41.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.717+0000 7fb5a5a00640 1 -- start start 2024-04-18T04:51:41.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.721+0000 7fb5a5a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb5a006b880 0x7fb5a0161770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:41.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.721+0000 7fb5a5a00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb5a006c680 0x7fb5a00c01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:41.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.721+0000 7fb5a5a00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5a00c57c0 con 0x7fb5a006bc60 2024-04-18T04:51:41.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.721+0000 7fb5a5a00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5a00c5a10 con 0x7fb5a006c680 2024-04-18T04:51:41.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.721+0000 7fb5a5a00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a00c5cf0 con 0x7fb5a006b880 2024-04-18T04:51:41.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.721+0000 7fb5a5000640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fb5a006bc60 0x7fb5a01576c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:51996/0 (socket says 172.21.15.120:51996) 2024-04-18T04:51:41.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.721+0000 7fb5a5000640 1 -- 172.21.15.120:0/3895490965 learned_addr learned my addr 172.21.15.120:0/3895490965 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:51:41.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.721+0000 7fb59f400640 1 --2- 172.21.15.120:0/3895490965 >> v2:172.21.15.120:3300/0 conn(0x7fb5a006c680 0x7fb5a00c01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:41.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.721+0000 7fb59fe00640 1 --2- 172.21.15.120:0/3895490965 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb5a006b880 0x7fb5a0161770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:41.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.725+0000 7fb59ea00640 1 -- 172.21.15.120:0/3895490965 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2894189611 0 0) 0x7fb5a00c57c0 con 0x7fb5a006bc60 2024-04-18T04:51:41.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.725+0000 7fb59ea00640 1 -- 172.21.15.120:0/3895490965 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb584003530 con 0x7fb5a006bc60 2024-04-18T04:51:41.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.729+0000 7fb59f400640 1 -- 172.21.15.120:0/3895490965 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb5a006b880 msgr2=0x7fb5a0161770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:51:41.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.729+0000 7fb59f400640 1 --2- 172.21.15.120:0/3895490965 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb5a006b880 0x7fb5a0161770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:41.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.729+0000 7fb59f400640 1 -- 172.21.15.120:0/3895490965 >> v1:172.21.15.132:6789/0 conn(0x7fb5a006bc60 legacy=0x7fb5a01576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:41.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.729+0000 7fb59f400640 1 -- 172.21.15.120:0/3895490965 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a00c5fd0 con 0x7fb5a006c680 2024-04-18T04:51:41.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.733+0000 7fb59f400640 1 --2- 172.21.15.120:0/3895490965 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5a006c680 0x7fb5a00c01a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb5900097c0 tx=0x7fb59001ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe3445473a93740e server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:41.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.733+0000 7fb59ea00640 1 -- 172.21.15.120:0/3895490965 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5900a8990 con 0x7fb5a006c680 2024-04-18T04:51:41.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.737+0000 7fb59ea00640 1 -- 172.21.15.120:0/3895490965 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5900a8af0 con 0x7fb5a006c680 2024-04-18T04:51:41.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.737+0000 7fb5a5a00640 1 -- 172.21.15.120:0/3895490965 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5a006c680 msgr2=0x7fb5a00c01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:41.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.737+0000 7fb5a5a00640 1 --2- 172.21.15.120:0/3895490965 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5a006c680 0x7fb5a00c01a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb5900097c0 tx=0x7fb59001ecd0 comp rx=0 tx=0).stop 2024-04-18T04:51:41.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.737+0000 7fb5a5a00640 1 -- 172.21.15.120:0/3895490965 shutdown_connections 2024-04-18T04:51:41.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.737+0000 7fb5a5a00640 1 --2- 172.21.15.120:0/3895490965 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5a006c680 0x7fb5a00c01a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:41.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.737+0000 7fb5a5a00640 1 --2- 172.21.15.120:0/3895490965 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb5a006b880 0x7fb5a0161770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:41.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.737+0000 7fb5a5a00640 1 -- 172.21.15.120:0/3895490965 >> 172.21.15.120:0/3895490965 conn(0x7fb5a006d000 msgr2=0x7fb5a006d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:51:41.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.737+0000 7fb5a5a00640 1 -- 172.21.15.120:0/3895490965 shutdown_connections 2024-04-18T04:51:41.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.737+0000 7fb5a5a00640 1 -- 172.21.15.120:0/3895490965 wait complete. 2024-04-18T04:51:41.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.745+0000 7fb5a5a00640 1 Processor -- start 2024-04-18T04:51:41.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.757+0000 7fb5a5a00640 1 -- start start 2024-04-18T04:51:41.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.761+0000 7fb5a5a00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5a006b880 0x7fb5a01f2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:41.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.761+0000 7fb5a5a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb5a006bc60 0x7fb5a01fbf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:41.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.761+0000 7fb59fe00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5a006b880 0x7fb5a01f2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:41.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.761+0000 7fb59fe00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5a006b880 0x7fb5a01f2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:49952/0 (socket says 172.21.15.120:49952) 2024-04-18T04:51:41.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.761+0000 7fb59fe00640 1 -- 172.21.15.120:0/3113529046 learned_addr learned my addr 172.21.15.120:0/3113529046 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:51:41.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.761+0000 7fb5a5a00640 1 --2- 172.21.15.120:0/3113529046 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5a006c680 0x7fb5a015f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:41.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.765+0000 7fb5a5000640 1 --2- 172.21.15.120:0/3113529046 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5a006c680 0x7fb5a015f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:41.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.765+0000 7fb59f400640 1 --2- 172.21.15.120:0/3113529046 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb5a006bc60 0x7fb5a01fbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:41.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.765+0000 7fb5a5a00640 1 -- 172.21.15.120:0/3113529046 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a015f580 con 0x7fb5a006c680 2024-04-18T04:51:41.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.765+0000 7fb5a5a00640 1 -- 172.21.15.120:0/3113529046 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a00bfe70 con 0x7fb5a006b880 2024-04-18T04:51:41.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.765+0000 7fb5a5a00640 1 -- 172.21.15.120:0/3113529046 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a01fb850 con 0x7fb5a006bc60 2024-04-18T04:51:41.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.765+0000 7fb59f400640 1 -- 172.21.15.120:0/3113529046 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5a006b880 msgr2=0x7fb5a01f2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:41.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.765+0000 7fb59f400640 1 --2- 172.21.15.120:0/3113529046 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5a006b880 0x7fb5a01f2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:41.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.765+0000 7fb59f400640 1 -- 172.21.15.120:0/3113529046 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5a006c680 msgr2=0x7fb5a015f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:41.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.765+0000 7fb59f400640 1 --2- 172.21.15.120:0/3113529046 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5a006c680 0x7fb5a015f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:41.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.765+0000 7fb59f400640 1 -- 172.21.15.120:0/3113529046 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb590009420 con 0x7fb5a006bc60 2024-04-18T04:51:41.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.769+0000 7fb59f400640 1 --2- 172.21.15.120:0/3113529046 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb5a006bc60 0x7fb5a01fbf80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb5900af000 tx=0x7fb59001ba70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:41.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.773+0000 7fb597e00640 1 -- 172.21.15.120:0/3113529046 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5900bf070 con 0x7fb5a006bc60 2024-04-18T04:51:41.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.773+0000 7fb597e00640 1 -- 172.21.15.120:0/3113529046 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5900b0b00 con 0x7fb5a006bc60 2024-04-18T04:51:41.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.773+0000 7fb597e00640 1 -- 172.21.15.120:0/3113529046 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5900b0e90 con 0x7fb5a006bc60 2024-04-18T04:51:41.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.777+0000 7fb5a5a00640 1 -- 172.21.15.120:0/3113529046 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5a00c6c30 con 0x7fb5a006bc60 2024-04-18T04:51:41.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.777+0000 7fb5a5a00640 1 -- 172.21.15.120:0/3113529046 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5a015ea20 con 0x7fb5a006bc60 2024-04-18T04:51:41.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.777+0000 7fb5a5a00640 1 -- 172.21.15.120:0/3113529046 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5a006f9f0 con 0x7fb5a006bc60 2024-04-18T04:51:41.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.781+0000 7fb597e00640 1 -- 172.21.15.120:0/3113529046 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb5900b7040 con 0x7fb5a006bc60 2024-04-18T04:51:41.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.785+0000 7fb597e00640 1 --2- 172.21.15.120:0/3113529046 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb5800666e0 0x7fb580068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:41.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.785+0000 7fb597e00640 1 -- 172.21.15.120:0/3113529046 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7fb590121680 con 0x7fb5a006bc60 2024-04-18T04:51:41.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.789+0000 7fb59fe00640 1 --2- 172.21.15.120:0/3113529046 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb5800666e0 0x7fb580068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:41.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.789+0000 7fb59fe00640 1 --2- 172.21.15.120:0/3113529046 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb5800666e0 0x7fb580068ba0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb598009a40 tx=0x7fb59800b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:41.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:41.801+0000 7fb597e00640 1 -- 172.21.15.120:0/3113529046 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fb5900ee6c0 con 0x7fb5a006bc60 2024-04-18T04:51:42.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:42.385+0000 7fb5a5a00640 1 -- 172.21.15.120:0/3113529046 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb5a00728f0 con 0x7fb5a006bc60 2024-04-18T04:51:42.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:42.385+0000 7fb597e00640 1 -- 172.21.15.120:0/3113529046 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+6290 (secure 0 0 0) 0x7fb5900f1ce0 con 0x7fb5a006bc60 2024-04-18T04:51:42.385 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:51:42.385 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:51:24.198712+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4967,"mds_2":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:active","state_seq":31,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5130":{"gid":5130,"name":"c","rank":2,"incarnation":22,"state":"up:stopping","state_seq":23,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:51:42.385 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 35 2024-04-18T04:51:42.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:42.389+0000 7fb5a5a00640 1 -- 172.21.15.120:0/3113529046 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb5800666e0 msgr2=0x7fb580068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:42.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:42.389+0000 7fb5a5a00640 1 --2- 172.21.15.120:0/3113529046 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb5800666e0 0x7fb580068ba0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb598009a40 tx=0x7fb59800b040 comp rx=0 tx=0).stop 2024-04-18T04:51:42.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:42.389+0000 7fb5a5a00640 1 -- 172.21.15.120:0/3113529046 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb5a006bc60 msgr2=0x7fb5a01fbf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:42.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:42.389+0000 7fb5a5a00640 1 --2- 172.21.15.120:0/3113529046 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb5a006bc60 0x7fb5a01fbf80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb5900af000 tx=0x7fb59001ba70 comp rx=0 tx=0).stop 2024-04-18T04:51:42.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:42.389+0000 7fb5a5a00640 1 -- 172.21.15.120:0/3113529046 shutdown_connections 2024-04-18T04:51:42.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:42.389+0000 7fb5a5a00640 1 --2- 172.21.15.120:0/3113529046 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb5800666e0 0x7fb580068ba0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:42.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:42.389+0000 7fb5a5a00640 1 --2- 172.21.15.120:0/3113529046 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5a006c680 0x7fb5a015f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:42.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:42.389+0000 7fb5a5a00640 1 --2- 172.21.15.120:0/3113529046 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb5a006bc60 0x7fb5a01fbf80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:42.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:42.389+0000 7fb5a5a00640 1 --2- 172.21.15.120:0/3113529046 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5a006b880 0x7fb5a01f2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:42.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:42.389+0000 7fb5a5a00640 1 -- 172.21.15.120:0/3113529046 >> 172.21.15.120:0/3113529046 conn(0x7fb5a006d000 msgr2=0x7fb5a0157490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:51:42.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:42.389+0000 7fb5a5a00640 1 -- 172.21.15.120:0/3113529046 shutdown_connections 2024-04-18T04:51:42.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:42.389+0000 7fb5a5a00640 1 -- 172.21.15.120:0/3113529046 wait complete. 2024-04-18T04:51:42.430 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:51:42.717 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:51:42.722 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:51:44.431 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:51:44.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.733+0000 7f7dd9400640 1 Processor -- start 2024-04-18T04:51:44.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.733+0000 7f7dd9400640 1 -- start start 2024-04-18T04:51:44.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.737+0000 7f7dd9400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7dd40bfe70 0x7f7dd4156430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:44.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.737+0000 7f7dd9400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7dd4156970 0x7f7dd40c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:44.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.737+0000 7f7dd9400640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd406f9b0 con 0x7f7dd40c7480 2024-04-18T04:51:44.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.737+0000 7f7dd9400640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd40c0520 con 0x7f7dd40bfe70 2024-04-18T04:51:44.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.737+0000 7f7dd9400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd40c0800 con 0x7f7dd4156970 2024-04-18T04:51:44.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.737+0000 7f7dd2800640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f7dd40c7480 0x7f7dd4150340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:46996/0 (socket says 172.21.15.120:46996) 2024-04-18T04:51:44.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.737+0000 7f7dd2800640 1 -- 172.21.15.120:0/3098090047 learned_addr learned my addr 172.21.15.120:0/3098090047 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:51:44.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.737+0000 7f7dd1e00640 1 --2- 172.21.15.120:0/3098090047 >> v2:172.21.15.120:3300/0 conn(0x7f7dd40bfe70 0x7f7dd4156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:44.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.737+0000 7f7dd1400640 1 -- 172.21.15.120:0/3098090047 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1263717063 0 0) 0x7f7dd406f9b0 con 0x7f7dd40c7480 2024-04-18T04:51:44.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.737+0000 7f7dd1400640 1 -- 172.21.15.120:0/3098090047 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7db8003530 con 0x7f7dd40c7480 2024-04-18T04:51:44.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.737+0000 7f7dd1400640 1 -- 172.21.15.120:0/3098090047 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1747234971 0 0) 0x7f7db8003530 con 0x7f7dd40c7480 2024-04-18T04:51:44.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.737+0000 7f7dd1400640 1 -- 172.21.15.120:0/3098090047 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7dd4156970 msgr2=0x7f7dd40c57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:51:44.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.737+0000 7f7dd1400640 1 --2- 172.21.15.120:0/3098090047 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7dd4156970 0x7f7dd40c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:44.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.737+0000 7f7dd1400640 1 -- 172.21.15.120:0/3098090047 >> v2:172.21.15.120:3300/0 conn(0x7f7dd40bfe70 msgr2=0x7f7dd4156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:51:44.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.737+0000 7f7dd1400640 1 --2- 172.21.15.120:0/3098090047 >> v2:172.21.15.120:3300/0 conn(0x7f7dd40bfe70 0x7f7dd4156430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:44.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.737+0000 7f7dd1400640 1 -- 172.21.15.120:0/3098090047 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd406fc20 con 0x7f7dd40c7480 2024-04-18T04:51:44.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.737+0000 7f7dd1400640 1 -- 172.21.15.120:0/3098090047 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7f7dc0001680 con 0x7f7dd40c7480 2024-04-18T04:51:44.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.737+0000 7f7dd1400640 1 -- 172.21.15.120:0/3098090047 >> v1:172.21.15.120:6789/0 conn(0x7f7dd40c7480 legacy=0x7f7dd4150340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:44.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.737+0000 7f7dd1400640 1 --2- 172.21.15.120:0/3098090047 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7db8003980 0x7f7db8003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:44.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.737+0000 7f7dd1400640 1 --2- 172.21.15.120:0/3098090047 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7db8004350 0x7f7db8004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:44.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.737+0000 7f7dd1400640 1 --2- 172.21.15.120:0/3098090047 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7db8005030 0x7f7db800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:44.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.737+0000 7f7dd1400640 1 -- 172.21.15.120:0/3098090047 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd40c0520 con 0x7f7db8004350 2024-04-18T04:51:44.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.737+0000 7f7dd1400640 1 -- 172.21.15.120:0/3098090047 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd40c0800 con 0x7f7db8005030 2024-04-18T04:51:44.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.737+0000 7f7dd1400640 1 -- 172.21.15.120:0/3098090047 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db800bfb0 con 0x7f7db8003980 2024-04-18T04:51:44.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.741+0000 7f7dd3200640 1 --2- 172.21.15.120:0/3098090047 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7db8005030 0x7f7db800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:44.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.741+0000 7f7dd1e00640 1 --2- 172.21.15.120:0/3098090047 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7db8004350 0x7f7db8004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:44.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.741+0000 7f7dd3200640 1 -- 172.21.15.120:0/3098090047 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7db8003980 msgr2=0x7f7db8003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:51:44.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.741+0000 7f7dd3200640 1 --2- 172.21.15.120:0/3098090047 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7db8003980 0x7f7db8003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:44.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.741+0000 7f7dd3200640 1 -- 172.21.15.120:0/3098090047 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7db8004350 msgr2=0x7f7db8004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:51:44.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.741+0000 7f7dd3200640 1 --2- 172.21.15.120:0/3098090047 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7db8004350 0x7f7db8004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:44.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.741+0000 7f7dd3200640 1 -- 172.21.15.120:0/3098090047 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db8003530 con 0x7f7db8005030 2024-04-18T04:51:44.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.745+0000 7f7dd3200640 1 --2- 172.21.15.120:0/3098090047 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7db8005030 0x7f7db800b990 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7dd406ec90 tx=0x7f7dc401c240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef0582f6699fc611 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:44.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.753+0000 7f7dd1400640 1 -- 172.21.15.120:0/3098090047 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc40ab600 con 0x7f7db8005030 2024-04-18T04:51:44.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.753+0000 7f7dd1400640 1 -- 172.21.15.120:0/3098090047 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc40a7050 con 0x7f7db8005030 2024-04-18T04:51:44.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.757+0000 7f7dd9400640 1 -- 172.21.15.120:0/3098090047 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7db8005030 msgr2=0x7f7db800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:44.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.757+0000 7f7dd9400640 1 --2- 172.21.15.120:0/3098090047 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7db8005030 0x7f7db800b990 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7dd406ec90 tx=0x7f7dc401c240 comp rx=0 tx=0).stop 2024-04-18T04:51:44.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.757+0000 7f7dd3200640 1 -- 172.21.15.120:0/3098090047 reap_dead start 2024-04-18T04:51:44.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.757+0000 7f7dd9400640 1 -- 172.21.15.120:0/3098090047 shutdown_connections 2024-04-18T04:51:44.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.757+0000 7f7dd9400640 1 -- 172.21.15.120:0/3098090047 >> 172.21.15.120:0/3098090047 conn(0x7f7dd40c78c0 msgr2=0x7f7dd40c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:51:44.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.761+0000 7f7dd9400640 1 -- 172.21.15.120:0/3098090047 shutdown_connections 2024-04-18T04:51:44.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.761+0000 7f7dd9400640 1 -- 172.21.15.120:0/3098090047 wait complete. 2024-04-18T04:51:44.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.765+0000 7f7dd9400640 1 Processor -- start 2024-04-18T04:51:44.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.765+0000 7f7dd9400640 1 -- start start 2024-04-18T04:51:44.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.765+0000 7f7dd9400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7dd414b8a0 0x7f7dd41fc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:44.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.765+0000 7f7dd9400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7dd414bc80 0x7f7dd41556f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:44.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.765+0000 7f7dd9400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7dd41563f0 0x7f7dd4155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:44.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.765+0000 7f7dd9400640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd41552d0 con 0x7f7dd414b8a0 2024-04-18T04:51:44.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.765+0000 7f7dd9400640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd41fca90 con 0x7f7dd414bc80 2024-04-18T04:51:44.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.765+0000 7f7dd9400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd41543b0 con 0x7f7dd41563f0 2024-04-18T04:51:44.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.765+0000 7f7dd3200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7dd41563f0 0x7f7dd4155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:44.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.765+0000 7f7dd3200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7dd41563f0 0x7f7dd4155c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:42512/0 (socket says 172.21.15.120:42512) 2024-04-18T04:51:44.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.765+0000 7f7dd3200640 1 -- 172.21.15.120:0/4001671249 learned_addr learned my addr 172.21.15.120:0/4001671249 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:51:44.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.769+0000 7f7dd3200640 1 -- 172.21.15.120:0/4001671249 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7dd414bc80 msgr2=0x7f7dd41556f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-18T04:51:44.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.769+0000 7f7dd3200640 1 --2- 172.21.15.120:0/4001671249 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7dd414bc80 0x7f7dd41556f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:44.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.769+0000 7f7dd3200640 1 -- 172.21.15.120:0/4001671249 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7dd414b8a0 msgr2=0x7f7dd41fc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:44.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.769+0000 7f7dd3200640 1 --2- 172.21.15.120:0/4001671249 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7dd414b8a0 0x7f7dd41fc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:44.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.769+0000 7f7dd3200640 1 -- 172.21.15.120:0/4001671249 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd40c0f60 con 0x7f7dd41563f0 2024-04-18T04:51:44.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.773+0000 7f7dd3200640 1 --2- 172.21.15.120:0/4001671249 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7dd41563f0 0x7f7dd4155c30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4097c50 tx=0x7f7dc4018fe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:44.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.773+0000 7f7dcaa00640 1 -- 172.21.15.120:0/4001671249 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc40b7860 con 0x7f7dd41563f0 2024-04-18T04:51:44.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.773+0000 7f7dcaa00640 1 -- 172.21.15.120:0/4001671249 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc40b79c0 con 0x7f7dd41563f0 2024-04-18T04:51:44.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.773+0000 7f7dcaa00640 1 -- 172.21.15.120:0/4001671249 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc40b7d30 con 0x7f7dd41563f0 2024-04-18T04:51:44.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.777+0000 7f7dd9400640 1 -- 172.21.15.120:0/4001671249 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd4154650 con 0x7f7dd41563f0 2024-04-18T04:51:44.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.777+0000 7f7dd9400640 1 -- 172.21.15.120:0/4001671249 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd4154c10 con 0x7f7dd41563f0 2024-04-18T04:51:44.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.777+0000 7f7dcaa00640 1 -- 172.21.15.120:0/4001671249 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7dc40b5400 con 0x7f7dd41563f0 2024-04-18T04:51:44.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.781+0000 7f7dd9400640 1 -- 172.21.15.120:0/4001671249 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dd40726d0 con 0x7f7dd41563f0 2024-04-18T04:51:44.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.781+0000 7f7dcaa00640 1 --2- 172.21.15.120:0/4001671249 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7db4066790 0x7f7db4068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:44.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.781+0000 7f7dcaa00640 1 -- 172.21.15.120:0/4001671249 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f7dc411e220 con 0x7f7dd41563f0 2024-04-18T04:51:44.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.785+0000 7f7dd2800640 1 --2- 172.21.15.120:0/4001671249 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7db4066790 0x7f7db4068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:44.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.785+0000 7f7dd2800640 1 --2- 172.21.15.120:0/4001671249 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7db4066790 0x7f7db4068c50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0007ad0 tx=0x7f7dc00019e0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:44.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:44.793+0000 7f7dcaa00640 1 -- 172.21.15.120:0/4001671249 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f7dc40eb040 con 0x7f7dd41563f0 2024-04-18T04:51:45.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:45.273+0000 7f7dd9400640 1 -- 172.21.15.120:0/4001671249 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7dd4073e10 con 0x7f7dd41563f0 2024-04-18T04:51:45.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:45.273+0000 7f7dcaa00640 1 -- 172.21.15.120:0/4001671249 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+6290 (secure 0 0 0) 0x7f7dc40b0020 con 0x7f7dd41563f0 2024-04-18T04:51:45.275 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:51:45.275 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:51:24.198712+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4967,"mds_2":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:active","state_seq":31,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5130":{"gid":5130,"name":"c","rank":2,"incarnation":22,"state":"up:stopping","state_seq":23,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:51:45.276 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 35 2024-04-18T04:51:45.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:45.277+0000 7f7dbfe00640 1 -- 172.21.15.120:0/4001671249 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7db4066790 msgr2=0x7f7db4068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:45.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:45.277+0000 7f7dbfe00640 1 --2- 172.21.15.120:0/4001671249 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7db4066790 0x7f7db4068c50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0007ad0 tx=0x7f7dc00019e0 comp rx=0 tx=0).stop 2024-04-18T04:51:45.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:45.277+0000 7f7dbfe00640 1 -- 172.21.15.120:0/4001671249 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7dd41563f0 msgr2=0x7f7dd4155c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:45.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:45.277+0000 7f7dbfe00640 1 --2- 172.21.15.120:0/4001671249 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7dd41563f0 0x7f7dd4155c30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4097c50 tx=0x7f7dc4018fe0 comp rx=0 tx=0).stop 2024-04-18T04:51:45.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:45.277+0000 7f7dbfe00640 1 -- 172.21.15.120:0/4001671249 shutdown_connections 2024-04-18T04:51:45.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:45.277+0000 7f7dbfe00640 1 --2- 172.21.15.120:0/4001671249 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7db4066790 0x7f7db4068c50 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:45.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:45.277+0000 7f7dbfe00640 1 --2- 172.21.15.120:0/4001671249 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7dd41563f0 0x7f7dd4155c30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:45.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:45.277+0000 7f7dbfe00640 1 --2- 172.21.15.120:0/4001671249 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7dd414bc80 0x7f7dd41556f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:45.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:45.277+0000 7f7dbfe00640 1 --2- 172.21.15.120:0/4001671249 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7dd414b8a0 0x7f7dd41fc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:45.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:45.277+0000 7f7dbfe00640 1 -- 172.21.15.120:0/4001671249 >> 172.21.15.120:0/4001671249 conn(0x7f7dd40c78c0 msgr2=0x7f7dd406cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:51:45.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:45.281+0000 7f7dbfe00640 1 -- 172.21.15.120:0/4001671249 shutdown_connections 2024-04-18T04:51:45.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:45.285+0000 7f7dbfe00640 1 -- 172.21.15.120:0/4001671249 wait complete. 2024-04-18T04:51:45.330 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:51:47.332 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:51:47.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.713+0000 7f2120600640 1 Processor -- start 2024-04-18T04:51:47.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.713+0000 7f2120600640 1 -- start start 2024-04-18T04:51:47.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.717+0000 7f2120600640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f21181573c0 0x7f211806fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:47.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.717+0000 7f2120600640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21181577d0 con 0x7f21180ccee0 2024-04-18T04:51:47.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.717+0000 7f2120600640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2118157a50 con 0x7f21181515e0 2024-04-18T04:51:47.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.717+0000 7f2120600640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21180c3120 con 0x7f21181573c0 2024-04-18T04:51:47.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.717+0000 7f211dc00640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f21181515e0 0x7f21180ca280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:52010/0 (socket says 172.21.15.120:52010) 2024-04-18T04:51:47.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.717+0000 7f211dc00640 1 -- 172.21.15.120:0/561579115 learned_addr learned my addr 172.21.15.120:0/561579115 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:51:47.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.717+0000 7f211d200640 1 --2- 172.21.15.120:0/561579115 >> v2:172.21.15.120:3300/0 conn(0x7f21181573c0 0x7f211806fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:47.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.717+0000 7f211d200640 1 -- 172.21.15.120:0/561579115 >> v1:172.21.15.132:6789/0 conn(0x7f21181515e0 legacy=0x7f21180ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:47.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.717+0000 7f211d200640 1 -- 172.21.15.120:0/561579115 >> v1:172.21.15.120:6789/0 conn(0x7f21180ccee0 legacy=0x7f2118161d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:47.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.717+0000 7f211d200640 1 -- 172.21.15.120:0/561579115 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2118157d10 con 0x7f21181573c0 2024-04-18T04:51:47.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.725+0000 7f211d200640 1 --2- 172.21.15.120:0/561579115 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f21181573c0 0x7f211806fd00 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2118157c40 tx=0x7f210401c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e523bd53865668 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:47.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.725+0000 7f2117e00640 1 -- 172.21.15.120:0/561579115 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21040ac600 con 0x7f21181573c0 2024-04-18T04:51:47.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.725+0000 7f2117e00640 1 -- 172.21.15.120:0/561579115 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21040a8050 con 0x7f21181573c0 2024-04-18T04:51:47.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.725+0000 7f2117e00640 1 -- 172.21.15.120:0/561579115 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21040ac980 con 0x7f21181573c0 2024-04-18T04:51:47.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.725+0000 7f2120600640 1 -- 172.21.15.120:0/561579115 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f21181573c0 msgr2=0x7f211806fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:47.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.725+0000 7f2120600640 1 --2- 172.21.15.120:0/561579115 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f21181573c0 0x7f211806fd00 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2118157c40 tx=0x7f210401c340 comp rx=0 tx=0).stop 2024-04-18T04:51:47.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.725+0000 7f2120600640 1 -- 172.21.15.120:0/561579115 shutdown_connections 2024-04-18T04:51:47.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.725+0000 7f2120600640 1 --2- 172.21.15.120:0/561579115 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f21181573c0 0x7f211806fd00 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:47.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.725+0000 7f2120600640 1 -- 172.21.15.120:0/561579115 >> 172.21.15.120:0/561579115 conn(0x7f211806e0f0 msgr2=0x7f2118071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:51:47.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.725+0000 7f2120600640 1 -- 172.21.15.120:0/561579115 shutdown_connections 2024-04-18T04:51:47.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.725+0000 7f2120600640 1 -- 172.21.15.120:0/561579115 wait complete. 2024-04-18T04:51:47.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.729+0000 7f2120600640 1 Processor -- start 2024-04-18T04:51:47.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.729+0000 7f2120600640 1 -- start start 2024-04-18T04:51:47.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.729+0000 7f2120600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f21180ccee0 0x7f211815a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:47.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.729+0000 7f2120600640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f21181515e0 0x7f21180c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:47.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.729+0000 7f2120600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f21181573c0 0x7f21181f0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:47.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.729+0000 7f2120600640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211815b1c0 con 0x7f21180ccee0 2024-04-18T04:51:47.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.729+0000 7f2120600640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211815acc0 con 0x7f21181515e0 2024-04-18T04:51:47.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.729+0000 7f2120600640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2118158720 con 0x7f21181573c0 2024-04-18T04:51:47.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.733+0000 7f211e600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f21181573c0 0x7f21181f0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:47.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.733+0000 7f211e600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f21181573c0 0x7f21181f0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:42528/0 (socket says 172.21.15.120:42528) 2024-04-18T04:51:47.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.733+0000 7f211e600640 1 -- 172.21.15.120:0/3422970146 learned_addr learned my addr 172.21.15.120:0/3422970146 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:51:47.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.733+0000 7f211dc00640 1 --2- 172.21.15.120:0/3422970146 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f21180ccee0 0x7f211815a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:47.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.733+0000 7f211d200640 1 --2- 172.21.15.120:0/3422970146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f21181515e0 0x7f21180c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:47.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.733+0000 7f211dc00640 1 -- 172.21.15.120:0/3422970146 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f21181573c0 msgr2=0x7f21181f0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:47.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.733+0000 7f211dc00640 1 --2- 172.21.15.120:0/3422970146 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f21181573c0 0x7f21181f0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:47.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.733+0000 7f211dc00640 1 -- 172.21.15.120:0/3422970146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f21181515e0 msgr2=0x7f21180c7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:47.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.733+0000 7f211dc00640 1 --2- 172.21.15.120:0/3422970146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f21181515e0 0x7f21180c7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:47.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.733+0000 7f211dc00640 1 -- 172.21.15.120:0/3422970146 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2104009420 con 0x7f21180ccee0 2024-04-18T04:51:47.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.733+0000 7f211dc00640 1 --2- 172.21.15.120:0/3422970146 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f21180ccee0 0x7f211815a780 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f210c009e30 tx=0x7f210c00c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:47.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.733+0000 7f2115600640 1 -- 172.21.15.120:0/3422970146 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c0078f0 con 0x7f21180ccee0 2024-04-18T04:51:47.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.733+0000 7f2115600640 1 -- 172.21.15.120:0/3422970146 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210c007a50 con 0x7f21180ccee0 2024-04-18T04:51:47.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.733+0000 7f2115600640 1 -- 172.21.15.120:0/3422970146 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c007dc0 con 0x7f21180ccee0 2024-04-18T04:51:47.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.733+0000 7f2120600640 1 -- 172.21.15.120:0/3422970146 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f211815a0a0 con 0x7f21180ccee0 2024-04-18T04:51:47.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.733+0000 7f2120600640 1 -- 172.21.15.120:0/3422970146 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f211815aee0 con 0x7f21180ccee0 2024-04-18T04:51:47.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.737+0000 7f2120600640 1 -- 172.21.15.120:0/3422970146 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2118072a70 con 0x7f21180ccee0 2024-04-18T04:51:47.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.737+0000 7f2115600640 1 -- 172.21.15.120:0/3422970146 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f210c009070 con 0x7f21180ccee0 2024-04-18T04:51:47.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.737+0000 7f2115600640 1 --2- 172.21.15.120:0/3422970146 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f20f80666c0 0x7f20f8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:47.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.737+0000 7f2115600640 1 -- 172.21.15.120:0/3422970146 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f210c086c10 con 0x7f21180ccee0 2024-04-18T04:51:47.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.745+0000 7f211d200640 1 --2- 172.21.15.120:0/3422970146 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f20f80666c0 0x7f20f8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:47.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.745+0000 7f2115600640 1 -- 172.21.15.120:0/3422970146 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f210c053990 con 0x7f21180ccee0 2024-04-18T04:51:47.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:47.745+0000 7f211d200640 1 --2- 172.21.15.120:0/3422970146 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f20f80666c0 0x7f20f8068b80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f21040ae000 tx=0x7f21040a7000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:48.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:48.165+0000 7f2120600640 1 -- 172.21.15.120:0/3422970146 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f21180c9b70 con 0x7f21180ccee0 2024-04-18T04:51:48.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:48.173+0000 7f2115600640 1 -- 172.21.15.120:0/3422970146 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+6290 (secure 0 0 0) 0x7f210c056fb0 con 0x7f21180ccee0 2024-04-18T04:51:48.177 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:51:48.177 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:51:24.198712+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1,2],"up":{"mds_0":4288,"mds_1":4967,"mds_2":5130},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:active","state_seq":31,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5130":{"gid":5130,"name":"c","rank":2,"incarnation":22,"state":"up:stopping","state_seq":23,"addr":"172.21.15.120:6833/4067927368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4067927368},{"type":"v1","addr":"172.21.15.120:6833","nonce":4067927368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:51:48.177 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 35 2024-04-18T04:51:48.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:48.181+0000 7f2120600640 1 -- 172.21.15.120:0/3422970146 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f20f80666c0 msgr2=0x7f20f8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:48.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:48.181+0000 7f2120600640 1 --2- 172.21.15.120:0/3422970146 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f20f80666c0 0x7f20f8068b80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f21040ae000 tx=0x7f21040a7000 comp rx=0 tx=0).stop 2024-04-18T04:51:48.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:48.181+0000 7f2120600640 1 -- 172.21.15.120:0/3422970146 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f21180ccee0 msgr2=0x7f211815a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:48.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:48.181+0000 7f2120600640 1 --2- 172.21.15.120:0/3422970146 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f21180ccee0 0x7f211815a780 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f210c009e30 tx=0x7f210c00c430 comp rx=0 tx=0).stop 2024-04-18T04:51:48.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:48.185+0000 7f2120600640 1 -- 172.21.15.120:0/3422970146 shutdown_connections 2024-04-18T04:51:48.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:48.185+0000 7f2120600640 1 --2- 172.21.15.120:0/3422970146 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f20f80666c0 0x7f20f8068b80 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:48.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:48.185+0000 7f2120600640 1 --2- 172.21.15.120:0/3422970146 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f21181573c0 0x7f21181f0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:48.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:48.185+0000 7f2120600640 1 --2- 172.21.15.120:0/3422970146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f21181515e0 0x7f21180c7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:48.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:48.185+0000 7f2120600640 1 --2- 172.21.15.120:0/3422970146 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f21180ccee0 0x7f211815a780 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:48.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:48.185+0000 7f2120600640 1 -- 172.21.15.120:0/3422970146 >> 172.21.15.120:0/3422970146 conn(0x7f211806e0f0 msgr2=0x7f21180ca010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:51:48.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:48.197+0000 7f2120600640 1 -- 172.21.15.120:0/3422970146 shutdown_connections 2024-04-18T04:51:48.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:48.197+0000 7f2120600640 1 -- 172.21.15.120:0/3422970146 wait complete. 2024-04-18T04:51:48.271 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:51:50.272 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:51:50.463 INFO:tasks.ceph.mds.c.smithi120.stdout:starting mds.c at 2024-04-18T04:51:50.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.657+0000 7f59a3200640 1 Processor -- start 2024-04-18T04:51:50.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.657+0000 7f59a3200640 1 -- start start 2024-04-18T04:51:50.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.661+0000 7f59a3200640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f59a41512a0 0x7f59a40c1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:50.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.661+0000 7f59a3200640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59a415add0 con 0x7f59a4157f80 2024-04-18T04:51:50.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.661+0000 7f59a3200640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59a406e170 con 0x7f59a415a980 2024-04-18T04:51:50.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.661+0000 7f59a3200640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59a41583c0 con 0x7f59a41512a0 2024-04-18T04:51:50.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.661+0000 7f59a1400640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f59a4157f80 0x7f59a406e5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:47034/0 (socket says 172.21.15.120:47034) 2024-04-18T04:51:50.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.665+0000 7f59a1400640 1 -- 172.21.15.120:0/768781193 learned_addr learned my addr 172.21.15.120:0/768781193 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:51:50.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.665+0000 7f59a1e00640 1 --2- 172.21.15.120:0/768781193 >> v2:172.21.15.132:3300/0 conn(0x7f59a41512a0 0x7f59a40c1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:50.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.665+0000 7f59a0a00640 1 -- 172.21.15.120:0/768781193 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 406212554 0 0) 0x7f59a406e170 con 0x7f59a415a980 2024-04-18T04:51:50.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.665+0000 7f59a0a00640 1 -- 172.21.15.120:0/768781193 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5988003530 con 0x7f59a415a980 2024-04-18T04:51:50.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.665+0000 7f59a0a00640 1 -- 172.21.15.120:0/768781193 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1162567628 0 0) 0x7f5990001050 con 0x7f59a4157f80 2024-04-18T04:51:50.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.665+0000 7f59a0a00640 1 -- 172.21.15.120:0/768781193 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59a406e170 con 0x7f59a4157f80 2024-04-18T04:51:50.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.665+0000 7f59a1e00640 1 -- 172.21.15.120:0/768781193 >> v1:172.21.15.132:6789/0 conn(0x7f59a415a980 legacy=0x7f59a40cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:50.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.665+0000 7f59a1e00640 1 -- 172.21.15.120:0/768781193 >> v1:172.21.15.120:6789/0 conn(0x7f59a4157f80 legacy=0x7f59a406e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:50.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.665+0000 7f59a1e00640 1 -- 172.21.15.120:0/768781193 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a406dbb0 con 0x7f59a41512a0 2024-04-18T04:51:50.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.673+0000 7f59a1e00640 1 --2- 172.21.15.120:0/768781193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59a41512a0 0x7f59a40c1f70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5994009740 tx=0x7f599401c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c2a90a9ec57ffe server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:50.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.673+0000 7f59a0a00640 1 -- 172.21.15.120:0/768781193 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5990001640 con 0x7f59a41512a0 2024-04-18T04:51:50.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.673+0000 7f59a0a00640 1 -- 172.21.15.120:0/768781193 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59940a7050 con 0x7f59a41512a0 2024-04-18T04:51:50.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.673+0000 7f59a0a00640 1 -- 172.21.15.120:0/768781193 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599c001a00 con 0x7f59a41512a0 2024-04-18T04:51:50.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.677+0000 7f59a3200640 1 -- 172.21.15.120:0/768781193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59a41512a0 msgr2=0x7f59a40c1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:50.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.677+0000 7f59a3200640 1 --2- 172.21.15.120:0/768781193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59a41512a0 0x7f59a40c1f70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5994009740 tx=0x7f599401c2d0 comp rx=0 tx=0).stop 2024-04-18T04:51:50.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.677+0000 7f59a3200640 1 -- 172.21.15.120:0/768781193 shutdown_connections 2024-04-18T04:51:50.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.677+0000 7f59a3200640 1 --2- 172.21.15.120:0/768781193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59a41512a0 0x7f59a40c1f70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:50.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.677+0000 7f59a3200640 1 -- 172.21.15.120:0/768781193 >> 172.21.15.120:0/768781193 conn(0x7f59a4071cf0 msgr2=0x7f59a4072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:51:50.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.677+0000 7f59a3200640 1 -- 172.21.15.120:0/768781193 shutdown_connections 2024-04-18T04:51:50.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.677+0000 7f59a3200640 1 -- 172.21.15.120:0/768781193 wait complete. 2024-04-18T04:51:50.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.685+0000 7f59a3200640 1 Processor -- start 2024-04-18T04:51:50.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.685+0000 7f59a3200640 1 -- start start 2024-04-18T04:51:50.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.701+0000 7f59a3200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59a41512a0 0x7f59a413eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:50.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.701+0000 7f59a3200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59a4157f80 0x7f59a41465e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:50.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.701+0000 7f59a3200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59a415a980 0x7f59a413f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:50.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.701+0000 7f59a3200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a41ef520 con 0x7f59a415a980 2024-04-18T04:51:50.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.701+0000 7f59a3200640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a41f04b0 con 0x7f59a4157f80 2024-04-18T04:51:50.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.701+0000 7f59a3200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a41f3a00 con 0x7f59a41512a0 2024-04-18T04:51:50.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.701+0000 7f59a1e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59a41512a0 0x7f59a413eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:50.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.705+0000 7f59a1e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59a41512a0 0x7f59a413eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:42550/0 (socket says 172.21.15.120:42550) 2024-04-18T04:51:50.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.705+0000 7f59a1e00640 1 -- 172.21.15.120:0/88839922 learned_addr learned my addr 172.21.15.120:0/88839922 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:51:50.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.705+0000 7f59a1400640 1 --2- 172.21.15.120:0/88839922 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59a4157f80 0x7f59a41465e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:50.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.705+0000 7f59a2800640 1 --2- 172.21.15.120:0/88839922 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59a415a980 0x7f59a413f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:50.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.705+0000 7f59a1e00640 1 -- 172.21.15.120:0/88839922 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59a4157f80 msgr2=0x7f59a41465e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:50.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.705+0000 7f59a1e00640 1 --2- 172.21.15.120:0/88839922 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59a4157f80 0x7f59a41465e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:50.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.705+0000 7f59a1e00640 1 -- 172.21.15.120:0/88839922 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59a415a980 msgr2=0x7f59a413f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:50.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.705+0000 7f59a1e00640 1 --2- 172.21.15.120:0/88839922 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59a415a980 0x7f59a413f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:50.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.705+0000 7f59a1e00640 1 -- 172.21.15.120:0/88839922 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5994009420 con 0x7f59a41512a0 2024-04-18T04:51:50.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.705+0000 7f59a1e00640 1 --2- 172.21.15.120:0/88839922 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59a41512a0 0x7f59a413eb60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5994019f00 tx=0x7f599401ab10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:50.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.709+0000 7f599a000640 1 -- 172.21.15.120:0/88839922 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59940b7650 con 0x7f59a41512a0 2024-04-18T04:51:50.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.709+0000 7f599a000640 1 -- 172.21.15.120:0/88839922 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59940b77b0 con 0x7f59a41512a0 2024-04-18T04:51:50.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.709+0000 7f599a000640 1 -- 172.21.15.120:0/88839922 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59940b7b60 con 0x7f59a41512a0 2024-04-18T04:51:50.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.709+0000 7f59a3200640 1 -- 172.21.15.120:0/88839922 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59a41f0020 con 0x7f59a41512a0 2024-04-18T04:51:50.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.709+0000 7f59a3200640 1 -- 172.21.15.120:0/88839922 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59a4144a20 con 0x7f59a41512a0 2024-04-18T04:51:50.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.717+0000 7f599a000640 1 -- 172.21.15.120:0/88839922 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f59940b7cc0 con 0x7f59a41512a0 2024-04-18T04:51:50.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.721+0000 7f599a000640 1 --2- 172.21.15.120:0/88839922 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f59840666e0 0x7f5984068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:50.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.721+0000 7f599a000640 1 -- 172.21.15.120:0/88839922 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f599411ee50 con 0x7f59a41512a0 2024-04-18T04:51:50.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.721+0000 7f598f400640 1 -- 172.21.15.120:0/88839922 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59a4067070 con 0x7f59a41512a0 2024-04-18T04:51:50.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.721+0000 7f59a1400640 1 --2- 172.21.15.120:0/88839922 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f59840666e0 0x7f5984068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:50.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.725+0000 7f59a1400640 1 --2- 172.21.15.120:0/88839922 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f59840666e0 0x7f5984068ba0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5990001830 tx=0x7f5990001620 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:50.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:50.733+0000 7f599a000640 1 -- 172.21.15.120:0/88839922 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f59940bb080 con 0x7f59a41512a0 2024-04-18T04:51:51.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.197+0000 7f598f400640 1 -- 172.21.15.120:0/88839922 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f59a40c82e0 con 0x7f59a41512a0 2024-04-18T04:51:51.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.201+0000 7f599a000640 1 -- 172.21.15.120:0/88839922 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+5514 (secure 0 0 0) 0x7f59940b0030 con 0x7f59a41512a0 2024-04-18T04:51:51.198 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:51:51.198 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:51:50.163765+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":4288,"mds_1":4967},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:active","state_seq":31,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:51:51.199 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 36 2024-04-18T04:51:51.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.205+0000 7f598f400640 1 -- 172.21.15.120:0/88839922 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f59840666e0 msgr2=0x7f5984068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:51.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.205+0000 7f598f400640 1 --2- 172.21.15.120:0/88839922 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f59840666e0 0x7f5984068ba0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5990001830 tx=0x7f5990001620 comp rx=0 tx=0).stop 2024-04-18T04:51:51.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.205+0000 7f598f400640 1 -- 172.21.15.120:0/88839922 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59a41512a0 msgr2=0x7f59a413eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:51.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.205+0000 7f598f400640 1 --2- 172.21.15.120:0/88839922 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59a41512a0 0x7f59a413eb60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5994019f00 tx=0x7f599401ab10 comp rx=0 tx=0).stop 2024-04-18T04:51:51.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.205+0000 7f598f400640 1 -- 172.21.15.120:0/88839922 shutdown_connections 2024-04-18T04:51:51.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.205+0000 7f598f400640 1 --2- 172.21.15.120:0/88839922 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f59840666e0 0x7f5984068ba0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:51.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.205+0000 7f598f400640 1 --2- 172.21.15.120:0/88839922 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59a415a980 0x7f59a413f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:51.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.205+0000 7f598f400640 1 --2- 172.21.15.120:0/88839922 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59a4157f80 0x7f59a41465e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:51.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.205+0000 7f598f400640 1 --2- 172.21.15.120:0/88839922 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59a41512a0 0x7f59a413eb60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:51.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.205+0000 7f598f400640 1 -- 172.21.15.120:0/88839922 >> 172.21.15.120:0/88839922 conn(0x7f59a4071cf0 msgr2=0x7f59a406f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:51:51.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.205+0000 7f598f400640 1 -- 172.21.15.120:0/88839922 shutdown_connections 2024-04-18T04:51:51.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.205+0000 7f598f400640 1 -- 172.21.15.120:0/88839922 wait complete. 2024-04-18T04:51:51.243 INFO:tasks.mds_thrash.fs.[cephfs]:mds cluster has 2 alive and active, now stable! 2024-04-18T04:51:51.243 INFO:tasks.mds_thrash.fs.[cephfs]:kill mds.e (rank=0) 2024-04-18T04:51:51.244 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-04-18T04:51:51.244 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T04:51:51.276 INFO:tasks.ceph.mds.e:Stopped 2024-04-18T04:51:51.276 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:51:51.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.569+0000 7f941e000640 1 Processor -- start 2024-04-18T04:51:51.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.569+0000 7f941e000640 1 -- start start 2024-04-18T04:51:51.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.573+0000 7f941e000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9418155c80 0x7f9418070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:51.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.573+0000 7f941e000640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94180c6190 con 0x7f94180c71c0 2024-04-18T04:51:51.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.573+0000 7f941e000640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9418156170 con 0x7f94180c6de0 2024-04-18T04:51:51.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.573+0000 7f941e000640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9418070ff0 con 0x7f9418155c80 2024-04-18T04:51:51.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.573+0000 7f9417e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9418155c80 0x7f9418070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:51.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.573+0000 7f941d600640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f94180c71c0 0x7f941814f290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:41540/0 (socket says 172.21.15.120:41540) 2024-04-18T04:51:51.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.573+0000 7f941d600640 1 -- 172.21.15.120:0/1496762694 learned_addr learned my addr 172.21.15.120:0/1496762694 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:51:51.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.573+0000 7f941cc00640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f94180c6de0 0x7f9418155570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:51814/0 (socket says 172.21.15.120:51814) 2024-04-18T04:51:51.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.573+0000 7f9417e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9418155c80 0x7f9418070ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:51948/0 (socket says 172.21.15.120:51948) 2024-04-18T04:51:51.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.577+0000 7f9417400640 1 -- 172.21.15.120:0/1496762694 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2297282745 0 0) 0x7f9418156170 con 0x7f94180c6de0 2024-04-18T04:51:51.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.577+0000 7f9417400640 1 -- 172.21.15.120:0/1496762694 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9400003450 con 0x7f94180c6de0 2024-04-18T04:51:51.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.577+0000 7f9417e00640 1 -- 172.21.15.120:0/1496762694 >> v1:172.21.15.132:6789/0 conn(0x7f94180c6de0 legacy=0x7f9418155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:51.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.577+0000 7f9417e00640 1 -- 172.21.15.120:0/1496762694 >> v1:172.21.15.120:6789/0 conn(0x7f94180c71c0 legacy=0x7f941814f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:51.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.577+0000 7f9417e00640 1 -- 172.21.15.120:0/1496762694 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94180c5860 con 0x7f9418155c80 2024-04-18T04:51:51.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.577+0000 7f9417e00640 1 --2- 172.21.15.120:0/1496762694 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9418155c80 0x7f9418070ab0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f94080090e0 tx=0x7f940801c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4084348e4d4e606 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:51.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.581+0000 7f9417400640 1 -- 172.21.15.120:0/1496762694 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94080ac600 con 0x7f9418155c80 2024-04-18T04:51:51.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.581+0000 7f9417400640 1 -- 172.21.15.120:0/1496762694 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94080a8050 con 0x7f9418155c80 2024-04-18T04:51:51.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.581+0000 7f9417400640 1 -- 172.21.15.120:0/1496762694 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94080ac980 con 0x7f9418155c80 2024-04-18T04:51:51.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.581+0000 7f941e000640 1 -- 172.21.15.120:0/1496762694 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9418155c80 msgr2=0x7f9418070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:51.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.581+0000 7f941e000640 1 --2- 172.21.15.120:0/1496762694 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9418155c80 0x7f9418070ab0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f94080090e0 tx=0x7f940801c400 comp rx=0 tx=0).stop 2024-04-18T04:51:51.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.581+0000 7f941e000640 1 -- 172.21.15.120:0/1496762694 shutdown_connections 2024-04-18T04:51:51.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.581+0000 7f941e000640 1 --2- 172.21.15.120:0/1496762694 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9418155c80 0x7f9418070ab0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:51.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.585+0000 7f941e000640 1 -- 172.21.15.120:0/1496762694 >> 172.21.15.120:0/1496762694 conn(0x7f941806cf90 msgr2=0x7f941806d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:51:51.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.585+0000 7f941e000640 1 -- 172.21.15.120:0/1496762694 shutdown_connections 2024-04-18T04:51:51.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.589+0000 7f941e000640 1 -- 172.21.15.120:0/1496762694 wait complete. 2024-04-18T04:51:51.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.593+0000 7f941e000640 1 Processor -- start 2024-04-18T04:51:51.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.597+0000 7f941e000640 1 -- start start 2024-04-18T04:51:51.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.597+0000 7f941e000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94180c6de0 0x7f9418148910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:51.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.597+0000 7f941e000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94180c71c0 0x7f9418154a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:51.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.601+0000 7f941cc00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94180c6de0 0x7f9418148910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:51.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.601+0000 7f941e000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f941814f060 0x7f9418154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:51.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.601+0000 7f9417e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94180c71c0 0x7f9418154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:51.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.601+0000 7f941e000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941806cdb0 con 0x7f94180c6de0 2024-04-18T04:51:51.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.601+0000 7f941e000640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94181f35b0 con 0x7f941814f060 2024-04-18T04:51:51.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.601+0000 7f941d600640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f941814f060 0x7f9418154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:51.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.601+0000 7f941cc00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94180c6de0 0x7f9418148910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55352/0 (socket says 172.21.15.120:55352) 2024-04-18T04:51:51.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.601+0000 7f941cc00640 1 -- 172.21.15.120:0/2872726209 learned_addr learned my addr 172.21.15.120:0/2872726209 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:51:51.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.601+0000 7f941e000640 1 -- 172.21.15.120:0/2872726209 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94181f3ac0 con 0x7f94180c71c0 2024-04-18T04:51:51.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.601+0000 7f941d600640 1 -- 172.21.15.120:0/2872726209 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94180c71c0 msgr2=0x7f9418154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:51.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.601+0000 7f941d600640 1 --2- 172.21.15.120:0/2872726209 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94180c71c0 0x7f9418154a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:51.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.601+0000 7f941d600640 1 -- 172.21.15.120:0/2872726209 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94180c6de0 msgr2=0x7f9418148910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:51.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.601+0000 7f941d600640 1 --2- 172.21.15.120:0/2872726209 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94180c6de0 0x7f9418148910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:51.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.601+0000 7f941d600640 1 -- 172.21.15.120:0/2872726209 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9408009cb0 con 0x7f941814f060 2024-04-18T04:51:51.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.605+0000 7f941d600640 1 --2- 172.21.15.120:0/2872726209 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f941814f060 0x7f9418154fd0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f94180727b0 tx=0x7f941000ef00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:51.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.605+0000 7f9414c00640 1 -- 172.21.15.120:0/2872726209 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941000fe10 con 0x7f941814f060 2024-04-18T04:51:51.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.605+0000 7f9414c00640 1 -- 172.21.15.120:0/2872726209 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9410018470 con 0x7f941814f060 2024-04-18T04:51:51.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.605+0000 7f9414c00640 1 -- 172.21.15.120:0/2872726209 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9410018820 con 0x7f941814f060 2024-04-18T04:51:51.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.605+0000 7f941e000640 1 -- 172.21.15.120:0/2872726209 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9418157990 con 0x7f941814f060 2024-04-18T04:51:51.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.605+0000 7f941e000640 1 -- 172.21.15.120:0/2872726209 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9418157c70 con 0x7f941814f060 2024-04-18T04:51:51.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.609+0000 7f941e000640 1 -- 172.21.15.120:0/2872726209 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94180728f0 con 0x7f941814f060 2024-04-18T04:51:51.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.609+0000 7f9414c00640 1 -- 172.21.15.120:0/2872726209 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9410015070 con 0x7f941814f060 2024-04-18T04:51:51.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.613+0000 7f9414c00640 1 --2- 172.21.15.120:0/2872726209 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f93fc0776f0 0x7f93fc079bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:51.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.613+0000 7f9414c00640 1 -- 172.21.15.120:0/2872726209 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f9410087600 con 0x7f941814f060 2024-04-18T04:51:51.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.613+0000 7f941cc00640 1 --2- 172.21.15.120:0/2872726209 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f93fc0776f0 0x7f93fc079bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:51.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.613+0000 7f941cc00640 1 --2- 172.21.15.120:0/2872726209 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f93fc0776f0 0x7f93fc079bb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f940c0011f0 tx=0x7f940c007e00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:51.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:51.621+0000 7f9414c00640 1 -- 172.21.15.120:0/2872726209 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f94100545d0 con 0x7f941814f060 2024-04-18T04:51:52.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:52.105+0000 7f941e000640 1 -- 172.21.15.120:0/2872726209 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f94181f37e0 con 0x7f941814f060 2024-04-18T04:51:52.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:52.105+0000 7f9414c00640 1 -- 172.21.15.120:0/2872726209 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+6274 (secure 0 0 0) 0x7f9410057bf0 con 0x7f941814f060 2024-04-18T04:51:52.110 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:51:52.110 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5105,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:51:50.163765+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":4288,"mds_1":4967},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:active","state_seq":31,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:51:52.110 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 37 2024-04-18T04:51:52.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:52.117+0000 7f941e000640 1 -- 172.21.15.120:0/2872726209 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f93fc0776f0 msgr2=0x7f93fc079bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:52.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:52.117+0000 7f941e000640 1 --2- 172.21.15.120:0/2872726209 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f93fc0776f0 0x7f93fc079bb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f940c0011f0 tx=0x7f940c007e00 comp rx=0 tx=0).stop 2024-04-18T04:51:52.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:52.117+0000 7f941e000640 1 -- 172.21.15.120:0/2872726209 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f941814f060 msgr2=0x7f9418154fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:52.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:52.117+0000 7f941e000640 1 --2- 172.21.15.120:0/2872726209 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f941814f060 0x7f9418154fd0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f94180727b0 tx=0x7f941000ef00 comp rx=0 tx=0).stop 2024-04-18T04:51:52.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:52.117+0000 7f941e000640 1 -- 172.21.15.120:0/2872726209 shutdown_connections 2024-04-18T04:51:52.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:52.117+0000 7f941e000640 1 --2- 172.21.15.120:0/2872726209 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f93fc0776f0 0x7f93fc079bb0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:52.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:52.117+0000 7f941e000640 1 --2- 172.21.15.120:0/2872726209 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f941814f060 0x7f9418154fd0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:52.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:52.117+0000 7f941e000640 1 --2- 172.21.15.120:0/2872726209 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94180c71c0 0x7f9418154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:52.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:52.117+0000 7f941e000640 1 --2- 172.21.15.120:0/2872726209 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94180c6de0 0x7f9418148910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:52.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:52.117+0000 7f941e000640 1 -- 172.21.15.120:0/2872726209 >> 172.21.15.120:0/2872726209 conn(0x7f941806cf90 msgr2=0x7f941814d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:51:52.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:52.117+0000 7f941e000640 1 -- 172.21.15.120:0/2872726209 shutdown_connections 2024-04-18T04:51:52.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:52.117+0000 7f941e000640 1 -- 172.21.15.120:0/2872726209 wait complete. 2024-04-18T04:51:52.182 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-04-18T04:51:54.183 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:51:54.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.425+0000 7f51cac00640 1 Processor -- start 2024-04-18T04:51:54.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.429+0000 7f51cac00640 1 -- start start 2024-04-18T04:51:54.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.429+0000 7f51cac00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f51c40b0c40 0x7f51c40c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:54.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.429+0000 7f51cac00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f51c40c6e10 0x7f51c4156270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:54.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.429+0000 7f51cac00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51c40c0880 con 0x7f51c4150670 2024-04-18T04:51:54.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.429+0000 7f51cac00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51c4150a50 con 0x7f51c40c6e10 2024-04-18T04:51:54.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.429+0000 7f51cac00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c40c05a0 con 0x7f51c40b0c40 2024-04-18T04:51:54.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.429+0000 7f51ca200640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f51c40c6e10 0x7f51c4156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:54.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.429+0000 7f51c8e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f51c40b0c40 0x7f51c40c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:54.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.429+0000 7f51ca200640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f51c40c6e10 0x7f51c4156270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:41652/0 (socket says 172.21.15.120:41652) 2024-04-18T04:51:54.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.429+0000 7f51ca200640 1 -- 172.21.15.120:0/174407552 learned_addr learned my addr 172.21.15.120:0/174407552 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:51:54.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.429+0000 7f51c8e00640 1 -- 172.21.15.120:0/174407552 >> v2:172.21.15.132:3300/0 conn(0x7f51c40c6e10 msgr2=0x7f51c4156270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:51:54.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.429+0000 7f51c8e00640 1 --2- 172.21.15.120:0/174407552 >> v2:172.21.15.132:3300/0 conn(0x7f51c40c6e10 0x7f51c4156270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:54.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.429+0000 7f51c8e00640 1 -- 172.21.15.120:0/174407552 >> v1:172.21.15.132:6789/0 conn(0x7f51c4150670 legacy=0x7f51c406db20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-18T04:51:54.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.429+0000 7f51c8e00640 1 -- 172.21.15.120:0/174407552 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c406b7c0 con 0x7f51c40b0c40 2024-04-18T04:51:54.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.437+0000 7f51c8e00640 1 --2- 172.21.15.120:0/174407552 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f51c40b0c40 0x7f51c40c68d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f51b000dbe0 tx=0x7f51b0022f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f934d79c139ef8da server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:54.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.437+0000 7f51c3e00640 1 -- 172.21.15.120:0/174407552 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b000d2d0 con 0x7f51c40b0c40 2024-04-18T04:51:54.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.437+0000 7f51c3e00640 1 -- 172.21.15.120:0/174407552 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b00acb30 con 0x7f51c40b0c40 2024-04-18T04:51:54.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.437+0000 7f51c3e00640 1 -- 172.21.15.120:0/174407552 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b000d2d0 con 0x7f51c40b0c40 2024-04-18T04:51:54.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.437+0000 7f51cac00640 1 -- 172.21.15.120:0/174407552 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f51c40b0c40 msgr2=0x7f51c40c68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:54.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.437+0000 7f51cac00640 1 --2- 172.21.15.120:0/174407552 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f51c40b0c40 0x7f51c40c68d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f51b000dbe0 tx=0x7f51b0022f60 comp rx=0 tx=0).stop 2024-04-18T04:51:54.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.437+0000 7f51cac00640 1 -- 172.21.15.120:0/174407552 shutdown_connections 2024-04-18T04:51:54.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.437+0000 7f51cac00640 1 --2- 172.21.15.120:0/174407552 >> v2:172.21.15.132:3300/0 conn(0x7f51c40c6e10 0x7f51c4156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:54.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.437+0000 7f51cac00640 1 --2- 172.21.15.120:0/174407552 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f51c40b0c40 0x7f51c40c68d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:54.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.437+0000 7f51cac00640 1 -- 172.21.15.120:0/174407552 >> 172.21.15.120:0/174407552 conn(0x7f51c406d000 msgr2=0x7f51c406d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:51:54.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.437+0000 7f51cac00640 1 -- 172.21.15.120:0/174407552 shutdown_connections 2024-04-18T04:51:54.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.441+0000 7f51cac00640 1 -- 172.21.15.120:0/174407552 wait complete. 2024-04-18T04:51:54.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.441+0000 7f51cac00640 1 Processor -- start 2024-04-18T04:51:54.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.441+0000 7f51cac00640 1 -- start start 2024-04-18T04:51:54.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.445+0000 7f51cac00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51c40b0c40 0x7f51c40ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:54.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.445+0000 7f51cac00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51c40c6e10 0x7f51c41f4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:54.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.445+0000 7f51cac00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f51c4156e00 0x7f51c41f4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:54.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.445+0000 7f51cac00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c4149530 con 0x7f51c40c6e10 2024-04-18T04:51:54.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.445+0000 7f51cac00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c4155fe0 con 0x7f51c40b0c40 2024-04-18T04:51:54.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.445+0000 7f51cac00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c4155240 con 0x7f51c4156e00 2024-04-18T04:51:54.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.445+0000 7f51c8e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51c40c6e10 0x7f51c41f4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:54.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.445+0000 7f51c8e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51c40c6e10 0x7f51c41f4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55354/0 (socket says 172.21.15.120:55354) 2024-04-18T04:51:54.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.445+0000 7f51c8e00640 1 -- 172.21.15.120:0/3793748243 learned_addr learned my addr 172.21.15.120:0/3793748243 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:51:54.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.445+0000 7f51ca200640 1 --2- 172.21.15.120:0/3793748243 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f51c4156e00 0x7f51c41f4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:54.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.445+0000 7f51ca200640 1 -- 172.21.15.120:0/3793748243 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51c40b0c40 msgr2=0x7f51c40ca0a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:51:54.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.445+0000 7f51ca200640 1 --2- 172.21.15.120:0/3793748243 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51c40b0c40 0x7f51c40ca0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:54.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.445+0000 7f51ca200640 1 -- 172.21.15.120:0/3793748243 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51c40c6e10 msgr2=0x7f51c41f4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:54.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.445+0000 7f51ca200640 1 --2- 172.21.15.120:0/3793748243 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51c40c6e10 0x7f51c41f4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:54.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.445+0000 7f51ca200640 1 -- 172.21.15.120:0/3793748243 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b000d8c0 con 0x7f51c4156e00 2024-04-18T04:51:54.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.445+0000 7f51ca200640 1 --2- 172.21.15.120:0/3793748243 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f51c4156e00 0x7f51c41f4990 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f51bc00bf70 tx=0x7f51bc007680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:54.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.449+0000 7f51c1600640 1 -- 172.21.15.120:0/3793748243 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc010040 con 0x7f51c4156e00 2024-04-18T04:51:54.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.449+0000 7f51c1600640 1 -- 172.21.15.120:0/3793748243 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51bc007e50 con 0x7f51c4156e00 2024-04-18T04:51:54.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.449+0000 7f51c1600640 1 -- 172.21.15.120:0/3793748243 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc008940 con 0x7f51c4156e00 2024-04-18T04:51:54.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.449+0000 7f51cac00640 1 -- 172.21.15.120:0/3793748243 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51c41561f0 con 0x7f51c4156e00 2024-04-18T04:51:54.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.449+0000 7f51cac00640 1 -- 172.21.15.120:0/3793748243 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51c41567b0 con 0x7f51c4156e00 2024-04-18T04:51:54.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.449+0000 7f51cac00640 1 -- 172.21.15.120:0/3793748243 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51c41569a0 con 0x7f51c4156e00 2024-04-18T04:51:54.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.461+0000 7f51c1600640 1 -- 172.21.15.120:0/3793748243 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f51bc009600 con 0x7f51c4156e00 2024-04-18T04:51:54.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.461+0000 7f51c1600640 1 --2- 172.21.15.120:0/3793748243 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f51a4066710 0x7f51a4068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:54.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.461+0000 7f51c1600640 1 -- 172.21.15.120:0/3793748243 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f51bc084e80 con 0x7f51c4156e00 2024-04-18T04:51:54.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.465+0000 7f51c1600640 1 -- 172.21.15.120:0/3793748243 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f51bc051dc0 con 0x7f51c4156e00 2024-04-18T04:51:54.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.477+0000 7f51c9800640 1 --2- 172.21.15.120:0/3793748243 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f51a4066710 0x7f51a4068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:54.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.485+0000 7f51c9800640 1 --2- 172.21.15.120:0/3793748243 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f51a4066710 0x7f51a4068bd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f51c406e990 tx=0x7f51b8006be0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:54.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.981+0000 7f51cac00640 1 -- 172.21.15.120:0/3793748243 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51c40728f0 con 0x7f51c4156e00 2024-04-18T04:51:54.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.989+0000 7f51c1600640 1 -- 172.21.15.120:0/3793748243 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+6274 (secure 0 0 0) 0x7f51bc023090 con 0x7f51c4156e00 2024-04-18T04:51:54.991 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:51:54.992 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5105,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:51:50.163765+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":4288,"mds_1":4967},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:active","state_seq":31,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:51:54.992 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 37 2024-04-18T04:51:54.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.997+0000 7f51cac00640 1 -- 172.21.15.120:0/3793748243 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f51a4066710 msgr2=0x7f51a4068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:54.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.997+0000 7f51cac00640 1 --2- 172.21.15.120:0/3793748243 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f51a4066710 0x7f51a4068bd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f51c406e990 tx=0x7f51b8006be0 comp rx=0 tx=0).stop 2024-04-18T04:51:54.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.997+0000 7f51cac00640 1 -- 172.21.15.120:0/3793748243 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f51c4156e00 msgr2=0x7f51c41f4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:54.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.997+0000 7f51cac00640 1 --2- 172.21.15.120:0/3793748243 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f51c4156e00 0x7f51c41f4990 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f51bc00bf70 tx=0x7f51bc007680 comp rx=0 tx=0).stop 2024-04-18T04:51:54.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.997+0000 7f51cac00640 1 -- 172.21.15.120:0/3793748243 shutdown_connections 2024-04-18T04:51:54.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.997+0000 7f51cac00640 1 --2- 172.21.15.120:0/3793748243 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f51a4066710 0x7f51a4068bd0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:54.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.997+0000 7f51cac00640 1 --2- 172.21.15.120:0/3793748243 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f51c4156e00 0x7f51c41f4990 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:54.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.997+0000 7f51cac00640 1 --2- 172.21.15.120:0/3793748243 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51c40c6e10 0x7f51c41f4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:54.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.997+0000 7f51cac00640 1 --2- 172.21.15.120:0/3793748243 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51c40b0c40 0x7f51c40ca0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:54.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.997+0000 7f51cac00640 1 -- 172.21.15.120:0/3793748243 >> 172.21.15.120:0/3793748243 conn(0x7f51c406d000 msgr2=0x7f51c406d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:51:54.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.997+0000 7f51cac00640 1 -- 172.21.15.120:0/3793748243 shutdown_connections 2024-04-18T04:51:54.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:54.997+0000 7f51cac00640 1 -- 172.21.15.120:0/3793748243 wait complete. 2024-04-18T04:51:55.045 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-04-18T04:51:57.046 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:51:57.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.437+0000 7f1b36400640 1 Processor -- start 2024-04-18T04:51:57.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.437+0000 7f1b36400640 1 -- start start 2024-04-18T04:51:57.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.441+0000 7f1b36400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1b300c00d0 0x7f1b30158b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:57.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.441+0000 7f1b36400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1b300c04b0 0x7f1b3006c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:57.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.441+0000 7f1b36400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b3006c950 0x7f1b300c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:57.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.441+0000 7f1b36400640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b300c1270 con 0x7f1b300c00d0 2024-04-18T04:51:57.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.441+0000 7f1b36400640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b30159a80 con 0x7f1b300c04b0 2024-04-18T04:51:57.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.441+0000 7f1b36400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b30070c00 con 0x7f1b3006c950 2024-04-18T04:51:57.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.441+0000 7f1b2e000640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1b300c04b0 0x7f1b3006c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:57.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.441+0000 7f1b2f400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b3006c950 0x7f1b300c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:57.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.441+0000 7f1b2f400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b3006c950 0x7f1b300c1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:52000/0 (socket says 172.21.15.120:52000) 2024-04-18T04:51:57.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.441+0000 7f1b2f400640 1 -- 172.21.15.120:0/397590795 learned_addr learned my addr 172.21.15.120:0/397590795 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:51:57.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.445+0000 7f1b2f400640 1 -- 172.21.15.120:0/397590795 >> v2:172.21.15.132:3300/0 conn(0x7f1b300c04b0 msgr2=0x7f1b3006c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:51:57.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.445+0000 7f1b2f400640 1 --2- 172.21.15.120:0/397590795 >> v2:172.21.15.132:3300/0 conn(0x7f1b300c04b0 0x7f1b3006c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:57.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.445+0000 7f1b2f400640 1 -- 172.21.15.120:0/397590795 >> v2:172.21.15.120:3300/0 conn(0x7f1b300c00d0 msgr2=0x7f1b30158b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:51:57.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.445+0000 7f1b2ea00640 1 --2- 172.21.15.120:0/397590795 >> v2:172.21.15.120:3300/0 conn(0x7f1b300c00d0 0x7f1b30158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:57.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.445+0000 7f1b2f400640 1 --2- 172.21.15.120:0/397590795 >> v2:172.21.15.120:3300/0 conn(0x7f1b300c00d0 0x7f1b30158b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:57.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.445+0000 7f1b2f400640 1 -- 172.21.15.120:0/397590795 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b30159200 con 0x7f1b3006c950 2024-04-18T04:51:57.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.449+0000 7f1b2ea00640 1 --2- 172.21.15.120:0/397590795 >> v2:172.21.15.120:3300/0 conn(0x7f1b300c00d0 0x7f1b30158b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:51:57.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.465+0000 7f1b2f400640 1 --2- 172.21.15.120:0/397590795 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b3006c950 0x7f1b300c1700 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1b3006efe0 tx=0x7f1b2401cf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf196a633ecc7c79 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:57.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.465+0000 7f1b34e00640 1 -- 172.21.15.120:0/397590795 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b240ae410 con 0x7f1b3006c950 2024-04-18T04:51:57.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.465+0000 7f1b34e00640 1 -- 172.21.15.120:0/397590795 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b240a8030 con 0x7f1b3006c950 2024-04-18T04:51:57.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.465+0000 7f1b34e00640 1 -- 172.21.15.120:0/397590795 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b240ae790 con 0x7f1b3006c950 2024-04-18T04:51:57.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.465+0000 7f1b36400640 1 -- 172.21.15.120:0/397590795 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b3006c950 msgr2=0x7f1b300c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:57.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.465+0000 7f1b36400640 1 --2- 172.21.15.120:0/397590795 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b3006c950 0x7f1b300c1700 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1b3006efe0 tx=0x7f1b2401cf50 comp rx=0 tx=0).stop 2024-04-18T04:51:57.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.465+0000 7f1b36400640 1 -- 172.21.15.120:0/397590795 shutdown_connections 2024-04-18T04:51:57.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.465+0000 7f1b36400640 1 --2- 172.21.15.120:0/397590795 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b3006c950 0x7f1b300c1700 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:57.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.465+0000 7f1b36400640 1 --2- 172.21.15.120:0/397590795 >> v2:172.21.15.132:3300/0 conn(0x7f1b300c04b0 0x7f1b3006c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:57.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.465+0000 7f1b36400640 1 --2- 172.21.15.120:0/397590795 >> v2:172.21.15.120:3300/0 conn(0x7f1b300c00d0 0x7f1b30158b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:57.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.465+0000 7f1b36400640 1 -- 172.21.15.120:0/397590795 >> 172.21.15.120:0/397590795 conn(0x7f1b300c78c0 msgr2=0x7f1b300c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:51:57.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.473+0000 7f1b36400640 1 -- 172.21.15.120:0/397590795 shutdown_connections 2024-04-18T04:51:57.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.477+0000 7f1b36400640 1 -- 172.21.15.120:0/397590795 wait complete. 2024-04-18T04:51:57.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.477+0000 7f1b36400640 1 Processor -- start 2024-04-18T04:51:57.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.477+0000 7f1b36400640 1 -- start start 2024-04-18T04:51:57.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.481+0000 7f1b36400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b3006c950 0x7f1b301445e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:57.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.481+0000 7f1b36400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b300c00d0 0x7f1b300c9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:57.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.481+0000 7f1b36400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b300c04b0 0x7f1b301425e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:57.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.481+0000 7f1b36400640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b30145050 con 0x7f1b300c04b0 2024-04-18T04:51:57.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.481+0000 7f1b36400640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b300c9330 con 0x7f1b3006c950 2024-04-18T04:51:57.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.481+0000 7f1b36400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b30141e70 con 0x7f1b300c00d0 2024-04-18T04:51:57.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.481+0000 7f1b2ea00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b3006c950 0x7f1b301445e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:57.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.481+0000 7f1b2ea00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b3006c950 0x7f1b301445e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:41670/0 (socket says 172.21.15.120:41670) 2024-04-18T04:51:57.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.481+0000 7f1b2ea00640 1 -- 172.21.15.120:0/433150008 learned_addr learned my addr 172.21.15.120:0/433150008 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:51:57.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.481+0000 7f1b2f400640 1 --2- 172.21.15.120:0/433150008 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b300c04b0 0x7f1b301425e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:57.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.481+0000 7f1b2ea00640 1 -- 172.21.15.120:0/433150008 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b300c00d0 msgr2=0x7f1b300c9870 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:51:57.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.481+0000 7f1b2ea00640 1 --2- 172.21.15.120:0/433150008 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b300c00d0 0x7f1b300c9870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:57.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.481+0000 7f1b2ea00640 1 -- 172.21.15.120:0/433150008 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b300c04b0 msgr2=0x7f1b301425e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:57.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.481+0000 7f1b2ea00640 1 --2- 172.21.15.120:0/433150008 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b300c04b0 0x7f1b301425e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:57.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.481+0000 7f1b2ea00640 1 -- 172.21.15.120:0/433150008 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b24007e20 con 0x7f1b3006c950 2024-04-18T04:51:57.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.485+0000 7f1b2ea00640 1 --2- 172.21.15.120:0/433150008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b3006c950 0x7f1b301445e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1b2800c7f0 tx=0x7f1b2800cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:57.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.489+0000 7f1b23400640 1 -- 172.21.15.120:0/433150008 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b28007a30 con 0x7f1b3006c950 2024-04-18T04:51:57.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.489+0000 7f1b23400640 1 -- 172.21.15.120:0/433150008 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b28007b90 con 0x7f1b3006c950 2024-04-18T04:51:57.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.489+0000 7f1b23400640 1 -- 172.21.15.120:0/433150008 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2800ce40 con 0x7f1b3006c950 2024-04-18T04:51:57.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.489+0000 7f1b36400640 1 -- 172.21.15.120:0/433150008 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b3014be50 con 0x7f1b3006c950 2024-04-18T04:51:57.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.489+0000 7f1b36400640 1 -- 172.21.15.120:0/433150008 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b3014c3f0 con 0x7f1b3006c950 2024-04-18T04:51:57.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.493+0000 7f1b36400640 1 -- 172.21.15.120:0/433150008 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b30072a70 con 0x7f1b3006c950 2024-04-18T04:51:57.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.493+0000 7f1b23400640 1 -- 172.21.15.120:0/433150008 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1b280113f0 con 0x7f1b3006c950 2024-04-18T04:51:57.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.497+0000 7f1b23400640 1 --2- 172.21.15.120:0/433150008 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1b10066760 0x7f1b10068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:51:57.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.497+0000 7f1b2e000640 1 --2- 172.21.15.120:0/433150008 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1b10066760 0x7f1b10068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:51:57.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.497+0000 7f1b23400640 1 -- 172.21.15.120:0/433150008 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f1b280847f0 con 0x7f1b3006c950 2024-04-18T04:51:57.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.497+0000 7f1b2e000640 1 --2- 172.21.15.120:0/433150008 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1b10066760 0x7f1b10068c20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1b30158c00 tx=0x7f1b1c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:51:57.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.501+0000 7f1b23400640 1 -- 172.21.15.120:0/433150008 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f1b280516a0 con 0x7f1b3006c950 2024-04-18T04:51:57.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.993+0000 7f1b36400640 1 -- 172.21.15.120:0/433150008 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b300c6d30 con 0x7f1b3006c950 2024-04-18T04:51:57.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:57.993+0000 7f1b23400640 1 -- 172.21.15.120:0/433150008 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+6274 (secure 0 0 0) 0x7f1b28054cc0 con 0x7f1b3006c950 2024-04-18T04:51:57.993 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:51:57.993 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5105,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:51:50.163765+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":4288,"mds_1":4967},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:active","state_seq":31,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:51:57.993 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 37 2024-04-18T04:51:57.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:58.001+0000 7f1b36400640 1 -- 172.21.15.120:0/433150008 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1b10066760 msgr2=0x7f1b10068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:57.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:58.001+0000 7f1b36400640 1 --2- 172.21.15.120:0/433150008 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1b10066760 0x7f1b10068c20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1b30158c00 tx=0x7f1b1c008040 comp rx=0 tx=0).stop 2024-04-18T04:51:57.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:58.001+0000 7f1b36400640 1 -- 172.21.15.120:0/433150008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b3006c950 msgr2=0x7f1b301445e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:51:57.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:58.001+0000 7f1b36400640 1 --2- 172.21.15.120:0/433150008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b3006c950 0x7f1b301445e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1b2800c7f0 tx=0x7f1b2800cbf0 comp rx=0 tx=0).stop 2024-04-18T04:51:57.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:58.001+0000 7f1b36400640 1 -- 172.21.15.120:0/433150008 shutdown_connections 2024-04-18T04:51:57.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:58.001+0000 7f1b36400640 1 --2- 172.21.15.120:0/433150008 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1b10066760 0x7f1b10068c20 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:57.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:58.001+0000 7f1b36400640 1 --2- 172.21.15.120:0/433150008 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b300c04b0 0x7f1b301425e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:57.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:58.001+0000 7f1b36400640 1 --2- 172.21.15.120:0/433150008 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b300c00d0 0x7f1b300c9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:57.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:58.001+0000 7f1b36400640 1 --2- 172.21.15.120:0/433150008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b3006c950 0x7f1b301445e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:51:57.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:58.001+0000 7f1b36400640 1 -- 172.21.15.120:0/433150008 >> 172.21.15.120:0/433150008 conn(0x7f1b300c78c0 msgr2=0x7f1b300c7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:51:57.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:58.001+0000 7f1b36400640 1 -- 172.21.15.120:0/433150008 shutdown_connections 2024-04-18T04:51:57.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:51:58.001+0000 7f1b36400640 1 -- 172.21.15.120:0/433150008 wait complete. 2024-04-18T04:51:58.033 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-04-18T04:52:00.034 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:52:00.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.293+0000 7f4a31800640 1 Processor -- start 2024-04-18T04:52:00.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.293+0000 7f4a31800640 1 -- start start 2024-04-18T04:52:00.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.297+0000 7f4a31800640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4a2c1504f0 0x7f4a2c15a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:00.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.297+0000 7f4a31800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a2c0c9c60 0x7f4a2c1561c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:00.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.297+0000 7f4a31800640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a2c159730 con 0x7f4a2c0cb060 2024-04-18T04:52:00.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.297+0000 7f4a31800640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a2c15a6c0 con 0x7f4a2c1504f0 2024-04-18T04:52:00.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.297+0000 7f4a31800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c159cf0 con 0x7f4a2c0c9c60 2024-04-18T04:52:00.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.297+0000 7f4a2b400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a2c0c9c60 0x7f4a2c1561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:00.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.297+0000 7f4a2be00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4a2c1504f0 0x7f4a2c15a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:00.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.297+0000 7f4a2b400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a2c0c9c60 0x7f4a2c1561c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:52008/0 (socket says 172.21.15.120:52008) 2024-04-18T04:52:00.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.297+0000 7f4a2b400640 1 -- 172.21.15.120:0/1199046755 learned_addr learned my addr 172.21.15.120:0/1199046755 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:52:00.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.297+0000 7f4a2b400640 1 -- 172.21.15.120:0/1199046755 >> v2:172.21.15.132:3300/0 conn(0x7f4a2c1504f0 msgr2=0x7f4a2c15a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:52:00.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.297+0000 7f4a2b400640 1 --2- 172.21.15.120:0/1199046755 >> v2:172.21.15.132:3300/0 conn(0x7f4a2c1504f0 0x7f4a2c15a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:00.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.297+0000 7f4a2aa00640 1 -- 172.21.15.120:0/1199046755 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1357108908 0 0) 0x7f4a2c159730 con 0x7f4a2c0cb060 2024-04-18T04:52:00.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.297+0000 7f4a2b400640 1 -- 172.21.15.120:0/1199046755 >> v1:172.21.15.132:6789/0 conn(0x7f4a2c0cb060 legacy=0x7f4a2c06c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:00.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.297+0000 7f4a2b400640 1 -- 172.21.15.120:0/1199046755 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a2c1569e0 con 0x7f4a2c0c9c60 2024-04-18T04:52:00.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.301+0000 7f4a2b400640 1 --2- 172.21.15.120:0/1199046755 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a2c0c9c60 0x7f4a2c1561c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4a18006fd0 tx=0x7f4a18021400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a2ca068e6fc75da server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:00.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.301+0000 7f4a2aa00640 1 -- 172.21.15.120:0/1199046755 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a180b1600 con 0x7f4a2c0c9c60 2024-04-18T04:52:00.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.301+0000 7f4a2aa00640 1 -- 172.21.15.120:0/1199046755 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a180ad050 con 0x7f4a2c0c9c60 2024-04-18T04:52:00.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.301+0000 7f4a2aa00640 1 -- 172.21.15.120:0/1199046755 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a180b1980 con 0x7f4a2c0c9c60 2024-04-18T04:52:00.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.301+0000 7f4a31800640 1 -- 172.21.15.120:0/1199046755 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a2c0c9c60 msgr2=0x7f4a2c1561c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:00.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.301+0000 7f4a31800640 1 --2- 172.21.15.120:0/1199046755 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a2c0c9c60 0x7f4a2c1561c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4a18006fd0 tx=0x7f4a18021400 comp rx=0 tx=0).stop 2024-04-18T04:52:00.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.305+0000 7f4a31800640 1 -- 172.21.15.120:0/1199046755 shutdown_connections 2024-04-18T04:52:00.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.305+0000 7f4a31800640 1 --2- 172.21.15.120:0/1199046755 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a2c0c9c60 0x7f4a2c1561c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:00.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.305+0000 7f4a31800640 1 --2- 172.21.15.120:0/1199046755 >> v2:172.21.15.132:3300/0 conn(0x7f4a2c1504f0 0x7f4a2c15a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:00.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.305+0000 7f4a31800640 1 -- 172.21.15.120:0/1199046755 >> 172.21.15.120:0/1199046755 conn(0x7f4a2c06e140 msgr2=0x7f4a2c06e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:52:00.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.305+0000 7f4a31800640 1 -- 172.21.15.120:0/1199046755 shutdown_connections 2024-04-18T04:52:00.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.305+0000 7f4a31800640 1 -- 172.21.15.120:0/1199046755 wait complete. 2024-04-18T04:52:00.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.305+0000 7f4a31800640 1 Processor -- start 2024-04-18T04:52:00.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.305+0000 7f4a31800640 1 -- start start 2024-04-18T04:52:00.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.309+0000 7f4a31800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a2c0cb060 0x7f4a2c1e17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:00.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.309+0000 7f4a31800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a2c1504f0 0x7f4a2c14de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:00.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.309+0000 7f4a31800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a2c155a00 0x7f4a2c1dfb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:00.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.309+0000 7f4a31800640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c0b10a0 con 0x7f4a2c155a00 2024-04-18T04:52:00.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.309+0000 7f4a31800640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c1535e0 con 0x7f4a2c1504f0 2024-04-18T04:52:00.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.309+0000 7f4a31800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c1df680 con 0x7f4a2c0cb060 2024-04-18T04:52:00.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.309+0000 7f4a2be00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a2c0cb060 0x7f4a2c1e17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:00.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.309+0000 7f4a2be00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a2c0cb060 0x7f4a2c1e17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:52018/0 (socket says 172.21.15.120:52018) 2024-04-18T04:52:00.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.309+0000 7f4a2be00640 1 -- 172.21.15.120:0/129299054 learned_addr learned my addr 172.21.15.120:0/129299054 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:52:00.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.309+0000 7f4a2b400640 1 --2- 172.21.15.120:0/129299054 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a2c1504f0 0x7f4a2c14de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:00.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.309+0000 7f4a2be00640 1 -- 172.21.15.120:0/129299054 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a2c1504f0 msgr2=0x7f4a2c14de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:00.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.309+0000 7f4a2be00640 1 --2- 172.21.15.120:0/129299054 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a2c1504f0 0x7f4a2c14de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:00.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.309+0000 7f4a2be00640 1 -- 172.21.15.120:0/129299054 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a2c155a00 msgr2=0x7f4a2c1dfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:00.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.309+0000 7f4a30e00640 1 --2- 172.21.15.120:0/129299054 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a2c155a00 0x7f4a2c1dfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:00.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.313+0000 7f4a2be00640 1 --2- 172.21.15.120:0/129299054 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a2c155a00 0x7f4a2c1dfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:00.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.313+0000 7f4a2be00640 1 -- 172.21.15.120:0/129299054 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1800b720 con 0x7f4a2c0cb060 2024-04-18T04:52:00.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.313+0000 7f4a30e00640 1 --2- 172.21.15.120:0/129299054 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a2c155a00 0x7f4a2c1dfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:52:00.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.313+0000 7f4a2be00640 1 --2- 172.21.15.120:0/129299054 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a2c0cb060 0x7f4a2c1e17e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c00efc0 tx=0x7f4a1c00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:00.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.313+0000 7f4a23e00640 1 -- 172.21.15.120:0/129299054 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c009b80 con 0x7f4a2c0cb060 2024-04-18T04:52:00.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.313+0000 7f4a23e00640 1 -- 172.21.15.120:0/129299054 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1c00f040 con 0x7f4a2c0cb060 2024-04-18T04:52:00.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.313+0000 7f4a23e00640 1 -- 172.21.15.120:0/129299054 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c0146a0 con 0x7f4a2c0cb060 2024-04-18T04:52:00.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.313+0000 7f4a31800640 1 -- 172.21.15.120:0/129299054 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a2c0b12f0 con 0x7f4a2c0cb060 2024-04-18T04:52:00.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.313+0000 7f4a31800640 1 -- 172.21.15.120:0/129299054 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a2c154d00 con 0x7f4a2c0cb060 2024-04-18T04:52:00.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.317+0000 7f4a21600640 1 -- 172.21.15.120:0/129299054 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a2c154ef0 con 0x7f4a2c0cb060 2024-04-18T04:52:00.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.321+0000 7f4a23e00640 1 -- 172.21.15.120:0/129299054 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4a1c014800 con 0x7f4a2c0cb060 2024-04-18T04:52:00.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.321+0000 7f4a23e00640 1 --2- 172.21.15.120:0/129299054 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4a0c066710 0x7f4a0c068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:00.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.321+0000 7f4a23e00640 1 -- 172.21.15.120:0/129299054 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f4a1c084f30 con 0x7f4a2c0cb060 2024-04-18T04:52:00.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.321+0000 7f4a2b400640 1 --2- 172.21.15.120:0/129299054 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4a0c066710 0x7f4a0c068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:00.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.321+0000 7f4a2b400640 1 --2- 172.21.15.120:0/129299054 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4a0c066710 0x7f4a0c068bd0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4a180b3000 tx=0x7f4a180ac000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:00.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.333+0000 7f4a23e00640 1 -- 172.21.15.120:0/129299054 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f4a1c0b6be0 con 0x7f4a2c0cb060 2024-04-18T04:52:00.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.673+0000 7f4a21600640 1 -- 172.21.15.120:0/129299054 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a2c156680 con 0x7f4a2c0cb060 2024-04-18T04:52:00.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.677+0000 7f4a23e00640 1 -- 172.21.15.120:0/129299054 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+6274 (secure 0 0 0) 0x7f4a1c0559e0 con 0x7f4a2c0cb060 2024-04-18T04:52:00.674 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:52:00.674 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5105,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:51:50.163765+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":4288,"mds_1":4967},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:active","state_seq":31,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:52:00.674 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 37 2024-04-18T04:52:00.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.681+0000 7f4a21600640 1 -- 172.21.15.120:0/129299054 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4a0c066710 msgr2=0x7f4a0c068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:00.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.681+0000 7f4a21600640 1 --2- 172.21.15.120:0/129299054 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4a0c066710 0x7f4a0c068bd0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4a180b3000 tx=0x7f4a180ac000 comp rx=0 tx=0).stop 2024-04-18T04:52:00.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.681+0000 7f4a21600640 1 -- 172.21.15.120:0/129299054 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a2c0cb060 msgr2=0x7f4a2c1e17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:00.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.681+0000 7f4a21600640 1 --2- 172.21.15.120:0/129299054 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a2c0cb060 0x7f4a2c1e17e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c00efc0 tx=0x7f4a1c00c490 comp rx=0 tx=0).stop 2024-04-18T04:52:00.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.681+0000 7f4a21600640 1 -- 172.21.15.120:0/129299054 shutdown_connections 2024-04-18T04:52:00.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.681+0000 7f4a21600640 1 --2- 172.21.15.120:0/129299054 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4a0c066710 0x7f4a0c068bd0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:00.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.681+0000 7f4a21600640 1 --2- 172.21.15.120:0/129299054 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a2c155a00 0x7f4a2c1dfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:00.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.681+0000 7f4a21600640 1 --2- 172.21.15.120:0/129299054 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a2c1504f0 0x7f4a2c14de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:00.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.681+0000 7f4a21600640 1 --2- 172.21.15.120:0/129299054 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a2c0cb060 0x7f4a2c1e17e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:00.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.681+0000 7f4a21600640 1 -- 172.21.15.120:0/129299054 >> 172.21.15.120:0/129299054 conn(0x7f4a2c06e140 msgr2=0x7f4a2c06a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:52:00.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.681+0000 7f4a21600640 1 -- 172.21.15.120:0/129299054 shutdown_connections 2024-04-18T04:52:00.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:00.681+0000 7f4a21600640 1 -- 172.21.15.120:0/129299054 wait complete. 2024-04-18T04:52:00.713 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-04-18T04:52:02.714 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:52:02.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.949+0000 7f5105a00640 1 Processor -- start 2024-04-18T04:52:02.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.949+0000 7f5105a00640 1 -- start start 2024-04-18T04:52:02.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.953+0000 7f5105a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5100070b00 0x7f51000c6940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:02.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.953+0000 7f50fea00640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f5100157f50 0x7f5100071a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:58762/0 (socket says 172.21.15.120:58762) 2024-04-18T04:52:02.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.953+0000 7f50fea00640 1 -- 172.21.15.120:0/2794944594 learned_addr learned my addr 172.21.15.120:0/2794944594 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:52:02.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.953+0000 7f50fe000640 1 --2- 172.21.15.120:0/2794944594 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5100070b00 0x7f51000c6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:02.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.953+0000 7f5105a00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f510015eb00 con 0x7f5100157f50 2024-04-18T04:52:02.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.953+0000 7f5105a00640 1 -- 172.21.15.120:0/2794944594 --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51000c85a0 con 0x7f510006a070 2024-04-18T04:52:02.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.953+0000 7f5105a00640 1 -- 172.21.15.120:0/2794944594 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51000c8880 con 0x7f5100070b00 2024-04-18T04:52:02.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.953+0000 7f50fd600640 1 -- 172.21.15.120:0/2794944594 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3576107513 0 0) 0x7f510015eb00 con 0x7f5100157f50 2024-04-18T04:52:02.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.953+0000 7f50fd600640 1 -- 172.21.15.120:0/2794944594 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50e4003530 con 0x7f5100157f50 2024-04-18T04:52:02.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.953+0000 7f50fd600640 1 -- 172.21.15.120:0/2794944594 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1396286236 0 0) 0x7f51000c85a0 con 0x7f510006a070 2024-04-18T04:52:02.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.953+0000 7f50fd600640 1 -- 172.21.15.120:0/2794944594 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f510015eb00 con 0x7f510006a070 2024-04-18T04:52:02.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.953+0000 7f50fd600640 1 -- 172.21.15.120:0/2794944594 <== mon.1 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 127768058 0 0) 0x7f510015eb00 con 0x7f510006a070 2024-04-18T04:52:02.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.953+0000 7f50fd600640 1 -- 172.21.15.120:0/2794944594 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5100070b00 msgr2=0x7f51000c6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:52:02.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.953+0000 7f50fd600640 1 --2- 172.21.15.120:0/2794944594 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5100070b00 0x7f51000c6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:02.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.953+0000 7f50fd600640 1 -- 172.21.15.120:0/2794944594 >> v1:172.21.15.120:6789/0 conn(0x7f5100157f50 legacy=0x7f5100071a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:02.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.953+0000 7f50fd600640 1 -- 172.21.15.120:0/2794944594 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f510006d660 con 0x7f510006a070 2024-04-18T04:52:02.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.953+0000 7f50fd600640 1 -- 172.21.15.120:0/2794944594 <== mon.1 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7f50e8001680 con 0x7f510006a070 2024-04-18T04:52:02.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.953+0000 7f50fd600640 1 -- 172.21.15.120:0/2794944594 >> v1:172.21.15.132:6789/0 conn(0x7f510006a070 legacy=0x7f510006a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:02.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.957+0000 7f50fd600640 1 --2- 172.21.15.120:0/2794944594 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50e4003b10 0x7f50e4003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:02.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.957+0000 7f50fd600640 1 --2- 172.21.15.120:0/2794944594 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50e40047d0 0x7f50e4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:02.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.957+0000 7f50fd600640 1 --2- 172.21.15.120:0/2794944594 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f50e4005190 0x7f50e400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:02.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.957+0000 7f50fd600640 1 -- 172.21.15.120:0/2794944594 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51000c8880 con 0x7f50e4003b10 2024-04-18T04:52:02.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.957+0000 7f50fd600640 1 -- 172.21.15.120:0/2794944594 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e400c060 con 0x7f50e40047d0 2024-04-18T04:52:02.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.957+0000 7f50fd600640 1 -- 172.21.15.120:0/2794944594 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e400c1d0 con 0x7f50e4005190 2024-04-18T04:52:02.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.957+0000 7f50fe000640 1 --2- 172.21.15.120:0/2794944594 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50e40047d0 0x7f50e4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:02.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.957+0000 7f50fea00640 1 --2- 172.21.15.120:0/2794944594 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50e4003b10 0x7f50e4003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:02.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.957+0000 7f50fe000640 1 -- 172.21.15.120:0/2794944594 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f50e4005190 msgr2=0x7f50e400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:52:02.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.957+0000 7f50fe000640 1 --2- 172.21.15.120:0/2794944594 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f50e4005190 0x7f50e400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:02.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.957+0000 7f50fe000640 1 -- 172.21.15.120:0/2794944594 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50e4003b10 msgr2=0x7f50e4003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:52:02.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.957+0000 7f50fe000640 1 --2- 172.21.15.120:0/2794944594 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50e4003b10 0x7f50e4003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:02.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.957+0000 7f50fe000640 1 -- 172.21.15.120:0/2794944594 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f510006d660 con 0x7f50e40047d0 2024-04-18T04:52:02.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.961+0000 7f50fe000640 1 --2- 172.21.15.120:0/2794944594 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50e40047d0 0x7f50e4004c50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f51000ccf80 tx=0x7f50f001c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d59b7e96d0bd483f server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:02.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.961+0000 7f50fd600640 1 -- 172.21.15.120:0/2794944594 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f00ad410 con 0x7f50e40047d0 2024-04-18T04:52:02.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.961+0000 7f50fd600640 1 -- 172.21.15.120:0/2794944594 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f00a7030 con 0x7f50e40047d0 2024-04-18T04:52:02.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.961+0000 7f50fd600640 1 -- 172.21.15.120:0/2794944594 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f00ad7d0 con 0x7f50e40047d0 2024-04-18T04:52:02.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.961+0000 7f5105a00640 1 -- 172.21.15.120:0/2794944594 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50e40047d0 msgr2=0x7f50e4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:02.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.961+0000 7f5105a00640 1 --2- 172.21.15.120:0/2794944594 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50e40047d0 0x7f50e4004c50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f51000ccf80 tx=0x7f50f001c510 comp rx=0 tx=0).stop 2024-04-18T04:52:02.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.961+0000 7f50ff400640 1 -- 172.21.15.120:0/2794944594 reap_dead start 2024-04-18T04:52:02.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.965+0000 7f5105a00640 1 -- 172.21.15.120:0/2794944594 shutdown_connections 2024-04-18T04:52:02.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.965+0000 7f5105a00640 1 -- 172.21.15.120:0/2794944594 >> 172.21.15.120:0/2794944594 conn(0x7f51000c8a40 msgr2=0x7f51000c8e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:52:02.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.965+0000 7f5105a00640 1 -- 172.21.15.120:0/2794944594 shutdown_connections 2024-04-18T04:52:02.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.965+0000 7f5105a00640 1 -- 172.21.15.120:0/2794944594 wait complete. 2024-04-18T04:52:02.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.965+0000 7f5105a00640 1 Processor -- start 2024-04-18T04:52:02.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.965+0000 7f5105a00640 1 -- start start 2024-04-18T04:52:02.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.969+0000 7f5105a00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50e40047d0 0x7f5100151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:02.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.969+0000 7f5105a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f510015a040 0x7f51001515b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:02.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.969+0000 7f5105a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f51001f7f20 0x7f51001f83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:02.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.969+0000 7f5105a00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51001f77b0 con 0x7f510015a040 2024-04-18T04:52:02.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.969+0000 7f5105a00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51001f88e0 con 0x7f50e40047d0 2024-04-18T04:52:02.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.969+0000 7f5105a00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f510015a5a0 con 0x7f51001f7f20 2024-04-18T04:52:02.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.969+0000 7f50fe000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f510015a040 0x7f51001515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:02.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.969+0000 7f50fe000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f510015a040 0x7f51001515b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36960/0 (socket says 172.21.15.120:36960) 2024-04-18T04:52:02.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.969+0000 7f50fe000640 1 -- 172.21.15.120:0/2306286529 learned_addr learned my addr 172.21.15.120:0/2306286529 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:52:02.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.969+0000 7f50fe000640 1 -- 172.21.15.120:0/2306286529 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f51001f7f20 msgr2=0x7f51001f83a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:52:02.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.969+0000 7f50fe000640 1 --2- 172.21.15.120:0/2306286529 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f51001f7f20 0x7f51001f83a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:02.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.969+0000 7f50fe000640 1 -- 172.21.15.120:0/2306286529 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50e40047d0 msgr2=0x7f5100151070 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-18T04:52:02.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.969+0000 7f50fe000640 1 --2- 172.21.15.120:0/2306286529 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50e40047d0 0x7f5100151070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:02.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.969+0000 7f50fe000640 1 -- 172.21.15.120:0/2306286529 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f510015a880 con 0x7f510015a040 2024-04-18T04:52:02.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.969+0000 7f50fe000640 1 --2- 172.21.15.120:0/2306286529 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f510015a040 0x7f51001515b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f50f0000c10 tx=0x7f50e4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:02.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.969+0000 7f50f6a00640 1 -- 172.21.15.120:0/2306286529 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f0003860 con 0x7f510015a040 2024-04-18T04:52:02.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.969+0000 7f50f6a00640 1 -- 172.21.15.120:0/2306286529 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f00039c0 con 0x7f510015a040 2024-04-18T04:52:02.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.969+0000 7f50f6a00640 1 -- 172.21.15.120:0/2306286529 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f0003d70 con 0x7f510015a040 2024-04-18T04:52:02.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.973+0000 7f5105a00640 1 -- 172.21.15.120:0/2306286529 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f510015ab60 con 0x7f510015a040 2024-04-18T04:52:02.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.973+0000 7f5105a00640 1 -- 172.21.15.120:0/2306286529 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51001f7a00 con 0x7f510015a040 2024-04-18T04:52:02.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.973+0000 7f5105a00640 1 -- 172.21.15.120:0/2306286529 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5100073fd0 con 0x7f510015a040 2024-04-18T04:52:02.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.977+0000 7f50f6a00640 1 -- 172.21.15.120:0/2306286529 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f50f00b4040 con 0x7f510015a040 2024-04-18T04:52:02.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.977+0000 7f50f6a00640 1 --2- 172.21.15.120:0/2306286529 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f50dc0666c0 0x7f50dc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:02.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.977+0000 7f50f6a00640 1 -- 172.21.15.120:0/2306286529 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f50f00f0060 con 0x7f510015a040 2024-04-18T04:52:02.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.977+0000 7f50fea00640 1 --2- 172.21.15.120:0/2306286529 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f50dc0666c0 0x7f50dc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:02.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.989+0000 7f50fea00640 1 --2- 172.21.15.120:0/2306286529 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f50dc0666c0 0x7f50dc068b80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f50f8004d10 tx=0x7f50f8001c20 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:02.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:02.997+0000 7f50f6a00640 1 -- 172.21.15.120:0/2306286529 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f50f00ebca0 con 0x7f510015a040 2024-04-18T04:52:03.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:03.213+0000 7f5105a00640 1 -- 172.21.15.120:0/2306286529 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51001f7bf0 con 0x7f510015a040 2024-04-18T04:52:03.212 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:52:03.212 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5105,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:51:50.163765+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":4288,"mds_1":4967},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:active","state_seq":31,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:52:03.212 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 37 2024-04-18T04:52:03.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:03.213+0000 7f50f6a00640 1 -- 172.21.15.120:0/2306286529 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+6274 (secure 0 0 0) 0x7f50f00b2070 con 0x7f510015a040 2024-04-18T04:52:03.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:03.217+0000 7f5105a00640 1 -- 172.21.15.120:0/2306286529 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f50dc0666c0 msgr2=0x7f50dc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:03.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:03.217+0000 7f5105a00640 1 --2- 172.21.15.120:0/2306286529 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f50dc0666c0 0x7f50dc068b80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f50f8004d10 tx=0x7f50f8001c20 comp rx=0 tx=0).stop 2024-04-18T04:52:03.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:03.217+0000 7f5105a00640 1 -- 172.21.15.120:0/2306286529 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f510015a040 msgr2=0x7f51001515b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:03.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:03.217+0000 7f5105a00640 1 --2- 172.21.15.120:0/2306286529 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f510015a040 0x7f51001515b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f50f0000c10 tx=0x7f50e4005800 comp rx=0 tx=0).stop 2024-04-18T04:52:03.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:03.217+0000 7f5105a00640 1 -- 172.21.15.120:0/2306286529 shutdown_connections 2024-04-18T04:52:03.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:03.217+0000 7f5105a00640 1 --2- 172.21.15.120:0/2306286529 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f50dc0666c0 0x7f50dc068b80 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:03.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:03.217+0000 7f5105a00640 1 --2- 172.21.15.120:0/2306286529 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f51001f7f20 0x7f51001f83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:03.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:03.217+0000 7f5105a00640 1 --2- 172.21.15.120:0/2306286529 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f510015a040 0x7f51001515b0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:03.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:03.217+0000 7f5105a00640 1 --2- 172.21.15.120:0/2306286529 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50e40047d0 0x7f5100151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:03.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:03.217+0000 7f5105a00640 1 -- 172.21.15.120:0/2306286529 >> 172.21.15.120:0/2306286529 conn(0x7f51000c8a40 msgr2=0x7f5100071a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:52:03.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:03.217+0000 7f5105a00640 1 -- 172.21.15.120:0/2306286529 shutdown_connections 2024-04-18T04:52:03.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:03.217+0000 7f5105a00640 1 -- 172.21.15.120:0/2306286529 wait complete. 2024-04-18T04:52:03.341 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-04-18T04:52:05.342 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:52:05.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.585+0000 7f502e800640 1 Processor -- start 2024-04-18T04:52:05.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.585+0000 7f502e800640 1 -- start start 2024-04-18T04:52:05.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.585+0000 7f502e800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5028150340 0x7f5028156430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:05.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.585+0000 7f502e800640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f502806f9b0 con 0x7f50280c7480 2024-04-18T04:52:05.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.585+0000 7f502e800640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50280c0520 con 0x7f5028156970 2024-04-18T04:52:05.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.585+0000 7f502e800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50280c0800 con 0x7f5028150340 2024-04-18T04:52:05.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.589+0000 7f5027e00640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f50280c7480 0x7f5028160db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:58774/0 (socket says 172.21.15.120:58774) 2024-04-18T04:52:05.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.589+0000 7f5027e00640 1 -- 172.21.15.120:0/3963785637 learned_addr learned my addr 172.21.15.120:0/3963785637 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:52:05.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.589+0000 7f5027400640 1 --2- 172.21.15.120:0/3963785637 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5028150340 0x7f5028156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:05.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.589+0000 7f5026000640 1 -- 172.21.15.120:0/3963785637 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2622850619 0 0) 0x7f502806f9b0 con 0x7f50280c7480 2024-04-18T04:52:05.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.589+0000 7f5026000640 1 -- 172.21.15.120:0/3963785637 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f500c007940 con 0x7f50280c7480 2024-04-18T04:52:05.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.589+0000 7f5026000640 1 -- 172.21.15.120:0/3963785637 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 994374836 0 0) 0x7f50280c0520 con 0x7f5028156970 2024-04-18T04:52:05.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.589+0000 7f5026000640 1 -- 172.21.15.120:0/3963785637 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f502806f9b0 con 0x7f5028156970 2024-04-18T04:52:05.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.589+0000 7f5026000640 1 -- 172.21.15.120:0/3963785637 <== mon.1 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1983081536 0 0) 0x7f502806f9b0 con 0x7f5028156970 2024-04-18T04:52:05.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.589+0000 7f5027400640 1 -- 172.21.15.120:0/3963785637 >> v1:172.21.15.132:6789/0 conn(0x7f5028156970 legacy=0x7f50280c68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:05.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.589+0000 7f5027400640 1 -- 172.21.15.120:0/3963785637 >> v1:172.21.15.120:6789/0 conn(0x7f50280c7480 legacy=0x7f5028160db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:05.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.589+0000 7f5027400640 1 -- 172.21.15.120:0/3963785637 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f502806fc20 con 0x7f5028150340 2024-04-18T04:52:05.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.593+0000 7f5027400640 1 --2- 172.21.15.120:0/3963785637 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5028150340 0x7f5028156430 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f501800b8a0 tx=0x7f501801efc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a1c1544cb0185ea server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:05.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.593+0000 7f5026000640 1 -- 172.21.15.120:0/3963785637 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5020001980 con 0x7f5028150340 2024-04-18T04:52:05.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.593+0000 7f5026000640 1 -- 172.21.15.120:0/3963785637 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50180a8b50 con 0x7f5028150340 2024-04-18T04:52:05.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.593+0000 7f5026000640 1 -- 172.21.15.120:0/3963785637 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50140015b0 con 0x7f5028150340 2024-04-18T04:52:05.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.593+0000 7f502e800640 1 -- 172.21.15.120:0/3963785637 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5028150340 msgr2=0x7f5028156430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:05.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.593+0000 7f502e800640 1 --2- 172.21.15.120:0/3963785637 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5028150340 0x7f5028156430 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f501800b8a0 tx=0x7f501801efc0 comp rx=0 tx=0).stop 2024-04-18T04:52:05.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.593+0000 7f502e800640 1 -- 172.21.15.120:0/3963785637 shutdown_connections 2024-04-18T04:52:05.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.593+0000 7f502e800640 1 --2- 172.21.15.120:0/3963785637 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5028150340 0x7f5028156430 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:05.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.593+0000 7f502e800640 1 -- 172.21.15.120:0/3963785637 >> 172.21.15.120:0/3963785637 conn(0x7f50280c78c0 msgr2=0x7f50280c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:52:05.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.593+0000 7f502e800640 1 -- 172.21.15.120:0/3963785637 shutdown_connections 2024-04-18T04:52:05.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.593+0000 7f502e800640 1 -- 172.21.15.120:0/3963785637 wait complete. 2024-04-18T04:52:05.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.597+0000 7f502e800640 1 Processor -- start 2024-04-18T04:52:05.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.597+0000 7f502e800640 1 -- start start 2024-04-18T04:52:05.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.597+0000 7f502e800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f50280c7480 0x7f50281518d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:05.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.597+0000 7f502e800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5028150340 0x7f50281556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:05.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.597+0000 7f502e800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50280c21c0 0x7f5028152040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:05.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.597+0000 7f502e800640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50281565d0 con 0x7f5028150340 2024-04-18T04:52:05.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.597+0000 7f502e800640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5028156050 con 0x7f50280c21c0 2024-04-18T04:52:05.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.597+0000 7f502e800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50281562f0 con 0x7f50280c7480 2024-04-18T04:52:05.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.597+0000 7f5027400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f50280c7480 0x7f50281518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:05.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.597+0000 7f5027400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f50280c7480 0x7f50281518d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:39374/0 (socket says 172.21.15.120:39374) 2024-04-18T04:52:05.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.597+0000 7f5027400640 1 -- 172.21.15.120:0/98293503 learned_addr learned my addr 172.21.15.120:0/98293503 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:52:05.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.597+0000 7f5026a00640 1 --2- 172.21.15.120:0/98293503 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5028150340 0x7f50281556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:05.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.601+0000 7f5027e00640 1 --2- 172.21.15.120:0/98293503 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50280c21c0 0x7f5028152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:05.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.601+0000 7f5027400640 1 -- 172.21.15.120:0/98293503 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50280c21c0 msgr2=0x7f5028152040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:05.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.601+0000 7f5027400640 1 --2- 172.21.15.120:0/98293503 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50280c21c0 0x7f5028152040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:05.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.601+0000 7f5027400640 1 -- 172.21.15.120:0/98293503 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5028150340 msgr2=0x7f50281556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:05.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.601+0000 7f5027400640 1 --2- 172.21.15.120:0/98293503 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5028150340 0x7f50281556e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:05.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.601+0000 7f5027400640 1 -- 172.21.15.120:0/98293503 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f501800b4d0 con 0x7f50280c7480 2024-04-18T04:52:05.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.601+0000 7f5027e00640 1 --2- 172.21.15.120:0/98293503 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50280c21c0 0x7f5028152040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:52:05.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.601+0000 7f5027400640 1 --2- 172.21.15.120:0/98293503 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f50280c7480 0x7f50281518d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f501800b8a0 tx=0x7f501801bd60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:05.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.601+0000 7f501f400640 1 -- 172.21.15.120:0/98293503 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5018004030 con 0x7f50280c7480 2024-04-18T04:52:05.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.601+0000 7f501f400640 1 -- 172.21.15.120:0/98293503 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5018004190 con 0x7f50280c7480 2024-04-18T04:52:05.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.601+0000 7f501f400640 1 -- 172.21.15.120:0/98293503 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5018004520 con 0x7f50280c7480 2024-04-18T04:52:05.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.601+0000 7f502e800640 1 -- 172.21.15.120:0/98293503 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5028154c00 con 0x7f50280c7480 2024-04-18T04:52:05.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.601+0000 7f502e800640 1 -- 172.21.15.120:0/98293503 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50281551c0 con 0x7f50280c7480 2024-04-18T04:52:05.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.601+0000 7f502e800640 1 -- 172.21.15.120:0/98293503 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50280726d0 con 0x7f50280c7480 2024-04-18T04:52:05.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.605+0000 7f501f400640 1 -- 172.21.15.120:0/98293503 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f50180b7050 con 0x7f50280c7480 2024-04-18T04:52:05.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.605+0000 7f501f400640 1 --2- 172.21.15.120:0/98293503 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f50080666e0 0x7f5008068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:05.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.605+0000 7f501f400640 1 -- 172.21.15.120:0/98293503 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f5018121a40 con 0x7f50280c7480 2024-04-18T04:52:05.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.605+0000 7f5026a00640 1 --2- 172.21.15.120:0/98293503 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f50080666e0 0x7f5008068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:05.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.605+0000 7f5026a00640 1 --2- 172.21.15.120:0/98293503 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f50080666e0 0x7f5008068ba0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f50280b0d90 tx=0x7f5014001170 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:05.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.609+0000 7f501f400640 1 -- 172.21.15.120:0/98293503 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f50180ee8f0 con 0x7f50280c7480 2024-04-18T04:52:05.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.949+0000 7f502e800640 1 -- 172.21.15.120:0/98293503 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50280726d0 con 0x7f50280c7480 2024-04-18T04:52:05.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.949+0000 7f501f400640 1 -- 172.21.15.120:0/98293503 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+6274 (secure 0 0 0) 0x7f50180b5090 con 0x7f50280c7480 2024-04-18T04:52:05.948 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:52:05.948 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5105,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:51:50.163765+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":4288,"mds_1":4967},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_4288":{"gid":4288,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.120:6837/76856194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":76856194},{"type":"v1","addr":"172.21.15.120:6837","nonce":76856194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:active","state_seq":31,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:52:05.948 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 37 2024-04-18T04:52:05.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.957+0000 7f502e800640 1 -- 172.21.15.120:0/98293503 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f50080666e0 msgr2=0x7f5008068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:05.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.957+0000 7f502e800640 1 --2- 172.21.15.120:0/98293503 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f50080666e0 0x7f5008068ba0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f50280b0d90 tx=0x7f5014001170 comp rx=0 tx=0).stop 2024-04-18T04:52:05.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.957+0000 7f502e800640 1 -- 172.21.15.120:0/98293503 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f50280c7480 msgr2=0x7f50281518d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:05.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.957+0000 7f502e800640 1 --2- 172.21.15.120:0/98293503 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f50280c7480 0x7f50281518d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f501800b8a0 tx=0x7f501801bd60 comp rx=0 tx=0).stop 2024-04-18T04:52:05.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.957+0000 7f502e800640 1 -- 172.21.15.120:0/98293503 shutdown_connections 2024-04-18T04:52:05.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.957+0000 7f502e800640 1 --2- 172.21.15.120:0/98293503 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f50080666e0 0x7f5008068ba0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:05.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.957+0000 7f502e800640 1 --2- 172.21.15.120:0/98293503 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50280c21c0 0x7f5028152040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:05.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.957+0000 7f502e800640 1 --2- 172.21.15.120:0/98293503 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5028150340 0x7f50281556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:05.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.957+0000 7f502e800640 1 --2- 172.21.15.120:0/98293503 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f50280c7480 0x7f50281518d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:05.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.957+0000 7f502e800640 1 -- 172.21.15.120:0/98293503 >> 172.21.15.120:0/98293503 conn(0x7f50280c78c0 msgr2=0x7f50280c60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:52:05.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.957+0000 7f502e800640 1 -- 172.21.15.120:0/98293503 shutdown_connections 2024-04-18T04:52:05.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:05.957+0000 7f502e800640 1 -- 172.21.15.120:0/98293503 wait complete. 2024-04-18T04:52:05.992 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-04-18T04:52:07.993 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:52:08.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.225+0000 7f258d000640 1 Processor -- start 2024-04-18T04:52:08.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.225+0000 7f258d000640 1 -- start start 2024-04-18T04:52:08.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.225+0000 7f258d000640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2588157a00 0x7f25880c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:08.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.225+0000 7f258d000640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f25880c0330 0x7f2588157de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:08.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.225+0000 7f258d000640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f258815e970 con 0x7f258806b660 2024-04-18T04:52:08.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.225+0000 7f258d000640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2588158320 con 0x7f25880c0330 2024-04-18T04:52:08.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.225+0000 7f258d000640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2588162170 con 0x7f2588157a00 2024-04-18T04:52:08.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.229+0000 7f2585e00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2588157a00 0x7f25880c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:08.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.229+0000 7f2585e00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2588157a00 0x7f25880c69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:52460/0 (socket says 172.21.15.120:52460) 2024-04-18T04:52:08.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.229+0000 7f2585e00640 1 -- 172.21.15.120:0/460255272 learned_addr learned my addr 172.21.15.120:0/460255272 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:52:08.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.229+0000 7f2585e00640 1 -- 172.21.15.120:0/460255272 >> v2:172.21.15.120:3300/0 conn(0x7f25880c0330 msgr2=0x7f2588157de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:52:08.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.229+0000 7f2585e00640 1 --2- 172.21.15.120:0/460255272 >> v2:172.21.15.120:3300/0 conn(0x7f25880c0330 0x7f2588157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:08.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.229+0000 7f2585e00640 1 -- 172.21.15.120:0/460255272 >> v1:172.21.15.120:6789/0 conn(0x7f258806b660 legacy=0x7f258806bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:52:08.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.229+0000 7f2585e00640 1 -- 172.21.15.120:0/460255272 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25880c0780 con 0x7f2588157a00 2024-04-18T04:52:08.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.233+0000 7f2585e00640 1 --2- 172.21.15.120:0/460255272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2588157a00 0x7f25880c69e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2588074050 tx=0x7f258001f1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11c33c4e8a4bee10 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:08.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.233+0000 7f2584a00640 1 -- 172.21.15.120:0/460255272 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25800af400 con 0x7f2588157a00 2024-04-18T04:52:08.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.233+0000 7f2584a00640 1 -- 172.21.15.120:0/460255272 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25800ab050 con 0x7f2588157a00 2024-04-18T04:52:08.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.233+0000 7f2584a00640 1 -- 172.21.15.120:0/460255272 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25800af780 con 0x7f2588157a00 2024-04-18T04:52:08.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.233+0000 7f258d000640 1 -- 172.21.15.120:0/460255272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2588157a00 msgr2=0x7f25880c69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:08.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.233+0000 7f258d000640 1 --2- 172.21.15.120:0/460255272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2588157a00 0x7f25880c69e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2588074050 tx=0x7f258001f1a0 comp rx=0 tx=0).stop 2024-04-18T04:52:08.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.233+0000 7f258d000640 1 -- 172.21.15.120:0/460255272 shutdown_connections 2024-04-18T04:52:08.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.233+0000 7f258d000640 1 --2- 172.21.15.120:0/460255272 >> v2:172.21.15.120:3300/0 conn(0x7f25880c0330 0x7f2588157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:08.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.233+0000 7f258d000640 1 --2- 172.21.15.120:0/460255272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2588157a00 0x7f25880c69e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:08.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.233+0000 7f258d000640 1 -- 172.21.15.120:0/460255272 >> 172.21.15.120:0/460255272 conn(0x7f25880c78c0 msgr2=0x7f25880c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:52:08.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.237+0000 7f258d000640 1 -- 172.21.15.120:0/460255272 shutdown_connections 2024-04-18T04:52:08.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.237+0000 7f258d000640 1 -- 172.21.15.120:0/460255272 wait complete. 2024-04-18T04:52:08.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.237+0000 7f258d000640 1 Processor -- start 2024-04-18T04:52:08.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.237+0000 7f258d000640 1 -- start start 2024-04-18T04:52:08.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.241+0000 7f258d000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f258806b660 0x7f258806d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:08.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.241+0000 7f258d000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25880c0330 0x7f2588160d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:08.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.241+0000 7f258d000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2588157a00 0x7f2588152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:08.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.241+0000 7f2585400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25880c0330 0x7f2588160d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:08.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.241+0000 7f2585e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f258806b660 0x7f258806d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:08.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.241+0000 7f2585e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f258806b660 0x7f258806d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:52470/0 (socket says 172.21.15.120:52470) 2024-04-18T04:52:08.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.241+0000 7f2585400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25880c0330 0x7f2588160d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36984/0 (socket says 172.21.15.120:36984) 2024-04-18T04:52:08.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.241+0000 7f2585e00640 1 -- 172.21.15.120:0/1198061212 learned_addr learned my addr 172.21.15.120:0/1198061212 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:52:08.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.241+0000 7f258d000640 1 -- 172.21.15.120:0/1198061212 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2588161940 con 0x7f25880c0330 2024-04-18T04:52:08.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.241+0000 7f2586800640 1 --2- 172.21.15.120:0/1198061212 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2588157a00 0x7f2588152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:08.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.241+0000 7f258d000640 1 -- 172.21.15.120:0/1198061212 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25881f41e0 con 0x7f258806b660 2024-04-18T04:52:08.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.241+0000 7f258d000640 1 -- 172.21.15.120:0/1198061212 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25881f4710 con 0x7f2588157a00 2024-04-18T04:52:08.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.245+0000 7f2586800640 1 -- 172.21.15.120:0/1198061212 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f258806b660 msgr2=0x7f258806d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:08.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.245+0000 7f2586800640 1 --2- 172.21.15.120:0/1198061212 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f258806b660 0x7f258806d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:08.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.245+0000 7f2586800640 1 -- 172.21.15.120:0/1198061212 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25880c0330 msgr2=0x7f2588160d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:08.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.245+0000 7f2586800640 1 --2- 172.21.15.120:0/1198061212 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25880c0330 0x7f2588160d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:08.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.245+0000 7f2586800640 1 -- 172.21.15.120:0/1198061212 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2580009b30 con 0x7f2588157a00 2024-04-18T04:52:08.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.245+0000 7f2586800640 1 --2- 172.21.15.120:0/1198061212 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2588157a00 0x7f2588152f00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2574009420 tx=0x7f25740098e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:08.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.245+0000 7f257e000640 1 -- 172.21.15.120:0/1198061212 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25740107b0 con 0x7f2588157a00 2024-04-18T04:52:08.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.245+0000 7f257e000640 1 -- 172.21.15.120:0/1198061212 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2574010910 con 0x7f2588157a00 2024-04-18T04:52:08.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.245+0000 7f257e000640 1 -- 172.21.15.120:0/1198061212 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2574010cc0 con 0x7f2588157a00 2024-04-18T04:52:08.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.245+0000 7f258d000640 1 -- 172.21.15.120:0/1198061212 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2588161b20 con 0x7f2588157a00 2024-04-18T04:52:08.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.245+0000 7f258d000640 1 -- 172.21.15.120:0/1198061212 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25881e9a50 con 0x7f2588157a00 2024-04-18T04:52:08.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.249+0000 7f258d000640 1 -- 172.21.15.120:0/1198061212 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25881e98b0 con 0x7f2588157a00 2024-04-18T04:52:08.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.249+0000 7f257e000640 1 -- 172.21.15.120:0/1198061212 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f257401b460 con 0x7f2588157a00 2024-04-18T04:52:08.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.253+0000 7f257e000640 1 --2- 172.21.15.120:0/1198061212 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2568066760 0x7f2568068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:08.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.253+0000 7f257e000640 1 -- 172.21.15.120:0/1198061212 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f25740841b0 con 0x7f2588157a00 2024-04-18T04:52:08.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.253+0000 7f2585e00640 1 --2- 172.21.15.120:0/1198061212 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2568066760 0x7f2568068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:08.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.253+0000 7f2585e00640 1 --2- 172.21.15.120:0/1198061212 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2568066760 0x7f2568068c20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2580000f90 tx=0x7f25800aa000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:08.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.269+0000 7f257e000640 1 -- 172.21.15.120:0/1198061212 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f25881e98b0 con 0x7f2588157a00 2024-04-18T04:52:08.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.765+0000 7f258d000640 1 -- 172.21.15.120:0/1198061212 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25881e98b0 con 0x7f2588157a00 2024-04-18T04:52:08.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.765+0000 7f257e000640 1 -- 172.21.15.120:0/1198061212 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+5521 (secure 0 0 0) 0x7f25881e98b0 con 0x7f2588157a00 2024-04-18T04:52:08.766 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:52:08.766 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:52:05.994323+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5105,"mds_1":4967},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:active","state_seq":31,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5105":{"gid":5105,"name":"c","rank":0,"incarnation":38,"state":"up:replay","state_seq":1,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:52:08.766 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 38 2024-04-18T04:52:08.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.773+0000 7f258d000640 1 -- 172.21.15.120:0/1198061212 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2568066760 msgr2=0x7f2568068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:08.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.773+0000 7f258d000640 1 --2- 172.21.15.120:0/1198061212 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2568066760 0x7f2568068c20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2580000f90 tx=0x7f25800aa000 comp rx=0 tx=0).stop 2024-04-18T04:52:08.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.773+0000 7f258d000640 1 -- 172.21.15.120:0/1198061212 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2588157a00 msgr2=0x7f2588152f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:08.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.773+0000 7f258d000640 1 --2- 172.21.15.120:0/1198061212 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2588157a00 0x7f2588152f00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2574009420 tx=0x7f25740098e0 comp rx=0 tx=0).stop 2024-04-18T04:52:08.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.773+0000 7f258d000640 1 -- 172.21.15.120:0/1198061212 shutdown_connections 2024-04-18T04:52:08.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.773+0000 7f258d000640 1 --2- 172.21.15.120:0/1198061212 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2568066760 0x7f2568068c20 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:08.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.773+0000 7f258d000640 1 --2- 172.21.15.120:0/1198061212 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2588157a00 0x7f2588152f00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:08.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.773+0000 7f258d000640 1 --2- 172.21.15.120:0/1198061212 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25880c0330 0x7f2588160d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:08.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.773+0000 7f258d000640 1 --2- 172.21.15.120:0/1198061212 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f258806b660 0x7f258806d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:08.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.773+0000 7f258d000640 1 -- 172.21.15.120:0/1198061212 >> 172.21.15.120:0/1198061212 conn(0x7f25880c78c0 msgr2=0x7f2588155fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:52:08.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.773+0000 7f258d000640 1 -- 172.21.15.120:0/1198061212 shutdown_connections 2024-04-18T04:52:08.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:08.773+0000 7f258d000640 1 -- 172.21.15.120:0/1198061212 wait complete. 2024-04-18T04:52:08.834 INFO:tasks.mds_thrash.fs.[cephfs]:mds.e down, removed from mdsmap 2024-04-18T04:52:08.834 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for mds cluster to stabilize... 2024-04-18T04:52:08.834 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:52:09.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.105+0000 7f5621e00640 1 Processor -- start 2024-04-18T04:52:09.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.105+0000 7f5621e00640 1 -- start start 2024-04-18T04:52:09.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.105+0000 7f5621e00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f561c06c6d0 0x7f561c0c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:09.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.105+0000 7f5621e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f561c1699d0 0x7f561c169de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:09.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.105+0000 7f5621e00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f561c06b800 con 0x7f561c163a90 2024-04-18T04:52:09.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.105+0000 7f5621e00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f561c070130 con 0x7f561c1699d0 2024-04-18T04:52:09.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.105+0000 7f5621e00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f561c0c72e0 con 0x7f561c06c6d0 2024-04-18T04:52:09.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.105+0000 7f561aa00640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f561c163a90 0x7f561c06bfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:52794/0 (socket says 172.21.15.120:52794) 2024-04-18T04:52:09.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.105+0000 7f561aa00640 1 -- 172.21.15.120:0/512252104 learned_addr learned my addr 172.21.15.120:0/512252104 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:52:09.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.105+0000 7f561a000640 1 --2- 172.21.15.120:0/512252104 >> v2:172.21.15.132:3300/0 conn(0x7f561c06c6d0 0x7f561c0c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:09.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.109+0000 7f561b400640 1 --2- 172.21.15.120:0/512252104 >> v2:172.21.15.120:3300/0 conn(0x7f561c1699d0 0x7f561c169de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:09.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.109+0000 7f5619600640 1 -- 172.21.15.120:0/512252104 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4115467203 0 0) 0x7f561c06b800 con 0x7f561c163a90 2024-04-18T04:52:09.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.125+0000 7f5619600640 1 -- 172.21.15.120:0/512252104 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5600003530 con 0x7f561c163a90 2024-04-18T04:52:09.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.125+0000 7f561b400640 1 -- 172.21.15.120:0/512252104 >> v2:172.21.15.132:3300/0 conn(0x7f561c06c6d0 msgr2=0x7f561c0c61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:52:09.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.125+0000 7f561b400640 1 --2- 172.21.15.120:0/512252104 >> v2:172.21.15.132:3300/0 conn(0x7f561c06c6d0 0x7f561c0c61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:09.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.125+0000 7f561b400640 1 -- 172.21.15.120:0/512252104 >> v1:172.21.15.132:6789/0 conn(0x7f561c163a90 legacy=0x7f561c06bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:09.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.125+0000 7f561b400640 1 -- 172.21.15.120:0/512252104 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f561c0c6d20 con 0x7f561c1699d0 2024-04-18T04:52:09.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.133+0000 7f561b400640 1 --2- 172.21.15.120:0/512252104 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f561c1699d0 0x7f561c169de0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f561c06ebc0 tx=0x7f560c01f0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a648cecd52fc94c server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:09.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.133+0000 7f5619600640 1 -- 172.21.15.120:0/512252104 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560c0b0440 con 0x7f561c1699d0 2024-04-18T04:52:09.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.133+0000 7f5619600640 1 -- 172.21.15.120:0/512252104 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f560c0b05a0 con 0x7f561c1699d0 2024-04-18T04:52:09.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.133+0000 7f5619600640 1 -- 172.21.15.120:0/512252104 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560c0b0930 con 0x7f561c1699d0 2024-04-18T04:52:09.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.133+0000 7f5621e00640 1 -- 172.21.15.120:0/512252104 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f561c1699d0 msgr2=0x7f561c169de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:09.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.133+0000 7f5621e00640 1 --2- 172.21.15.120:0/512252104 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f561c1699d0 0x7f561c169de0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f561c06ebc0 tx=0x7f560c01f0e0 comp rx=0 tx=0).stop 2024-04-18T04:52:09.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.137+0000 7f5621e00640 1 -- 172.21.15.120:0/512252104 shutdown_connections 2024-04-18T04:52:09.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.137+0000 7f5621e00640 1 --2- 172.21.15.120:0/512252104 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f561c1699d0 0x7f561c169de0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:09.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.137+0000 7f5621e00640 1 --2- 172.21.15.120:0/512252104 >> v2:172.21.15.132:3300/0 conn(0x7f561c06c6d0 0x7f561c0c61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:09.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.137+0000 7f5621e00640 1 -- 172.21.15.120:0/512252104 >> 172.21.15.120:0/512252104 conn(0x7f561c0c78c0 msgr2=0x7f561c0c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:52:09.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.137+0000 7f5621e00640 1 -- 172.21.15.120:0/512252104 shutdown_connections 2024-04-18T04:52:09.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.137+0000 7f5621e00640 1 -- 172.21.15.120:0/512252104 wait complete. 2024-04-18T04:52:09.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.141+0000 7f5621e00640 1 Processor -- start 2024-04-18T04:52:09.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.149+0000 7f5621e00640 1 -- start start 2024-04-18T04:52:09.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.153+0000 7f5621e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f561c06c6d0 0x7f561c15beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:09.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.153+0000 7f5621e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f561c163a90 0x7f561c15aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:09.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.153+0000 7f5621e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f561c1699d0 0x7f561c170f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:09.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.153+0000 7f561a000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f561c163a90 0x7f561c15aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:09.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.153+0000 7f561a000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f561c163a90 0x7f561c15aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:52478/0 (socket says 172.21.15.120:52478) 2024-04-18T04:52:09.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.153+0000 7f561a000640 1 -- 172.21.15.120:0/2716855610 learned_addr learned my addr 172.21.15.120:0/2716855610 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:52:09.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.153+0000 7f5621e00640 1 -- 172.21.15.120:0/2716855610 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f561c0c9ec0 con 0x7f561c1699d0 2024-04-18T04:52:09.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.153+0000 7f561b400640 1 --2- 172.21.15.120:0/2716855610 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f561c1699d0 0x7f561c170f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:09.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.153+0000 7f5621e00640 1 -- 172.21.15.120:0/2716855610 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f561c205220 con 0x7f561c163a90 2024-04-18T04:52:09.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.153+0000 7f5621e00640 1 -- 172.21.15.120:0/2716855610 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f561c204910 con 0x7f561c06c6d0 2024-04-18T04:52:09.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.153+0000 7f561b400640 1 -- 172.21.15.120:0/2716855610 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f561c06c6d0 msgr2=0x7f561c15beb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:52:09.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.153+0000 7f561b400640 1 --2- 172.21.15.120:0/2716855610 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f561c06c6d0 0x7f561c15beb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:09.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.153+0000 7f561b400640 1 -- 172.21.15.120:0/2716855610 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f561c163a90 msgr2=0x7f561c15aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:09.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.153+0000 7f561b400640 1 --2- 172.21.15.120:0/2716855610 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f561c163a90 0x7f561c15aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:09.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.153+0000 7f561b400640 1 -- 172.21.15.120:0/2716855610 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f560c009a70 con 0x7f561c1699d0 2024-04-18T04:52:09.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.157+0000 7f561b400640 1 --2- 172.21.15.120:0/2716855610 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f561c1699d0 0x7f561c170f60 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f561c06ef20 tx=0x7f560c01be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:09.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.157+0000 7f5613400640 1 -- 172.21.15.120:0/2716855610 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560c0c0070 con 0x7f561c1699d0 2024-04-18T04:52:09.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.157+0000 7f5613400640 1 -- 172.21.15.120:0/2716855610 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f560c0b0920 con 0x7f561c1699d0 2024-04-18T04:52:09.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.157+0000 7f5613400640 1 -- 172.21.15.120:0/2716855610 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560c0b0cf0 con 0x7f561c1699d0 2024-04-18T04:52:09.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.157+0000 7f5621e00640 1 -- 172.21.15.120:0/2716855610 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f561c15c4d0 con 0x7f561c1699d0 2024-04-18T04:52:09.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.157+0000 7f5621e00640 1 -- 172.21.15.120:0/2716855610 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f561c204bd0 con 0x7f561c1699d0 2024-04-18T04:52:09.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.161+0000 7f5621e00640 1 -- 172.21.15.120:0/2716855610 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f561c073e10 con 0x7f561c1699d0 2024-04-18T04:52:09.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.169+0000 7f5613400640 1 -- 172.21.15.120:0/2716855610 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f560c0b7070 con 0x7f561c1699d0 2024-04-18T04:52:09.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.169+0000 7f5613400640 1 --2- 172.21.15.120:0/2716855610 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f55fc066790 0x7f55fc068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:09.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.173+0000 7f5613400640 1 -- 172.21.15.120:0/2716855610 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f560c121c60 con 0x7f561c1699d0 2024-04-18T04:52:09.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.173+0000 7f561aa00640 1 --2- 172.21.15.120:0/2716855610 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f55fc066790 0x7f55fc068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:09.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.189+0000 7f5613400640 1 -- 172.21.15.120:0/2716855610 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f560c0eeaa0 con 0x7f561c1699d0 2024-04-18T04:52:09.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.189+0000 7f561aa00640 1 --2- 172.21.15.120:0/2716855610 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f55fc066790 0x7f55fc068c50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5614000c10 tx=0x7f5614007990 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:09.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.573+0000 7f5621e00640 1 -- 172.21.15.120:0/2716855610 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f561c072a70 con 0x7f561c1699d0 2024-04-18T04:52:09.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.573+0000 7f5613400640 1 -- 172.21.15.120:0/2716855610 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+5521 (secure 0 0 0) 0x7f560c0b5090 con 0x7f561c1699d0 2024-04-18T04:52:09.571 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:52:09.572 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:52:05.994323+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5105,"mds_1":4967},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:active","state_seq":31,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5105":{"gid":5105,"name":"c","rank":0,"incarnation":38,"state":"up:replay","state_seq":1,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:52:09.572 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 38 2024-04-18T04:52:09.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.577+0000 7f5621e00640 1 -- 172.21.15.120:0/2716855610 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f55fc066790 msgr2=0x7f55fc068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:09.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.577+0000 7f5621e00640 1 --2- 172.21.15.120:0/2716855610 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f55fc066790 0x7f55fc068c50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5614000c10 tx=0x7f5614007990 comp rx=0 tx=0).stop 2024-04-18T04:52:09.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.577+0000 7f5621e00640 1 -- 172.21.15.120:0/2716855610 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f561c1699d0 msgr2=0x7f561c170f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:09.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.577+0000 7f5621e00640 1 --2- 172.21.15.120:0/2716855610 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f561c1699d0 0x7f561c170f60 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f561c06ef20 tx=0x7f560c01be80 comp rx=0 tx=0).stop 2024-04-18T04:52:09.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.581+0000 7f5621e00640 1 -- 172.21.15.120:0/2716855610 shutdown_connections 2024-04-18T04:52:09.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.581+0000 7f5621e00640 1 --2- 172.21.15.120:0/2716855610 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f55fc066790 0x7f55fc068c50 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:09.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.581+0000 7f5621e00640 1 --2- 172.21.15.120:0/2716855610 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f561c1699d0 0x7f561c170f60 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:09.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.581+0000 7f5621e00640 1 --2- 172.21.15.120:0/2716855610 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f561c163a90 0x7f561c15aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:09.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.581+0000 7f5621e00640 1 --2- 172.21.15.120:0/2716855610 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f561c06c6d0 0x7f561c15beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:09.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.581+0000 7f5621e00640 1 -- 172.21.15.120:0/2716855610 >> 172.21.15.120:0/2716855610 conn(0x7f561c0c78c0 msgr2=0x7f561c1677d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:52:09.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.585+0000 7f5621e00640 1 -- 172.21.15.120:0/2716855610 shutdown_connections 2024-04-18T04:52:09.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:09.585+0000 7f5621e00640 1 -- 172.21.15.120:0/2716855610 wait complete. 2024-04-18T04:52:09.678 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 38, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-18T04:44:30.251235+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 38, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1 ], "info": { "gid_4967": { "addr": "172.21.15.132:6835/396956733", "addrs": { "addrvec": [ { "addr": "172.21.15.132:6834", "nonce": 396956733, "type": "v2" }, { "addr": "172.21.15.132:6835", "nonce": 396956733, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4967, "incarnation": 28, "join_fscid": -1, "name": "b", "rank": 1, "state": "up:active", "state_seq": 31 }, "gid_5105": { "addr": "172.21.15.120:6833/3842815393", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6832", "nonce": 3842815393, "type": "v2" }, { "addr": "172.21.15.120:6833", "nonce": 3842815393, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5105, "incarnation": 38, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 31, "max_file_size": 1099511627776, "max_mds": 2, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-18T04:52:05.994323+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [ 2 ], "tableserver": 0, "up": { "mds_0": 5105, "mds_1": 4967 } } } ], "standbys": [ { "addr": "172.21.15.132:6839/4292136288", "addrs": { "addrvec": [ { "addr": "172.21.15.132:6836", "nonce": 4292136288, "type": "v2" }, { "addr": "172.21.15.132:6839", "nonce": 4292136288, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4241, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.132:6838/1712856922", "addrs": { "addrvec": [ { "addr": "172.21.15.132:6837", "nonce": 1712856922, "type": "v2" }, { "addr": "172.21.15.132:6838", "nonce": 1712856922, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 2, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4244, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.120:6836/2384594941", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6834", "nonce": 2384594941, "type": "v2" }, { "addr": "172.21.15.120:6836", "nonce": 2384594941, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 33, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5051, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-18T04:52:11.679 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:52:11.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.945+0000 7f7658200640 1 Processor -- start 2024-04-18T04:52:11.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.945+0000 7f7658200640 1 -- start start 2024-04-18T04:52:11.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.949+0000 7f7658200640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f765006b040 0x7f76500c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:11.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.949+0000 7f7658200640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f765006ca10 0x7f765015db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:11.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.949+0000 7f7658200640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f765006e280 con 0x7f7650157e90 2024-04-18T04:52:11.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.949+0000 7f7658200640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7650158270 con 0x7f765006b040 2024-04-18T04:52:11.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.949+0000 7f7658200640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76500c9710 con 0x7f765006ca10 2024-04-18T04:52:11.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.949+0000 7f7655800640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f7650157e90 0x7f76500c9900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:55048/0 (socket says 172.21.15.120:55048) 2024-04-18T04:52:11.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.949+0000 7f7655800640 1 -- 172.21.15.120:0/3672272751 learned_addr learned my addr 172.21.15.120:0/3672272751 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:52:11.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.953+0000 7f7656200640 1 --2- 172.21.15.120:0/3672272751 >> v2:172.21.15.132:3300/0 conn(0x7f765006ca10 0x7f765015db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:11.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.949+0000 7f7654e00640 1 --2- 172.21.15.120:0/3672272751 >> v2:172.21.15.120:3300/0 conn(0x7f765006b040 0x7f76500c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:11.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.953+0000 7f7656200640 1 -- 172.21.15.120:0/3672272751 >> v2:172.21.15.120:3300/0 conn(0x7f765006b040 msgr2=0x7f76500c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:52:11.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.953+0000 7f7656200640 1 --2- 172.21.15.120:0/3672272751 >> v2:172.21.15.120:3300/0 conn(0x7f765006b040 0x7f76500c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:11.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.953+0000 7f7656200640 1 -- 172.21.15.120:0/3672272751 >> v1:172.21.15.120:6789/0 conn(0x7f7650157e90 legacy=0x7f76500c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:11.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.953+0000 7f7656200640 1 -- 172.21.15.120:0/3672272751 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f765006cf80 con 0x7f765006ca10 2024-04-18T04:52:11.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.957+0000 7f7654e00640 1 --2- 172.21.15.120:0/3672272751 >> v2:172.21.15.120:3300/0 conn(0x7f765006b040 0x7f76500c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:52:11.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.957+0000 7f7656200640 1 --2- 172.21.15.120:0/3672272751 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f765006ca10 0x7f765015db30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f765006c680 tx=0x7f764801c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61ff8219937054a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:11.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.961+0000 7f764fe00640 1 -- 172.21.15.120:0/3672272751 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76480a5950 con 0x7f765006ca10 2024-04-18T04:52:11.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.961+0000 7f764fe00640 1 -- 172.21.15.120:0/3672272751 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76480a5ab0 con 0x7f765006ca10 2024-04-18T04:52:11.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.961+0000 7f764fe00640 1 -- 172.21.15.120:0/3672272751 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76480a5e80 con 0x7f765006ca10 2024-04-18T04:52:11.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.961+0000 7f7658200640 1 -- 172.21.15.120:0/3672272751 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f765006ca10 msgr2=0x7f765015db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:11.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.961+0000 7f7658200640 1 --2- 172.21.15.120:0/3672272751 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f765006ca10 0x7f765015db30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f765006c680 tx=0x7f764801c890 comp rx=0 tx=0).stop 2024-04-18T04:52:11.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.961+0000 7f7658200640 1 -- 172.21.15.120:0/3672272751 shutdown_connections 2024-04-18T04:52:11.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.961+0000 7f7658200640 1 --2- 172.21.15.120:0/3672272751 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f765006ca10 0x7f765015db30 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:11.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.961+0000 7f7658200640 1 --2- 172.21.15.120:0/3672272751 >> v2:172.21.15.120:3300/0 conn(0x7f765006b040 0x7f76500c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:11.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.961+0000 7f7658200640 1 -- 172.21.15.120:0/3672272751 >> 172.21.15.120:0/3672272751 conn(0x7f76500720e0 msgr2=0x7f7650065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:52:11.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.961+0000 7f7658200640 1 -- 172.21.15.120:0/3672272751 shutdown_connections 2024-04-18T04:52:11.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.961+0000 7f7658200640 1 -- 172.21.15.120:0/3672272751 wait complete. 2024-04-18T04:52:11.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.969+0000 7f7658200640 1 Processor -- start 2024-04-18T04:52:11.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.973+0000 7f7658200640 1 -- start start 2024-04-18T04:52:11.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.977+0000 7f7658200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f765006b040 0x7f76501f9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:11.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.977+0000 7f7658200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f765006ca10 0x7f76501fa460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:11.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.977+0000 7f7655800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f765006b040 0x7f76501f9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:11.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.977+0000 7f7654e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f765006ca10 0x7f76501fa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:11.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.977+0000 7f7654e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f765006ca10 0x7f76501fa460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:59594/0 (socket says 172.21.15.120:59594) 2024-04-18T04:52:11.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.977+0000 7f7655800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f765006b040 0x7f76501f9f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:51584/0 (socket says 172.21.15.120:51584) 2024-04-18T04:52:11.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.977+0000 7f7658200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7650157e90 0x7f765014a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:11.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.977+0000 7f7654e00640 1 -- 172.21.15.120:0/1971730964 learned_addr learned my addr 172.21.15.120:0/1971730964 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:52:11.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.977+0000 7f7658200640 1 -- 172.21.15.120:0/1971730964 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76501faa90 con 0x7f7650157e90 2024-04-18T04:52:11.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.977+0000 7f7658200640 1 -- 172.21.15.120:0/1971730964 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76500cbf20 con 0x7f765006b040 2024-04-18T04:52:11.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.977+0000 7f7658200640 1 -- 172.21.15.120:0/1971730964 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76500cc200 con 0x7f765006ca10 2024-04-18T04:52:11.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.981+0000 7f7656200640 1 --2- 172.21.15.120:0/1971730964 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7650157e90 0x7f765014a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:11.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.981+0000 7f7655800640 1 -- 172.21.15.120:0/1971730964 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f765006ca10 msgr2=0x7f76501fa460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:11.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.981+0000 7f7655800640 1 --2- 172.21.15.120:0/1971730964 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f765006ca10 0x7f76501fa460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:11.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.981+0000 7f7655800640 1 -- 172.21.15.120:0/1971730964 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7650157e90 msgr2=0x7f765014a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:11.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.981+0000 7f7655800640 1 --2- 172.21.15.120:0/1971730964 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7650157e90 0x7f765014a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:11.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.981+0000 7f7655800640 1 -- 172.21.15.120:0/1971730964 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7648009a70 con 0x7f765006b040 2024-04-18T04:52:11.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.981+0000 7f7654e00640 1 --2- 172.21.15.120:0/1971730964 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f765006ca10 0x7f76501fa460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:52:11.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.981+0000 7f7655800640 1 --2- 172.21.15.120:0/1971730964 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f765006b040 0x7f76501f9f20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f763c00c390 tx=0x7f763c00c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:11.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.981+0000 7f764d600640 1 -- 172.21.15.120:0/1971730964 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c005cf0 con 0x7f765006b040 2024-04-18T04:52:11.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.981+0000 7f7658200640 1 -- 172.21.15.120:0/1971730964 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76500cc4e0 con 0x7f765006b040 2024-04-18T04:52:11.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.981+0000 7f764d600640 1 -- 172.21.15.120:0/1971730964 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763c005e50 con 0x7f765006b040 2024-04-18T04:52:11.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.981+0000 7f764d600640 1 -- 172.21.15.120:0/1971730964 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c005cf0 con 0x7f765006b040 2024-04-18T04:52:11.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.981+0000 7f7658200640 1 -- 172.21.15.120:0/1971730964 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f765015b830 con 0x7f765006b040 2024-04-18T04:52:11.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.985+0000 7f7658200640 1 -- 172.21.15.120:0/1971730964 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7650149fc0 con 0x7f765006b040 2024-04-18T04:52:11.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.989+0000 7f764d600640 1 -- 172.21.15.120:0/1971730964 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f763c0070d0 con 0x7f765006b040 2024-04-18T04:52:11.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.989+0000 7f764d600640 1 --2- 172.21.15.120:0/1971730964 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f76300666f0 0x7f7630068bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:11.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.989+0000 7f7654e00640 1 --2- 172.21.15.120:0/1971730964 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f76300666f0 0x7f7630068bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:11.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.989+0000 7f764d600640 1 -- 172.21.15.120:0/1971730964 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f763c083640 con 0x7f765006b040 2024-04-18T04:52:11.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.993+0000 7f7654e00640 1 --2- 172.21.15.120:0/1971730964 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f76300666f0 0x7f7630068bb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f76500c7170 tx=0x7f7644008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:11.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:11.997+0000 7f764d600640 1 -- 172.21.15.120:0/1971730964 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f763c088060 con 0x7f765006b040 2024-04-18T04:52:12.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:12.469+0000 7f7658200640 1 -- 172.21.15.120:0/1971730964 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7650072a70 con 0x7f765006b040 2024-04-18T04:52:12.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:12.469+0000 7f764d600640 1 -- 172.21.15.120:0/1971730964 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+5521 (secure 0 0 0) 0x7f763c017020 con 0x7f765006b040 2024-04-18T04:52:12.470 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:52:12.470 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:52:05.994323+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5105,"mds_1":4967},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:active","state_seq":31,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5105":{"gid":5105,"name":"c","rank":0,"incarnation":38,"state":"up:replay","state_seq":1,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:52:12.470 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 38 2024-04-18T04:52:12.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:12.485+0000 7f7658200640 1 -- 172.21.15.120:0/1971730964 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f76300666f0 msgr2=0x7f7630068bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:12.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:12.485+0000 7f7658200640 1 --2- 172.21.15.120:0/1971730964 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f76300666f0 0x7f7630068bb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f76500c7170 tx=0x7f7644008040 comp rx=0 tx=0).stop 2024-04-18T04:52:12.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:12.485+0000 7f7658200640 1 -- 172.21.15.120:0/1971730964 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f765006b040 msgr2=0x7f76501f9f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:12.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:12.485+0000 7f7658200640 1 --2- 172.21.15.120:0/1971730964 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f765006b040 0x7f76501f9f20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f763c00c390 tx=0x7f763c00c850 comp rx=0 tx=0).stop 2024-04-18T04:52:12.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:12.485+0000 7f7658200640 1 -- 172.21.15.120:0/1971730964 shutdown_connections 2024-04-18T04:52:12.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:12.485+0000 7f7658200640 1 --2- 172.21.15.120:0/1971730964 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f76300666f0 0x7f7630068bb0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:12.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:12.485+0000 7f7658200640 1 --2- 172.21.15.120:0/1971730964 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7650157e90 0x7f765014a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:12.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:12.485+0000 7f7658200640 1 --2- 172.21.15.120:0/1971730964 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f765006ca10 0x7f76501fa460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:12.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:12.485+0000 7f7658200640 1 --2- 172.21.15.120:0/1971730964 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f765006b040 0x7f76501f9f20 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:12.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:12.485+0000 7f7658200640 1 -- 172.21.15.120:0/1971730964 >> 172.21.15.120:0/1971730964 conn(0x7f76500720e0 msgr2=0x7f7650152800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:52:12.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:12.485+0000 7f7658200640 1 -- 172.21.15.120:0/1971730964 shutdown_connections 2024-04-18T04:52:12.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:12.485+0000 7f7658200640 1 -- 172.21.15.120:0/1971730964 wait complete. 2024-04-18T04:52:12.525 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:52:13.444 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:52:13.455 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:52:14.527 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:52:14.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.845+0000 7f83b0200640 1 Processor -- start 2024-04-18T04:52:14.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.845+0000 7f83b0200640 1 -- start start 2024-04-18T04:52:14.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.845+0000 7f83b0200640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f83a80c7480 0x7f83a80c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:14.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.845+0000 7f83b0200640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f83a80bfe70 0x7f83a80c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:14.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.849+0000 7f83ace00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f83a80c7480 0x7f83a80c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:14.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.849+0000 7f83ace00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f83a80c7480 0x7f83a80c68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:51600/0 (socket says 172.21.15.120:51600) 2024-04-18T04:52:14.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.849+0000 7f83ace00640 1 -- 172.21.15.120:0/2464067646 learned_addr learned my addr 172.21.15.120:0/2464067646 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:52:14.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.849+0000 7f83b0200640 1 -- 172.21.15.120:0/2464067646 --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83a806f9b0 con 0x7f83a8150340 2024-04-18T04:52:14.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.849+0000 7f83b0200640 1 -- 172.21.15.120:0/2464067646 --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83a8156b40 con 0x7f83a80bfe70 2024-04-18T04:52:14.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.849+0000 7f83b0200640 1 -- 172.21.15.120:0/2464067646 --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83a80c0520 con 0x7f83a80c7480 2024-04-18T04:52:14.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.857+0000 7f83ae200640 1 --2- 172.21.15.120:0/2464067646 >> v2:172.21.15.120:3300/0 conn(0x7f83a80bfe70 0x7f83a80c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:14.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.857+0000 7f83ace00640 1 -- 172.21.15.120:0/2464067646 >> v2:172.21.15.120:3300/0 conn(0x7f83a80bfe70 msgr2=0x7f83a80c6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:52:14.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.857+0000 7f83ace00640 1 --2- 172.21.15.120:0/2464067646 >> v2:172.21.15.120:3300/0 conn(0x7f83a80bfe70 0x7f83a80c6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:14.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.857+0000 7f83ace00640 1 -- 172.21.15.120:0/2464067646 >> v1:172.21.15.132:6789/0 conn(0x7f83a8150340 legacy=0x7f83a8156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:14.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.857+0000 7f83ace00640 1 -- 172.21.15.120:0/2464067646 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a80c0800 con 0x7f83a80c7480 2024-04-18T04:52:14.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.869+0000 7f83ace00640 1 --2- 172.21.15.120:0/2464067646 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83a80c7480 0x7f83a80c68d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f83a806ec90 tx=0x7f839401ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=893cb2b63b0122ec server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:14.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.873+0000 7f83a7e00640 1 -- 172.21.15.120:0/2464067646 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83940a8a10 con 0x7f83a80c7480 2024-04-18T04:52:14.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.873+0000 7f83a7e00640 1 -- 172.21.15.120:0/2464067646 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83940a8b70 con 0x7f83a80c7480 2024-04-18T04:52:14.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.873+0000 7f83a7e00640 1 -- 172.21.15.120:0/2464067646 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83940b0440 con 0x7f83a80c7480 2024-04-18T04:52:14.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.873+0000 7f83b0200640 1 -- 172.21.15.120:0/2464067646 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83a80c7480 msgr2=0x7f83a80c68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:14.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.873+0000 7f83b0200640 1 --2- 172.21.15.120:0/2464067646 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83a80c7480 0x7f83a80c68d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f83a806ec90 tx=0x7f839401ed10 comp rx=0 tx=0).stop 2024-04-18T04:52:14.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.881+0000 7f83b0200640 1 -- 172.21.15.120:0/2464067646 shutdown_connections 2024-04-18T04:52:14.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.881+0000 7f83b0200640 1 --2- 172.21.15.120:0/2464067646 >> v2:172.21.15.120:3300/0 conn(0x7f83a80bfe70 0x7f83a80c6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:14.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.881+0000 7f83b0200640 1 --2- 172.21.15.120:0/2464067646 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83a80c7480 0x7f83a80c68d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:14.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.881+0000 7f83b0200640 1 -- 172.21.15.120:0/2464067646 >> 172.21.15.120:0/2464067646 conn(0x7f83a80c78c0 msgr2=0x7f83a80c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:52:14.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.885+0000 7f83b0200640 1 -- 172.21.15.120:0/2464067646 shutdown_connections 2024-04-18T04:52:14.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.885+0000 7f83b0200640 1 -- 172.21.15.120:0/2464067646 wait complete. 2024-04-18T04:52:14.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.885+0000 7f83b0200640 1 Processor -- start 2024-04-18T04:52:14.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.889+0000 7f83b0200640 1 -- start start 2024-04-18T04:52:14.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.893+0000 7f83b0200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f83a80bfe70 0x7f83a8144a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:14.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.893+0000 7f83b0200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f83a80c7480 0x7f83a814b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:14.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.893+0000 7f83b0200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83a8150340 0x7f83a8147dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:14.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.893+0000 7f83b0200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a8155dd0 con 0x7f83a80c7480 2024-04-18T04:52:14.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.893+0000 7f83b0200640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a81450c0 con 0x7f83a8150340 2024-04-18T04:52:14.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.893+0000 7f83b0200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a81453a0 con 0x7f83a80bfe70 2024-04-18T04:52:14.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.893+0000 7f83ae200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83a8150340 0x7f83a8147dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:14.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.893+0000 7f83ae200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83a8150340 0x7f83a8147dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:51612/0 (socket says 172.21.15.120:51612) 2024-04-18T04:52:14.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.893+0000 7f83ae200640 1 -- 172.21.15.120:0/546595872 learned_addr learned my addr 172.21.15.120:0/546595872 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:52:14.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.893+0000 7f83ad800640 1 --2- 172.21.15.120:0/546595872 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f83a80bfe70 0x7f83a8144a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:14.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.893+0000 7f83ae200640 1 -- 172.21.15.120:0/546595872 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f83a80bfe70 msgr2=0x7f83a8144a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:14.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.893+0000 7f83ae200640 1 --2- 172.21.15.120:0/546595872 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f83a80bfe70 0x7f83a8144a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:14.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.893+0000 7f83ae200640 1 -- 172.21.15.120:0/546595872 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f83a80c7480 msgr2=0x7f83a814b490 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:52:14.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.893+0000 7f83ae200640 1 --2- 172.21.15.120:0/546595872 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f83a80c7480 0x7f83a814b490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:14.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.893+0000 7f83ae200640 1 -- 172.21.15.120:0/546595872 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83940094d0 con 0x7f83a8150340 2024-04-18T04:52:14.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.897+0000 7f83ae200640 1 --2- 172.21.15.120:0/546595872 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83a8150340 0x7f83a8147dc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f83a0007d90 tx=0x7f83a000e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:14.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.897+0000 7f83a5600640 1 -- 172.21.15.120:0/546595872 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a0014420 con 0x7f83a8150340 2024-04-18T04:52:14.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.897+0000 7f83a5600640 1 -- 172.21.15.120:0/546595872 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a00145a0 con 0x7f83a8150340 2024-04-18T04:52:14.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.897+0000 7f83a5600640 1 -- 172.21.15.120:0/546595872 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a0014950 con 0x7f83a8150340 2024-04-18T04:52:14.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.897+0000 7f83b0200640 1 -- 172.21.15.120:0/546595872 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83a8155710 con 0x7f83a8150340 2024-04-18T04:52:14.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.897+0000 7f83b0200640 1 -- 172.21.15.120:0/546595872 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83a814b9d0 con 0x7f83a8150340 2024-04-18T04:52:14.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.901+0000 7f83b0200640 1 -- 172.21.15.120:0/546595872 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83a80726d0 con 0x7f83a8150340 2024-04-18T04:52:14.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.905+0000 7f83a5600640 1 -- 172.21.15.120:0/546595872 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f83a0014ab0 con 0x7f83a8150340 2024-04-18T04:52:14.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.905+0000 7f83a5600640 1 --2- 172.21.15.120:0/546595872 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f83880666c0 0x7f8388068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:14.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.909+0000 7f83a5600640 1 -- 172.21.15.120:0/546595872 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f83a0085050 con 0x7f83a8150340 2024-04-18T04:52:14.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.909+0000 7f83a5600640 1 -- 172.21.15.120:0/546595872 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f83a00558a0 con 0x7f83a8150340 2024-04-18T04:52:14.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.913+0000 7f83ad800640 1 --2- 172.21.15.120:0/546595872 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f83880666c0 0x7f8388068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:14.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:14.917+0000 7f83ad800640 1 --2- 172.21.15.120:0/546595872 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f83880666c0 0x7f8388068b80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f839c0015b0 tx=0x7f839c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:15.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:15.329+0000 7f83b0200640 1 -- 172.21.15.120:0/546595872 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83a8073e10 con 0x7f83a8150340 2024-04-18T04:52:15.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:15.329+0000 7f83a5600640 1 -- 172.21.15.120:0/546595872 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+5521 (secure 0 0 0) 0x7f83a0055430 con 0x7f83a8150340 2024-04-18T04:52:15.328 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:52:15.328 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:52:05.994323+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5105,"mds_1":4967},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:active","state_seq":31,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5105":{"gid":5105,"name":"c","rank":0,"incarnation":38,"state":"up:replay","state_seq":1,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:52:15.329 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 38 2024-04-18T04:52:15.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:15.337+0000 7f83b0200640 1 -- 172.21.15.120:0/546595872 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f83880666c0 msgr2=0x7f8388068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:15.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:15.337+0000 7f83b0200640 1 --2- 172.21.15.120:0/546595872 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f83880666c0 0x7f8388068b80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f839c0015b0 tx=0x7f839c009040 comp rx=0 tx=0).stop 2024-04-18T04:52:15.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:15.337+0000 7f83b0200640 1 -- 172.21.15.120:0/546595872 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83a8150340 msgr2=0x7f83a8147dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:15.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:15.337+0000 7f83b0200640 1 --2- 172.21.15.120:0/546595872 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83a8150340 0x7f83a8147dc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f83a0007d90 tx=0x7f83a000e4b0 comp rx=0 tx=0).stop 2024-04-18T04:52:15.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:15.341+0000 7f83b0200640 1 -- 172.21.15.120:0/546595872 shutdown_connections 2024-04-18T04:52:15.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:15.341+0000 7f83b0200640 1 --2- 172.21.15.120:0/546595872 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f83880666c0 0x7f8388068b80 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:15.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:15.341+0000 7f83b0200640 1 --2- 172.21.15.120:0/546595872 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83a8150340 0x7f83a8147dc0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:15.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:15.341+0000 7f83b0200640 1 --2- 172.21.15.120:0/546595872 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f83a80c7480 0x7f83a814b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:15.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:15.341+0000 7f83b0200640 1 --2- 172.21.15.120:0/546595872 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f83a80bfe70 0x7f83a8144a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:15.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:15.341+0000 7f83b0200640 1 -- 172.21.15.120:0/546595872 >> 172.21.15.120:0/546595872 conn(0x7f83a80c78c0 msgr2=0x7f83a806cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:52:15.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:15.341+0000 7f83b0200640 1 -- 172.21.15.120:0/546595872 shutdown_connections 2024-04-18T04:52:15.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:15.341+0000 7f83b0200640 1 -- 172.21.15.120:0/546595872 wait complete. 2024-04-18T04:52:15.376 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:52:17.377 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:52:17.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.649+0000 7f9abb200640 1 Processor -- start 2024-04-18T04:52:17.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.649+0000 7f9abb200640 1 -- start start 2024-04-18T04:52:17.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.653+0000 7f9abb200640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9ab414fab0 0x7f9ab406c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:17.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.653+0000 7f9abb200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9ab41562a0 0x7f9ab40c6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:17.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.653+0000 7f9abb200640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9ab406b660 0x7f9ab406baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:17.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.653+0000 7f9abb200640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ab406cb30 con 0x7f9ab406b660 2024-04-18T04:52:17.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.653+0000 7f9abb200640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ab40c6f00 con 0x7f9ab414fab0 2024-04-18T04:52:17.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.653+0000 7f9abb200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab40c57c0 con 0x7f9ab41562a0 2024-04-18T04:52:17.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.653+0000 7f9ab3e00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9ab414fab0 0x7f9ab406c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:17.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.653+0000 7f9ab3e00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9ab414fab0 0x7f9ab406c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:51616/0 (socket says 172.21.15.120:51616) 2024-04-18T04:52:17.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.653+0000 7f9ab3e00640 1 -- 172.21.15.120:0/2729039893 learned_addr learned my addr 172.21.15.120:0/2729039893 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:52:17.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.653+0000 7f9ab3400640 1 --2- 172.21.15.120:0/2729039893 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9ab41562a0 0x7f9ab40c6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:17.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.653+0000 7f9ab3e00640 1 -- 172.21.15.120:0/2729039893 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9ab41562a0 msgr2=0x7f9ab40c6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:52:17.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.653+0000 7f9ab3e00640 1 --2- 172.21.15.120:0/2729039893 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9ab41562a0 0x7f9ab40c6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:17.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.653+0000 7f9ab3e00640 1 -- 172.21.15.120:0/2729039893 >> v2:172.21.15.120:3300/0 conn(0x7f9ab406b660 msgr2=0x7f9ab406baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:52:17.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.653+0000 7f9ab3e00640 1 --2- 172.21.15.120:0/2729039893 >> v2:172.21.15.120:3300/0 conn(0x7f9ab406b660 0x7f9ab406baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:17.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.653+0000 7f9ab3e00640 1 -- 172.21.15.120:0/2729039893 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab40c5d80 con 0x7f9ab414fab0 2024-04-18T04:52:17.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.657+0000 7f9ab3e00640 1 --2- 172.21.15.120:0/2729039893 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ab414fab0 0x7f9ab406c5f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4073f20 tx=0x7f9aa001fd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4a0806ad81ea666 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:17.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.657+0000 7f9ab2a00640 1 -- 172.21.15.120:0/2729039893 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0008be0 con 0x7f9ab414fab0 2024-04-18T04:52:17.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.657+0000 7f9ab2a00640 1 -- 172.21.15.120:0/2729039893 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa0008d40 con 0x7f9ab414fab0 2024-04-18T04:52:17.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.657+0000 7f9ab2a00640 1 -- 172.21.15.120:0/2729039893 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa00a9b10 con 0x7f9ab414fab0 2024-04-18T04:52:17.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.661+0000 7f9abb200640 1 -- 172.21.15.120:0/2729039893 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ab414fab0 msgr2=0x7f9ab406c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:17.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.661+0000 7f9abb200640 1 --2- 172.21.15.120:0/2729039893 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ab414fab0 0x7f9ab406c5f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4073f20 tx=0x7f9aa001fd60 comp rx=0 tx=0).stop 2024-04-18T04:52:17.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.661+0000 7f9abb200640 1 -- 172.21.15.120:0/2729039893 shutdown_connections 2024-04-18T04:52:17.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.661+0000 7f9abb200640 1 --2- 172.21.15.120:0/2729039893 >> v2:172.21.15.120:3300/0 conn(0x7f9ab406b660 0x7f9ab406baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:17.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.661+0000 7f9abb200640 1 --2- 172.21.15.120:0/2729039893 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9ab41562a0 0x7f9ab40c6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:17.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.661+0000 7f9abb200640 1 --2- 172.21.15.120:0/2729039893 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ab414fab0 0x7f9ab406c5f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:17.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.661+0000 7f9abb200640 1 -- 172.21.15.120:0/2729039893 >> 172.21.15.120:0/2729039893 conn(0x7f9ab40c78c0 msgr2=0x7f9ab40c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:52:17.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.661+0000 7f9abb200640 1 -- 172.21.15.120:0/2729039893 shutdown_connections 2024-04-18T04:52:17.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.661+0000 7f9abb200640 1 -- 172.21.15.120:0/2729039893 wait complete. 2024-04-18T04:52:17.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.665+0000 7f9abb200640 1 Processor -- start 2024-04-18T04:52:17.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.665+0000 7f9abb200640 1 -- start start 2024-04-18T04:52:17.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.665+0000 7f9abb200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ab406b660 0x7f9ab415bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:17.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.665+0000 7f9abb200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9ab414fab0 0x7f9ab40c44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:17.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.665+0000 7f9abb200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ab41562a0 0x7f9ab41ef900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:17.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.665+0000 7f9abb200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab4153c20 con 0x7f9ab406b660 2024-04-18T04:52:17.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.665+0000 7f9abb200640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab41550c0 con 0x7f9ab41562a0 2024-04-18T04:52:17.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.665+0000 7f9abb200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab4153940 con 0x7f9ab414fab0 2024-04-18T04:52:17.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.665+0000 7f9ab3400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9ab414fab0 0x7f9ab40c44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:17.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.665+0000 7f9ab3400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9ab414fab0 0x7f9ab40c44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:59624/0 (socket says 172.21.15.120:59624) 2024-04-18T04:52:17.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.665+0000 7f9ab3400640 1 -- 172.21.15.120:0/262322354 learned_addr learned my addr 172.21.15.120:0/262322354 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:52:17.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.665+0000 7f9ab9200640 1 --2- 172.21.15.120:0/262322354 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ab41562a0 0x7f9ab41ef900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:17.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.665+0000 7f9ab3400640 1 -- 172.21.15.120:0/262322354 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ab41562a0 msgr2=0x7f9ab41ef900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:17.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.665+0000 7f9ab3400640 1 --2- 172.21.15.120:0/262322354 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ab41562a0 0x7f9ab41ef900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:17.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.665+0000 7f9ab3400640 1 -- 172.21.15.120:0/262322354 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ab406b660 msgr2=0x7f9ab415bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:17.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.665+0000 7f9ab3400640 1 --2- 172.21.15.120:0/262322354 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ab406b660 0x7f9ab415bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:17.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.665+0000 7f9ab3400640 1 -- 172.21.15.120:0/262322354 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa0007040 con 0x7f9ab414fab0 2024-04-18T04:52:17.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.665+0000 7f9ab3400640 1 --2- 172.21.15.120:0/262322354 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9ab414fab0 0x7f9ab40c44e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9aac007f20 tx=0x7f9aac00e570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:17.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.669+0000 7f9aabe00640 1 -- 172.21.15.120:0/262322354 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aac014620 con 0x7f9ab414fab0 2024-04-18T04:52:17.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.669+0000 7f9abb200640 1 -- 172.21.15.120:0/262322354 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab4155330 con 0x7f9ab414fab0 2024-04-18T04:52:17.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.669+0000 7f9abb200640 1 -- 172.21.15.120:0/262322354 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab41ef090 con 0x7f9ab414fab0 2024-04-18T04:52:17.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.669+0000 7f9aabe00640 1 -- 172.21.15.120:0/262322354 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aac014780 con 0x7f9ab414fab0 2024-04-18T04:52:17.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.669+0000 7f9aabe00640 1 -- 172.21.15.120:0/262322354 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aac014620 con 0x7f9ab414fab0 2024-04-18T04:52:17.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.669+0000 7f9abb200640 1 -- 172.21.15.120:0/262322354 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a8c005260 con 0x7f9ab414fab0 2024-04-18T04:52:17.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.669+0000 7f9aabe00640 1 -- 172.21.15.120:0/262322354 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9aac0148f0 con 0x7f9ab414fab0 2024-04-18T04:52:17.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.673+0000 7f9aabe00640 1 --2- 172.21.15.120:0/262322354 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9a980668c0 0x7f9a98068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:17.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.673+0000 7f9aabe00640 1 -- 172.21.15.120:0/262322354 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f9aac084c60 con 0x7f9ab414fab0 2024-04-18T04:52:17.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.673+0000 7f9ab3e00640 1 --2- 172.21.15.120:0/262322354 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9a980668c0 0x7f9a98068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:17.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.673+0000 7f9ab3e00640 1 --2- 172.21.15.120:0/262322354 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9a980668c0 0x7f9a98068d80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9aa00b2000 tx=0x7f9aa0004740 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:17.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:17.681+0000 7f9aabe00640 1 -- 172.21.15.120:0/262322354 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f9aac051ab0 con 0x7f9ab414fab0 2024-04-18T04:52:18.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:18.069+0000 7f9abb200640 1 -- 172.21.15.120:0/262322354 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a8c005a90 con 0x7f9ab414fab0 2024-04-18T04:52:18.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:18.069+0000 7f9aabe00640 1 -- 172.21.15.120:0/262322354 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+5521 (secure 0 0 0) 0x7f9aac0550d0 con 0x7f9ab414fab0 2024-04-18T04:52:18.074 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:52:18.074 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:52:05.994323+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5105,"mds_1":4967},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:active","state_seq":31,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5105":{"gid":5105,"name":"c","rank":0,"incarnation":38,"state":"up:replay","state_seq":1,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:52:18.074 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 38 2024-04-18T04:52:18.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:18.077+0000 7f9abb200640 1 -- 172.21.15.120:0/262322354 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9a980668c0 msgr2=0x7f9a98068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:18.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:18.077+0000 7f9abb200640 1 --2- 172.21.15.120:0/262322354 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9a980668c0 0x7f9a98068d80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9aa00b2000 tx=0x7f9aa0004740 comp rx=0 tx=0).stop 2024-04-18T04:52:18.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:18.077+0000 7f9abb200640 1 -- 172.21.15.120:0/262322354 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9ab414fab0 msgr2=0x7f9ab40c44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:18.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:18.077+0000 7f9abb200640 1 --2- 172.21.15.120:0/262322354 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9ab414fab0 0x7f9ab40c44e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9aac007f20 tx=0x7f9aac00e570 comp rx=0 tx=0).stop 2024-04-18T04:52:18.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:18.093+0000 7f9abb200640 1 -- 172.21.15.120:0/262322354 shutdown_connections 2024-04-18T04:52:18.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:18.093+0000 7f9abb200640 1 --2- 172.21.15.120:0/262322354 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9a980668c0 0x7f9a98068d80 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:18.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:18.093+0000 7f9abb200640 1 --2- 172.21.15.120:0/262322354 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ab41562a0 0x7f9ab41ef900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:18.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:18.093+0000 7f9abb200640 1 --2- 172.21.15.120:0/262322354 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9ab414fab0 0x7f9ab40c44e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:18.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:18.093+0000 7f9abb200640 1 --2- 172.21.15.120:0/262322354 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ab406b660 0x7f9ab415bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:18.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:18.093+0000 7f9abb200640 1 -- 172.21.15.120:0/262322354 >> 172.21.15.120:0/262322354 conn(0x7f9ab40c78c0 msgr2=0x7f9ab414d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:52:18.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:18.097+0000 7f9abb200640 1 -- 172.21.15.120:0/262322354 shutdown_connections 2024-04-18T04:52:18.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:18.097+0000 7f9abb200640 1 -- 172.21.15.120:0/262322354 wait complete. 2024-04-18T04:52:18.143 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:52:20.144 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:52:20.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.389+0000 7f1b91800640 1 Processor -- start 2024-04-18T04:52:20.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.393+0000 7f1b91800640 1 -- start start 2024-04-18T04:52:20.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.401+0000 7f1b91800640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1b8c157c60 0x7f1b8c0b0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:20.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.405+0000 7f1b8be00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1b8c157c60 0x7f1b8c0b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:20.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.405+0000 7f1b8be00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1b8c157c60 0x7f1b8c0b0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46808/0 (socket says 172.21.15.120:46808) 2024-04-18T04:52:20.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.405+0000 7f1b8be00640 1 -- 172.21.15.120:0/2017370730 learned_addr learned my addr 172.21.15.120:0/2017370730 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:52:20.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.405+0000 7f1b91800640 1 --2- 172.21.15.120:0/2017370730 >> v2:172.21.15.132:3300/0 conn(0x7f1b8c06ba30 0x7f1b8c06be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:20.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.405+0000 7f1b8b400640 1 --2- 172.21.15.120:0/2017370730 >> v2:172.21.15.132:3300/0 conn(0x7f1b8c06ba30 0x7f1b8c06be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:20.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.405+0000 7f1b91800640 1 -- 172.21.15.120:0/2017370730 --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b8c072430 con 0x7f1b8c15d8d0 2024-04-18T04:52:20.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.405+0000 7f1b91800640 1 -- 172.21.15.120:0/2017370730 --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b8c0c1ca0 con 0x7f1b8c157c60 2024-04-18T04:52:20.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.405+0000 7f1b91800640 1 -- 172.21.15.120:0/2017370730 --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b8c06b5e0 con 0x7f1b8c06ba30 2024-04-18T04:52:20.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.409+0000 7f1b8b400640 1 -- 172.21.15.120:0/2017370730 >> v2:172.21.15.120:3300/0 conn(0x7f1b8c157c60 msgr2=0x7f1b8c0b0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:52:20.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.409+0000 7f1b8b400640 1 --2- 172.21.15.120:0/2017370730 >> v2:172.21.15.120:3300/0 conn(0x7f1b8c157c60 0x7f1b8c0b0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:20.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.409+0000 7f1b8b400640 1 -- 172.21.15.120:0/2017370730 >> v1:172.21.15.120:6789/0 conn(0x7f1b8c15d8d0 legacy=0x7f1b8c15dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:20.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.409+0000 7f1b8b400640 1 -- 172.21.15.120:0/2017370730 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b8c0c1420 con 0x7f1b8c06ba30 2024-04-18T04:52:20.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.409+0000 7f1b8aa00640 1 -- 172.21.15.120:0/2017370730 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 873138911 0 0) 0x7f1b8c072430 con 0x7f1b8c15d8d0 2024-04-18T04:52:20.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.409+0000 7f1b8be00640 1 --2- 172.21.15.120:0/2017370730 >> v2:172.21.15.120:3300/0 conn(0x7f1b8c157c60 0x7f1b8c0b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:52:20.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.413+0000 7f1b8b400640 1 --2- 172.21.15.120:0/2017370730 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b8c06ba30 0x7f1b8c06be10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c0c0670 tx=0x7f1b7801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a755759f1a013df server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:20.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.413+0000 7f1b8aa00640 1 -- 172.21.15.120:0/2017370730 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b780ab600 con 0x7f1b8c06ba30 2024-04-18T04:52:20.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.413+0000 7f1b8aa00640 1 -- 172.21.15.120:0/2017370730 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b780a7050 con 0x7f1b8c06ba30 2024-04-18T04:52:20.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.413+0000 7f1b8aa00640 1 -- 172.21.15.120:0/2017370730 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b780ab980 con 0x7f1b8c06ba30 2024-04-18T04:52:20.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.417+0000 7f1b91800640 1 -- 172.21.15.120:0/2017370730 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b8c06ba30 msgr2=0x7f1b8c06be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:20.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.417+0000 7f1b91800640 1 --2- 172.21.15.120:0/2017370730 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b8c06ba30 0x7f1b8c06be10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c0c0670 tx=0x7f1b7801c480 comp rx=0 tx=0).stop 2024-04-18T04:52:20.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.421+0000 7f1b91800640 1 -- 172.21.15.120:0/2017370730 shutdown_connections 2024-04-18T04:52:20.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.421+0000 7f1b91800640 1 --2- 172.21.15.120:0/2017370730 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b8c06ba30 0x7f1b8c06be10 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:20.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.421+0000 7f1b91800640 1 --2- 172.21.15.120:0/2017370730 >> v2:172.21.15.120:3300/0 conn(0x7f1b8c157c60 0x7f1b8c0b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:20.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.421+0000 7f1b91800640 1 -- 172.21.15.120:0/2017370730 >> 172.21.15.120:0/2017370730 conn(0x7f1b8c06cf90 msgr2=0x7f1b8c06d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:52:20.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.425+0000 7f1b91800640 1 -- 172.21.15.120:0/2017370730 shutdown_connections 2024-04-18T04:52:20.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.425+0000 7f1b91800640 1 -- 172.21.15.120:0/2017370730 wait complete. 2024-04-18T04:52:20.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.425+0000 7f1b91800640 1 Processor -- start 2024-04-18T04:52:20.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.429+0000 7f1b91800640 1 -- start start 2024-04-18T04:52:20.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.433+0000 7f1b91800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b8c06ba30 0x7f1b8c202170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:20.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.433+0000 7f1b91800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b8c157c60 0x7f1b8c200eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:20.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.433+0000 7f1b8be00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b8c06ba30 0x7f1b8c202170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:20.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.433+0000 7f1b8be00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b8c06ba30 0x7f1b8c202170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:59638/0 (socket says 172.21.15.120:59638) 2024-04-18T04:52:20.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.433+0000 7f1b8be00640 1 -- 172.21.15.120:0/4021004571 learned_addr learned my addr 172.21.15.120:0/4021004571 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:52:20.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.433+0000 7f1b91800640 1 --2- 172.21.15.120:0/4021004571 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b8c15d8d0 0x7f1b8c2013f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:20.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.433+0000 7f1b91800640 1 -- 172.21.15.120:0/4021004571 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8c202bd0 con 0x7f1b8c157c60 2024-04-18T04:52:20.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.433+0000 7f1b91800640 1 -- 172.21.15.120:0/4021004571 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8c1ffe10 con 0x7f1b8c15d8d0 2024-04-18T04:52:20.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.433+0000 7f1b91800640 1 -- 172.21.15.120:0/4021004571 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8c2000f0 con 0x7f1b8c06ba30 2024-04-18T04:52:20.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.437+0000 7f1b90e00640 1 --2- 172.21.15.120:0/4021004571 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b8c15d8d0 0x7f1b8c2013f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:20.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.437+0000 7f1b90e00640 1 -- 172.21.15.120:0/4021004571 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b8c06ba30 msgr2=0x7f1b8c202170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:20.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.437+0000 7f1b90e00640 1 --2- 172.21.15.120:0/4021004571 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b8c06ba30 0x7f1b8c202170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:20.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.437+0000 7f1b90e00640 1 -- 172.21.15.120:0/4021004571 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b8c157c60 msgr2=0x7f1b8c200eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:20.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.437+0000 7f1b90e00640 1 --2- 172.21.15.120:0/4021004571 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b8c157c60 0x7f1b8c200eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:20.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.437+0000 7f1b90e00640 1 -- 172.21.15.120:0/4021004571 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b7c0094d0 con 0x7f1b8c15d8d0 2024-04-18T04:52:20.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.437+0000 7f1b90e00640 1 --2- 172.21.15.120:0/4021004571 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b8c15d8d0 0x7f1b8c2013f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1b8400c700 tx=0x7f1b8400cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:20.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.437+0000 7f1b83e00640 1 -- 172.21.15.120:0/4021004571 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b84003db0 con 0x7f1b8c15d8d0 2024-04-18T04:52:20.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.437+0000 7f1b91800640 1 -- 172.21.15.120:0/4021004571 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b78009420 con 0x7f1b8c15d8d0 2024-04-18T04:52:20.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.437+0000 7f1b91800640 1 -- 172.21.15.120:0/4021004571 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b8c2006b0 con 0x7f1b8c15d8d0 2024-04-18T04:52:20.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.437+0000 7f1b83e00640 1 -- 172.21.15.120:0/4021004571 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b8400ce10 con 0x7f1b8c15d8d0 2024-04-18T04:52:20.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.437+0000 7f1b91800640 1 -- 172.21.15.120:0/4021004571 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b8c06af70 con 0x7f1b8c15d8d0 2024-04-18T04:52:20.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.437+0000 7f1b83e00640 1 -- 172.21.15.120:0/4021004571 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b84005290 con 0x7f1b8c15d8d0 2024-04-18T04:52:20.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.441+0000 7f1b83e00640 1 -- 172.21.15.120:0/4021004571 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1b840053f0 con 0x7f1b8c15d8d0 2024-04-18T04:52:20.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.445+0000 7f1b83e00640 1 --2- 172.21.15.120:0/4021004571 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1b6c0666e0 0x7f1b6c068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:20.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.445+0000 7f1b83e00640 1 -- 172.21.15.120:0/4021004571 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f1b84083c50 con 0x7f1b8c15d8d0 2024-04-18T04:52:20.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.445+0000 7f1b8be00640 1 --2- 172.21.15.120:0/4021004571 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1b6c0666e0 0x7f1b6c068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:20.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.449+0000 7f1b8be00640 1 --2- 172.21.15.120:0/4021004571 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1b6c0666e0 0x7f1b6c068ba0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c009d00 tx=0x7f1b7c009240 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:20.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.453+0000 7f1b83e00640 1 -- 172.21.15.120:0/4021004571 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f1b84050cd0 con 0x7f1b8c15d8d0 2024-04-18T04:52:20.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.849+0000 7f1b91800640 1 -- 172.21.15.120:0/4021004571 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b8c0728f0 con 0x7f1b8c15d8d0 2024-04-18T04:52:20.856 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:52:20.856 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":39,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:52:18.192025+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5105,"mds_1":4967},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:active","state_seq":31,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5105":{"gid":5105,"name":"c","rank":0,"incarnation":38,"state":"up:resolve","state_seq":8,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:52:20.856 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 39 2024-04-18T04:52:20.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.853+0000 7f1b83e00640 1 -- 172.21.15.120:0/4021004571 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+5522 (secure 0 0 0) 0x7f1b84081e60 con 0x7f1b8c15d8d0 2024-04-18T04:52:20.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.873+0000 7f1b91800640 1 -- 172.21.15.120:0/4021004571 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1b6c0666e0 msgr2=0x7f1b6c068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:20.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.873+0000 7f1b91800640 1 --2- 172.21.15.120:0/4021004571 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1b6c0666e0 0x7f1b6c068ba0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c009d00 tx=0x7f1b7c009240 comp rx=0 tx=0).stop 2024-04-18T04:52:20.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.873+0000 7f1b91800640 1 -- 172.21.15.120:0/4021004571 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b8c15d8d0 msgr2=0x7f1b8c2013f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:20.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.873+0000 7f1b91800640 1 --2- 172.21.15.120:0/4021004571 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b8c15d8d0 0x7f1b8c2013f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1b8400c700 tx=0x7f1b8400cbc0 comp rx=0 tx=0).stop 2024-04-18T04:52:20.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.877+0000 7f1b91800640 1 -- 172.21.15.120:0/4021004571 shutdown_connections 2024-04-18T04:52:20.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.877+0000 7f1b91800640 1 --2- 172.21.15.120:0/4021004571 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1b6c0666e0 0x7f1b6c068ba0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:20.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.877+0000 7f1b91800640 1 --2- 172.21.15.120:0/4021004571 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b8c15d8d0 0x7f1b8c2013f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:20.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.877+0000 7f1b91800640 1 --2- 172.21.15.120:0/4021004571 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b8c157c60 0x7f1b8c200eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:20.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.877+0000 7f1b91800640 1 --2- 172.21.15.120:0/4021004571 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b8c06ba30 0x7f1b8c202170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:20.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.877+0000 7f1b91800640 1 -- 172.21.15.120:0/4021004571 >> 172.21.15.120:0/4021004571 conn(0x7f1b8c06cf90 msgr2=0x7f1b8c0c8f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:52:20.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.877+0000 7f1b91800640 1 -- 172.21.15.120:0/4021004571 shutdown_connections 2024-04-18T04:52:20.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:20.877+0000 7f1b91800640 1 -- 172.21.15.120:0/4021004571 wait complete. 2024-04-18T04:52:20.922 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:52:22.923 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:52:23.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.157+0000 7f1bcaa00640 1 Processor -- start 2024-04-18T04:52:23.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.161+0000 7f1bcaa00640 1 -- start start 2024-04-18T04:52:23.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.161+0000 7f1bcaa00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1bc4151380 0x7f1bc40c1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:23.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.161+0000 7f1bcaa00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1bc40c7950 0x7f1bc415a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:23.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.161+0000 7f1bcaa00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bc415b480 con 0x7f1bc4151760 2024-04-18T04:52:23.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.161+0000 7f1bcaa00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bc415b760 con 0x7f1bc4151380 2024-04-18T04:52:23.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.161+0000 7f1bcaa00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bc4157650 con 0x7f1bc40c7950 2024-04-18T04:52:23.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.161+0000 7f1bca000640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1bc40c7950 0x7f1bc415a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:23.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.161+0000 7f1bca000640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1bc40c7950 0x7f1bc415a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:42518/0 (socket says 172.21.15.120:42518) 2024-04-18T04:52:23.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.161+0000 7f1bca000640 1 -- 172.21.15.120:0/890148724 learned_addr learned my addr 172.21.15.120:0/890148724 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:52:23.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.165+0000 7f1bca000640 1 -- 172.21.15.120:0/890148724 >> v2:172.21.15.120:3300/0 conn(0x7f1bc4151380 msgr2=0x7f1bc40c1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:52:23.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.165+0000 7f1bca000640 1 --2- 172.21.15.120:0/890148724 >> v2:172.21.15.120:3300/0 conn(0x7f1bc4151380 0x7f1bc40c1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:23.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.165+0000 7f1bca000640 1 -- 172.21.15.120:0/890148724 >> v1:172.21.15.120:6789/0 conn(0x7f1bc4151760 legacy=0x7f1bc406f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:52:23.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.165+0000 7f1bca000640 1 -- 172.21.15.120:0/890148724 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc4157930 con 0x7f1bc40c7950 2024-04-18T04:52:23.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.177+0000 7f1bca000640 1 --2- 172.21.15.120:0/890148724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bc40c7950 0x7f1bc415a8f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1bc40704b0 tx=0x7f1bbc01c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cf64bd92802fb34 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:23.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.177+0000 7f1bc3e00640 1 -- 172.21.15.120:0/890148724 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc0a5750 con 0x7f1bc40c7950 2024-04-18T04:52:23.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.177+0000 7f1bc3e00640 1 -- 172.21.15.120:0/890148724 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bbc0a58b0 con 0x7f1bc40c7950 2024-04-18T04:52:23.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.177+0000 7f1bc3e00640 1 -- 172.21.15.120:0/890148724 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc0a5c40 con 0x7f1bc40c7950 2024-04-18T04:52:23.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.177+0000 7f1bcaa00640 1 -- 172.21.15.120:0/890148724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bc40c7950 msgr2=0x7f1bc415a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:23.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.177+0000 7f1bcaa00640 1 --2- 172.21.15.120:0/890148724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bc40c7950 0x7f1bc415a8f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1bc40704b0 tx=0x7f1bbc01c9a0 comp rx=0 tx=0).stop 2024-04-18T04:52:23.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.181+0000 7f1bcaa00640 1 -- 172.21.15.120:0/890148724 shutdown_connections 2024-04-18T04:52:23.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.181+0000 7f1bcaa00640 1 --2- 172.21.15.120:0/890148724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bc40c7950 0x7f1bc415a8f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:23.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.181+0000 7f1bcaa00640 1 --2- 172.21.15.120:0/890148724 >> v2:172.21.15.120:3300/0 conn(0x7f1bc4151380 0x7f1bc40c1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:23.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.181+0000 7f1bcaa00640 1 -- 172.21.15.120:0/890148724 >> 172.21.15.120:0/890148724 conn(0x7f1bc40ccf50 msgr2=0x7f1bc40cd360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:52:23.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.181+0000 7f1bcaa00640 1 -- 172.21.15.120:0/890148724 shutdown_connections 2024-04-18T04:52:23.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.185+0000 7f1bcaa00640 1 -- 172.21.15.120:0/890148724 wait complete. 2024-04-18T04:52:23.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.189+0000 7f1bcaa00640 1 Processor -- start 2024-04-18T04:52:23.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.189+0000 7f1bcaa00640 1 -- start start 2024-04-18T04:52:23.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.197+0000 7f1bcaa00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bc40c7950 0x7f1bc4152600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:23.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.197+0000 7f1bcaa00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bc4151380 0x7f1bc414dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:23.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.197+0000 7f1bcaa00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1bc4151760 0x7f1bc40c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:23.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.197+0000 7f1bcaa00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc41541e0 con 0x7f1bc4151380 2024-04-18T04:52:23.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.197+0000 7f1bcaa00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc415bd30 con 0x7f1bc40c7950 2024-04-18T04:52:23.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.197+0000 7f1bcaa00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc414e160 con 0x7f1bc4151760 2024-04-18T04:52:23.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.197+0000 7f1bc9600640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bc40c7950 0x7f1bc4152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:23.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.197+0000 7f1bc9600640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bc40c7950 0x7f1bc4152600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:42530/0 (socket says 172.21.15.120:42530) 2024-04-18T04:52:23.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.197+0000 7f1bc9600640 1 -- 172.21.15.120:0/3530274969 learned_addr learned my addr 172.21.15.120:0/3530274969 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:52:23.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.197+0000 7f1bca000640 1 --2- 172.21.15.120:0/3530274969 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1bc4151760 0x7f1bc40c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:23.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.197+0000 7f1bc9600640 1 -- 172.21.15.120:0/3530274969 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1bc4151760 msgr2=0x7f1bc40c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:23.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.197+0000 7f1bc9600640 1 --2- 172.21.15.120:0/3530274969 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1bc4151760 0x7f1bc40c8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:23.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.197+0000 7f1bc9600640 1 -- 172.21.15.120:0/3530274969 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bc4151380 msgr2=0x7f1bc414dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:23.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.197+0000 7f1bc9600640 1 --2- 172.21.15.120:0/3530274969 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bc4151380 0x7f1bc414dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:23.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.197+0000 7f1bc9600640 1 -- 172.21.15.120:0/3530274969 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bbc009b30 con 0x7f1bc40c7950 2024-04-18T04:52:23.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.197+0000 7f1bc9600640 1 --2- 172.21.15.120:0/3530274969 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bc40c7950 0x7f1bc4152600 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1bb800b550 tx=0x7f1bb800ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:23.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.197+0000 7f1bc1600640 1 -- 172.21.15.120:0/3530274969 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb8010870 con 0x7f1bc40c7950 2024-04-18T04:52:23.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.197+0000 7f1bc1600640 1 -- 172.21.15.120:0/3530274969 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb80109f0 con 0x7f1bc40c7950 2024-04-18T04:52:23.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.197+0000 7f1bc1600640 1 -- 172.21.15.120:0/3530274969 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb8010da0 con 0x7f1bc40c7950 2024-04-18T04:52:23.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.197+0000 7f1bcaa00640 1 -- 172.21.15.120:0/3530274969 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bc4152d00 con 0x7f1bc40c7950 2024-04-18T04:52:23.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.197+0000 7f1bcaa00640 1 -- 172.21.15.120:0/3530274969 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bc41e98d0 con 0x7f1bc40c7950 2024-04-18T04:52:23.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.201+0000 7f1bcaa00640 1 -- 172.21.15.120:0/3530274969 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bc4067070 con 0x7f1bc40c7950 2024-04-18T04:52:23.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.201+0000 7f1bc1600640 1 -- 172.21.15.120:0/3530274969 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1bb800f3c0 con 0x7f1bc40c7950 2024-04-18T04:52:23.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.205+0000 7f1bc1600640 1 --2- 172.21.15.120:0/3530274969 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1ba4066710 0x7f1ba4068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:23.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.205+0000 7f1bc1600640 1 -- 172.21.15.120:0/3530274969 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f1bb8084500 con 0x7f1bc40c7950 2024-04-18T04:52:23.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.205+0000 7f1bc8c00640 1 --2- 172.21.15.120:0/3530274969 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1ba4066710 0x7f1ba4068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:23.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.205+0000 7f1bc8c00640 1 --2- 172.21.15.120:0/3530274969 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1ba4066710 0x7f1ba4068bd0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1bc40cdf20 tx=0x7f1bb0006bb0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:23.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.213+0000 7f1bc1600640 1 -- 172.21.15.120:0/3530274969 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f1bb80514f0 con 0x7f1bc40c7950 2024-04-18T04:52:23.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.573+0000 7f1bcaa00640 1 -- 172.21.15.120:0/3530274969 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1bc4161770 con 0x7f1bc40c7950 2024-04-18T04:52:23.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.573+0000 7f1bc1600640 1 -- 172.21.15.120:0/3530274969 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+5525 (secure 0 0 0) 0x7f1bb8054b10 con 0x7f1bc40c7950 2024-04-18T04:52:23.573 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:52:23.573 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:52:23.239073+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5105,"mds_1":4967},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:active","state_seq":31,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5105":{"gid":5105,"name":"c","rank":0,"incarnation":38,"state":"up:reconnect","state_seq":10,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:52:23.576 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 40 2024-04-18T04:52:23.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.581+0000 7f1bcaa00640 1 -- 172.21.15.120:0/3530274969 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1ba4066710 msgr2=0x7f1ba4068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:23.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.581+0000 7f1bcaa00640 1 --2- 172.21.15.120:0/3530274969 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1ba4066710 0x7f1ba4068bd0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1bc40cdf20 tx=0x7f1bb0006bb0 comp rx=0 tx=0).stop 2024-04-18T04:52:23.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.581+0000 7f1bcaa00640 1 -- 172.21.15.120:0/3530274969 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bc40c7950 msgr2=0x7f1bc4152600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:23.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.581+0000 7f1bcaa00640 1 --2- 172.21.15.120:0/3530274969 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bc40c7950 0x7f1bc4152600 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1bb800b550 tx=0x7f1bb800ba10 comp rx=0 tx=0).stop 2024-04-18T04:52:23.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.581+0000 7f1bcaa00640 1 -- 172.21.15.120:0/3530274969 shutdown_connections 2024-04-18T04:52:23.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.581+0000 7f1bcaa00640 1 --2- 172.21.15.120:0/3530274969 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f1ba4066710 0x7f1ba4068bd0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:23.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.581+0000 7f1bcaa00640 1 --2- 172.21.15.120:0/3530274969 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1bc4151760 0x7f1bc40c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:23.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.581+0000 7f1bcaa00640 1 --2- 172.21.15.120:0/3530274969 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bc4151380 0x7f1bc414dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:23.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.581+0000 7f1bcaa00640 1 --2- 172.21.15.120:0/3530274969 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bc40c7950 0x7f1bc4152600 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:23.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.581+0000 7f1bcaa00640 1 -- 172.21.15.120:0/3530274969 >> 172.21.15.120:0/3530274969 conn(0x7f1bc40ccf50 msgr2=0x7f1bc4150a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:52:23.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.581+0000 7f1bcaa00640 1 -- 172.21.15.120:0/3530274969 shutdown_connections 2024-04-18T04:52:23.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:23.581+0000 7f1bcaa00640 1 -- 172.21.15.120:0/3530274969 wait complete. 2024-04-18T04:52:23.620 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 40, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-18T04:44:30.251235+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 40, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1 ], "info": { "gid_4967": { "addr": "172.21.15.132:6835/396956733", "addrs": { "addrvec": [ { "addr": "172.21.15.132:6834", "nonce": 396956733, "type": "v2" }, { "addr": "172.21.15.132:6835", "nonce": 396956733, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4967, "incarnation": 28, "join_fscid": -1, "name": "b", "rank": 1, "state": "up:active", "state_seq": 31 }, "gid_5105": { "addr": "172.21.15.120:6833/3842815393", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6832", "nonce": 3842815393, "type": "v2" }, { "addr": "172.21.15.120:6833", "nonce": 3842815393, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5105, "incarnation": 38, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:reconnect", "state_seq": 10 } }, "last_failure": 0, "last_failure_osd_epoch": 31, "max_file_size": 1099511627776, "max_mds": 2, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-18T04:52:23.239073+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [ 2 ], "tableserver": 0, "up": { "mds_0": 5105, "mds_1": 4967 } } } ], "standbys": [ { "addr": "172.21.15.132:6839/4292136288", "addrs": { "addrvec": [ { "addr": "172.21.15.132:6836", "nonce": 4292136288, "type": "v2" }, { "addr": "172.21.15.132:6839", "nonce": 4292136288, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4241, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.132:6838/1712856922", "addrs": { "addrvec": [ { "addr": "172.21.15.132:6837", "nonce": 1712856922, "type": "v2" }, { "addr": "172.21.15.132:6838", "nonce": 1712856922, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 2, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4244, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.120:6836/2384594941", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6834", "nonce": 2384594941, "type": "v2" }, { "addr": "172.21.15.120:6836", "nonce": 2384594941, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 33, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5051, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-18T04:52:25.621 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:52:25.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.933+0000 7fdf55200640 1 Processor -- start 2024-04-18T04:52:25.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.933+0000 7fdf55200640 1 -- start start 2024-04-18T04:52:25.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.937+0000 7fdf55200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdf5006c5f0 0x7fdf501562a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:25.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.937+0000 7fdf55200640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fdf500c6210 0x7fdf5006b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:25.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.937+0000 7fdf55200640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf501567e0 con 0x7fdf500c83e0 2024-04-18T04:52:25.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.937+0000 7fdf55200640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf500c6f00 con 0x7fdf500c6210 2024-04-18T04:52:25.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.937+0000 7fdf55200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf500c57c0 con 0x7fdf5006c5f0 2024-04-18T04:52:25.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.937+0000 7fdf4d400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdf5006c5f0 0x7fdf501562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:25.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.941+0000 7fdf4d400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdf5006c5f0 0x7fdf501562a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:50534/0 (socket says 172.21.15.120:50534) 2024-04-18T04:52:25.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.941+0000 7fdf4d400640 1 -- 172.21.15.120:0/1595693513 learned_addr learned my addr 172.21.15.120:0/1595693513 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:52:25.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.941+0000 7fdf4d400640 1 -- 172.21.15.120:0/1595693513 >> v2:172.21.15.120:3300/0 conn(0x7fdf500c6210 msgr2=0x7fdf5006b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:52:25.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.941+0000 7fdf4d400640 1 --2- 172.21.15.120:0/1595693513 >> v2:172.21.15.120:3300/0 conn(0x7fdf500c6210 0x7fdf5006b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:25.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.941+0000 7fdf4d400640 1 -- 172.21.15.120:0/1595693513 >> v1:172.21.15.120:6789/0 conn(0x7fdf500c83e0 legacy=0x7fdf5014fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:52:25.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.941+0000 7fdf4d400640 1 -- 172.21.15.120:0/1595693513 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf500c5d80 con 0x7fdf5006c5f0 2024-04-18T04:52:25.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.949+0000 7fdf4d400640 1 --2- 172.21.15.120:0/1595693513 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdf5006c5f0 0x7fdf501562a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdf40009870 tx=0x7fdf4001ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ba09c2dac5a13f server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:25.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.949+0000 7fdf4ca00640 1 -- 172.21.15.120:0/1595693513 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf400a89d0 con 0x7fdf5006c5f0 2024-04-18T04:52:25.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.949+0000 7fdf4ca00640 1 -- 172.21.15.120:0/1595693513 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf400a8b30 con 0x7fdf5006c5f0 2024-04-18T04:52:25.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.949+0000 7fdf4ca00640 1 -- 172.21.15.120:0/1595693513 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf400b0440 con 0x7fdf5006c5f0 2024-04-18T04:52:25.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.953+0000 7fdf55200640 1 -- 172.21.15.120:0/1595693513 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdf5006c5f0 msgr2=0x7fdf501562a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:25.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.953+0000 7fdf55200640 1 --2- 172.21.15.120:0/1595693513 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdf5006c5f0 0x7fdf501562a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdf40009870 tx=0x7fdf4001ed30 comp rx=0 tx=0).stop 2024-04-18T04:52:25.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.953+0000 7fdf55200640 1 -- 172.21.15.120:0/1595693513 shutdown_connections 2024-04-18T04:52:25.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.953+0000 7fdf55200640 1 --2- 172.21.15.120:0/1595693513 >> v2:172.21.15.120:3300/0 conn(0x7fdf500c6210 0x7fdf5006b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:25.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.953+0000 7fdf55200640 1 --2- 172.21.15.120:0/1595693513 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdf5006c5f0 0x7fdf501562a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:25.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.953+0000 7fdf55200640 1 -- 172.21.15.120:0/1595693513 >> 172.21.15.120:0/1595693513 conn(0x7fdf500c78c0 msgr2=0x7fdf500c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:52:25.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.953+0000 7fdf55200640 1 -- 172.21.15.120:0/1595693513 shutdown_connections 2024-04-18T04:52:25.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.953+0000 7fdf55200640 1 -- 172.21.15.120:0/1595693513 wait complete. 2024-04-18T04:52:25.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.957+0000 7fdf55200640 1 Processor -- start 2024-04-18T04:52:25.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.957+0000 7fdf55200640 1 -- start start 2024-04-18T04:52:25.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.957+0000 7fdf55200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf5006c5f0 0x7fdf5014c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:25.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.957+0000 7fdf55200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdf500c6210 0x7fdf501ed850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:25.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.957+0000 7fdf55200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf500c83e0 0x7fdf501edd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:25.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.957+0000 7fdf55200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf501f1110 con 0x7fdf500c83e0 2024-04-18T04:52:25.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.957+0000 7fdf55200640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf501f1640 con 0x7fdf5006c5f0 2024-04-18T04:52:25.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.957+0000 7fdf55200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf501ed3c0 con 0x7fdf500c6210 2024-04-18T04:52:25.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.961+0000 7fdf4e800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf500c83e0 0x7fdf501edd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:25.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.961+0000 7fdf4e800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf500c83e0 0x7fdf501edd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49974/0 (socket says 172.21.15.120:49974) 2024-04-18T04:52:25.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.961+0000 7fdf4e800640 1 -- 172.21.15.120:0/2656142713 learned_addr learned my addr 172.21.15.120:0/2656142713 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:52:25.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.961+0000 7fdf4e800640 1 -- 172.21.15.120:0/2656142713 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdf500c6210 msgr2=0x7fdf501ed850 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-18T04:52:25.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.961+0000 7fdf4e800640 1 --2- 172.21.15.120:0/2656142713 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdf500c6210 0x7fdf501ed850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:25.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.961+0000 7fdf4e800640 1 -- 172.21.15.120:0/2656142713 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf5006c5f0 msgr2=0x7fdf5014c6b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-18T04:52:25.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.961+0000 7fdf4e800640 1 --2- 172.21.15.120:0/2656142713 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf5006c5f0 0x7fdf5014c6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:25.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.961+0000 7fdf4e800640 1 -- 172.21.15.120:0/2656142713 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf400094d0 con 0x7fdf500c83e0 2024-04-18T04:52:25.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.961+0000 7fdf4e800640 1 --2- 172.21.15.120:0/2656142713 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf500c83e0 0x7fdf501edd90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fdf4800ba40 tx=0x7fdf4800bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:25.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.961+0000 7fdf46000640 1 -- 172.21.15.120:0/2656142713 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4800cb20 con 0x7fdf500c83e0 2024-04-18T04:52:25.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.961+0000 7fdf46000640 1 -- 172.21.15.120:0/2656142713 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf4800cca0 con 0x7fdf500c83e0 2024-04-18T04:52:25.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.961+0000 7fdf46000640 1 -- 172.21.15.120:0/2656142713 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf48014680 con 0x7fdf500c83e0 2024-04-18T04:52:25.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.961+0000 7fdf55200640 1 -- 172.21.15.120:0/2656142713 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf50154690 con 0x7fdf500c83e0 2024-04-18T04:52:25.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.961+0000 7fdf55200640 1 -- 172.21.15.120:0/2656142713 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf50149970 con 0x7fdf500c83e0 2024-04-18T04:52:25.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.965+0000 7fdf55200640 1 -- 172.21.15.120:0/2656142713 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf50067590 con 0x7fdf500c83e0 2024-04-18T04:52:25.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.965+0000 7fdf46000640 1 -- 172.21.15.120:0/2656142713 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdf4801d3b0 con 0x7fdf500c83e0 2024-04-18T04:52:25.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.969+0000 7fdf46000640 1 --2- 172.21.15.120:0/2656142713 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fdf300666e0 0x7fdf30068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:25.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.969+0000 7fdf4de00640 1 --2- 172.21.15.120:0/2656142713 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fdf300666e0 0x7fdf30068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:25.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.969+0000 7fdf4de00640 1 --2- 172.21.15.120:0/2656142713 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fdf300666e0 0x7fdf30068ba0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c006fd0 tx=0x7fdf3c006b40 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:25.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.973+0000 7fdf46000640 1 -- 172.21.15.120:0/2656142713 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7007+0+0 (secure 0 0 0) 0x7fdf480555a0 con 0x7fdf500c83e0 2024-04-18T04:52:25.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:25.973+0000 7fdf46000640 1 -- 172.21.15.120:0/2656142713 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fdf48089060 con 0x7fdf500c83e0 2024-04-18T04:52:26.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:26.457+0000 7fdf55200640 1 -- 172.21.15.120:0/2656142713 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf50072a70 con 0x7fdf500c83e0 2024-04-18T04:52:26.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:26.461+0000 7fdf46000640 1 -- 172.21.15.120:0/2656142713 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+5525 (secure 0 0 0) 0x7fdf480511e0 con 0x7fdf500c83e0 2024-04-18T04:52:26.459 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:52:26.459 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:52:23.239073+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5105,"mds_1":4967},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:active","state_seq":31,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5105":{"gid":5105,"name":"c","rank":0,"incarnation":38,"state":"up:reconnect","state_seq":10,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:52:26.459 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 40 2024-04-18T04:52:26.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:26.465+0000 7fdf55200640 1 -- 172.21.15.120:0/2656142713 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fdf300666e0 msgr2=0x7fdf30068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:26.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:26.465+0000 7fdf55200640 1 --2- 172.21.15.120:0/2656142713 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fdf300666e0 0x7fdf30068ba0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c006fd0 tx=0x7fdf3c006b40 comp rx=0 tx=0).stop 2024-04-18T04:52:26.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:26.465+0000 7fdf55200640 1 -- 172.21.15.120:0/2656142713 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf500c83e0 msgr2=0x7fdf501edd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:26.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:26.465+0000 7fdf55200640 1 --2- 172.21.15.120:0/2656142713 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf500c83e0 0x7fdf501edd90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fdf4800ba40 tx=0x7fdf4800bf00 comp rx=0 tx=0).stop 2024-04-18T04:52:26.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:26.465+0000 7fdf55200640 1 -- 172.21.15.120:0/2656142713 shutdown_connections 2024-04-18T04:52:26.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:26.465+0000 7fdf55200640 1 --2- 172.21.15.120:0/2656142713 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fdf300666e0 0x7fdf30068ba0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:26.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:26.465+0000 7fdf55200640 1 --2- 172.21.15.120:0/2656142713 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf500c83e0 0x7fdf501edd90 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:26.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:26.465+0000 7fdf55200640 1 --2- 172.21.15.120:0/2656142713 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdf500c6210 0x7fdf501ed850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:26.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:26.465+0000 7fdf55200640 1 --2- 172.21.15.120:0/2656142713 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf5006c5f0 0x7fdf5014c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:26.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:26.465+0000 7fdf55200640 1 -- 172.21.15.120:0/2656142713 >> 172.21.15.120:0/2656142713 conn(0x7fdf500c78c0 msgr2=0x7fdf50144930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:52:26.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:26.465+0000 7fdf55200640 1 -- 172.21.15.120:0/2656142713 shutdown_connections 2024-04-18T04:52:26.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:26.465+0000 7fdf55200640 1 -- 172.21.15.120:0/2656142713 wait complete. 2024-04-18T04:52:26.504 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:52:28.507 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:52:28.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.744+0000 7fb1cd400640 1 Processor -- start 2024-04-18T04:52:28.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.744+0000 7fb1cd400640 1 -- start start 2024-04-18T04:52:28.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.748+0000 7fb1cd400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb1c80c83e0 0x7fb1c806c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:28.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.748+0000 7fb1cd400640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c80c6f00 con 0x7fb1c81562a0 2024-04-18T04:52:28.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.748+0000 7fb1cd400640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c80c57c0 con 0x7fb1c80c6210 2024-04-18T04:52:28.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.748+0000 7fb1cd400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c806cb30 con 0x7fb1c80c83e0 2024-04-18T04:52:28.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.748+0000 7fb1c7200640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fb1c80c6210 0x7fb1c806b660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:42988/0 (socket says 172.21.15.120:42988) 2024-04-18T04:52:28.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.748+0000 7fb1c7200640 1 -- 172.21.15.120:0/3386549575 learned_addr learned my addr 172.21.15.120:0/3386549575 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:52:28.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.748+0000 7fb1c6800640 1 --2- 172.21.15.120:0/3386549575 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb1c80c83e0 0x7fb1c806c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:28.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.752+0000 7fb1c5400640 1 -- 172.21.15.120:0/3386549575 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1498745501 0 0) 0x7fb1c80c57c0 con 0x7fb1c80c6210 2024-04-18T04:52:28.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.752+0000 7fb1c5400640 1 -- 172.21.15.120:0/3386549575 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1ac003530 con 0x7fb1c80c6210 2024-04-18T04:52:28.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.752+0000 7fb1c6800640 1 -- 172.21.15.120:0/3386549575 >> v1:172.21.15.132:6789/0 conn(0x7fb1c80c6210 legacy=0x7fb1c806b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:28.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.752+0000 7fb1c6800640 1 -- 172.21.15.120:0/3386549575 >> v1:172.21.15.120:6789/0 conn(0x7fb1c81562a0 legacy=0x7fb1c814fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:52:28.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.752+0000 7fb1c6800640 1 -- 172.21.15.120:0/3386549575 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c80c5d80 con 0x7fb1c80c83e0 2024-04-18T04:52:28.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.756+0000 7fb1c6800640 1 --2- 172.21.15.120:0/3386549575 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb1c80c83e0 0x7fb1c806c5f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0009dc0 tx=0x7fb1c001f160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21f6465a57310a26 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:28.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.760+0000 7fb1c5400640 1 -- 172.21.15.120:0/3386549575 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c00af600 con 0x7fb1c80c83e0 2024-04-18T04:52:28.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.760+0000 7fb1c5400640 1 -- 172.21.15.120:0/3386549575 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c00ab050 con 0x7fb1c80c83e0 2024-04-18T04:52:28.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.760+0000 7fb1c5400640 1 -- 172.21.15.120:0/3386549575 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c00af9c0 con 0x7fb1c80c83e0 2024-04-18T04:52:28.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.760+0000 7fb1cd400640 1 -- 172.21.15.120:0/3386549575 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb1c80c83e0 msgr2=0x7fb1c806c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:28.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.760+0000 7fb1cd400640 1 --2- 172.21.15.120:0/3386549575 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb1c80c83e0 0x7fb1c806c5f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0009dc0 tx=0x7fb1c001f160 comp rx=0 tx=0).stop 2024-04-18T04:52:28.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.760+0000 7fb1cd400640 1 -- 172.21.15.120:0/3386549575 shutdown_connections 2024-04-18T04:52:28.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.760+0000 7fb1cd400640 1 --2- 172.21.15.120:0/3386549575 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb1c80c83e0 0x7fb1c806c5f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:28.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.760+0000 7fb1cd400640 1 -- 172.21.15.120:0/3386549575 >> 172.21.15.120:0/3386549575 conn(0x7fb1c80c78c0 msgr2=0x7fb1c80c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:52:28.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.764+0000 7fb1cd400640 1 -- 172.21.15.120:0/3386549575 shutdown_connections 2024-04-18T04:52:28.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.764+0000 7fb1cd400640 1 -- 172.21.15.120:0/3386549575 wait complete. 2024-04-18T04:52:28.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.764+0000 7fb1cd400640 1 Processor -- start 2024-04-18T04:52:28.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.768+0000 7fb1cd400640 1 -- start start 2024-04-18T04:52:28.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.772+0000 7fb1cd400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb1c80c6210 0x7fb1c81fc380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:28.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.772+0000 7fb1cd400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1c80c83e0 0x7fb1c8158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:28.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.772+0000 7fb1c6800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb1c80c6210 0x7fb1c81fc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:28.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.772+0000 7fb1c6800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb1c80c6210 0x7fb1c81fc380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:50578/0 (socket says 172.21.15.120:50578) 2024-04-18T04:52:28.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.776+0000 7fb1c6800640 1 -- 172.21.15.120:0/410759122 learned_addr learned my addr 172.21.15.120:0/410759122 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:52:28.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.776+0000 7fb1cd400640 1 --2- 172.21.15.120:0/410759122 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1c81562a0 0x7fb1c80c4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:28.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.776+0000 7fb1cd400640 1 -- 172.21.15.120:0/410759122 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c80c1110 con 0x7fb1c81562a0 2024-04-18T04:52:28.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.776+0000 7fb1cd400640 1 -- 172.21.15.120:0/410759122 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c81fc8c0 con 0x7fb1c80c83e0 2024-04-18T04:52:28.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.776+0000 7fb1cd400640 1 -- 172.21.15.120:0/410759122 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c81f60c0 con 0x7fb1c80c6210 2024-04-18T04:52:28.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.776+0000 7fb1c5e00640 1 --2- 172.21.15.120:0/410759122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1c80c83e0 0x7fb1c8158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:28.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.776+0000 7fb1c7200640 1 --2- 172.21.15.120:0/410759122 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1c81562a0 0x7fb1c80c4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:28.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.776+0000 7fb1c6800640 1 -- 172.21.15.120:0/410759122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1c80c83e0 msgr2=0x7fb1c8158fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:28.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.776+0000 7fb1c6800640 1 --2- 172.21.15.120:0/410759122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1c80c83e0 0x7fb1c8158fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:28.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.776+0000 7fb1c6800640 1 -- 172.21.15.120:0/410759122 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1c81562a0 msgr2=0x7fb1c80c4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:28.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.776+0000 7fb1c6800640 1 --2- 172.21.15.120:0/410759122 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1c81562a0 0x7fb1c80c4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:28.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.776+0000 7fb1c6800640 1 -- 172.21.15.120:0/410759122 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c0009a70 con 0x7fb1c80c6210 2024-04-18T04:52:28.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.776+0000 7fb1c6800640 1 --2- 172.21.15.120:0/410759122 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb1c80c6210 0x7fb1c81fc380 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb1c001cd90 tx=0x7fb1c001bf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:28.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.780+0000 7fb1bea00640 1 -- 172.21.15.120:0/410759122 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c00afb70 con 0x7fb1c80c6210 2024-04-18T04:52:28.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.780+0000 7fb1bea00640 1 -- 172.21.15.120:0/410759122 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c00afcd0 con 0x7fb1c80c6210 2024-04-18T04:52:28.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.780+0000 7fb1bea00640 1 -- 172.21.15.120:0/410759122 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c00c4630 con 0x7fb1c80c6210 2024-04-18T04:52:28.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.780+0000 7fb1cd400640 1 -- 172.21.15.120:0/410759122 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1c80c0dc0 con 0x7fb1c80c6210 2024-04-18T04:52:28.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.780+0000 7fb1cd400640 1 -- 172.21.15.120:0/410759122 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1c80c01b0 con 0x7fb1c80c6210 2024-04-18T04:52:28.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.780+0000 7fb1cd400640 1 -- 172.21.15.120:0/410759122 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1c8067590 con 0x7fb1c80c6210 2024-04-18T04:52:28.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.784+0000 7fb1bea00640 1 -- 172.21.15.120:0/410759122 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb1c00b6070 con 0x7fb1c80c6210 2024-04-18T04:52:28.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.784+0000 7fb1bea00640 1 --2- 172.21.15.120:0/410759122 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb1a40666e0 0x7fb1a4068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:28.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.784+0000 7fb1bea00640 1 -- 172.21.15.120:0/410759122 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7007+0+0 (secure 0 0 0) 0x7fb1c0122e60 con 0x7fb1c80c6210 2024-04-18T04:52:28.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.788+0000 7fb1c5e00640 1 --2- 172.21.15.120:0/410759122 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb1a40666e0 0x7fb1a4068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:28.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.792+0000 7fb1c5e00640 1 --2- 172.21.15.120:0/410759122 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb1a40666e0 0x7fb1a4068ba0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb1c814c8e0 tx=0x7fb1b0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:28.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:28.792+0000 7fb1bea00640 1 -- 172.21.15.120:0/410759122 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fb1c00efc10 con 0x7fb1c80c6210 2024-04-18T04:52:29.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:29.192+0000 7fb1cd400640 1 -- 172.21.15.120:0/410759122 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb1c8072a70 con 0x7fb1c80c6210 2024-04-18T04:52:29.192 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:52:29.192 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:52:28.541002+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5105,"mds_1":4967},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:active","state_seq":31,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5105":{"gid":5105,"name":"c","rank":0,"incarnation":38,"state":"up:rejoin","state_seq":12,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:52:29.192 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 41 2024-04-18T04:52:29.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:29.192+0000 7fb1bea00640 1 -- 172.21.15.120:0/410759122 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+5522 (secure 0 0 0) 0x7fb1c00b4020 con 0x7fb1c80c6210 2024-04-18T04:52:29.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:29.196+0000 7fb1cd400640 1 -- 172.21.15.120:0/410759122 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb1a40666e0 msgr2=0x7fb1a4068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:29.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:29.196+0000 7fb1cd400640 1 --2- 172.21.15.120:0/410759122 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb1a40666e0 0x7fb1a4068ba0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb1c814c8e0 tx=0x7fb1b0008040 comp rx=0 tx=0).stop 2024-04-18T04:52:29.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:29.196+0000 7fb1cd400640 1 -- 172.21.15.120:0/410759122 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb1c80c6210 msgr2=0x7fb1c81fc380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:29.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:29.196+0000 7fb1cd400640 1 --2- 172.21.15.120:0/410759122 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb1c80c6210 0x7fb1c81fc380 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb1c001cd90 tx=0x7fb1c001bf00 comp rx=0 tx=0).stop 2024-04-18T04:52:29.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:29.196+0000 7fb1cd400640 1 -- 172.21.15.120:0/410759122 shutdown_connections 2024-04-18T04:52:29.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:29.196+0000 7fb1cd400640 1 --2- 172.21.15.120:0/410759122 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb1a40666e0 0x7fb1a4068ba0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:29.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:29.196+0000 7fb1cd400640 1 --2- 172.21.15.120:0/410759122 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1c81562a0 0x7fb1c80c4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:29.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:29.196+0000 7fb1cd400640 1 --2- 172.21.15.120:0/410759122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1c80c83e0 0x7fb1c8158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:29.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:29.196+0000 7fb1cd400640 1 --2- 172.21.15.120:0/410759122 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb1c80c6210 0x7fb1c81fc380 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:29.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:29.196+0000 7fb1cd400640 1 -- 172.21.15.120:0/410759122 >> 172.21.15.120:0/410759122 conn(0x7fb1c80c78c0 msgr2=0x7fb1c8070c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:52:29.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:29.196+0000 7fb1cd400640 1 -- 172.21.15.120:0/410759122 shutdown_connections 2024-04-18T04:52:29.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:29.196+0000 7fb1cd400640 1 -- 172.21.15.120:0/410759122 wait complete. 2024-04-18T04:52:29.308 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:52:31.309 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:52:31.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.616+0000 7fdf5ae00640 1 Processor -- start 2024-04-18T04:52:31.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.616+0000 7fdf5ae00640 1 -- start start 2024-04-18T04:52:31.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.616+0000 7fdf5ae00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fdf54153830 0x7fdf5406fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:31.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.616+0000 7fdf5ae00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdf5415d090 0x7fdf5415d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:31.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.616+0000 7fdf5ae00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf540703b0 con 0x7fdf540c8850 2024-04-18T04:52:31.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.616+0000 7fdf5ae00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf540c4200 con 0x7fdf54153830 2024-04-18T04:52:31.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.616+0000 7fdf5ae00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf540c9520 con 0x7fdf5415d090 2024-04-18T04:52:31.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.616+0000 7fdf58e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdf5415d090 0x7fdf5415d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:31.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.616+0000 7fdf58e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdf5415d090 0x7fdf5415d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:50458/0 (socket says 172.21.15.120:50458) 2024-04-18T04:52:31.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.616+0000 7fdf58e00640 1 -- 172.21.15.120:0/2770767378 learned_addr learned my addr 172.21.15.120:0/2770767378 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:52:31.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.616+0000 7fdf58e00640 1 -- 172.21.15.120:0/2770767378 >> v2:172.21.15.120:3300/0 conn(0x7fdf54153830 msgr2=0x7fdf5406fe70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:52:31.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.616+0000 7fdf53e00640 1 --2- 172.21.15.120:0/2770767378 >> v2:172.21.15.120:3300/0 conn(0x7fdf54153830 0x7fdf5406fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:31.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.616+0000 7fdf58e00640 1 --2- 172.21.15.120:0/2770767378 >> v2:172.21.15.120:3300/0 conn(0x7fdf54153830 0x7fdf5406fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:31.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.616+0000 7fdf58e00640 1 -- 172.21.15.120:0/2770767378 >> v1:172.21.15.132:6789/0 conn(0x7fdf540c8850 legacy=0x7fdf540ccee0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-18T04:52:31.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.616+0000 7fdf58e00640 1 -- 172.21.15.120:0/2770767378 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf5415cc00 con 0x7fdf5415d090 2024-04-18T04:52:31.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.624+0000 7fdf58e00640 1 --2- 172.21.15.120:0/2770767378 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdf5415d090 0x7fdf5415d4e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c009e50 tx=0x7fdf4c01c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ab78a9c24fe90fc server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:31.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.624+0000 7fdf53400640 1 -- 172.21.15.120:0/2770767378 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c0a5870 con 0x7fdf5415d090 2024-04-18T04:52:31.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.624+0000 7fdf53400640 1 -- 172.21.15.120:0/2770767378 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf4c0a59d0 con 0x7fdf5415d090 2024-04-18T04:52:31.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.624+0000 7fdf53400640 1 -- 172.21.15.120:0/2770767378 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c0a5d60 con 0x7fdf5415d090 2024-04-18T04:52:31.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.624+0000 7fdf5ae00640 1 -- 172.21.15.120:0/2770767378 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdf5415d090 msgr2=0x7fdf5415d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:31.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.624+0000 7fdf5ae00640 1 --2- 172.21.15.120:0/2770767378 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdf5415d090 0x7fdf5415d4e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c009e50 tx=0x7fdf4c01c9f0 comp rx=0 tx=0).stop 2024-04-18T04:52:31.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.624+0000 7fdf5ae00640 1 -- 172.21.15.120:0/2770767378 shutdown_connections 2024-04-18T04:52:31.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.624+0000 7fdf5ae00640 1 --2- 172.21.15.120:0/2770767378 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdf5415d090 0x7fdf5415d4e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:31.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.624+0000 7fdf5ae00640 1 --2- 172.21.15.120:0/2770767378 >> v2:172.21.15.120:3300/0 conn(0x7fdf54153830 0x7fdf5406fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:31.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.624+0000 7fdf5ae00640 1 -- 172.21.15.120:0/2770767378 >> 172.21.15.120:0/2770767378 conn(0x7fdf5406e0f0 msgr2=0x7fdf54071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:52:31.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.624+0000 7fdf5ae00640 1 -- 172.21.15.120:0/2770767378 shutdown_connections 2024-04-18T04:52:31.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.624+0000 7fdf5ae00640 1 -- 172.21.15.120:0/2770767378 wait complete. 2024-04-18T04:52:31.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.628+0000 7fdf5ae00640 1 Processor -- start 2024-04-18T04:52:31.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.628+0000 7fdf5ae00640 1 -- start start 2024-04-18T04:52:31.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.640+0000 7fdf5ae00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf540c8850 0x7fdf541f4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:31.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.640+0000 7fdf5ae00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdf54153830 0x7fdf5414f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:31.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.640+0000 7fdf5ae00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf5415d090 0x7fdf5414bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:31.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.640+0000 7fdf5ae00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf54146480 con 0x7fdf5415d090 2024-04-18T04:52:31.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.640+0000 7fdf5ae00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf541f50d0 con 0x7fdf540c8850 2024-04-18T04:52:31.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.640+0000 7fdf5ae00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf54145f20 con 0x7fdf54153830 2024-04-18T04:52:31.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.640+0000 7fdf4be00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdf54153830 0x7fdf5414f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:31.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.640+0000 7fdf4be00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdf54153830 0x7fdf5414f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:50472/0 (socket says 172.21.15.120:50472) 2024-04-18T04:52:31.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.640+0000 7fdf4be00640 1 -- 172.21.15.120:0/2248624954 learned_addr learned my addr 172.21.15.120:0/2248624954 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:52:31.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.640+0000 7fdf58e00640 1 --2- 172.21.15.120:0/2248624954 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf5415d090 0x7fdf5414bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:31.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.644+0000 7fdf4be00640 1 -- 172.21.15.120:0/2248624954 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf540c8850 msgr2=0x7fdf541f4b90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:52:31.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.644+0000 7fdf4be00640 1 --2- 172.21.15.120:0/2248624954 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf540c8850 0x7fdf541f4b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:31.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.644+0000 7fdf4be00640 1 -- 172.21.15.120:0/2248624954 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf5415d090 msgr2=0x7fdf5414bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:31.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.644+0000 7fdf4be00640 1 --2- 172.21.15.120:0/2248624954 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf5415d090 0x7fdf5414bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:31.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.644+0000 7fdf4be00640 1 -- 172.21.15.120:0/2248624954 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf4c009b30 con 0x7fdf54153830 2024-04-18T04:52:31.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.656+0000 7fdf4be00640 1 --2- 172.21.15.120:0/2248624954 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdf54153830 0x7fdf5414f460 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdf4400b4d0 tx=0x7fdf4400b990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:31.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.656+0000 7fdf50c00640 1 -- 172.21.15.120:0/2248624954 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf44010870 con 0x7fdf54153830 2024-04-18T04:52:31.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.656+0000 7fdf50c00640 1 -- 172.21.15.120:0/2248624954 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf440109f0 con 0x7fdf54153830 2024-04-18T04:52:31.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.656+0000 7fdf50c00640 1 -- 172.21.15.120:0/2248624954 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf44010da0 con 0x7fdf54153830 2024-04-18T04:52:31.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.660+0000 7fdf5ae00640 1 -- 172.21.15.120:0/2248624954 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf540cc030 con 0x7fdf54153830 2024-04-18T04:52:31.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.660+0000 7fdf5ae00640 1 -- 172.21.15.120:0/2248624954 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf540cc2d0 con 0x7fdf54153830 2024-04-18T04:52:31.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.664+0000 7fdf5ae00640 1 -- 172.21.15.120:0/2248624954 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf54067590 con 0x7fdf54153830 2024-04-18T04:52:31.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.676+0000 7fdf50c00640 1 -- 172.21.15.120:0/2248624954 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdf44023480 con 0x7fdf54153830 2024-04-18T04:52:31.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.680+0000 7fdf50c00640 1 --2- 172.21.15.120:0/2248624954 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fdf30066760 0x7fdf30068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:31.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.680+0000 7fdf50c00640 1 -- 172.21.15.120:0/2248624954 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7007+0+0 (secure 0 0 0) 0x7fdf44084ab0 con 0x7fdf54153830 2024-04-18T04:52:31.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.684+0000 7fdf53e00640 1 --2- 172.21.15.120:0/2248624954 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fdf30066760 0x7fdf30068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:31.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.688+0000 7fdf53e00640 1 --2- 172.21.15.120:0/2248624954 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fdf30066760 0x7fdf30068c20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c00a830 tx=0x7fdf3c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:31.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:31.696+0000 7fdf50c00640 1 -- 172.21.15.120:0/2248624954 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fdf440519a0 con 0x7fdf54153830 2024-04-18T04:52:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:52:32.151 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:52:28.541002+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5105,"mds_1":4967},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:active","state_seq":31,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5105":{"gid":5105,"name":"c","rank":0,"incarnation":38,"state":"up:rejoin","state_seq":12,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:52:32.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:32.144+0000 7fdf5ae00640 1 -- 172.21.15.120:0/2248624954 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf540ca120 con 0x7fdf54153830 2024-04-18T04:52:32.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:32.152+0000 7fdf50c00640 1 -- 172.21.15.120:0/2248624954 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+5522 (secure 0 0 0) 0x7fdf44054fc0 con 0x7fdf54153830 2024-04-18T04:52:32.152 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 41 2024-04-18T04:52:32.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:32.156+0000 7fdf5ae00640 1 -- 172.21.15.120:0/2248624954 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fdf30066760 msgr2=0x7fdf30068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:32.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:32.156+0000 7fdf5ae00640 1 --2- 172.21.15.120:0/2248624954 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fdf30066760 0x7fdf30068c20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c00a830 tx=0x7fdf3c008040 comp rx=0 tx=0).stop 2024-04-18T04:52:32.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:32.156+0000 7fdf5ae00640 1 -- 172.21.15.120:0/2248624954 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdf54153830 msgr2=0x7fdf5414f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:32.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:32.156+0000 7fdf5ae00640 1 --2- 172.21.15.120:0/2248624954 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdf54153830 0x7fdf5414f460 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdf4400b4d0 tx=0x7fdf4400b990 comp rx=0 tx=0).stop 2024-04-18T04:52:32.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:32.164+0000 7fdf5ae00640 1 -- 172.21.15.120:0/2248624954 shutdown_connections 2024-04-18T04:52:32.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:32.164+0000 7fdf5ae00640 1 --2- 172.21.15.120:0/2248624954 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fdf30066760 0x7fdf30068c20 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:32.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:32.164+0000 7fdf5ae00640 1 --2- 172.21.15.120:0/2248624954 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf5415d090 0x7fdf5414bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:32.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:32.164+0000 7fdf5ae00640 1 --2- 172.21.15.120:0/2248624954 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdf54153830 0x7fdf5414f460 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:32.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:32.164+0000 7fdf5ae00640 1 --2- 172.21.15.120:0/2248624954 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf540c8850 0x7fdf541f4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:32.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:32.164+0000 7fdf5ae00640 1 -- 172.21.15.120:0/2248624954 >> 172.21.15.120:0/2248624954 conn(0x7fdf5406e0f0 msgr2=0x7fdf5415b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:52:32.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:32.184+0000 7fdf5ae00640 1 -- 172.21.15.120:0/2248624954 shutdown_connections 2024-04-18T04:52:32.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:32.192+0000 7fdf5ae00640 1 -- 172.21.15.120:0/2248624954 wait complete. 2024-04-18T04:52:32.262 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:52:34.263 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:52:34.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.532+0000 7fcde2a00640 1 Processor -- start 2024-04-18T04:52:34.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.532+0000 7fcde2a00640 1 -- start start 2024-04-18T04:52:34.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.532+0000 7fcde2a00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcddc06a780 0x7fcddc0c6940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:34.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.532+0000 7fcde2a00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcddc15eb00 con 0x7fcddc157f50 2024-04-18T04:52:34.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.532+0000 7fcde2a00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcddc0c85a0 con 0x7fcddc070b00 2024-04-18T04:52:34.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.532+0000 7fcde2a00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcddc0c8880 con 0x7fcddc06a780 2024-04-18T04:52:34.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.532+0000 7fcde0a00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcddc06a780 0x7fcddc0c6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:34.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.532+0000 7fcde0a00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcddc06a780 0x7fcddc0c6940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35928/0 (socket says 172.21.15.120:35928) 2024-04-18T04:52:34.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.532+0000 7fcde0a00640 1 -- 172.21.15.120:0/3762238019 learned_addr learned my addr 172.21.15.120:0/3762238019 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:52:34.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.532+0000 7fcde0a00640 1 -- 172.21.15.120:0/3762238019 >> v1:172.21.15.132:6789/0 conn(0x7fcddc070b00 legacy=0x7fcddc06a070 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-18T04:52:34.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.532+0000 7fcde0a00640 1 -- 172.21.15.120:0/3762238019 >> v1:172.21.15.120:6789/0 conn(0x7fcddc157f50 legacy=0x7fcddc071a90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:52:34.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.532+0000 7fcde0a00640 1 -- 172.21.15.120:0/3762238019 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcddc06d660 con 0x7fcddc06a780 2024-04-18T04:52:34.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.540+0000 7fcde0a00640 1 --2- 172.21.15.120:0/3762238019 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcddc06a780 0x7fcddc0c6940 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc009870 tx=0x7fcdcc01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69a207ec72e687d server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:34.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.540+0000 7fcddaa00640 1 -- 172.21.15.120:0/3762238019 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc0aa430 con 0x7fcddc06a780 2024-04-18T04:52:34.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.540+0000 7fcddaa00640 1 -- 172.21.15.120:0/3762238019 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdcc0aa590 con 0x7fcddc06a780 2024-04-18T04:52:34.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.540+0000 7fcddaa00640 1 -- 172.21.15.120:0/3762238019 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc0aa920 con 0x7fcddc06a780 2024-04-18T04:52:34.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.540+0000 7fcde2a00640 1 -- 172.21.15.120:0/3762238019 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcddc06a780 msgr2=0x7fcddc0c6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:34.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.540+0000 7fcde2a00640 1 --2- 172.21.15.120:0/3762238019 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcddc06a780 0x7fcddc0c6940 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc009870 tx=0x7fcdcc01c4b0 comp rx=0 tx=0).stop 2024-04-18T04:52:34.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.544+0000 7fcde2a00640 1 -- 172.21.15.120:0/3762238019 shutdown_connections 2024-04-18T04:52:34.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.544+0000 7fcde2a00640 1 --2- 172.21.15.120:0/3762238019 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcddc06a780 0x7fcddc0c6940 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:34.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.544+0000 7fcde2a00640 1 -- 172.21.15.120:0/3762238019 >> 172.21.15.120:0/3762238019 conn(0x7fcddc0c8a40 msgr2=0x7fcddc0c8e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:52:34.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.544+0000 7fcde2a00640 1 -- 172.21.15.120:0/3762238019 shutdown_connections 2024-04-18T04:52:34.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.544+0000 7fcde2a00640 1 -- 172.21.15.120:0/3762238019 wait complete. 2024-04-18T04:52:34.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.548+0000 7fcde2a00640 1 Processor -- start 2024-04-18T04:52:34.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.548+0000 7fcde2a00640 1 -- start start 2024-04-18T04:52:34.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.548+0000 7fcde2a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcddc06a780 0x7fcddc1538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:34.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.548+0000 7fcde2a00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcddc070b00 0x7fcddc153e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:34.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.548+0000 7fcde2a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcddc157f50 0x7fcddc149f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:34.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.548+0000 7fcde2a00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcddc153480 con 0x7fcddc157f50 2024-04-18T04:52:34.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.548+0000 7fcde2a00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcddc14de80 con 0x7fcddc070b00 2024-04-18T04:52:34.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.548+0000 7fcde2a00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcddc14d670 con 0x7fcddc06a780 2024-04-18T04:52:34.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.548+0000 7fcddbe00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcddc06a780 0x7fcddc1538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:34.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.548+0000 7fcddb400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcddc070b00 0x7fcddc153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:34.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.548+0000 7fcddbe00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcddc06a780 0x7fcddc1538d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:50478/0 (socket says 172.21.15.120:50478) 2024-04-18T04:52:34.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.548+0000 7fcddbe00640 1 -- 172.21.15.120:0/926023708 learned_addr learned my addr 172.21.15.120:0/926023708 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:52:34.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.552+0000 7fcddbe00640 1 -- 172.21.15.120:0/926023708 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcddc070b00 msgr2=0x7fcddc153e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:34.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.552+0000 7fcddbe00640 1 --2- 172.21.15.120:0/926023708 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcddc070b00 0x7fcddc153e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:34.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.552+0000 7fcddbe00640 1 -- 172.21.15.120:0/926023708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcddc157f50 msgr2=0x7fcddc149f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:34.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.552+0000 7fcddbe00640 1 --2- 172.21.15.120:0/926023708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcddc157f50 0x7fcddc149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:34.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.552+0000 7fcddbe00640 1 -- 172.21.15.120:0/926023708 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdcc0094d0 con 0x7fcddc06a780 2024-04-18T04:52:34.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.552+0000 7fcddb400640 1 --2- 172.21.15.120:0/926023708 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcddc070b00 0x7fcddc153e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:52:34.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.552+0000 7fcddbe00640 1 --2- 172.21.15.120:0/926023708 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcddc06a780 0x7fcddc1538d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcdd400ba80 tx=0x7fcdd400bf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:34.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.552+0000 7fcdd3e00640 1 -- 172.21.15.120:0/926023708 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd400cc90 con 0x7fcddc06a780 2024-04-18T04:52:34.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.552+0000 7fcdd3e00640 1 -- 172.21.15.120:0/926023708 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd400cdf0 con 0x7fcddc06a780 2024-04-18T04:52:34.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.552+0000 7fcdd3e00640 1 -- 172.21.15.120:0/926023708 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd4014680 con 0x7fcddc06a780 2024-04-18T04:52:34.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.552+0000 7fcde2a00640 1 -- 172.21.15.120:0/926023708 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcddc159b50 con 0x7fcddc06a780 2024-04-18T04:52:34.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.552+0000 7fcde2a00640 1 -- 172.21.15.120:0/926023708 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcddc14dba0 con 0x7fcddc06a780 2024-04-18T04:52:34.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.556+0000 7fcde2a00640 1 -- 172.21.15.120:0/926023708 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcddc153250 con 0x7fcddc06a780 2024-04-18T04:52:34.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.556+0000 7fcdd3e00640 1 -- 172.21.15.120:0/926023708 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcdd40147e0 con 0x7fcddc06a780 2024-04-18T04:52:34.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.556+0000 7fcdd3e00640 1 --2- 172.21.15.120:0/926023708 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fcdbc066690 0x7fcdbc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:34.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.556+0000 7fcdd3e00640 1 -- 172.21.15.120:0/926023708 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7007+0+0 (secure 0 0 0) 0x7fcdd4054eb0 con 0x7fcddc06a780 2024-04-18T04:52:34.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.560+0000 7fcddb400640 1 --2- 172.21.15.120:0/926023708 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fcdbc066690 0x7fcdbc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:34.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.560+0000 7fcddb400640 1 --2- 172.21.15.120:0/926023708 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fcdbc066690 0x7fcdbc068b50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcddc155400 tx=0x7fcdc80090e0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:34.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.568+0000 7fcdd3e00640 1 -- 172.21.15.120:0/926023708 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fcddc153250 con 0x7fcddc06a780 2024-04-18T04:52:34.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.920+0000 7fcde2a00640 1 -- 172.21.15.120:0/926023708 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcddc153250 con 0x7fcddc06a780 2024-04-18T04:52:34.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.924+0000 7fcdd3e00640 1 -- 172.21.15.120:0/926023708 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+5522 (secure 0 0 0) 0x7fcddc153250 con 0x7fcddc06a780 2024-04-18T04:52:34.925 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:52:34.925 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:52:34.088115+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5105,"mds_1":4967},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:active","state_seq":31,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5105":{"gid":5105,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":14,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:52:34.925 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 42 2024-04-18T04:52:34.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.928+0000 7fcde2a00640 1 -- 172.21.15.120:0/926023708 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fcdbc066690 msgr2=0x7fcdbc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:34.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.928+0000 7fcde2a00640 1 --2- 172.21.15.120:0/926023708 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fcdbc066690 0x7fcdbc068b50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcddc155400 tx=0x7fcdc80090e0 comp rx=0 tx=0).stop 2024-04-18T04:52:34.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.928+0000 7fcde2a00640 1 -- 172.21.15.120:0/926023708 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcddc06a780 msgr2=0x7fcddc1538d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:34.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.928+0000 7fcde2a00640 1 --2- 172.21.15.120:0/926023708 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcddc06a780 0x7fcddc1538d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcdd400ba80 tx=0x7fcdd400bf40 comp rx=0 tx=0).stop 2024-04-18T04:52:34.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.928+0000 7fcde2a00640 1 -- 172.21.15.120:0/926023708 shutdown_connections 2024-04-18T04:52:34.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.928+0000 7fcde2a00640 1 --2- 172.21.15.120:0/926023708 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fcdbc066690 0x7fcdbc068b50 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:34.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.928+0000 7fcde2a00640 1 --2- 172.21.15.120:0/926023708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcddc157f50 0x7fcddc149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:34.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.928+0000 7fcde2a00640 1 --2- 172.21.15.120:0/926023708 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcddc070b00 0x7fcddc153e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:34.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.928+0000 7fcde2a00640 1 --2- 172.21.15.120:0/926023708 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcddc06a780 0x7fcddc1538d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:34.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.928+0000 7fcde2a00640 1 -- 172.21.15.120:0/926023708 >> 172.21.15.120:0/926023708 conn(0x7fcddc0c8a40 msgr2=0x7fcddc071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:52:34.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.928+0000 7fcde2a00640 1 -- 172.21.15.120:0/926023708 shutdown_connections 2024-04-18T04:52:34.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:34.928+0000 7fcde2a00640 1 -- 172.21.15.120:0/926023708 wait complete. 2024-04-18T04:52:34.957 INFO:tasks.mds_thrash.fs.[cephfs]:mds.c has gained rank=0, replacing gid=4288 2024-04-18T04:52:34.957 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 4 secs before reviving mds.e 2024-04-18T04:52:38.958 INFO:tasks.mds_thrash.fs.[cephfs]:reviving mds.e 2024-04-18T04:52:38.958 INFO:tasks.ceph.mds.e:Restarting daemon 2024-04-18T04:52:38.959 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-04-18T04:52:38.963 INFO:tasks.ceph.mds.e:Started 2024-04-18T04:52:38.963 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:52:39.504 INFO:tasks.ceph.mds.e.smithi120.stdout:starting mds.e at 2024-04-18T04:52:39.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.248+0000 7f406e800640 1 Processor -- start 2024-04-18T04:52:39.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.248+0000 7f406e800640 1 -- start start 2024-04-18T04:52:39.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.248+0000 7f406e800640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f406806c6d0 0x7f40680c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:39.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.248+0000 7f406e800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f40681699d0 0x7f4068169e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:39.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.248+0000 7f406e800640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f406806b800 con 0x7f4068163a90 2024-04-18T04:52:39.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.248+0000 7f406e800640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4068070130 con 0x7f406806c6d0 2024-04-18T04:52:39.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.248+0000 7f406e800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40680c72e0 con 0x7f40681699d0 2024-04-18T04:52:39.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.248+0000 7f405ea00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f406806c6d0 0x7f40680c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:39.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.248+0000 7f405ea00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f406806c6d0 0x7f40680c61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35962/0 (socket says 172.21.15.120:35962) 2024-04-18T04:52:39.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.248+0000 7f405ea00640 1 -- 172.21.15.120:0/2977523008 learned_addr learned my addr 172.21.15.120:0/2977523008 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:52:39.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.248+0000 7f4067e00640 1 --2- 172.21.15.120:0/2977523008 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f40681699d0 0x7f4068169e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:39.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.248+0000 7f4066a00640 1 -- 172.21.15.120:0/2977523008 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1155668462 0 0) 0x7f406806b800 con 0x7f4068163a90 2024-04-18T04:52:39.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.504+0000 7f4066a00640 1 -- 172.21.15.120:0/2977523008 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f404c004640 con 0x7f4068163a90 2024-04-18T04:52:39.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.508+0000 7f4067e00640 1 -- 172.21.15.120:0/2977523008 >> v2:172.21.15.120:3300/0 conn(0x7f406806c6d0 msgr2=0x7f40680c61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:52:39.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.508+0000 7f4067e00640 1 --2- 172.21.15.120:0/2977523008 >> v2:172.21.15.120:3300/0 conn(0x7f406806c6d0 0x7f40680c61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:39.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.508+0000 7f4067e00640 1 -- 172.21.15.120:0/2977523008 >> v1:172.21.15.120:6789/0 conn(0x7f4068163a90 legacy=0x7f406806bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:39.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.508+0000 7f4067e00640 1 -- 172.21.15.120:0/2977523008 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40680c6d20 con 0x7f40681699d0 2024-04-18T04:52:39.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.512+0000 7f4067e00640 1 --2- 172.21.15.120:0/2977523008 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f40681699d0 0x7f4068169e20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4060007b60 tx=0x7f406001f450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0ad8353bc5f693c server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:39.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.512+0000 7f4066a00640 1 -- 172.21.15.120:0/2977523008 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40600af600 con 0x7f40681699d0 2024-04-18T04:52:39.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.512+0000 7f4066a00640 1 -- 172.21.15.120:0/2977523008 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40600ab050 con 0x7f40681699d0 2024-04-18T04:52:39.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.512+0000 7f4066a00640 1 -- 172.21.15.120:0/2977523008 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40600af980 con 0x7f40681699d0 2024-04-18T04:52:39.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.524+0000 7f406e800640 1 -- 172.21.15.120:0/2977523008 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f40681699d0 msgr2=0x7f4068169e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:39.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.524+0000 7f406e800640 1 --2- 172.21.15.120:0/2977523008 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f40681699d0 0x7f4068169e20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4060007b60 tx=0x7f406001f450 comp rx=0 tx=0).stop 2024-04-18T04:52:39.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.524+0000 7f406e800640 1 -- 172.21.15.120:0/2977523008 shutdown_connections 2024-04-18T04:52:39.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.524+0000 7f406e800640 1 --2- 172.21.15.120:0/2977523008 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f40681699d0 0x7f4068169e20 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:39.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.524+0000 7f406e800640 1 --2- 172.21.15.120:0/2977523008 >> v2:172.21.15.120:3300/0 conn(0x7f406806c6d0 0x7f40680c61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:39.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.524+0000 7f406e800640 1 -- 172.21.15.120:0/2977523008 >> 172.21.15.120:0/2977523008 conn(0x7f40680c78c0 msgr2=0x7f40680c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:52:39.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.524+0000 7f406e800640 1 -- 172.21.15.120:0/2977523008 shutdown_connections 2024-04-18T04:52:39.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.524+0000 7f406e800640 1 -- 172.21.15.120:0/2977523008 wait complete. 2024-04-18T04:52:39.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.528+0000 7f406e800640 1 Processor -- start 2024-04-18T04:52:39.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.532+0000 7f406e800640 1 -- start start 2024-04-18T04:52:39.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.532+0000 7f406e800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f406806c6d0 0x7f40680c4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:39.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.532+0000 7f406e800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4068163a90 0x7f4068210ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:39.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.532+0000 7f406e800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40681699d0 0x7f4068211020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:39.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.532+0000 7f406e800640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40680c5e40 con 0x7f406806c6d0 2024-04-18T04:52:39.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.532+0000 7f406e800640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40680aa710 con 0x7f40681699d0 2024-04-18T04:52:39.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.532+0000 7f406e800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40680c5020 con 0x7f4068163a90 2024-04-18T04:52:39.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.532+0000 7f4067e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40681699d0 0x7f4068211020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:39.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.532+0000 7f4067e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40681699d0 0x7f4068211020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:53062/0 (socket says 172.21.15.120:53062) 2024-04-18T04:52:39.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.532+0000 7f4067e00640 1 -- 172.21.15.120:0/1151370216 learned_addr learned my addr 172.21.15.120:0/1151370216 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:52:39.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.532+0000 7f405ea00640 1 --2- 172.21.15.120:0/1151370216 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4068163a90 0x7f4068210ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:39.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.536+0000 7f4067e00640 1 -- 172.21.15.120:0/1151370216 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4068163a90 msgr2=0x7f4068210ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:39.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.536+0000 7f4067e00640 1 --2- 172.21.15.120:0/1151370216 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4068163a90 0x7f4068210ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:39.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.536+0000 7f4067e00640 1 -- 172.21.15.120:0/1151370216 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f406806c6d0 msgr2=0x7f40680c4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:39.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.536+0000 7f4067e00640 1 --2- 172.21.15.120:0/1151370216 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f406806c6d0 0x7f40680c4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:39.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.536+0000 7f4067e00640 1 -- 172.21.15.120:0/1151370216 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40600077c0 con 0x7f40681699d0 2024-04-18T04:52:39.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.536+0000 7f4067e00640 1 --2- 172.21.15.120:0/1151370216 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40681699d0 0x7f4068211020 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f406001db00 tx=0x7f406001c1f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:39.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.540+0000 7f405fe00640 1 -- 172.21.15.120:0/1151370216 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40600ba420 con 0x7f40681699d0 2024-04-18T04:52:39.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.540+0000 7f405fe00640 1 -- 172.21.15.120:0/1151370216 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40600ba580 con 0x7f40681699d0 2024-04-18T04:52:39.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.540+0000 7f405fe00640 1 -- 172.21.15.120:0/1151370216 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40600ba8f0 con 0x7f40681699d0 2024-04-18T04:52:39.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.544+0000 7f406e800640 1 -- 172.21.15.120:0/1151370216 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40680c52c0 con 0x7f40681699d0 2024-04-18T04:52:39.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.544+0000 7f406e800640 1 -- 172.21.15.120:0/1151370216 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40680c5880 con 0x7f40681699d0 2024-04-18T04:52:39.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.552+0000 7f405fe00640 1 -- 172.21.15.120:0/1151370216 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f40600baa50 con 0x7f40681699d0 2024-04-18T04:52:39.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.552+0000 7f406e800640 1 -- 172.21.15.120:0/1151370216 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4040005260 con 0x7f40681699d0 2024-04-18T04:52:39.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.552+0000 7f405fe00640 1 --2- 172.21.15.120:0/1151370216 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4044066760 0x7f4044068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:39.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.556+0000 7f405fe00640 1 -- 172.21.15.120:0/1151370216 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f4060122ac0 con 0x7f40681699d0 2024-04-18T04:52:39.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.556+0000 7f4067400640 1 --2- 172.21.15.120:0/1151370216 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4044066760 0x7f4044068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:39.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.556+0000 7f4067400640 1 --2- 172.21.15.120:0/1151370216 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4044066760 0x7f4044068c20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4058007fd0 tx=0x7f4058007940 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:39.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:39.592+0000 7f405fe00640 1 -- 172.21.15.120:0/1151370216 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f40600b4020 con 0x7f40681699d0 2024-04-18T04:52:40.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:40.160+0000 7f406e800640 1 -- 172.21.15.120:0/1151370216 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4040005a90 con 0x7f40681699d0 2024-04-18T04:52:40.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:40.168+0000 7f405fe00640 1 -- 172.21.15.120:0/1151370216 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+5522 (secure 0 0 0) 0x7f40600ef920 con 0x7f40681699d0 2024-04-18T04:52:40.168 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:52:40.169 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:52:34.088115+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5105,"mds_1":4967},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:active","state_seq":31,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5105":{"gid":5105,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":14,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:52:40.172 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 42 2024-04-18T04:52:40.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:40.176+0000 7f406e800640 1 -- 172.21.15.120:0/1151370216 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4044066760 msgr2=0x7f4044068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:40.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:40.176+0000 7f406e800640 1 --2- 172.21.15.120:0/1151370216 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4044066760 0x7f4044068c20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4058007fd0 tx=0x7f4058007940 comp rx=0 tx=0).stop 2024-04-18T04:52:40.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:40.176+0000 7f406e800640 1 -- 172.21.15.120:0/1151370216 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40681699d0 msgr2=0x7f4068211020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:40.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:40.176+0000 7f406e800640 1 --2- 172.21.15.120:0/1151370216 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40681699d0 0x7f4068211020 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f406001db00 tx=0x7f406001c1f0 comp rx=0 tx=0).stop 2024-04-18T04:52:40.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:40.176+0000 7f406e800640 1 -- 172.21.15.120:0/1151370216 shutdown_connections 2024-04-18T04:52:40.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:40.176+0000 7f406e800640 1 --2- 172.21.15.120:0/1151370216 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4044066760 0x7f4044068c20 secure :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4058007fd0 tx=0x7f4058007940 comp rx=0 tx=0).stop 2024-04-18T04:52:40.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:40.176+0000 7f406e800640 1 --2- 172.21.15.120:0/1151370216 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40681699d0 0x7f4068211020 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:40.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:40.176+0000 7f406e800640 1 --2- 172.21.15.120:0/1151370216 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4068163a90 0x7f4068210ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:40.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:40.176+0000 7f406e800640 1 --2- 172.21.15.120:0/1151370216 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f406806c6d0 0x7f40680c4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:40.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:40.176+0000 7f406e800640 1 -- 172.21.15.120:0/1151370216 >> 172.21.15.120:0/1151370216 conn(0x7f40680c78c0 msgr2=0x7f40680c7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:52:40.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:40.176+0000 7f406e800640 1 -- 172.21.15.120:0/1151370216 shutdown_connections 2024-04-18T04:52:40.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:40.180+0000 7f406e800640 1 -- 172.21.15.120:0/1151370216 wait complete. 2024-04-18T04:52:40.213 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is in active, standby or standby-replay 2024-04-18T04:52:42.214 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:52:42.256 INFO:tasks.ceph.mds.c.smithi120.stderr:2024-04-18T04:52:42.256+0000 7f653d600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-18T04:52:42.256 INFO:tasks.ceph.mds.c.smithi120.stderr:2024-04-18T04:52:42.256+0000 7f653d600640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-18T04:52:42.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.500+0000 7fd64b600640 1 Processor -- start 2024-04-18T04:52:42.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.500+0000 7fd64b600640 1 -- start start 2024-04-18T04:52:42.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.504+0000 7fd64b600640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd6440c69e0 0x7fd6440c0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:42.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.504+0000 7fd64b600640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd644157de0 0x7fd64406bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:42.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.504+0000 7fd64b600640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd64415e970 con 0x7fd644157a00 2024-04-18T04:52:42.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.504+0000 7fd64b600640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd644162170 con 0x7fd644157de0 2024-04-18T04:52:42.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.504+0000 7fd64b600640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd644158250 con 0x7fd6440c69e0 2024-04-18T04:52:42.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.504+0000 7fd643e00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd6440c69e0 0x7fd6440c0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:42.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.504+0000 7fd643e00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd6440c69e0 0x7fd6440c0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:34268/0 (socket says 172.21.15.120:34268) 2024-04-18T04:52:42.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.504+0000 7fd643e00640 1 -- 172.21.15.120:0/587472256 learned_addr learned my addr 172.21.15.120:0/587472256 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:52:42.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.504+0000 7fd649600640 1 --2- 172.21.15.120:0/587472256 >> v2:172.21.15.120:3300/0 conn(0x7fd644157de0 0x7fd64406bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:42.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.504+0000 7fd643e00640 1 -- 172.21.15.120:0/587472256 >> v2:172.21.15.120:3300/0 conn(0x7fd644157de0 msgr2=0x7fd64406bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:52:42.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.504+0000 7fd643e00640 1 --2- 172.21.15.120:0/587472256 >> v2:172.21.15.120:3300/0 conn(0x7fd644157de0 0x7fd64406bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:42.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.504+0000 7fd643e00640 1 -- 172.21.15.120:0/587472256 >> v1:172.21.15.132:6789/0 conn(0x7fd644157a00 legacy=0x7fd64406b660 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-18T04:52:42.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.504+0000 7fd643e00640 1 -- 172.21.15.120:0/587472256 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6440c5940 con 0x7fd6440c69e0 2024-04-18T04:52:42.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.508+0000 7fd643e00640 1 --2- 172.21.15.120:0/587472256 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6440c69e0 0x7fd6440c0330 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd64406f010 tx=0x7fd63401ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bae3946d7abfbd0b server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:42.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.508+0000 7fd643400640 1 -- 172.21.15.120:0/587472256 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6340a89d0 con 0x7fd6440c69e0 2024-04-18T04:52:42.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.512+0000 7fd643400640 1 -- 172.21.15.120:0/587472256 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6340a8b30 con 0x7fd6440c69e0 2024-04-18T04:52:42.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.512+0000 7fd643400640 1 -- 172.21.15.120:0/587472256 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6340b0440 con 0x7fd6440c69e0 2024-04-18T04:52:42.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.512+0000 7fd64b600640 1 -- 172.21.15.120:0/587472256 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6440c69e0 msgr2=0x7fd6440c0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:42.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.512+0000 7fd64b600640 1 --2- 172.21.15.120:0/587472256 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6440c69e0 0x7fd6440c0330 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd64406f010 tx=0x7fd63401ecd0 comp rx=0 tx=0).stop 2024-04-18T04:52:42.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.516+0000 7fd64b600640 1 -- 172.21.15.120:0/587472256 shutdown_connections 2024-04-18T04:52:42.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.516+0000 7fd64b600640 1 --2- 172.21.15.120:0/587472256 >> v2:172.21.15.120:3300/0 conn(0x7fd644157de0 0x7fd64406bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:42.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.516+0000 7fd64b600640 1 --2- 172.21.15.120:0/587472256 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6440c69e0 0x7fd6440c0330 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:42.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.516+0000 7fd64b600640 1 -- 172.21.15.120:0/587472256 >> 172.21.15.120:0/587472256 conn(0x7fd6440c78c0 msgr2=0x7fd6440c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:52:42.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.516+0000 7fd64b600640 1 -- 172.21.15.120:0/587472256 shutdown_connections 2024-04-18T04:52:42.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.516+0000 7fd64b600640 1 -- 172.21.15.120:0/587472256 wait complete. 2024-04-18T04:52:42.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.524+0000 7fd64b600640 1 Processor -- start 2024-04-18T04:52:42.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.524+0000 7fd64b600640 1 -- start start 2024-04-18T04:52:42.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.524+0000 7fd64b600640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6440c69e0 0x7fd6441f5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:42.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.528+0000 7fd64b600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd644157a00 0x7fd64415aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:42.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.528+0000 7fd64b600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd644157de0 0x7fd6441f1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:42.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.528+0000 7fd64b600640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6441f6b60 con 0x7fd644157a00 2024-04-18T04:52:42.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.528+0000 7fd64b600640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64415b410 con 0x7fd6440c69e0 2024-04-18T04:52:42.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.528+0000 7fd64b600640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6441f5d00 con 0x7fd644157de0 2024-04-18T04:52:42.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.528+0000 7fd648c00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6440c69e0 0x7fd6441f5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:42.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.528+0000 7fd648c00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6440c69e0 0x7fd6441f5650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:34274/0 (socket says 172.21.15.120:34274) 2024-04-18T04:52:42.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.528+0000 7fd648c00640 1 -- 172.21.15.120:0/3263998463 learned_addr learned my addr 172.21.15.120:0/3263998463 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:52:42.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.528+0000 7fd648c00640 1 -- 172.21.15.120:0/3263998463 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd644157de0 msgr2=0x7fd6441f1b20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-18T04:52:42.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.528+0000 7fd648c00640 1 --2- 172.21.15.120:0/3263998463 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd644157de0 0x7fd6441f1b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:42.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.528+0000 7fd648c00640 1 -- 172.21.15.120:0/3263998463 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd644157a00 msgr2=0x7fd64415aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:42.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.528+0000 7fd648c00640 1 --2- 172.21.15.120:0/3263998463 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd644157a00 0x7fd64415aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:42.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.528+0000 7fd648c00640 1 -- 172.21.15.120:0/3263998463 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6340094d0 con 0x7fd6440c69e0 2024-04-18T04:52:42.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.528+0000 7fd648c00640 1 --2- 172.21.15.120:0/3263998463 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6440c69e0 0x7fd6441f5650 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd63000b4d0 tx=0x7fd63000b990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:42.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.528+0000 7fd640c00640 1 -- 172.21.15.120:0/3263998463 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd630010870 con 0x7fd6440c69e0 2024-04-18T04:52:42.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.532+0000 7fd640c00640 1 -- 172.21.15.120:0/3263998463 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6300109f0 con 0x7fd6440c69e0 2024-04-18T04:52:42.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.532+0000 7fd640c00640 1 -- 172.21.15.120:0/3263998463 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd630010da0 con 0x7fd6440c69e0 2024-04-18T04:52:42.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.532+0000 7fd64b600640 1 -- 172.21.15.120:0/3263998463 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6441f5fe0 con 0x7fd6440c69e0 2024-04-18T04:52:42.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.532+0000 7fd64b600640 1 -- 172.21.15.120:0/3263998463 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6441f65a0 con 0x7fd6440c69e0 2024-04-18T04:52:42.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.536+0000 7fd640c00640 1 -- 172.21.15.120:0/3263998463 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd63000f3c0 con 0x7fd6440c69e0 2024-04-18T04:52:42.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.536+0000 7fd640c00640 1 --2- 172.21.15.120:0/3263998463 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd624066760 0x7fd624068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:52:42.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.536+0000 7fd640c00640 1 -- 172.21.15.120:0/3263998463 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7007+0+0 (secure 0 0 0) 0x7fd6300845f0 con 0x7fd6440c69e0 2024-04-18T04:52:42.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.540+0000 7fd64b600640 1 -- 172.21.15.120:0/3263998463 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd644072a70 con 0x7fd6440c69e0 2024-04-18T04:52:42.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.540+0000 7fd643e00640 1 --2- 172.21.15.120:0/3263998463 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd624066760 0x7fd624068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:52:42.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.548+0000 7fd640c00640 1 -- 172.21.15.120:0/3263998463 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fd6300514c0 con 0x7fd6440c69e0 2024-04-18T04:52:42.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.548+0000 7fd643e00640 1 --2- 172.21.15.120:0/3263998463 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd624066760 0x7fd624068c20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd6340b2000 tx=0x7fd634004740 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:52:42.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.948+0000 7fd64b600640 1 -- 172.21.15.120:0/3263998463 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd644073790 con 0x7fd6440c69e0 2024-04-18T04:52:42.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.952+0000 7fd640c00640 1 -- 172.21.15.120:0/3263998463 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+6279 (secure 0 0 0) 0x7fd63001e090 con 0x7fd6440c69e0 2024-04-18T04:52:42.950 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:52:42.950 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":43,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5400,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/671327196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":671327196},{"type":"v1","addr":"172.21.15.120:6837","nonce":671327196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:52:34.088115+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5105,"mds_1":4967},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:active","state_seq":31,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5105":{"gid":5105,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":14,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:52:42.950 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 43 2024-04-18T04:52:42.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.952+0000 7fd64b600640 1 -- 172.21.15.120:0/3263998463 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd624066760 msgr2=0x7fd624068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:42.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.952+0000 7fd64b600640 1 --2- 172.21.15.120:0/3263998463 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd624066760 0x7fd624068c20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd6340b2000 tx=0x7fd634004740 comp rx=0 tx=0).stop 2024-04-18T04:52:42.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.952+0000 7fd64b600640 1 -- 172.21.15.120:0/3263998463 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6440c69e0 msgr2=0x7fd6441f5650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:52:42.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.952+0000 7fd64b600640 1 --2- 172.21.15.120:0/3263998463 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6440c69e0 0x7fd6441f5650 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd63000b4d0 tx=0x7fd63000b990 comp rx=0 tx=0).stop 2024-04-18T04:52:42.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.952+0000 7fd64b600640 1 -- 172.21.15.120:0/3263998463 shutdown_connections 2024-04-18T04:52:42.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.952+0000 7fd64b600640 1 --2- 172.21.15.120:0/3263998463 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd624066760 0x7fd624068c20 secure :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd6340b2000 tx=0x7fd634004740 comp rx=0 tx=0).stop 2024-04-18T04:52:42.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.952+0000 7fd64b600640 1 --2- 172.21.15.120:0/3263998463 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd644157de0 0x7fd6441f1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:42.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.952+0000 7fd64b600640 1 --2- 172.21.15.120:0/3263998463 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd644157a00 0x7fd64415aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:42.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.952+0000 7fd64b600640 1 --2- 172.21.15.120:0/3263998463 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6440c69e0 0x7fd6441f5650 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:52:42.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.952+0000 7fd64b600640 1 -- 172.21.15.120:0/3263998463 >> 172.21.15.120:0/3263998463 conn(0x7fd6440c78c0 msgr2=0x7fd644070940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:52:42.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.956+0000 7fd64b600640 1 -- 172.21.15.120:0/3263998463 shutdown_connections 2024-04-18T04:52:42.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:52:42.956+0000 7fd64b600640 1 -- 172.21.15.120:0/3263998463 wait complete. 2024-04-18T04:52:42.992 INFO:tasks.mds_thrash.fs.[cephfs]:mds.e reported in up:standby state 2024-04-18T04:52:42.992 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 29 secs before thrashing 2024-04-18T04:52:44.672 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:52:44.675 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:53:11.994 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:53:12.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.408+0000 7f8497400640 1 Processor -- start 2024-04-18T04:53:12.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.408+0000 7f8497400640 1 -- start start 2024-04-18T04:53:12.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.412+0000 7f8497400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8490157d70 0x7f849006afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:12.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.412+0000 7f8497400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f849006f3b0 0x7f849006f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:12.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.412+0000 7f8494a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8490157d70 0x7f849006afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:12.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.412+0000 7f8494a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8490157d70 0x7f849006afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:50650/0 (socket says 172.21.15.120:50650) 2024-04-18T04:53:12.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.412+0000 7f8494a00640 1 -- 172.21.15.120:0/1534412141 learned_addr learned my addr 172.21.15.120:0/1534412141 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:53:12.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.412+0000 7f8497400640 1 -- 172.21.15.120:0/1534412141 --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f849006caa0 con 0x7f84900700c0 2024-04-18T04:53:12.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.412+0000 7f8495400640 1 --2- 172.21.15.120:0/1534412141 >> v2:172.21.15.132:3300/0 conn(0x7f849006f3b0 0x7f849006f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:12.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.412+0000 7f8497400640 1 -- 172.21.15.120:0/1534412141 --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84900cdcb0 con 0x7f849006f3b0 2024-04-18T04:53:12.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.412+0000 7f8497400640 1 -- 172.21.15.120:0/1534412141 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84900cd820 con 0x7f8490157d70 2024-04-18T04:53:12.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.412+0000 7f848f400640 1 -- 172.21.15.120:0/1534412141 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1423280656 0 0) 0x7f849006caa0 con 0x7f84900700c0 2024-04-18T04:53:12.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.412+0000 7f848f400640 1 -- 172.21.15.120:0/1534412141 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8478003530 con 0x7f84900700c0 2024-04-18T04:53:12.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.412+0000 7f848f400640 1 -- 172.21.15.120:0/1534412141 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4059785685 0 0) 0x7f8478003530 con 0x7f84900700c0 2024-04-18T04:53:12.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.412+0000 7f848f400640 1 -- 172.21.15.120:0/1534412141 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8490157d70 msgr2=0x7f849006afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:53:12.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.412+0000 7f848f400640 1 --2- 172.21.15.120:0/1534412141 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8490157d70 0x7f849006afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:12.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.412+0000 7f848f400640 1 -- 172.21.15.120:0/1534412141 >> v2:172.21.15.132:3300/0 conn(0x7f849006f3b0 msgr2=0x7f849006f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:53:12.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.412+0000 7f848f400640 1 --2- 172.21.15.120:0/1534412141 >> v2:172.21.15.132:3300/0 conn(0x7f849006f3b0 0x7f849006f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:12.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.416+0000 7f848f400640 1 -- 172.21.15.120:0/1534412141 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84900ccf30 con 0x7f84900700c0 2024-04-18T04:53:12.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.416+0000 7f848f400640 1 -- 172.21.15.120:0/1534412141 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7f847c001680 con 0x7f84900700c0 2024-04-18T04:53:12.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.416+0000 7f8494a00640 1 --2- 172.21.15.120:0/1534412141 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8490157d70 0x7f849006afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:53:12.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.416+0000 7f848f400640 1 -- 172.21.15.120:0/1534412141 >> v1:172.21.15.120:6789/0 conn(0x7f84900700c0 legacy=0x7f849015dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:12.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.416+0000 7f848f400640 1 --2- 172.21.15.120:0/1534412141 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8478003980 0x7f8478003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:12.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.416+0000 7f848f400640 1 --2- 172.21.15.120:0/1534412141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8478004370 0x7f8478004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:12.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.416+0000 7f848f400640 1 --2- 172.21.15.120:0/1534412141 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8478004f70 0x7f847800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:12.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.416+0000 7f848f400640 1 -- 172.21.15.120:0/1534412141 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84900cdcb0 con 0x7f8478004f70 2024-04-18T04:53:12.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.416+0000 7f848f400640 1 -- 172.21.15.120:0/1534412141 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84900cd820 con 0x7f8478004370 2024-04-18T04:53:12.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.416+0000 7f848f400640 1 -- 172.21.15.120:0/1534412141 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f847800bf00 con 0x7f8478003980 2024-04-18T04:53:12.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.416+0000 7f8495400640 1 --2- 172.21.15.120:0/1534412141 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8478004f70 0x7f847800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:12.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.416+0000 7f8494a00640 1 --2- 172.21.15.120:0/1534412141 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8478003980 0x7f8478003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:12.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.416+0000 7f848fe00640 1 --2- 172.21.15.120:0/1534412141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8478004370 0x7f8478004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:12.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.416+0000 7f8494a00640 1 -- 172.21.15.120:0/1534412141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8478004370 msgr2=0x7f8478004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:53:12.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.416+0000 7f8494a00640 1 --2- 172.21.15.120:0/1534412141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8478004370 0x7f8478004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:12.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.416+0000 7f8494a00640 1 -- 172.21.15.120:0/1534412141 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8478004f70 msgr2=0x7f847800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:53:12.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.416+0000 7f8494a00640 1 --2- 172.21.15.120:0/1534412141 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8478004f70 0x7f847800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:12.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.416+0000 7f8494a00640 1 -- 172.21.15.120:0/1534412141 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84900ccf30 con 0x7f8478003980 2024-04-18T04:53:12.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.416+0000 7f8495400640 1 --2- 172.21.15.120:0/1534412141 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8478004f70 0x7f847800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:53:12.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.432+0000 7f8494a00640 1 --2- 172.21.15.120:0/1534412141 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8478003980 0x7f8478003da0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8490072600 tx=0x7f848401c610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32b287e103242157 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:12.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.432+0000 7f848f400640 1 -- 172.21.15.120:0/1534412141 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84840a9620 con 0x7f8478003980 2024-04-18T04:53:12.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.432+0000 7f848f400640 1 -- 172.21.15.120:0/1534412141 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84840a9780 con 0x7f8478003980 2024-04-18T04:53:12.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.436+0000 7f8497400640 1 -- 172.21.15.120:0/1534412141 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8478003980 msgr2=0x7f8478003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:12.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.436+0000 7f8497400640 1 --2- 172.21.15.120:0/1534412141 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8478003980 0x7f8478003da0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8490072600 tx=0x7f848401c610 comp rx=0 tx=0).stop 2024-04-18T04:53:12.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.436+0000 7f8495400640 1 -- 172.21.15.120:0/1534412141 reap_dead start 2024-04-18T04:53:12.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.436+0000 7f8497400640 1 -- 172.21.15.120:0/1534412141 shutdown_connections 2024-04-18T04:53:12.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.436+0000 7f8497400640 1 -- 172.21.15.120:0/1534412141 >> 172.21.15.120:0/1534412141 conn(0x7f8490069ec0 msgr2=0x7f849006a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:53:12.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.436+0000 7f8497400640 1 -- 172.21.15.120:0/1534412141 shutdown_connections 2024-04-18T04:53:12.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.436+0000 7f8497400640 1 -- 172.21.15.120:0/1534412141 wait complete. 2024-04-18T04:53:12.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.440+0000 7f8497400640 1 Processor -- start 2024-04-18T04:53:12.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.440+0000 7f8497400640 1 -- start start 2024-04-18T04:53:12.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.448+0000 7f8497400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8478003980 0x7f849015eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:12.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.448+0000 7f8497400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84901fc4e0 0x7f84901fc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:12.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.448+0000 7f8497400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84901fdfc0 0x7f84901fe440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:12.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.448+0000 7f8494a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8478003980 0x7f849015eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:12.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.448+0000 7f8494a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8478003980 0x7f849015eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:50674/0 (socket says 172.21.15.120:50674) 2024-04-18T04:53:12.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.448+0000 7f848fe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84901fc4e0 0x7f84901fc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:12.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.448+0000 7f848fe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84901fc4e0 0x7f84901fc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36212/0 (socket says 172.21.15.120:36212) 2024-04-18T04:53:12.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.448+0000 7f8494a00640 1 -- 172.21.15.120:0/3439841990 learned_addr learned my addr 172.21.15.120:0/3439841990 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:53:12.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.448+0000 7f8495400640 1 --2- 172.21.15.120:0/3439841990 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84901fdfc0 0x7f84901fe440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:12.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.448+0000 7f8497400640 1 -- 172.21.15.120:0/3439841990 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8490161820 con 0x7f84901fc4e0 2024-04-18T04:53:12.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.448+0000 7f8497400640 1 -- 172.21.15.120:0/3439841990 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8490160340 con 0x7f84901fdfc0 2024-04-18T04:53:12.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.448+0000 7f8497400640 1 -- 172.21.15.120:0/3439841990 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84900c7640 con 0x7f8478003980 2024-04-18T04:53:12.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.452+0000 7f8495400640 1 -- 172.21.15.120:0/3439841990 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8478003980 msgr2=0x7f849015eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:12.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.452+0000 7f8495400640 1 --2- 172.21.15.120:0/3439841990 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8478003980 0x7f849015eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:12.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.452+0000 7f8495400640 1 -- 172.21.15.120:0/3439841990 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84901fc4e0 msgr2=0x7f84901fc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:12.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.452+0000 7f8495400640 1 --2- 172.21.15.120:0/3439841990 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84901fc4e0 0x7f84901fc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:12.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.452+0000 7f8495400640 1 -- 172.21.15.120:0/3439841990 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84901fce40 con 0x7f84901fdfc0 2024-04-18T04:53:12.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.452+0000 7f8495400640 1 --2- 172.21.15.120:0/3439841990 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84901fdfc0 0x7f84901fe440 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f84900cdf10 tx=0x7f8488010590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:12.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.452+0000 7f848cc00640 1 -- 172.21.15.120:0/3439841990 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848800e050 con 0x7f84901fdfc0 2024-04-18T04:53:12.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.452+0000 7f848cc00640 1 -- 172.21.15.120:0/3439841990 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848800f040 con 0x7f84901fdfc0 2024-04-18T04:53:12.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.452+0000 7f848cc00640 1 -- 172.21.15.120:0/3439841990 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8488003ba0 con 0x7f84901fdfc0 2024-04-18T04:53:12.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.452+0000 7f8497400640 1 -- 172.21.15.120:0/3439841990 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84901fe980 con 0x7f84901fdfc0 2024-04-18T04:53:12.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.452+0000 7f8497400640 1 -- 172.21.15.120:0/3439841990 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84901551b0 con 0x7f84901fdfc0 2024-04-18T04:53:12.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.456+0000 7f8497400640 1 -- 172.21.15.120:0/3439841990 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8490072a70 con 0x7f84901fdfc0 2024-04-18T04:53:12.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.456+0000 7f848cc00640 1 -- 172.21.15.120:0/3439841990 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8488003d00 con 0x7f84901fdfc0 2024-04-18T04:53:12.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.456+0000 7f848cc00640 1 --2- 172.21.15.120:0/3439841990 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8470066790 0x7f8470068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:12.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.456+0000 7f848cc00640 1 -- 172.21.15.120:0/3439841990 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f8488084fe0 con 0x7f84901fdfc0 2024-04-18T04:53:12.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.456+0000 7f8494a00640 1 --2- 172.21.15.120:0/3439841990 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8470066790 0x7f8470068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:12.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.460+0000 7f8494a00640 1 --2- 172.21.15.120:0/3439841990 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8470066790 0x7f8470068c50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8484006cb0 tx=0x7f84840046d0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:12.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.464+0000 7f848cc00640 1 -- 172.21.15.120:0/3439841990 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f8488051d90 con 0x7f84901fdfc0 2024-04-18T04:53:12.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.772+0000 7f8497400640 1 -- 172.21.15.120:0/3439841990 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f849006fea0 con 0x7f84901fdfc0 2024-04-18T04:53:12.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.776+0000 7f848cc00640 1 -- 172.21.15.120:0/3439841990 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+6279 (secure 0 0 0) 0x7f84880553b0 con 0x7f84901fdfc0 2024-04-18T04:53:12.785 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:53:12.786 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":43,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5400,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/671327196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":671327196},{"type":"v1","addr":"172.21.15.120:6837","nonce":671327196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:52:34.088115+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5105,"mds_1":4967},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:active","state_seq":31,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5105":{"gid":5105,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":14,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:53:12.786 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 43 2024-04-18T04:53:12.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.784+0000 7f8497400640 1 -- 172.21.15.120:0/3439841990 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8470066790 msgr2=0x7f8470068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:12.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.784+0000 7f8497400640 1 --2- 172.21.15.120:0/3439841990 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8470066790 0x7f8470068c50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8484006cb0 tx=0x7f84840046d0 comp rx=0 tx=0).stop 2024-04-18T04:53:12.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.784+0000 7f8497400640 1 -- 172.21.15.120:0/3439841990 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84901fdfc0 msgr2=0x7f84901fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:12.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.784+0000 7f8497400640 1 --2- 172.21.15.120:0/3439841990 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84901fdfc0 0x7f84901fe440 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f84900cdf10 tx=0x7f8488010590 comp rx=0 tx=0).stop 2024-04-18T04:53:12.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.788+0000 7f8497400640 1 -- 172.21.15.120:0/3439841990 shutdown_connections 2024-04-18T04:53:12.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.788+0000 7f8497400640 1 --2- 172.21.15.120:0/3439841990 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8470066790 0x7f8470068c50 secure :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8484006cb0 tx=0x7f84840046d0 comp rx=0 tx=0).stop 2024-04-18T04:53:12.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.788+0000 7f8497400640 1 --2- 172.21.15.120:0/3439841990 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84901fdfc0 0x7f84901fe440 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:12.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.788+0000 7f8497400640 1 --2- 172.21.15.120:0/3439841990 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84901fc4e0 0x7f84901fc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:12.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.788+0000 7f8497400640 1 --2- 172.21.15.120:0/3439841990 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8478003980 0x7f849015eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:12.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.788+0000 7f8497400640 1 -- 172.21.15.120:0/3439841990 >> 172.21.15.120:0/3439841990 conn(0x7f8490069ec0 msgr2=0x7f8490150300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:53:12.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.788+0000 7f8497400640 1 -- 172.21.15.120:0/3439841990 shutdown_connections 2024-04-18T04:53:12.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:12.788+0000 7f8497400640 1 -- 172.21.15.120:0/3439841990 wait complete. 2024-04-18T04:53:12.872 INFO:tasks.mds_thrash.fs.[cephfs]:kill mds.b (rank=1) 2024-04-18T04:53:12.872 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-18T04:53:12.872 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T04:53:12.892 INFO:tasks.ceph.mds.b:Stopped 2024-04-18T04:53:12.893 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:53:13.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.160+0000 7f9964a00640 1 Processor -- start 2024-04-18T04:53:13.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.160+0000 7f9964a00640 1 -- start start 2024-04-18T04:53:13.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.160+0000 7f9964a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9960157dd0 0x7f99600ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:13.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.160+0000 7f9964a00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f99600c96d0 0x7f996015e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:13.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.160+0000 7f9964a00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f99600ccee0 0x7f99600cd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:13.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.164+0000 7f9964a00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99600c4200 con 0x7f99600ccee0 2024-04-18T04:53:13.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.164+0000 7f9964a00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f996015df10 con 0x7f99600c96d0 2024-04-18T04:53:13.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.164+0000 7f9964a00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99600c7c90 con 0x7f9960157dd0 2024-04-18T04:53:13.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.164+0000 7f995d400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f99600c96d0 0x7f996015e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:13.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.164+0000 7f995d400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f99600c96d0 0x7f996015e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:40406/0 (socket says 172.21.15.120:40406) 2024-04-18T04:53:13.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.164+0000 7f995d400640 1 -- 172.21.15.120:0/3318110155 learned_addr learned my addr 172.21.15.120:0/3318110155 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:53:13.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.164+0000 7f995e800640 1 --2- 172.21.15.120:0/3318110155 >> v2:172.21.15.120:3300/0 conn(0x7f99600ccee0 0x7f99600cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:13.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.164+0000 7f995de00640 1 --2- 172.21.15.120:0/3318110155 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9960157dd0 0x7f99600ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:13.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.164+0000 7f995d400640 1 -- 172.21.15.120:0/3318110155 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9960157dd0 msgr2=0x7f99600ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:53:13.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.164+0000 7f995d400640 1 --2- 172.21.15.120:0/3318110155 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9960157dd0 0x7f99600ca2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:13.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.164+0000 7f995d400640 1 -- 172.21.15.120:0/3318110155 >> v2:172.21.15.120:3300/0 conn(0x7f99600ccee0 msgr2=0x7f99600cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:53:13.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.164+0000 7f995d400640 1 --2- 172.21.15.120:0/3318110155 >> v2:172.21.15.120:3300/0 conn(0x7f99600ccee0 0x7f99600cd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:13.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.164+0000 7f995d400640 1 -- 172.21.15.120:0/3318110155 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99600c7f50 con 0x7f99600c96d0 2024-04-18T04:53:13.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.164+0000 7f995e800640 1 --2- 172.21.15.120:0/3318110155 >> v2:172.21.15.120:3300/0 conn(0x7f99600ccee0 0x7f99600cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:53:13.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.168+0000 7f995d400640 1 --2- 172.21.15.120:0/3318110155 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99600c96d0 0x7f996015e3a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9960072760 tx=0x7f994c01c4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6093c70389b7fe0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:13.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.168+0000 7f995ca00640 1 -- 172.21.15.120:0/3318110155 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c0ac410 con 0x7f99600c96d0 2024-04-18T04:53:13.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.168+0000 7f995ca00640 1 -- 172.21.15.120:0/3318110155 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994c0ac570 con 0x7f99600c96d0 2024-04-18T04:53:13.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.168+0000 7f995ca00640 1 -- 172.21.15.120:0/3318110155 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c0ac900 con 0x7f99600c96d0 2024-04-18T04:53:13.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.172+0000 7f9964a00640 1 -- 172.21.15.120:0/3318110155 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99600c96d0 msgr2=0x7f996015e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:13.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.172+0000 7f9964a00640 1 --2- 172.21.15.120:0/3318110155 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99600c96d0 0x7f996015e3a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9960072760 tx=0x7f994c01c4c0 comp rx=0 tx=0).stop 2024-04-18T04:53:13.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.176+0000 7f9964a00640 1 -- 172.21.15.120:0/3318110155 shutdown_connections 2024-04-18T04:53:13.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.176+0000 7f9964a00640 1 --2- 172.21.15.120:0/3318110155 >> v2:172.21.15.120:3300/0 conn(0x7f99600ccee0 0x7f99600cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:13.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.176+0000 7f9964a00640 1 --2- 172.21.15.120:0/3318110155 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99600c96d0 0x7f996015e3a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:13.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.176+0000 7f9964a00640 1 --2- 172.21.15.120:0/3318110155 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9960157dd0 0x7f99600ca2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:13.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.176+0000 7f9964a00640 1 -- 172.21.15.120:0/3318110155 >> 172.21.15.120:0/3318110155 conn(0x7f996006e0f0 msgr2=0x7f9960071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:53:13.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.176+0000 7f9964a00640 1 -- 172.21.15.120:0/3318110155 shutdown_connections 2024-04-18T04:53:13.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.180+0000 7f9964a00640 1 -- 172.21.15.120:0/3318110155 wait complete. 2024-04-18T04:53:13.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.184+0000 7f9964a00640 1 Processor -- start 2024-04-18T04:53:13.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.184+0000 7f9964a00640 1 -- start start 2024-04-18T04:53:13.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.184+0000 7f9964a00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99600c96d0 0x7f9960151a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:13.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.184+0000 7f9964a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f99600ccee0 0x7f9960160280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:13.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.184+0000 7f9964a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9960157dd0 0x7f996014e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:13.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.184+0000 7f9964a00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9960153170 con 0x7f99600ccee0 2024-04-18T04:53:13.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.184+0000 7f9964a00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9960152280 con 0x7f99600c96d0 2024-04-18T04:53:13.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.184+0000 7f9964a00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9960152560 con 0x7f9960157dd0 2024-04-18T04:53:13.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.188+0000 7f995e800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9960157dd0 0x7f996014e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:13.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.188+0000 7f995d400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f99600ccee0 0x7f9960160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:13.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.188+0000 7f995e800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9960157dd0 0x7f996014e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:50686/0 (socket says 172.21.15.120:50686) 2024-04-18T04:53:13.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.188+0000 7f995e800640 1 -- 172.21.15.120:0/3179501321 learned_addr learned my addr 172.21.15.120:0/3179501321 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:53:13.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.188+0000 7f995d400640 1 -- 172.21.15.120:0/3179501321 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9960157dd0 msgr2=0x7f996014e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:13.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.188+0000 7f995d400640 1 --2- 172.21.15.120:0/3179501321 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9960157dd0 0x7f996014e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:13.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.188+0000 7f995d400640 1 -- 172.21.15.120:0/3179501321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99600c96d0 msgr2=0x7f9960151a60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-18T04:53:13.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.188+0000 7f995d400640 1 --2- 172.21.15.120:0/3179501321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99600c96d0 0x7f9960151a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:13.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.188+0000 7f995d400640 1 -- 172.21.15.120:0/3179501321 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f994c0094d0 con 0x7f99600ccee0 2024-04-18T04:53:13.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.188+0000 7f995d400640 1 --2- 172.21.15.120:0/3179501321 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f99600ccee0 0x7f9960160280 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f994c0ac000 tx=0x7f994c019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:13.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.188+0000 7f9956000640 1 -- 172.21.15.120:0/3179501321 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c0b9070 con 0x7f99600ccee0 2024-04-18T04:53:13.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.188+0000 7f9956000640 1 -- 172.21.15.120:0/3179501321 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994c0ace80 con 0x7f99600ccee0 2024-04-18T04:53:13.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.188+0000 7f9956000640 1 -- 172.21.15.120:0/3179501321 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c0ac410 con 0x7f99600ccee0 2024-04-18T04:53:13.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.188+0000 7f9964a00640 1 -- 172.21.15.120:0/3179501321 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9960152840 con 0x7f99600ccee0 2024-04-18T04:53:13.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.188+0000 7f9964a00640 1 -- 172.21.15.120:0/3179501321 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9960152e00 con 0x7f99600ccee0 2024-04-18T04:53:13.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.192+0000 7f9964a00640 1 -- 172.21.15.120:0/3179501321 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9938005260 con 0x7f99600ccee0 2024-04-18T04:53:13.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.192+0000 7f9956000640 1 -- 172.21.15.120:0/3179501321 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f994c0b3070 con 0x7f99600ccee0 2024-04-18T04:53:13.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.192+0000 7f9956000640 1 --2- 172.21.15.120:0/3179501321 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f99400666e0 0x7f9940068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:13.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.196+0000 7f9956000640 1 -- 172.21.15.120:0/3179501321 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f994c11dc30 con 0x7f99600ccee0 2024-04-18T04:53:13.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.196+0000 7f995de00640 1 --2- 172.21.15.120:0/3179501321 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f99400666e0 0x7f9940068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:13.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.196+0000 7f995de00640 1 --2- 172.21.15.120:0/3179501321 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f99400666e0 0x7f9940068ba0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f995000b770 tx=0x7f9950008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:13.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.216+0000 7f9956000640 1 -- 172.21.15.120:0/3179501321 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f994c0eab70 con 0x7f99600ccee0 2024-04-18T04:53:13.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.628+0000 7f9964a00640 1 -- 172.21.15.120:0/3179501321 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99380050d0 con 0x7f99600ccee0 2024-04-18T04:53:13.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.640+0000 7f9956000640 1 -- 172.21.15.120:0/3179501321 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+6279 (secure 0 0 0) 0x7f994c0ee190 con 0x7f99600ccee0 2024-04-18T04:53:13.639 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:53:13.639 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":43,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5400,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/671327196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":671327196},{"type":"v1","addr":"172.21.15.120:6837","nonce":671327196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:52:34.088115+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5105,"mds_1":4967},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:active","state_seq":31,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5105":{"gid":5105,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":14,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:53:13.639 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 43 2024-04-18T04:53:13.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.644+0000 7f9964a00640 1 -- 172.21.15.120:0/3179501321 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f99400666e0 msgr2=0x7f9940068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:13.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.644+0000 7f9964a00640 1 --2- 172.21.15.120:0/3179501321 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f99400666e0 0x7f9940068ba0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f995000b770 tx=0x7f9950008040 comp rx=0 tx=0).stop 2024-04-18T04:53:13.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.644+0000 7f9964a00640 1 -- 172.21.15.120:0/3179501321 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f99600ccee0 msgr2=0x7f9960160280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:13.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.644+0000 7f9964a00640 1 --2- 172.21.15.120:0/3179501321 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f99600ccee0 0x7f9960160280 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f994c0ac000 tx=0x7f994c019260 comp rx=0 tx=0).stop 2024-04-18T04:53:13.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.644+0000 7f9964a00640 1 -- 172.21.15.120:0/3179501321 shutdown_connections 2024-04-18T04:53:13.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.644+0000 7f9964a00640 1 --2- 172.21.15.120:0/3179501321 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f99400666e0 0x7f9940068ba0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:13.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.644+0000 7f9964a00640 1 --2- 172.21.15.120:0/3179501321 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9960157dd0 0x7f996014e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:13.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.644+0000 7f9964a00640 1 --2- 172.21.15.120:0/3179501321 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f99600ccee0 0x7f9960160280 secure :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f994c0ac000 tx=0x7f994c019260 comp rx=0 tx=0).stop 2024-04-18T04:53:13.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.644+0000 7f9964a00640 1 --2- 172.21.15.120:0/3179501321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99600c96d0 0x7f9960151a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:13.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.644+0000 7f9964a00640 1 -- 172.21.15.120:0/3179501321 >> 172.21.15.120:0/3179501321 conn(0x7f996006e0f0 msgr2=0x7f996015d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:53:13.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.648+0000 7f9964a00640 1 -- 172.21.15.120:0/3179501321 shutdown_connections 2024-04-18T04:53:13.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:13.648+0000 7f9964a00640 1 -- 172.21.15.120:0/3179501321 wait complete. 2024-04-18T04:53:13.685 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-18T04:53:15.686 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:53:15.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.936+0000 7feaebc00640 1 Processor -- start 2024-04-18T04:53:15.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.936+0000 7feaebc00640 1 -- start start 2024-04-18T04:53:15.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.936+0000 7feaebc00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7feae41538a0 0x7feae406ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:15.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.936+0000 7feaebc00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7feae40c47d0 0x7feae40c4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:15.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.936+0000 7feaebc00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feae40c5120 con 0x7feae415cbb0 2024-04-18T04:53:15.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.936+0000 7feaebc00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feae40cb300 con 0x7feae40c47d0 2024-04-18T04:53:15.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.936+0000 7feaebc00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feae415d310 con 0x7feae41538a0 2024-04-18T04:53:15.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.936+0000 7feae3e00640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7feae415cbb0 0x7feae40cf400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:53280/0 (socket says 172.21.15.120:53280) 2024-04-18T04:53:15.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.936+0000 7feae3e00640 1 -- 172.21.15.120:0/1538475177 learned_addr learned my addr 172.21.15.120:0/1538475177 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:53:15.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.936+0000 7feae9200640 1 --2- 172.21.15.120:0/1538475177 >> v2:172.21.15.132:3300/0 conn(0x7feae41538a0 0x7feae406ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:15.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.940+0000 7feae9200640 1 -- 172.21.15.120:0/1538475177 >> v2:172.21.15.120:3300/0 conn(0x7feae40c47d0 msgr2=0x7feae40c4be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:53:15.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.940+0000 7feae9200640 1 --2- 172.21.15.120:0/1538475177 >> v2:172.21.15.120:3300/0 conn(0x7feae40c47d0 0x7feae40c4be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:15.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.940+0000 7feae9200640 1 -- 172.21.15.120:0/1538475177 >> v1:172.21.15.132:6789/0 conn(0x7feae415cbb0 legacy=0x7feae40cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:15.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.940+0000 7feae9200640 1 -- 172.21.15.120:0/1538475177 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae415d5f0 con 0x7feae41538a0 2024-04-18T04:53:15.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.952+0000 7feae9200640 1 --2- 172.21.15.120:0/1538475177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feae41538a0 0x7feae406ab90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7feae406a8b0 tx=0x7feadc01c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba0bd8dd5768d48e server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:15.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.952+0000 7feae3400640 1 -- 172.21.15.120:0/1538475177 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc0a59e0 con 0x7feae41538a0 2024-04-18T04:53:15.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.952+0000 7feae3400640 1 -- 172.21.15.120:0/1538475177 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feadc0a5b40 con 0x7feae41538a0 2024-04-18T04:53:15.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.952+0000 7feae3400640 1 -- 172.21.15.120:0/1538475177 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc0a59e0 con 0x7feae41538a0 2024-04-18T04:53:15.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.956+0000 7feaebc00640 1 -- 172.21.15.120:0/1538475177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feae41538a0 msgr2=0x7feae406ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:15.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.956+0000 7feaebc00640 1 --2- 172.21.15.120:0/1538475177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feae41538a0 0x7feae406ab90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7feae406a8b0 tx=0x7feadc01c940 comp rx=0 tx=0).stop 2024-04-18T04:53:15.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.956+0000 7feaebc00640 1 -- 172.21.15.120:0/1538475177 shutdown_connections 2024-04-18T04:53:15.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.956+0000 7feaebc00640 1 --2- 172.21.15.120:0/1538475177 >> v2:172.21.15.120:3300/0 conn(0x7feae40c47d0 0x7feae40c4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:15.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.956+0000 7feaebc00640 1 --2- 172.21.15.120:0/1538475177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feae41538a0 0x7feae406ab90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:15.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.956+0000 7feaebc00640 1 -- 172.21.15.120:0/1538475177 >> 172.21.15.120:0/1538475177 conn(0x7feae4065fc0 msgr2=0x7feae40663d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:53:15.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.956+0000 7feaebc00640 1 -- 172.21.15.120:0/1538475177 shutdown_connections 2024-04-18T04:53:15.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.956+0000 7feaebc00640 1 -- 172.21.15.120:0/1538475177 wait complete. 2024-04-18T04:53:15.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.960+0000 7feaebc00640 1 Processor -- start 2024-04-18T04:53:15.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.960+0000 7feaebc00640 1 -- start start 2024-04-18T04:53:15.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.964+0000 7feaebc00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feae40c47d0 0x7feae415bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:15.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.964+0000 7feaebc00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feae41538a0 0x7feae42013e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:15.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.964+0000 7feaebc00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feae415cbb0 0x7feae4201920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:15.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.964+0000 7feaebc00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae406ce30 con 0x7feae40c47d0 2024-04-18T04:53:15.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.964+0000 7feaebc00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae4157600 con 0x7feae415cbb0 2024-04-18T04:53:15.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.964+0000 7feaebc00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae4200f50 con 0x7feae41538a0 2024-04-18T04:53:15.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.964+0000 7feae3e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feae41538a0 0x7feae42013e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:15.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.964+0000 7feae3e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feae41538a0 0x7feae42013e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:50698/0 (socket says 172.21.15.120:50698) 2024-04-18T04:53:15.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.964+0000 7feae3e00640 1 -- 172.21.15.120:0/633368367 learned_addr learned my addr 172.21.15.120:0/633368367 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:53:15.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.964+0000 7feae9c00640 1 --2- 172.21.15.120:0/633368367 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feae415cbb0 0x7feae4201920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:15.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.964+0000 7feae3e00640 1 -- 172.21.15.120:0/633368367 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feae415cbb0 msgr2=0x7feae4201920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:15.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.964+0000 7feae3e00640 1 --2- 172.21.15.120:0/633368367 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feae415cbb0 0x7feae4201920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:15.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.964+0000 7feae3e00640 1 -- 172.21.15.120:0/633368367 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feae40c47d0 msgr2=0x7feae415bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:15.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.964+0000 7feae3e00640 1 --2- 172.21.15.120:0/633368367 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feae40c47d0 0x7feae415bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:15.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.964+0000 7feae3e00640 1 -- 172.21.15.120:0/633368367 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feadc009a70 con 0x7feae41538a0 2024-04-18T04:53:15.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.964+0000 7feae3e00640 1 --2- 172.21.15.120:0/633368367 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feae41538a0 0x7feae42013e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fead400c400 tx=0x7fead400c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:15.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.968+0000 7feae0c00640 1 -- 172.21.15.120:0/633368367 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead4005cf0 con 0x7feae41538a0 2024-04-18T04:53:15.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.968+0000 7feae0c00640 1 -- 172.21.15.120:0/633368367 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead4005e50 con 0x7feae41538a0 2024-04-18T04:53:15.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.968+0000 7feae0c00640 1 -- 172.21.15.120:0/633368367 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead40072d0 con 0x7feae41538a0 2024-04-18T04:53:15.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.968+0000 7feaebc00640 1 -- 172.21.15.120:0/633368367 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae406d060 con 0x7feae41538a0 2024-04-18T04:53:15.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.968+0000 7feaebc00640 1 -- 172.21.15.120:0/633368367 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae4200340 con 0x7feae41538a0 2024-04-18T04:53:15.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.972+0000 7feae0c00640 1 -- 172.21.15.120:0/633368367 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fead4007430 con 0x7feae41538a0 2024-04-18T04:53:15.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.972+0000 7feae0c00640 1 --2- 172.21.15.120:0/633368367 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7feac4066760 0x7feac4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:15.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.972+0000 7feae0c00640 1 -- 172.21.15.120:0/633368367 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7007+0+0 (secure 0 0 0) 0x7fead4083c50 con 0x7feae41538a0 2024-04-18T04:53:15.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.976+0000 7feae9200640 1 --2- 172.21.15.120:0/633368367 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7feac4066760 0x7feac4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:15.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.976+0000 7feaebc00640 1 -- 172.21.15.120:0/633368367 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feae4067590 con 0x7feae41538a0 2024-04-18T04:53:15.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.980+0000 7feae9200640 1 --2- 172.21.15.120:0/633368367 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7feac4066760 0x7feac4068c20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7feadc0af000 tx=0x7feadc004ac0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:15.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:15.992+0000 7feae0c00640 1 -- 172.21.15.120:0/633368367 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fead4083e60 con 0x7feae41538a0 2024-04-18T04:53:16.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:16.448+0000 7feaebc00640 1 -- 172.21.15.120:0/633368367 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feae4072a70 con 0x7feae41538a0 2024-04-18T04:53:16.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:16.448+0000 7feae0c00640 1 -- 172.21.15.120:0/633368367 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+6279 (secure 0 0 0) 0x7fead4017030 con 0x7feae41538a0 2024-04-18T04:53:16.447 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:53:16.447 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":43,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5400,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/671327196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":671327196},{"type":"v1","addr":"172.21.15.120:6837","nonce":671327196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:52:34.088115+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5105,"mds_1":4967},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:active","state_seq":31,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5105":{"gid":5105,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":14,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:53:16.447 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 43 2024-04-18T04:53:16.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:16.452+0000 7feaebc00640 1 -- 172.21.15.120:0/633368367 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7feac4066760 msgr2=0x7feac4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:16.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:16.452+0000 7feaebc00640 1 --2- 172.21.15.120:0/633368367 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7feac4066760 0x7feac4068c20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7feadc0af000 tx=0x7feadc004ac0 comp rx=0 tx=0).stop 2024-04-18T04:53:16.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:16.452+0000 7feaebc00640 1 -- 172.21.15.120:0/633368367 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feae41538a0 msgr2=0x7feae42013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:16.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:16.452+0000 7feaebc00640 1 --2- 172.21.15.120:0/633368367 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feae41538a0 0x7feae42013e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fead400c400 tx=0x7fead400c8c0 comp rx=0 tx=0).stop 2024-04-18T04:53:16.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:16.452+0000 7feaebc00640 1 -- 172.21.15.120:0/633368367 shutdown_connections 2024-04-18T04:53:16.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:16.452+0000 7feaebc00640 1 --2- 172.21.15.120:0/633368367 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7feac4066760 0x7feac4068c20 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:16.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:16.452+0000 7feaebc00640 1 --2- 172.21.15.120:0/633368367 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feae415cbb0 0x7feae4201920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:16.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:16.452+0000 7feaebc00640 1 --2- 172.21.15.120:0/633368367 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feae41538a0 0x7feae42013e0 secure :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fead400c400 tx=0x7fead400c8c0 comp rx=0 tx=0).stop 2024-04-18T04:53:16.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:16.452+0000 7feaebc00640 1 --2- 172.21.15.120:0/633368367 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feae40c47d0 0x7feae415bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:16.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:16.452+0000 7feaebc00640 1 -- 172.21.15.120:0/633368367 >> 172.21.15.120:0/633368367 conn(0x7feae4065fc0 msgr2=0x7feae40ccdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:53:16.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:16.452+0000 7feaebc00640 1 -- 172.21.15.120:0/633368367 shutdown_connections 2024-04-18T04:53:16.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:16.460+0000 7feaebc00640 1 -- 172.21.15.120:0/633368367 wait complete. 2024-04-18T04:53:16.512 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-18T04:53:17.606 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:53:17.611 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T04:53:18.016 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-04-18T04:53:18.016+0000 7f0857c00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 39789) UID: 0 2024-04-18T04:53:18.016 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-04-18T04:53:18.016+0000 7f4881000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 39789) UID: 0 2024-04-18T04:53:18.016 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-04-18T04:53:18.016+0000 7f0a8fe00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 39789) UID: 0 2024-04-18T04:53:18.019 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-18T04:53:18.016+0000 7f3186200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 39789) UID: 0 2024-04-18T04:53:18.513 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:53:18.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.827+0000 7f38d9e00640 1 Processor -- start 2024-04-18T04:53:18.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.827+0000 7f38d9e00640 1 -- start start 2024-04-18T04:53:18.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.827+0000 7f38d9e00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f38d40caac0 0x7f38d40b2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:18.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.827+0000 7f38d9e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f38d40caea0 0x7f38d40c6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:18.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.827+0000 7f38d9e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f38d40cbde0 0x7f38d40b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:18.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.831+0000 7f38d9e00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38d40c6400 con 0x7f38d40cbde0 2024-04-18T04:53:18.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.831+0000 7f38d9e00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38d40cb780 con 0x7f38d40caac0 2024-04-18T04:53:18.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.831+0000 7f38d9e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d40cc370 con 0x7f38d40caea0 2024-04-18T04:53:18.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.831+0000 7f38d9400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f38d40cbde0 0x7f38d40b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:18.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.831+0000 7f38d9400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f38d40cbde0 0x7f38d40b3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36244/0 (socket says 172.21.15.120:36244) 2024-04-18T04:53:18.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.831+0000 7f38d9400640 1 -- 172.21.15.120:0/240329073 learned_addr learned my addr 172.21.15.120:0/240329073 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:53:18.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.831+0000 7f38d9400640 1 -- 172.21.15.120:0/240329073 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f38d40caea0 msgr2=0x7f38d40c6fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-18T04:53:18.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.831+0000 7f38d9400640 1 --2- 172.21.15.120:0/240329073 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f38d40caea0 0x7f38d40c6fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:18.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.831+0000 7f38d9400640 1 -- 172.21.15.120:0/240329073 >> v2:172.21.15.132:3300/0 conn(0x7f38d40caac0 msgr2=0x7f38d40b2ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-18T04:53:18.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.831+0000 7f38d9400640 1 --2- 172.21.15.120:0/240329073 >> v2:172.21.15.132:3300/0 conn(0x7f38d40caac0 0x7f38d40b2ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:18.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.831+0000 7f38d9400640 1 -- 172.21.15.120:0/240329073 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d40cc650 con 0x7f38d40cbde0 2024-04-18T04:53:18.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.843+0000 7f38d9400640 1 --2- 172.21.15.120:0/240329073 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f38d40cbde0 0x7f38d40b3ff0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f38d40cff60 tx=0x7f38cc01f220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f643e2e1ecbd0a12 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:18.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.843+0000 7f38d3400640 1 -- 172.21.15.120:0/240329073 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc0af400 con 0x7f38d40cbde0 2024-04-18T04:53:18.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.843+0000 7f38d3400640 1 -- 172.21.15.120:0/240329073 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38cc0ab050 con 0x7f38d40cbde0 2024-04-18T04:53:18.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.843+0000 7f38d3400640 1 -- 172.21.15.120:0/240329073 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc0af780 con 0x7f38d40cbde0 2024-04-18T04:53:18.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.843+0000 7f38d9e00640 1 -- 172.21.15.120:0/240329073 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f38d40cbde0 msgr2=0x7f38d40b3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:18.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.843+0000 7f38d9e00640 1 --2- 172.21.15.120:0/240329073 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f38d40cbde0 0x7f38d40b3ff0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f38d40cff60 tx=0x7f38cc01f220 comp rx=0 tx=0).stop 2024-04-18T04:53:18.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.843+0000 7f38d9e00640 1 -- 172.21.15.120:0/240329073 shutdown_connections 2024-04-18T04:53:18.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.843+0000 7f38d9e00640 1 --2- 172.21.15.120:0/240329073 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f38d40cbde0 0x7f38d40b3ff0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:18.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.843+0000 7f38d9e00640 1 --2- 172.21.15.120:0/240329073 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f38d40caea0 0x7f38d40c6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:18.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.843+0000 7f38d9e00640 1 --2- 172.21.15.120:0/240329073 >> v2:172.21.15.132:3300/0 conn(0x7f38d40caac0 0x7f38d40b2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:18.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.843+0000 7f38d9e00640 1 -- 172.21.15.120:0/240329073 >> 172.21.15.120:0/240329073 conn(0x7f38d4065fc0 msgr2=0x7f38d40663d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:53:18.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.847+0000 7f38d9e00640 1 -- 172.21.15.120:0/240329073 shutdown_connections 2024-04-18T04:53:18.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.847+0000 7f38d9e00640 1 -- 172.21.15.120:0/240329073 wait complete. 2024-04-18T04:53:18.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.851+0000 7f38d9e00640 1 Processor -- start 2024-04-18T04:53:18.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.855+0000 7f38d9e00640 1 -- start start 2024-04-18T04:53:18.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.855+0000 7f38d9e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38d40caac0 0x7f38d40c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:18.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.859+0000 7f38d8a00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38d40caac0 0x7f38d40c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:18.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.859+0000 7f38d8a00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38d40caac0 0x7f38d40c3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:40444/0 (socket says 172.21.15.120:40444) 2024-04-18T04:53:18.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.859+0000 7f38d9e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f38d40caea0 0x7f38d4157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:18.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.859+0000 7f38d9e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f38d40cbde0 0x7f38d4158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:18.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.859+0000 7f38d9e00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d4156370 con 0x7f38d40cbde0 2024-04-18T04:53:18.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.859+0000 7f38d9e00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d40c5360 con 0x7f38d40caac0 2024-04-18T04:53:18.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.859+0000 7f38d9e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d4155e10 con 0x7f38d40caea0 2024-04-18T04:53:18.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.859+0000 7f38d8a00640 1 -- 172.21.15.120:0/2633895307 learned_addr learned my addr 172.21.15.120:0/2633895307 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:53:18.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.859+0000 7f38d9400640 1 --2- 172.21.15.120:0/2633895307 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f38d40cbde0 0x7f38d4158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:18.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.859+0000 7f38d8a00640 1 -- 172.21.15.120:0/2633895307 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f38d40caea0 msgr2=0x7f38d4157be0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-18T04:53:18.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.859+0000 7f38d8a00640 1 --2- 172.21.15.120:0/2633895307 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f38d40caea0 0x7f38d4157be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:18.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.859+0000 7f38d8a00640 1 -- 172.21.15.120:0/2633895307 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f38d40cbde0 msgr2=0x7f38d4158120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:18.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.859+0000 7f38d8a00640 1 --2- 172.21.15.120:0/2633895307 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f38d40cbde0 0x7f38d4158120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:18.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.859+0000 7f38d8a00640 1 -- 172.21.15.120:0/2633895307 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38cc009b30 con 0x7f38d40caac0 2024-04-18T04:53:18.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.863+0000 7f38d8a00640 1 --2- 172.21.15.120:0/2633895307 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38d40caac0 0x7f38d40c3e70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f38c400b4d0 tx=0x7f38c400b990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:18.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.863+0000 7f38d0c00640 1 -- 172.21.15.120:0/2633895307 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c4010870 con 0x7f38d40caac0 2024-04-18T04:53:18.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.863+0000 7f38d0c00640 1 -- 172.21.15.120:0/2633895307 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c40109f0 con 0x7f38d40caac0 2024-04-18T04:53:18.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.863+0000 7f38d0c00640 1 -- 172.21.15.120:0/2633895307 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c4010da0 con 0x7f38d40caac0 2024-04-18T04:53:18.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.863+0000 7f38d9e00640 1 -- 172.21.15.120:0/2633895307 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d41560b0 con 0x7f38d40caac0 2024-04-18T04:53:18.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.863+0000 7f38d9e00640 1 -- 172.21.15.120:0/2633895307 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38d40c5890 con 0x7f38d40caac0 2024-04-18T04:53:18.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.867+0000 7f38d0c00640 1 -- 172.21.15.120:0/2633895307 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f38c400f3c0 con 0x7f38d40caac0 2024-04-18T04:53:18.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.867+0000 7f38d0c00640 1 --2- 172.21.15.120:0/2633895307 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f38b4066760 0x7f38b4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:18.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.867+0000 7f38d3e00640 1 --2- 172.21.15.120:0/2633895307 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f38b4066760 0x7f38b4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:18.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.871+0000 7f38d0c00640 1 -- 172.21.15.120:0/2633895307 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f38c40846d0 con 0x7f38d40caac0 2024-04-18T04:53:18.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.871+0000 7f38d3e00640 1 --2- 172.21.15.120:0/2633895307 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f38b4066760 0x7f38b4068c20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f38d40b3d50 tx=0x7f38c0006be0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:18.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.871+0000 7f38d9e00640 1 -- 172.21.15.120:0/2633895307 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38d4067070 con 0x7f38d40caac0 2024-04-18T04:53:18.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:18.879+0000 7f38d0c00640 1 -- 172.21.15.120:0/2633895307 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f38c4051510 con 0x7f38d40caac0 2024-04-18T04:53:19.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:19.443+0000 7f38d9e00640 1 -- 172.21.15.120:0/2633895307 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f38d40b1a40 con 0x7f38d40caac0 2024-04-18T04:53:19.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:19.447+0000 7f38d0c00640 1 -- 172.21.15.120:0/2633895307 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+6279 (secure 0 0 0) 0x7f38c401e020 con 0x7f38d40caac0 2024-04-18T04:53:19.446 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:53:19.447 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":43,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5400,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/671327196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":671327196},{"type":"v1","addr":"172.21.15.120:6837","nonce":671327196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:52:34.088115+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5105,"mds_1":4967},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:active","state_seq":31,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5105":{"gid":5105,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":14,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:53:19.447 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 43 2024-04-18T04:53:19.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:19.451+0000 7f38d9e00640 1 -- 172.21.15.120:0/2633895307 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f38b4066760 msgr2=0x7f38b4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:19.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:19.451+0000 7f38d9e00640 1 --2- 172.21.15.120:0/2633895307 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f38b4066760 0x7f38b4068c20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f38d40b3d50 tx=0x7f38c0006be0 comp rx=0 tx=0).stop 2024-04-18T04:53:19.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:19.451+0000 7f38d9e00640 1 -- 172.21.15.120:0/2633895307 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38d40caac0 msgr2=0x7f38d40c3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:19.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:19.451+0000 7f38d9e00640 1 --2- 172.21.15.120:0/2633895307 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38d40caac0 0x7f38d40c3e70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f38c400b4d0 tx=0x7f38c400b990 comp rx=0 tx=0).stop 2024-04-18T04:53:19.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:19.451+0000 7f38d9e00640 1 -- 172.21.15.120:0/2633895307 shutdown_connections 2024-04-18T04:53:19.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:19.451+0000 7f38d9e00640 1 --2- 172.21.15.120:0/2633895307 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f38b4066760 0x7f38b4068c20 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:19.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:19.451+0000 7f38d9e00640 1 --2- 172.21.15.120:0/2633895307 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f38d40cbde0 0x7f38d4158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:19.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:19.451+0000 7f38d9e00640 1 --2- 172.21.15.120:0/2633895307 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f38d40caea0 0x7f38d4157be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:19.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:19.451+0000 7f38d9e00640 1 --2- 172.21.15.120:0/2633895307 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38d40caac0 0x7f38d40c3e70 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:19.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:19.451+0000 7f38d9e00640 1 -- 172.21.15.120:0/2633895307 >> 172.21.15.120:0/2633895307 conn(0x7f38d4065fc0 msgr2=0x7f38d40cd680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:53:19.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:19.455+0000 7f38d9e00640 1 -- 172.21.15.120:0/2633895307 shutdown_connections 2024-04-18T04:53:19.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:19.455+0000 7f38d9e00640 1 -- 172.21.15.120:0/2633895307 wait complete. 2024-04-18T04:53:19.519 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-18T04:53:21.519 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:53:21.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.751+0000 7f4a39600640 1 Processor -- start 2024-04-18T04:53:21.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.751+0000 7f4a39600640 1 -- start start 2024-04-18T04:53:21.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.751+0000 7f4a39600640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4a340c69e0 0x7f4a340c0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:21.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.751+0000 7f4a39600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a34157de0 0x7f4a3406bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:21.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.751+0000 7f4a39600640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a3415e970 con 0x7f4a34157a00 2024-04-18T04:53:21.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.751+0000 7f4a39600640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a34162170 con 0x7f4a340c69e0 2024-04-18T04:53:21.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.751+0000 7f4a39600640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a340c5940 con 0x7f4a34157de0 2024-04-18T04:53:21.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.751+0000 7f4a32a00640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f4a34157a00 0x7f4a3406b660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:33020/0 (socket says 172.21.15.120:33020) 2024-04-18T04:53:21.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.751+0000 7f4a32a00640 1 -- 172.21.15.120:0/2501360068 learned_addr learned my addr 172.21.15.120:0/2501360068 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:53:21.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.751+0000 7f4a32000640 1 --2- 172.21.15.120:0/2501360068 >> v2:172.21.15.120:3300/0 conn(0x7f4a340c69e0 0x7f4a340c0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:21.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.751+0000 7f4a33400640 1 --2- 172.21.15.120:0/2501360068 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a34157de0 0x7f4a3406bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:21.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.751+0000 7f4a31600640 1 -- 172.21.15.120:0/2501360068 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1322574414 0 0) 0x7f4a3415e970 con 0x7f4a34157a00 2024-04-18T04:53:21.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.751+0000 7f4a31600640 1 -- 172.21.15.120:0/2501360068 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a18003530 con 0x7f4a34157a00 2024-04-18T04:53:21.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.751+0000 7f4a31600640 1 -- 172.21.15.120:0/2501360068 <== mon.1 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3458483220 0 0) 0x7f4a18003530 con 0x7f4a34157a00 2024-04-18T04:53:21.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.751+0000 7f4a31600640 1 -- 172.21.15.120:0/2501360068 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a34157de0 msgr2=0x7f4a3406bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:53:21.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.751+0000 7f4a31600640 1 --2- 172.21.15.120:0/2501360068 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a34157de0 0x7f4a3406bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:21.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.751+0000 7f4a31600640 1 -- 172.21.15.120:0/2501360068 >> v2:172.21.15.120:3300/0 conn(0x7f4a340c69e0 msgr2=0x7f4a340c0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:53:21.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.755+0000 7f4a31600640 1 --2- 172.21.15.120:0/2501360068 >> v2:172.21.15.120:3300/0 conn(0x7f4a340c69e0 0x7f4a340c0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:21.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.755+0000 7f4a31600640 1 -- 172.21.15.120:0/2501360068 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a340c5c20 con 0x7f4a34157a00 2024-04-18T04:53:21.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.755+0000 7f4a31600640 1 -- 172.21.15.120:0/2501360068 <== mon.1 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7f4a20001680 con 0x7f4a34157a00 2024-04-18T04:53:21.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.755+0000 7f4a31600640 1 -- 172.21.15.120:0/2501360068 >> v1:172.21.15.132:6789/0 conn(0x7f4a34157a00 legacy=0x7f4a3406b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:21.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.755+0000 7f4a31600640 1 --2- 172.21.15.120:0/2501360068 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a18003980 0x7f4a18003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:21.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.755+0000 7f4a31600640 1 --2- 172.21.15.120:0/2501360068 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a180047d0 0x7f4a18004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:21.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.755+0000 7f4a31600640 1 --2- 172.21.15.120:0/2501360068 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a18005190 0x7f4a1800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:21.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.755+0000 7f4a31600640 1 -- 172.21.15.120:0/2501360068 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a34162170 con 0x7f4a18003980 2024-04-18T04:53:21.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.755+0000 7f4a31600640 1 -- 172.21.15.120:0/2501360068 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a340c5940 con 0x7f4a180047d0 2024-04-18T04:53:21.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.755+0000 7f4a31600640 1 -- 172.21.15.120:0/2501360068 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1800bed0 con 0x7f4a18005190 2024-04-18T04:53:21.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.755+0000 7f4a32a00640 1 --2- 172.21.15.120:0/2501360068 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a18003980 0x7f4a18003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:21.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.755+0000 7f4a33400640 1 --2- 172.21.15.120:0/2501360068 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a18005190 0x7f4a1800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:21.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.755+0000 7f4a32a00640 1 -- 172.21.15.120:0/2501360068 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a18005190 msgr2=0x7f4a1800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:53:21.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.755+0000 7f4a32a00640 1 --2- 172.21.15.120:0/2501360068 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a18005190 0x7f4a1800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:21.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.755+0000 7f4a32a00640 1 -- 172.21.15.120:0/2501360068 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a180047d0 msgr2=0x7f4a18004c50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-18T04:53:21.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.755+0000 7f4a32a00640 1 --2- 172.21.15.120:0/2501360068 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a180047d0 0x7f4a18004c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:21.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.755+0000 7f4a32a00640 1 -- 172.21.15.120:0/2501360068 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a18003530 con 0x7f4a18003980 2024-04-18T04:53:21.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.759+0000 7f4a32a00640 1 --2- 172.21.15.120:0/2501360068 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a18003980 0x7f4a18003da0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4a2000c190 tx=0x7f4a2001f310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a875a9d8e7efddb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:21.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.759+0000 7f4a31600640 1 -- 172.21.15.120:0/2501360068 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a20005ae0 con 0x7f4a18003980 2024-04-18T04:53:21.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.759+0000 7f4a31600640 1 -- 172.21.15.120:0/2501360068 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a200ab070 con 0x7f4a18003980 2024-04-18T04:53:21.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.759+0000 7f4a39600640 1 -- 172.21.15.120:0/2501360068 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a18003980 msgr2=0x7f4a18003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:21.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.759+0000 7f4a39600640 1 --2- 172.21.15.120:0/2501360068 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a18003980 0x7f4a18003da0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4a2000c190 tx=0x7f4a2001f310 comp rx=0 tx=0).stop 2024-04-18T04:53:21.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.759+0000 7f4a33400640 1 -- 172.21.15.120:0/2501360068 reap_dead start 2024-04-18T04:53:21.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.759+0000 7f4a39600640 1 -- 172.21.15.120:0/2501360068 shutdown_connections 2024-04-18T04:53:21.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.759+0000 7f4a39600640 1 -- 172.21.15.120:0/2501360068 >> 172.21.15.120:0/2501360068 conn(0x7f4a340c78c0 msgr2=0x7f4a340c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:53:21.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.759+0000 7f4a39600640 1 -- 172.21.15.120:0/2501360068 shutdown_connections 2024-04-18T04:53:21.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.759+0000 7f4a39600640 1 -- 172.21.15.120:0/2501360068 wait complete. 2024-04-18T04:53:21.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.763+0000 7f4a39600640 1 Processor -- start 2024-04-18T04:53:21.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.763+0000 7f4a39600640 1 -- start start 2024-04-18T04:53:21.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.763+0000 7f4a39600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a34161360 0x7f4a341460e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:21.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.763+0000 7f4a39600640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a34146620 0x7f4a34147a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:21.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.763+0000 7f4a39600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a34161740 0x7f4a34147f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:21.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.763+0000 7f4a39600640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a34134fa0 con 0x7f4a34161740 2024-04-18T04:53:21.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.763+0000 7f4a39600640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a34160ba0 con 0x7f4a34146620 2024-04-18T04:53:21.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.763+0000 7f4a39600640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a34146f50 con 0x7f4a34161360 2024-04-18T04:53:21.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.763+0000 7f4a32a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a34161360 0x7f4a341460e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:21.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.763+0000 7f4a32a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a34161360 0x7f4a341460e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:38356/0 (socket says 172.21.15.120:38356) 2024-04-18T04:53:21.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.763+0000 7f4a32a00640 1 -- 172.21.15.120:0/1659683576 learned_addr learned my addr 172.21.15.120:0/1659683576 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:53:21.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.767+0000 7f4a32000640 1 --2- 172.21.15.120:0/1659683576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a34146620 0x7f4a34147a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:21.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.767+0000 7f4a32a00640 1 -- 172.21.15.120:0/1659683576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a34146620 msgr2=0x7f4a34147a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:21.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.767+0000 7f4a32a00640 1 --2- 172.21.15.120:0/1659683576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a34146620 0x7f4a34147a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:21.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.767+0000 7f4a32a00640 1 -- 172.21.15.120:0/1659683576 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a34161740 msgr2=0x7f4a34147f50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:53:21.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.767+0000 7f4a32a00640 1 --2- 172.21.15.120:0/1659683576 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a34161740 0x7f4a34147f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:21.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.767+0000 7f4a32a00640 1 -- 172.21.15.120:0/1659683576 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a34147210 con 0x7f4a34161360 2024-04-18T04:53:21.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.767+0000 7f4a32a00640 1 --2- 172.21.15.120:0/1659683576 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a34161360 0x7f4a341460e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4a20025f80 tx=0x7f4a18005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:21.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.775+0000 7f4a2aa00640 1 -- 172.21.15.120:0/1659683576 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a200b6070 con 0x7f4a34161360 2024-04-18T04:53:21.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.775+0000 7f4a2aa00640 1 -- 172.21.15.120:0/1659683576 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a200ab070 con 0x7f4a34161360 2024-04-18T04:53:21.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.775+0000 7f4a2aa00640 1 -- 172.21.15.120:0/1659683576 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a20007450 con 0x7f4a34161360 2024-04-18T04:53:21.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.779+0000 7f4a39600640 1 -- 172.21.15.120:0/1659683576 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a34143910 con 0x7f4a34161360 2024-04-18T04:53:21.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.779+0000 7f4a39600640 1 -- 172.21.15.120:0/1659683576 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a34160830 con 0x7f4a34161360 2024-04-18T04:53:21.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.779+0000 7f4a39600640 1 -- 172.21.15.120:0/1659683576 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a34072a70 con 0x7f4a34161360 2024-04-18T04:53:21.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.787+0000 7f4a2aa00640 1 -- 172.21.15.120:0/1659683576 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4a200ad020 con 0x7f4a34161360 2024-04-18T04:53:21.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.787+0000 7f4a2aa00640 1 --2- 172.21.15.120:0/1659683576 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4a14066760 0x7f4a14068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:21.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.791+0000 7f4a2aa00640 1 -- 172.21.15.120:0/1659683576 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f4a20121810 con 0x7f4a34161360 2024-04-18T04:53:21.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.791+0000 7f4a32000640 1 --2- 172.21.15.120:0/1659683576 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4a14066760 0x7f4a14068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:21.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.795+0000 7f4a32000640 1 --2- 172.21.15.120:0/1659683576 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4a14066760 0x7f4a14068c20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4a340c4e20 tx=0x7f4a24009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:21.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:21.799+0000 7f4a2aa00640 1 -- 172.21.15.120:0/1659683576 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f4a200ee6e0 con 0x7f4a34161360 2024-04-18T04:53:22.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:22.219+0000 7f4a39600640 1 -- 172.21.15.120:0/1659683576 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a34146f50 con 0x7f4a34161360 2024-04-18T04:53:22.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:22.223+0000 7f4a2aa00640 1 -- 172.21.15.120:0/1659683576 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+6279 (secure 0 0 0) 0x7f4a200f1d00 con 0x7f4a34161360 2024-04-18T04:53:22.223 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:53:22.225 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":43,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5400,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/671327196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":671327196},{"type":"v1","addr":"172.21.15.120:6837","nonce":671327196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:52:34.088115+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5105,"mds_1":4967},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:active","state_seq":31,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5105":{"gid":5105,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":14,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:53:22.225 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 43 2024-04-18T04:53:22.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:22.227+0000 7f4a39600640 1 -- 172.21.15.120:0/1659683576 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4a14066760 msgr2=0x7f4a14068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:22.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:22.227+0000 7f4a39600640 1 --2- 172.21.15.120:0/1659683576 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4a14066760 0x7f4a14068c20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4a340c4e20 tx=0x7f4a24009190 comp rx=0 tx=0).stop 2024-04-18T04:53:22.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:22.227+0000 7f4a39600640 1 -- 172.21.15.120:0/1659683576 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a34161360 msgr2=0x7f4a341460e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:22.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:22.227+0000 7f4a39600640 1 --2- 172.21.15.120:0/1659683576 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a34161360 0x7f4a341460e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4a20025f80 tx=0x7f4a18005800 comp rx=0 tx=0).stop 2024-04-18T04:53:22.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:22.227+0000 7f4a39600640 1 -- 172.21.15.120:0/1659683576 shutdown_connections 2024-04-18T04:53:22.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:22.227+0000 7f4a39600640 1 --2- 172.21.15.120:0/1659683576 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4a14066760 0x7f4a14068c20 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:22.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:22.227+0000 7f4a39600640 1 --2- 172.21.15.120:0/1659683576 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a34161740 0x7f4a34147f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:22.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:22.227+0000 7f4a39600640 1 --2- 172.21.15.120:0/1659683576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a34146620 0x7f4a34147a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:22.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:22.227+0000 7f4a39600640 1 --2- 172.21.15.120:0/1659683576 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a34161360 0x7f4a341460e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:22.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:22.227+0000 7f4a39600640 1 -- 172.21.15.120:0/1659683576 >> 172.21.15.120:0/1659683576 conn(0x7f4a340c78c0 msgr2=0x7f4a340c6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:53:22.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:22.231+0000 7f4a39600640 1 -- 172.21.15.120:0/1659683576 shutdown_connections 2024-04-18T04:53:22.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:22.235+0000 7f4a39600640 1 -- 172.21.15.120:0/1659683576 wait complete. 2024-04-18T04:53:22.300 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-18T04:53:24.301 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:53:24.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.547+0000 7f1402c00640 1 Processor -- start 2024-04-18T04:53:24.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.547+0000 7f1402c00640 1 -- start start 2024-04-18T04:53:24.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.551+0000 7f1402c00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f13fc06dab0 0x7f13fc070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:24.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.551+0000 7f1402c00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13fc0c6190 con 0x7f13fc0c6620 2024-04-18T04:53:24.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.551+0000 7f1402c00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13fc0c5860 con 0x7f13fc06c270 2024-04-18T04:53:24.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.551+0000 7f1402c00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13fc070ff0 con 0x7f13fc06dab0 2024-04-18T04:53:24.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.555+0000 7f1401800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f13fc06dab0 0x7f13fc070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:24.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.555+0000 7f1401800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f13fc06dab0 0x7f13fc070ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:38366/0 (socket says 172.21.15.120:38366) 2024-04-18T04:53:24.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.555+0000 7f1402200640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f13fc06c270 0x7f13fc155570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:33034/0 (socket says 172.21.15.120:33034) 2024-04-18T04:53:24.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.555+0000 7f1402200640 1 -- 172.21.15.120:0/2647256956 learned_addr learned my addr 172.21.15.120:0/2647256956 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:53:24.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.555+0000 7f13fbe00640 1 -- 172.21.15.120:0/2647256956 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4133014354 0 0) 0x7f13fc0c5860 con 0x7f13fc06c270 2024-04-18T04:53:24.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.555+0000 7f13fbe00640 1 -- 172.21.15.120:0/2647256956 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13e4003530 con 0x7f13fc06c270 2024-04-18T04:53:24.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.555+0000 7f1401800640 1 -- 172.21.15.120:0/2647256956 >> v1:172.21.15.132:6789/0 conn(0x7f13fc06c270 legacy=0x7f13fc155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:24.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.555+0000 7f1401800640 1 -- 172.21.15.120:0/2647256956 >> v1:172.21.15.120:6789/0 conn(0x7f13fc0c6620 legacy=0x7f13fc0c6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:53:24.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.555+0000 7f1401800640 1 -- 172.21.15.120:0/2647256956 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13fc0c5b40 con 0x7f13fc06dab0 2024-04-18T04:53:24.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.563+0000 7f1401800640 1 --2- 172.21.15.120:0/2647256956 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f13fc06dab0 0x7f13fc070ab0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f13f00097f0 tx=0x7f13f001ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa3681a5181ba47b server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:24.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.563+0000 7f13fbe00640 1 -- 172.21.15.120:0/2647256956 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f00a8990 con 0x7f13fc06dab0 2024-04-18T04:53:24.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.563+0000 7f13fbe00640 1 -- 172.21.15.120:0/2647256956 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f00a8af0 con 0x7f13fc06dab0 2024-04-18T04:53:24.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.563+0000 7f13fbe00640 1 -- 172.21.15.120:0/2647256956 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f00a8e80 con 0x7f13fc06dab0 2024-04-18T04:53:24.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.567+0000 7f1402c00640 1 -- 172.21.15.120:0/2647256956 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f13fc06dab0 msgr2=0x7f13fc070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:24.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.567+0000 7f1402c00640 1 --2- 172.21.15.120:0/2647256956 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f13fc06dab0 0x7f13fc070ab0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f13f00097f0 tx=0x7f13f001ec90 comp rx=0 tx=0).stop 2024-04-18T04:53:24.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.567+0000 7f1402c00640 1 -- 172.21.15.120:0/2647256956 shutdown_connections 2024-04-18T04:53:24.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.567+0000 7f1402c00640 1 --2- 172.21.15.120:0/2647256956 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f13fc06dab0 0x7f13fc070ab0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:24.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.567+0000 7f1402c00640 1 -- 172.21.15.120:0/2647256956 >> 172.21.15.120:0/2647256956 conn(0x7f13fc06cf90 msgr2=0x7f13fc06d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:53:24.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.567+0000 7f1402c00640 1 -- 172.21.15.120:0/2647256956 shutdown_connections 2024-04-18T04:53:24.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.567+0000 7f1402c00640 1 -- 172.21.15.120:0/2647256956 wait complete. 2024-04-18T04:53:24.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.571+0000 7f1402c00640 1 Processor -- start 2024-04-18T04:53:24.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.571+0000 7f1402c00640 1 -- start start 2024-04-18T04:53:24.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.575+0000 7f1402c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13fc06c270 0x7f13fc13f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:24.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.575+0000 7f1402c00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f13fc06dab0 0x7f13fc157240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:24.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.575+0000 7f1402c00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13fc0c6620 0x7f13fc157780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:24.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.575+0000 7f1402c00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13fc13a7f0 con 0x7f13fc06c270 2024-04-18T04:53:24.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.575+0000 7f1402c00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13fc0c51f0 con 0x7f13fc0c6620 2024-04-18T04:53:24.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.575+0000 7f1402c00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13fc13c090 con 0x7f13fc06dab0 2024-04-18T04:53:24.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.575+0000 7f1400e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f13fc06dab0 0x7f13fc157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:24.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.575+0000 7f1402200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13fc0c6620 0x7f13fc157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:24.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.575+0000 7f1402200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13fc0c6620 0x7f13fc157780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:33454/0 (socket says 172.21.15.120:33454) 2024-04-18T04:53:24.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.575+0000 7f1402200640 1 -- 172.21.15.120:0/661057321 learned_addr learned my addr 172.21.15.120:0/661057321 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:53:24.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.575+0000 7f1402200640 1 -- 172.21.15.120:0/661057321 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f13fc06dab0 msgr2=0x7f13fc157240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:24.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.575+0000 7f1402200640 1 --2- 172.21.15.120:0/661057321 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f13fc06dab0 0x7f13fc157240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:24.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.575+0000 7f1402200640 1 -- 172.21.15.120:0/661057321 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13fc06c270 msgr2=0x7f13fc13f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:24.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.575+0000 7f1402200640 1 --2- 172.21.15.120:0/661057321 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13fc06c270 0x7f13fc13f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:24.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.575+0000 7f1402200640 1 -- 172.21.15.120:0/661057321 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f0009420 con 0x7f13fc0c6620 2024-04-18T04:53:24.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.575+0000 7f1402200640 1 --2- 172.21.15.120:0/661057321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13fc0c6620 0x7f13fc157780 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f13e800c390 tx=0x7f13e800c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:24.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.579+0000 7f13f9600640 1 -- 172.21.15.120:0/661057321 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e8005cf0 con 0x7f13fc0c6620 2024-04-18T04:53:24.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.579+0000 7f13f9600640 1 -- 172.21.15.120:0/661057321 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e8005e70 con 0x7f13fc0c6620 2024-04-18T04:53:24.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.579+0000 7f13f9600640 1 -- 172.21.15.120:0/661057321 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e80072f0 con 0x7f13fc0c6620 2024-04-18T04:53:24.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.583+0000 7f1402c00640 1 -- 172.21.15.120:0/661057321 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13fc13c370 con 0x7f13fc0c6620 2024-04-18T04:53:24.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.583+0000 7f1402c00640 1 -- 172.21.15.120:0/661057321 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13fc13a1a0 con 0x7f13fc0c6620 2024-04-18T04:53:24.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.587+0000 7f13f9600640 1 -- 172.21.15.120:0/661057321 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f13e8007450 con 0x7f13fc0c6620 2024-04-18T04:53:24.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.587+0000 7f13f9600640 1 --2- 172.21.15.120:0/661057321 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f13dc066760 0x7f13dc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:24.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.587+0000 7f13f9600640 1 -- 172.21.15.120:0/661057321 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f13e8083c00 con 0x7f13fc0c6620 2024-04-18T04:53:24.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.591+0000 7f1402c00640 1 -- 172.21.15.120:0/661057321 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13fc06af90 con 0x7f13fc0c6620 2024-04-18T04:53:24.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.591+0000 7f1401800640 1 --2- 172.21.15.120:0/661057321 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f13dc066760 0x7f13dc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:24.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.595+0000 7f1401800640 1 --2- 172.21.15.120:0/661057321 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f13dc066760 0x7f13dc068c20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f13f00b2000 tx=0x7f13f0004740 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:24.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:24.599+0000 7f13f9600640 1 -- 172.21.15.120:0/661057321 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f13e8017070 con 0x7f13fc0c6620 2024-04-18T04:53:25.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:25.051+0000 7f1402c00640 1 -- 172.21.15.120:0/661057321 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f13fc0728f0 con 0x7f13fc0c6620 2024-04-18T04:53:25.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:25.063+0000 7f13f9600640 1 -- 172.21.15.120:0/661057321 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+6279 (secure 0 0 0) 0x7f13e80544f0 con 0x7f13fc0c6620 2024-04-18T04:53:25.072 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:53:25.072 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":43,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5400,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/671327196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":671327196},{"type":"v1","addr":"172.21.15.120:6837","nonce":671327196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:52:34.088115+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5105,"mds_1":4967},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_4967":{"gid":4967,"name":"b","rank":1,"incarnation":28,"state":"up:active","state_seq":31,"addr":"172.21.15.132:6835/396956733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":396956733},{"type":"v1","addr":"172.21.15.132:6835","nonce":396956733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5105":{"gid":5105,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":14,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:53:25.075 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 43 2024-04-18T04:53:25.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:25.083+0000 7f1402c00640 1 -- 172.21.15.120:0/661057321 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f13dc066760 msgr2=0x7f13dc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:25.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:25.083+0000 7f1402c00640 1 --2- 172.21.15.120:0/661057321 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f13dc066760 0x7f13dc068c20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f13f00b2000 tx=0x7f13f0004740 comp rx=0 tx=0).stop 2024-04-18T04:53:25.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:25.083+0000 7f1402c00640 1 -- 172.21.15.120:0/661057321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13fc0c6620 msgr2=0x7f13fc157780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:25.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:25.083+0000 7f1402c00640 1 --2- 172.21.15.120:0/661057321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13fc0c6620 0x7f13fc157780 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f13e800c390 tx=0x7f13e800c850 comp rx=0 tx=0).stop 2024-04-18T04:53:25.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:25.083+0000 7f1402c00640 1 -- 172.21.15.120:0/661057321 shutdown_connections 2024-04-18T04:53:25.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:25.083+0000 7f1402c00640 1 --2- 172.21.15.120:0/661057321 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f13dc066760 0x7f13dc068c20 secure :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f13f00b2000 tx=0x7f13f0004740 comp rx=0 tx=0).stop 2024-04-18T04:53:25.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:25.083+0000 7f1402c00640 1 --2- 172.21.15.120:0/661057321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13fc0c6620 0x7f13fc157780 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:25.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:25.083+0000 7f1402c00640 1 --2- 172.21.15.120:0/661057321 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f13fc06dab0 0x7f13fc157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:25.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:25.083+0000 7f1402c00640 1 --2- 172.21.15.120:0/661057321 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13fc06c270 0x7f13fc13f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:25.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:25.083+0000 7f1402c00640 1 -- 172.21.15.120:0/661057321 >> 172.21.15.120:0/661057321 conn(0x7f13fc06cf90 msgr2=0x7f13fc0c6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:53:25.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:25.087+0000 7f1402c00640 1 -- 172.21.15.120:0/661057321 shutdown_connections 2024-04-18T04:53:25.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:25.087+0000 7f1402c00640 1 -- 172.21.15.120:0/661057321 wait complete. 2024-04-18T04:53:25.155 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-18T04:53:27.156 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:53:27.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.395+0000 7f4472e00640 1 Processor -- start 2024-04-18T04:53:27.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.395+0000 7f4472e00640 1 -- start start 2024-04-18T04:53:27.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.399+0000 7f4472e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f446c06f910 0x7f446c14fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:27.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.399+0000 7f4472e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f446c158d90 0x7f446c159200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:27.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.399+0000 7f4472e00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f446c06bfc0 con 0x7f446c0c61d0 2024-04-18T04:53:27.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.399+0000 7f4472e00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f446c06b700 con 0x7f446c158d90 2024-04-18T04:53:27.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.399+0000 7f4472e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f446c14fff0 con 0x7f446c06f910 2024-04-18T04:53:27.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.399+0000 7f4470e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f446c158d90 0x7f446c159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:27.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.399+0000 7f4470e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f446c158d90 0x7f446c159200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38024/0 (socket says 172.21.15.120:38024) 2024-04-18T04:53:27.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.399+0000 7f4470e00640 1 -- 172.21.15.120:0/214905481 learned_addr learned my addr 172.21.15.120:0/214905481 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:53:27.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.399+0000 7f446aa00640 1 -- 172.21.15.120:0/214905481 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1507620419 0 0) 0x7f446c06bfc0 con 0x7f446c0c61d0 2024-04-18T04:53:27.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.399+0000 7f446aa00640 1 -- 172.21.15.120:0/214905481 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4450003530 con 0x7f446c0c61d0 2024-04-18T04:53:27.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.399+0000 7f446be00640 1 --2- 172.21.15.120:0/214905481 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f446c06f910 0x7f446c14fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:27.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.399+0000 7f4470e00640 1 -- 172.21.15.120:0/214905481 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f446c06f910 msgr2=0x7f446c14fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:53:27.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.399+0000 7f4470e00640 1 --2- 172.21.15.120:0/214905481 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f446c06f910 0x7f446c14fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:27.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.399+0000 7f4470e00640 1 -- 172.21.15.120:0/214905481 >> v1:172.21.15.120:6789/0 conn(0x7f446c0c61d0 legacy=0x7f446c06c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:27.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.399+0000 7f4470e00640 1 -- 172.21.15.120:0/214905481 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446c0c6f50 con 0x7f446c158d90 2024-04-18T04:53:27.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.411+0000 7f4470e00640 1 --2- 172.21.15.120:0/214905481 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f446c158d90 0x7f446c159200 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4464009e50 tx=0x7f446401c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d11326613c51fba server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:27.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.415+0000 7f446aa00640 1 -- 172.21.15.120:0/214905481 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c001680 con 0x7f446c158d90 2024-04-18T04:53:27.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.415+0000 7f446aa00640 1 -- 172.21.15.120:0/214905481 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44640090d0 con 0x7f446c158d90 2024-04-18T04:53:27.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.415+0000 7f446aa00640 1 -- 172.21.15.120:0/214905481 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44640a9650 con 0x7f446c158d90 2024-04-18T04:53:27.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.415+0000 7f4472e00640 1 -- 172.21.15.120:0/214905481 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f446c158d90 msgr2=0x7f446c159200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:27.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.415+0000 7f4472e00640 1 --2- 172.21.15.120:0/214905481 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f446c158d90 0x7f446c159200 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4464009e50 tx=0x7f446401c800 comp rx=0 tx=0).stop 2024-04-18T04:53:27.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.415+0000 7f4472e00640 1 -- 172.21.15.120:0/214905481 shutdown_connections 2024-04-18T04:53:27.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.415+0000 7f4472e00640 1 --2- 172.21.15.120:0/214905481 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f446c158d90 0x7f446c159200 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:27.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.415+0000 7f4472e00640 1 --2- 172.21.15.120:0/214905481 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f446c06f910 0x7f446c14fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:27.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.415+0000 7f4472e00640 1 -- 172.21.15.120:0/214905481 >> 172.21.15.120:0/214905481 conn(0x7f446c0c78c0 msgr2=0x7f446c0c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:53:27.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.415+0000 7f4472e00640 1 -- 172.21.15.120:0/214905481 shutdown_connections 2024-04-18T04:53:27.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.419+0000 7f4472e00640 1 -- 172.21.15.120:0/214905481 wait complete. 2024-04-18T04:53:27.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.423+0000 7f4472e00640 1 Processor -- start 2024-04-18T04:53:27.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.423+0000 7f4472e00640 1 -- start start 2024-04-18T04:53:27.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.427+0000 7f4472e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f446c06f910 0x7f446c145610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:27.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.427+0000 7f4472e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f446c0c61d0 0x7f446c158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:27.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.427+0000 7f4472e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f446c158d90 0x7f446c13f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:27.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.427+0000 7f4472e00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446c140bc0 con 0x7f446c0c61d0 2024-04-18T04:53:27.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.427+0000 7f4472e00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446c145c70 con 0x7f446c06f910 2024-04-18T04:53:27.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.427+0000 7f4472e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f446c0c1090 con 0x7f446c158d90 2024-04-18T04:53:27.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.427+0000 7f446be00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f446c06f910 0x7f446c145610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:27.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.427+0000 7f446b400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f446c0c61d0 0x7f446c158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:27.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.427+0000 7f446b400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f446c0c61d0 0x7f446c158390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38030/0 (socket says 172.21.15.120:38030) 2024-04-18T04:53:27.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.427+0000 7f446b400640 1 -- 172.21.15.120:0/947912859 learned_addr learned my addr 172.21.15.120:0/947912859 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:53:27.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.427+0000 7f4470e00640 1 --2- 172.21.15.120:0/947912859 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f446c158d90 0x7f446c13f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:27.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.427+0000 7f446b400640 1 -- 172.21.15.120:0/947912859 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f446c158d90 msgr2=0x7f446c13f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:27.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.427+0000 7f446b400640 1 --2- 172.21.15.120:0/947912859 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f446c158d90 0x7f446c13f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:27.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.427+0000 7f446b400640 1 -- 172.21.15.120:0/947912859 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f446c06f910 msgr2=0x7f446c145610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:27.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.427+0000 7f446b400640 1 --2- 172.21.15.120:0/947912859 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f446c06f910 0x7f446c145610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:27.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.427+0000 7f446b400640 1 -- 172.21.15.120:0/947912859 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4464009b30 con 0x7f446c0c61d0 2024-04-18T04:53:27.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.427+0000 7f446b400640 1 --2- 172.21.15.120:0/947912859 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f446c0c61d0 0x7f446c158390 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f445c00c7f0 tx=0x7f445c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:27.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.427+0000 7f4463e00640 1 -- 172.21.15.120:0/947912859 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c005480 con 0x7f446c0c61d0 2024-04-18T04:53:27.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.427+0000 7f4463e00640 1 -- 172.21.15.120:0/947912859 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445c003600 con 0x7f446c0c61d0 2024-04-18T04:53:27.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.427+0000 7f4463e00640 1 -- 172.21.15.120:0/947912859 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c003990 con 0x7f446c0c61d0 2024-04-18T04:53:27.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.431+0000 7f4472e00640 1 -- 172.21.15.120:0/947912859 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f446c0c1370 con 0x7f446c0c61d0 2024-04-18T04:53:27.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.431+0000 7f4472e00640 1 -- 172.21.15.120:0/947912859 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f446c0c1930 con 0x7f446c0c61d0 2024-04-18T04:53:27.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.431+0000 7f4472e00640 1 -- 172.21.15.120:0/947912859 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f446c073e10 con 0x7f446c0c61d0 2024-04-18T04:53:27.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.435+0000 7f4463e00640 1 -- 172.21.15.120:0/947912859 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f445c003af0 con 0x7f446c0c61d0 2024-04-18T04:53:27.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.435+0000 7f4463e00640 1 --2- 172.21.15.120:0/947912859 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f444c0666e0 0x7f444c068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:27.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.435+0000 7f4463e00640 1 -- 172.21.15.120:0/947912859 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f445c085060 con 0x7f446c0c61d0 2024-04-18T04:53:27.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.439+0000 7f446be00640 1 --2- 172.21.15.120:0/947912859 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f444c0666e0 0x7f444c068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:27.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.439+0000 7f446be00640 1 --2- 172.21.15.120:0/947912859 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f444c0666e0 0x7f444c068ba0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f44580079c0 tx=0x7f4458008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:27.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.443+0000 7f4463e00640 1 -- 172.21.15.120:0/947912859 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f445c051e40 con 0x7f446c0c61d0 2024-04-18T04:53:27.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.715+0000 7f4472e00640 1 -- 172.21.15.120:0/947912859 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f446c072a70 con 0x7f446c0c61d0 2024-04-18T04:53:27.717 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:53:27.718 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":44,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:53:26.033305+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5105,"mds_1":5400},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_5105":{"gid":5105,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":14,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5400":{"gid":5400,"name":"e","rank":1,"incarnation":44,"state":"up:replay","state_seq":1,"addr":"172.21.15.120:6837/671327196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":671327196},{"type":"v1","addr":"172.21.15.120:6837","nonce":671327196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:53:27.718 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 44 2024-04-18T04:53:27.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.719+0000 7f4463e00640 1 -- 172.21.15.120:0/947912859 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+5521 (secure 0 0 0) 0x7f445c055460 con 0x7f446c0c61d0 2024-04-18T04:53:27.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.719+0000 7f4472e00640 1 -- 172.21.15.120:0/947912859 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f444c0666e0 msgr2=0x7f444c068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:27.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.719+0000 7f4472e00640 1 --2- 172.21.15.120:0/947912859 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f444c0666e0 0x7f444c068ba0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f44580079c0 tx=0x7f4458008040 comp rx=0 tx=0).stop 2024-04-18T04:53:27.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.719+0000 7f4472e00640 1 -- 172.21.15.120:0/947912859 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f446c0c61d0 msgr2=0x7f446c158390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:27.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.719+0000 7f4472e00640 1 --2- 172.21.15.120:0/947912859 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f446c0c61d0 0x7f446c158390 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f445c00c7f0 tx=0x7f445c00ccb0 comp rx=0 tx=0).stop 2024-04-18T04:53:27.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.719+0000 7f4472e00640 1 -- 172.21.15.120:0/947912859 shutdown_connections 2024-04-18T04:53:27.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.719+0000 7f4472e00640 1 --2- 172.21.15.120:0/947912859 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f444c0666e0 0x7f444c068ba0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:27.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.719+0000 7f4472e00640 1 --2- 172.21.15.120:0/947912859 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f446c158d90 0x7f446c13f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:27.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.719+0000 7f4472e00640 1 --2- 172.21.15.120:0/947912859 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f446c0c61d0 0x7f446c158390 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:27.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.719+0000 7f4472e00640 1 --2- 172.21.15.120:0/947912859 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f446c06f910 0x7f446c145610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:27.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.719+0000 7f4472e00640 1 -- 172.21.15.120:0/947912859 >> 172.21.15.120:0/947912859 conn(0x7f446c0c78c0 msgr2=0x7f446c15c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:53:27.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.719+0000 7f4472e00640 1 -- 172.21.15.120:0/947912859 shutdown_connections 2024-04-18T04:53:27.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:27.719+0000 7f4472e00640 1 -- 172.21.15.120:0/947912859 wait complete. 2024-04-18T04:53:27.785 INFO:tasks.mds_thrash.fs.[cephfs]:mds.b down, removed from mdsmap 2024-04-18T04:53:27.785 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for mds cluster to stabilize... 2024-04-18T04:53:27.785 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:53:28.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.187+0000 7fcb0da00640 1 Processor -- start 2024-04-18T04:53:28.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.211+0000 7fcb0da00640 1 -- start start 2024-04-18T04:53:28.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.215+0000 7fcb0da00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcb081573c0 0x7fcb0806fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:28.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.215+0000 7fcb0da00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb080ccee0 0x7fcb080cd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:28.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.215+0000 7fcb0da00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb081577d0 con 0x7fcb081515e0 2024-04-18T04:53:28.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.215+0000 7fcb0da00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb080c3120 con 0x7fcb081573c0 2024-04-18T04:53:28.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.215+0000 7fcb0da00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb080ca990 con 0x7fcb080ccee0 2024-04-18T04:53:28.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.215+0000 7fcb06a00640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fcb081515e0 0x7fcb080ca280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:33038/0 (socket says 172.21.15.120:33038) 2024-04-18T04:53:28.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.215+0000 7fcb06a00640 1 -- 172.21.15.120:0/3387200607 learned_addr learned my addr 172.21.15.120:0/3387200607 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:53:28.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.215+0000 7fcb06000640 1 --2- 172.21.15.120:0/3387200607 >> v2:172.21.15.132:3300/0 conn(0x7fcb081573c0 0x7fcb0806fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:28.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.219+0000 7fcb07400640 1 --2- 172.21.15.120:0/3387200607 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb080ccee0 0x7fcb080cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:28.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.219+0000 7fcb06000640 1 -- 172.21.15.120:0/3387200607 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb080ccee0 msgr2=0x7fcb080cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:53:28.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.219+0000 7fcb06000640 1 --2- 172.21.15.120:0/3387200607 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb080ccee0 0x7fcb080cd330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:28.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.219+0000 7fcb06000640 1 -- 172.21.15.120:0/3387200607 >> v1:172.21.15.132:6789/0 conn(0x7fcb081515e0 legacy=0x7fcb080ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:28.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.219+0000 7fcb06000640 1 -- 172.21.15.120:0/3387200607 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb08157a50 con 0x7fcb081573c0 2024-04-18T04:53:28.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.231+0000 7fcb06000640 1 --2- 172.21.15.120:0/3387200607 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb081573c0 0x7fcb0806fd00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fcaf40097c0 tx=0x7fcaf401ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5acc2eb83aef4e91 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:28.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.231+0000 7fcb05600640 1 -- 172.21.15.120:0/3387200607 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf40a8990 con 0x7fcb081573c0 2024-04-18T04:53:28.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.231+0000 7fcb05600640 1 -- 172.21.15.120:0/3387200607 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf40a8af0 con 0x7fcb081573c0 2024-04-18T04:53:28.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.231+0000 7fcb05600640 1 -- 172.21.15.120:0/3387200607 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf40a8e80 con 0x7fcb081573c0 2024-04-18T04:53:28.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.243+0000 7fcb0da00640 1 -- 172.21.15.120:0/3387200607 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb081573c0 msgr2=0x7fcb0806fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:28.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.243+0000 7fcb0da00640 1 --2- 172.21.15.120:0/3387200607 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb081573c0 0x7fcb0806fd00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fcaf40097c0 tx=0x7fcaf401ecd0 comp rx=0 tx=0).stop 2024-04-18T04:53:28.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.247+0000 7fcb0da00640 1 -- 172.21.15.120:0/3387200607 shutdown_connections 2024-04-18T04:53:28.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.247+0000 7fcb0da00640 1 --2- 172.21.15.120:0/3387200607 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb080ccee0 0x7fcb080cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:28.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.247+0000 7fcb0da00640 1 --2- 172.21.15.120:0/3387200607 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb081573c0 0x7fcb0806fd00 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:28.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.247+0000 7fcb0da00640 1 -- 172.21.15.120:0/3387200607 >> 172.21.15.120:0/3387200607 conn(0x7fcb0806e0f0 msgr2=0x7fcb08071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:53:28.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.247+0000 7fcb0da00640 1 -- 172.21.15.120:0/3387200607 shutdown_connections 2024-04-18T04:53:28.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.251+0000 7fcb0da00640 1 -- 172.21.15.120:0/3387200607 wait complete. 2024-04-18T04:53:28.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.263+0000 7fcb0da00640 1 Processor -- start 2024-04-18T04:53:28.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.267+0000 7fcb0da00640 1 -- start start 2024-04-18T04:53:28.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.275+0000 7fcb0da00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb080ccee0 0x7fcb080c6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:28.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.275+0000 7fcb0da00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb081515e0 0x7fcb080c5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:28.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.275+0000 7fcb0da00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb081573c0 0x7fcb0815aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:28.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.275+0000 7fcb0da00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0814ec00 con 0x7fcb080ccee0 2024-04-18T04:53:28.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.275+0000 7fcb0da00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0814fd50 con 0x7fcb081515e0 2024-04-18T04:53:28.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.275+0000 7fcb0da00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb081ed750 con 0x7fcb081573c0 2024-04-18T04:53:28.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.275+0000 7fcb07400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb081573c0 0x7fcb0815aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:28.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.275+0000 7fcb07400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb081573c0 0x7fcb0815aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:38424/0 (socket says 172.21.15.120:38424) 2024-04-18T04:53:28.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.275+0000 7fcb07400640 1 -- 172.21.15.120:0/4180301436 learned_addr learned my addr 172.21.15.120:0/4180301436 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:53:28.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.279+0000 7fcb07400640 1 -- 172.21.15.120:0/4180301436 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb081515e0 msgr2=0x7fcb080c5910 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-18T04:53:28.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.279+0000 7fcb07400640 1 --2- 172.21.15.120:0/4180301436 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb081515e0 0x7fcb080c5910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:28.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.279+0000 7fcb07400640 1 -- 172.21.15.120:0/4180301436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb080ccee0 msgr2=0x7fcb080c6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:28.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.279+0000 7fcb07400640 1 --2- 172.21.15.120:0/4180301436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb080ccee0 0x7fcb080c6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:28.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.279+0000 7fcb07400640 1 -- 172.21.15.120:0/4180301436 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf4009420 con 0x7fcb081573c0 2024-04-18T04:53:28.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.283+0000 7fcb07400640 1 --2- 172.21.15.120:0/4180301436 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb081573c0 0x7fcb0815aa90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcb0000cda0 tx=0x7fcb0000a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:28.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.287+0000 7fcafea00640 1 -- 172.21.15.120:0/4180301436 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb00003ba0 con 0x7fcb081573c0 2024-04-18T04:53:28.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.287+0000 7fcafea00640 1 -- 172.21.15.120:0/4180301436 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb00003d00 con 0x7fcb081573c0 2024-04-18T04:53:28.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.287+0000 7fcafea00640 1 -- 172.21.15.120:0/4180301436 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb00004240 con 0x7fcb081573c0 2024-04-18T04:53:28.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.295+0000 7fcb0da00640 1 -- 172.21.15.120:0/4180301436 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb081eda30 con 0x7fcb081573c0 2024-04-18T04:53:28.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.299+0000 7fcb0da00640 1 -- 172.21.15.120:0/4180301436 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb08150280 con 0x7fcb081573c0 2024-04-18T04:53:28.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.311+0000 7fcafea00640 1 -- 172.21.15.120:0/4180301436 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcb000043a0 con 0x7fcb081573c0 2024-04-18T04:53:28.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.315+0000 7fcb0da00640 1 -- 172.21.15.120:0/4180301436 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb080c1f70 con 0x7fcb081573c0 2024-04-18T04:53:28.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.319+0000 7fcafea00640 1 --2- 172.21.15.120:0/4180301436 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fcae8066760 0x7fcae8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:28.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.319+0000 7fcafea00640 1 -- 172.21.15.120:0/4180301436 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7fcb00012070 con 0x7fcb081573c0 2024-04-18T04:53:28.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.331+0000 7fcb06a00640 1 --2- 172.21.15.120:0/4180301436 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fcae8066760 0x7fcae8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:28.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.339+0000 7fcb06a00640 1 --2- 172.21.15.120:0/4180301436 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fcae8066760 0x7fcae8068c20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8001600 tx=0x7fcaf8007a50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:28.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.343+0000 7fcafea00640 1 -- 172.21.15.120:0/4180301436 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fcb00051ec0 con 0x7fcb081573c0 2024-04-18T04:53:28.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.811+0000 7fcb0da00640 1 -- 172.21.15.120:0/4180301436 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcb08072a70 con 0x7fcb081573c0 2024-04-18T04:53:28.823 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:53:28.823 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":44,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:53:26.033305+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5105,"mds_1":5400},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_5105":{"gid":5105,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":14,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5400":{"gid":5400,"name":"e","rank":1,"incarnation":44,"state":"up:replay","state_seq":1,"addr":"172.21.15.120:6837/671327196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":671327196},{"type":"v1","addr":"172.21.15.120:6837","nonce":671327196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:53:28.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.819+0000 7fcafea00640 1 -- 172.21.15.120:0/4180301436 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+5521 (secure 0 0 0) 0x7fcb000554e0 con 0x7fcb081573c0 2024-04-18T04:53:28.824 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 44 2024-04-18T04:53:28.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.823+0000 7fcb0da00640 1 -- 172.21.15.120:0/4180301436 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fcae8066760 msgr2=0x7fcae8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:28.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.823+0000 7fcb0da00640 1 --2- 172.21.15.120:0/4180301436 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fcae8066760 0x7fcae8068c20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8001600 tx=0x7fcaf8007a50 comp rx=0 tx=0).stop 2024-04-18T04:53:28.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.823+0000 7fcb0da00640 1 -- 172.21.15.120:0/4180301436 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb081573c0 msgr2=0x7fcb0815aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:28.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.823+0000 7fcb0da00640 1 --2- 172.21.15.120:0/4180301436 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb081573c0 0x7fcb0815aa90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcb0000cda0 tx=0x7fcb0000a660 comp rx=0 tx=0).stop 2024-04-18T04:53:28.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.823+0000 7fcb0da00640 1 -- 172.21.15.120:0/4180301436 shutdown_connections 2024-04-18T04:53:28.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.823+0000 7fcb0da00640 1 --2- 172.21.15.120:0/4180301436 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fcae8066760 0x7fcae8068c20 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:28.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.823+0000 7fcb0da00640 1 --2- 172.21.15.120:0/4180301436 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb081573c0 0x7fcb0815aa90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:28.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.823+0000 7fcb0da00640 1 --2- 172.21.15.120:0/4180301436 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb081515e0 0x7fcb080c5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:28.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.823+0000 7fcb0da00640 1 --2- 172.21.15.120:0/4180301436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb080ccee0 0x7fcb080c6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:28.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.823+0000 7fcb0da00640 1 -- 172.21.15.120:0/4180301436 >> 172.21.15.120:0/4180301436 conn(0x7fcb0806e0f0 msgr2=0x7fcb08156270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:53:28.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.831+0000 7fcb0da00640 1 -- 172.21.15.120:0/4180301436 shutdown_connections 2024-04-18T04:53:28.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:28.831+0000 7fcb0da00640 1 -- 172.21.15.120:0/4180301436 wait complete. 2024-04-18T04:53:28.875 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 44, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-18T04:44:30.251235+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 44, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1 ], "info": { "gid_5105": { "addr": "172.21.15.120:6833/3842815393", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6832", "nonce": 3842815393, "type": "v2" }, { "addr": "172.21.15.120:6833", "nonce": 3842815393, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5105, "incarnation": 38, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 14 }, "gid_5400": { "addr": "172.21.15.120:6837/671327196", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6835", "nonce": 671327196, "type": "v2" }, { "addr": "172.21.15.120:6837", "nonce": 671327196, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5400, "incarnation": 44, "join_fscid": -1, "name": "e", "rank": 1, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 32, "max_file_size": 1099511627776, "max_mds": 2, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-18T04:53:26.033305+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [ 2 ], "tableserver": 0, "up": { "mds_0": 5105, "mds_1": 5400 } } } ], "standbys": [ { "addr": "172.21.15.132:6839/4292136288", "addrs": { "addrvec": [ { "addr": "172.21.15.132:6836", "nonce": 4292136288, "type": "v2" }, { "addr": "172.21.15.132:6839", "nonce": 4292136288, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4241, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.132:6838/1712856922", "addrs": { "addrvec": [ { "addr": "172.21.15.132:6837", "nonce": 1712856922, "type": "v2" }, { "addr": "172.21.15.132:6838", "nonce": 1712856922, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 2, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4244, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.120:6836/2384594941", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6834", "nonce": 2384594941, "type": "v2" }, { "addr": "172.21.15.120:6836", "nonce": 2384594941, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 33, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5051, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-18T04:53:30.876 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:53:31.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.103+0000 7f7d51600640 1 Processor -- start 2024-04-18T04:53:31.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.103+0000 7f7d51600640 1 -- start start 2024-04-18T04:53:31.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.103+0000 7f7d51600640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7d44050c80 0x7f7d4404c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:31.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.103+0000 7f7d51600640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7d440dad00 0x7f7d440db110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:31.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.103+0000 7f7d51600640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d4404c7f0 con 0x7f7d44034770 2024-04-18T04:53:31.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.103+0000 7f7d51600640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d4404bf20 con 0x7f7d44050c80 2024-04-18T04:53:31.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.103+0000 7f7d51600640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d440d5480 con 0x7f7d440dad00 2024-04-18T04:53:31.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.103+0000 7f7d4be00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7d44050c80 0x7f7d4404c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:31.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.103+0000 7f7d4b400640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f7d44034770 0x7f7d440d4d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:49276/0 (socket says 172.21.15.120:49276) 2024-04-18T04:53:31.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.103+0000 7f7d50c00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7d440dad00 0x7f7d440db110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:31.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.103+0000 7f7d4b400640 1 -- 172.21.15.120:0/4241559922 learned_addr learned my addr 172.21.15.120:0/4241559922 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:53:31.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.103+0000 7f7d50c00640 1 -- 172.21.15.120:0/4241559922 >> v2:172.21.15.120:3300/0 conn(0x7f7d44050c80 msgr2=0x7f7d4404c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:53:31.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.103+0000 7f7d50c00640 1 --2- 172.21.15.120:0/4241559922 >> v2:172.21.15.120:3300/0 conn(0x7f7d44050c80 0x7f7d4404c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:31.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.103+0000 7f7d50c00640 1 -- 172.21.15.120:0/4241559922 >> v1:172.21.15.132:6789/0 conn(0x7f7d44034770 legacy=0x7f7d440d4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:31.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.103+0000 7f7d50c00640 1 -- 172.21.15.120:0/4241559922 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4404bc40 con 0x7f7d440dad00 2024-04-18T04:53:31.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.111+0000 7f7d50c00640 1 --2- 172.21.15.120:0/4241559922 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7d440dad00 0x7f7d440db110 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c02c920 tx=0x7f7d4c0970a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f7d606d6297a2c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:31.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.111+0000 7f7d4aa00640 1 -- 172.21.15.120:0/4241559922 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c127440 con 0x7f7d440dad00 2024-04-18T04:53:31.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.111+0000 7f7d4aa00640 1 -- 172.21.15.120:0/4241559922 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4c1275a0 con 0x7f7d440dad00 2024-04-18T04:53:31.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.111+0000 7f7d4aa00640 1 -- 172.21.15.120:0/4241559922 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c127a10 con 0x7f7d440dad00 2024-04-18T04:53:31.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.111+0000 7f7d51600640 1 -- 172.21.15.120:0/4241559922 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7d440dad00 msgr2=0x7f7d440db110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:31.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.111+0000 7f7d51600640 1 --2- 172.21.15.120:0/4241559922 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7d440dad00 0x7f7d440db110 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c02c920 tx=0x7f7d4c0970a0 comp rx=0 tx=0).stop 2024-04-18T04:53:31.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.115+0000 7f7d51600640 1 -- 172.21.15.120:0/4241559922 shutdown_connections 2024-04-18T04:53:31.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.115+0000 7f7d51600640 1 --2- 172.21.15.120:0/4241559922 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7d440dad00 0x7f7d440db110 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:31.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.115+0000 7f7d51600640 1 --2- 172.21.15.120:0/4241559922 >> v2:172.21.15.120:3300/0 conn(0x7f7d44050c80 0x7f7d4404c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:31.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.115+0000 7f7d51600640 1 -- 172.21.15.120:0/4241559922 >> 172.21.15.120:0/4241559922 conn(0x7f7d44050160 msgr2=0x7f7d44050570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:53:31.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.115+0000 7f7d51600640 1 -- 172.21.15.120:0/4241559922 shutdown_connections 2024-04-18T04:53:31.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.115+0000 7f7d51600640 1 -- 172.21.15.120:0/4241559922 wait complete. 2024-04-18T04:53:31.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.119+0000 7f7d51600640 1 Processor -- start 2024-04-18T04:53:31.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.119+0000 7f7d51600640 1 -- start start 2024-04-18T04:53:31.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.123+0000 7f7d51600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d44034770 0x7f7d441847d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:31.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.123+0000 7f7d51600640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7d44050c80 0x7f7d44048c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:31.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.123+0000 7f7d51600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7d440dad00 0x7f7d44049150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:31.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.123+0000 7f7d51600640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d440f53e0 con 0x7f7d44034770 2024-04-18T04:53:31.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.123+0000 7f7d51600640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d44049960 con 0x7f7d44050c80 2024-04-18T04:53:31.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.123+0000 7f7d51600640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d440f5140 con 0x7f7d440dad00 2024-04-18T04:53:31.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.123+0000 7f7d50c00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7d440dad00 0x7f7d44049150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:31.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.123+0000 7f7d50c00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7d440dad00 0x7f7d44049150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:37064/0 (socket says 172.21.15.120:37064) 2024-04-18T04:53:31.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.123+0000 7f7d50c00640 1 -- 172.21.15.120:0/393231642 learned_addr learned my addr 172.21.15.120:0/393231642 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:53:31.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.123+0000 7f7d4be00640 1 --2- 172.21.15.120:0/393231642 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d44034770 0x7f7d441847d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:31.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.123+0000 7f7d50c00640 1 -- 172.21.15.120:0/393231642 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7d44050c80 msgr2=0x7f7d44048c10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:53:31.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.123+0000 7f7d50c00640 1 --2- 172.21.15.120:0/393231642 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7d44050c80 0x7f7d44048c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:31.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.123+0000 7f7d50c00640 1 -- 172.21.15.120:0/393231642 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d44034770 msgr2=0x7f7d441847d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:31.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.123+0000 7f7d50c00640 1 --2- 172.21.15.120:0/393231642 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d44034770 0x7f7d441847d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:31.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.123+0000 7f7d50c00640 1 -- 172.21.15.120:0/393231642 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4c072040 con 0x7f7d440dad00 2024-04-18T04:53:31.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.123+0000 7f7d50c00640 1 --2- 172.21.15.120:0/393231642 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7d440dad00 0x7f7d44049150 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c072f40 tx=0x7f7d4c093ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:31.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.123+0000 7f7d3fe00640 1 -- 172.21.15.120:0/393231642 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c138070 con 0x7f7d440dad00 2024-04-18T04:53:31.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.123+0000 7f7d3fe00640 1 -- 172.21.15.120:0/393231642 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4c126860 con 0x7f7d440dad00 2024-04-18T04:53:31.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.123+0000 7f7d3fe00640 1 -- 172.21.15.120:0/393231642 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c127440 con 0x7f7d440dad00 2024-04-18T04:53:31.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.123+0000 7f7d51600640 1 -- 172.21.15.120:0/393231642 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d440d9290 con 0x7f7d440dad00 2024-04-18T04:53:31.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.127+0000 7f7d51600640 1 -- 172.21.15.120:0/393231642 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d4404b2e0 con 0x7f7d440dad00 2024-04-18T04:53:31.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.127+0000 7f7d3fe00640 1 -- 172.21.15.120:0/393231642 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7d4c12e040 con 0x7f7d440dad00 2024-04-18T04:53:31.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.127+0000 7f7d51600640 1 -- 172.21.15.120:0/393231642 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d44185420 con 0x7f7d440dad00 2024-04-18T04:53:31.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.131+0000 7f7d3fe00640 1 --2- 172.21.15.120:0/393231642 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7d2c0666c0 0x7f7d2c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:31.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.131+0000 7f7d3fe00640 1 -- 172.21.15.120:0/393231642 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f7d4c199660 con 0x7f7d440dad00 2024-04-18T04:53:31.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.131+0000 7f7d4be00640 1 --2- 172.21.15.120:0/393231642 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7d2c0666c0 0x7f7d2c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:31.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.131+0000 7f7d4be00640 1 --2- 172.21.15.120:0/393231642 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7d2c0666c0 0x7f7d2c068b80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7d40009af0 tx=0x7f7d40008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:31.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.139+0000 7f7d3fe00640 1 -- 172.21.15.120:0/393231642 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f7d4c166450 con 0x7f7d440dad00 2024-04-18T04:53:31.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.715+0000 7f7d51600640 1 -- 172.21.15.120:0/393231642 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d44005370 con 0x7f7d440dad00 2024-04-18T04:53:31.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.719+0000 7f7d3fe00640 1 -- 172.21.15.120:0/393231642 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+5521 (secure 0 0 0) 0x7f7d4c16ee60 con 0x7f7d440dad00 2024-04-18T04:53:31.725 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:53:31.725 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":44,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:53:26.033305+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5105,"mds_1":5400},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_5105":{"gid":5105,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":14,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5400":{"gid":5400,"name":"e","rank":1,"incarnation":44,"state":"up:replay","state_seq":1,"addr":"172.21.15.120:6837/671327196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":671327196},{"type":"v1","addr":"172.21.15.120:6837","nonce":671327196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:53:31.725 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 44 2024-04-18T04:53:31.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.727+0000 7f7d51600640 1 -- 172.21.15.120:0/393231642 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7d2c0666c0 msgr2=0x7f7d2c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:31.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.727+0000 7f7d51600640 1 --2- 172.21.15.120:0/393231642 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7d2c0666c0 0x7f7d2c068b80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7d40009af0 tx=0x7f7d40008040 comp rx=0 tx=0).stop 2024-04-18T04:53:31.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.727+0000 7f7d51600640 1 -- 172.21.15.120:0/393231642 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7d440dad00 msgr2=0x7f7d44049150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:31.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.727+0000 7f7d51600640 1 --2- 172.21.15.120:0/393231642 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7d440dad00 0x7f7d44049150 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c072f40 tx=0x7f7d4c093ee0 comp rx=0 tx=0).stop 2024-04-18T04:53:31.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.727+0000 7f7d51600640 1 -- 172.21.15.120:0/393231642 shutdown_connections 2024-04-18T04:53:31.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.727+0000 7f7d51600640 1 --2- 172.21.15.120:0/393231642 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7d2c0666c0 0x7f7d2c068b80 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:31.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.727+0000 7f7d51600640 1 --2- 172.21.15.120:0/393231642 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7d440dad00 0x7f7d44049150 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:31.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.727+0000 7f7d51600640 1 --2- 172.21.15.120:0/393231642 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7d44050c80 0x7f7d44048c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:31.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.727+0000 7f7d51600640 1 --2- 172.21.15.120:0/393231642 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d44034770 0x7f7d441847d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:31.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.727+0000 7f7d51600640 1 -- 172.21.15.120:0/393231642 >> 172.21.15.120:0/393231642 conn(0x7f7d44050160 msgr2=0x7f7d44034f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:53:31.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.727+0000 7f7d51600640 1 -- 172.21.15.120:0/393231642 shutdown_connections 2024-04-18T04:53:31.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:31.727+0000 7f7d51600640 1 -- 172.21.15.120:0/393231642 wait complete. 2024-04-18T04:53:31.821 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:53:33.822 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:53:34.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.239+0000 7fd3a0c00640 1 Processor -- start 2024-04-18T04:53:34.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.239+0000 7fd3a0c00640 1 -- start start 2024-04-18T04:53:34.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.239+0000 7fd3a0c00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd39c157a00 0x7fd39c0c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:34.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.239+0000 7fd3a0c00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd39c157de0 0x7fd39c06bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:34.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.239+0000 7fd3a0c00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd39c15e970 con 0x7fd39c0c0330 2024-04-18T04:53:34.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.239+0000 7fd3a0c00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd39c162170 con 0x7fd39c157a00 2024-04-18T04:53:34.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.239+0000 7fd3a0c00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd39c0c0780 con 0x7fd39c157de0 2024-04-18T04:53:34.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.239+0000 7fd399e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd39c157a00 0x7fd39c0c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:34.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.239+0000 7fd399e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd39c157a00 0x7fd39c0c69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49726/0 (socket says 172.21.15.120:49726) 2024-04-18T04:53:34.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.239+0000 7fd399e00640 1 -- 172.21.15.120:0/3340770819 learned_addr learned my addr 172.21.15.120:0/3340770819 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:53:34.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.243+0000 7fd399e00640 1 -- 172.21.15.120:0/3340770819 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd39c157de0 msgr2=0x7fd39c06bd70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:53:34.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.243+0000 7fd399e00640 1 --2- 172.21.15.120:0/3340770819 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd39c157de0 0x7fd39c06bd70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:34.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.243+0000 7fd399e00640 1 -- 172.21.15.120:0/3340770819 >> v1:172.21.15.132:6789/0 conn(0x7fd39c0c0330 legacy=0x7fd39c06b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:53:34.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.243+0000 7fd399e00640 1 -- 172.21.15.120:0/3340770819 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd39c0c5940 con 0x7fd39c157a00 2024-04-18T04:53:34.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.251+0000 7fd399e00640 1 --2- 172.21.15.120:0/3340770819 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd39c157a00 0x7fd39c0c69e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd38c009870 tx=0x7fd38c01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ca4bc797413036e server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:34.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.255+0000 7fd398a00640 1 -- 172.21.15.120:0/3340770819 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c0a89f0 con 0x7fd39c157a00 2024-04-18T04:53:34.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.259+0000 7fd398a00640 1 -- 172.21.15.120:0/3340770819 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38c0a8b50 con 0x7fd39c157a00 2024-04-18T04:53:34.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.259+0000 7fd398a00640 1 -- 172.21.15.120:0/3340770819 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c0b0440 con 0x7fd39c157a00 2024-04-18T04:53:34.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.267+0000 7fd3a0c00640 1 -- 172.21.15.120:0/3340770819 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd39c157a00 msgr2=0x7fd39c0c69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:34.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.267+0000 7fd3a0c00640 1 --2- 172.21.15.120:0/3340770819 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd39c157a00 0x7fd39c0c69e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd38c009870 tx=0x7fd38c01ed30 comp rx=0 tx=0).stop 2024-04-18T04:53:34.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.267+0000 7fd3a0c00640 1 -- 172.21.15.120:0/3340770819 shutdown_connections 2024-04-18T04:53:34.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.267+0000 7fd3a0c00640 1 --2- 172.21.15.120:0/3340770819 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd39c157de0 0x7fd39c06bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:34.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.267+0000 7fd3a0c00640 1 --2- 172.21.15.120:0/3340770819 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd39c157a00 0x7fd39c0c69e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:34.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.267+0000 7fd3a0c00640 1 -- 172.21.15.120:0/3340770819 >> 172.21.15.120:0/3340770819 conn(0x7fd39c0c78c0 msgr2=0x7fd39c0c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:53:34.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.267+0000 7fd3a0c00640 1 -- 172.21.15.120:0/3340770819 shutdown_connections 2024-04-18T04:53:34.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.267+0000 7fd3a0c00640 1 -- 172.21.15.120:0/3340770819 wait complete. 2024-04-18T04:53:34.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.271+0000 7fd3a0c00640 1 Processor -- start 2024-04-18T04:53:34.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.275+0000 7fd3a0c00640 1 -- start start 2024-04-18T04:53:34.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.283+0000 7fd3a0c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd39c0c0330 0x7fd39c131be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:34.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.283+0000 7fd3a0c00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd39c157a00 0x7fd39c132120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:34.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.283+0000 7fd3a0c00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd39c157de0 0x7fd39c15ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:34.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.283+0000 7fd3a0c00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39c0c4510 con 0x7fd39c0c0330 2024-04-18T04:53:34.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.283+0000 7fd3a0c00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39c161e40 con 0x7fd39c157de0 2024-04-18T04:53:34.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.283+0000 7fd3a0c00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd39c161250 con 0x7fd39c157a00 2024-04-18T04:53:34.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.283+0000 7fd39a800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd39c157de0 0x7fd39c15ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:34.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.283+0000 7fd39a800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd39c157de0 0x7fd39c15ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:33420/0 (socket says 172.21.15.120:33420) 2024-04-18T04:53:34.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.283+0000 7fd39a800640 1 -- 172.21.15.120:0/3728418597 learned_addr learned my addr 172.21.15.120:0/3728418597 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:53:34.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.283+0000 7fd399e00640 1 --2- 172.21.15.120:0/3728418597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd39c0c0330 0x7fd39c131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:34.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.283+0000 7fd399400640 1 --2- 172.21.15.120:0/3728418597 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd39c157a00 0x7fd39c132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:34.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.283+0000 7fd39a800640 1 -- 172.21.15.120:0/3728418597 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd39c157a00 msgr2=0x7fd39c132120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:34.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.283+0000 7fd39a800640 1 --2- 172.21.15.120:0/3728418597 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd39c157a00 0x7fd39c132120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:34.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.283+0000 7fd39a800640 1 -- 172.21.15.120:0/3728418597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd39c0c0330 msgr2=0x7fd39c131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:34.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.283+0000 7fd39a800640 1 --2- 172.21.15.120:0/3728418597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd39c0c0330 0x7fd39c131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:34.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.283+0000 7fd39a800640 1 -- 172.21.15.120:0/3728418597 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd38c0094d0 con 0x7fd39c157de0 2024-04-18T04:53:34.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.283+0000 7fd39a800640 1 --2- 172.21.15.120:0/3728418597 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd39c157de0 0x7fd39c15ff50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd39400b9e0 tx=0x7fd39400bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:34.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.287+0000 7fd392000640 1 -- 172.21.15.120:0/3728418597 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39400caa0 con 0x7fd39c157de0 2024-04-18T04:53:34.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.287+0000 7fd3a0c00640 1 -- 172.21.15.120:0/3728418597 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd39c161510 con 0x7fd39c157de0 2024-04-18T04:53:34.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.287+0000 7fd3a0c00640 1 -- 172.21.15.120:0/3728418597 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd39c161ad0 con 0x7fd39c157de0 2024-04-18T04:53:34.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.287+0000 7fd3a0c00640 1 -- 172.21.15.120:0/3728418597 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd39c067590 con 0x7fd39c157de0 2024-04-18T04:53:34.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.287+0000 7fd392000640 1 -- 172.21.15.120:0/3728418597 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd39400cc00 con 0x7fd39c157de0 2024-04-18T04:53:34.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.291+0000 7fd392000640 1 -- 172.21.15.120:0/3728418597 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39400caa0 con 0x7fd39c157de0 2024-04-18T04:53:34.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.303+0000 7fd392000640 1 -- 172.21.15.120:0/3728418597 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd39401e440 con 0x7fd39c157de0 2024-04-18T04:53:34.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.307+0000 7fd392000640 1 --2- 172.21.15.120:0/3728418597 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd37c066750 0x7fd37c068c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:34.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.307+0000 7fd392000640 1 -- 172.21.15.120:0/3728418597 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7fd394084620 con 0x7fd39c157de0 2024-04-18T04:53:34.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.307+0000 7fd392000640 1 -- 172.21.15.120:0/3728418597 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fd3940849f0 con 0x7fd39c157de0 2024-04-18T04:53:34.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.307+0000 7fd399e00640 1 --2- 172.21.15.120:0/3728418597 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd37c066750 0x7fd37c068c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:34.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.307+0000 7fd399e00640 1 --2- 172.21.15.120:0/3728418597 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd37c066750 0x7fd37c068c10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd38c0b2000 tx=0x7fd38c0aa070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:34.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.799+0000 7fd3a0c00640 1 -- 172.21.15.120:0/3728418597 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd39c131890 con 0x7fd39c157de0 2024-04-18T04:53:34.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.799+0000 7fd392000640 1 -- 172.21.15.120:0/3728418597 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+5521 (secure 0 0 0) 0x7fd3940514c0 con 0x7fd39c157de0 2024-04-18T04:53:34.801 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:53:34.801 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":44,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:53:26.033305+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5105,"mds_1":5400},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_5105":{"gid":5105,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":14,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5400":{"gid":5400,"name":"e","rank":1,"incarnation":44,"state":"up:replay","state_seq":1,"addr":"172.21.15.120:6837/671327196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":671327196},{"type":"v1","addr":"172.21.15.120:6837","nonce":671327196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:53:34.801 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 44 2024-04-18T04:53:34.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.811+0000 7fd3a0c00640 1 -- 172.21.15.120:0/3728418597 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd37c066750 msgr2=0x7fd37c068c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:34.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.811+0000 7fd3a0c00640 1 --2- 172.21.15.120:0/3728418597 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd37c066750 0x7fd37c068c10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd38c0b2000 tx=0x7fd38c0aa070 comp rx=0 tx=0).stop 2024-04-18T04:53:34.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.811+0000 7fd3a0c00640 1 -- 172.21.15.120:0/3728418597 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd39c157de0 msgr2=0x7fd39c15ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:34.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.811+0000 7fd3a0c00640 1 --2- 172.21.15.120:0/3728418597 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd39c157de0 0x7fd39c15ff50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd39400b9e0 tx=0x7fd39400bea0 comp rx=0 tx=0).stop 2024-04-18T04:53:34.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.811+0000 7fd3a0c00640 1 -- 172.21.15.120:0/3728418597 shutdown_connections 2024-04-18T04:53:34.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.811+0000 7fd3a0c00640 1 --2- 172.21.15.120:0/3728418597 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd37c066750 0x7fd37c068c10 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:34.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.811+0000 7fd3a0c00640 1 --2- 172.21.15.120:0/3728418597 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd39c157de0 0x7fd39c15ff50 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:34.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.811+0000 7fd3a0c00640 1 --2- 172.21.15.120:0/3728418597 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd39c157a00 0x7fd39c132120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:34.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.811+0000 7fd3a0c00640 1 --2- 172.21.15.120:0/3728418597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd39c0c0330 0x7fd39c131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:34.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.811+0000 7fd3a0c00640 1 -- 172.21.15.120:0/3728418597 >> 172.21.15.120:0/3728418597 conn(0x7fd39c0c78c0 msgr2=0x7fd39c0c9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:53:34.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.811+0000 7fd3a0c00640 1 -- 172.21.15.120:0/3728418597 shutdown_connections 2024-04-18T04:53:34.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:34.811+0000 7fd3a0c00640 1 -- 172.21.15.120:0/3728418597 wait complete. 2024-04-18T04:53:34.941 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:53:36.942 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:53:37.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.343+0000 7f790f000640 1 Processor -- start 2024-04-18T04:53:37.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.343+0000 7f790f000640 1 -- start start 2024-04-18T04:53:37.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.351+0000 7f790f000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7908150020 0x7f790806f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:37.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.351+0000 7f790f000640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f79080c7280 0x7f7908155c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:37.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.351+0000 7f790f000640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f79080c0a40 0x7f7908071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:37.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.351+0000 7f790f000640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79080c08b0 con 0x7f79080c0a40 2024-04-18T04:53:37.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.351+0000 7f790f000640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7908071450 con 0x7f79080c7280 2024-04-18T04:53:37.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.351+0000 7f790f000640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7908071db0 con 0x7f7908150020 2024-04-18T04:53:37.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.351+0000 7f7907e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7908150020 0x7f790806f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:37.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.351+0000 7f7907400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f79080c7280 0x7f7908155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:37.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.351+0000 7f7907400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f79080c7280 0x7f7908155c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:33434/0 (socket says 172.21.15.120:33434) 2024-04-18T04:53:37.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.351+0000 7f7907400640 1 -- 172.21.15.120:0/2793512772 learned_addr learned my addr 172.21.15.120:0/2793512772 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:53:37.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.351+0000 7f7907e00640 1 -- 172.21.15.120:0/2793512772 >> v2:172.21.15.132:3300/0 conn(0x7f79080c7280 msgr2=0x7f7908155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:53:37.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.351+0000 7f7907e00640 1 --2- 172.21.15.120:0/2793512772 >> v2:172.21.15.132:3300/0 conn(0x7f79080c7280 0x7f7908155c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:37.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.351+0000 7f7907e00640 1 -- 172.21.15.120:0/2793512772 >> v2:172.21.15.120:3300/0 conn(0x7f79080c0a40 msgr2=0x7f7908071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:53:37.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.351+0000 7f7907e00640 1 --2- 172.21.15.120:0/2793512772 >> v2:172.21.15.120:3300/0 conn(0x7f79080c0a40 0x7f7908071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:37.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.351+0000 7f7907e00640 1 -- 172.21.15.120:0/2793512772 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7908150400 con 0x7f7908150020 2024-04-18T04:53:37.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.375+0000 7f7907e00640 1 --2- 172.21.15.120:0/2793512772 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7908150020 0x7f790806f910 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f79080740b0 tx=0x7f78f401ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc79557431d071c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:37.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.375+0000 7f7906a00640 1 -- 172.21.15.120:0/2793512772 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f40a8930 con 0x7f7908150020 2024-04-18T04:53:37.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.379+0000 7f7906a00640 1 -- 172.21.15.120:0/2793512772 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f40a8a90 con 0x7f7908150020 2024-04-18T04:53:37.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.379+0000 7f7906a00640 1 -- 172.21.15.120:0/2793512772 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f40a8e20 con 0x7f7908150020 2024-04-18T04:53:37.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.395+0000 7f790f000640 1 -- 172.21.15.120:0/2793512772 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7908150020 msgr2=0x7f790806f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:37.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.395+0000 7f790f000640 1 --2- 172.21.15.120:0/2793512772 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7908150020 0x7f790806f910 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f79080740b0 tx=0x7f78f401ec70 comp rx=0 tx=0).stop 2024-04-18T04:53:37.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.399+0000 7f790f000640 1 -- 172.21.15.120:0/2793512772 shutdown_connections 2024-04-18T04:53:37.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.399+0000 7f790f000640 1 --2- 172.21.15.120:0/2793512772 >> v2:172.21.15.120:3300/0 conn(0x7f79080c0a40 0x7f7908071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:37.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.399+0000 7f790f000640 1 --2- 172.21.15.120:0/2793512772 >> v2:172.21.15.132:3300/0 conn(0x7f79080c7280 0x7f7908155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:37.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.399+0000 7f790f000640 1 --2- 172.21.15.120:0/2793512772 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7908150020 0x7f790806f910 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:37.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.399+0000 7f790f000640 1 -- 172.21.15.120:0/2793512772 >> 172.21.15.120:0/2793512772 conn(0x7f79080c78c0 msgr2=0x7f79080c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:53:37.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.403+0000 7f790f000640 1 -- 172.21.15.120:0/2793512772 shutdown_connections 2024-04-18T04:53:37.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.403+0000 7f790f000640 1 -- 172.21.15.120:0/2793512772 wait complete. 2024-04-18T04:53:37.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.403+0000 7f790f000640 1 Processor -- start 2024-04-18T04:53:37.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.407+0000 7f790f000640 1 -- start start 2024-04-18T04:53:37.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.415+0000 7f790f000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f79080c0a40 0x7f79080aad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:37.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.415+0000 7f790f000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f79080c7280 0x7f79081513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:37.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.415+0000 7f790f000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7908150020 0x7f79081518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:37.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.415+0000 7f790f000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790806c8e0 con 0x7f79080c0a40 2024-04-18T04:53:37.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.415+0000 7f790f000640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790806d9c0 con 0x7f79080c7280 2024-04-18T04:53:37.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.415+0000 7f790f000640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f790806d720 con 0x7f7908150020 2024-04-18T04:53:37.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.415+0000 7f790d000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7908150020 0x7f79081518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:37.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.415+0000 7f790d000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7908150020 0x7f79081518e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:37090/0 (socket says 172.21.15.120:37090) 2024-04-18T04:53:37.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.415+0000 7f790d000640 1 -- 172.21.15.120:0/1881591734 learned_addr learned my addr 172.21.15.120:0/1881591734 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:53:37.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.415+0000 7f790d000640 1 -- 172.21.15.120:0/1881591734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f79080c7280 msgr2=0x7f79081513a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:37.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.415+0000 7f790d000640 1 --2- 172.21.15.120:0/1881591734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f79080c7280 0x7f79081513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:37.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.415+0000 7f790d000640 1 -- 172.21.15.120:0/1881591734 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f79080c0a40 msgr2=0x7f79080aad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:37.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.415+0000 7f790d000640 1 --2- 172.21.15.120:0/1881591734 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f79080c0a40 0x7f79080aad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:37.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.415+0000 7f790d000640 1 -- 172.21.15.120:0/1881591734 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f4009420 con 0x7f7908150020 2024-04-18T04:53:37.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.419+0000 7f790d000640 1 --2- 172.21.15.120:0/1881591734 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7908150020 0x7f79081518e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f790000ba10 tx=0x7f790000bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:37.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.419+0000 7f78ffe00640 1 -- 172.21.15.120:0/1881591734 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790000cac0 con 0x7f7908150020 2024-04-18T04:53:37.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.419+0000 7f790f000640 1 -- 172.21.15.120:0/1881591734 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f790814dbd0 con 0x7f7908150020 2024-04-18T04:53:37.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.419+0000 7f78ffe00640 1 -- 172.21.15.120:0/1881591734 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f790000cc20 con 0x7f7908150020 2024-04-18T04:53:37.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.423+0000 7f78ffe00640 1 -- 172.21.15.120:0/1881591734 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790000cac0 con 0x7f7908150020 2024-04-18T04:53:37.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.423+0000 7f790f000640 1 -- 172.21.15.120:0/1881591734 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79080c4e70 con 0x7f7908150020 2024-04-18T04:53:37.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.423+0000 7f78fd600640 1 -- 172.21.15.120:0/1881591734 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78dc005260 con 0x7f7908150020 2024-04-18T04:53:37.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.423+0000 7f78ffe00640 1 -- 172.21.15.120:0/1881591734 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f790001d3b0 con 0x7f7908150020 2024-04-18T04:53:37.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.427+0000 7f78ffe00640 1 --2- 172.21.15.120:0/1881591734 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f78e80666e0 0x7f78e8068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:37.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.427+0000 7f7907e00640 1 --2- 172.21.15.120:0/1881591734 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f78e80666e0 0x7f78e8068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:37.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.427+0000 7f7907e00640 1 --2- 172.21.15.120:0/1881591734 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f78e80666e0 0x7f78e8068ba0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f79080740b0 tx=0x7f78f4004740 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:37.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.439+0000 7f78ffe00640 1 -- 172.21.15.120:0/1881591734 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f790000ce30 con 0x7f7908150020 2024-04-18T04:53:37.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.447+0000 7f78ffe00640 1 -- 172.21.15.120:0/1881591734 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f7900019070 con 0x7f7908150020 2024-04-18T04:53:37.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.931+0000 7f78fd600640 1 -- 172.21.15.120:0/1881591734 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f78dc0057e0 con 0x7f7908150020 2024-04-18T04:53:37.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.935+0000 7f78ffe00640 1 -- 172.21.15.120:0/1881591734 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+5523 (secure 0 0 0) 0x7f7900050e40 con 0x7f7908150020 2024-04-18T04:53:37.943 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:53:37.943 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":45,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:53:35.234251+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5105,"mds_1":5400},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_5105":{"gid":5105,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":14,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5400":{"gid":5400,"name":"e","rank":1,"incarnation":44,"state":"up:resolve","state_seq":15,"addr":"172.21.15.120:6837/671327196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":671327196},{"type":"v1","addr":"172.21.15.120:6837","nonce":671327196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:53:37.943 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 45 2024-04-18T04:53:37.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.943+0000 7f78fd600640 1 -- 172.21.15.120:0/1881591734 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f78e80666e0 msgr2=0x7f78e8068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:37.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.943+0000 7f78fd600640 1 --2- 172.21.15.120:0/1881591734 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f78e80666e0 0x7f78e8068ba0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f79080740b0 tx=0x7f78f4004740 comp rx=0 tx=0).stop 2024-04-18T04:53:37.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.943+0000 7f78fd600640 1 -- 172.21.15.120:0/1881591734 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7908150020 msgr2=0x7f79081518e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:37.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.943+0000 7f78fd600640 1 --2- 172.21.15.120:0/1881591734 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7908150020 0x7f79081518e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f790000ba10 tx=0x7f790000bed0 comp rx=0 tx=0).stop 2024-04-18T04:53:37.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.947+0000 7f78fd600640 1 -- 172.21.15.120:0/1881591734 shutdown_connections 2024-04-18T04:53:37.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.947+0000 7f78fd600640 1 --2- 172.21.15.120:0/1881591734 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f78e80666e0 0x7f78e8068ba0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:37.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.947+0000 7f78fd600640 1 --2- 172.21.15.120:0/1881591734 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7908150020 0x7f79081518e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:37.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.947+0000 7f78fd600640 1 --2- 172.21.15.120:0/1881591734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f79080c7280 0x7f79081513a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:37.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.947+0000 7f78fd600640 1 --2- 172.21.15.120:0/1881591734 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f79080c0a40 0x7f79080aad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:37.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.947+0000 7f78fd600640 1 -- 172.21.15.120:0/1881591734 >> 172.21.15.120:0/1881591734 conn(0x7f79080c78c0 msgr2=0x7f790814e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:53:37.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.947+0000 7f78fd600640 1 -- 172.21.15.120:0/1881591734 shutdown_connections 2024-04-18T04:53:37.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:37.947+0000 7f78fd600640 1 -- 172.21.15.120:0/1881591734 wait complete. 2024-04-18T04:53:38.032 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:53:40.033 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:53:40.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.339+0000 7f83f9400640 1 Processor -- start 2024-04-18T04:53:40.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.339+0000 7f83f9400640 1 -- start start 2024-04-18T04:53:40.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.339+0000 7f83f9400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f83ec04b6e0 0x7f83ec0d4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:40.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.339+0000 7f83f9400640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83ec0dbd50 con 0x7f83ec046d80 2024-04-18T04:53:40.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.339+0000 7f83f9400640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83ec0468f0 con 0x7f83ec04b300 2024-04-18T04:53:40.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.339+0000 7f83f9400640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83ec0dbab0 con 0x7f83ec04b6e0 2024-04-18T04:53:40.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.339+0000 7f83f2800640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f83ec04b300 0x7f83ec005ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:49282/0 (socket says 172.21.15.120:49282) 2024-04-18T04:53:40.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.339+0000 7f83f2800640 1 -- 172.21.15.120:0/2690109759 learned_addr learned my addr 172.21.15.120:0/2690109759 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:53:40.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.339+0000 7f83f1e00640 1 --2- 172.21.15.120:0/2690109759 >> v2:172.21.15.120:3300/0 conn(0x7f83ec04b6e0 0x7f83ec0d4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:40.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.343+0000 7f83f1400640 1 -- 172.21.15.120:0/2690109759 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3782078869 0 0) 0x7f83ec0468f0 con 0x7f83ec04b300 2024-04-18T04:53:40.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.343+0000 7f83f1400640 1 -- 172.21.15.120:0/2690109759 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83d8003530 con 0x7f83ec04b300 2024-04-18T04:53:40.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.343+0000 7f83f1e00640 1 -- 172.21.15.120:0/2690109759 >> v1:172.21.15.132:6789/0 conn(0x7f83ec04b300 legacy=0x7f83ec005ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:40.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.343+0000 7f83f1e00640 1 -- 172.21.15.120:0/2690109759 >> v1:172.21.15.120:6789/0 conn(0x7f83ec046d80 legacy=0x7f83ec0dad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:40.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.343+0000 7f83f1e00640 1 -- 172.21.15.120:0/2690109759 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ec045fc0 con 0x7f83ec04b6e0 2024-04-18T04:53:40.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.355+0000 7f83f1e00640 1 --2- 172.21.15.120:0/2690109759 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f83ec04b6e0 0x7f83ec0d4b50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f83e00097c0 tx=0x7f83e001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53b72e566fab04f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:40.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.359+0000 7f83f1400640 1 -- 172.21.15.120:0/2690109759 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e00ab600 con 0x7f83ec04b6e0 2024-04-18T04:53:40.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.359+0000 7f83f1400640 1 -- 172.21.15.120:0/2690109759 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e00a7050 con 0x7f83ec04b6e0 2024-04-18T04:53:40.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.359+0000 7f83f1400640 1 -- 172.21.15.120:0/2690109759 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e00ab980 con 0x7f83ec04b6e0 2024-04-18T04:53:40.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.359+0000 7f83f9400640 1 -- 172.21.15.120:0/2690109759 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f83ec04b6e0 msgr2=0x7f83ec0d4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:40.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.359+0000 7f83f9400640 1 --2- 172.21.15.120:0/2690109759 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f83ec04b6e0 0x7f83ec0d4b50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f83e00097c0 tx=0x7f83e001c3e0 comp rx=0 tx=0).stop 2024-04-18T04:53:40.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.359+0000 7f83f9400640 1 -- 172.21.15.120:0/2690109759 shutdown_connections 2024-04-18T04:53:40.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.359+0000 7f83f9400640 1 --2- 172.21.15.120:0/2690109759 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f83ec04b6e0 0x7f83ec0d4b50 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:40.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.359+0000 7f83f9400640 1 -- 172.21.15.120:0/2690109759 >> 172.21.15.120:0/2690109759 conn(0x7f83ec050190 msgr2=0x7f83ec0505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:53:40.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.359+0000 7f83f9400640 1 -- 172.21.15.120:0/2690109759 shutdown_connections 2024-04-18T04:53:40.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.359+0000 7f83f9400640 1 -- 172.21.15.120:0/2690109759 wait complete. 2024-04-18T04:53:40.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.363+0000 7f83f9400640 1 Processor -- start 2024-04-18T04:53:40.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.367+0000 7f83f9400640 1 -- start start 2024-04-18T04:53:40.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.371+0000 7f83f9400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f83ec046d80 0x7f83ec0ce690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:40.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.371+0000 7f83f9400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83ec04b300 0x7f83ec0d99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:40.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.371+0000 7f83f9400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f83ec04b6e0 0x7f83ec0d9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:40.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.371+0000 7f83f9400640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83ec0cebd0 con 0x7f83ec04b6e0 2024-04-18T04:53:40.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.371+0000 7f83f9400640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83ec047240 con 0x7f83ec04b300 2024-04-18T04:53:40.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.371+0000 7f83f9400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83ec049860 con 0x7f83ec046d80 2024-04-18T04:53:40.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.375+0000 7f83f3200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f83ec04b6e0 0x7f83ec0d9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:40.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.375+0000 7f83f3200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f83ec04b6e0 0x7f83ec0d9f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49774/0 (socket says 172.21.15.120:49774) 2024-04-18T04:53:40.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.375+0000 7f83f3200640 1 -- 172.21.15.120:0/1407817817 learned_addr learned my addr 172.21.15.120:0/1407817817 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:53:40.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.375+0000 7f83f3200640 1 -- 172.21.15.120:0/1407817817 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f83ec046d80 msgr2=0x7f83ec0ce690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:53:40.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.375+0000 7f83f3200640 1 --2- 172.21.15.120:0/1407817817 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f83ec046d80 0x7f83ec0ce690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:40.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.375+0000 7f83f3200640 1 -- 172.21.15.120:0/1407817817 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83ec04b300 msgr2=0x7f83ec0d99e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:53:40.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.375+0000 7f83f3200640 1 --2- 172.21.15.120:0/1407817817 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83ec04b300 0x7f83ec0d99e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:40.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.375+0000 7f83f3200640 1 -- 172.21.15.120:0/1407817817 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e0009420 con 0x7f83ec04b6e0 2024-04-18T04:53:40.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.375+0000 7f83f3200640 1 --2- 172.21.15.120:0/1407817817 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f83ec04b6e0 0x7f83ec0d9f20 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f83f4072e20 tx=0x7f83f4067500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:40.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.379+0000 7f83eaa00640 1 -- 172.21.15.120:0/1407817817 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f4067f80 con 0x7f83ec04b6e0 2024-04-18T04:53:40.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.379+0000 7f83eaa00640 1 -- 172.21.15.120:0/1407817817 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f4068100 con 0x7f83ec04b6e0 2024-04-18T04:53:40.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.379+0000 7f83eaa00640 1 -- 172.21.15.120:0/1407817817 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f4068530 con 0x7f83ec04b6e0 2024-04-18T04:53:40.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.383+0000 7f83f9400640 1 -- 172.21.15.120:0/1407817817 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83ec184a30 con 0x7f83ec04b6e0 2024-04-18T04:53:40.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.383+0000 7f83f9400640 1 -- 172.21.15.120:0/1407817817 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83ec184ff0 con 0x7f83ec04b6e0 2024-04-18T04:53:40.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.383+0000 7f83f9400640 1 -- 172.21.15.120:0/1407817817 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83ec0053a0 con 0x7f83ec04b6e0 2024-04-18T04:53:40.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.391+0000 7f83eaa00640 1 -- 172.21.15.120:0/1407817817 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f83f4091020 con 0x7f83ec04b6e0 2024-04-18T04:53:40.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.395+0000 7f83eaa00640 1 --2- 172.21.15.120:0/1407817817 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f83d40666e0 0x7f83d4068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:40.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.395+0000 7f83f2800640 1 --2- 172.21.15.120:0/1407817817 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f83d40666e0 0x7f83d4068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:40.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.395+0000 7f83eaa00640 1 -- 172.21.15.120:0/1407817817 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f83f40d0050 con 0x7f83ec04b6e0 2024-04-18T04:53:40.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.395+0000 7f83f2800640 1 --2- 172.21.15.120:0/1407817817 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f83d40666e0 0x7f83d4068ba0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f83e4007fd0 tx=0x7f83e4007900 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:40.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.399+0000 7f83eaa00640 1 -- 172.21.15.120:0/1407817817 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f83f40cc420 con 0x7f83ec04b6e0 2024-04-18T04:53:40.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.967+0000 7f83f9400640 1 -- 172.21.15.120:0/1407817817 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83ec0e64b0 con 0x7f83ec04b6e0 2024-04-18T04:53:40.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.967+0000 7f83eaa00640 1 -- 172.21.15.120:0/1407817817 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+5525 (secure 0 0 0) 0x7f83f4099030 con 0x7f83ec04b6e0 2024-04-18T04:53:40.972 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:53:40.972 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":46,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:53:40.358620+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5105,"mds_1":5400},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_5105":{"gid":5105,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":14,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5400":{"gid":5400,"name":"e","rank":1,"incarnation":44,"state":"up:reconnect","state_seq":17,"addr":"172.21.15.120:6837/671327196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":671327196},{"type":"v1","addr":"172.21.15.120:6837","nonce":671327196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:53:40.972 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 46 2024-04-18T04:53:40.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.983+0000 7f83f9400640 1 -- 172.21.15.120:0/1407817817 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f83d40666e0 msgr2=0x7f83d4068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:40.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.983+0000 7f83f9400640 1 --2- 172.21.15.120:0/1407817817 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f83d40666e0 0x7f83d4068ba0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f83e4007fd0 tx=0x7f83e4007900 comp rx=0 tx=0).stop 2024-04-18T04:53:40.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.983+0000 7f83f9400640 1 -- 172.21.15.120:0/1407817817 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f83ec04b6e0 msgr2=0x7f83ec0d9f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:40.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.983+0000 7f83f9400640 1 --2- 172.21.15.120:0/1407817817 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f83ec04b6e0 0x7f83ec0d9f20 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f83f4072e20 tx=0x7f83f4067500 comp rx=0 tx=0).stop 2024-04-18T04:53:40.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.987+0000 7f83f9400640 1 -- 172.21.15.120:0/1407817817 shutdown_connections 2024-04-18T04:53:40.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.987+0000 7f83f9400640 1 --2- 172.21.15.120:0/1407817817 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f83d40666e0 0x7f83d4068ba0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:40.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.987+0000 7f83f9400640 1 --2- 172.21.15.120:0/1407817817 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f83ec04b6e0 0x7f83ec0d9f20 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:40.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.987+0000 7f83f9400640 1 --2- 172.21.15.120:0/1407817817 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83ec04b300 0x7f83ec0d99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:40.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.987+0000 7f83f9400640 1 --2- 172.21.15.120:0/1407817817 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f83ec046d80 0x7f83ec0ce690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:40.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.987+0000 7f83f9400640 1 -- 172.21.15.120:0/1407817817 >> 172.21.15.120:0/1407817817 conn(0x7f83ec050190 msgr2=0x7f83ec04f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:53:40.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.987+0000 7f83f9400640 1 -- 172.21.15.120:0/1407817817 shutdown_connections 2024-04-18T04:53:40.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:40.987+0000 7f83f9400640 1 -- 172.21.15.120:0/1407817817 wait complete. 2024-04-18T04:53:41.035 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:53:43.036 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:53:43.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.319+0000 7f8c41600640 1 Processor -- start 2024-04-18T04:53:43.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.319+0000 7f8c41600640 1 -- start start 2024-04-18T04:53:43.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.323+0000 7f8c41600640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8c3c157d70 0x7f8c3c15e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:43.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.323+0000 7f8c41600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8c3c0c6a50 0x7f8c3c0c0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:43.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.323+0000 7f8c41600640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c3c1618d0 con 0x7f8c3c0c0850 2024-04-18T04:53:43.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.323+0000 7f8c41600640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c3c06fec0 con 0x7f8c3c157d70 2024-04-18T04:53:43.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.323+0000 7f8c41600640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c158150 con 0x7f8c3c0c6a50 2024-04-18T04:53:43.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.323+0000 7f8c3a000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8c3c0c6a50 0x7f8c3c0c0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:43.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.323+0000 7f8c3a000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8c3c0c6a50 0x7f8c3c0c0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:36082/0 (socket says 172.21.15.120:36082) 2024-04-18T04:53:43.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.323+0000 7f8c3a000640 1 -- 172.21.15.120:0/891262768 learned_addr learned my addr 172.21.15.120:0/891262768 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:53:43.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.323+0000 7f8c3aa00640 1 --2- 172.21.15.120:0/891262768 >> v2:172.21.15.132:3300/0 conn(0x7f8c3c157d70 0x7f8c3c15e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:43.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.323+0000 7f8c3a000640 1 -- 172.21.15.120:0/891262768 >> v2:172.21.15.132:3300/0 conn(0x7f8c3c157d70 msgr2=0x7f8c3c15e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:53:43.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.327+0000 7f8c3a000640 1 --2- 172.21.15.120:0/891262768 >> v2:172.21.15.132:3300/0 conn(0x7f8c3c157d70 0x7f8c3c15e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:43.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.327+0000 7f8c3a000640 1 -- 172.21.15.120:0/891262768 >> v1:172.21.15.132:6789/0 conn(0x7f8c3c0c0850 legacy=0x7f8c3c06b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:43.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.327+0000 7f8c3a000640 1 -- 172.21.15.120:0/891262768 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3c06bf80 con 0x7f8c3c0c6a50 2024-04-18T04:53:43.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.327+0000 7f8c3aa00640 1 --2- 172.21.15.120:0/891262768 >> v2:172.21.15.132:3300/0 conn(0x7f8c3c157d70 0x7f8c3c15e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:53:43.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.323+0000 7f8c39600640 1 -- 172.21.15.120:0/891262768 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 283384696 0 0) 0x7f8c3c1618d0 con 0x7f8c3c0c0850 2024-04-18T04:53:43.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.339+0000 7f8c3a000640 1 --2- 172.21.15.120:0/891262768 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8c3c0c6a50 0x7f8c3c0c0310 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c009870 tx=0x7f8c2c01ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=981917f14e83e7de server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:43.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.339+0000 7f8c39600640 1 -- 172.21.15.120:0/891262768 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c0a8a50 con 0x7f8c3c0c6a50 2024-04-18T04:53:43.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.339+0000 7f8c39600640 1 -- 172.21.15.120:0/891262768 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c2c0a8bb0 con 0x7f8c3c0c6a50 2024-04-18T04:53:43.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.339+0000 7f8c39600640 1 -- 172.21.15.120:0/891262768 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c0b0440 con 0x7f8c3c0c6a50 2024-04-18T04:53:43.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.339+0000 7f8c41600640 1 -- 172.21.15.120:0/891262768 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8c3c0c6a50 msgr2=0x7f8c3c0c0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:43.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.339+0000 7f8c41600640 1 --2- 172.21.15.120:0/891262768 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8c3c0c6a50 0x7f8c3c0c0310 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c009870 tx=0x7f8c2c01ed50 comp rx=0 tx=0).stop 2024-04-18T04:53:43.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.339+0000 7f8c41600640 1 -- 172.21.15.120:0/891262768 shutdown_connections 2024-04-18T04:53:43.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.339+0000 7f8c41600640 1 --2- 172.21.15.120:0/891262768 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8c3c0c6a50 0x7f8c3c0c0310 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:43.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.339+0000 7f8c41600640 1 --2- 172.21.15.120:0/891262768 >> v2:172.21.15.132:3300/0 conn(0x7f8c3c157d70 0x7f8c3c15e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:43.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.339+0000 7f8c41600640 1 -- 172.21.15.120:0/891262768 >> 172.21.15.120:0/891262768 conn(0x7f8c3c06d000 msgr2=0x7f8c3c06d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:53:43.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.339+0000 7f8c41600640 1 -- 172.21.15.120:0/891262768 shutdown_connections 2024-04-18T04:53:43.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.339+0000 7f8c41600640 1 -- 172.21.15.120:0/891262768 wait complete. 2024-04-18T04:53:43.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.343+0000 7f8c41600640 1 Processor -- start 2024-04-18T04:53:43.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.343+0000 7f8c41600640 1 -- start start 2024-04-18T04:53:43.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.347+0000 7f8c41600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8c3c0c0850 0x7f8c3c070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:43.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.347+0000 7f8c41600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c3c0c6a50 0x7f8c3c0c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:43.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.347+0000 7f8c41600640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c3c157d70 0x7f8c3c0c9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:43.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.347+0000 7f8c41600640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c15eb70 con 0x7f8c3c0c6a50 2024-04-18T04:53:43.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.347+0000 7f8c41600640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c160930 con 0x7f8c3c157d70 2024-04-18T04:53:43.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.347+0000 7f8c41600640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c160c10 con 0x7f8c3c0c0850 2024-04-18T04:53:43.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.347+0000 7f8c3b400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c3c157d70 0x7f8c3c0c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:43.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.347+0000 7f8c3b400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c3c157d70 0x7f8c3c0c9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:57160/0 (socket says 172.21.15.120:57160) 2024-04-18T04:53:43.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.347+0000 7f8c3b400640 1 -- 172.21.15.120:0/899847036 learned_addr learned my addr 172.21.15.120:0/899847036 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:53:43.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.351+0000 7f8c3aa00640 1 --2- 172.21.15.120:0/899847036 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8c3c0c0850 0x7f8c3c070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:43.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.351+0000 7f8c3b400640 1 -- 172.21.15.120:0/899847036 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8c3c0c0850 msgr2=0x7f8c3c070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:43.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.351+0000 7f8c3b400640 1 --2- 172.21.15.120:0/899847036 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8c3c0c0850 0x7f8c3c070690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:43.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.351+0000 7f8c3b400640 1 -- 172.21.15.120:0/899847036 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c3c0c6a50 msgr2=0x7f8c3c0c8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:43.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.351+0000 7f8c3b400640 1 --2- 172.21.15.120:0/899847036 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c3c0c6a50 0x7f8c3c0c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:43.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.351+0000 7f8c3b400640 1 -- 172.21.15.120:0/899847036 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c2c0094d0 con 0x7f8c3c157d70 2024-04-18T04:53:43.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.351+0000 7f8c3aa00640 1 --2- 172.21.15.120:0/899847036 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8c3c0c0850 0x7f8c3c070690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:53:43.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.351+0000 7f8c3b400640 1 --2- 172.21.15.120:0/899847036 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c3c157d70 0x7f8c3c0c9200 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8c34002240 tx=0x7f8c3400cc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:43.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.351+0000 7f8c32a00640 1 -- 172.21.15.120:0/899847036 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3400cea0 con 0x7f8c3c157d70 2024-04-18T04:53:43.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.351+0000 7f8c32a00640 1 -- 172.21.15.120:0/899847036 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c34003db0 con 0x7f8c3c157d70 2024-04-18T04:53:43.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.351+0000 7f8c32a00640 1 -- 172.21.15.120:0/899847036 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c340052b0 con 0x7f8c3c157d70 2024-04-18T04:53:43.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.355+0000 7f8c41600640 1 -- 172.21.15.120:0/899847036 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c3c132810 con 0x7f8c3c157d70 2024-04-18T04:53:43.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.355+0000 7f8c41600640 1 -- 172.21.15.120:0/899847036 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c3c160320 con 0x7f8c3c157d70 2024-04-18T04:53:43.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.359+0000 7f8c32a00640 1 -- 172.21.15.120:0/899847036 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8c34005410 con 0x7f8c3c157d70 2024-04-18T04:53:43.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.363+0000 7f8c32a00640 1 --2- 172.21.15.120:0/899847036 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8c18066690 0x7f8c18068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:43.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.363+0000 7f8c32a00640 1 -- 172.21.15.120:0/899847036 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f8c34084050 con 0x7f8c3c157d70 2024-04-18T04:53:43.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.367+0000 7f8c41600640 1 -- 172.21.15.120:0/899847036 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c3c0728f0 con 0x7f8c3c157d70 2024-04-18T04:53:43.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.367+0000 7f8c3aa00640 1 --2- 172.21.15.120:0/899847036 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8c18066690 0x7f8c18068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:43.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.367+0000 7f8c3aa00640 1 --2- 172.21.15.120:0/899847036 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8c18066690 0x7f8c18068b50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8c2400a9b0 tx=0x7f8c24008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:43.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.383+0000 7f8c32a00640 1 -- 172.21.15.120:0/899847036 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f8c34017020 con 0x7f8c3c157d70 2024-04-18T04:53:43.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.971+0000 7f8c41600640 1 -- 172.21.15.120:0/899847036 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c3c0c5150 con 0x7f8c3c157d70 2024-04-18T04:53:43.974 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:53:43.974 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":46,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:53:40.358620+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5105,"mds_1":5400},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_5105":{"gid":5105,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":14,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5400":{"gid":5400,"name":"e","rank":1,"incarnation":44,"state":"up:reconnect","state_seq":17,"addr":"172.21.15.120:6837/671327196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":671327196},{"type":"v1","addr":"172.21.15.120:6837","nonce":671327196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:53:43.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.975+0000 7f8c32a00640 1 -- 172.21.15.120:0/899847036 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+5525 (secure 0 0 0) 0x7f8c34054840 con 0x7f8c3c157d70 2024-04-18T04:53:43.975 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 46 2024-04-18T04:53:43.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.979+0000 7f8c41600640 1 -- 172.21.15.120:0/899847036 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8c18066690 msgr2=0x7f8c18068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:43.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.979+0000 7f8c41600640 1 --2- 172.21.15.120:0/899847036 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8c18066690 0x7f8c18068b50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8c2400a9b0 tx=0x7f8c24008040 comp rx=0 tx=0).stop 2024-04-18T04:53:43.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.979+0000 7f8c41600640 1 -- 172.21.15.120:0/899847036 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c3c157d70 msgr2=0x7f8c3c0c9200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:43.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.979+0000 7f8c41600640 1 --2- 172.21.15.120:0/899847036 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c3c157d70 0x7f8c3c0c9200 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8c34002240 tx=0x7f8c3400cc50 comp rx=0 tx=0).stop 2024-04-18T04:53:43.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.979+0000 7f8c41600640 1 -- 172.21.15.120:0/899847036 shutdown_connections 2024-04-18T04:53:43.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.979+0000 7f8c41600640 1 --2- 172.21.15.120:0/899847036 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8c18066690 0x7f8c18068b50 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:43.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.979+0000 7f8c41600640 1 --2- 172.21.15.120:0/899847036 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c3c157d70 0x7f8c3c0c9200 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:43.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.979+0000 7f8c41600640 1 --2- 172.21.15.120:0/899847036 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c3c0c6a50 0x7f8c3c0c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:43.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.979+0000 7f8c41600640 1 --2- 172.21.15.120:0/899847036 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8c3c0c0850 0x7f8c3c070690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:43.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.979+0000 7f8c41600640 1 -- 172.21.15.120:0/899847036 >> 172.21.15.120:0/899847036 conn(0x7f8c3c06d000 msgr2=0x7f8c3c154ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:53:43.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.983+0000 7f8c41600640 1 -- 172.21.15.120:0/899847036 shutdown_connections 2024-04-18T04:53:43.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:43.983+0000 7f8c41600640 1 -- 172.21.15.120:0/899847036 wait complete. 2024-04-18T04:53:44.031 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 46, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-18T04:44:30.251235+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 46, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1 ], "info": { "gid_5105": { "addr": "172.21.15.120:6833/3842815393", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6832", "nonce": 3842815393, "type": "v2" }, { "addr": "172.21.15.120:6833", "nonce": 3842815393, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5105, "incarnation": 38, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 14 }, "gid_5400": { "addr": "172.21.15.120:6837/671327196", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6835", "nonce": 671327196, "type": "v2" }, { "addr": "172.21.15.120:6837", "nonce": 671327196, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5400, "incarnation": 44, "join_fscid": -1, "name": "e", "rank": 1, "state": "up:reconnect", "state_seq": 17 } }, "last_failure": 0, "last_failure_osd_epoch": 32, "max_file_size": 1099511627776, "max_mds": 2, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-18T04:53:40.358620+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [ 2 ], "tableserver": 0, "up": { "mds_0": 5105, "mds_1": 5400 } } } ], "standbys": [ { "addr": "172.21.15.132:6839/4292136288", "addrs": { "addrvec": [ { "addr": "172.21.15.132:6836", "nonce": 4292136288, "type": "v2" }, { "addr": "172.21.15.132:6839", "nonce": 4292136288, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4241, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.132:6838/1712856922", "addrs": { "addrvec": [ { "addr": "172.21.15.132:6837", "nonce": 1712856922, "type": "v2" }, { "addr": "172.21.15.132:6838", "nonce": 1712856922, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 2, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4244, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.120:6836/2384594941", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6834", "nonce": 2384594941, "type": "v2" }, { "addr": "172.21.15.120:6836", "nonce": 2384594941, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 33, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5051, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-18T04:53:46.032 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:53:46.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.315+0000 7feec3600640 1 Processor -- start 2024-04-18T04:53:46.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.319+0000 7feec3600640 1 -- start start 2024-04-18T04:53:46.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.323+0000 7feec3600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feebc157a00 0x7feebc0c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:46.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.323+0000 7feec3600640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7feebc0c0330 0x7feebc157de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:46.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.323+0000 7feec3600640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7feebc06b660 0x7feebc06bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:46.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.323+0000 7feec0c00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feebc157a00 0x7feebc0c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:46.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.323+0000 7feec0c00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feebc157a00 0x7feebc0c69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:36088/0 (socket says 172.21.15.120:36088) 2024-04-18T04:53:46.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.323+0000 7feec0c00640 1 -- 172.21.15.120:0/29299442 learned_addr learned my addr 172.21.15.120:0/29299442 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:53:46.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.323+0000 7feec1600640 1 --2- 172.21.15.120:0/29299442 >> v2:172.21.15.132:3300/0 conn(0x7feebc06b660 0x7feebc06bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:46.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.323+0000 7feec3600640 1 -- 172.21.15.120:0/29299442 --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feebc158320 con 0x7feebc0c0330 2024-04-18T04:53:46.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.323+0000 7feec3600640 1 -- 172.21.15.120:0/29299442 --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feebc15e970 con 0x7feebc06b660 2024-04-18T04:53:46.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.323+0000 7feec3600640 1 -- 172.21.15.120:0/29299442 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feebc0c5940 con 0x7feebc157a00 2024-04-18T04:53:46.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.323+0000 7feebbe00640 1 --2- 172.21.15.120:0/29299442 >> v2:172.21.15.120:3300/0 conn(0x7feebc0c0330 0x7feebc157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:46.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.327+0000 7feec1600640 1 -- 172.21.15.120:0/29299442 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feebc157a00 msgr2=0x7feebc0c69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:53:46.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.327+0000 7feec1600640 1 --2- 172.21.15.120:0/29299442 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feebc157a00 0x7feebc0c69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:46.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.327+0000 7feec1600640 1 -- 172.21.15.120:0/29299442 >> v2:172.21.15.120:3300/0 conn(0x7feebc0c0330 msgr2=0x7feebc157de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:53:46.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.327+0000 7feec1600640 1 --2- 172.21.15.120:0/29299442 >> v2:172.21.15.120:3300/0 conn(0x7feebc0c0330 0x7feebc157de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:46.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.327+0000 7feec1600640 1 -- 172.21.15.120:0/29299442 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feebc0c5c20 con 0x7feebc06b660 2024-04-18T04:53:46.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.327+0000 7feebbe00640 1 --2- 172.21.15.120:0/29299442 >> v2:172.21.15.120:3300/0 conn(0x7feebc0c0330 0x7feebc157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:53:46.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.335+0000 7feec1600640 1 --2- 172.21.15.120:0/29299442 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feebc06b660 0x7feebc06bad0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7feebc06e440 tx=0x7feeb4041140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3750457710c0b56f server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:46.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.335+0000 7feebb400640 1 -- 172.21.15.120:0/29299442 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb40d2440 con 0x7feebc06b660 2024-04-18T04:53:46.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.335+0000 7feebb400640 1 -- 172.21.15.120:0/29299442 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb40d25a0 con 0x7feebc06b660 2024-04-18T04:53:46.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.335+0000 7feebb400640 1 -- 172.21.15.120:0/29299442 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb40d2930 con 0x7feebc06b660 2024-04-18T04:53:46.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.343+0000 7feec3600640 1 -- 172.21.15.120:0/29299442 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feebc06b660 msgr2=0x7feebc06bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:46.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.343+0000 7feec3600640 1 --2- 172.21.15.120:0/29299442 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feebc06b660 0x7feebc06bad0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7feebc06e440 tx=0x7feeb4041140 comp rx=0 tx=0).stop 2024-04-18T04:53:46.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.343+0000 7feec3600640 1 -- 172.21.15.120:0/29299442 shutdown_connections 2024-04-18T04:53:46.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.343+0000 7feec3600640 1 --2- 172.21.15.120:0/29299442 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feebc06b660 0x7feebc06bad0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:46.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.343+0000 7feec3600640 1 --2- 172.21.15.120:0/29299442 >> v2:172.21.15.120:3300/0 conn(0x7feebc0c0330 0x7feebc157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:46.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.343+0000 7feec3600640 1 --2- 172.21.15.120:0/29299442 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feebc157a00 0x7feebc0c69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:46.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.343+0000 7feec3600640 1 -- 172.21.15.120:0/29299442 >> 172.21.15.120:0/29299442 conn(0x7feebc0c78c0 msgr2=0x7feebc0c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:53:46.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.343+0000 7feec3600640 1 -- 172.21.15.120:0/29299442 shutdown_connections 2024-04-18T04:53:46.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.343+0000 7feec3600640 1 -- 172.21.15.120:0/29299442 wait complete. 2024-04-18T04:53:46.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.351+0000 7feec3600640 1 Processor -- start 2024-04-18T04:53:46.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.351+0000 7feec3600640 1 -- start start 2024-04-18T04:53:46.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.355+0000 7feec3600640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feebc06b660 0x7feebc15cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:46.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.355+0000 7feec3600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feebc0c0330 0x7feebc158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:46.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.355+0000 7feec3600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feebc157a00 0x7feebc1ec4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:46.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.355+0000 7feec3600640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feebc15a7f0 con 0x7feebc157a00 2024-04-18T04:53:46.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.355+0000 7feec3600640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feebc15aad0 con 0x7feebc06b660 2024-04-18T04:53:46.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.355+0000 7feec0c00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feebc06b660 0x7feebc15cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:46.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.355+0000 7feec0c00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feebc06b660 0x7feebc15cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:57168/0 (socket says 172.21.15.120:57168) 2024-04-18T04:53:46.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.355+0000 7feec0c00640 1 -- 172.21.15.120:0/1672702416 learned_addr learned my addr 172.21.15.120:0/1672702416 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:53:46.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.355+0000 7feebbe00640 1 --2- 172.21.15.120:0/1672702416 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feebc0c0330 0x7feebc158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:46.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.355+0000 7feec3600640 1 -- 172.21.15.120:0/1672702416 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feebc15adb0 con 0x7feebc0c0330 2024-04-18T04:53:46.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.355+0000 7feec1600640 1 --2- 172.21.15.120:0/1672702416 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feebc157a00 0x7feebc1ec4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:46.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.359+0000 7feebbe00640 1 -- 172.21.15.120:0/1672702416 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feebc06b660 msgr2=0x7feebc15cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:46.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.359+0000 7feebbe00640 1 --2- 172.21.15.120:0/1672702416 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feebc06b660 0x7feebc15cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:46.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.359+0000 7feebbe00640 1 -- 172.21.15.120:0/1672702416 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feebc157a00 msgr2=0x7feebc1ec4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:46.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.359+0000 7feebbe00640 1 --2- 172.21.15.120:0/1672702416 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feebc157a00 0x7feebc1ec4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:46.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.359+0000 7feebbe00640 1 -- 172.21.15.120:0/1672702416 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb4009a70 con 0x7feebc0c0330 2024-04-18T04:53:46.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.359+0000 7feebbe00640 1 --2- 172.21.15.120:0/1672702416 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feebc0c0330 0x7feebc158b40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7feea800e5e0 tx=0x7feea800eaa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:46.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.359+0000 7feeb8c00640 1 -- 172.21.15.120:0/1672702416 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea8004230 con 0x7feebc0c0330 2024-04-18T04:53:46.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.359+0000 7feeb8c00640 1 -- 172.21.15.120:0/1672702416 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea8004390 con 0x7feebc0c0330 2024-04-18T04:53:46.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.359+0000 7feeb8c00640 1 -- 172.21.15.120:0/1672702416 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea8003840 con 0x7feebc0c0330 2024-04-18T04:53:46.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.359+0000 7feec3600640 1 -- 172.21.15.120:0/1672702416 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feebc15b090 con 0x7feebc0c0330 2024-04-18T04:53:46.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.359+0000 7feec3600640 1 -- 172.21.15.120:0/1672702416 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feebc1ebf80 con 0x7feebc0c0330 2024-04-18T04:53:46.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.363+0000 7feec3600640 1 -- 172.21.15.120:0/1672702416 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feebc1ec170 con 0x7feebc0c0330 2024-04-18T04:53:46.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.363+0000 7feeb8c00640 1 -- 172.21.15.120:0/1672702416 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7feea80039a0 con 0x7feebc0c0330 2024-04-18T04:53:46.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.367+0000 7feeb8c00640 1 --2- 172.21.15.120:0/1672702416 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fee9c066690 0x7fee9c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:46.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.367+0000 7feeb8c00640 1 -- 172.21.15.120:0/1672702416 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7feea8084170 con 0x7feebc0c0330 2024-04-18T04:53:46.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.371+0000 7feec0c00640 1 --2- 172.21.15.120:0/1672702416 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fee9c066690 0x7fee9c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:46.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.375+0000 7feec0c00640 1 --2- 172.21.15.120:0/1672702416 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fee9c066690 0x7fee9c068b50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7feeac0094a0 tx=0x7feeac009240 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:46.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.391+0000 7feeb8c00640 1 -- 172.21.15.120:0/1672702416 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7feea8050f80 con 0x7feebc0c0330 2024-04-18T04:53:46.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.887+0000 7feec3600640 1 -- 172.21.15.120:0/1672702416 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feebc15aef0 con 0x7feebc0c0330 2024-04-18T04:53:46.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.891+0000 7feeb8c00640 1 -- 172.21.15.120:0/1672702416 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+5522 (secure 0 0 0) 0x7feebc15aef0 con 0x7feebc0c0330 2024-04-18T04:53:46.893 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:53:46.893 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":47,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:53:46.091483+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5105,"mds_1":5400},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_5105":{"gid":5105,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":14,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5400":{"gid":5400,"name":"e","rank":1,"incarnation":44,"state":"up:rejoin","state_seq":19,"addr":"172.21.15.120:6837/671327196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":671327196},{"type":"v1","addr":"172.21.15.120:6837","nonce":671327196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:53:46.893 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 47 2024-04-18T04:53:46.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.907+0000 7feec3600640 1 -- 172.21.15.120:0/1672702416 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fee9c066690 msgr2=0x7fee9c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:46.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.907+0000 7feec3600640 1 --2- 172.21.15.120:0/1672702416 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fee9c066690 0x7fee9c068b50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7feeac0094a0 tx=0x7feeac009240 comp rx=0 tx=0).stop 2024-04-18T04:53:46.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.907+0000 7feec3600640 1 -- 172.21.15.120:0/1672702416 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feebc0c0330 msgr2=0x7feebc158b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:46.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.907+0000 7feec3600640 1 --2- 172.21.15.120:0/1672702416 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feebc0c0330 0x7feebc158b40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7feea800e5e0 tx=0x7feea800eaa0 comp rx=0 tx=0).stop 2024-04-18T04:53:46.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.907+0000 7feec3600640 1 -- 172.21.15.120:0/1672702416 shutdown_connections 2024-04-18T04:53:46.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.907+0000 7feec3600640 1 --2- 172.21.15.120:0/1672702416 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fee9c066690 0x7fee9c068b50 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:46.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.907+0000 7feec3600640 1 --2- 172.21.15.120:0/1672702416 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feebc157a00 0x7feebc1ec4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:46.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.907+0000 7feec3600640 1 --2- 172.21.15.120:0/1672702416 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feebc0c0330 0x7feebc158b40 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:46.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.907+0000 7feec3600640 1 --2- 172.21.15.120:0/1672702416 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feebc06b660 0x7feebc15cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:46.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.907+0000 7feec3600640 1 -- 172.21.15.120:0/1672702416 >> 172.21.15.120:0/1672702416 conn(0x7feebc0c78c0 msgr2=0x7feebc0ca170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:53:46.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.907+0000 7feec3600640 1 -- 172.21.15.120:0/1672702416 shutdown_connections 2024-04-18T04:53:46.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:46.907+0000 7feec3600640 1 -- 172.21.15.120:0/1672702416 wait complete. 2024-04-18T04:53:46.958 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:53:48.959 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:53:49.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.227+0000 7f2b12c00640 1 Processor -- start 2024-04-18T04:53:49.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.227+0000 7f2b12c00640 1 -- start start 2024-04-18T04:53:49.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.231+0000 7f2b12c00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b0c0c71c0 0x7f2b0c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:49.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.231+0000 7f2b12c00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b0c0c6190 con 0x7f2b0c0c6de0 2024-04-18T04:53:49.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.231+0000 7f2b12200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b0c0c71c0 0x7f2b0c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:49.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.231+0000 7f2b12200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b0c0c71c0 0x7f2b0c070ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:36106/0 (socket says 172.21.15.120:36106) 2024-04-18T04:53:49.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.231+0000 7f2b12200640 1 -- 172.21.15.120:0/1071680473 learned_addr learned my addr 172.21.15.120:0/1071680473 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:53:49.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.231+0000 7f2b12c00640 1 -- 172.21.15.120:0/1071680473 --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b0c156170 con 0x7f2b0c155c80 2024-04-18T04:53:49.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.231+0000 7f2b12c00640 1 -- 172.21.15.120:0/1071680473 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0c070ff0 con 0x7f2b0c0c71c0 2024-04-18T04:53:49.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.231+0000 7f2b0be00640 1 -- 172.21.15.120:0/1071680473 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1760784802 0 0) 0x7f2b0c156170 con 0x7f2b0c155c80 2024-04-18T04:53:49.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.231+0000 7f2b0be00640 1 -- 172.21.15.120:0/1071680473 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2af4003530 con 0x7f2b0c155c80 2024-04-18T04:53:49.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.231+0000 7f2b12200640 1 -- 172.21.15.120:0/1071680473 >> v1:172.21.15.132:6789/0 conn(0x7f2b0c155c80 legacy=0x7f2b0c14f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:49.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.231+0000 7f2b12200640 1 -- 172.21.15.120:0/1071680473 >> v1:172.21.15.120:6789/0 conn(0x7f2b0c0c6de0 legacy=0x7f2b0c155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:49.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.231+0000 7f2b12200640 1 -- 172.21.15.120:0/1071680473 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b0c0c5860 con 0x7f2b0c0c71c0 2024-04-18T04:53:49.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.239+0000 7f2b12200640 1 --2- 172.21.15.120:0/1071680473 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b0c0c71c0 0x7f2b0c070ab0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2b0400c3a0 tx=0x7f2b04021840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2b74c6e351bca6d server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:49.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.239+0000 7f2b0be00640 1 -- 172.21.15.120:0/1071680473 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0400a2d0 con 0x7f2b0c0c71c0 2024-04-18T04:53:49.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.239+0000 7f2b0be00640 1 -- 172.21.15.120:0/1071680473 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b0400a430 con 0x7f2b0c0c71c0 2024-04-18T04:53:49.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.239+0000 7f2b0be00640 1 -- 172.21.15.120:0/1071680473 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0400a800 con 0x7f2b0c0c71c0 2024-04-18T04:53:49.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.243+0000 7f2b12c00640 1 -- 172.21.15.120:0/1071680473 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b0c0c71c0 msgr2=0x7f2b0c070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:49.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.243+0000 7f2b12c00640 1 --2- 172.21.15.120:0/1071680473 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b0c0c71c0 0x7f2b0c070ab0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2b0400c3a0 tx=0x7f2b04021840 comp rx=0 tx=0).stop 2024-04-18T04:53:49.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.243+0000 7f2b12c00640 1 -- 172.21.15.120:0/1071680473 shutdown_connections 2024-04-18T04:53:49.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.243+0000 7f2b12c00640 1 --2- 172.21.15.120:0/1071680473 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b0c0c71c0 0x7f2b0c070ab0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:49.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.243+0000 7f2b12c00640 1 -- 172.21.15.120:0/1071680473 >> 172.21.15.120:0/1071680473 conn(0x7f2b0c06cf90 msgr2=0x7f2b0c06d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:53:49.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.247+0000 7f2b12c00640 1 -- 172.21.15.120:0/1071680473 shutdown_connections 2024-04-18T04:53:49.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.251+0000 7f2b12c00640 1 -- 172.21.15.120:0/1071680473 wait complete. 2024-04-18T04:53:49.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.255+0000 7f2b12c00640 1 Processor -- start 2024-04-18T04:53:49.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.259+0000 7f2b12c00640 1 -- start start 2024-04-18T04:53:49.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.259+0000 7f2b12c00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b0c0c6de0 0x7f2b0c1458e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:49.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.263+0000 7f2b12c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b0c0c71c0 0x7f2b0c153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:49.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.263+0000 7f2b10e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b0c0c71c0 0x7f2b0c153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:49.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.263+0000 7f2b10e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b0c0c71c0 0x7f2b0c153ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51422/0 (socket says 172.21.15.120:51422) 2024-04-18T04:53:49.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.263+0000 7f2b11800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b0c0c6de0 0x7f2b0c1458e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:49.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.263+0000 7f2b11800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b0c0c6de0 0x7f2b0c1458e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:57184/0 (socket says 172.21.15.120:57184) 2024-04-18T04:53:49.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.263+0000 7f2b10e00640 1 -- 172.21.15.120:0/2868362318 learned_addr learned my addr 172.21.15.120:0/2868362318 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:53:49.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.263+0000 7f2b12c00640 1 --2- 172.21.15.120:0/2868362318 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b0c155c80 0x7f2b0c154420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:49.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.263+0000 7f2b12c00640 1 -- 172.21.15.120:0/2868362318 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0c153ac0 con 0x7f2b0c0c71c0 2024-04-18T04:53:49.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.263+0000 7f2b12c00640 1 -- 172.21.15.120:0/2868362318 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0c0caae0 con 0x7f2b0c0c6de0 2024-04-18T04:53:49.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.263+0000 7f2b12c00640 1 -- 172.21.15.120:0/2868362318 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0c148fc0 con 0x7f2b0c155c80 2024-04-18T04:53:49.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.263+0000 7f2b12200640 1 --2- 172.21.15.120:0/2868362318 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b0c155c80 0x7f2b0c154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:49.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.263+0000 7f2b12200640 1 -- 172.21.15.120:0/2868362318 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b0c0c6de0 msgr2=0x7f2b0c1458e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:49.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.263+0000 7f2b12200640 1 --2- 172.21.15.120:0/2868362318 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b0c0c6de0 0x7f2b0c1458e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:49.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.263+0000 7f2b12200640 1 -- 172.21.15.120:0/2868362318 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b0c0c71c0 msgr2=0x7f2b0c153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:49.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.263+0000 7f2b12200640 1 --2- 172.21.15.120:0/2868362318 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b0c0c71c0 0x7f2b0c153ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:49.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.263+0000 7f2b12200640 1 -- 172.21.15.120:0/2868362318 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b0400c050 con 0x7f2b0c155c80 2024-04-18T04:53:49.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.263+0000 7f2b12200640 1 --2- 172.21.15.120:0/2868362318 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b0c155c80 0x7f2b0c154420 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c06eeb0 tx=0x7f2b0401e5e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:49.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.267+0000 7f2b09600640 1 -- 172.21.15.120:0/2868362318 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0400a2d0 con 0x7f2b0c155c80 2024-04-18T04:53:49.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.267+0000 7f2b09600640 1 -- 172.21.15.120:0/2868362318 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b040cc070 con 0x7f2b0c155c80 2024-04-18T04:53:49.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.267+0000 7f2b09600640 1 -- 172.21.15.120:0/2868362318 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0400a2d0 con 0x7f2b0c155c80 2024-04-18T04:53:49.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.267+0000 7f2b12c00640 1 -- 172.21.15.120:0/2868362318 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b0c153070 con 0x7f2b0c155c80 2024-04-18T04:53:49.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.267+0000 7f2b12c00640 1 -- 172.21.15.120:0/2868362318 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b0c1f3e40 con 0x7f2b0c155c80 2024-04-18T04:53:49.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.267+0000 7f2b12c00640 1 -- 172.21.15.120:0/2868362318 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b0c153c00 con 0x7f2b0c155c80 2024-04-18T04:53:49.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.275+0000 7f2b09600640 1 -- 172.21.15.120:0/2868362318 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2b040d3480 con 0x7f2b0c155c80 2024-04-18T04:53:49.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.279+0000 7f2b09600640 1 --2- 172.21.15.120:0/2868362318 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2aec066750 0x7f2aec068c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:49.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.279+0000 7f2b09600640 1 -- 172.21.15.120:0/2868362318 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f2b040ce070 con 0x7f2b0c155c80 2024-04-18T04:53:49.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.279+0000 7f2b11800640 1 --2- 172.21.15.120:0/2868362318 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2aec066750 0x7f2aec068c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:49.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.283+0000 7f2b11800640 1 --2- 172.21.15.120:0/2868362318 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2aec066750 0x7f2aec068c10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2af8007fd0 tx=0x7f2af8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:49.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.287+0000 7f2b09600640 1 -- 172.21.15.120:0/2868362318 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f2b0c153c00 con 0x7f2b0c155c80 2024-04-18T04:53:49.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.663+0000 7f2b12c00640 1 -- 172.21.15.120:0/2868362318 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b0c153c00 con 0x7f2b0c155c80 2024-04-18T04:53:49.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.663+0000 7f2b09600640 1 -- 172.21.15.120:0/2868362318 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+5522 (secure 0 0 0) 0x7f2b0c153c00 con 0x7f2b0c155c80 2024-04-18T04:53:49.665 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:53:49.665 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":47,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:53:46.091483+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5105,"mds_1":5400},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_5105":{"gid":5105,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":14,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5400":{"gid":5400,"name":"e","rank":1,"incarnation":44,"state":"up:rejoin","state_seq":19,"addr":"172.21.15.120:6837/671327196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":671327196},{"type":"v1","addr":"172.21.15.120:6837","nonce":671327196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:53:49.666 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 47 2024-04-18T04:53:49.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.671+0000 7f2b12c00640 1 -- 172.21.15.120:0/2868362318 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2aec066750 msgr2=0x7f2aec068c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:49.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.671+0000 7f2b12c00640 1 --2- 172.21.15.120:0/2868362318 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2aec066750 0x7f2aec068c10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2af8007fd0 tx=0x7f2af8009040 comp rx=0 tx=0).stop 2024-04-18T04:53:49.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.671+0000 7f2b12c00640 1 -- 172.21.15.120:0/2868362318 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b0c155c80 msgr2=0x7f2b0c154420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:49.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.671+0000 7f2b12c00640 1 --2- 172.21.15.120:0/2868362318 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b0c155c80 0x7f2b0c154420 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c06eeb0 tx=0x7f2b0401e5e0 comp rx=0 tx=0).stop 2024-04-18T04:53:49.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.671+0000 7f2b12c00640 1 -- 172.21.15.120:0/2868362318 shutdown_connections 2024-04-18T04:53:49.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.671+0000 7f2b12c00640 1 --2- 172.21.15.120:0/2868362318 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2aec066750 0x7f2aec068c10 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:49.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.671+0000 7f2b12c00640 1 --2- 172.21.15.120:0/2868362318 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b0c155c80 0x7f2b0c154420 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:49.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.671+0000 7f2b12c00640 1 --2- 172.21.15.120:0/2868362318 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b0c0c71c0 0x7f2b0c153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:49.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.671+0000 7f2b12c00640 1 --2- 172.21.15.120:0/2868362318 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b0c0c6de0 0x7f2b0c1458e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:49.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.671+0000 7f2b12c00640 1 -- 172.21.15.120:0/2868362318 >> 172.21.15.120:0/2868362318 conn(0x7f2b0c06cf90 msgr2=0x7f2b0c06b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:53:49.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.671+0000 7f2b12c00640 1 -- 172.21.15.120:0/2868362318 shutdown_connections 2024-04-18T04:53:49.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:49.671+0000 7f2b12c00640 1 -- 172.21.15.120:0/2868362318 wait complete. 2024-04-18T04:53:49.716 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:53:51.717 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:53:52.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.067+0000 7ff110c00640 1 Processor -- start 2024-04-18T04:53:52.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.067+0000 7ff110c00640 1 -- start start 2024-04-18T04:53:52.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.067+0000 7ff110c00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff10c153a80 0x7ff10c0c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:52.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.067+0000 7ff110c00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff10c06cbc0 con 0x7ff10c0ad490 2024-04-18T04:53:52.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.067+0000 7ff110c00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff10c153e60 con 0x7ff10c070d60 2024-04-18T04:53:52.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.067+0000 7ff110c00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff10c06c780 con 0x7ff10c153a80 2024-04-18T04:53:52.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.067+0000 7ff109400640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff10c070d60 0x7ff10c0711b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:57916/0 (socket says 172.21.15.120:57916) 2024-04-18T04:53:52.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.067+0000 7ff109400640 1 -- 172.21.15.120:0/2132614585 learned_addr learned my addr 172.21.15.120:0/2132614585 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:53:52.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.067+0000 7ff109e00640 1 --2- 172.21.15.120:0/2132614585 >> v2:172.21.15.132:3300/0 conn(0x7ff10c153a80 0x7ff10c0c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:52.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.067+0000 7ff109e00640 1 -- 172.21.15.120:0/2132614585 >> v1:172.21.15.132:6789/0 conn(0x7ff10c070d60 legacy=0x7ff10c0711b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:52.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.067+0000 7ff109e00640 1 -- 172.21.15.120:0/2132614585 >> v1:172.21.15.120:6789/0 conn(0x7ff10c0ad490 legacy=0x7ff10c15ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:53:52.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.067+0000 7ff109e00640 1 -- 172.21.15.120:0/2132614585 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff10c06b660 con 0x7ff10c153a80 2024-04-18T04:53:52.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.067+0000 7ff108a00640 1 -- 172.21.15.120:0/2132614585 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4196676593 0 0) 0x7ff10c153e60 con 0x7ff10c070d60 2024-04-18T04:53:52.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.071+0000 7ff109e00640 1 --2- 172.21.15.120:0/2132614585 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff10c153a80 0x7ff10c0c61d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc0097c0 tx=0x7ff0fc01c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80df69b313ad767a server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:52.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.071+0000 7ff108a00640 1 -- 172.21.15.120:0/2132614585 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc0a7070 con 0x7ff10c153a80 2024-04-18T04:53:52.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.071+0000 7ff108a00640 1 -- 172.21.15.120:0/2132614585 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0fc0ab430 con 0x7ff10c153a80 2024-04-18T04:53:52.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.071+0000 7ff108a00640 1 -- 172.21.15.120:0/2132614585 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc0ab7c0 con 0x7ff10c153a80 2024-04-18T04:53:52.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.075+0000 7ff110c00640 1 -- 172.21.15.120:0/2132614585 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff10c153a80 msgr2=0x7ff10c0c61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:52.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.075+0000 7ff110c00640 1 --2- 172.21.15.120:0/2132614585 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff10c153a80 0x7ff10c0c61d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc0097c0 tx=0x7ff0fc01c430 comp rx=0 tx=0).stop 2024-04-18T04:53:52.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.075+0000 7ff110c00640 1 -- 172.21.15.120:0/2132614585 shutdown_connections 2024-04-18T04:53:52.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.075+0000 7ff110c00640 1 --2- 172.21.15.120:0/2132614585 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff10c153a80 0x7ff10c0c61d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:52.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.075+0000 7ff110c00640 1 -- 172.21.15.120:0/2132614585 >> 172.21.15.120:0/2132614585 conn(0x7ff10c0c78c0 msgr2=0x7ff10c0c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:53:52.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.075+0000 7ff110c00640 1 -- 172.21.15.120:0/2132614585 shutdown_connections 2024-04-18T04:53:52.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.075+0000 7ff110c00640 1 -- 172.21.15.120:0/2132614585 wait complete. 2024-04-18T04:53:52.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.075+0000 7ff110c00640 1 Processor -- start 2024-04-18T04:53:52.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.079+0000 7ff110c00640 1 -- start start 2024-04-18T04:53:52.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.079+0000 7ff110c00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff10c070d60 0x7ff10c1f2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:52.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.079+0000 7ff110c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff10c0ac120 0x7ff10c0aad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:52.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.079+0000 7ff110c00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff10c0b0c60 0x7ff10c0ab2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:52.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.079+0000 7ff110c00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c0aa8f0 con 0x7ff10c0ac120 2024-04-18T04:53:52.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.079+0000 7ff110c00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c1ff820 con 0x7ff10c0b0c60 2024-04-18T04:53:52.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.079+0000 7ff110c00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c0a9920 con 0x7ff10c070d60 2024-04-18T04:53:52.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.079+0000 7ff10a800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff10c0b0c60 0x7ff10c0ab2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:52.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.079+0000 7ff10a800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff10c0b0c60 0x7ff10c0ab2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:39620/0 (socket says 172.21.15.120:39620) 2024-04-18T04:53:52.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.079+0000 7ff10a800640 1 -- 172.21.15.120:0/2828339100 learned_addr learned my addr 172.21.15.120:0/2828339100 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:53:52.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.079+0000 7ff109e00640 1 --2- 172.21.15.120:0/2828339100 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff10c070d60 0x7ff10c1f2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:52.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.079+0000 7ff10a800640 1 -- 172.21.15.120:0/2828339100 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff10c070d60 msgr2=0x7ff10c1f2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:52.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.079+0000 7ff10a800640 1 --2- 172.21.15.120:0/2828339100 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff10c070d60 0x7ff10c1f2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:52.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.079+0000 7ff109400640 1 --2- 172.21.15.120:0/2828339100 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff10c0ac120 0x7ff10c0aad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:52.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.079+0000 7ff10a800640 1 -- 172.21.15.120:0/2828339100 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff10c0ac120 msgr2=0x7ff10c0aad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:52.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.079+0000 7ff10a800640 1 --2- 172.21.15.120:0/2828339100 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff10c0ac120 0x7ff10c0aad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:52.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.079+0000 7ff10a800640 1 -- 172.21.15.120:0/2828339100 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0fc009420 con 0x7ff10c0b0c60 2024-04-18T04:53:52.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.083+0000 7ff10a800640 1 --2- 172.21.15.120:0/2828339100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff10c0b0c60 0x7ff10c0ab2c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff10400b9e0 tx=0x7ff10400bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:52.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.083+0000 7ff102000640 1 -- 172.21.15.120:0/2828339100 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10400caa0 con 0x7ff10c0b0c60 2024-04-18T04:53:52.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.083+0000 7ff102000640 1 -- 172.21.15.120:0/2828339100 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff10400cc00 con 0x7ff10c0b0c60 2024-04-18T04:53:52.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.083+0000 7ff102000640 1 -- 172.21.15.120:0/2828339100 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff104014440 con 0x7ff10c0b0c60 2024-04-18T04:53:52.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.083+0000 7ff110c00640 1 -- 172.21.15.120:0/2828339100 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff10c0a9c00 con 0x7ff10c0b0c60 2024-04-18T04:53:52.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.083+0000 7ff110c00640 1 -- 172.21.15.120:0/2828339100 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff10c1ff520 con 0x7ff10c0b0c60 2024-04-18T04:53:52.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.083+0000 7ff110c00640 1 -- 172.21.15.120:0/2828339100 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff10c073e10 con 0x7ff10c0b0c60 2024-04-18T04:53:52.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.087+0000 7ff102000640 1 -- 172.21.15.120:0/2828339100 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff10401d3b0 con 0x7ff10c0b0c60 2024-04-18T04:53:52.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.087+0000 7ff102000640 1 --2- 172.21.15.120:0/2828339100 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff0ec066690 0x7ff0ec068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:52.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.087+0000 7ff102000640 1 -- 172.21.15.120:0/2828339100 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7ff104084610 con 0x7ff10c0b0c60 2024-04-18T04:53:52.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.087+0000 7ff109e00640 1 --2- 172.21.15.120:0/2828339100 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff0ec066690 0x7ff0ec068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:52.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.091+0000 7ff109e00640 1 --2- 172.21.15.120:0/2828339100 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff0ec066690 0x7ff0ec068b50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc0af000 tx=0x7ff0fc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:52.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.099+0000 7ff102000640 1 -- 172.21.15.120:0/2828339100 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7ff104051400 con 0x7ff10c0b0c60 2024-04-18T04:53:52.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.599+0000 7ff110c00640 1 -- 172.21.15.120:0/2828339100 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff10c072a70 con 0x7ff10c0b0c60 2024-04-18T04:53:52.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.603+0000 7ff102000640 1 -- 172.21.15.120:0/2828339100 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+5522 (secure 0 0 0) 0x7ff104054a20 con 0x7ff10c0b0c60 2024-04-18T04:53:52.606 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:53:52.606 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":47,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:53:46.091483+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5105,"mds_1":5400},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_5105":{"gid":5105,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":14,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5400":{"gid":5400,"name":"e","rank":1,"incarnation":44,"state":"up:rejoin","state_seq":19,"addr":"172.21.15.120:6837/671327196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":671327196},{"type":"v1","addr":"172.21.15.120:6837","nonce":671327196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:53:52.606 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 47 2024-04-18T04:53:52.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.611+0000 7ff110c00640 1 -- 172.21.15.120:0/2828339100 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff0ec066690 msgr2=0x7ff0ec068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:52.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.611+0000 7ff110c00640 1 --2- 172.21.15.120:0/2828339100 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff0ec066690 0x7ff0ec068b50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc0af000 tx=0x7ff0fc008040 comp rx=0 tx=0).stop 2024-04-18T04:53:52.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.611+0000 7ff110c00640 1 -- 172.21.15.120:0/2828339100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff10c0b0c60 msgr2=0x7ff10c0ab2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:52.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.611+0000 7ff110c00640 1 --2- 172.21.15.120:0/2828339100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff10c0b0c60 0x7ff10c0ab2c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff10400b9e0 tx=0x7ff10400bea0 comp rx=0 tx=0).stop 2024-04-18T04:53:52.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.611+0000 7ff110c00640 1 -- 172.21.15.120:0/2828339100 shutdown_connections 2024-04-18T04:53:52.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.611+0000 7ff110c00640 1 --2- 172.21.15.120:0/2828339100 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff0ec066690 0x7ff0ec068b50 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:52.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.611+0000 7ff110c00640 1 --2- 172.21.15.120:0/2828339100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff10c0b0c60 0x7ff10c0ab2c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:52.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.611+0000 7ff110c00640 1 --2- 172.21.15.120:0/2828339100 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff10c0ac120 0x7ff10c0aad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:52.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.611+0000 7ff110c00640 1 --2- 172.21.15.120:0/2828339100 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff10c070d60 0x7ff10c1f2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:52.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.611+0000 7ff110c00640 1 -- 172.21.15.120:0/2828339100 >> 172.21.15.120:0/2828339100 conn(0x7ff10c0c78c0 msgr2=0x7ff10c0ca1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:53:52.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.615+0000 7ff110c00640 1 -- 172.21.15.120:0/2828339100 shutdown_connections 2024-04-18T04:53:52.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:52.615+0000 7ff110c00640 1 -- 172.21.15.120:0/2828339100 wait complete. 2024-04-18T04:53:52.643 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:53:54.644 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:53:54.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.871+0000 7fda60600640 1 Processor -- start 2024-04-18T04:53:54.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.871+0000 7fda60600640 1 -- start start 2024-04-18T04:53:54.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.875+0000 7fda60600640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fda5806c570 0x7fda58070e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:54.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.875+0000 7fda60600640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda58071510 con 0x7fda580c7430 2024-04-18T04:53:54.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.875+0000 7fda60600640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda5806b9d0 con 0x7fda5815ae00 2024-04-18T04:53:54.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.875+0000 7fda60600640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda58070300 con 0x7fda5806c570 2024-04-18T04:53:54.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.875+0000 7fda5dc00640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fda5815ae00 0x7fda5815b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:57930/0 (socket says 172.21.15.120:57930) 2024-04-18T04:53:54.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.875+0000 7fda5dc00640 1 -- 172.21.15.120:0/1326051358 learned_addr learned my addr 172.21.15.120:0/1326051358 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:53:54.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.879+0000 7fda57e00640 1 -- 172.21.15.120:0/1326051358 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4251749428 0 0) 0x7fda5806b9d0 con 0x7fda5815ae00 2024-04-18T04:53:54.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.879+0000 7fda57e00640 1 -- 172.21.15.120:0/1326051358 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda40003530 con 0x7fda5815ae00 2024-04-18T04:53:54.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.879+0000 7fda57e00640 1 -- 172.21.15.120:0/1326051358 <== mon.1 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1764124545 0 0) 0x7fda40003530 con 0x7fda5815ae00 2024-04-18T04:53:54.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.879+0000 7fda5e600640 1 --2- 172.21.15.120:0/1326051358 >> v2:172.21.15.120:3300/0 conn(0x7fda5806c570 0x7fda58070e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:54.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.879+0000 7fda57e00640 1 -- 172.21.15.120:0/1326051358 >> v2:172.21.15.120:3300/0 conn(0x7fda5806c570 msgr2=0x7fda58070e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:53:54.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.879+0000 7fda57e00640 1 --2- 172.21.15.120:0/1326051358 >> v2:172.21.15.120:3300/0 conn(0x7fda5806c570 0x7fda58070e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:54.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.879+0000 7fda57e00640 1 -- 172.21.15.120:0/1326051358 >> v1:172.21.15.120:6789/0 conn(0x7fda580c7430 legacy=0x7fda5806be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:53:54.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.883+0000 7fda57e00640 1 -- 172.21.15.120:0/1326051358 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5815b8f0 con 0x7fda5815ae00 2024-04-18T04:53:54.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.883+0000 7fda57e00640 1 -- 172.21.15.120:0/1326051358 <== mon.1 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7fda44001680 con 0x7fda5815ae00 2024-04-18T04:53:54.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.883+0000 7fda57e00640 1 -- 172.21.15.120:0/1326051358 >> v1:172.21.15.132:6789/0 conn(0x7fda5815ae00 legacy=0x7fda5815b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:54.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.883+0000 7fda57e00640 1 --2- 172.21.15.120:0/1326051358 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda40003980 0x7fda40003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:54.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.883+0000 7fda57e00640 1 --2- 172.21.15.120:0/1326051358 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fda400047d0 0x7fda40004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:54.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.883+0000 7fda57e00640 1 --2- 172.21.15.120:0/1326051358 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda400052b0 0x7fda4000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:54.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.883+0000 7fda57e00640 1 -- 172.21.15.120:0/1326051358 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4000c180 con 0x7fda40003980 2024-04-18T04:53:54.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.883+0000 7fda57e00640 1 -- 172.21.15.120:0/1326051358 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4000c2f0 con 0x7fda400052b0 2024-04-18T04:53:54.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.883+0000 7fda57e00640 1 -- 172.21.15.120:0/1326051358 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda4000c4b0 con 0x7fda400047d0 2024-04-18T04:53:54.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.883+0000 7fda5d200640 1 --2- 172.21.15.120:0/1326051358 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fda400047d0 0x7fda40004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:54.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.883+0000 7fda5dc00640 1 --2- 172.21.15.120:0/1326051358 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda40003980 0x7fda40003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:54.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.887+0000 7fda5d200640 1 -- 172.21.15.120:0/1326051358 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda400052b0 msgr2=0x7fda4000b990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:53:54.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.887+0000 7fda5d200640 1 --2- 172.21.15.120:0/1326051358 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda400052b0 0x7fda4000b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:54.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.887+0000 7fda5d200640 1 -- 172.21.15.120:0/1326051358 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda40003980 msgr2=0x7fda40003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:53:54.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.887+0000 7fda5d200640 1 --2- 172.21.15.120:0/1326051358 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda40003980 0x7fda40003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:54.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.887+0000 7fda5d200640 1 -- 172.21.15.120:0/1326051358 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5815b8f0 con 0x7fda400047d0 2024-04-18T04:53:54.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.887+0000 7fda5e600640 1 --2- 172.21.15.120:0/1326051358 >> v2:172.21.15.120:3300/0 conn(0x7fda5806c570 0x7fda58070e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:53:54.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.887+0000 7fda5e600640 1 -- 172.21.15.120:0/1326051358 reap_dead start 2024-04-18T04:53:54.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.895+0000 7fda5d200640 1 --2- 172.21.15.120:0/1326051358 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fda400047d0 0x7fda40004c50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fda4c007fd0 tx=0x7fda4c01c270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33ed1ea9593c520f server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:54.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.895+0000 7fda57e00640 1 -- 172.21.15.120:0/1326051358 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c005070 con 0x7fda400047d0 2024-04-18T04:53:54.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.895+0000 7fda57e00640 1 -- 172.21.15.120:0/1326051358 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4c0a7070 con 0x7fda400047d0 2024-04-18T04:53:54.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.895+0000 7fda57e00640 1 -- 172.21.15.120:0/1326051358 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c005470 con 0x7fda400047d0 2024-04-18T04:53:54.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.895+0000 7fda60600640 1 -- 172.21.15.120:0/1326051358 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fda400047d0 msgr2=0x7fda40004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:54.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.895+0000 7fda60600640 1 --2- 172.21.15.120:0/1326051358 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fda400047d0 0x7fda40004c50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fda4c007fd0 tx=0x7fda4c01c270 comp rx=0 tx=0).stop 2024-04-18T04:53:54.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.895+0000 7fda60600640 1 -- 172.21.15.120:0/1326051358 shutdown_connections 2024-04-18T04:53:54.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.895+0000 7fda60600640 1 --2- 172.21.15.120:0/1326051358 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fda400047d0 0x7fda40004c50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:54.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.895+0000 7fda60600640 1 -- 172.21.15.120:0/1326051358 >> 172.21.15.120:0/1326051358 conn(0x7fda580c78c0 msgr2=0x7fda580c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:53:54.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.899+0000 7fda60600640 1 -- 172.21.15.120:0/1326051358 shutdown_connections 2024-04-18T04:53:54.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.899+0000 7fda60600640 1 -- 172.21.15.120:0/1326051358 wait complete. 2024-04-18T04:53:54.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.899+0000 7fda60600640 1 Processor -- start 2024-04-18T04:53:54.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.903+0000 7fda60600640 1 -- start start 2024-04-18T04:53:54.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.911+0000 7fda60600640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda400047d0 0x7fda58152710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:54.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.911+0000 7fda60600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda580c5710 0x7fda580c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:54.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.911+0000 7fda60600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fda580c5b50 0x7fda580c27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:54.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.911+0000 7fda60600640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda58152250 con 0x7fda580c5710 2024-04-18T04:53:54.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.911+0000 7fda60600640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda581536b0 con 0x7fda400047d0 2024-04-18T04:53:54.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.911+0000 7fda60600640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda581f0940 con 0x7fda580c5b50 2024-04-18T04:53:54.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.911+0000 7fda5dc00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda400047d0 0x7fda58152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:54.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.911+0000 7fda5dc00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda400047d0 0x7fda58152710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:39628/0 (socket says 172.21.15.120:39628) 2024-04-18T04:53:54.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.911+0000 7fda5dc00640 1 -- 172.21.15.120:0/2212502682 learned_addr learned my addr 172.21.15.120:0/2212502682 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:53:54.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.911+0000 7fda5e600640 1 --2- 172.21.15.120:0/2212502682 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fda580c5b50 0x7fda580c27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:54.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.915+0000 7fda5e600640 1 -- 172.21.15.120:0/2212502682 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda400047d0 msgr2=0x7fda58152710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:54.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.915+0000 7fda5e600640 1 --2- 172.21.15.120:0/2212502682 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda400047d0 0x7fda58152710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:54.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.915+0000 7fda5e600640 1 -- 172.21.15.120:0/2212502682 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda580c5710 msgr2=0x7fda580c3cc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:53:54.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.915+0000 7fda5e600640 1 --2- 172.21.15.120:0/2212502682 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda580c5710 0x7fda580c3cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:54.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.915+0000 7fda5e600640 1 -- 172.21.15.120:0/2212502682 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda581efa70 con 0x7fda580c5b50 2024-04-18T04:53:54.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.915+0000 7fda5e600640 1 --2- 172.21.15.120:0/2212502682 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fda580c5b50 0x7fda580c27a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fda58073f20 tx=0x7fda5000a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:54.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.915+0000 7fda55600640 1 -- 172.21.15.120:0/2212502682 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda50026440 con 0x7fda580c5b50 2024-04-18T04:53:54.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.915+0000 7fda55600640 1 -- 172.21.15.120:0/2212502682 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda500265c0 con 0x7fda580c5b50 2024-04-18T04:53:54.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.915+0000 7fda55600640 1 -- 172.21.15.120:0/2212502682 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda50026970 con 0x7fda580c5b50 2024-04-18T04:53:54.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.915+0000 7fda60600640 1 -- 172.21.15.120:0/2212502682 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda581efd30 con 0x7fda580c5b50 2024-04-18T04:53:54.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.915+0000 7fda60600640 1 -- 172.21.15.120:0/2212502682 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda581f02f0 con 0x7fda580c5b50 2024-04-18T04:53:54.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.923+0000 7fda60600640 1 -- 172.21.15.120:0/2212502682 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda58072a70 con 0x7fda580c5b50 2024-04-18T04:53:54.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.923+0000 7fda55600640 1 -- 172.21.15.120:0/2212502682 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fda5001e440 con 0x7fda580c5b50 2024-04-18T04:53:54.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.927+0000 7fda55600640 1 --2- 172.21.15.120:0/2212502682 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fda38066760 0x7fda38068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:54.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.927+0000 7fda5dc00640 1 --2- 172.21.15.120:0/2212502682 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fda38066760 0x7fda38068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:54.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.931+0000 7fda55600640 1 -- 172.21.15.120:0/2212502682 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7fda50095bf0 con 0x7fda580c5b50 2024-04-18T04:53:54.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.935+0000 7fda55600640 1 -- 172.21.15.120:0/2212502682 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fda50062a80 con 0x7fda580c5b50 2024-04-18T04:53:54.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:54.955+0000 7fda5dc00640 1 --2- 172.21.15.120:0/2212502682 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fda38066760 0x7fda38068c20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fda44001ec0 tx=0x7fda44009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:55.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:55.323+0000 7fda60600640 1 -- 172.21.15.120:0/2212502682 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda5806fc40 con 0x7fda580c5b50 2024-04-18T04:53:55.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:55.323+0000 7fda55600640 1 -- 172.21.15.120:0/2212502682 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+5522 (secure 0 0 0) 0x7fda5002b020 con 0x7fda580c5b50 2024-04-18T04:53:55.324 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:53:55.324 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":47,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:53:46.091483+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5105,"mds_1":5400},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_5105":{"gid":5105,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":14,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5400":{"gid":5400,"name":"e","rank":1,"incarnation":44,"state":"up:rejoin","state_seq":19,"addr":"172.21.15.120:6837/671327196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":671327196},{"type":"v1","addr":"172.21.15.120:6837","nonce":671327196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:53:55.325 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 47 2024-04-18T04:53:55.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:55.327+0000 7fda60600640 1 -- 172.21.15.120:0/2212502682 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fda38066760 msgr2=0x7fda38068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:55.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:55.327+0000 7fda60600640 1 --2- 172.21.15.120:0/2212502682 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fda38066760 0x7fda38068c20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fda44001ec0 tx=0x7fda44009040 comp rx=0 tx=0).stop 2024-04-18T04:53:55.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:55.327+0000 7fda60600640 1 -- 172.21.15.120:0/2212502682 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fda580c5b50 msgr2=0x7fda580c27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:55.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:55.327+0000 7fda60600640 1 --2- 172.21.15.120:0/2212502682 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fda580c5b50 0x7fda580c27a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fda58073f20 tx=0x7fda5000a340 comp rx=0 tx=0).stop 2024-04-18T04:53:55.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:55.327+0000 7fda60600640 1 -- 172.21.15.120:0/2212502682 shutdown_connections 2024-04-18T04:53:55.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:55.327+0000 7fda60600640 1 --2- 172.21.15.120:0/2212502682 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fda38066760 0x7fda38068c20 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:55.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:55.327+0000 7fda60600640 1 --2- 172.21.15.120:0/2212502682 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fda580c5b50 0x7fda580c27a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:55.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:55.327+0000 7fda60600640 1 --2- 172.21.15.120:0/2212502682 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda580c5710 0x7fda580c3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:55.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:55.327+0000 7fda60600640 1 --2- 172.21.15.120:0/2212502682 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda400047d0 0x7fda58152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:55.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:55.327+0000 7fda60600640 1 -- 172.21.15.120:0/2212502682 >> 172.21.15.120:0/2212502682 conn(0x7fda580c78c0 msgr2=0x7fda580c9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:53:55.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:55.331+0000 7fda60600640 1 -- 172.21.15.120:0/2212502682 shutdown_connections 2024-04-18T04:53:55.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:55.331+0000 7fda60600640 1 -- 172.21.15.120:0/2212502682 wait complete. 2024-04-18T04:53:55.376 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:53:57.377 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:53:57.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.631+0000 7f978ea00640 1 Processor -- start 2024-04-18T04:53:57.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.631+0000 7f978ea00640 1 -- start start 2024-04-18T04:53:57.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.635+0000 7f978ea00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f97880c2000 0x7f978815a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:57.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.635+0000 7f978ea00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9788157e20 0x7f978806d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:57.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.635+0000 7f978ea00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9788157990 con 0x7f97881513c0 2024-04-18T04:53:57.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.635+0000 7f978ea00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9788158290 con 0x7f9788157e20 2024-04-18T04:53:57.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.635+0000 7f978ea00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f978806ed90 con 0x7f97880c2000 2024-04-18T04:53:57.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.635+0000 7f978cc00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f97880c2000 0x7f978815a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:57.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.635+0000 7f978d600640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f97881513c0 0x7f978806e680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:59936/0 (socket says 172.21.15.120:59936) 2024-04-18T04:53:57.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.635+0000 7f978d600640 1 -- 172.21.15.120:0/2182472772 learned_addr learned my addr 172.21.15.120:0/2182472772 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:53:57.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.635+0000 7f9787e00640 1 -- 172.21.15.120:0/2182472772 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 23552300 0 0) 0x7f9788157990 con 0x7f97881513c0 2024-04-18T04:53:57.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.635+0000 7f978e000640 1 --2- 172.21.15.120:0/2182472772 >> v2:172.21.15.120:3300/0 conn(0x7f9788157e20 0x7f978806d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:57.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.639+0000 7f9787e00640 1 -- 172.21.15.120:0/2182472772 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9770003530 con 0x7f97881513c0 2024-04-18T04:53:57.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.639+0000 7f978cc00640 1 -- 172.21.15.120:0/2182472772 >> v2:172.21.15.120:3300/0 conn(0x7f9788157e20 msgr2=0x7f978806d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:53:57.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.639+0000 7f978cc00640 1 --2- 172.21.15.120:0/2182472772 >> v2:172.21.15.120:3300/0 conn(0x7f9788157e20 0x7f978806d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:57.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.639+0000 7f978cc00640 1 -- 172.21.15.120:0/2182472772 >> v1:172.21.15.120:6789/0 conn(0x7f97881513c0 legacy=0x7f978806e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:57.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.639+0000 7f978cc00640 1 -- 172.21.15.120:0/2182472772 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97881517a0 con 0x7f97880c2000 2024-04-18T04:53:57.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.639+0000 7f978e000640 1 --2- 172.21.15.120:0/2182472772 >> v2:172.21.15.120:3300/0 conn(0x7f9788157e20 0x7f978806d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:53:57.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.647+0000 7f978cc00640 1 --2- 172.21.15.120:0/2182472772 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97880c2000 0x7f978815a8c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f97880703e0 tx=0x7f9774020820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ed49be6f53e101d server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:57.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.647+0000 7f9787e00640 1 -- 172.21.15.120:0/2182472772 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97740aa500 con 0x7f97880c2000 2024-04-18T04:53:57.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.647+0000 7f9787e00640 1 -- 172.21.15.120:0/2182472772 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97740aa660 con 0x7f97880c2000 2024-04-18T04:53:57.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.647+0000 7f9787e00640 1 -- 172.21.15.120:0/2182472772 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97740aa9f0 con 0x7f97880c2000 2024-04-18T04:53:57.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.647+0000 7f978ea00640 1 -- 172.21.15.120:0/2182472772 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97880c2000 msgr2=0x7f978815a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:57.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.647+0000 7f978ea00640 1 --2- 172.21.15.120:0/2182472772 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97880c2000 0x7f978815a8c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f97880703e0 tx=0x7f9774020820 comp rx=0 tx=0).stop 2024-04-18T04:53:57.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.651+0000 7f978ea00640 1 -- 172.21.15.120:0/2182472772 shutdown_connections 2024-04-18T04:53:57.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.651+0000 7f978ea00640 1 --2- 172.21.15.120:0/2182472772 >> v2:172.21.15.120:3300/0 conn(0x7f9788157e20 0x7f978806d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:57.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.651+0000 7f978ea00640 1 --2- 172.21.15.120:0/2182472772 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97880c2000 0x7f978815a8c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:57.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.651+0000 7f978ea00640 1 -- 172.21.15.120:0/2182472772 >> 172.21.15.120:0/2182472772 conn(0x7f97880720a0 msgr2=0x7f9788065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:53:57.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.651+0000 7f978ea00640 1 -- 172.21.15.120:0/2182472772 shutdown_connections 2024-04-18T04:53:57.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.651+0000 7f978ea00640 1 -- 172.21.15.120:0/2182472772 wait complete. 2024-04-18T04:53:57.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.663+0000 7f978ea00640 1 Processor -- start 2024-04-18T04:53:57.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.671+0000 7f978ea00640 1 -- start start 2024-04-18T04:53:57.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.671+0000 7f978ea00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97880c2000 0x7f978813d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:57.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.671+0000 7f978ea00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97881513c0 0x7f97881f9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:57.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.671+0000 7f978ea00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9788157e20 0x7f97881f9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:57.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.671+0000 7f978ea00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f978813f100 con 0x7f97881513c0 2024-04-18T04:53:57.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.671+0000 7f978ea00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f978813f3c0 con 0x7f97880c2000 2024-04-18T04:53:57.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.671+0000 7f978ea00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f978813f6a0 con 0x7f9788157e20 2024-04-18T04:53:57.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.671+0000 7f978e000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9788157e20 0x7f97881f9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:57.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.671+0000 7f978e000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9788157e20 0x7f97881f9a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:36720/0 (socket says 172.21.15.120:36720) 2024-04-18T04:53:57.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.671+0000 7f978e000640 1 -- 172.21.15.120:0/3821898203 learned_addr learned my addr 172.21.15.120:0/3821898203 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:53:57.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.675+0000 7f978e000640 1 -- 172.21.15.120:0/3821898203 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97880c2000 msgr2=0x7f978813d720 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-18T04:53:57.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.675+0000 7f978e000640 1 --2- 172.21.15.120:0/3821898203 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97880c2000 0x7f978813d720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:57.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.675+0000 7f978e000640 1 -- 172.21.15.120:0/3821898203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97881513c0 msgr2=0x7f97881f9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:57.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.675+0000 7f978e000640 1 --2- 172.21.15.120:0/3821898203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97881513c0 0x7f97881f9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:57.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.675+0000 7f978e000640 1 -- 172.21.15.120:0/3821898203 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9774009420 con 0x7f9788157e20 2024-04-18T04:53:57.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.675+0000 7f978e000640 1 --2- 172.21.15.120:0/3821898203 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9788157e20 0x7f97881f9a90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f978000cd50 tx=0x7f978000a650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:57.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.675+0000 7f9785600640 1 -- 172.21.15.120:0/3821898203 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978000f680 con 0x7f9788157e20 2024-04-18T04:53:57.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.675+0000 7f9785600640 1 -- 172.21.15.120:0/3821898203 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978000f800 con 0x7f9788157e20 2024-04-18T04:53:57.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.675+0000 7f9785600640 1 -- 172.21.15.120:0/3821898203 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978000fbb0 con 0x7f9788157e20 2024-04-18T04:53:57.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.679+0000 7f978ea00640 1 -- 172.21.15.120:0/3821898203 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9788151ba0 con 0x7f9788157e20 2024-04-18T04:53:57.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.679+0000 7f978ea00640 1 -- 172.21.15.120:0/3821898203 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9788152160 con 0x7f9788157e20 2024-04-18T04:53:57.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.679+0000 7f978ea00640 1 -- 172.21.15.120:0/3821898203 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97880c9960 con 0x7f9788157e20 2024-04-18T04:53:57.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.683+0000 7f9785600640 1 -- 172.21.15.120:0/3821898203 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f978000b040 con 0x7f9788157e20 2024-04-18T04:53:57.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.683+0000 7f9785600640 1 --2- 172.21.15.120:0/3821898203 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f97680666e0 0x7f9768068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:53:57.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.683+0000 7f9785600640 1 -- 172.21.15.120:0/3821898203 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f9780085190 con 0x7f9788157e20 2024-04-18T04:53:57.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.683+0000 7f978d600640 1 --2- 172.21.15.120:0/3821898203 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f97680666e0 0x7f9768068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:53:57.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.683+0000 7f978d600640 1 --2- 172.21.15.120:0/3821898203 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f97680666e0 0x7f9768068ba0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f977c007fd0 tx=0x7f977c0078c0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:53:57.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.691+0000 7f9785600640 1 -- 172.21.15.120:0/3821898203 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f9780051f60 con 0x7f9788157e20 2024-04-18T04:53:57.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.899+0000 7f978ea00640 1 -- 172.21.15.120:0/3821898203 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9788067070 con 0x7f9788157e20 2024-04-18T04:53:57.899 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:53:57.899 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":47,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:53:46.091483+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5105,"mds_1":5400},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_5105":{"gid":5105,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":14,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5400":{"gid":5400,"name":"e","rank":1,"incarnation":44,"state":"up:rejoin","state_seq":19,"addr":"172.21.15.120:6837/671327196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":671327196},{"type":"v1","addr":"172.21.15.120:6837","nonce":671327196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:53:57.900 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 47 2024-04-18T04:53:58.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.899+0000 7f9785600640 1 -- 172.21.15.120:0/3821898203 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+5522 (secure 0 0 0) 0x7f9780055580 con 0x7f9788157e20 2024-04-18T04:53:58.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.903+0000 7f978ea00640 1 -- 172.21.15.120:0/3821898203 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f97680666e0 msgr2=0x7f9768068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:58.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.903+0000 7f978ea00640 1 --2- 172.21.15.120:0/3821898203 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f97680666e0 0x7f9768068ba0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f977c007fd0 tx=0x7f977c0078c0 comp rx=0 tx=0).stop 2024-04-18T04:53:58.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.903+0000 7f978ea00640 1 -- 172.21.15.120:0/3821898203 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9788157e20 msgr2=0x7f97881f9a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:53:58.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.903+0000 7f978ea00640 1 --2- 172.21.15.120:0/3821898203 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9788157e20 0x7f97881f9a90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f978000cd50 tx=0x7f978000a650 comp rx=0 tx=0).stop 2024-04-18T04:53:58.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.903+0000 7f978ea00640 1 -- 172.21.15.120:0/3821898203 shutdown_connections 2024-04-18T04:53:58.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.903+0000 7f978ea00640 1 --2- 172.21.15.120:0/3821898203 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f97680666e0 0x7f9768068ba0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:58.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.903+0000 7f978ea00640 1 --2- 172.21.15.120:0/3821898203 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9788157e20 0x7f97881f9a90 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:58.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.903+0000 7f978ea00640 1 --2- 172.21.15.120:0/3821898203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97881513c0 0x7f97881f9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:58.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.903+0000 7f978ea00640 1 --2- 172.21.15.120:0/3821898203 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97880c2000 0x7f978813d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:53:58.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.903+0000 7f978ea00640 1 -- 172.21.15.120:0/3821898203 >> 172.21.15.120:0/3821898203 conn(0x7f97880720a0 msgr2=0x7f97880cb020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:53:58.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.903+0000 7f978ea00640 1 -- 172.21.15.120:0/3821898203 shutdown_connections 2024-04-18T04:53:58.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:53:57.903+0000 7f978ea00640 1 -- 172.21.15.120:0/3821898203 wait complete. 2024-04-18T04:53:58.049 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 47, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-18T04:44:30.251235+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 47, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1 ], "info": { "gid_5105": { "addr": "172.21.15.120:6833/3842815393", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6832", "nonce": 3842815393, "type": "v2" }, { "addr": "172.21.15.120:6833", "nonce": 3842815393, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5105, "incarnation": 38, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 14 }, "gid_5400": { "addr": "172.21.15.120:6837/671327196", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6835", "nonce": 671327196, "type": "v2" }, { "addr": "172.21.15.120:6837", "nonce": 671327196, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5400, "incarnation": 44, "join_fscid": -1, "name": "e", "rank": 1, "state": "up:rejoin", "state_seq": 19 } }, "last_failure": 0, "last_failure_osd_epoch": 32, "max_file_size": 1099511627776, "max_mds": 2, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-18T04:53:46.091483+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [ 2 ], "tableserver": 0, "up": { "mds_0": 5105, "mds_1": 5400 } } } ], "standbys": [ { "addr": "172.21.15.132:6839/4292136288", "addrs": { "addrvec": [ { "addr": "172.21.15.132:6836", "nonce": 4292136288, "type": "v2" }, { "addr": "172.21.15.132:6839", "nonce": 4292136288, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4241, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.132:6838/1712856922", "addrs": { "addrvec": [ { "addr": "172.21.15.132:6837", "nonce": 1712856922, "type": "v2" }, { "addr": "172.21.15.132:6838", "nonce": 1712856922, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 2, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4244, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.120:6836/2384594941", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6834", "nonce": 2384594941, "type": "v2" }, { "addr": "172.21.15.120:6836", "nonce": 2384594941, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 33, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5051, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-18T04:54:00.050 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:54:00.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.323+0000 7f51c6000640 1 Processor -- start 2024-04-18T04:54:00.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.323+0000 7f51c6000640 1 -- start start 2024-04-18T04:54:00.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.327+0000 7f51c6000640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f51c00c69e0 0x7f51c00c0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:00.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.327+0000 7f51c6000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f51c0157de0 0x7f51c006bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:00.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.327+0000 7f51c6000640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51c015e970 con 0x7f51c0157a00 2024-04-18T04:54:00.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.327+0000 7f51c6000640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51c0162170 con 0x7f51c00c69e0 2024-04-18T04:54:00.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.327+0000 7f51c6000640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c00c5940 con 0x7f51c0157de0 2024-04-18T04:54:00.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.327+0000 7f51b7e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f51c00c69e0 0x7f51c00c0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:00.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.327+0000 7f51b7e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f51c00c69e0 0x7f51c00c0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34706/0 (socket says 172.21.15.120:34706) 2024-04-18T04:54:00.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.327+0000 7f51b7e00640 1 -- 172.21.15.120:0/4061033557 learned_addr learned my addr 172.21.15.120:0/4061033557 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:54:00.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.327+0000 7f51bfe00640 1 --2- 172.21.15.120:0/4061033557 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f51c0157de0 0x7f51c006bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:00.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.327+0000 7f51bfe00640 1 -- 172.21.15.120:0/4061033557 >> v2:172.21.15.120:3300/0 conn(0x7f51c00c69e0 msgr2=0x7f51c00c0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:00.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.327+0000 7f51bfe00640 1 --2- 172.21.15.120:0/4061033557 >> v2:172.21.15.120:3300/0 conn(0x7f51c00c69e0 0x7f51c00c0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:00.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.327+0000 7f51bfe00640 1 -- 172.21.15.120:0/4061033557 >> v1:172.21.15.132:6789/0 conn(0x7f51c0157a00 legacy=0x7f51c006b660 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-18T04:54:00.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.327+0000 7f51bfe00640 1 -- 172.21.15.120:0/4061033557 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c00c5c20 con 0x7f51c0157de0 2024-04-18T04:54:00.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.331+0000 7f51b7e00640 1 --2- 172.21.15.120:0/4061033557 >> v2:172.21.15.120:3300/0 conn(0x7f51c00c69e0 0x7f51c00c0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:54:00.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.335+0000 7f51bfe00640 1 --2- 172.21.15.120:0/4061033557 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f51c0157de0 0x7f51c006bd70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f51b8009d90 tx=0x7f51b801f140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=592c053ccd691cb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:00.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.335+0000 7f51bea00640 1 -- 172.21.15.120:0/4061033557 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b80b0440 con 0x7f51c0157de0 2024-04-18T04:54:00.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.335+0000 7f51bea00640 1 -- 172.21.15.120:0/4061033557 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b80b05a0 con 0x7f51c0157de0 2024-04-18T04:54:00.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.339+0000 7f51bea00640 1 -- 172.21.15.120:0/4061033557 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b80b0930 con 0x7f51c0157de0 2024-04-18T04:54:00.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.339+0000 7f51c6000640 1 -- 172.21.15.120:0/4061033557 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f51c0157de0 msgr2=0x7f51c006bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:00.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.339+0000 7f51c6000640 1 --2- 172.21.15.120:0/4061033557 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f51c0157de0 0x7f51c006bd70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f51b8009d90 tx=0x7f51b801f140 comp rx=0 tx=0).stop 2024-04-18T04:54:00.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.339+0000 7f51c6000640 1 -- 172.21.15.120:0/4061033557 shutdown_connections 2024-04-18T04:54:00.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.339+0000 7f51c6000640 1 --2- 172.21.15.120:0/4061033557 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f51c0157de0 0x7f51c006bd70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:00.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.339+0000 7f51c6000640 1 --2- 172.21.15.120:0/4061033557 >> v2:172.21.15.120:3300/0 conn(0x7f51c00c69e0 0x7f51c00c0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:00.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.339+0000 7f51c6000640 1 -- 172.21.15.120:0/4061033557 >> 172.21.15.120:0/4061033557 conn(0x7f51c00c78c0 msgr2=0x7f51c00c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:00.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.339+0000 7f51c6000640 1 -- 172.21.15.120:0/4061033557 shutdown_connections 2024-04-18T04:54:00.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.339+0000 7f51c6000640 1 -- 172.21.15.120:0/4061033557 wait complete. 2024-04-18T04:54:00.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.343+0000 7f51c6000640 1 Processor -- start 2024-04-18T04:54:00.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.351+0000 7f51c6000640 1 -- start start 2024-04-18T04:54:00.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.351+0000 7f51c6000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f51c00c69e0 0x7f51c0154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:00.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.351+0000 7f51c6000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51c0157a00 0x7f51c01f17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:00.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.351+0000 7f51c6000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51c0157de0 0x7f51c0155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:00.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.351+0000 7f51c6000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c015d270 con 0x7f51c0157de0 2024-04-18T04:54:00.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.351+0000 7f51c6000640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c0161ff0 con 0x7f51c0157a00 2024-04-18T04:54:00.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.351+0000 7f51c6000640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c0161a70 con 0x7f51c00c69e0 2024-04-18T04:54:00.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.351+0000 7f51bf400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f51c00c69e0 0x7f51c0154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:00.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.351+0000 7f51bf400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f51c00c69e0 0x7f51c0154160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:36724/0 (socket says 172.21.15.120:36724) 2024-04-18T04:54:00.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.355+0000 7f51bf400640 1 -- 172.21.15.120:0/731358705 learned_addr learned my addr 172.21.15.120:0/731358705 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:54:00.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.355+0000 7f51bf400640 1 -- 172.21.15.120:0/731358705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51c0157a00 msgr2=0x7f51c01f17c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:54:00.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.355+0000 7f51bf400640 1 --2- 172.21.15.120:0/731358705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51c0157a00 0x7f51c01f17c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:00.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.355+0000 7f51bf400640 1 -- 172.21.15.120:0/731358705 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51c0157de0 msgr2=0x7f51c0155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:00.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.355+0000 7f51bf400640 1 --2- 172.21.15.120:0/731358705 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51c0157de0 0x7f51c0155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:00.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.355+0000 7f51bf400640 1 -- 172.21.15.120:0/731358705 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a80094d0 con 0x7f51c00c69e0 2024-04-18T04:54:00.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.355+0000 7f51bf400640 1 --2- 172.21.15.120:0/731358705 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f51c00c69e0 0x7f51c0154160 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f51b000b410 tx=0x7f51b000b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:00.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.355+0000 7f51b7400640 1 -- 172.21.15.120:0/731358705 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b0011830 con 0x7f51c00c69e0 2024-04-18T04:54:00.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.355+0000 7f51b7400640 1 -- 172.21.15.120:0/731358705 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b0011990 con 0x7f51c00c69e0 2024-04-18T04:54:00.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.355+0000 7f51b7400640 1 -- 172.21.15.120:0/731358705 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b0011d40 con 0x7f51c00c69e0 2024-04-18T04:54:00.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.355+0000 7f51c6000640 1 -- 172.21.15.120:0/731358705 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51b8009a70 con 0x7f51c00c69e0 2024-04-18T04:54:00.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.355+0000 7f51c6000640 1 -- 172.21.15.120:0/731358705 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51c0155d40 con 0x7f51c00c69e0 2024-04-18T04:54:00.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.359+0000 7f51c6000640 1 -- 172.21.15.120:0/731358705 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51c0153fb0 con 0x7f51c00c69e0 2024-04-18T04:54:00.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.359+0000 7f51b7400640 1 -- 172.21.15.120:0/731358705 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f51b001a400 con 0x7f51c00c69e0 2024-04-18T04:54:00.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.359+0000 7f51b7400640 1 --2- 172.21.15.120:0/731358705 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f519c066760 0x7f519c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:00.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.363+0000 7f51b7400640 1 -- 172.21.15.120:0/731358705 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f51b0084840 con 0x7f51c00c69e0 2024-04-18T04:54:00.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.363+0000 7f51b7e00640 1 --2- 172.21.15.120:0/731358705 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f519c066760 0x7f519c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:00.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.363+0000 7f51b7e00640 1 --2- 172.21.15.120:0/731358705 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f519c066760 0x7f519c068c20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f51c006e160 tx=0x7f51a8009240 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:00.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.371+0000 7f51b7400640 1 -- 172.21.15.120:0/731358705 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f51b0051620 con 0x7f51c00c69e0 2024-04-18T04:54:00.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.783+0000 7f51c6000640 1 -- 172.21.15.120:0/731358705 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51c0153da0 con 0x7f51c00c69e0 2024-04-18T04:54:00.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.783+0000 7f51b7400640 1 -- 172.21.15.120:0/731358705 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+5522 (secure 0 0 0) 0x7f51b0054c40 con 0x7f51c00c69e0 2024-04-18T04:54:00.785 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:54:00.785 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":47,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:53:46.091483+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5105,"mds_1":5400},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_5105":{"gid":5105,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":14,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5400":{"gid":5400,"name":"e","rank":1,"incarnation":44,"state":"up:rejoin","state_seq":19,"addr":"172.21.15.120:6837/671327196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":671327196},{"type":"v1","addr":"172.21.15.120:6837","nonce":671327196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:54:00.785 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 47 2024-04-18T04:54:00.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.795+0000 7f51c6000640 1 -- 172.21.15.120:0/731358705 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f519c066760 msgr2=0x7f519c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:00.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.795+0000 7f51c6000640 1 --2- 172.21.15.120:0/731358705 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f519c066760 0x7f519c068c20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f51c006e160 tx=0x7f51a8009240 comp rx=0 tx=0).stop 2024-04-18T04:54:00.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.795+0000 7f51c6000640 1 -- 172.21.15.120:0/731358705 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f51c00c69e0 msgr2=0x7f51c0154160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:00.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.795+0000 7f51c6000640 1 --2- 172.21.15.120:0/731358705 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f51c00c69e0 0x7f51c0154160 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f51b000b410 tx=0x7f51b000b8d0 comp rx=0 tx=0).stop 2024-04-18T04:54:00.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.795+0000 7f51c6000640 1 -- 172.21.15.120:0/731358705 shutdown_connections 2024-04-18T04:54:00.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.795+0000 7f51c6000640 1 --2- 172.21.15.120:0/731358705 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f519c066760 0x7f519c068c20 secure :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f51c006e160 tx=0x7f51a8009240 comp rx=0 tx=0).stop 2024-04-18T04:54:00.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.795+0000 7f51c6000640 1 --2- 172.21.15.120:0/731358705 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51c0157de0 0x7f51c0155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:00.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.795+0000 7f51c6000640 1 --2- 172.21.15.120:0/731358705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51c0157a00 0x7f51c01f17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:00.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.795+0000 7f51c6000640 1 --2- 172.21.15.120:0/731358705 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f51c00c69e0 0x7f51c0154160 secure :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f51b000b410 tx=0x7f51b000b8d0 comp rx=0 tx=0).stop 2024-04-18T04:54:00.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.795+0000 7f51c6000640 1 -- 172.21.15.120:0/731358705 >> 172.21.15.120:0/731358705 conn(0x7f51c00c78c0 msgr2=0x7f51c00c93b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:00.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.799+0000 7f51c6000640 1 -- 172.21.15.120:0/731358705 shutdown_connections 2024-04-18T04:54:00.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:00.799+0000 7f51c6000640 1 -- 172.21.15.120:0/731358705 wait complete. 2024-04-18T04:54:00.836 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:54:02.837 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:54:03.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.059+0000 7f8a46a00640 1 Processor -- start 2024-04-18T04:54:03.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.059+0000 7f8a46a00640 1 -- start start 2024-04-18T04:54:03.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.059+0000 7f8a46a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8a40165990 0x7f8a4006c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:03.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.059+0000 7f8a46a00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a400c6150 con 0x7f8a40166d80 2024-04-18T04:54:03.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.059+0000 7f8a46a00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a400c5860 con 0x7f8a400c73d0 2024-04-18T04:54:03.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.059+0000 7f8a46a00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4006fe60 con 0x7f8a40165990 2024-04-18T04:54:03.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.059+0000 7f8a46000640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f8a40166d80 0x7f8a401696c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:42730/0 (socket says 172.21.15.120:42730) 2024-04-18T04:54:03.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.059+0000 7f8a46000640 1 -- 172.21.15.120:0/2090071482 learned_addr learned my addr 172.21.15.120:0/2090071482 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:54:03.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.059+0000 7f8a45600640 1 --2- 172.21.15.120:0/2090071482 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8a40165990 0x7f8a4006c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:03.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.063+0000 7f8a3fe00640 1 -- 172.21.15.120:0/2090071482 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2304454272 0 0) 0x7f8a400c5860 con 0x7f8a400c73d0 2024-04-18T04:54:03.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.239+0000 7f8a3fe00640 1 -- 172.21.15.120:0/2090071482 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a28003530 con 0x7f8a400c73d0 2024-04-18T04:54:03.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.239+0000 7f8a3fe00640 1 -- 172.21.15.120:0/2090071482 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1495169501 0 0) 0x7f8a400c6150 con 0x7f8a40166d80 2024-04-18T04:54:03.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.239+0000 7f8a3fe00640 1 -- 172.21.15.120:0/2090071482 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a400c5860 con 0x7f8a40166d80 2024-04-18T04:54:03.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.243+0000 7f8a3fe00640 1 -- 172.21.15.120:0/2090071482 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2776817650 0 0) 0x7f8a400c5860 con 0x7f8a40166d80 2024-04-18T04:54:03.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.243+0000 7f8a3fe00640 1 -- 172.21.15.120:0/2090071482 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8a40165990 msgr2=0x7f8a4006c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:03.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.243+0000 7f8a3fe00640 1 --2- 172.21.15.120:0/2090071482 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8a40165990 0x7f8a4006c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:03.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.243+0000 7f8a3fe00640 1 -- 172.21.15.120:0/2090071482 >> v1:172.21.15.132:6789/0 conn(0x7f8a400c73d0 legacy=0x7f8a400c65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:03.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.243+0000 7f8a3fe00640 1 -- 172.21.15.120:0/2090071482 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a4006c670 con 0x7f8a40166d80 2024-04-18T04:54:03.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.243+0000 7f8a3fe00640 1 -- 172.21.15.120:0/2090071482 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7f8a38001a00 con 0x7f8a40166d80 2024-04-18T04:54:03.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.243+0000 7f8a3fe00640 1 -- 172.21.15.120:0/2090071482 >> v1:172.21.15.120:6789/0 conn(0x7f8a40166d80 legacy=0x7f8a401696c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:03.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.243+0000 7f8a3fe00640 1 --2- 172.21.15.120:0/2090071482 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8a28004ba0 0x7f8a28004f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:03.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.243+0000 7f8a3fe00640 1 --2- 172.21.15.120:0/2090071482 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a28003770 0x7f8a28003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:03.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.243+0000 7f8a3fe00640 1 --2- 172.21.15.120:0/2090071482 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a28004130 0x7f8a2800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:03.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.243+0000 7f8a3fe00640 1 -- 172.21.15.120:0/2090071482 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2800bf00 con 0x7f8a28003770 2024-04-18T04:54:03.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.243+0000 7f8a3fe00640 1 -- 172.21.15.120:0/2090071482 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2800c070 con 0x7f8a28004130 2024-04-18T04:54:03.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.243+0000 7f8a3fe00640 1 -- 172.21.15.120:0/2090071482 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2800c230 con 0x7f8a28004ba0 2024-04-18T04:54:03.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.243+0000 7f8a44c00640 1 --2- 172.21.15.120:0/2090071482 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a28003770 0x7f8a28003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:03.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.243+0000 7f8a46000640 1 --2- 172.21.15.120:0/2090071482 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a28004130 0x7f8a2800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:03.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.243+0000 7f8a44c00640 1 -- 172.21.15.120:0/2090071482 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8a28004ba0 msgr2=0x7f8a28004f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:54:03.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.243+0000 7f8a44c00640 1 --2- 172.21.15.120:0/2090071482 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8a28004ba0 0x7f8a28004f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:03.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.243+0000 7f8a44c00640 1 -- 172.21.15.120:0/2090071482 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a28004130 msgr2=0x7f8a2800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:03.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.243+0000 7f8a44c00640 1 --2- 172.21.15.120:0/2090071482 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a28004130 0x7f8a2800b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:03.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.243+0000 7f8a44c00640 1 -- 172.21.15.120:0/2090071482 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a4006c670 con 0x7f8a28003770 2024-04-18T04:54:03.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.255+0000 7f8a44c00640 1 --2- 172.21.15.120:0/2090071482 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a28003770 0x7f8a28003bf0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c001940 tx=0x7f8a2c01ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67027cee0ca798b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:03.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.255+0000 7f8a3fe00640 1 -- 172.21.15.120:0/2090071482 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c0a8a10 con 0x7f8a28003770 2024-04-18T04:54:03.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.255+0000 7f8a3fe00640 1 -- 172.21.15.120:0/2090071482 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a2c0a8b70 con 0x7f8a28003770 2024-04-18T04:54:03.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.259+0000 7f8a3fe00640 1 -- 172.21.15.120:0/2090071482 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c0b0440 con 0x7f8a28003770 2024-04-18T04:54:03.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.263+0000 7f8a46a00640 1 -- 172.21.15.120:0/2090071482 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a28003770 msgr2=0x7f8a28003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:03.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.263+0000 7f8a46a00640 1 --2- 172.21.15.120:0/2090071482 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a28003770 0x7f8a28003bf0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c001940 tx=0x7f8a2c01ed70 comp rx=0 tx=0).stop 2024-04-18T04:54:03.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.263+0000 7f8a46000640 1 -- 172.21.15.120:0/2090071482 reap_dead start 2024-04-18T04:54:03.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.263+0000 7f8a46a00640 1 -- 172.21.15.120:0/2090071482 shutdown_connections 2024-04-18T04:54:03.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.263+0000 7f8a46a00640 1 -- 172.21.15.120:0/2090071482 >> 172.21.15.120:0/2090071482 conn(0x7f8a4006d000 msgr2=0x7f8a4006d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:03.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.263+0000 7f8a46a00640 1 -- 172.21.15.120:0/2090071482 shutdown_connections 2024-04-18T04:54:03.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.267+0000 7f8a46a00640 1 -- 172.21.15.120:0/2090071482 wait complete. 2024-04-18T04:54:03.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.271+0000 7f8a46a00640 1 Processor -- start 2024-04-18T04:54:03.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.271+0000 7f8a46a00640 1 -- start start 2024-04-18T04:54:03.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.271+0000 7f8a46a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a28003770 0x7f8a401ffc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:03.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.271+0000 7f8a46a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8a400c4d20 0x7f8a4015e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:03.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.271+0000 7f8a46a00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a40158230 0x7f8a40070db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:03.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.271+0000 7f8a46a00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4008b120 con 0x7f8a28003770 2024-04-18T04:54:03.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.271+0000 7f8a46a00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a400705f0 con 0x7f8a40158230 2024-04-18T04:54:03.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.271+0000 7f8a46a00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a402002b0 con 0x7f8a400c4d20 2024-04-18T04:54:03.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.271+0000 7f8a46000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a40158230 0x7f8a40070db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:03.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.271+0000 7f8a46000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a40158230 0x7f8a40070db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:34950/0 (socket says 172.21.15.120:34950) 2024-04-18T04:54:03.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.275+0000 7f8a46000640 1 -- 172.21.15.120:0/2648235517 learned_addr learned my addr 172.21.15.120:0/2648235517 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:54:03.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.275+0000 7f8a46000640 1 -- 172.21.15.120:0/2648235517 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8a400c4d20 msgr2=0x7f8a4015e9d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:54:03.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.275+0000 7f8a46000640 1 --2- 172.21.15.120:0/2648235517 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8a400c4d20 0x7f8a4015e9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:03.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.275+0000 7f8a46000640 1 -- 172.21.15.120:0/2648235517 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a28003770 msgr2=0x7f8a401ffc70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:54:03.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.275+0000 7f8a46000640 1 --2- 172.21.15.120:0/2648235517 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a28003770 0x7f8a401ffc70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:03.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.275+0000 7f8a46000640 1 -- 172.21.15.120:0/2648235517 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a40200590 con 0x7f8a40158230 2024-04-18T04:54:03.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.275+0000 7f8a46000640 1 --2- 172.21.15.120:0/2648235517 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a40158230 0x7f8a40070db0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8a40167160 tx=0x7f8a3800b4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:03.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.275+0000 7f8a3d600640 1 -- 172.21.15.120:0/2648235517 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3800bb80 con 0x7f8a40158230 2024-04-18T04:54:03.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.275+0000 7f8a3d600640 1 -- 172.21.15.120:0/2648235517 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3800bce0 con 0x7f8a40158230 2024-04-18T04:54:03.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.275+0000 7f8a3d600640 1 -- 172.21.15.120:0/2648235517 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3800bb80 con 0x7f8a40158230 2024-04-18T04:54:03.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.279+0000 7f8a46a00640 1 -- 172.21.15.120:0/2648235517 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a40200870 con 0x7f8a40158230 2024-04-18T04:54:03.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.279+0000 7f8a46a00640 1 -- 172.21.15.120:0/2648235517 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a4015f3c0 con 0x7f8a40158230 2024-04-18T04:54:03.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.279+0000 7f8a46a00640 1 -- 172.21.15.120:0/2648235517 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a400728f0 con 0x7f8a40158230 2024-04-18T04:54:03.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.283+0000 7f8a3d600640 1 -- 172.21.15.120:0/2648235517 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8a38007070 con 0x7f8a40158230 2024-04-18T04:54:03.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.283+0000 7f8a3d600640 1 --2- 172.21.15.120:0/2648235517 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8a20066710 0x7f8a20068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:03.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.283+0000 7f8a3d600640 1 -- 172.21.15.120:0/2648235517 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f8a38055320 con 0x7f8a40158230 2024-04-18T04:54:03.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.283+0000 7f8a45600640 1 --2- 172.21.15.120:0/2648235517 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8a20066710 0x7f8a20068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:03.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.295+0000 7f8a45600640 1 --2- 172.21.15.120:0/2648235517 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8a20066710 0x7f8a20068bd0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8a4006e040 tx=0x7f8a34008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:03.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.303+0000 7f8a3d600640 1 -- 172.21.15.120:0/2648235517 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f8a38051df0 con 0x7f8a40158230 2024-04-18T04:54:03.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.739+0000 7f8a46a00640 1 -- 172.21.15.120:0/2648235517 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a40070a60 con 0x7f8a40158230 2024-04-18T04:54:03.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.743+0000 7f8a3d600640 1 -- 172.21.15.120:0/2648235517 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+5522 (secure 0 0 0) 0x7f8a38051f90 con 0x7f8a40158230 2024-04-18T04:54:03.745 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:54:03.745 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":47,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:53:46.091483+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5105,"mds_1":5400},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_5105":{"gid":5105,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":14,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5400":{"gid":5400,"name":"e","rank":1,"incarnation":44,"state":"up:rejoin","state_seq":19,"addr":"172.21.15.120:6837/671327196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":671327196},{"type":"v1","addr":"172.21.15.120:6837","nonce":671327196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:54:03.745 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 47 2024-04-18T04:54:03.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.751+0000 7f8a46a00640 1 -- 172.21.15.120:0/2648235517 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8a20066710 msgr2=0x7f8a20068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:03.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.751+0000 7f8a46a00640 1 --2- 172.21.15.120:0/2648235517 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8a20066710 0x7f8a20068bd0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8a4006e040 tx=0x7f8a34008040 comp rx=0 tx=0).stop 2024-04-18T04:54:03.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.751+0000 7f8a46a00640 1 -- 172.21.15.120:0/2648235517 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a40158230 msgr2=0x7f8a40070db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:03.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.751+0000 7f8a46a00640 1 --2- 172.21.15.120:0/2648235517 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a40158230 0x7f8a40070db0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8a40167160 tx=0x7f8a3800b4a0 comp rx=0 tx=0).stop 2024-04-18T04:54:03.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.755+0000 7f8a46a00640 1 -- 172.21.15.120:0/2648235517 shutdown_connections 2024-04-18T04:54:03.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.755+0000 7f8a46a00640 1 --2- 172.21.15.120:0/2648235517 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f8a20066710 0x7f8a20068bd0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:03.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.755+0000 7f8a46a00640 1 --2- 172.21.15.120:0/2648235517 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a40158230 0x7f8a40070db0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:03.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.755+0000 7f8a46a00640 1 --2- 172.21.15.120:0/2648235517 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8a400c4d20 0x7f8a4015e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:03.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.755+0000 7f8a46a00640 1 --2- 172.21.15.120:0/2648235517 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a28003770 0x7f8a401ffc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:03.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.755+0000 7f8a46a00640 1 -- 172.21.15.120:0/2648235517 >> 172.21.15.120:0/2648235517 conn(0x7f8a4006d000 msgr2=0x7f8a4015cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:03.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.755+0000 7f8a46a00640 1 -- 172.21.15.120:0/2648235517 shutdown_connections 2024-04-18T04:54:03.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:03.755+0000 7f8a46a00640 1 -- 172.21.15.120:0/2648235517 wait complete. 2024-04-18T04:54:03.816 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:54:05.818 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:54:06.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.147+0000 7f9d87200640 1 Processor -- start 2024-04-18T04:54:06.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.147+0000 7f9d87200640 1 -- start start 2024-04-18T04:54:06.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.151+0000 7f9d87200640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9d80157dd0 0x7f9d800ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:06.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.151+0000 7f9d87200640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9d800c96d0 0x7f9d8015e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:06.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.151+0000 7f9d87200640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d8015df10 con 0x7f9d800ccee0 2024-04-18T04:54:06.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.151+0000 7f9d87200640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d800c4200 con 0x7f9d80157dd0 2024-04-18T04:54:06.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.151+0000 7f9d87200640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d800c7c90 con 0x7f9d800c96d0 2024-04-18T04:54:06.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.151+0000 7f9d7fe00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9d80157dd0 0x7f9d800ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:06.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.151+0000 7f9d7fe00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9d80157dd0 0x7f9d800ca2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:39390/0 (socket says 172.21.15.120:39390) 2024-04-18T04:54:06.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.151+0000 7f9d7f400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9d800c96d0 0x7f9d8015e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:06.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.151+0000 7f9d7fe00640 1 -- 172.21.15.120:0/358303932 learned_addr learned my addr 172.21.15.120:0/358303932 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:54:06.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.163+0000 7f9d7ea00640 1 -- 172.21.15.120:0/358303932 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4192667626 0 0) 0x7f9d8015df10 con 0x7f9d800ccee0 2024-04-18T04:54:06.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.163+0000 7f9d7ea00640 1 -- 172.21.15.120:0/358303932 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d64003530 con 0x7f9d800ccee0 2024-04-18T04:54:06.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.163+0000 7f9d7ea00640 1 -- 172.21.15.120:0/358303932 <== mon.1 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1428265710 0 0) 0x7f9d64003530 con 0x7f9d800ccee0 2024-04-18T04:54:06.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.163+0000 7f9d7ea00640 1 -- 172.21.15.120:0/358303932 >> v2:172.21.15.132:3300/0 conn(0x7f9d800c96d0 msgr2=0x7f9d8015e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:06.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.163+0000 7f9d7ea00640 1 --2- 172.21.15.120:0/358303932 >> v2:172.21.15.132:3300/0 conn(0x7f9d800c96d0 0x7f9d8015e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:06.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.163+0000 7f9d7ea00640 1 -- 172.21.15.120:0/358303932 >> v2:172.21.15.120:3300/0 conn(0x7f9d80157dd0 msgr2=0x7f9d800ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:06.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.163+0000 7f9d7ea00640 1 --2- 172.21.15.120:0/358303932 >> v2:172.21.15.120:3300/0 conn(0x7f9d80157dd0 0x7f9d800ca2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:06.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.163+0000 7f9d7ea00640 1 -- 172.21.15.120:0/358303932 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d800c7f50 con 0x7f9d800ccee0 2024-04-18T04:54:06.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.163+0000 7f9d7ea00640 1 -- 172.21.15.120:0/358303932 <== mon.1 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7f9d70001680 con 0x7f9d800ccee0 2024-04-18T04:54:06.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.163+0000 7f9d7ea00640 1 -- 172.21.15.120:0/358303932 >> v1:172.21.15.132:6789/0 conn(0x7f9d800ccee0 legacy=0x7f9d80161070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:06.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.163+0000 7f9d7ea00640 1 --2- 172.21.15.120:0/358303932 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d64003980 0x7f9d64003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:06.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.163+0000 7f9d7ea00640 1 --2- 172.21.15.120:0/358303932 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d640047d0 0x7f9d64004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:06.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.163+0000 7f9d7ea00640 1 --2- 172.21.15.120:0/358303932 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d64005390 0x7f9d6400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:06.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.163+0000 7f9d7ea00640 1 -- 172.21.15.120:0/358303932 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d800c7c90 con 0x7f9d64005390 2024-04-18T04:54:06.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.163+0000 7f9d7ea00640 1 -- 172.21.15.120:0/358303932 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6400c250 con 0x7f9d64003980 2024-04-18T04:54:06.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.163+0000 7f9d7ea00640 1 -- 172.21.15.120:0/358303932 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6400c410 con 0x7f9d640047d0 2024-04-18T04:54:06.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.163+0000 7f9d7f400640 1 --2- 172.21.15.120:0/358303932 >> v2:172.21.15.132:3300/0 conn(0x7f9d800c96d0 0x7f9d8015e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:54:06.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.163+0000 7f9d7f400640 1 --2- 172.21.15.120:0/358303932 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d640047d0 0x7f9d64004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:06.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.163+0000 7f9d7fe00640 1 --2- 172.21.15.120:0/358303932 >> v2:172.21.15.120:3300/0 conn(0x7f9d80157dd0 0x7f9d800ca2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:54:06.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.163+0000 7f9d7f400640 1 -- 172.21.15.120:0/358303932 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d64003980 msgr2=0x7f9d64003da0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-18T04:54:06.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.163+0000 7f9d7f400640 1 --2- 172.21.15.120:0/358303932 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d64003980 0x7f9d64003da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:06.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.163+0000 7f9d7f400640 1 -- 172.21.15.120:0/358303932 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d64005390 msgr2=0x7f9d6400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:06.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.163+0000 7f9d7f400640 1 --2- 172.21.15.120:0/358303932 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d64005390 0x7f9d6400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:06.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.163+0000 7f9d85200640 1 -- 172.21.15.120:0/358303932 reap_dead start 2024-04-18T04:54:06.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.163+0000 7f9d7f400640 1 -- 172.21.15.120:0/358303932 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d800c7f50 con 0x7f9d640047d0 2024-04-18T04:54:06.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.191+0000 7f9d7f400640 1 --2- 172.21.15.120:0/358303932 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d640047d0 0x7f9d64004c50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9d64005770 tx=0x7f9d7801cff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81f765912a7edfc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:06.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.191+0000 7f9d7ea00640 1 -- 172.21.15.120:0/358303932 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d780ac600 con 0x7f9d640047d0 2024-04-18T04:54:06.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.191+0000 7f9d7ea00640 1 -- 172.21.15.120:0/358303932 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d780a8050 con 0x7f9d640047d0 2024-04-18T04:54:06.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.191+0000 7f9d87200640 1 -- 172.21.15.120:0/358303932 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d640047d0 msgr2=0x7f9d64004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:06.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.191+0000 7f9d7ea00640 1 -- 172.21.15.120:0/358303932 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d780ac600 con 0x7f9d640047d0 2024-04-18T04:54:06.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.191+0000 7f9d87200640 1 --2- 172.21.15.120:0/358303932 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d640047d0 0x7f9d64004c50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9d64005770 tx=0x7f9d7801cff0 comp rx=0 tx=0).stop 2024-04-18T04:54:06.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.191+0000 7f9d87200640 1 -- 172.21.15.120:0/358303932 shutdown_connections 2024-04-18T04:54:06.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.191+0000 7f9d87200640 1 --2- 172.21.15.120:0/358303932 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d640047d0 0x7f9d64004c50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:06.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.191+0000 7f9d87200640 1 -- 172.21.15.120:0/358303932 >> 172.21.15.120:0/358303932 conn(0x7f9d8006e0f0 msgr2=0x7f9d80071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:06.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.191+0000 7f9d87200640 1 -- 172.21.15.120:0/358303932 shutdown_connections 2024-04-18T04:54:06.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.191+0000 7f9d87200640 1 -- 172.21.15.120:0/358303932 wait complete. 2024-04-18T04:54:06.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.199+0000 7f9d87200640 1 Processor -- start 2024-04-18T04:54:06.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.207+0000 7f9d87200640 1 -- start start 2024-04-18T04:54:06.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.207+0000 7f9d87200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d640047d0 0x7f9d80148870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:06.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.207+0000 7f9d87200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d800cae50 0x7f9d800cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:06.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.207+0000 7f9d87200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d80155d70 0x7f9d801561f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:06.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.207+0000 7f9d87200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d80145fc0 con 0x7f9d800cae50 2024-04-18T04:54:06.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.207+0000 7f9d87200640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d80144cb0 con 0x7f9d80155d70 2024-04-18T04:54:06.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.207+0000 7f9d87200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d80144820 con 0x7f9d640047d0 2024-04-18T04:54:06.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.207+0000 7f9d7fe00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d640047d0 0x7f9d80148870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:06.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.207+0000 7f9d7fe00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d640047d0 0x7f9d80148870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:43498/0 (socket says 172.21.15.120:43498) 2024-04-18T04:54:06.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.207+0000 7f9d7fe00640 1 -- 172.21.15.120:0/867868506 learned_addr learned my addr 172.21.15.120:0/867868506 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:54:06.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.207+0000 7f9d85200640 1 --2- 172.21.15.120:0/867868506 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d80155d70 0x7f9d801561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:06.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.207+0000 7f9d7fe00640 1 -- 172.21.15.120:0/867868506 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d80155d70 msgr2=0x7f9d801561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:06.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.207+0000 7f9d7fe00640 1 --2- 172.21.15.120:0/867868506 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d80155d70 0x7f9d801561f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:06.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.207+0000 7f9d7fe00640 1 -- 172.21.15.120:0/867868506 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d800cae50 msgr2=0x7f9d800cb2b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:54:06.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.207+0000 7f9d7fe00640 1 --2- 172.21.15.120:0/867868506 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d800cae50 0x7f9d800cb2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:06.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.207+0000 7f9d7fe00640 1 -- 172.21.15.120:0/867868506 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d80148db0 con 0x7f9d640047d0 2024-04-18T04:54:06.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.207+0000 7f9d7fe00640 1 --2- 172.21.15.120:0/867868506 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d640047d0 0x7f9d80148870 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c00c7a0 tx=0x7f9d6c00cc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:06.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.211+0000 7f9d77e00640 1 -- 172.21.15.120:0/867868506 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c007820 con 0x7f9d640047d0 2024-04-18T04:54:06.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.211+0000 7f9d77e00640 1 -- 172.21.15.120:0/867868506 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d6c0079a0 con 0x7f9d640047d0 2024-04-18T04:54:06.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.211+0000 7f9d77e00640 1 -- 172.21.15.120:0/867868506 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c007d50 con 0x7f9d640047d0 2024-04-18T04:54:06.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.211+0000 7f9d87200640 1 -- 172.21.15.120:0/867868506 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d80143930 con 0x7f9d640047d0 2024-04-18T04:54:06.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.211+0000 7f9d87200640 1 -- 172.21.15.120:0/867868506 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d80143ef0 con 0x7f9d640047d0 2024-04-18T04:54:06.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.211+0000 7f9d75600640 1 -- 172.21.15.120:0/867868506 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d80067590 con 0x7f9d640047d0 2024-04-18T04:54:06.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.215+0000 7f9d77e00640 1 -- 172.21.15.120:0/867868506 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9d6c024480 con 0x7f9d640047d0 2024-04-18T04:54:06.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.215+0000 7f9d77e00640 1 --2- 172.21.15.120:0/867868506 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9d60066760 0x7f9d60068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:06.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.215+0000 7f9d77e00640 1 -- 172.21.15.120:0/867868506 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f9d6c084bb0 con 0x7f9d640047d0 2024-04-18T04:54:06.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.219+0000 7f9d7f400640 1 --2- 172.21.15.120:0/867868506 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9d60066760 0x7f9d60068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:06.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.219+0000 7f9d7f400640 1 --2- 172.21.15.120:0/867868506 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9d60066760 0x7f9d60068c20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9d780ae000 tx=0x7f9d78004ac0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:06.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.219+0000 7f9d77e00640 1 -- 172.21.15.120:0/867868506 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f9d6c051ad0 con 0x7f9d640047d0 2024-04-18T04:54:06.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.583+0000 7f9d75600640 1 -- 172.21.15.120:0/867868506 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d80072a70 con 0x7f9d640047d0 2024-04-18T04:54:06.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.583+0000 7f9d77e00640 1 -- 172.21.15.120:0/867868506 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+5522 (secure 0 0 0) 0x7f9d6c01f090 con 0x7f9d640047d0 2024-04-18T04:54:06.588 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:54:06.588 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":47,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:53:46.091483+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5105,"mds_1":5400},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_5105":{"gid":5105,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":14,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5400":{"gid":5400,"name":"e","rank":1,"incarnation":44,"state":"up:rejoin","state_seq":19,"addr":"172.21.15.120:6837/671327196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":671327196},{"type":"v1","addr":"172.21.15.120:6837","nonce":671327196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:54:06.589 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 47 2024-04-18T04:54:06.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.587+0000 7f9d75600640 1 -- 172.21.15.120:0/867868506 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9d60066760 msgr2=0x7f9d60068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:06.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.587+0000 7f9d75600640 1 --2- 172.21.15.120:0/867868506 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9d60066760 0x7f9d60068c20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9d780ae000 tx=0x7f9d78004ac0 comp rx=0 tx=0).stop 2024-04-18T04:54:06.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.587+0000 7f9d75600640 1 -- 172.21.15.120:0/867868506 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d640047d0 msgr2=0x7f9d80148870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:06.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.587+0000 7f9d75600640 1 --2- 172.21.15.120:0/867868506 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d640047d0 0x7f9d80148870 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c00c7a0 tx=0x7f9d6c00cc60 comp rx=0 tx=0).stop 2024-04-18T04:54:06.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.587+0000 7f9d75600640 1 -- 172.21.15.120:0/867868506 shutdown_connections 2024-04-18T04:54:06.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.587+0000 7f9d75600640 1 --2- 172.21.15.120:0/867868506 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9d60066760 0x7f9d60068c20 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:06.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.587+0000 7f9d75600640 1 --2- 172.21.15.120:0/867868506 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d80155d70 0x7f9d801561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:06.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.587+0000 7f9d75600640 1 --2- 172.21.15.120:0/867868506 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d800cae50 0x7f9d800cb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:06.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.587+0000 7f9d75600640 1 --2- 172.21.15.120:0/867868506 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d640047d0 0x7f9d80148870 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:06.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.587+0000 7f9d75600640 1 -- 172.21.15.120:0/867868506 >> 172.21.15.120:0/867868506 conn(0x7f9d8006e0f0 msgr2=0x7f9d800c8c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:06.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.587+0000 7f9d75600640 1 -- 172.21.15.120:0/867868506 shutdown_connections 2024-04-18T04:54:06.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:06.587+0000 7f9d75600640 1 -- 172.21.15.120:0/867868506 wait complete. 2024-04-18T04:54:06.629 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:54:08.630 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:54:08.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:08.886+0000 7f60a7e00640 1 Processor -- start 2024-04-18T04:54:08.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:08.890+0000 7f60a7e00640 1 -- start start 2024-04-18T04:54:08.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:08.890+0000 7f60a7e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f60a8165990 0x7f60a806c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:08.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:08.890+0000 7f60a7e00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a80c6150 con 0x7f60a80c73d0 2024-04-18T04:54:08.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:08.890+0000 7f60a7e00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a80c5860 con 0x7f60a8166d80 2024-04-18T04:54:08.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:08.890+0000 7f60a7e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a806fe60 con 0x7f60a8165990 2024-04-18T04:54:08.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:08.890+0000 7f60a7400640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f60a8166d80 0x7f60a81696c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:47882/0 (socket says 172.21.15.120:47882) 2024-04-18T04:54:08.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:08.890+0000 7f60a7400640 1 -- 172.21.15.120:0/4098532612 learned_addr learned my addr 172.21.15.120:0/4098532612 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:54:08.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:08.890+0000 7f60a5600640 1 -- 172.21.15.120:0/4098532612 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3737081726 0 0) 0x7f60a80c5860 con 0x7f60a8166d80 2024-04-18T04:54:08.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:08.894+0000 7f60a6a00640 1 --2- 172.21.15.120:0/4098532612 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f60a8165990 0x7f60a806c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:08.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:08.986+0000 7f60a5600640 1 -- 172.21.15.120:0/4098532612 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f608c003530 con 0x7f60a8166d80 2024-04-18T04:54:08.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:08.986+0000 7f60a5600640 1 -- 172.21.15.120:0/4098532612 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497772306 0 0) 0x7f60a80c6150 con 0x7f60a80c73d0 2024-04-18T04:54:08.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:08.986+0000 7f60a5600640 1 -- 172.21.15.120:0/4098532612 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60a80c5860 con 0x7f60a80c73d0 2024-04-18T04:54:08.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:08.986+0000 7f60a6a00640 1 -- 172.21.15.120:0/4098532612 >> v1:172.21.15.132:6789/0 conn(0x7f60a8166d80 legacy=0x7f60a81696c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:08.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:08.986+0000 7f60a6a00640 1 -- 172.21.15.120:0/4098532612 >> v1:172.21.15.120:6789/0 conn(0x7f60a80c73d0 legacy=0x7f60a80c65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:08.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:08.986+0000 7f60a6a00640 1 -- 172.21.15.120:0/4098532612 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a806c670 con 0x7f60a8165990 2024-04-18T04:54:08.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:08.990+0000 7f60a6a00640 1 --2- 172.21.15.120:0/4098532612 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f60a8165990 0x7f60a806c030 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f60a0007b20 tx=0x7f60a0020070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e88a066dd93c5ce server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:08.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:08.994+0000 7f60a5600640 1 -- 172.21.15.120:0/4098532612 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6098001680 con 0x7f60a8165990 2024-04-18T04:54:08.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:08.994+0000 7f60a5600640 1 -- 172.21.15.120:0/4098532612 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a00a9d80 con 0x7f60a8165990 2024-04-18T04:54:08.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:08.994+0000 7f60a5600640 1 -- 172.21.15.120:0/4098532612 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a00b1660 con 0x7f60a8165990 2024-04-18T04:54:08.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:08.994+0000 7f60a7e00640 1 -- 172.21.15.120:0/4098532612 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f60a8165990 msgr2=0x7f60a806c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:08.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:08.994+0000 7f60a7e00640 1 --2- 172.21.15.120:0/4098532612 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f60a8165990 0x7f60a806c030 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f60a0007b20 tx=0x7f60a0020070 comp rx=0 tx=0).stop 2024-04-18T04:54:09.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:08.998+0000 7f60a7e00640 1 -- 172.21.15.120:0/4098532612 shutdown_connections 2024-04-18T04:54:09.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:08.998+0000 7f60a7e00640 1 --2- 172.21.15.120:0/4098532612 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f60a8165990 0x7f60a806c030 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:09.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:08.998+0000 7f60a7e00640 1 -- 172.21.15.120:0/4098532612 >> 172.21.15.120:0/4098532612 conn(0x7f60a806d000 msgr2=0x7f60a806d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:09.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.002+0000 7f60a7e00640 1 -- 172.21.15.120:0/4098532612 shutdown_connections 2024-04-18T04:54:09.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.002+0000 7f60a7e00640 1 -- 172.21.15.120:0/4098532612 wait complete. 2024-04-18T04:54:09.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.010+0000 7f60a7e00640 1 Processor -- start 2024-04-18T04:54:09.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.010+0000 7f60a7e00640 1 -- start start 2024-04-18T04:54:09.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.014+0000 7f60a7e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f60a80c73d0 0x7f60a81615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:09.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.014+0000 7f60a7e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60a8165990 0x7f60a80c1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:09.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.014+0000 7f60a6a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f60a80c73d0 0x7f60a81615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:09.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.014+0000 7f60a6a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f60a80c73d0 0x7f60a81615e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:43514/0 (socket says 172.21.15.120:43514) 2024-04-18T04:54:09.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.014+0000 7f60a6a00640 1 -- 172.21.15.120:0/1658434050 learned_addr learned my addr 172.21.15.120:0/1658434050 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:54:09.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.014+0000 7f60a6000640 1 --2- 172.21.15.120:0/1658434050 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60a8165990 0x7f60a80c1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:09.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.014+0000 7f60a7e00640 1 --2- 172.21.15.120:0/1658434050 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60a8166d80 0x7f60a8160a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:09.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.014+0000 7f60a7e00640 1 -- 172.21.15.120:0/1658434050 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a8200b40 con 0x7f60a8165990 2024-04-18T04:54:09.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.014+0000 7f60a7e00640 1 -- 172.21.15.120:0/1658434050 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a8200d70 con 0x7f60a8166d80 2024-04-18T04:54:09.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.014+0000 7f60a7e00640 1 -- 172.21.15.120:0/1658434050 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a80ab120 con 0x7f60a80c73d0 2024-04-18T04:54:09.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.018+0000 7f60a7400640 1 --2- 172.21.15.120:0/1658434050 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60a8166d80 0x7f60a8160a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:09.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.026+0000 7f60a6a00640 1 -- 172.21.15.120:0/1658434050 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60a8166d80 msgr2=0x7f60a8160a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:09.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.026+0000 7f60a6a00640 1 --2- 172.21.15.120:0/1658434050 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60a8166d80 0x7f60a8160a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:09.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.026+0000 7f60a6a00640 1 -- 172.21.15.120:0/1658434050 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60a8165990 msgr2=0x7f60a80c1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:09.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.026+0000 7f60a6a00640 1 --2- 172.21.15.120:0/1658434050 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60a8165990 0x7f60a80c1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:09.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.026+0000 7f60a6a00640 1 -- 172.21.15.120:0/1658434050 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a00077d0 con 0x7f60a80c73d0 2024-04-18T04:54:09.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.026+0000 7f60a6a00640 1 --2- 172.21.15.120:0/1658434050 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f60a80c73d0 0x7f60a81615e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f60a001e720 tx=0x7f60a001ce10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:09.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.030+0000 7f609ea00640 1 -- 172.21.15.120:0/1658434050 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a000c3a0 con 0x7f60a80c73d0 2024-04-18T04:54:09.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.030+0000 7f609ea00640 1 -- 172.21.15.120:0/1658434050 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a000c500 con 0x7f60a80c73d0 2024-04-18T04:54:09.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.030+0000 7f609ea00640 1 -- 172.21.15.120:0/1658434050 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a000c890 con 0x7f60a80c73d0 2024-04-18T04:54:09.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.030+0000 7f60a7e00640 1 -- 172.21.15.120:0/1658434050 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60a8201010 con 0x7f60a80c73d0 2024-04-18T04:54:09.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.030+0000 7f60a7e00640 1 -- 172.21.15.120:0/1658434050 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60a82015d0 con 0x7f60a80c73d0 2024-04-18T04:54:09.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.034+0000 7f60a7e00640 1 -- 172.21.15.120:0/1658434050 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60a80728f0 con 0x7f60a80c73d0 2024-04-18T04:54:09.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.046+0000 7f609ea00640 1 -- 172.21.15.120:0/1658434050 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f60a00b8040 con 0x7f60a80c73d0 2024-04-18T04:54:09.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.046+0000 7f609ea00640 1 --2- 172.21.15.120:0/1658434050 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6088066760 0x7f6088068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:09.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.046+0000 7f609ea00640 1 -- 172.21.15.120:0/1658434050 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f60a012b5b0 con 0x7f60a80c73d0 2024-04-18T04:54:09.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.054+0000 7f60a6000640 1 --2- 172.21.15.120:0/1658434050 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6088066760 0x7f6088068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:09.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.062+0000 7f60a6000640 1 --2- 172.21.15.120:0/1658434050 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6088066760 0x7f6088068c20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f60a806e060 tx=0x7f6094009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:09.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.066+0000 7f609ea00640 1 -- 172.21.15.120:0/1658434050 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f60a00f83b0 con 0x7f60a80c73d0 2024-04-18T04:54:09.530 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:54:09.530 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":47,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:53:46.091483+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5105,"mds_1":5400},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_5105":{"gid":5105,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":14,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5400":{"gid":5400,"name":"e","rank":1,"incarnation":44,"state":"up:rejoin","state_seq":19,"addr":"172.21.15.120:6837/671327196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":671327196},{"type":"v1","addr":"172.21.15.120:6837","nonce":671327196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:54:09.530 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 47 2024-04-18T04:54:09.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.522+0000 7f60a7e00640 1 -- 172.21.15.120:0/1658434050 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60a80728f0 con 0x7f60a80c73d0 2024-04-18T04:54:09.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.526+0000 7f609ea00640 1 -- 172.21.15.120:0/1658434050 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+5522 (secure 0 0 0) 0x7f60a00b6070 con 0x7f60a80c73d0 2024-04-18T04:54:09.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.530+0000 7f60a7e00640 1 -- 172.21.15.120:0/1658434050 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6088066760 msgr2=0x7f6088068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:09.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.530+0000 7f60a7e00640 1 --2- 172.21.15.120:0/1658434050 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6088066760 0x7f6088068c20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f60a806e060 tx=0x7f6094009040 comp rx=0 tx=0).stop 2024-04-18T04:54:09.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.530+0000 7f60a7e00640 1 -- 172.21.15.120:0/1658434050 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f60a80c73d0 msgr2=0x7f60a81615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:09.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.530+0000 7f60a7e00640 1 --2- 172.21.15.120:0/1658434050 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f60a80c73d0 0x7f60a81615e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f60a001e720 tx=0x7f60a001ce10 comp rx=0 tx=0).stop 2024-04-18T04:54:09.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.534+0000 7f60a7e00640 1 -- 172.21.15.120:0/1658434050 shutdown_connections 2024-04-18T04:54:09.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.534+0000 7f60a7e00640 1 --2- 172.21.15.120:0/1658434050 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6088066760 0x7f6088068c20 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:09.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.534+0000 7f60a7e00640 1 --2- 172.21.15.120:0/1658434050 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60a8166d80 0x7f60a8160a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:09.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.534+0000 7f60a7e00640 1 --2- 172.21.15.120:0/1658434050 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60a8165990 0x7f60a80c1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:09.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.534+0000 7f60a7e00640 1 --2- 172.21.15.120:0/1658434050 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f60a80c73d0 0x7f60a81615e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:09.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.534+0000 7f60a7e00640 1 -- 172.21.15.120:0/1658434050 >> 172.21.15.120:0/1658434050 conn(0x7f60a806d000 msgr2=0x7f60a80c9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:09.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.538+0000 7f60a7e00640 1 -- 172.21.15.120:0/1658434050 shutdown_connections 2024-04-18T04:54:09.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:09.538+0000 7f60a7e00640 1 -- 172.21.15.120:0/1658434050 wait complete. 2024-04-18T04:54:09.610 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:54:11.610 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:54:11.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.870+0000 7f4371e00640 1 Processor -- start 2024-04-18T04:54:11.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.870+0000 7f4371e00640 1 -- start start 2024-04-18T04:54:11.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.874+0000 7f4371e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f436c06b8c0 0x7f436c0c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:11.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.874+0000 7f4371e00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f436c06c0c0 0x7f436c070750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:11.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.874+0000 7f4371e00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f436c06c550 con 0x7f436c06bca0 2024-04-18T04:54:11.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.874+0000 7f4371e00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f436c158610 con 0x7f436c06c0c0 2024-04-18T04:54:11.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.874+0000 7f4371e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f436c0c7740 con 0x7f436c06b8c0 2024-04-18T04:54:11.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.874+0000 7f436a000640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f436c06bca0 0x7f436c151440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:40160/0 (socket says 172.21.15.120:40160) 2024-04-18T04:54:11.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.874+0000 7f436a000640 1 -- 172.21.15.120:0/3524605360 learned_addr learned my addr 172.21.15.120:0/3524605360 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:54:11.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.874+0000 7f436b400640 1 --2- 172.21.15.120:0/3524605360 >> v2:172.21.15.132:3300/0 conn(0x7f436c06c0c0 0x7f436c070750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:11.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.878+0000 7f436b400640 1 -- 172.21.15.120:0/3524605360 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f436c06b8c0 msgr2=0x7f436c0c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:11.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.874+0000 7f436aa00640 1 --2- 172.21.15.120:0/3524605360 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f436c06b8c0 0x7f436c0c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:11.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.878+0000 7f436b400640 1 --2- 172.21.15.120:0/3524605360 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f436c06b8c0 0x7f436c0c7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:11.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.878+0000 7f436b400640 1 -- 172.21.15.120:0/3524605360 >> v1:172.21.15.120:6789/0 conn(0x7f436c06bca0 legacy=0x7f436c151440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:11.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.878+0000 7f436b400640 1 -- 172.21.15.120:0/3524605360 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f436c1576f0 con 0x7f436c06c0c0 2024-04-18T04:54:11.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.878+0000 7f436aa00640 1 --2- 172.21.15.120:0/3524605360 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f436c06b8c0 0x7f436c0c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:54:11.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.886+0000 7f436b400640 1 --2- 172.21.15.120:0/3524605360 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f436c06c0c0 0x7f436c070750 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4364009dc0 tx=0x7f436401f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=847204b1215e4190 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:11.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.890+0000 7f4369600640 1 -- 172.21.15.120:0/3524605360 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43640af600 con 0x7f436c06c0c0 2024-04-18T04:54:11.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.890+0000 7f4369600640 1 -- 172.21.15.120:0/3524605360 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43640ab050 con 0x7f436c06c0c0 2024-04-18T04:54:11.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.890+0000 7f4369600640 1 -- 172.21.15.120:0/3524605360 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43640af980 con 0x7f436c06c0c0 2024-04-18T04:54:11.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.894+0000 7f4371e00640 1 -- 172.21.15.120:0/3524605360 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f436c06c0c0 msgr2=0x7f436c070750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:11.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.894+0000 7f4371e00640 1 --2- 172.21.15.120:0/3524605360 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f436c06c0c0 0x7f436c070750 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4364009dc0 tx=0x7f436401f150 comp rx=0 tx=0).stop 2024-04-18T04:54:11.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.894+0000 7f4371e00640 1 -- 172.21.15.120:0/3524605360 shutdown_connections 2024-04-18T04:54:11.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.894+0000 7f4371e00640 1 --2- 172.21.15.120:0/3524605360 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f436c06c0c0 0x7f436c070750 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:11.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.894+0000 7f4371e00640 1 --2- 172.21.15.120:0/3524605360 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f436c06b8c0 0x7f436c0c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:11.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.894+0000 7f4371e00640 1 -- 172.21.15.120:0/3524605360 >> 172.21.15.120:0/3524605360 conn(0x7f436c0c78c0 msgr2=0x7f436c0c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:11.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.894+0000 7f4371e00640 1 -- 172.21.15.120:0/3524605360 shutdown_connections 2024-04-18T04:54:11.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.898+0000 7f4371e00640 1 -- 172.21.15.120:0/3524605360 wait complete. 2024-04-18T04:54:11.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.898+0000 7f4371e00640 1 Processor -- start 2024-04-18T04:54:11.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.898+0000 7f4371e00640 1 -- start start 2024-04-18T04:54:11.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.902+0000 7f4371e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f436c06b8c0 0x7f436c159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:11.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.902+0000 7f4371e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f436c06bca0 0x7f436c0c2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:11.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.902+0000 7f4371e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f436c06c0c0 0x7f436c0c2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:11.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.902+0000 7f4371e00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436c0b05a0 con 0x7f436c06bca0 2024-04-18T04:54:11.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.902+0000 7f4371e00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436c147a50 con 0x7f436c06c0c0 2024-04-18T04:54:11.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.902+0000 7f4371e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f436c147c40 con 0x7f436c06b8c0 2024-04-18T04:54:11.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.902+0000 7f436aa00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f436c06b8c0 0x7f436c159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:11.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.902+0000 7f436aa00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f436c06b8c0 0x7f436c159a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:52338/0 (socket says 172.21.15.120:52338) 2024-04-18T04:54:11.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.902+0000 7f436aa00640 1 -- 172.21.15.120:0/3501944084 learned_addr learned my addr 172.21.15.120:0/3501944084 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:54:11.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.902+0000 7f436a000640 1 --2- 172.21.15.120:0/3501944084 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f436c06bca0 0x7f436c0c2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:11.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.902+0000 7f436b400640 1 --2- 172.21.15.120:0/3501944084 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f436c06c0c0 0x7f436c0c2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:11.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.902+0000 7f436b400640 1 -- 172.21.15.120:0/3501944084 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f436c06b8c0 msgr2=0x7f436c159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:11.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.902+0000 7f436b400640 1 --2- 172.21.15.120:0/3501944084 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f436c06b8c0 0x7f436c159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:11.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.902+0000 7f436b400640 1 -- 172.21.15.120:0/3501944084 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f436c06bca0 msgr2=0x7f436c0c2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:11.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.902+0000 7f436b400640 1 --2- 172.21.15.120:0/3501944084 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f436c06bca0 0x7f436c0c2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:11.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.902+0000 7f436b400640 1 -- 172.21.15.120:0/3501944084 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4364009a70 con 0x7f436c06c0c0 2024-04-18T04:54:11.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.902+0000 7f436b400640 1 --2- 172.21.15.120:0/3501944084 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f436c06c0c0 0x7f436c0c2b70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f436c06ee30 tx=0x7f436401bef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:11.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.902+0000 7f4363400640 1 -- 172.21.15.120:0/3501944084 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43640afdc0 con 0x7f436c06c0c0 2024-04-18T04:54:11.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.902+0000 7f4363400640 1 -- 172.21.15.120:0/3501944084 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43640c4410 con 0x7f436c06c0c0 2024-04-18T04:54:11.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.902+0000 7f4363400640 1 -- 172.21.15.120:0/3501944084 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43640c47c0 con 0x7f436c06c0c0 2024-04-18T04:54:11.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.902+0000 7f4371e00640 1 -- 172.21.15.120:0/3501944084 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f436c0c1a90 con 0x7f436c06c0c0 2024-04-18T04:54:11.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.902+0000 7f4371e00640 1 -- 172.21.15.120:0/3501944084 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f436c15a580 con 0x7f436c06c0c0 2024-04-18T04:54:11.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.906+0000 7f4360c00640 1 -- 172.21.15.120:0/3501944084 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4340005260 con 0x7f436c06c0c0 2024-04-18T04:54:11.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.906+0000 7f4363400640 1 -- 172.21.15.120:0/3501944084 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f43640b6070 con 0x7f436c06c0c0 2024-04-18T04:54:11.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.906+0000 7f4363400640 1 --2- 172.21.15.120:0/3501944084 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f434c066760 0x7f434c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:11.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.906+0000 7f4363400640 1 -- 172.21.15.120:0/3501944084 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f43641237c0 con 0x7f436c06c0c0 2024-04-18T04:54:11.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.906+0000 7f436aa00640 1 --2- 172.21.15.120:0/3501944084 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f434c066760 0x7f434c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:11.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.906+0000 7f436aa00640 1 --2- 172.21.15.120:0/3501944084 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f434c066760 0x7f434c068c20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4358006fd0 tx=0x7f4358008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:11.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:11.922+0000 7f4363400640 1 -- 172.21.15.120:0/3501944084 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f43640f06f0 con 0x7f436c06c0c0 2024-04-18T04:54:12.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:12.278+0000 7f4360c00640 1 -- 172.21.15.120:0/3501944084 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f43400057e0 con 0x7f436c06c0c0 2024-04-18T04:54:12.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:12.278+0000 7f4363400640 1 -- 172.21.15.120:0/3501944084 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+5522 (secure 0 0 0) 0x7f43640bf090 con 0x7f436c06c0c0 2024-04-18T04:54:12.280 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:54:12.281 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":47,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:53:46.091483+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5105,"mds_1":5400},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_5105":{"gid":5105,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":14,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5400":{"gid":5400,"name":"e","rank":1,"incarnation":44,"state":"up:rejoin","state_seq":19,"addr":"172.21.15.120:6837/671327196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":671327196},{"type":"v1","addr":"172.21.15.120:6837","nonce":671327196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:54:12.281 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 47 2024-04-18T04:54:12.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:12.286+0000 7f4360c00640 1 -- 172.21.15.120:0/3501944084 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f434c066760 msgr2=0x7f434c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:12.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:12.286+0000 7f4360c00640 1 --2- 172.21.15.120:0/3501944084 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f434c066760 0x7f434c068c20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4358006fd0 tx=0x7f4358008040 comp rx=0 tx=0).stop 2024-04-18T04:54:12.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:12.286+0000 7f4360c00640 1 -- 172.21.15.120:0/3501944084 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f436c06c0c0 msgr2=0x7f436c0c2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:12.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:12.286+0000 7f4360c00640 1 --2- 172.21.15.120:0/3501944084 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f436c06c0c0 0x7f436c0c2b70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f436c06ee30 tx=0x7f436401bef0 comp rx=0 tx=0).stop 2024-04-18T04:54:12.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:12.286+0000 7f4360c00640 1 -- 172.21.15.120:0/3501944084 shutdown_connections 2024-04-18T04:54:12.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:12.286+0000 7f4360c00640 1 --2- 172.21.15.120:0/3501944084 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f434c066760 0x7f434c068c20 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:12.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:12.286+0000 7f4360c00640 1 --2- 172.21.15.120:0/3501944084 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f436c06c0c0 0x7f436c0c2b70 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:12.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:12.286+0000 7f4360c00640 1 --2- 172.21.15.120:0/3501944084 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f436c06bca0 0x7f436c0c2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:12.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:12.286+0000 7f4360c00640 1 --2- 172.21.15.120:0/3501944084 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f436c06b8c0 0x7f436c159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:12.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:12.286+0000 7f4360c00640 1 -- 172.21.15.120:0/3501944084 >> 172.21.15.120:0/3501944084 conn(0x7f436c0c78c0 msgr2=0x7f436c0c4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:12.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:12.286+0000 7f4360c00640 1 -- 172.21.15.120:0/3501944084 shutdown_connections 2024-04-18T04:54:12.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:12.286+0000 7f4360c00640 1 -- 172.21.15.120:0/3501944084 wait complete. 2024-04-18T04:54:12.332 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 47, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-18T04:44:30.251235+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 47, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1 ], "info": { "gid_5105": { "addr": "172.21.15.120:6833/3842815393", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6832", "nonce": 3842815393, "type": "v2" }, { "addr": "172.21.15.120:6833", "nonce": 3842815393, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5105, "incarnation": 38, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 14 }, "gid_5400": { "addr": "172.21.15.120:6837/671327196", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6835", "nonce": 671327196, "type": "v2" }, { "addr": "172.21.15.120:6837", "nonce": 671327196, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5400, "incarnation": 44, "join_fscid": -1, "name": "e", "rank": 1, "state": "up:rejoin", "state_seq": 19 } }, "last_failure": 0, "last_failure_osd_epoch": 32, "max_file_size": 1099511627776, "max_mds": 2, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-18T04:53:46.091483+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [ 2 ], "tableserver": 0, "up": { "mds_0": 5105, "mds_1": 5400 } } } ], "standbys": [ { "addr": "172.21.15.132:6839/4292136288", "addrs": { "addrvec": [ { "addr": "172.21.15.132:6836", "nonce": 4292136288, "type": "v2" }, { "addr": "172.21.15.132:6839", "nonce": 4292136288, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4241, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.132:6838/1712856922", "addrs": { "addrvec": [ { "addr": "172.21.15.132:6837", "nonce": 1712856922, "type": "v2" }, { "addr": "172.21.15.132:6838", "nonce": 1712856922, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 2, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4244, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.120:6836/2384594941", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6834", "nonce": 2384594941, "type": "v2" }, { "addr": "172.21.15.120:6836", "nonce": 2384594941, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 33, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5051, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-18T04:54:14.334 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:54:14.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.594+0000 7f49f1c00640 1 Processor -- start 2024-04-18T04:54:14.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.594+0000 7f49f1c00640 1 -- start start 2024-04-18T04:54:14.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.598+0000 7f49f1c00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f49ec06bdf0 0x7f49ec06cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:14.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.598+0000 7f49f1c00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49ec15e880 con 0x7f49ec06c1d0 2024-04-18T04:54:14.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.598+0000 7f49f1c00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49ec0c5b40 con 0x7f49ec0c0460 2024-04-18T04:54:14.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.598+0000 7f49f1c00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49ec0c5e20 con 0x7f49ec06bdf0 2024-04-18T04:54:14.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.598+0000 7f49eb400640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f49ec0c0460 0x7f49ec0c6900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:34650/0 (socket says 172.21.15.120:34650) 2024-04-18T04:54:14.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.598+0000 7f49eb400640 1 -- 172.21.15.120:0/4076006518 learned_addr learned my addr 172.21.15.120:0/4076006518 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:54:14.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.598+0000 7f49ebe00640 1 --2- 172.21.15.120:0/4076006518 >> v2:172.21.15.132:3300/0 conn(0x7f49ec06bdf0 0x7f49ec06cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:14.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.598+0000 7f49eaa00640 1 -- 172.21.15.120:0/4076006518 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1776868039 0 0) 0x7f49ec0c5b40 con 0x7f49ec0c0460 2024-04-18T04:54:14.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.598+0000 7f49eaa00640 1 -- 172.21.15.120:0/4076006518 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49d0003530 con 0x7f49ec0c0460 2024-04-18T04:54:14.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.598+0000 7f49eaa00640 1 -- 172.21.15.120:0/4076006518 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3459936514 0 0) 0x7f49ec15e880 con 0x7f49ec06c1d0 2024-04-18T04:54:14.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.598+0000 7f49eaa00640 1 -- 172.21.15.120:0/4076006518 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49ec0c5b40 con 0x7f49ec06c1d0 2024-04-18T04:54:14.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.598+0000 7f49eaa00640 1 -- 172.21.15.120:0/4076006518 <== mon.1 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1074882859 0 0) 0x7f49d0003530 con 0x7f49ec0c0460 2024-04-18T04:54:14.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.598+0000 7f49eaa00640 1 -- 172.21.15.120:0/4076006518 >> v2:172.21.15.132:3300/0 conn(0x7f49ec06bdf0 msgr2=0x7f49ec06cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:14.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.598+0000 7f49eaa00640 1 --2- 172.21.15.120:0/4076006518 >> v2:172.21.15.132:3300/0 conn(0x7f49ec06bdf0 0x7f49ec06cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:14.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.598+0000 7f49eaa00640 1 -- 172.21.15.120:0/4076006518 >> v1:172.21.15.120:6789/0 conn(0x7f49ec06c1d0 legacy=0x7f49ec157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:14.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.598+0000 7f49eaa00640 1 -- 172.21.15.120:0/4076006518 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ec0c6100 con 0x7f49ec0c0460 2024-04-18T04:54:14.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.598+0000 7f49eaa00640 1 -- 172.21.15.120:0/4076006518 <== mon.1 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7f49d4001680 con 0x7f49ec0c0460 2024-04-18T04:54:14.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.598+0000 7f49eaa00640 1 -- 172.21.15.120:0/4076006518 >> v1:172.21.15.132:6789/0 conn(0x7f49ec0c0460 legacy=0x7f49ec0c6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:14.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.598+0000 7f49eaa00640 1 --2- 172.21.15.120:0/4076006518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49d0004b70 0x7f49d0004f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:14.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.598+0000 7f49eaa00640 1 --2- 172.21.15.120:0/4076006518 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f49d0003770 0x7f49d0003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:14.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.598+0000 7f49eaa00640 1 --2- 172.21.15.120:0/4076006518 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f49d0004130 0x7f49d000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:14.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.598+0000 7f49eaa00640 1 -- 172.21.15.120:0/4076006518 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e40015e0 con 0x7f49d0003770 2024-04-18T04:54:14.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.598+0000 7f49eaa00640 1 -- 172.21.15.120:0/4076006518 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec0c5e20 con 0x7f49d0004b70 2024-04-18T04:54:14.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.598+0000 7f49eaa00640 1 -- 172.21.15.120:0/4076006518 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d000bfd0 con 0x7f49d0004130 2024-04-18T04:54:14.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.598+0000 7f49ebe00640 1 --2- 172.21.15.120:0/4076006518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49d0004b70 0x7f49d0004f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:14.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.602+0000 7f49f1200640 1 --2- 172.21.15.120:0/4076006518 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f49d0004130 0x7f49d000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:14.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.602+0000 7f49eb400640 1 --2- 172.21.15.120:0/4076006518 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f49d0003770 0x7f49d0003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:14.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.602+0000 7f49ebe00640 1 -- 172.21.15.120:0/4076006518 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f49d0004130 msgr2=0x7f49d000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:14.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.602+0000 7f49ebe00640 1 --2- 172.21.15.120:0/4076006518 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f49d0004130 0x7f49d000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:14.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.602+0000 7f49ebe00640 1 -- 172.21.15.120:0/4076006518 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f49d0003770 msgr2=0x7f49d0003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:14.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.602+0000 7f49ebe00640 1 --2- 172.21.15.120:0/4076006518 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f49d0003770 0x7f49d0003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:14.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.602+0000 7f49ebe00640 1 -- 172.21.15.120:0/4076006518 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ec0c6100 con 0x7f49d0004b70 2024-04-18T04:54:14.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.602+0000 7f49eb400640 1 --2- 172.21.15.120:0/4076006518 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f49d0003770 0x7f49d0003bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:54:14.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.602+0000 7f49f1200640 1 --2- 172.21.15.120:0/4076006518 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f49d0004130 0x7f49d000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:54:14.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.602+0000 7f49f1200640 1 -- 172.21.15.120:0/4076006518 reap_dead start 2024-04-18T04:54:14.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.614+0000 7f49ebe00640 1 --2- 172.21.15.120:0/4076006518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49d0004b70 0x7f49d0004f50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f49dc009ae0 tx=0x7f49dc01c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=130100b281a5e03e server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:14.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.614+0000 7f49eaa00640 1 -- 172.21.15.120:0/4076006518 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc0a6440 con 0x7f49d0004b70 2024-04-18T04:54:14.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.614+0000 7f49eaa00640 1 -- 172.21.15.120:0/4076006518 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49dc0a65a0 con 0x7f49d0004b70 2024-04-18T04:54:14.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.614+0000 7f49eaa00640 1 -- 172.21.15.120:0/4076006518 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc0a6990 con 0x7f49d0004b70 2024-04-18T04:54:14.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.618+0000 7f49f1c00640 1 -- 172.21.15.120:0/4076006518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49d0004b70 msgr2=0x7f49d0004f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:14.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.618+0000 7f49f1c00640 1 --2- 172.21.15.120:0/4076006518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49d0004b70 0x7f49d0004f50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f49dc009ae0 tx=0x7f49dc01c950 comp rx=0 tx=0).stop 2024-04-18T04:54:14.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.618+0000 7f49f1c00640 1 -- 172.21.15.120:0/4076006518 shutdown_connections 2024-04-18T04:54:14.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.618+0000 7f49f1c00640 1 --2- 172.21.15.120:0/4076006518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49d0004b70 0x7f49d0004f50 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:14.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.618+0000 7f49f1c00640 1 -- 172.21.15.120:0/4076006518 >> 172.21.15.120:0/4076006518 conn(0x7f49ec0cafa0 msgr2=0x7f49ec0cb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:14.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.618+0000 7f49f1c00640 1 -- 172.21.15.120:0/4076006518 shutdown_connections 2024-04-18T04:54:14.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.618+0000 7f49f1c00640 1 -- 172.21.15.120:0/4076006518 wait complete. 2024-04-18T04:54:14.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.622+0000 7f49f1c00640 1 Processor -- start 2024-04-18T04:54:14.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.622+0000 7f49f1c00640 1 -- start start 2024-04-18T04:54:14.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.626+0000 7f49f1c00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f49d0004b70 0x7f49ec071ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:14.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.626+0000 7f49f1c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f49ec153220 0x7f49ec15b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:14.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.626+0000 7f49f1c00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49ec1f3ee0 0x7f49ec149fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:14.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.626+0000 7f49f1c00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec15d1f0 con 0x7f49ec153220 2024-04-18T04:54:14.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.626+0000 7f49f1c00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec0c9d30 con 0x7f49ec1f3ee0 2024-04-18T04:54:14.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.626+0000 7f49f1c00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec15c210 con 0x7f49d0004b70 2024-04-18T04:54:14.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.626+0000 7f49f1200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49ec1f3ee0 0x7f49ec149fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:14.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.626+0000 7f49f1200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49ec1f3ee0 0x7f49ec149fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:42224/0 (socket says 172.21.15.120:42224) 2024-04-18T04:54:14.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.626+0000 7f49f1200640 1 -- 172.21.15.120:0/2079549448 learned_addr learned my addr 172.21.15.120:0/2079549448 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:54:14.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.626+0000 7f49ebe00640 1 --2- 172.21.15.120:0/2079549448 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f49d0004b70 0x7f49ec071ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:14.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.626+0000 7f49f1200640 1 -- 172.21.15.120:0/2079549448 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f49d0004b70 msgr2=0x7f49ec071ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:14.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.626+0000 7f49f1200640 1 --2- 172.21.15.120:0/2079549448 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f49d0004b70 0x7f49ec071ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:14.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.626+0000 7f49f1200640 1 -- 172.21.15.120:0/2079549448 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f49ec153220 msgr2=0x7f49ec15b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:14.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.626+0000 7f49f1200640 1 --2- 172.21.15.120:0/2079549448 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f49ec153220 0x7f49ec15b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:14.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.626+0000 7f49f1200640 1 -- 172.21.15.120:0/2079549448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ec15c570 con 0x7f49ec1f3ee0 2024-04-18T04:54:14.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.630+0000 7f49f1200640 1 --2- 172.21.15.120:0/2079549448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49ec1f3ee0 0x7f49ec149fe0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f49ec0c8e50 tx=0x7f49e4010f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:14.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.630+0000 7f49e3e00640 1 -- 172.21.15.120:0/2079549448 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e400ebc0 con 0x7f49ec1f3ee0 2024-04-18T04:54:14.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.630+0000 7f49f1c00640 1 -- 172.21.15.120:0/2079549448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49ec15c850 con 0x7f49ec1f3ee0 2024-04-18T04:54:14.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.630+0000 7f49f1c00640 1 -- 172.21.15.120:0/2079549448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49ec15ce10 con 0x7f49ec1f3ee0 2024-04-18T04:54:14.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.630+0000 7f49e3e00640 1 -- 172.21.15.120:0/2079549448 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e400ed40 con 0x7f49ec1f3ee0 2024-04-18T04:54:14.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.630+0000 7f49e3e00640 1 -- 172.21.15.120:0/2079549448 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e4015640 con 0x7f49ec1f3ee0 2024-04-18T04:54:14.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.634+0000 7f49f1c00640 1 -- 172.21.15.120:0/2079549448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49c4005260 con 0x7f49ec1f3ee0 2024-04-18T04:54:14.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.634+0000 7f49e3e00640 1 -- 172.21.15.120:0/2079549448 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f49e401e3b0 con 0x7f49ec1f3ee0 2024-04-18T04:54:14.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.638+0000 7f49e3e00640 1 --2- 172.21.15.120:0/2079549448 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f49c8066690 0x7f49c8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:14.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.638+0000 7f49e3e00640 1 -- 172.21.15.120:0/2079549448 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f49e4087440 con 0x7f49ec1f3ee0 2024-04-18T04:54:14.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.638+0000 7f49ebe00640 1 --2- 172.21.15.120:0/2079549448 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f49c8066690 0x7f49c8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:14.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.638+0000 7f49ebe00640 1 --2- 172.21.15.120:0/2079549448 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f49c8066690 0x7f49c8068b50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f49dc0ad000 tx=0x7f49dc0a9040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:14.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:14.646+0000 7f49e3e00640 1 -- 172.21.15.120:0/2079549448 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f49e4054230 con 0x7f49ec1f3ee0 2024-04-18T04:54:15.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:15.122+0000 7f49f1c00640 1 -- 172.21.15.120:0/2079549448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f49c4005a90 con 0x7f49ec1f3ee0 2024-04-18T04:54:15.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:15.126+0000 7f49e3e00640 1 -- 172.21.15.120:0/2079549448 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+5522 (secure 0 0 0) 0x7f49e4057850 con 0x7f49ec1f3ee0 2024-04-18T04:54:15.134 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:54:15.134 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":47,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:53:46.091483+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5105,"mds_1":5400},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_5105":{"gid":5105,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":14,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5400":{"gid":5400,"name":"e","rank":1,"incarnation":44,"state":"up:rejoin","state_seq":19,"addr":"172.21.15.120:6837/671327196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":671327196},{"type":"v1","addr":"172.21.15.120:6837","nonce":671327196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:54:15.135 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 47 2024-04-18T04:54:15.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:15.142+0000 7f49f1c00640 1 -- 172.21.15.120:0/2079549448 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f49c8066690 msgr2=0x7f49c8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:15.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:15.142+0000 7f49f1c00640 1 --2- 172.21.15.120:0/2079549448 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f49c8066690 0x7f49c8068b50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f49dc0ad000 tx=0x7f49dc0a9040 comp rx=0 tx=0).stop 2024-04-18T04:54:15.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:15.142+0000 7f49f1c00640 1 -- 172.21.15.120:0/2079549448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49ec1f3ee0 msgr2=0x7f49ec149fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:15.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:15.142+0000 7f49f1c00640 1 --2- 172.21.15.120:0/2079549448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49ec1f3ee0 0x7f49ec149fe0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f49ec0c8e50 tx=0x7f49e4010f20 comp rx=0 tx=0).stop 2024-04-18T04:54:15.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:15.146+0000 7f49f1c00640 1 -- 172.21.15.120:0/2079549448 shutdown_connections 2024-04-18T04:54:15.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:15.146+0000 7f49f1c00640 1 --2- 172.21.15.120:0/2079549448 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f49c8066690 0x7f49c8068b50 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:15.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:15.146+0000 7f49f1c00640 1 --2- 172.21.15.120:0/2079549448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49ec1f3ee0 0x7f49ec149fe0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:15.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:15.146+0000 7f49f1c00640 1 --2- 172.21.15.120:0/2079549448 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f49ec153220 0x7f49ec15b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:15.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:15.146+0000 7f49f1c00640 1 --2- 172.21.15.120:0/2079549448 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f49d0004b70 0x7f49ec071ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:15.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:15.146+0000 7f49f1c00640 1 -- 172.21.15.120:0/2079549448 >> 172.21.15.120:0/2079549448 conn(0x7f49ec0cafa0 msgr2=0x7f49ec0c7910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:15.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:15.154+0000 7f49f1c00640 1 -- 172.21.15.120:0/2079549448 shutdown_connections 2024-04-18T04:54:15.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:15.154+0000 7f49f1c00640 1 -- 172.21.15.120:0/2079549448 wait complete. 2024-04-18T04:54:15.198 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:54:17.199 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:54:17.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.538+0000 7f9ee8600640 1 Processor -- start 2024-04-18T04:54:17.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.542+0000 7f9ee8600640 1 -- start start 2024-04-18T04:54:17.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.542+0000 7f9ee8600640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9ee0157ea0 0x7f9ee0071110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:17.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.542+0000 7f9ee8600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9ee006da70 0x7f9ee006df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:17.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.542+0000 7f9ee8600640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ee015da70 con 0x7f9ee015df00 2024-04-18T04:54:17.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.542+0000 7f9ee8600640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ee00c5e40 con 0x7f9ee0157ea0 2024-04-18T04:54:17.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.542+0000 7f9ee8600640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee0158280 con 0x7f9ee006da70 2024-04-18T04:54:17.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.546+0000 7f9ee6600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9ee006da70 0x7f9ee006df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:17.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.546+0000 7f9ee6600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9ee006da70 0x7f9ee006df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:52356/0 (socket says 172.21.15.120:52356) 2024-04-18T04:54:17.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.546+0000 7f9ee6600640 1 -- 172.21.15.120:0/4023886115 learned_addr learned my addr 172.21.15.120:0/4023886115 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:54:17.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.546+0000 7f9ee6600640 1 -- 172.21.15.120:0/4023886115 >> v2:172.21.15.120:3300/0 conn(0x7f9ee0157ea0 msgr2=0x7f9ee0071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:17.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.546+0000 7f9ee6600640 1 --2- 172.21.15.120:0/4023886115 >> v2:172.21.15.120:3300/0 conn(0x7f9ee0157ea0 0x7f9ee0071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:17.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.546+0000 7f9ee6600640 1 -- 172.21.15.120:0/4023886115 >> v1:172.21.15.120:6789/0 conn(0x7f9ee015df00 legacy=0x7f9ee015e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:17.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.546+0000 7f9ee6600640 1 -- 172.21.15.120:0/4023886115 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee00c6020 con 0x7f9ee006da70 2024-04-18T04:54:17.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.550+0000 7f9ee6600640 1 --2- 172.21.15.120:0/4023886115 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9ee006da70 0x7f9ee006df20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8009e50 tx=0x7f9ed801c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7e9d47fd157b6d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:17.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.550+0000 7f9edfe00640 1 -- 172.21.15.120:0/4023886115 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed80a5890 con 0x7f9ee006da70 2024-04-18T04:54:17.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.550+0000 7f9edfe00640 1 -- 172.21.15.120:0/4023886115 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed80a59f0 con 0x7f9ee006da70 2024-04-18T04:54:17.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.550+0000 7f9edfe00640 1 -- 172.21.15.120:0/4023886115 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed80a5d80 con 0x7f9ee006da70 2024-04-18T04:54:17.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.566+0000 7f9ee8600640 1 -- 172.21.15.120:0/4023886115 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9ee006da70 msgr2=0x7f9ee006df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:17.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.566+0000 7f9ee8600640 1 --2- 172.21.15.120:0/4023886115 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9ee006da70 0x7f9ee006df20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8009e50 tx=0x7f9ed801c9f0 comp rx=0 tx=0).stop 2024-04-18T04:54:17.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.570+0000 7f9ee8600640 1 -- 172.21.15.120:0/4023886115 shutdown_connections 2024-04-18T04:54:17.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.570+0000 7f9ee8600640 1 --2- 172.21.15.120:0/4023886115 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9ee006da70 0x7f9ee006df20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:17.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.570+0000 7f9ee8600640 1 --2- 172.21.15.120:0/4023886115 >> v2:172.21.15.120:3300/0 conn(0x7f9ee0157ea0 0x7f9ee0071110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:17.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.570+0000 7f9ee8600640 1 -- 172.21.15.120:0/4023886115 >> 172.21.15.120:0/4023886115 conn(0x7f9ee0066a50 msgr2=0x7f9ee0069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:17.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.570+0000 7f9ee8600640 1 -- 172.21.15.120:0/4023886115 shutdown_connections 2024-04-18T04:54:17.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.570+0000 7f9ee8600640 1 -- 172.21.15.120:0/4023886115 wait complete. 2024-04-18T04:54:17.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.574+0000 7f9ee8600640 1 Processor -- start 2024-04-18T04:54:17.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.574+0000 7f9ee8600640 1 -- start start 2024-04-18T04:54:17.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.578+0000 7f9ee8600640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ee006da70 0x7f9ee013e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:17.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.578+0000 7f9ee8600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9ee0157ea0 0x7f9ee02023c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:17.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.578+0000 7f9ee8600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ee015df00 0x7f9ee0160b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:17.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.578+0000 7f9ee5c00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ee006da70 0x7f9ee013e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:17.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.578+0000 7f9ee5c00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ee006da70 0x7f9ee013e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:42232/0 (socket says 172.21.15.120:42232) 2024-04-18T04:54:17.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.582+0000 7f9ee5200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9ee0157ea0 0x7f9ee02023c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:17.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.582+0000 7f9ee5200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9ee0157ea0 0x7f9ee02023c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:52366/0 (socket says 172.21.15.120:52366) 2024-04-18T04:54:17.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.582+0000 7f9ee6600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ee015df00 0x7f9ee0160b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:17.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.582+0000 7f9ee6600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ee015df00 0x7f9ee0160b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59986/0 (socket says 172.21.15.120:59986) 2024-04-18T04:54:17.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.582+0000 7f9ee5c00640 1 -- 172.21.15.120:0/2717222536 learned_addr learned my addr 172.21.15.120:0/2717222536 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:54:17.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.582+0000 7f9ee8600640 1 -- 172.21.15.120:0/2717222536 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee00c4f30 con 0x7f9ee015df00 2024-04-18T04:54:17.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.586+0000 7f9ee8600640 1 -- 172.21.15.120:0/2717222536 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee00c9e20 con 0x7f9ee006da70 2024-04-18T04:54:17.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.586+0000 7f9ee8600640 1 -- 172.21.15.120:0/2717222536 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee00c9860 con 0x7f9ee0157ea0 2024-04-18T04:54:17.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.586+0000 7f9ee5c00640 1 -- 172.21.15.120:0/2717222536 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9ee0157ea0 msgr2=0x7f9ee02023c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:17.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.586+0000 7f9ee5c00640 1 --2- 172.21.15.120:0/2717222536 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9ee0157ea0 0x7f9ee02023c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:17.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.586+0000 7f9ee5c00640 1 -- 172.21.15.120:0/2717222536 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ee015df00 msgr2=0x7f9ee0160b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:17.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.586+0000 7f9ee5c00640 1 --2- 172.21.15.120:0/2717222536 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ee015df00 0x7f9ee0160b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:17.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.586+0000 7f9ee5c00640 1 -- 172.21.15.120:0/2717222536 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed8009b30 con 0x7f9ee006da70 2024-04-18T04:54:17.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.586+0000 7f9ee6600640 1 --2- 172.21.15.120:0/2717222536 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ee015df00 0x7f9ee0160b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:54:17.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.590+0000 7f9ee5c00640 1 --2- 172.21.15.120:0/2717222536 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ee006da70 0x7f9ee013e370 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9ed400b550 tx=0x7f9ed400ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:17.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.590+0000 7f9edd600640 1 -- 172.21.15.120:0/2717222536 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed4010870 con 0x7f9ee006da70 2024-04-18T04:54:17.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.590+0000 7f9edd600640 1 -- 172.21.15.120:0/2717222536 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed40109f0 con 0x7f9ee006da70 2024-04-18T04:54:17.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.590+0000 7f9edd600640 1 -- 172.21.15.120:0/2717222536 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed4010da0 con 0x7f9ee006da70 2024-04-18T04:54:17.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.590+0000 7f9ee8600640 1 -- 172.21.15.120:0/2717222536 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ee00c9b40 con 0x7f9ee006da70 2024-04-18T04:54:17.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.590+0000 7f9ee8600640 1 -- 172.21.15.120:0/2717222536 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee013cf20 con 0x7f9ee006da70 2024-04-18T04:54:17.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.594+0000 7f9ee8600640 1 -- 172.21.15.120:0/2717222536 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ee013caa0 con 0x7f9ee006da70 2024-04-18T04:54:17.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.594+0000 7f9edd600640 1 -- 172.21.15.120:0/2717222536 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9ed400f3c0 con 0x7f9ee006da70 2024-04-18T04:54:17.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.594+0000 7f9edd600640 1 --2- 172.21.15.120:0/2717222536 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9ec0066690 0x7f9ec0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:17.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.598+0000 7f9ee5200640 1 --2- 172.21.15.120:0/2717222536 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9ec0066690 0x7f9ec0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:17.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.598+0000 7f9ee5200640 1 --2- 172.21.15.120:0/2717222536 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9ec0066690 0x7f9ec0068b50 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9ee00c93d0 tx=0x7f9ecc009060 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:17.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.606+0000 7f9edd600640 1 -- 172.21.15.120:0/2717222536 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f9ed4054670 con 0x7f9ee006da70 2024-04-18T04:54:17.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.610+0000 7f9edd600640 1 -- 172.21.15.120:0/2717222536 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f9ee013caa0 con 0x7f9ee006da70 2024-04-18T04:54:17.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.974+0000 7f9ee8600640 1 -- 172.21.15.120:0/2717222536 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ee013caa0 con 0x7f9ee006da70 2024-04-18T04:54:17.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.974+0000 7f9edd600640 1 -- 172.21.15.120:0/2717222536 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+5522 (secure 0 0 0) 0x7f9ee013caa0 con 0x7f9ee006da70 2024-04-18T04:54:17.975 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:54:17.975 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":47,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:53:46.091483+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5105,"mds_1":5400},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_5105":{"gid":5105,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":14,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5400":{"gid":5400,"name":"e","rank":1,"incarnation":44,"state":"up:rejoin","state_seq":19,"addr":"172.21.15.120:6837/671327196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":671327196},{"type":"v1","addr":"172.21.15.120:6837","nonce":671327196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:54:17.975 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 47 2024-04-18T04:54:17.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.978+0000 7f9ee8600640 1 -- 172.21.15.120:0/2717222536 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9ec0066690 msgr2=0x7f9ec0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:17.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.978+0000 7f9ee8600640 1 --2- 172.21.15.120:0/2717222536 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9ec0066690 0x7f9ec0068b50 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9ee00c93d0 tx=0x7f9ecc009060 comp rx=0 tx=0).stop 2024-04-18T04:54:17.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.978+0000 7f9ee8600640 1 -- 172.21.15.120:0/2717222536 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ee006da70 msgr2=0x7f9ee013e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:17.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.978+0000 7f9ee8600640 1 --2- 172.21.15.120:0/2717222536 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ee006da70 0x7f9ee013e370 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9ed400b550 tx=0x7f9ed400ba10 comp rx=0 tx=0).stop 2024-04-18T04:54:17.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.978+0000 7f9ee8600640 1 -- 172.21.15.120:0/2717222536 shutdown_connections 2024-04-18T04:54:17.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.978+0000 7f9ee8600640 1 --2- 172.21.15.120:0/2717222536 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9ec0066690 0x7f9ec0068b50 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:17.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.978+0000 7f9ee8600640 1 --2- 172.21.15.120:0/2717222536 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ee015df00 0x7f9ee0160b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:17.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.978+0000 7f9ee8600640 1 --2- 172.21.15.120:0/2717222536 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9ee0157ea0 0x7f9ee02023c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:17.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.978+0000 7f9ee8600640 1 --2- 172.21.15.120:0/2717222536 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ee006da70 0x7f9ee013e370 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:17.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.978+0000 7f9ee8600640 1 -- 172.21.15.120:0/2717222536 >> 172.21.15.120:0/2717222536 conn(0x7f9ee0066a50 msgr2=0x7f9ee0069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:17.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.978+0000 7f9ee8600640 1 -- 172.21.15.120:0/2717222536 shutdown_connections 2024-04-18T04:54:17.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:17.978+0000 7f9ee8600640 1 -- 172.21.15.120:0/2717222536 wait complete. 2024-04-18T04:54:18.014 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-18T04:54:20.015 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:54:20.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.266+0000 7f5899800640 1 Processor -- start 2024-04-18T04:54:20.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.266+0000 7f5899800640 1 -- start start 2024-04-18T04:54:20.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.266+0000 7f5899800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f589406d300 0x7f58941590d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:20.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.270+0000 7f5899800640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f58940c7440 0x7f589414f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:20.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.270+0000 7f5899800640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58940708d0 con 0x7f589406d6e0 2024-04-18T04:54:20.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.270+0000 7f5899800640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5894071e40 con 0x7f58940c7440 2024-04-18T04:54:20.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.270+0000 7f5899800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5894159610 con 0x7f589406d300 2024-04-18T04:54:20.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.270+0000 7f5892a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f589406d300 0x7f58941590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:20.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.270+0000 7f5892a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f589406d300 0x7f58941590d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:52370/0 (socket says 172.21.15.120:52370) 2024-04-18T04:54:20.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.270+0000 7f5892a00640 1 -- 172.21.15.120:0/4006650883 learned_addr learned my addr 172.21.15.120:0/4006650883 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:54:20.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.270+0000 7f5893400640 1 --2- 172.21.15.120:0/4006650883 >> v2:172.21.15.132:3300/0 conn(0x7f58940c7440 0x7f589414f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:20.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.270+0000 7f5891600640 1 -- 172.21.15.120:0/4006650883 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2217065686 0 0) 0x7f58940708d0 con 0x7f589406d6e0 2024-04-18T04:54:20.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.270+0000 7f5891600640 1 -- 172.21.15.120:0/4006650883 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5878003530 con 0x7f589406d6e0 2024-04-18T04:54:20.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.270+0000 7f5892a00640 1 -- 172.21.15.120:0/4006650883 >> v2:172.21.15.132:3300/0 conn(0x7f58940c7440 msgr2=0x7f589414f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:20.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.270+0000 7f5892a00640 1 --2- 172.21.15.120:0/4006650883 >> v2:172.21.15.132:3300/0 conn(0x7f58940c7440 0x7f589414f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:20.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.270+0000 7f5892a00640 1 -- 172.21.15.120:0/4006650883 >> v1:172.21.15.120:6789/0 conn(0x7f589406d6e0 legacy=0x7f5894071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:20.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.270+0000 7f5892a00640 1 -- 172.21.15.120:0/4006650883 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5894071a30 con 0x7f589406d300 2024-04-18T04:54:20.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.274+0000 7f5892a00640 1 --2- 172.21.15.120:0/4006650883 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f589406d300 0x7f58941590d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f588c00af60 tx=0x7f588c01db00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27bd743eef408346 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:20.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.274+0000 7f5891600640 1 -- 172.21.15.120:0/4006650883 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588c00a2d0 con 0x7f589406d300 2024-04-18T04:54:20.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.274+0000 7f5891600640 1 -- 172.21.15.120:0/4006650883 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588c0a6870 con 0x7f589406d300 2024-04-18T04:54:20.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.274+0000 7f5891600640 1 -- 172.21.15.120:0/4006650883 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588c0a6c00 con 0x7f589406d300 2024-04-18T04:54:20.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.278+0000 7f5899800640 1 -- 172.21.15.120:0/4006650883 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f589406d300 msgr2=0x7f58941590d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:20.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.278+0000 7f5899800640 1 --2- 172.21.15.120:0/4006650883 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f589406d300 0x7f58941590d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f588c00af60 tx=0x7f588c01db00 comp rx=0 tx=0).stop 2024-04-18T04:54:20.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.278+0000 7f5899800640 1 -- 172.21.15.120:0/4006650883 shutdown_connections 2024-04-18T04:54:20.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.278+0000 7f5899800640 1 --2- 172.21.15.120:0/4006650883 >> v2:172.21.15.132:3300/0 conn(0x7f58940c7440 0x7f589414f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:20.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.278+0000 7f5899800640 1 --2- 172.21.15.120:0/4006650883 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f589406d300 0x7f58941590d0 secure :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f588c00af60 tx=0x7f588c01db00 comp rx=0 tx=0).stop 2024-04-18T04:54:20.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.278+0000 7f5899800640 1 -- 172.21.15.120:0/4006650883 >> 172.21.15.120:0/4006650883 conn(0x7f58940cb1b0 msgr2=0x7f58940cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:20.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.278+0000 7f5899800640 1 -- 172.21.15.120:0/4006650883 shutdown_connections 2024-04-18T04:54:20.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.278+0000 7f5899800640 1 -- 172.21.15.120:0/4006650883 wait complete. 2024-04-18T04:54:20.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.282+0000 7f5899800640 1 Processor -- start 2024-04-18T04:54:20.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.282+0000 7f5899800640 1 -- start start 2024-04-18T04:54:20.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.282+0000 7f5899800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f589406d6e0 0x7f58941527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:20.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.282+0000 7f5899800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58940c7440 0x7f5894152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:20.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.282+0000 7f5899800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f589414eee0 0x7f58941439d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:20.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.282+0000 7f5899800640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5894154480 con 0x7f589414eee0 2024-04-18T04:54:20.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.282+0000 7f5899800640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5894150c10 con 0x7f58940c7440 2024-04-18T04:54:20.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.282+0000 7f5899800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5894151790 con 0x7f589406d6e0 2024-04-18T04:54:20.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.282+0000 7f5892a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f589406d6e0 0x7f58941527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:20.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.282+0000 7f5892a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f589406d6e0 0x7f58941527c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:52382/0 (socket says 172.21.15.120:52382) 2024-04-18T04:54:20.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.282+0000 7f5892a00640 1 -- 172.21.15.120:0/3996507309 learned_addr learned my addr 172.21.15.120:0/3996507309 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:54:20.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.282+0000 7f5892000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58940c7440 0x7f5894152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:20.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.282+0000 7f5892a00640 1 -- 172.21.15.120:0/3996507309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58940c7440 msgr2=0x7f5894152d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:20.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.282+0000 7f5892a00640 1 --2- 172.21.15.120:0/3996507309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58940c7440 0x7f5894152d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:20.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.282+0000 7f5892a00640 1 -- 172.21.15.120:0/3996507309 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f589414eee0 msgr2=0x7f58941439d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:20.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.282+0000 7f5892a00640 1 --2- 172.21.15.120:0/3996507309 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f589414eee0 0x7f58941439d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:20.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.282+0000 7f5892a00640 1 -- 172.21.15.120:0/3996507309 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f588c00ac40 con 0x7f589406d6e0 2024-04-18T04:54:20.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.282+0000 7f5892a00640 1 --2- 172.21.15.120:0/3996507309 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f589406d6e0 0x7f58941527c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f588c01c1b0 tx=0x7f588c01a8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:20.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.282+0000 7f588aa00640 1 -- 172.21.15.120:0/3996507309 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588c0a6e70 con 0x7f589406d6e0 2024-04-18T04:54:20.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.282+0000 7f588aa00640 1 -- 172.21.15.120:0/3996507309 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588c008500 con 0x7f589406d6e0 2024-04-18T04:54:20.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.282+0000 7f588aa00640 1 -- 172.21.15.120:0/3996507309 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588c0088d0 con 0x7f589406d6e0 2024-04-18T04:54:20.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.286+0000 7f5899800640 1 -- 172.21.15.120:0/3996507309 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5894151230 con 0x7f589406d6e0 2024-04-18T04:54:20.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.286+0000 7f5899800640 1 -- 172.21.15.120:0/3996507309 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58941505c0 con 0x7f589406d6e0 2024-04-18T04:54:20.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.286+0000 7f5899800640 1 -- 172.21.15.120:0/3996507309 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58940728f0 con 0x7f589406d6e0 2024-04-18T04:54:20.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.286+0000 7f588aa00640 1 -- 172.21.15.120:0/3996507309 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f588c008a30 con 0x7f589406d6e0 2024-04-18T04:54:20.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.290+0000 7f588aa00640 1 --2- 172.21.15.120:0/3996507309 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f58740666c0 0x7f5874068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:20.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.290+0000 7f588aa00640 1 -- 172.21.15.120:0/3996507309 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f588c11fff0 con 0x7f589406d6e0 2024-04-18T04:54:20.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.290+0000 7f5892000640 1 --2- 172.21.15.120:0/3996507309 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f58740666c0 0x7f5874068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:20.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.290+0000 7f5892000640 1 --2- 172.21.15.120:0/3996507309 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f58740666c0 0x7f5874068b80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f58940c53a0 tx=0x7f5880009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:20.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.290+0000 7f588aa00640 1 -- 172.21.15.120:0/3996507309 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f588c0ecdf0 con 0x7f589406d6e0 2024-04-18T04:54:20.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.654+0000 7f5899800640 1 -- 172.21.15.120:0/3996507309 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f589414f400 con 0x7f589406d6e0 2024-04-18T04:54:20.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.654+0000 7f588aa00640 1 -- 172.21.15.120:0/3996507309 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+5522 (secure 0 0 0) 0x7f588c0f0410 con 0x7f589406d6e0 2024-04-18T04:54:20.658 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:54:20.659 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":48,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:54:18.217132+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5105,"mds_1":5400},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_5105":{"gid":5105,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":14,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5400":{"gid":5400,"name":"e","rank":1,"incarnation":44,"state":"up:active","state_seq":27,"addr":"172.21.15.120:6837/671327196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":671327196},{"type":"v1","addr":"172.21.15.120:6837","nonce":671327196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:54:20.659 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 48 2024-04-18T04:54:20.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.674+0000 7f5899800640 1 -- 172.21.15.120:0/3996507309 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f58740666c0 msgr2=0x7f5874068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:20.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.674+0000 7f5899800640 1 --2- 172.21.15.120:0/3996507309 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f58740666c0 0x7f5874068b80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f58940c53a0 tx=0x7f5880009040 comp rx=0 tx=0).stop 2024-04-18T04:54:20.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.674+0000 7f5899800640 1 -- 172.21.15.120:0/3996507309 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f589406d6e0 msgr2=0x7f58941527c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:20.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.674+0000 7f5899800640 1 --2- 172.21.15.120:0/3996507309 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f589406d6e0 0x7f58941527c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f588c01c1b0 tx=0x7f588c01a8a0 comp rx=0 tx=0).stop 2024-04-18T04:54:20.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.674+0000 7f5899800640 1 -- 172.21.15.120:0/3996507309 shutdown_connections 2024-04-18T04:54:20.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.674+0000 7f5899800640 1 --2- 172.21.15.120:0/3996507309 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f58740666c0 0x7f5874068b80 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:20.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.674+0000 7f5899800640 1 --2- 172.21.15.120:0/3996507309 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f589414eee0 0x7f58941439d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:20.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.674+0000 7f5899800640 1 --2- 172.21.15.120:0/3996507309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58940c7440 0x7f5894152d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:20.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.674+0000 7f5899800640 1 --2- 172.21.15.120:0/3996507309 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f589406d6e0 0x7f58941527c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:20.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.678+0000 7f5899800640 1 -- 172.21.15.120:0/3996507309 >> 172.21.15.120:0/3996507309 conn(0x7f58940cb1b0 msgr2=0x7f5894145f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:20.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.678+0000 7f5899800640 1 -- 172.21.15.120:0/3996507309 shutdown_connections 2024-04-18T04:54:20.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:20.678+0000 7f5899800640 1 -- 172.21.15.120:0/3996507309 wait complete. 2024-04-18T04:54:20.717 INFO:tasks.mds_thrash.fs.[cephfs]:mds.e has gained rank=1, replacing gid=4967 2024-04-18T04:54:20.717 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 3 secs before reviving mds.b 2024-04-18T04:54:23.719 INFO:tasks.mds_thrash.fs.[cephfs]:reviving mds.b 2024-04-18T04:54:23.719 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-18T04:54:23.719 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-18T04:54:23.721 INFO:tasks.ceph.mds.b:Started 2024-04-18T04:54:23.721 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:54:24.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.074+0000 7f0aa5200640 1 Processor -- start 2024-04-18T04:54:24.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.078+0000 7f0aa5200640 1 -- start start 2024-04-18T04:54:24.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.090+0000 7f0aa5200640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0a980e71f0 0x7f0a980462a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:24.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.090+0000 7f0a9de00640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f0a980dd2c0 0x7f0a980e66f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:34508/0 (socket says 172.21.15.120:34508) 2024-04-18T04:54:24.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.090+0000 7f0a9de00640 1 -- 172.21.15.120:0/2752247522 learned_addr learned my addr 172.21.15.120:0/2752247522 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:54:24.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.090+0000 7f0aa5200640 1 --2- 172.21.15.120:0/2752247522 >> v2:172.21.15.132:3300/0 conn(0x7f0a980467e0 0x7f0a9804ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:24.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.090+0000 7f0a9e800640 1 --2- 172.21.15.120:0/2752247522 >> v2:172.21.15.132:3300/0 conn(0x7f0a980467e0 0x7f0a9804ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:24.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.090+0000 7f0aa5200640 1 -- 172.21.15.120:0/2752247522 --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a9804c690 con 0x7f0a980dd2c0 2024-04-18T04:54:24.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.090+0000 7f0aa5200640 1 -- 172.21.15.120:0/2752247522 --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a98046c10 con 0x7f0a980e71f0 2024-04-18T04:54:24.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.090+0000 7f0aa5200640 1 -- 172.21.15.120:0/2752247522 --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a980454e0 con 0x7f0a980467e0 2024-04-18T04:54:24.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.090+0000 7f0a9ca00640 1 -- 172.21.15.120:0/2752247522 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 64815887 0 0) 0x7f0a9804c690 con 0x7f0a980dd2c0 2024-04-18T04:54:24.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.090+0000 7f0a9ca00640 1 -- 172.21.15.120:0/2752247522 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a84003530 con 0x7f0a980dd2c0 2024-04-18T04:54:24.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.090+0000 7f0a9d400640 1 --2- 172.21.15.120:0/2752247522 >> v2:172.21.15.120:3300/0 conn(0x7f0a980e71f0 0x7f0a980462a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:24.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.094+0000 7f0a9ca00640 1 -- 172.21.15.120:0/2752247522 <== mon.1 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1706776306 0 0) 0x7f0a84003530 con 0x7f0a980dd2c0 2024-04-18T04:54:24.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.094+0000 7f0a9ca00640 1 -- 172.21.15.120:0/2752247522 >> v2:172.21.15.132:3300/0 conn(0x7f0a980467e0 msgr2=0x7f0a9804ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:24.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.094+0000 7f0a9ca00640 1 --2- 172.21.15.120:0/2752247522 >> v2:172.21.15.132:3300/0 conn(0x7f0a980467e0 0x7f0a9804ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:24.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.094+0000 7f0a9ca00640 1 -- 172.21.15.120:0/2752247522 >> v2:172.21.15.120:3300/0 conn(0x7f0a980e71f0 msgr2=0x7f0a980462a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:24.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.094+0000 7f0a9ca00640 1 --2- 172.21.15.120:0/2752247522 >> v2:172.21.15.120:3300/0 conn(0x7f0a980e71f0 0x7f0a980462a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:24.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.094+0000 7f0a9ca00640 1 -- 172.21.15.120:0/2752247522 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a980457c0 con 0x7f0a980dd2c0 2024-04-18T04:54:24.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.094+0000 7f0a9ca00640 1 -- 172.21.15.120:0/2752247522 <== mon.1 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7f0a8c001680 con 0x7f0a980dd2c0 2024-04-18T04:54:24.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.094+0000 7f0a9ca00640 1 -- 172.21.15.120:0/2752247522 >> v1:172.21.15.132:6789/0 conn(0x7f0a980dd2c0 legacy=0x7f0a980e66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:24.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.094+0000 7f0a9ca00640 1 --2- 172.21.15.120:0/2752247522 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a84003980 0x7f0a84003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:24.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.094+0000 7f0a9ca00640 1 --2- 172.21.15.120:0/2752247522 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0a840047d0 0x7f0a84004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:24.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.094+0000 7f0a9ca00640 1 --2- 172.21.15.120:0/2752247522 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0a840052b0 0x7f0a8400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:24.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.094+0000 7f0a9ca00640 1 -- 172.21.15.120:0/2752247522 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a980454e0 con 0x7f0a840047d0 2024-04-18T04:54:24.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.094+0000 7f0a9ca00640 1 -- 172.21.15.120:0/2752247522 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8400c1a0 con 0x7f0a84003980 2024-04-18T04:54:24.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.094+0000 7f0a9ca00640 1 -- 172.21.15.120:0/2752247522 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8401d370 con 0x7f0a840052b0 2024-04-18T04:54:24.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.094+0000 7f0a9e800640 1 --2- 172.21.15.120:0/2752247522 >> v2:172.21.15.132:3300/0 conn(0x7f0a980467e0 0x7f0a9804ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:54:24.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.094+0000 7f0a9e800640 1 --2- 172.21.15.120:0/2752247522 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0a840052b0 0x7f0a8400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:24.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.094+0000 7f0a9e800640 1 -- 172.21.15.120:0/2752247522 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a84003980 msgr2=0x7f0a84003da0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-18T04:54:24.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.094+0000 7f0a9e800640 1 --2- 172.21.15.120:0/2752247522 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a84003980 0x7f0a84003da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:24.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.094+0000 7f0a9e800640 1 -- 172.21.15.120:0/2752247522 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0a840047d0 msgr2=0x7f0a84004c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:54:24.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.094+0000 7f0a9e800640 1 --2- 172.21.15.120:0/2752247522 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0a840047d0 0x7f0a84004c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:24.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.094+0000 7f0a9e800640 1 -- 172.21.15.120:0/2752247522 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a980457c0 con 0x7f0a840052b0 2024-04-18T04:54:24.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.106+0000 7f0a9e800640 1 -- 172.21.15.120:0/2752247522 reap_dead start 2024-04-18T04:54:24.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.106+0000 7f0a9e800640 1 --2- 172.21.15.120:0/2752247522 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0a840052b0 0x7f0a8400b990 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0a9000aaa0 tx=0x7f0a9001c6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=502810f1ac41d320 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:24.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.118+0000 7f0a9ca00640 1 -- 172.21.15.120:0/2752247522 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a900ad070 con 0x7f0a840052b0 2024-04-18T04:54:24.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.118+0000 7f0a9ca00640 1 -- 172.21.15.120:0/2752247522 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a900a8420 con 0x7f0a840052b0 2024-04-18T04:54:24.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.118+0000 7f0a9ca00640 1 -- 172.21.15.120:0/2752247522 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a900a87f0 con 0x7f0a840052b0 2024-04-18T04:54:24.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.122+0000 7f0aa5200640 1 -- 172.21.15.120:0/2752247522 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0a840052b0 msgr2=0x7f0a8400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:24.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.122+0000 7f0aa5200640 1 --2- 172.21.15.120:0/2752247522 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0a840052b0 0x7f0a8400b990 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0a9000aaa0 tx=0x7f0a9001c6b0 comp rx=0 tx=0).stop 2024-04-18T04:54:24.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.122+0000 7f0aa5200640 1 -- 172.21.15.120:0/2752247522 shutdown_connections 2024-04-18T04:54:24.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.122+0000 7f0aa5200640 1 --2- 172.21.15.120:0/2752247522 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0a840052b0 0x7f0a8400b990 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:24.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.122+0000 7f0aa5200640 1 -- 172.21.15.120:0/2752247522 >> 172.21.15.120:0/2752247522 conn(0x7f0a98050190 msgr2=0x7f0a980505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:24.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.130+0000 7f0aa5200640 1 -- 172.21.15.120:0/2752247522 shutdown_connections 2024-04-18T04:54:24.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.130+0000 7f0aa5200640 1 -- 172.21.15.120:0/2752247522 wait complete. 2024-04-18T04:54:24.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.130+0000 7f0aa5200640 1 Processor -- start 2024-04-18T04:54:24.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.138+0000 7f0aa5200640 1 -- start start 2024-04-18T04:54:24.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.142+0000 7f0aa5200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0a840052b0 0x7f0a98049cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:24.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.142+0000 7f0aa5200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a980e0720 0x7f0a980069e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:24.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.142+0000 7f0aa5200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0a98173dd0 0x7f0a980e5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:24.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.142+0000 7f0a9de00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0a840052b0 0x7f0a98049cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:24.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.142+0000 7f0a9d400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a980e0720 0x7f0a980069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:24.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.142+0000 7f0a9de00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0a840052b0 0x7f0a98049cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:33734/0 (socket says 172.21.15.120:33734) 2024-04-18T04:54:24.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.142+0000 7f0a9d400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a980e0720 0x7f0a980069e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:40136/0 (socket says 172.21.15.120:40136) 2024-04-18T04:54:24.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.142+0000 7f0aa5200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a980d61c0 con 0x7f0a840052b0 2024-04-18T04:54:24.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.142+0000 7f0aa5200640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a98174380 con 0x7f0a980e0720 2024-04-18T04:54:24.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.142+0000 7f0aa5200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a980cf7f0 con 0x7f0a98173dd0 2024-04-18T04:54:24.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.142+0000 7f0a9de00640 1 -- 172.21.15.120:0/2812416015 learned_addr learned my addr 172.21.15.120:0/2812416015 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:54:24.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.142+0000 7f0a9e800640 1 --2- 172.21.15.120:0/2812416015 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0a98173dd0 0x7f0a980e5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:24.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.142+0000 7f0a9e800640 1 -- 172.21.15.120:0/2812416015 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a980e0720 msgr2=0x7f0a980069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:24.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.142+0000 7f0a9e800640 1 --2- 172.21.15.120:0/2812416015 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a980e0720 0x7f0a980069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:24.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.142+0000 7f0a9e800640 1 -- 172.21.15.120:0/2812416015 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0a840052b0 msgr2=0x7f0a98049cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:24.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.142+0000 7f0a9e800640 1 --2- 172.21.15.120:0/2812416015 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0a840052b0 0x7f0a98049cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:24.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.142+0000 7f0a9e800640 1 -- 172.21.15.120:0/2812416015 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a980cec20 con 0x7f0a98173dd0 2024-04-18T04:54:24.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.142+0000 7f0a9d400640 1 --2- 172.21.15.120:0/2812416015 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a980e0720 0x7f0a980069e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:54:24.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.142+0000 7f0a9e800640 1 --2- 172.21.15.120:0/2812416015 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0a98173dd0 0x7f0a980e5650 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0a9800ddd0 tx=0x7f0a84005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:24.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.146+0000 7f0a96000640 1 -- 172.21.15.120:0/2812416015 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a900b8070 con 0x7f0a98173dd0 2024-04-18T04:54:24.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.146+0000 7f0a96000640 1 -- 172.21.15.120:0/2812416015 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a900ae040 con 0x7f0a98173dd0 2024-04-18T04:54:24.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.146+0000 7f0a96000640 1 -- 172.21.15.120:0/2812416015 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a900ad030 con 0x7f0a98173dd0 2024-04-18T04:54:24.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.150+0000 7f0aa5200640 1 -- 172.21.15.120:0/2812416015 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a980ceec0 con 0x7f0a98173dd0 2024-04-18T04:54:24.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.150+0000 7f0aa5200640 1 -- 172.21.15.120:0/2812416015 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a980cf480 con 0x7f0a98173dd0 2024-04-18T04:54:24.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.154+0000 7f0aa5200640 1 -- 172.21.15.120:0/2812416015 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a980053a0 con 0x7f0a98173dd0 2024-04-18T04:54:24.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.158+0000 7f0a96000640 1 -- 172.21.15.120:0/2812416015 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0a900b3810 con 0x7f0a98173dd0 2024-04-18T04:54:24.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.158+0000 7f0a96000640 1 --2- 172.21.15.120:0/2812416015 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0a80066760 0x7f0a80068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:24.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.162+0000 7f0a96000640 1 -- 172.21.15.120:0/2812416015 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f0a9011e300 con 0x7f0a98173dd0 2024-04-18T04:54:24.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.162+0000 7f0a9de00640 1 --2- 172.21.15.120:0/2812416015 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0a80066760 0x7f0a80068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:24.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.162+0000 7f0a9de00640 1 --2- 172.21.15.120:0/2812416015 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0a80066760 0x7f0a80068c20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c004d60 tx=0x7f0a8c001be0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:24.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.166+0000 7f0a96000640 1 -- 172.21.15.120:0/2812416015 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f0a900eb220 con 0x7f0a98173dd0 2024-04-18T04:54:24.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.650+0000 7f0aa5200640 1 -- 172.21.15.120:0/2812416015 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a980cf930 con 0x7f0a98173dd0 2024-04-18T04:54:24.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.650+0000 7f0a96000640 1 -- 172.21.15.120:0/2812416015 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+5522 (secure 0 0 0) 0x7f0a900ee840 con 0x7f0a98173dd0 2024-04-18T04:54:24.653 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:54:24.653 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":48,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:54:18.217132+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5105,"mds_1":5400},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_5105":{"gid":5105,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":14,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5400":{"gid":5400,"name":"e","rank":1,"incarnation":44,"state":"up:active","state_seq":27,"addr":"172.21.15.120:6837/671327196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":671327196},{"type":"v1","addr":"172.21.15.120:6837","nonce":671327196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:54:24.654 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 48 2024-04-18T04:54:24.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.654+0000 7f0aa5200640 1 -- 172.21.15.120:0/2812416015 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0a80066760 msgr2=0x7f0a80068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:24.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.654+0000 7f0aa5200640 1 --2- 172.21.15.120:0/2812416015 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0a80066760 0x7f0a80068c20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c004d60 tx=0x7f0a8c001be0 comp rx=0 tx=0).stop 2024-04-18T04:54:24.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.654+0000 7f0aa5200640 1 -- 172.21.15.120:0/2812416015 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0a98173dd0 msgr2=0x7f0a980e5650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:24.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.654+0000 7f0aa5200640 1 --2- 172.21.15.120:0/2812416015 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0a98173dd0 0x7f0a980e5650 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0a9800ddd0 tx=0x7f0a84005800 comp rx=0 tx=0).stop 2024-04-18T04:54:24.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.654+0000 7f0aa5200640 1 -- 172.21.15.120:0/2812416015 shutdown_connections 2024-04-18T04:54:24.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.654+0000 7f0aa5200640 1 --2- 172.21.15.120:0/2812416015 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0a80066760 0x7f0a80068c20 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:24.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.654+0000 7f0aa5200640 1 --2- 172.21.15.120:0/2812416015 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0a98173dd0 0x7f0a980e5650 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:24.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.654+0000 7f0aa5200640 1 --2- 172.21.15.120:0/2812416015 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a980e0720 0x7f0a980069e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:24.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.654+0000 7f0aa5200640 1 --2- 172.21.15.120:0/2812416015 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0a840052b0 0x7f0a98049cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:24.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.654+0000 7f0aa5200640 1 -- 172.21.15.120:0/2812416015 >> 172.21.15.120:0/2812416015 conn(0x7f0a98050190 msgr2=0x7f0a980dc930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:24.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.654+0000 7f0aa5200640 1 -- 172.21.15.120:0/2812416015 shutdown_connections 2024-04-18T04:54:24.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:24.654+0000 7f0aa5200640 1 -- 172.21.15.120:0/2812416015 wait complete. 2024-04-18T04:54:24.769 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is in active, standby or standby-replay 2024-04-18T04:54:26.051 INFO:tasks.ceph.mds.b.smithi132.stdout:starting mds.b at 2024-04-18T04:54:26.770 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:54:27.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.054+0000 7fc1ac800640 1 Processor -- start 2024-04-18T04:54:27.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.054+0000 7fc1ac800640 1 -- start start 2024-04-18T04:54:27.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.058+0000 7fc1ac800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1a414fab0 0x7fc1a406c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:27.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.058+0000 7fc1ac800640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1a40c6f00 con 0x7fc1a406b660 2024-04-18T04:54:27.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.058+0000 7fc1ac800640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1a40c57c0 con 0x7fc1a41562a0 2024-04-18T04:54:27.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.058+0000 7fc1ac800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a406cb30 con 0x7fc1a414fab0 2024-04-18T04:54:27.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.058+0000 7fc1a9e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1a414fab0 0x7fc1a406c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:27.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.058+0000 7fc1a9400640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fc1a41562a0 0x7fc1a40c6210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:34514/0 (socket says 172.21.15.120:34514) 2024-04-18T04:54:27.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.058+0000 7fc1a9400640 1 -- 172.21.15.120:0/1427790527 learned_addr learned my addr 172.21.15.120:0/1427790527 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:54:27.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.062+0000 7fc1a9e00640 1 -- 172.21.15.120:0/1427790527 >> v1:172.21.15.132:6789/0 conn(0x7fc1a41562a0 legacy=0x7fc1a40c6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:27.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.062+0000 7fc1a9e00640 1 -- 172.21.15.120:0/1427790527 >> v1:172.21.15.120:6789/0 conn(0x7fc1a406b660 legacy=0x7fc1a41600c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:54:27.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.062+0000 7fc1a9e00640 1 -- 172.21.15.120:0/1427790527 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a40c5d80 con 0x7fc1a414fab0 2024-04-18T04:54:27.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.066+0000 7fc1a9e00640 1 --2- 172.21.15.120:0/1427790527 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1a414fab0 0x7fc1a406c5f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc194007200 tx=0x7fc194020da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9573d5e979f4b6d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:27.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.066+0000 7fc1a8a00640 1 -- 172.21.15.120:0/1427790527 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc194008be0 con 0x7fc1a414fab0 2024-04-18T04:54:27.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.066+0000 7fc1a8a00640 1 -- 172.21.15.120:0/1427790527 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc194008d40 con 0x7fc1a414fab0 2024-04-18T04:54:27.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.066+0000 7fc1a8a00640 1 -- 172.21.15.120:0/1427790527 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1940aabb0 con 0x7fc1a414fab0 2024-04-18T04:54:27.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.066+0000 7fc1ac800640 1 -- 172.21.15.120:0/1427790527 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1a414fab0 msgr2=0x7fc1a406c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:27.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.066+0000 7fc1ac800640 1 --2- 172.21.15.120:0/1427790527 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1a414fab0 0x7fc1a406c5f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc194007200 tx=0x7fc194020da0 comp rx=0 tx=0).stop 2024-04-18T04:54:27.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.074+0000 7fc1ac800640 1 -- 172.21.15.120:0/1427790527 shutdown_connections 2024-04-18T04:54:27.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.074+0000 7fc1ac800640 1 --2- 172.21.15.120:0/1427790527 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1a414fab0 0x7fc1a406c5f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:27.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.074+0000 7fc1ac800640 1 -- 172.21.15.120:0/1427790527 >> 172.21.15.120:0/1427790527 conn(0x7fc1a40c78c0 msgr2=0x7fc1a40c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:27.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.078+0000 7fc1ac800640 1 -- 172.21.15.120:0/1427790527 shutdown_connections 2024-04-18T04:54:27.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.082+0000 7fc1ac800640 1 -- 172.21.15.120:0/1427790527 wait complete. 2024-04-18T04:54:27.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.082+0000 7fc1ac800640 1 Processor -- start 2024-04-18T04:54:27.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.086+0000 7fc1ac800640 1 -- start start 2024-04-18T04:54:27.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.086+0000 7fc1ac800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1a406b660 0x7fc1a4148ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:27.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.086+0000 7fc1a9e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1a406b660 0x7fc1a4148ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:27.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.086+0000 7fc1a9e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1a406b660 0x7fc1a4148ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:33736/0 (socket says 172.21.15.120:33736) 2024-04-18T04:54:27.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.086+0000 7fc1a9e00640 1 -- 172.21.15.120:0/1438042337 learned_addr learned my addr 172.21.15.120:0/1438042337 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:54:27.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.086+0000 7fc1ac800640 1 --2- 172.21.15.120:0/1438042337 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1a414fab0 0x7fc1a4141300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:27.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.086+0000 7fc1ac800640 1 --2- 172.21.15.120:0/1438042337 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1a41562a0 0x7fc1a414d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:27.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.086+0000 7fc1a9400640 1 --2- 172.21.15.120:0/1438042337 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1a414fab0 0x7fc1a4141300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:27.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.086+0000 7fc1ac800640 1 -- 172.21.15.120:0/1438042337 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a4152370 con 0x7fc1a406b660 2024-04-18T04:54:27.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.086+0000 7fc1ac800640 1 -- 172.21.15.120:0/1438042337 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a413e2c0 con 0x7fc1a414fab0 2024-04-18T04:54:27.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.086+0000 7fc1ac800640 1 -- 172.21.15.120:0/1438042337 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a41485e0 con 0x7fc1a41562a0 2024-04-18T04:54:27.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.086+0000 7fc1aa800640 1 --2- 172.21.15.120:0/1438042337 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1a41562a0 0x7fc1a414d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:27.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.086+0000 7fc1a9400640 1 -- 172.21.15.120:0/1438042337 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1a41562a0 msgr2=0x7fc1a414d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:27.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.086+0000 7fc1a9400640 1 --2- 172.21.15.120:0/1438042337 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1a41562a0 0x7fc1a414d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:27.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.086+0000 7fc1a9400640 1 -- 172.21.15.120:0/1438042337 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1a406b660 msgr2=0x7fc1a4148ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:27.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.086+0000 7fc1a9400640 1 --2- 172.21.15.120:0/1438042337 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1a406b660 0x7fc1a4148ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:27.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.086+0000 7fc1a9400640 1 -- 172.21.15.120:0/1438042337 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc19400ae50 con 0x7fc1a414fab0 2024-04-18T04:54:27.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.090+0000 7fc1a9400640 1 --2- 172.21.15.120:0/1438042337 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1a414fab0 0x7fc1a4141300 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc1a000cad0 tx=0x7fc1a000cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:27.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.090+0000 7fc19e000640 1 -- 172.21.15.120:0/1438042337 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a000abd0 con 0x7fc1a414fab0 2024-04-18T04:54:27.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.090+0000 7fc19e000640 1 -- 172.21.15.120:0/1438042337 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a000ad30 con 0x7fc1a414fab0 2024-04-18T04:54:27.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.090+0000 7fc19e000640 1 -- 172.21.15.120:0/1438042337 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a000aea0 con 0x7fc1a414fab0 2024-04-18T04:54:27.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.090+0000 7fc1ac800640 1 -- 172.21.15.120:0/1438042337 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1a41488c0 con 0x7fc1a414fab0 2024-04-18T04:54:27.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.090+0000 7fc1ac800640 1 -- 172.21.15.120:0/1438042337 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1a4140de0 con 0x7fc1a414fab0 2024-04-18T04:54:27.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.090+0000 7fc1ac800640 1 -- 172.21.15.120:0/1438042337 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1a4072a70 con 0x7fc1a414fab0 2024-04-18T04:54:27.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.094+0000 7fc19e000640 1 -- 172.21.15.120:0/1438042337 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc1a0007070 con 0x7fc1a414fab0 2024-04-18T04:54:27.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.094+0000 7fc19e000640 1 --2- 172.21.15.120:0/1438042337 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc1880666c0 0x7fc188068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:54:27.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.094+0000 7fc19e000640 1 -- 172.21.15.120:0/1438042337 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7fc1a0084420 con 0x7fc1a414fab0 2024-04-18T04:54:27.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.102+0000 7fc19e000640 1 -- 172.21.15.120:0/1438042337 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fc1a00512c0 con 0x7fc1a414fab0 2024-04-18T04:54:27.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.106+0000 7fc1a9e00640 1 --2- 172.21.15.120:0/1438042337 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc1880666c0 0x7fc188068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:54:27.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.106+0000 7fc1a9e00640 1 --2- 172.21.15.120:0/1438042337 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc1880666c0 0x7fc188068b80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc194020de0 tx=0x7fc19400e040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:54:27.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.574+0000 7fc1ac800640 1 -- 172.21.15.120:0/1438042337 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1a414ebc0 con 0x7fc1a414fab0 2024-04-18T04:54:27.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.578+0000 7fc19e000640 1 -- 172.21.15.120:0/1438042337 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+6279 (secure 0 0 0) 0x7fc1a00548e0 con 0x7fc1a414fab0 2024-04-18T04:54:27.580 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:54:27.580 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":49,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5602,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/450336204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":450336204},{"type":"v1","addr":"172.21.15.132:6835","nonce":450336204}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:54:18.217132+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5105,"mds_1":5400},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_5105":{"gid":5105,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":14,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5400":{"gid":5400,"name":"e","rank":1,"incarnation":44,"state":"up:active","state_seq":27,"addr":"172.21.15.120:6837/671327196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":671327196},{"type":"v1","addr":"172.21.15.120:6837","nonce":671327196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:54:27.580 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 49 2024-04-18T04:54:27.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.586+0000 7fc1ac800640 1 -- 172.21.15.120:0/1438042337 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc1880666c0 msgr2=0x7fc188068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:27.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.586+0000 7fc1ac800640 1 --2- 172.21.15.120:0/1438042337 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc1880666c0 0x7fc188068b80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc194020de0 tx=0x7fc19400e040 comp rx=0 tx=0).stop 2024-04-18T04:54:27.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.586+0000 7fc1ac800640 1 -- 172.21.15.120:0/1438042337 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1a414fab0 msgr2=0x7fc1a4141300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:54:27.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.586+0000 7fc1ac800640 1 --2- 172.21.15.120:0/1438042337 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1a414fab0 0x7fc1a4141300 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc1a000cad0 tx=0x7fc1a000cf90 comp rx=0 tx=0).stop 2024-04-18T04:54:27.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.586+0000 7fc1ac800640 1 -- 172.21.15.120:0/1438042337 shutdown_connections 2024-04-18T04:54:27.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.586+0000 7fc1ac800640 1 --2- 172.21.15.120:0/1438042337 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fc1880666c0 0x7fc188068b80 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:27.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.586+0000 7fc1ac800640 1 --2- 172.21.15.120:0/1438042337 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1a41562a0 0x7fc1a414d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:27.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.586+0000 7fc1ac800640 1 --2- 172.21.15.120:0/1438042337 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1a414fab0 0x7fc1a4141300 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:27.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.586+0000 7fc1ac800640 1 --2- 172.21.15.120:0/1438042337 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1a406b660 0x7fc1a4148ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:54:27.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.586+0000 7fc1ac800640 1 -- 172.21.15.120:0/1438042337 >> 172.21.15.120:0/1438042337 conn(0x7fc1a40c78c0 msgr2=0x7fc1a406bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:54:27.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.590+0000 7fc1ac800640 1 -- 172.21.15.120:0/1438042337 shutdown_connections 2024-04-18T04:54:27.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:54:27.590+0000 7fc1ac800640 1 -- 172.21.15.120:0/1438042337 wait complete. 2024-04-18T04:54:27.628 INFO:tasks.mds_thrash.fs.[cephfs]:mds.b reported in up:standby state 2024-04-18T04:54:27.628 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 70 secs before thrashing 2024-04-18T04:55:08.176 INFO:tasks.workunit.client.0.smithi120.stdout:Syncing()...100 sec 2024-04-18T04:55:08.176 INFO:tasks.workunit.client.0.smithi120.stdout:FFSB benchmark finished at: Thu Apr 18 04:55:08 2024 2024-04-18T04:55:08.176 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-04-18T04:55:08.177 INFO:tasks.workunit.client.0.smithi120.stdout:Results: 2024-04-18T04:55:08.177 INFO:tasks.workunit.client.0.smithi120.stdout:Benchmark took 412.55 sec 2024-04-18T04:55:08.177 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-04-18T04:55:08.177 INFO:tasks.workunit.client.0.smithi120.stdout:Total Results 2024-04-18T04:55:08.177 INFO:tasks.workunit.client.0.smithi120.stdout:=============== 2024-04-18T04:55:08.177 INFO:tasks.workunit.client.0.smithi120.stdout: Op Name Transactions Trans/sec % Trans % Op Weight Throughput 2024-04-18T04:55:08.177 INFO:tasks.workunit.client.0.smithi120.stdout: ======= ============ ========= ======= =========== ========== 2024-04-18T04:55:08.177 INFO:tasks.workunit.client.0.smithi120.stdout: write : 6714880 16276.34 100.000% 100.000% 63.6MB/sec 2024-04-18T04:55:08.177 INFO:tasks.workunit.client.0.smithi120.stdout:- 2024-04-18T04:55:08.177 INFO:tasks.workunit.client.0.smithi120.stdout:16276.34 Transactions per Second 2024-04-18T04:55:08.177 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-04-18T04:55:08.177 INFO:tasks.workunit.client.0.smithi120.stdout:Throughput Results 2024-04-18T04:55:08.177 INFO:tasks.workunit.client.0.smithi120.stdout:=================== 2024-04-18T04:55:08.177 INFO:tasks.workunit.client.0.smithi120.stdout:Write Throughput: 63.6MB/sec 2024-04-18T04:55:08.242 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-04-18T04:55:08.243 INFO:tasks.workunit.client.0.smithi120.stdout:System Call Latency statistics in millisecs 2024-04-18T04:55:08.243 INFO:tasks.workunit.client.0.smithi120.stdout:===== 2024-04-18T04:55:08.243 INFO:tasks.workunit.client.0.smithi120.stdout: Min Avg Max Total Calls 2024-04-18T04:55:08.243 INFO:tasks.workunit.client.0.smithi120.stdout: ======== ======== ======== ============ 2024-04-18T04:55:08.243 INFO:tasks.workunit.client.0.smithi120.stdout:[ open] 0.017000 7.626606 1112.729004 5246 2024-04-18T04:55:08.243 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-04-18T04:55:08.243 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-04-18T04:55:08.243 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[2] 1000.000000 - 2000.000000 : 1 2024-04-18T04:55:08.243 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[3] 500.000000 - 1000.000000 : 30 2024-04-18T04:55:08.243 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[4] 200.000000 - 500.000000 : 41 2024-04-18T04:55:08.243 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[5] 100.000000 - 200.000000 : 12 2024-04-18T04:55:08.243 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[6] 50.000000 - 100.000000 : 22 2024-04-18T04:55:08.243 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[7] 20.000000 - 50.000000 : 45 2024-04-18T04:55:08.244 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[8] 10.000000 - 20.000000 : 66 2024-04-18T04:55:08.244 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[9] 5.000000 - 10.000000 : 90 2024-04-18T04:55:08.244 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[10] 2.000000 - 5.000000 : 90 2024-04-18T04:55:08.244 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[11] 1.000000 - 2.000000 : 53 2024-04-18T04:55:08.244 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[12] 0.500000 - 1.000000 : 19 2024-04-18T04:55:08.244 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[13] 0.200000 - 0.500000 : 43 2024-04-18T04:55:08.244 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[14] 0.100000 - 0.200000 : 99 2024-04-18T04:55:08.244 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[15] 0.050000 - 0.100000 : 215 2024-04-18T04:55:08.244 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[16] 0.020000 - 0.050000 : 4414 2024-04-18T04:55:08.244 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[17] 0.010000 - 0.020000 : 6 2024-04-18T04:55:08.244 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-04-18T04:55:08.244 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-04-18T04:55:08.244 INFO:tasks.workunit.client.0.smithi120.stdout:[ write] 0.003000 1.332548 48106.761719 6714880 2024-04-18T04:55:08.244 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[0] 5000.000000 - 10000.000000 : 208 2024-04-18T04:55:08.244 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[1] 2000.000000 - 5000.000000 : 314 2024-04-18T04:55:08.245 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[2] 1000.000000 - 2000.000000 : 192 2024-04-18T04:55:08.245 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[3] 500.000000 - 1000.000000 : 183 2024-04-18T04:55:08.245 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[4] 200.000000 - 500.000000 : 4967 2024-04-18T04:55:08.245 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[5] 100.000000 - 200.000000 : 9499 2024-04-18T04:55:08.245 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[6] 50.000000 - 100.000000 : 11782 2024-04-18T04:55:08.245 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[7] 20.000000 - 50.000000 : 2760 2024-04-18T04:55:08.245 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[8] 10.000000 - 20.000000 : 2544 2024-04-18T04:55:08.245 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[9] 5.000000 - 10.000000 : 2635 2024-04-18T04:55:08.245 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[10] 2.000000 - 5.000000 : 4064 2024-04-18T04:55:08.245 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[11] 1.000000 - 2.000000 : 3003 2024-04-18T04:55:08.245 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[12] 0.500000 - 1.000000 : 2954 2024-04-18T04:55:08.245 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[13] 0.200000 - 0.500000 : 5587 2024-04-18T04:55:08.245 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[14] 0.100000 - 0.200000 : 7635 2024-04-18T04:55:08.245 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[15] 0.050000 - 0.100000 : 18443 2024-04-18T04:55:08.246 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[16] 0.020000 - 0.050000 : 187861 2024-04-18T04:55:08.246 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[17] 0.010000 - 0.020000 : 2858619 2024-04-18T04:55:08.246 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[18] 0.000000 - 0.010000 : 3591519 2024-04-18T04:55:08.246 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-04-18T04:55:08.246 INFO:tasks.workunit.client.0.smithi120.stdout:[ lseek] 0.000000 0.002364 98.901001 6714880 2024-04-18T04:55:08.246 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-04-18T04:55:08.246 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-04-18T04:55:08.246 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-04-18T04:55:08.246 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-04-18T04:55:08.246 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-04-18T04:55:08.246 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-04-18T04:55:08.246 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[6] 50.000000 - 100.000000 : 5 2024-04-18T04:55:08.246 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[7] 20.000000 - 50.000000 : 81 2024-04-18T04:55:08.247 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[8] 10.000000 - 20.000000 : 213 2024-04-18T04:55:08.247 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[9] 5.000000 - 10.000000 : 193 2024-04-18T04:55:08.247 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[10] 2.000000 - 5.000000 : 310 2024-04-18T04:55:08.247 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[11] 1.000000 - 2.000000 : 221 2024-04-18T04:55:08.247 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[12] 0.500000 - 1.000000 : 258 2024-04-18T04:55:08.247 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[13] 0.200000 - 0.500000 : 412 2024-04-18T04:55:08.247 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[14] 0.100000 - 0.200000 : 409 2024-04-18T04:55:08.247 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[15] 0.050000 - 0.100000 : 736 2024-04-18T04:55:08.247 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[16] 0.020000 - 0.050000 : 3695 2024-04-18T04:55:08.247 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[17] 0.010000 - 0.020000 : 2618 2024-04-18T04:55:08.247 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[18] 0.000000 - 0.010000 : 6705729 2024-04-18T04:55:08.247 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-04-18T04:55:08.247 INFO:tasks.workunit.client.0.smithi120.stdout:[ close] 0.004000 0.012639 7.872000 5246 2024-04-18T04:55:08.247 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-04-18T04:55:08.247 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-04-18T04:55:08.248 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-04-18T04:55:08.248 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-04-18T04:55:08.248 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-04-18T04:55:08.248 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-04-18T04:55:08.248 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-04-18T04:55:08.248 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[7] 20.000000 - 50.000000 : 0 2024-04-18T04:55:08.248 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[8] 10.000000 - 20.000000 : 0 2024-04-18T04:55:08.248 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[9] 5.000000 - 10.000000 : 1 2024-04-18T04:55:08.248 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[10] 2.000000 - 5.000000 : 1 2024-04-18T04:55:08.248 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[11] 1.000000 - 2.000000 : 1 2024-04-18T04:55:08.248 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[12] 0.500000 - 1.000000 : 2 2024-04-18T04:55:08.248 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[13] 0.200000 - 0.500000 : 6 2024-04-18T04:55:08.248 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[14] 0.100000 - 0.200000 : 3 2024-04-18T04:55:08.248 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[15] 0.050000 - 0.100000 : 7 2024-04-18T04:55:08.249 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[16] 0.020000 - 0.050000 : 38 2024-04-18T04:55:08.249 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[17] 0.010000 - 0.020000 : 2830 2024-04-18T04:55:08.249 INFO:tasks.workunit.client.0.smithi120.stdout: msec_range[18] 0.000000 - 0.010000 : 2357 2024-04-18T04:55:08.249 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-04-18T04:55:08.249 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-04-18T04:55:08.249 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-04-18T04:55:08.249 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-04-18T04:55:08.249 INFO:tasks.workunit.client.0.smithi120.stdout:1.7% User Time 2024-04-18T04:55:08.249 INFO:tasks.workunit.client.0.smithi120.stdout:18.2% System Time 2024-04-18T04:55:08.249 INFO:tasks.workunit.client.0.smithi120.stdout:19.9% CPU Utilization 2024-04-18T04:55:14.751 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-18T04:55:14.752 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-18T04:55:14.774 INFO:tasks.workunit:Stopping ['suites/ffsb.sh'] on client.0... 2024-04-18T04:55:14.774 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-18T04:55:15.990 DEBUG:teuthology.parallel:result is None 2024-04-18T04:55:15.990 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-18T04:55:16.019 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-18T04:55:16.019 DEBUG:teuthology.run_tasks:Unwinding manager mds_thrash 2024-04-18T04:55:16.030 INFO:tasks.mds_thrash:joining mds_thrasher 2024-04-18T04:55:16.030 INFO:tasks.mds_thrash.fs.[cephfs]:stat['max_mds'] = 1 2024-04-18T04:55:16.030 INFO:tasks.mds_thrash.fs.[cephfs]:stat['deactivate'] = 0 2024-04-18T04:55:16.030 INFO:tasks.mds_thrash.fs.[cephfs]:stat['kill'] = 5 2024-04-18T04:55:16.030 INFO:tasks.mds_thrash:done joining 2024-04-18T04:55:16.030 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-18T04:55:16.049 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-18T04:55:16.049 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-18T04:55:16.049 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-18T04:55:16.103 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-18T04:55:16.103 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-18T04:55:16.165 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T04:55:16.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.405+0000 7fe76f200640 1 Processor -- start 2024-04-18T04:55:16.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.405+0000 7fe76f200640 1 -- start start 2024-04-18T04:55:16.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.409+0000 7fe76f200640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe7681573c0 0x7fe76806fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:16.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.409+0000 7fe76f200640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7681577d0 con 0x7fe7681515e0 2024-04-18T04:55:16.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.409+0000 7fe76f200640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe768157a50 con 0x7fe7680ccee0 2024-04-18T04:55:16.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.409+0000 7fe76f200640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7680c3120 con 0x7fe7681573c0 2024-04-18T04:55:16.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.409+0000 7fe767e00640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fe7681515e0 0x7fe7680ca280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:40142/0 (socket says 172.21.15.120:40142) 2024-04-18T04:55:16.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.409+0000 7fe767e00640 1 -- 172.21.15.120:0/2426691322 learned_addr learned my addr 172.21.15.120:0/2426691322 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:55:16.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.409+0000 7fe767400640 1 --2- 172.21.15.120:0/2426691322 >> v2:172.21.15.132:3300/0 conn(0x7fe7681573c0 0x7fe76806fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:16.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.409+0000 7fe766a00640 1 -- 172.21.15.120:0/2426691322 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2175732631 0 0) 0x7fe7681577d0 con 0x7fe7681515e0 2024-04-18T04:55:16.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.409+0000 7fe766a00640 1 -- 172.21.15.120:0/2426691322 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe74c003530 con 0x7fe7681515e0 2024-04-18T04:55:16.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.409+0000 7fe766a00640 1 -- 172.21.15.120:0/2426691322 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2407796677 0 0) 0x7fe74c003530 con 0x7fe7681515e0 2024-04-18T04:55:16.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.409+0000 7fe766a00640 1 -- 172.21.15.120:0/2426691322 >> v2:172.21.15.132:3300/0 conn(0x7fe7681573c0 msgr2=0x7fe76806fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:16.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.409+0000 7fe766a00640 1 --2- 172.21.15.120:0/2426691322 >> v2:172.21.15.132:3300/0 conn(0x7fe7681573c0 0x7fe76806fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:16.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.409+0000 7fe766a00640 1 -- 172.21.15.120:0/2426691322 >> v1:172.21.15.132:6789/0 conn(0x7fe7680ccee0 legacy=0x7fe768161d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:16.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.409+0000 7fe766a00640 1 -- 172.21.15.120:0/2426691322 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe768157d10 con 0x7fe7681515e0 2024-04-18T04:55:16.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.409+0000 7fe766a00640 1 -- 172.21.15.120:0/2426691322 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7fe758001680 con 0x7fe7681515e0 2024-04-18T04:55:16.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.409+0000 7fe766a00640 1 -- 172.21.15.120:0/2426691322 >> v1:172.21.15.120:6789/0 conn(0x7fe7681515e0 legacy=0x7fe7680ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:16.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.409+0000 7fe766a00640 1 --2- 172.21.15.120:0/2426691322 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe74c003980 0x7fe74c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:16.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.409+0000 7fe766a00640 1 --2- 172.21.15.120:0/2426691322 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe74c0047d0 0x7fe74c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:16.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.409+0000 7fe766a00640 1 --2- 172.21.15.120:0/2426691322 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe74c005190 0x7fe74c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:16.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.409+0000 7fe766a00640 1 -- 172.21.15.120:0/2426691322 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c00c010 con 0x7fe74c003980 2024-04-18T04:55:16.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.409+0000 7fe766a00640 1 -- 172.21.15.120:0/2426691322 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c00c180 con 0x7fe74c005190 2024-04-18T04:55:16.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.409+0000 7fe766a00640 1 -- 172.21.15.120:0/2426691322 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c00c340 con 0x7fe74c0047d0 2024-04-18T04:55:16.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.409+0000 7fe767e00640 1 --2- 172.21.15.120:0/2426691322 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe74c003980 0x7fe74c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:16.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.409+0000 7fe76d200640 1 --2- 172.21.15.120:0/2426691322 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe74c005190 0x7fe74c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:16.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.409+0000 7fe767400640 1 --2- 172.21.15.120:0/2426691322 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe74c0047d0 0x7fe74c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:16.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.409+0000 7fe767e00640 1 -- 172.21.15.120:0/2426691322 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe74c0047d0 msgr2=0x7fe74c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:16.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.409+0000 7fe767e00640 1 --2- 172.21.15.120:0/2426691322 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe74c0047d0 0x7fe74c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:16.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.409+0000 7fe767e00640 1 -- 172.21.15.120:0/2426691322 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe74c005190 msgr2=0x7fe74c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:16.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.409+0000 7fe767e00640 1 --2- 172.21.15.120:0/2426691322 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe74c005190 0x7fe74c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:16.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.409+0000 7fe767e00640 1 -- 172.21.15.120:0/2426691322 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74c003530 con 0x7fe74c003980 2024-04-18T04:55:16.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.409+0000 7fe767400640 1 --2- 172.21.15.120:0/2426691322 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe74c0047d0 0x7fe74c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:55:16.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.409+0000 7fe76d200640 1 --2- 172.21.15.120:0/2426691322 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe74c005190 0x7fe74c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:55:16.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.409+0000 7fe76d200640 1 -- 172.21.15.120:0/2426691322 reap_dead start 2024-04-18T04:55:16.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.413+0000 7fe767e00640 1 --2- 172.21.15.120:0/2426691322 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe74c003980 0x7fe74c003dc0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe75800c240 tx=0x7fe75801f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2721185ebf0a1240 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:16.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.413+0000 7fe766a00640 1 -- 172.21.15.120:0/2426691322 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe758005ae0 con 0x7fe74c003980 2024-04-18T04:55:16.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.413+0000 7fe766a00640 1 -- 172.21.15.120:0/2426691322 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7580ab070 con 0x7fe74c003980 2024-04-18T04:55:16.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.413+0000 7fe766a00640 1 -- 172.21.15.120:0/2426691322 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe758007070 con 0x7fe74c003980 2024-04-18T04:55:16.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.413+0000 7fe76f200640 1 -- 172.21.15.120:0/2426691322 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe74c003980 msgr2=0x7fe74c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:16.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.413+0000 7fe76f200640 1 --2- 172.21.15.120:0/2426691322 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe74c003980 0x7fe74c003dc0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe75800c240 tx=0x7fe75801f3d0 comp rx=0 tx=0).stop 2024-04-18T04:55:16.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.413+0000 7fe76f200640 1 -- 172.21.15.120:0/2426691322 shutdown_connections 2024-04-18T04:55:16.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.413+0000 7fe76f200640 1 --2- 172.21.15.120:0/2426691322 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe74c003980 0x7fe74c003dc0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:16.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.413+0000 7fe76f200640 1 -- 172.21.15.120:0/2426691322 >> 172.21.15.120:0/2426691322 conn(0x7fe76806e0f0 msgr2=0x7fe768071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:16.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.413+0000 7fe76f200640 1 -- 172.21.15.120:0/2426691322 shutdown_connections 2024-04-18T04:55:16.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.413+0000 7fe76f200640 1 -- 172.21.15.120:0/2426691322 wait complete. 2024-04-18T04:55:16.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.413+0000 7fe76f200640 1 Processor -- start 2024-04-18T04:55:16.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.413+0000 7fe76f200640 1 -- start start 2024-04-18T04:55:16.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.417+0000 7fe76f200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe74c003980 0x7fe7680c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:16.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.417+0000 7fe76f200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe768154ba0 0x7fe7681519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:16.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.417+0000 7fe76f200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7681eca90 0x7fe7681ecf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:16.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.417+0000 7fe76f200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7681ed480 con 0x7fe74c003980 2024-04-18T04:55:16.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.417+0000 7fe76f200640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7681f0bb0 con 0x7fe7681eca90 2024-04-18T04:55:16.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.417+0000 7fe76f200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7681effa0 con 0x7fe768154ba0 2024-04-18T04:55:16.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.417+0000 7fe767e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe74c003980 0x7fe7680c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:16.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.417+0000 7fe767e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe74c003980 0x7fe7680c7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36718/0 (socket says 172.21.15.120:36718) 2024-04-18T04:55:16.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.417+0000 7fe767e00640 1 -- 172.21.15.120:0/1919037115 learned_addr learned my addr 172.21.15.120:0/1919037115 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:16.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.417+0000 7fe767400640 1 --2- 172.21.15.120:0/1919037115 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe768154ba0 0x7fe7681519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:16.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.417+0000 7fe76d200640 1 --2- 172.21.15.120:0/1919037115 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7681eca90 0x7fe7681ecf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:16.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.417+0000 7fe767e00640 1 -- 172.21.15.120:0/1919037115 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe768154ba0 msgr2=0x7fe7681519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:16.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.417+0000 7fe767e00640 1 --2- 172.21.15.120:0/1919037115 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe768154ba0 0x7fe7681519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:16.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.417+0000 7fe767e00640 1 -- 172.21.15.120:0/1919037115 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7681eca90 msgr2=0x7fe7681ecf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:16.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.417+0000 7fe767e00640 1 --2- 172.21.15.120:0/1919037115 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7681eca90 0x7fe7681ecf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:16.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.417+0000 7fe767e00640 1 -- 172.21.15.120:0/1919037115 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7681f0280 con 0x7fe74c003980 2024-04-18T04:55:16.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.417+0000 7fe767400640 1 --2- 172.21.15.120:0/1919037115 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe768154ba0 0x7fe7681519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:55:16.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.417+0000 7fe767e00640 1 --2- 172.21.15.120:0/1919037115 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe74c003980 0x7fe7680c7eb0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe75800c240 tx=0x7fe74c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:16.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.417+0000 7fe75fe00640 1 -- 172.21.15.120:0/1919037115 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe758004ab0 con 0x7fe74c003980 2024-04-18T04:55:16.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.417+0000 7fe75fe00640 1 -- 172.21.15.120:0/1919037115 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe758004c10 con 0x7fe74c003980 2024-04-18T04:55:16.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.417+0000 7fe75fe00640 1 -- 172.21.15.120:0/1919037115 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe758007070 con 0x7fe74c003980 2024-04-18T04:55:16.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.417+0000 7fe76f200640 1 -- 172.21.15.120:0/1919037115 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7681f0560 con 0x7fe74c003980 2024-04-18T04:55:16.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.417+0000 7fe76f200640 1 -- 172.21.15.120:0/1919037115 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7681522e0 con 0x7fe74c003980 2024-04-18T04:55:16.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.417+0000 7fe76f200640 1 -- 172.21.15.120:0/1919037115 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe768072a70 con 0x7fe74c003980 2024-04-18T04:55:16.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.421+0000 7fe75fe00640 1 -- 172.21.15.120:0/1919037115 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe7580071d0 con 0x7fe74c003980 2024-04-18T04:55:16.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.421+0000 7fe75fe00640 1 --2- 172.21.15.120:0/1919037115 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fe7480666c0 0x7fe748068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:16.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.421+0000 7fe75fe00640 1 -- 172.21.15.120:0/1919037115 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7fe7580b7070 con 0x7fe74c003980 2024-04-18T04:55:16.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.421+0000 7fe767400640 1 --2- 172.21.15.120:0/1919037115 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fe7480666c0 0x7fe748068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:16.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.421+0000 7fe767400640 1 --2- 172.21.15.120:0/1919037115 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fe7480666c0 0x7fe748068b80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe768156330 tx=0x7fe754008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:16.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.425+0000 7fe75fe00640 1 -- 172.21.15.120:0/1919037115 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fe7580ee230 con 0x7fe74c003980 2024-04-18T04:55:16.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.581+0000 7fe76f200640 1 -- 172.21.15.120:0/1919037115 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7680ccc30 con 0x7fe74c003980 2024-04-18T04:55:16.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.581+0000 7fe75fe00640 1 -- 172.21.15.120:0/1919037115 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+18910 (secure 0 0 0) 0x7fe7580f1850 con 0x7fe74c003980 2024-04-18T04:55:16.581 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:55:16.581 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":32,"fsid":"8e73592f-08e2-4957-a98f-9d044cec4ba5","created":"2024-04-18T04:44:06.139983+0000","modified":"2024-04-18T04:53:26.031496+0000","last_up_change":"2024-04-18T04:44:17.410146+0000","last_in_change":"2024-04-18T04:44:08.470250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T04:44:16.864728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T04:44:28.825773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T04:44:29.245857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-18T04:44:32.314302+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a80903bd-d9be-4fb9-af99-6125cb26bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":27468},{"type":"v1","addr":"172.21.15.120:6801","nonce":27468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":27468},{"type":"v1","addr":"172.21.15.120:6803","nonce":27468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":27468},{"type":"v1","addr":"172.21.15.120:6807","nonce":27468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":27468},{"type":"v1","addr":"172.21.15.120:6805","nonce":27468}]},"public_addr":"172.21.15.120:6801/27468","cluster_addr":"172.21.15.120:6803/27468","heartbeat_back_addr":"172.21.15.120:6807/27468","heartbeat_front_addr":"172.21.15.120:6805/27468","state":["exists","up"]},{"osd":1,"uuid":"8f5f004b-6870-4c78-8d50-9622e631ec25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":27470},{"type":"v1","addr":"172.21.15.120:6823","nonce":27470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":27470},{"type":"v1","addr":"172.21.15.120:6827","nonce":27470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":27470},{"type":"v1","addr":"172.21.15.120:6831","nonce":27470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":27470},{"type":"v1","addr":"172.21.15.120:6829","nonce":27470}]},"public_addr":"172.21.15.120:6823/27470","cluster_addr":"172.21.15.120:6827/27470","heartbeat_back_addr":"172.21.15.120:6831/27470","heartbeat_front_addr":"172.21.15.120:6829/27470","state":["exists","up"]},{"osd":2,"uuid":"6e228a2b-6103-4301-a8b5-ee81dbb1f920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":27471},{"type":"v1","addr":"172.21.15.120:6817","nonce":27471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":27471},{"type":"v1","addr":"172.21.15.120:6819","nonce":27471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":27471},{"type":"v1","addr":"172.21.15.120:6826","nonce":27471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":27471},{"type":"v1","addr":"172.21.15.120:6822","nonce":27471}]},"public_addr":"172.21.15.120:6817/27471","cluster_addr":"172.21.15.120:6819/27471","heartbeat_back_addr":"172.21.15.120:6826/27471","heartbeat_front_addr":"172.21.15.120:6822/27471","state":["exists","up"]},{"osd":3,"uuid":"7a5cabd7-d898-4e32-a03c-25b46e790134","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":27469},{"type":"v1","addr":"172.21.15.120:6809","nonce":27469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":27469},{"type":"v1","addr":"172.21.15.120:6811","nonce":27469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":27469},{"type":"v1","addr":"172.21.15.120:6815","nonce":27469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":27469},{"type":"v1","addr":"172.21.15.120:6813","nonce":27469}]},"public_addr":"172.21.15.120:6809/27469","cluster_addr":"172.21.15.120:6811/27469","heartbeat_back_addr":"172.21.15.120:6815/27469","heartbeat_front_addr":"172.21.15.120:6813/27469","state":["exists","up"]},{"osd":4,"uuid":"8e9f530f-6bab-4b23-a1a3-a71362fefcc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":28102},{"type":"v1","addr":"172.21.15.132:6825","nonce":28102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":28102},{"type":"v1","addr":"172.21.15.132:6827","nonce":28102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":28102},{"type":"v1","addr":"172.21.15.132:6831","nonce":28102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":28102},{"type":"v1","addr":"172.21.15.132:6829","nonce":28102}]},"public_addr":"172.21.15.132:6825/28102","cluster_addr":"172.21.15.132:6827/28102","heartbeat_back_addr":"172.21.15.132:6831/28102","heartbeat_front_addr":"172.21.15.132:6829/28102","state":["exists","up"]},{"osd":5,"uuid":"2243fabe-cc81-40cf-91bc-f106fe275a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":28104},{"type":"v1","addr":"172.21.15.132:6809","nonce":28104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":28104},{"type":"v1","addr":"172.21.15.132:6811","nonce":28104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":28104},{"type":"v1","addr":"172.21.15.132:6815","nonce":28104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":28104},{"type":"v1","addr":"172.21.15.132:6813","nonce":28104}]},"public_addr":"172.21.15.132:6809/28104","cluster_addr":"172.21.15.132:6811/28104","heartbeat_back_addr":"172.21.15.132:6815/28104","heartbeat_front_addr":"172.21.15.132:6813/28104","state":["exists","up"]},{"osd":6,"uuid":"c093a5ed-25c8-41a7-a20d-606a1a1661e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":28103},{"type":"v1","addr":"172.21.15.132:6801","nonce":28103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":28103},{"type":"v1","addr":"172.21.15.132:6803","nonce":28103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":28103},{"type":"v1","addr":"172.21.15.132:6807","nonce":28103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":28103},{"type":"v1","addr":"172.21.15.132:6805","nonce":28103}]},"public_addr":"172.21.15.132:6801/28103","cluster_addr":"172.21.15.132:6803/28103","heartbeat_back_addr":"172.21.15.132:6807/28103","heartbeat_front_addr":"172.21.15.132:6805/28103","state":["exists","up"]},{"osd":7,"uuid":"c37426b7-1080-4434-9f3e-a3afbbdc0fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":28129},{"type":"v1","addr":"172.21.15.132:6817","nonce":28129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":28129},{"type":"v1","addr":"172.21.15.132:6819","nonce":28129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":28129},{"type":"v1","addr":"172.21.15.132:6823","nonce":28129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":28129},{"type":"v1","addr":"172.21.15.132:6821","nonce":28129}]},"public_addr":"172.21.15.132:6817/28129","cluster_addr":"172.21.15.132:6819/28129","heartbeat_back_addr":"172.21.15.132:6823/28129","heartbeat_front_addr":"172.21.15.132:6821/28129","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.053825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.289753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.274645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.146361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.943883+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.701955+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.851076+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.800782+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":1}]},{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.132:6835/396956733":"2024-04-19T04:53:26.031128+0000","172.21.15.132:6834/396956733":"2024-04-19T04:53:26.031128+0000","172.21.15.120:6837/76856194":"2024-04-19T04:52:05.993392+0000","172.21.15.120:6835/76856194":"2024-04-19T04:52:05.993392+0000","172.21.15.120:6836/1079090700":"2024-04-19T04:50:25.928576+0000","172.21.15.132:6835/1552155328":"2024-04-19T04:48:30.875534+0000","172.21.15.132:6834/1552155328":"2024-04-19T04:48:30.875534+0000","172.21.15.120:6834/1079090700":"2024-04-19T04:50:25.928576+0000","172.21.15.120:6833/2564667113":"2024-04-19T04:47:00.847858+0000","172.21.15.120:6832/2564667113":"2024-04-19T04:47:00.847858+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T04:55:16.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.585+0000 7fe76f200640 1 -- 172.21.15.120:0/1919037115 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fe7480666c0 msgr2=0x7fe748068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:16.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.585+0000 7fe76f200640 1 --2- 172.21.15.120:0/1919037115 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fe7480666c0 0x7fe748068b80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe768156330 tx=0x7fe754008040 comp rx=0 tx=0).stop 2024-04-18T04:55:16.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.585+0000 7fe76f200640 1 -- 172.21.15.120:0/1919037115 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe74c003980 msgr2=0x7fe7680c7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:16.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.585+0000 7fe76f200640 1 --2- 172.21.15.120:0/1919037115 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe74c003980 0x7fe7680c7eb0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe75800c240 tx=0x7fe74c005800 comp rx=0 tx=0).stop 2024-04-18T04:55:16.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.585+0000 7fe76f200640 1 -- 172.21.15.120:0/1919037115 shutdown_connections 2024-04-18T04:55:16.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.585+0000 7fe76f200640 1 --2- 172.21.15.120:0/1919037115 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fe7480666c0 0x7fe748068b80 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:16.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.585+0000 7fe76f200640 1 --2- 172.21.15.120:0/1919037115 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7681eca90 0x7fe7681ecf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:16.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.585+0000 7fe76f200640 1 --2- 172.21.15.120:0/1919037115 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe768154ba0 0x7fe7681519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:16.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.585+0000 7fe76f200640 1 --2- 172.21.15.120:0/1919037115 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe74c003980 0x7fe7680c7eb0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:16.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.585+0000 7fe76f200640 1 -- 172.21.15.120:0/1919037115 >> 172.21.15.120:0/1919037115 conn(0x7fe76806e0f0 msgr2=0x7fe7681564c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:16.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.585+0000 7fe76f200640 1 -- 172.21.15.120:0/1919037115 shutdown_connections 2024-04-18T04:55:16.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.585+0000 7fe76f200640 1 -- 172.21.15.120:0/1919037115 wait complete. 2024-04-18T04:55:16.601 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T04:44:16.864728+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T04:44:28.825773+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T04:44:29.245857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-18T04:44:32.314302+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-18T04:55:16.602 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T04:55:16.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.745+0000 7ff1b4000640 1 Processor -- start 2024-04-18T04:55:16.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.745+0000 7ff1b4000640 1 -- start start 2024-04-18T04:55:16.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.745+0000 7ff1b4000640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff1ac0c1fe0 0x7ff1ac157db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:16.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.745+0000 7ff1b4000640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff1ac0c79c0 0x7ff1ac0c23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:16.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.745+0000 7ff1b4000640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1ac157920 con 0x7ff1ac0c3ef0 2024-04-18T04:55:16.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.745+0000 7ff1b4000640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1ac1582f0 con 0x7ff1ac0c79c0 2024-04-18T04:55:16.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.745+0000 7ff1b4000640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1ac0c2900 con 0x7ff1ac0c1fe0 2024-04-18T04:55:16.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.745+0000 7ff1b2000640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7ff1ac0c3ef0 0x7ff1ac15a920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:40148/0 (socket says 172.21.15.120:40148) 2024-04-18T04:55:16.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.745+0000 7ff1b2000640 1 -- 172.21.15.120:0/681620976 learned_addr learned my addr 172.21.15.120:0/681620976 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:55:16.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.745+0000 7ff1b0c00640 1 --2- 172.21.15.120:0/681620976 >> v2:172.21.15.120:3300/0 conn(0x7ff1ac0c79c0 0x7ff1ac0c23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:16.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.745+0000 7ff1b1600640 1 --2- 172.21.15.120:0/681620976 >> v2:172.21.15.132:3300/0 conn(0x7ff1ac0c1fe0 0x7ff1ac157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:16.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.745+0000 7ff1abe00640 1 -- 172.21.15.120:0/681620976 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 675562046 0 0) 0x7ff1ac157920 con 0x7ff1ac0c3ef0 2024-04-18T04:55:16.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.749+0000 7ff1b0c00640 1 -- 172.21.15.120:0/681620976 >> v2:172.21.15.132:3300/0 conn(0x7ff1ac0c1fe0 msgr2=0x7ff1ac157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:16.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.749+0000 7ff1b0c00640 1 --2- 172.21.15.120:0/681620976 >> v2:172.21.15.132:3300/0 conn(0x7ff1ac0c1fe0 0x7ff1ac157db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:16.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.749+0000 7ff1b0c00640 1 -- 172.21.15.120:0/681620976 >> v1:172.21.15.120:6789/0 conn(0x7ff1ac0c3ef0 legacy=0x7ff1ac15a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:16.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.749+0000 7ff1b0c00640 1 -- 172.21.15.120:0/681620976 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ac06e9a0 con 0x7ff1ac0c79c0 2024-04-18T04:55:16.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.749+0000 7ff1b0c00640 1 --2- 172.21.15.120:0/681620976 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1ac0c79c0 0x7ff1ac0c23c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac0cdc90 tx=0x7ff19801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e88689f90f820da0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:16.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.749+0000 7ff1abe00640 1 -- 172.21.15.120:0/681620976 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1980a8970 con 0x7ff1ac0c79c0 2024-04-18T04:55:16.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.749+0000 7ff1abe00640 1 -- 172.21.15.120:0/681620976 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1980a8ad0 con 0x7ff1ac0c79c0 2024-04-18T04:55:16.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.749+0000 7ff1abe00640 1 -- 172.21.15.120:0/681620976 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1980a8e60 con 0x7ff1ac0c79c0 2024-04-18T04:55:16.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.749+0000 7ff1b4000640 1 -- 172.21.15.120:0/681620976 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1ac0c79c0 msgr2=0x7ff1ac0c23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:16.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.749+0000 7ff1b4000640 1 --2- 172.21.15.120:0/681620976 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1ac0c79c0 0x7ff1ac0c23c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac0cdc90 tx=0x7ff19801ec70 comp rx=0 tx=0).stop 2024-04-18T04:55:16.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.749+0000 7ff1b4000640 1 -- 172.21.15.120:0/681620976 shutdown_connections 2024-04-18T04:55:16.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.749+0000 7ff1b4000640 1 --2- 172.21.15.120:0/681620976 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1ac0c79c0 0x7ff1ac0c23c0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:16.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.749+0000 7ff1b4000640 1 --2- 172.21.15.120:0/681620976 >> v2:172.21.15.132:3300/0 conn(0x7ff1ac0c1fe0 0x7ff1ac157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:16.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.749+0000 7ff1b4000640 1 -- 172.21.15.120:0/681620976 >> 172.21.15.120:0/681620976 conn(0x7ff1ac072190 msgr2=0x7ff1ac065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:16.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.749+0000 7ff1b4000640 1 -- 172.21.15.120:0/681620976 shutdown_connections 2024-04-18T04:55:16.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.749+0000 7ff1b4000640 1 -- 172.21.15.120:0/681620976 wait complete. 2024-04-18T04:55:16.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.753+0000 7ff1b4000640 1 Processor -- start 2024-04-18T04:55:16.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.753+0000 7ff1b4000640 1 -- start start 2024-04-18T04:55:16.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.753+0000 7ff1b4000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1ac0c1fe0 0x7ff1ac06c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:16.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.753+0000 7ff1b4000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff1ac0c3ef0 0x7ff1ac1f1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:16.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.753+0000 7ff1b4000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1ac0c79c0 0x7ff1ac149ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:16.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.753+0000 7ff1b4000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac1eeda0 con 0x7ff1ac0c79c0 2024-04-18T04:55:16.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.753+0000 7ff1b4000640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac06c950 con 0x7ff1ac0c1fe0 2024-04-18T04:55:16.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.753+0000 7ff1b4000640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac06cc30 con 0x7ff1ac0c3ef0 2024-04-18T04:55:16.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.753+0000 7ff1b2000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1ac0c79c0 0x7ff1ac149ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:16.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.753+0000 7ff1b2000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1ac0c79c0 0x7ff1ac149ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36736/0 (socket says 172.21.15.120:36736) 2024-04-18T04:55:16.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.753+0000 7ff1b2000640 1 -- 172.21.15.120:0/1303304610 learned_addr learned my addr 172.21.15.120:0/1303304610 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:16.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.753+0000 7ff1b0c00640 1 --2- 172.21.15.120:0/1303304610 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff1ac0c3ef0 0x7ff1ac1f1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:16.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.753+0000 7ff1b1600640 1 --2- 172.21.15.120:0/1303304610 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1ac0c1fe0 0x7ff1ac06c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:16.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.753+0000 7ff1b2000640 1 -- 172.21.15.120:0/1303304610 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff1ac0c3ef0 msgr2=0x7ff1ac1f1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:16.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.753+0000 7ff1b2000640 1 --2- 172.21.15.120:0/1303304610 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff1ac0c3ef0 0x7ff1ac1f1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:16.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.753+0000 7ff1b2000640 1 -- 172.21.15.120:0/1303304610 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1ac0c1fe0 msgr2=0x7ff1ac06c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:16.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.753+0000 7ff1b2000640 1 --2- 172.21.15.120:0/1303304610 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1ac0c1fe0 0x7ff1ac06c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:16.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.753+0000 7ff1b2000640 1 -- 172.21.15.120:0/1303304610 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff198009420 con 0x7ff1ac0c79c0 2024-04-18T04:55:16.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.753+0000 7ff1b2000640 1 --2- 172.21.15.120:0/1303304610 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1ac0c79c0 0x7ff1ac149ee0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4001570 tx=0x7ff1a400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:16.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.753+0000 7ff1a9600640 1 -- 172.21.15.120:0/1303304610 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a400a640 con 0x7ff1ac0c79c0 2024-04-18T04:55:16.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.753+0000 7ff1a9600640 1 -- 172.21.15.120:0/1303304610 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a400a7c0 con 0x7ff1ac0c79c0 2024-04-18T04:55:16.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.753+0000 7ff1a9600640 1 -- 172.21.15.120:0/1303304610 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a400ab70 con 0x7ff1ac0c79c0 2024-04-18T04:55:16.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.753+0000 7ff1b4000640 1 -- 172.21.15.120:0/1303304610 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1ac1ee750 con 0x7ff1ac0c79c0 2024-04-18T04:55:16.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.753+0000 7ff1b4000640 1 -- 172.21.15.120:0/1303304610 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1ac14a420 con 0x7ff1ac0c79c0 2024-04-18T04:55:16.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.757+0000 7ff1b4000640 1 -- 172.21.15.120:0/1303304610 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1ac067590 con 0x7ff1ac0c79c0 2024-04-18T04:55:16.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.757+0000 7ff1a9600640 1 -- 172.21.15.120:0/1303304610 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff1a400acd0 con 0x7ff1ac0c79c0 2024-04-18T04:55:16.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.757+0000 7ff1a9600640 1 --2- 172.21.15.120:0/1303304610 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff18c066690 0x7ff18c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:16.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.757+0000 7ff1a9600640 1 -- 172.21.15.120:0/1303304610 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7ff1a4083ce0 con 0x7ff1ac0c79c0 2024-04-18T04:55:16.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.757+0000 7ff1b1600640 1 --2- 172.21.15.120:0/1303304610 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff18c066690 0x7ff18c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:16.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.757+0000 7ff1b1600640 1 --2- 172.21.15.120:0/1303304610 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff18c066690 0x7ff18c068b50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0009b60 tx=0x7ff1a0009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:16.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.761+0000 7ff1a9600640 1 -- 172.21.15.120:0/1303304610 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7ff1a4050af0 con 0x7ff1ac0c79c0 2024-04-18T04:55:16.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.917+0000 7ff1b4000640 1 -- 172.21.15.120:0/1303304610 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff1ac0729d0 con 0x7ff1ac0c79c0 2024-04-18T04:55:16.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.917+0000 7ff1a9600640 1 -- 172.21.15.120:0/1303304610 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff1a4018070 con 0x7ff1ac0c79c0 2024-04-18T04:55:16.916 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2024-04-18T04:55:16.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.921+0000 7ff1b4000640 1 -- 172.21.15.120:0/1303304610 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff18c066690 msgr2=0x7ff18c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:16.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.921+0000 7ff1b4000640 1 --2- 172.21.15.120:0/1303304610 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff18c066690 0x7ff18c068b50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0009b60 tx=0x7ff1a0009190 comp rx=0 tx=0).stop 2024-04-18T04:55:16.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.921+0000 7ff1b4000640 1 -- 172.21.15.120:0/1303304610 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1ac0c79c0 msgr2=0x7ff1ac149ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:16.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.921+0000 7ff1b4000640 1 --2- 172.21.15.120:0/1303304610 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1ac0c79c0 0x7ff1ac149ee0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4001570 tx=0x7ff1a400cca0 comp rx=0 tx=0).stop 2024-04-18T04:55:16.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.921+0000 7ff1b4000640 1 -- 172.21.15.120:0/1303304610 shutdown_connections 2024-04-18T04:55:16.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.921+0000 7ff1b4000640 1 --2- 172.21.15.120:0/1303304610 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff18c066690 0x7ff18c068b50 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:16.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.921+0000 7ff1b4000640 1 --2- 172.21.15.120:0/1303304610 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1ac0c79c0 0x7ff1ac149ee0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:16.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.921+0000 7ff1b4000640 1 --2- 172.21.15.120:0/1303304610 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff1ac0c3ef0 0x7ff1ac1f1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:16.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.921+0000 7ff1b4000640 1 --2- 172.21.15.120:0/1303304610 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1ac0c1fe0 0x7ff1ac06c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:16.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.921+0000 7ff1b4000640 1 -- 172.21.15.120:0/1303304610 >> 172.21.15.120:0/1303304610 conn(0x7ff1ac072190 msgr2=0x7ff1ac065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:16.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.921+0000 7ff1b4000640 1 -- 172.21.15.120:0/1303304610 shutdown_connections 2024-04-18T04:55:16.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:16.921+0000 7ff1b4000640 1 -- 172.21.15.120:0/1303304610 wait complete. 2024-04-18T04:55:16.937 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T04:55:17.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.149+0000 7f8580000640 1 Processor -- start 2024-04-18T04:55:17.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.149+0000 7f8580000640 1 -- start start 2024-04-18T04:55:17.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.149+0000 7f8580000640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8578150620 0x7f8578156d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:17.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.149+0000 7f8580000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8578072010 0x7f85780714d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:17.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.149+0000 7f8580000640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8578070e50 con 0x7f8578072450 2024-04-18T04:55:17.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.149+0000 7f8580000640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8578157240 con 0x7f8578150620 2024-04-18T04:55:17.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.149+0000 7f8580000640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85780c81c0 con 0x7f8578072010 2024-04-18T04:55:17.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.149+0000 7f857cc00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8578072010 0x7f85780714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:17.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.149+0000 7f857d600640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8578150620 0x7f8578156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:17.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.149+0000 7f857cc00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8578072010 0x7f85780714d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:57380/0 (socket says 172.21.15.120:57380) 2024-04-18T04:55:17.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.149+0000 7f857cc00640 1 -- 172.21.15.120:0/438332629 learned_addr learned my addr 172.21.15.120:0/438332629 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:17.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.153+0000 7f8577e00640 1 -- 172.21.15.120:0/438332629 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2445446317 0 0) 0x7f85700014a0 con 0x7f8578072450 2024-04-18T04:55:17.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.153+0000 7f8577e00640 1 -- 172.21.15.120:0/438332629 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8560003530 con 0x7f8578072450 2024-04-18T04:55:17.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.157+0000 7f857cc00640 1 -- 172.21.15.120:0/438332629 >> v2:172.21.15.132:3300/0 conn(0x7f8578150620 msgr2=0x7f8578156d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:17.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.157+0000 7f857cc00640 1 --2- 172.21.15.120:0/438332629 >> v2:172.21.15.132:3300/0 conn(0x7f8578150620 0x7f8578156d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:17.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.157+0000 7f857cc00640 1 -- 172.21.15.120:0/438332629 >> v1:172.21.15.120:6789/0 conn(0x7f8578072450 legacy=0x7f85780c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:17.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.157+0000 7f857cc00640 1 -- 172.21.15.120:0/438332629 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85780c7360 con 0x7f8578072010 2024-04-18T04:55:17.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.169+0000 7f857cc00640 1 --2- 172.21.15.120:0/438332629 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8578072010 0x7f85780714d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f856400bb10 tx=0x7f856401ec20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=703c77f8e2e0d459 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:17.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.173+0000 7f8577e00640 1 -- 172.21.15.120:0/438332629 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85640a7bd0 con 0x7f8578072010 2024-04-18T04:55:17.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.173+0000 7f8577e00640 1 -- 172.21.15.120:0/438332629 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85640a7d30 con 0x7f8578072010 2024-04-18T04:55:17.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.173+0000 7f8577e00640 1 -- 172.21.15.120:0/438332629 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85640a7ea0 con 0x7f8578072010 2024-04-18T04:55:17.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.177+0000 7f8580000640 1 -- 172.21.15.120:0/438332629 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8578072010 msgr2=0x7f85780714d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:17.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.177+0000 7f8580000640 1 --2- 172.21.15.120:0/438332629 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8578072010 0x7f85780714d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f856400bb10 tx=0x7f856401ec20 comp rx=0 tx=0).stop 2024-04-18T04:55:17.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.181+0000 7f8580000640 1 -- 172.21.15.120:0/438332629 shutdown_connections 2024-04-18T04:55:17.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.181+0000 7f8580000640 1 --2- 172.21.15.120:0/438332629 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8578072010 0x7f85780714d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:17.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.181+0000 7f8580000640 1 --2- 172.21.15.120:0/438332629 >> v2:172.21.15.132:3300/0 conn(0x7f8578150620 0x7f8578156d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:17.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.181+0000 7f8580000640 1 -- 172.21.15.120:0/438332629 >> 172.21.15.120:0/438332629 conn(0x7f85780cbfb0 msgr2=0x7f85780cc3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:17.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.185+0000 7f8580000640 1 -- 172.21.15.120:0/438332629 shutdown_connections 2024-04-18T04:55:17.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.185+0000 7f8580000640 1 -- 172.21.15.120:0/438332629 wait complete. 2024-04-18T04:55:17.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.189+0000 7f8580000640 1 Processor -- start 2024-04-18T04:55:17.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.193+0000 7f8580000640 1 -- start start 2024-04-18T04:55:17.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.193+0000 7f8580000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8578072010 0x7f85781f73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:17.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.193+0000 7f8580000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8578072450 0x7f8578143aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:17.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.193+0000 7f8580000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8578150620 0x7f8578143fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:17.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.193+0000 7f8580000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8578152df0 con 0x7f8578072010 2024-04-18T04:55:17.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.193+0000 7f8580000640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85781f69f0 con 0x7f8578072450 2024-04-18T04:55:17.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.193+0000 7f8580000640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85781f6f50 con 0x7f8578150620 2024-04-18T04:55:17.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.197+0000 7f857e000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8578150620 0x7f8578143fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:17.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.197+0000 7f857e000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8578150620 0x7f8578143fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:57390/0 (socket says 172.21.15.120:57390) 2024-04-18T04:55:17.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.197+0000 7f857e000640 1 -- 172.21.15.120:0/1210521647 learned_addr learned my addr 172.21.15.120:0/1210521647 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:17.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.197+0000 7f857cc00640 1 --2- 172.21.15.120:0/1210521647 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8578072450 0x7f8578143aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:17.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.197+0000 7f857cc00640 1 -- 172.21.15.120:0/1210521647 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8578150620 msgr2=0x7f8578143fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:17.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.197+0000 7f857cc00640 1 --2- 172.21.15.120:0/1210521647 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8578150620 0x7f8578143fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:17.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.197+0000 7f857cc00640 1 -- 172.21.15.120:0/1210521647 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8578072010 msgr2=0x7f85781f73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:17.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.197+0000 7f857cc00640 1 --2- 172.21.15.120:0/1210521647 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8578072010 0x7f85781f73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:17.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.197+0000 7f857cc00640 1 -- 172.21.15.120:0/1210521647 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f856400b770 con 0x7f8578072450 2024-04-18T04:55:17.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.197+0000 7f857cc00640 1 --2- 172.21.15.120:0/1210521647 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8578072450 0x7f8578143aa0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f85640ae000 tx=0x7f856401b9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:17.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.197+0000 7f8575600640 1 -- 172.21.15.120:0/1210521647 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85640a7ea0 con 0x7f8578072450 2024-04-18T04:55:17.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.197+0000 7f8575600640 1 -- 172.21.15.120:0/1210521647 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85640afca0 con 0x7f8578072450 2024-04-18T04:55:17.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.197+0000 7f8575600640 1 -- 172.21.15.120:0/1210521647 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85640b8680 con 0x7f8578072450 2024-04-18T04:55:17.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.201+0000 7f8580000640 1 -- 172.21.15.120:0/1210521647 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85781f7920 con 0x7f8578072450 2024-04-18T04:55:17.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.201+0000 7f8580000640 1 -- 172.21.15.120:0/1210521647 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85781fa970 con 0x7f8578072450 2024-04-18T04:55:17.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.205+0000 7f8575600640 1 -- 172.21.15.120:0/1210521647 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f85640b6070 con 0x7f8578072450 2024-04-18T04:55:17.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.205+0000 7f8580000640 1 -- 172.21.15.120:0/1210521647 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85780cbdb0 con 0x7f8578072450 2024-04-18T04:55:17.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.205+0000 7f8575600640 1 --2- 172.21.15.120:0/1210521647 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f85580666e0 0x7f8558068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:17.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.209+0000 7f857d600640 1 --2- 172.21.15.120:0/1210521647 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f85580666e0 0x7f8558068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:17.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.217+0000 7f8575600640 1 -- 172.21.15.120:0/1210521647 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f85640ef0d0 con 0x7f8578072450 2024-04-18T04:55:17.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.221+0000 7f857d600640 1 --2- 172.21.15.120:0/1210521647 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f85580666e0 0x7f8558068ba0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f856c006aa0 tx=0x7f856c006a30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:17.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.225+0000 7f8575600640 1 -- 172.21.15.120:0/1210521647 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f85640b4020 con 0x7f8578072450 2024-04-18T04:55:17.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.593+0000 7f8580000640 1 -- 172.21.15.120:0/1210521647 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8578067590 con 0x7f8578072450 2024-04-18T04:55:17.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.597+0000 7f8575600640 1 -- 172.21.15.120:0/1210521647 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v32) v1 ==== 104+0+11 (secure 0 0 0) 0x7f85640ead10 con 0x7f8578072450 2024-04-18T04:55:17.594 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2024-04-18T04:55:17.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.609+0000 7f8580000640 1 -- 172.21.15.120:0/1210521647 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f85580666e0 msgr2=0x7f8558068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:17.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.609+0000 7f8580000640 1 --2- 172.21.15.120:0/1210521647 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f85580666e0 0x7f8558068ba0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f856c006aa0 tx=0x7f856c006a30 comp rx=0 tx=0).stop 2024-04-18T04:55:17.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.609+0000 7f8580000640 1 -- 172.21.15.120:0/1210521647 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8578072450 msgr2=0x7f8578143aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:17.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.609+0000 7f8580000640 1 --2- 172.21.15.120:0/1210521647 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8578072450 0x7f8578143aa0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f85640ae000 tx=0x7f856401b9c0 comp rx=0 tx=0).stop 2024-04-18T04:55:17.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.609+0000 7f8580000640 1 -- 172.21.15.120:0/1210521647 shutdown_connections 2024-04-18T04:55:17.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.609+0000 7f8580000640 1 --2- 172.21.15.120:0/1210521647 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f85580666e0 0x7f8558068ba0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:17.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.609+0000 7f8580000640 1 --2- 172.21.15.120:0/1210521647 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8578150620 0x7f8578143fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:17.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.609+0000 7f8580000640 1 --2- 172.21.15.120:0/1210521647 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8578072450 0x7f8578143aa0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:17.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.609+0000 7f8580000640 1 --2- 172.21.15.120:0/1210521647 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8578072010 0x7f85781f73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:17.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.609+0000 7f8580000640 1 -- 172.21.15.120:0/1210521647 >> 172.21.15.120:0/1210521647 conn(0x7f85780cbfb0 msgr2=0x7f85780c2130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:17.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.609+0000 7f8580000640 1 -- 172.21.15.120:0/1210521647 shutdown_connections 2024-04-18T04:55:17.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.609+0000 7f8580000640 1 -- 172.21.15.120:0/1210521647 wait complete. 2024-04-18T04:55:17.649 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T04:55:17.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.953+0000 7f2c57200640 1 Processor -- start 2024-04-18T04:55:17.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.953+0000 7f2c57200640 1 -- start start 2024-04-18T04:55:17.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.953+0000 7f2c57200640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2c50153b30 0x7f2c50069ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:17.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.953+0000 7f2c57200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2c5015d2d0 0x7f2c5006a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:17.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.953+0000 7f2c57200640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c50071c30 con 0x7f2c500ccb80 2024-04-18T04:55:17.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.953+0000 7f2c57200640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c500c6ae0 con 0x7f2c50153b30 2024-04-18T04:55:17.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.953+0000 7f2c57200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c500c6dc0 con 0x7f2c5015d2d0 2024-04-18T04:55:17.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.953+0000 7f2c47e00640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f2c500ccb80 0x7f2c5015cbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:40168/0 (socket says 172.21.15.120:40168) 2024-04-18T04:55:17.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.953+0000 7f2c47e00640 1 -- 172.21.15.120:0/108947506 learned_addr learned my addr 172.21.15.120:0/108947506 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:55:17.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.953+0000 7f2c4fe00640 1 --2- 172.21.15.120:0/108947506 >> v2:172.21.15.132:3300/0 conn(0x7f2c50153b30 0x7f2c50069ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:17.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.953+0000 7f2c55200640 1 --2- 172.21.15.120:0/108947506 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2c5015d2d0 0x7f2c5006a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:17.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.953+0000 7f2c4f400640 1 -- 172.21.15.120:0/108947506 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 899413988 0 0) 0x7f2c50071c30 con 0x7f2c500ccb80 2024-04-18T04:55:17.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.953+0000 7f2c4f400640 1 -- 172.21.15.120:0/108947506 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c34003530 con 0x7f2c500ccb80 2024-04-18T04:55:17.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.953+0000 7f2c4fe00640 1 -- 172.21.15.120:0/108947506 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2c5015d2d0 msgr2=0x7f2c5006a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:17.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.953+0000 7f2c4fe00640 1 --2- 172.21.15.120:0/108947506 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2c5015d2d0 0x7f2c5006a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:17.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.953+0000 7f2c4fe00640 1 -- 172.21.15.120:0/108947506 >> v1:172.21.15.120:6789/0 conn(0x7f2c500ccb80 legacy=0x7f2c5015cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:17.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.953+0000 7f2c4fe00640 1 -- 172.21.15.120:0/108947506 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c50071f60 con 0x7f2c50153b30 2024-04-18T04:55:17.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.957+0000 7f2c4fe00640 1 --2- 172.21.15.120:0/108947506 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c50153b30 0x7f2c50069ec0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2c400097c0 tx=0x7f2c4001c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ea684d1f21b31fa server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:17.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.957+0000 7f2c4f400640 1 -- 172.21.15.120:0/108947506 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c400aa5f0 con 0x7f2c50153b30 2024-04-18T04:55:17.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.957+0000 7f2c4f400640 1 -- 172.21.15.120:0/108947506 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c400aa750 con 0x7f2c50153b30 2024-04-18T04:55:17.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.957+0000 7f2c4f400640 1 -- 172.21.15.120:0/108947506 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c400aaae0 con 0x7f2c50153b30 2024-04-18T04:55:17.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.957+0000 7f2c57200640 1 -- 172.21.15.120:0/108947506 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c50153b30 msgr2=0x7f2c50069ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:17.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.957+0000 7f2c57200640 1 --2- 172.21.15.120:0/108947506 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c50153b30 0x7f2c50069ec0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2c400097c0 tx=0x7f2c4001c470 comp rx=0 tx=0).stop 2024-04-18T04:55:17.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.957+0000 7f2c57200640 1 -- 172.21.15.120:0/108947506 shutdown_connections 2024-04-18T04:55:17.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.957+0000 7f2c57200640 1 --2- 172.21.15.120:0/108947506 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2c5015d2d0 0x7f2c5006a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:17.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.957+0000 7f2c57200640 1 --2- 172.21.15.120:0/108947506 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c50153b30 0x7f2c50069ec0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:17.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.957+0000 7f2c57200640 1 -- 172.21.15.120:0/108947506 >> 172.21.15.120:0/108947506 conn(0x7f2c500cbfb0 msgr2=0x7f2c500cc3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:17.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.957+0000 7f2c57200640 1 -- 172.21.15.120:0/108947506 shutdown_connections 2024-04-18T04:55:17.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.957+0000 7f2c57200640 1 -- 172.21.15.120:0/108947506 wait complete. 2024-04-18T04:55:17.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.961+0000 7f2c57200640 1 Processor -- start 2024-04-18T04:55:17.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.961+0000 7f2c57200640 1 -- start start 2024-04-18T04:55:17.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.961+0000 7f2c57200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2c50153b30 0x7f2c501514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:17.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.961+0000 7f2c57200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c500c5f00 0x7f2c501f5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:17.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.961+0000 7f2c57200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c501f5d50 0x7f2c500c3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:17.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.961+0000 7f2c57200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c501f6580 con 0x7f2c501f5d50 2024-04-18T04:55:17.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.961+0000 7f2c57200640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c500c5640 con 0x7f2c500c5f00 2024-04-18T04:55:17.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.961+0000 7f2c57200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c500c3710 con 0x7f2c50153b30 2024-04-18T04:55:17.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.961+0000 7f2c4fe00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2c50153b30 0x7f2c501514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:17.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.961+0000 7f2c47e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c500c5f00 0x7f2c501f5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:17.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.961+0000 7f2c4fe00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2c50153b30 0x7f2c501514e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:57416/0 (socket says 172.21.15.120:57416) 2024-04-18T04:55:17.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.961+0000 7f2c4fe00640 1 -- 172.21.15.120:0/721177432 learned_addr learned my addr 172.21.15.120:0/721177432 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:17.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.961+0000 7f2c55200640 1 --2- 172.21.15.120:0/721177432 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c501f5d50 0x7f2c500c3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:17.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.961+0000 7f2c47e00640 1 -- 172.21.15.120:0/721177432 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2c50153b30 msgr2=0x7f2c501514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:17.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.961+0000 7f2c47e00640 1 --2- 172.21.15.120:0/721177432 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2c50153b30 0x7f2c501514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:17.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.961+0000 7f2c47e00640 1 -- 172.21.15.120:0/721177432 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c501f5d50 msgr2=0x7f2c500c3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:17.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.961+0000 7f2c47e00640 1 --2- 172.21.15.120:0/721177432 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c501f5d50 0x7f2c500c3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:17.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.961+0000 7f2c47e00640 1 -- 172.21.15.120:0/721177432 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c40009420 con 0x7f2c500c5f00 2024-04-18T04:55:17.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.961+0000 7f2c47e00640 1 --2- 172.21.15.120:0/721177432 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c500c5f00 0x7f2c501f5810 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2c3800c420 tx=0x7f2c3800c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:17.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.961+0000 7f2c4cc00640 1 -- 172.21.15.120:0/721177432 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c380074e0 con 0x7f2c500c5f00 2024-04-18T04:55:17.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.961+0000 7f2c4cc00640 1 -- 172.21.15.120:0/721177432 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c38007640 con 0x7f2c500c5f00 2024-04-18T04:55:17.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.961+0000 7f2c4cc00640 1 -- 172.21.15.120:0/721177432 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c38004a30 con 0x7f2c500c5f00 2024-04-18T04:55:17.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.961+0000 7f2c57200640 1 -- 172.21.15.120:0/721177432 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c501f62a0 con 0x7f2c500c5f00 2024-04-18T04:55:17.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.961+0000 7f2c57200640 1 -- 172.21.15.120:0/721177432 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c5014d9b0 con 0x7f2c500c5f00 2024-04-18T04:55:17.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.965+0000 7f2c57200640 1 -- 172.21.15.120:0/721177432 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c500729d0 con 0x7f2c500c5f00 2024-04-18T04:55:17.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.965+0000 7f2c4cc00640 1 -- 172.21.15.120:0/721177432 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2c38004b90 con 0x7f2c500c5f00 2024-04-18T04:55:17.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.965+0000 7f2c4cc00640 1 --2- 172.21.15.120:0/721177432 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2c2c0666c0 0x7f2c2c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:17.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.965+0000 7f2c4cc00640 1 -- 172.21.15.120:0/721177432 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f2c38084480 con 0x7f2c500c5f00 2024-04-18T04:55:17.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.965+0000 7f2c4fe00640 1 --2- 172.21.15.120:0/721177432 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2c2c0666c0 0x7f2c2c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:17.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.965+0000 7f2c4fe00640 1 --2- 172.21.15.120:0/721177432 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2c2c0666c0 0x7f2c2c068b80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2c400097c0 tx=0x7f2c400a7000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:17.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:17.969+0000 7f2c4cc00640 1 -- 172.21.15.120:0/721177432 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f2c38051200 con 0x7f2c500c5f00 2024-04-18T04:55:18.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.129+0000 7f2c57200640 1 -- 172.21.15.120:0/721177432 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2c5006d820 con 0x7f2c500c5f00 2024-04-18T04:55:18.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.129+0000 7f2c4cc00640 1 -- 172.21.15.120:0/721177432 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v32) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2c38054820 con 0x7f2c500c5f00 2024-04-18T04:55:18.126 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 64 2024-04-18T04:55:18.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.129+0000 7f2c57200640 1 -- 172.21.15.120:0/721177432 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2c2c0666c0 msgr2=0x7f2c2c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:18.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.129+0000 7f2c57200640 1 --2- 172.21.15.120:0/721177432 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2c2c0666c0 0x7f2c2c068b80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2c400097c0 tx=0x7f2c400a7000 comp rx=0 tx=0).stop 2024-04-18T04:55:18.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.129+0000 7f2c57200640 1 -- 172.21.15.120:0/721177432 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c500c5f00 msgr2=0x7f2c501f5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:18.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.129+0000 7f2c57200640 1 --2- 172.21.15.120:0/721177432 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c500c5f00 0x7f2c501f5810 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2c3800c420 tx=0x7f2c3800c8e0 comp rx=0 tx=0).stop 2024-04-18T04:55:18.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.129+0000 7f2c57200640 1 -- 172.21.15.120:0/721177432 shutdown_connections 2024-04-18T04:55:18.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.129+0000 7f2c57200640 1 --2- 172.21.15.120:0/721177432 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2c2c0666c0 0x7f2c2c068b80 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:18.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.129+0000 7f2c57200640 1 --2- 172.21.15.120:0/721177432 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c501f5d50 0x7f2c500c3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:18.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.129+0000 7f2c57200640 1 --2- 172.21.15.120:0/721177432 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c500c5f00 0x7f2c501f5810 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:18.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.129+0000 7f2c57200640 1 --2- 172.21.15.120:0/721177432 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2c50153b30 0x7f2c501514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:18.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.129+0000 7f2c57200640 1 -- 172.21.15.120:0/721177432 >> 172.21.15.120:0/721177432 conn(0x7f2c500cbfb0 msgr2=0x7f2c50152bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:18.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.129+0000 7f2c57200640 1 -- 172.21.15.120:0/721177432 shutdown_connections 2024-04-18T04:55:18.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.133+0000 7f2c57200640 1 -- 172.21.15.120:0/721177432 wait complete. 2024-04-18T04:55:18.147 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-18T04:55:18.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.293+0000 7fe906e00640 1 Processor -- start 2024-04-18T04:55:18.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.293+0000 7fe906e00640 1 -- start start 2024-04-18T04:55:18.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.293+0000 7fe906e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe9000c1fe0 0x7fe900157db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:18.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.293+0000 7fe906e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe9000c3ef0 0x7fe9000c23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:18.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.293+0000 7fe906e00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe900157920 con 0x7fe9000c79c0 2024-04-18T04:55:18.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.293+0000 7fe906e00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9001582f0 con 0x7fe9000c3ef0 2024-04-18T04:55:18.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.293+0000 7fe906e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9000c2900 con 0x7fe9000c1fe0 2024-04-18T04:55:18.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.293+0000 7fe904e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe9000c3ef0 0x7fe9000c23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:18.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.293+0000 7fe904e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe9000c3ef0 0x7fe9000c23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36768/0 (socket says 172.21.15.120:36768) 2024-04-18T04:55:18.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.293+0000 7fe904e00640 1 -- 172.21.15.120:0/1609197692 learned_addr learned my addr 172.21.15.120:0/1609197692 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:18.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.293+0000 7fe8ffe00640 1 --2- 172.21.15.120:0/1609197692 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe9000c1fe0 0x7fe900157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:18.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.293+0000 7fe904e00640 1 -- 172.21.15.120:0/1609197692 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe9000c1fe0 msgr2=0x7fe900157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:18.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.293+0000 7fe904e00640 1 --2- 172.21.15.120:0/1609197692 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe9000c1fe0 0x7fe900157db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:18.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.293+0000 7fe904e00640 1 -- 172.21.15.120:0/1609197692 >> v1:172.21.15.132:6789/0 conn(0x7fe9000c79c0 legacy=0x7fe90015a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:18.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.293+0000 7fe904e00640 1 -- 172.21.15.120:0/1609197692 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe90006e9a0 con 0x7fe9000c3ef0 2024-04-18T04:55:18.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.297+0000 7fe904e00640 1 --2- 172.21.15.120:0/1609197692 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9000c3ef0 0x7fe9000c23c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8009e50 tx=0x7fe8f801f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921047090d1084f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:18.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.301+0000 7fe8ff400640 1 -- 172.21.15.120:0/1609197692 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f80af400 con 0x7fe9000c3ef0 2024-04-18T04:55:18.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.301+0000 7fe8ff400640 1 -- 172.21.15.120:0/1609197692 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f80ab050 con 0x7fe9000c3ef0 2024-04-18T04:55:18.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.301+0000 7fe8ff400640 1 -- 172.21.15.120:0/1609197692 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f80af780 con 0x7fe9000c3ef0 2024-04-18T04:55:18.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.301+0000 7fe906e00640 1 -- 172.21.15.120:0/1609197692 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9000c3ef0 msgr2=0x7fe9000c23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:18.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.301+0000 7fe906e00640 1 --2- 172.21.15.120:0/1609197692 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9000c3ef0 0x7fe9000c23c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8009e50 tx=0x7fe8f801f210 comp rx=0 tx=0).stop 2024-04-18T04:55:18.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.301+0000 7fe906e00640 1 -- 172.21.15.120:0/1609197692 shutdown_connections 2024-04-18T04:55:18.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.301+0000 7fe906e00640 1 --2- 172.21.15.120:0/1609197692 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9000c3ef0 0x7fe9000c23c0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:18.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.301+0000 7fe906e00640 1 --2- 172.21.15.120:0/1609197692 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe9000c1fe0 0x7fe900157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:18.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.301+0000 7fe906e00640 1 -- 172.21.15.120:0/1609197692 >> 172.21.15.120:0/1609197692 conn(0x7fe900072190 msgr2=0x7fe900065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:18.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.301+0000 7fe906e00640 1 -- 172.21.15.120:0/1609197692 shutdown_connections 2024-04-18T04:55:18.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.301+0000 7fe906e00640 1 -- 172.21.15.120:0/1609197692 wait complete. 2024-04-18T04:55:18.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.301+0000 7fe906e00640 1 Processor -- start 2024-04-18T04:55:18.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.301+0000 7fe906e00640 1 -- start start 2024-04-18T04:55:18.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.301+0000 7fe906e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe9000c1fe0 0x7fe9001e3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:18.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.301+0000 7fe906e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9000c3ef0 0x7fe9001e0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:18.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.301+0000 7fe906e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9000c79c0 0x7fe9001e4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:18.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.301+0000 7fe906e00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9000c6a30 con 0x7fe9000c3ef0 2024-04-18T04:55:18.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.301+0000 7fe906e00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9000c6800 con 0x7fe9000c79c0 2024-04-18T04:55:18.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.301+0000 7fe906e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9001e26e0 con 0x7fe9000c1fe0 2024-04-18T04:55:18.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.301+0000 7fe8f7400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9000c3ef0 0x7fe9001e0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:18.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.301+0000 7fe8f7400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9000c3ef0 0x7fe9001e0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36778/0 (socket says 172.21.15.120:36778) 2024-04-18T04:55:18.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.301+0000 7fe8f7400640 1 -- 172.21.15.120:0/2587898220 learned_addr learned my addr 172.21.15.120:0/2587898220 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:18.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.305+0000 7fe8ffe00640 1 --2- 172.21.15.120:0/2587898220 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe9000c1fe0 0x7fe9001e3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:18.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.305+0000 7fe904e00640 1 --2- 172.21.15.120:0/2587898220 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9000c79c0 0x7fe9001e4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:18.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.305+0000 7fe8f7400640 1 -- 172.21.15.120:0/2587898220 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe9000c1fe0 msgr2=0x7fe9001e3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:18.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.305+0000 7fe8f7400640 1 --2- 172.21.15.120:0/2587898220 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe9000c1fe0 0x7fe9001e3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:18.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.305+0000 7fe8f7400640 1 -- 172.21.15.120:0/2587898220 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9000c79c0 msgr2=0x7fe9001e4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:18.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.305+0000 7fe8f7400640 1 --2- 172.21.15.120:0/2587898220 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9000c79c0 0x7fe9001e4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:18.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.305+0000 7fe8f7400640 1 -- 172.21.15.120:0/2587898220 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f8009b30 con 0x7fe9000c3ef0 2024-04-18T04:55:18.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.305+0000 7fe904e00640 1 --2- 172.21.15.120:0/2587898220 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9000c79c0 0x7fe9001e4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:55:18.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.305+0000 7fe8f7400640 1 --2- 172.21.15.120:0/2587898220 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9000c3ef0 0x7fe9001e0ef0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe8e800c3c0 tx=0x7fe8e800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:18.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.305+0000 7fe8fcc00640 1 -- 172.21.15.120:0/2587898220 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e80052d0 con 0x7fe9000c3ef0 2024-04-18T04:55:18.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.305+0000 7fe8fcc00640 1 -- 172.21.15.120:0/2587898220 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e8005430 con 0x7fe9000c3ef0 2024-04-18T04:55:18.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.305+0000 7fe8fcc00640 1 -- 172.21.15.120:0/2587898220 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e8003840 con 0x7fe9000c3ef0 2024-04-18T04:55:18.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.305+0000 7fe906e00640 1 -- 172.21.15.120:0/2587898220 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9001e6880 con 0x7fe9000c3ef0 2024-04-18T04:55:18.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.305+0000 7fe906e00640 1 -- 172.21.15.120:0/2587898220 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9001e18c0 con 0x7fe9000c3ef0 2024-04-18T04:55:18.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.305+0000 7fe906e00640 1 -- 172.21.15.120:0/2587898220 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9000729d0 con 0x7fe9000c3ef0 2024-04-18T04:55:18.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.305+0000 7fe8fcc00640 1 -- 172.21.15.120:0/2587898220 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe8e80039a0 con 0x7fe9000c3ef0 2024-04-18T04:55:18.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.309+0000 7fe8fcc00640 1 --2- 172.21.15.120:0/2587898220 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fe8dc066690 0x7fe8dc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:18.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.309+0000 7fe8fcc00640 1 -- 172.21.15.120:0/2587898220 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7fe8e8083b40 con 0x7fe9000c3ef0 2024-04-18T04:55:18.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.309+0000 7fe8ffe00640 1 --2- 172.21.15.120:0/2587898220 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fe8dc066690 0x7fe8dc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:18.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.309+0000 7fe8ffe00640 1 --2- 172.21.15.120:0/2587898220 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fe8dc066690 0x7fe8dc068b50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe8f0009b60 tx=0x7fe8f0009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:18.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.313+0000 7fe8fcc00640 1 -- 172.21.15.120:0/2587898220 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fe8e80509f0 con 0x7fe9000c3ef0 2024-04-18T04:55:18.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.473+0000 7fe906e00640 1 -- 172.21.15.120:0/2587898220 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe90006eb60 con 0x7fe9000c3ef0 2024-04-18T04:55:18.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.473+0000 7fe8fcc00640 1 -- 172.21.15.120:0/2587898220 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v32) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe8e8017020 con 0x7fe9000c3ef0 2024-04-18T04:55:18.469 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2024-04-18T04:55:18.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.473+0000 7fe906e00640 1 -- 172.21.15.120:0/2587898220 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fe8dc066690 msgr2=0x7fe8dc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:18.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.473+0000 7fe906e00640 1 --2- 172.21.15.120:0/2587898220 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fe8dc066690 0x7fe8dc068b50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe8f0009b60 tx=0x7fe8f0009190 comp rx=0 tx=0).stop 2024-04-18T04:55:18.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.473+0000 7fe906e00640 1 -- 172.21.15.120:0/2587898220 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9000c3ef0 msgr2=0x7fe9001e0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:18.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.473+0000 7fe906e00640 1 --2- 172.21.15.120:0/2587898220 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9000c3ef0 0x7fe9001e0ef0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe8e800c3c0 tx=0x7fe8e800c880 comp rx=0 tx=0).stop 2024-04-18T04:55:18.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.473+0000 7fe906e00640 1 -- 172.21.15.120:0/2587898220 shutdown_connections 2024-04-18T04:55:18.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.473+0000 7fe906e00640 1 --2- 172.21.15.120:0/2587898220 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fe8dc066690 0x7fe8dc068b50 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:18.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.473+0000 7fe906e00640 1 --2- 172.21.15.120:0/2587898220 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9000c79c0 0x7fe9001e4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:18.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.473+0000 7fe906e00640 1 --2- 172.21.15.120:0/2587898220 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9000c3ef0 0x7fe9001e0ef0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:18.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.473+0000 7fe906e00640 1 --2- 172.21.15.120:0/2587898220 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe9000c1fe0 0x7fe9001e3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:18.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.473+0000 7fe906e00640 1 -- 172.21.15.120:0/2587898220 >> 172.21.15.120:0/2587898220 conn(0x7fe900072190 msgr2=0x7fe90015b140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:18.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.473+0000 7fe906e00640 1 -- 172.21.15.120:0/2587898220 shutdown_connections 2024-04-18T04:55:18.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.473+0000 7fe906e00640 1 -- 172.21.15.120:0/2587898220 wait complete. 2024-04-18T04:55:18.490 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-18T04:55:18.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.649+0000 7fadf4200640 1 Processor -- start 2024-04-18T04:55:18.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.649+0000 7fadf4200640 1 -- start start 2024-04-18T04:55:18.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.653+0000 7fadf4200640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fadec0c7850 0x7fadec0c7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:18.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.653+0000 7fadf4200640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fadec0c66d0 0x7fadec1600b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:18.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.653+0000 7fadf4200640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadec0c57c0 con 0x7fadec0cb570 2024-04-18T04:55:18.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.653+0000 7fadf4200640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadec0bfe70 con 0x7fadec0c7850 2024-04-18T04:55:18.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.653+0000 7fadf4200640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadec0c8170 con 0x7fadec0c66d0 2024-04-18T04:55:18.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.653+0000 7fadf2200640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fadec0c66d0 0x7fadec1600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:18.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.653+0000 7fadf2200640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fadec0c66d0 0x7fadec1600b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:33702/0 (socket says 172.21.15.120:33702) 2024-04-18T04:55:18.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.653+0000 7fadf2200640 1 -- 172.21.15.120:0/2297360552 learned_addr learned my addr 172.21.15.120:0/2297360552 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:18.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.653+0000 7fadf1800640 1 --2- 172.21.15.120:0/2297360552 >> v2:172.21.15.120:3300/0 conn(0x7fadec0c7850 0x7fadec0c7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:18.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.653+0000 7fadf1800640 1 -- 172.21.15.120:0/2297360552 >> v2:172.21.15.132:3300/0 conn(0x7fadec0c66d0 msgr2=0x7fadec1600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:18.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.653+0000 7fadf1800640 1 --2- 172.21.15.120:0/2297360552 >> v2:172.21.15.132:3300/0 conn(0x7fadec0c66d0 0x7fadec1600b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:18.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.653+0000 7fadf1800640 1 -- 172.21.15.120:0/2297360552 >> v1:172.21.15.132:6789/0 conn(0x7fadec0cb570 legacy=0x7fadec158d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:18.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.653+0000 7fadf1800640 1 -- 172.21.15.120:0/2297360552 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadec0c0330 con 0x7fadec0c7850 2024-04-18T04:55:18.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.657+0000 7fadf1800640 1 --2- 172.21.15.120:0/2297360552 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fadec0c7850 0x7fadec0c7c30 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fadec06b730 tx=0x7fade001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2db3e02d41b6862f server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:18.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.657+0000 7fadebe00640 1 -- 172.21.15.120:0/2297360552 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade00a8970 con 0x7fadec0c7850 2024-04-18T04:55:18.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.657+0000 7fadebe00640 1 -- 172.21.15.120:0/2297360552 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade00a8ad0 con 0x7fadec0c7850 2024-04-18T04:55:18.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.657+0000 7fadebe00640 1 -- 172.21.15.120:0/2297360552 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade00a8e60 con 0x7fadec0c7850 2024-04-18T04:55:18.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.661+0000 7fadf4200640 1 -- 172.21.15.120:0/2297360552 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fadec0c7850 msgr2=0x7fadec0c7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:18.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.661+0000 7fadf4200640 1 --2- 172.21.15.120:0/2297360552 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fadec0c7850 0x7fadec0c7c30 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fadec06b730 tx=0x7fade001ec70 comp rx=0 tx=0).stop 2024-04-18T04:55:18.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.661+0000 7fadf4200640 1 -- 172.21.15.120:0/2297360552 shutdown_connections 2024-04-18T04:55:18.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.661+0000 7fadf4200640 1 --2- 172.21.15.120:0/2297360552 >> v2:172.21.15.132:3300/0 conn(0x7fadec0c66d0 0x7fadec1600b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:18.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.661+0000 7fadf4200640 1 --2- 172.21.15.120:0/2297360552 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fadec0c7850 0x7fadec0c7c30 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:18.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.661+0000 7fadf4200640 1 -- 172.21.15.120:0/2297360552 >> 172.21.15.120:0/2297360552 conn(0x7fadec06b780 msgr2=0x7fadec06bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:18.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.661+0000 7fadf4200640 1 -- 172.21.15.120:0/2297360552 shutdown_connections 2024-04-18T04:55:18.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.661+0000 7fadf4200640 1 -- 172.21.15.120:0/2297360552 wait complete. 2024-04-18T04:55:18.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.665+0000 7fadf4200640 1 Processor -- start 2024-04-18T04:55:18.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.665+0000 7fadf4200640 1 -- start start 2024-04-18T04:55:18.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.665+0000 7fadf4200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fadec0c66d0 0x7fadec1eed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:18.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.665+0000 7fadf4200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fadec0c7850 0x7fadec1f01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:18.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.665+0000 7fadf4200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fadec0cb570 0x7fadec14e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:18.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.665+0000 7fadf4200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadec0adbc0 con 0x7fadec0cb570 2024-04-18T04:55:18.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.665+0000 7fadf4200640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadec0aea20 con 0x7fadec0c66d0 2024-04-18T04:55:18.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.665+0000 7fadf4200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadec0ade10 con 0x7fadec0c7850 2024-04-18T04:55:18.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.665+0000 7fadf2200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fadec0cb570 0x7fadec14e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:18.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.665+0000 7fadf0e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fadec0c7850 0x7fadec1f01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:18.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.665+0000 7fadf2200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fadec0cb570 0x7fadec14e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36800/0 (socket says 172.21.15.120:36800) 2024-04-18T04:55:18.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.665+0000 7fadf2200640 1 -- 172.21.15.120:0/3250527630 learned_addr learned my addr 172.21.15.120:0/3250527630 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:18.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.665+0000 7fadf2200640 1 -- 172.21.15.120:0/3250527630 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fadec0c7850 msgr2=0x7fadec1f01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:18.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.669+0000 7fadf2200640 1 --2- 172.21.15.120:0/3250527630 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fadec0c7850 0x7fadec1f01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:18.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.669+0000 7fadf2200640 1 -- 172.21.15.120:0/3250527630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fadec0c66d0 msgr2=0x7fadec1eed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:18.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.669+0000 7fadf2200640 1 --2- 172.21.15.120:0/3250527630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fadec0c66d0 0x7fadec1eed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:18.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.669+0000 7fadf2200640 1 -- 172.21.15.120:0/3250527630 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade0009420 con 0x7fadec0cb570 2024-04-18T04:55:18.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.673+0000 7fadf2200640 1 --2- 172.21.15.120:0/3250527630 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fadec0cb570 0x7fadec14e420 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fade400b080 tx=0x7fade400b540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:18.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.673+0000 7fade9600640 1 -- 172.21.15.120:0/3250527630 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade4010040 con 0x7fadec0cb570 2024-04-18T04:55:18.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.673+0000 7fade9600640 1 -- 172.21.15.120:0/3250527630 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade400bcf0 con 0x7fadec0cb570 2024-04-18T04:55:18.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.673+0000 7fade9600640 1 -- 172.21.15.120:0/3250527630 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade4004030 con 0x7fadec0cb570 2024-04-18T04:55:18.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.673+0000 7fadf4200640 1 -- 172.21.15.120:0/3250527630 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadec0ae0f0 con 0x7fadec0cb570 2024-04-18T04:55:18.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.677+0000 7fadf4200640 1 -- 172.21.15.120:0/3250527630 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadec0ae6b0 con 0x7fadec0cb570 2024-04-18T04:55:18.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.677+0000 7fadf4200640 1 -- 172.21.15.120:0/3250527630 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadec0ae870 con 0x7fadec0cb570 2024-04-18T04:55:18.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.681+0000 7fade9600640 1 -- 172.21.15.120:0/3250527630 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fade4004190 con 0x7fadec0cb570 2024-04-18T04:55:18.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.685+0000 7fade9600640 1 --2- 172.21.15.120:0/3250527630 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fadcc0666e0 0x7fadcc068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:18.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.685+0000 7fade9600640 1 -- 172.21.15.120:0/3250527630 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7fade4085180 con 0x7fadec0cb570 2024-04-18T04:55:18.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.685+0000 7fadf1800640 1 --2- 172.21.15.120:0/3250527630 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fadcc0666e0 0x7fadcc068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:18.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.685+0000 7fadf1800640 1 --2- 172.21.15.120:0/3250527630 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fadcc0666e0 0x7fadcc068ba0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fade00b2000 tx=0x7fade0004740 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:18.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.689+0000 7fade9600640 1 -- 172.21.15.120:0/3250527630 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fade4051ed0 con 0x7fadec0cb570 2024-04-18T04:55:18.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.893+0000 7fadf4200640 1 -- 172.21.15.120:0/3250527630 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fadec072a70 con 0x7fadec0cb570 2024-04-18T04:55:18.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.893+0000 7fade9600640 1 -- 172.21.15.120:0/3250527630 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v32) v1 ==== 81+0+614 (secure 0 0 0) 0x7fade400be60 con 0x7fadec0cb570 2024-04-18T04:55:18.892 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.132:6835/396956733 2024-04-19T04:53:26.031128+0000 2024-04-18T04:55:18.892 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.132:6834/396956733 2024-04-19T04:53:26.031128+0000 2024-04-18T04:55:18.892 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:6837/76856194 2024-04-19T04:52:05.993392+0000 2024-04-18T04:55:18.892 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:6835/76856194 2024-04-19T04:52:05.993392+0000 2024-04-18T04:55:18.892 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:6836/1079090700 2024-04-19T04:50:25.928576+0000 2024-04-18T04:55:18.892 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.132:6835/1552155328 2024-04-19T04:48:30.875534+0000 2024-04-18T04:55:18.892 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.132:6834/1552155328 2024-04-19T04:48:30.875534+0000 2024-04-18T04:55:18.892 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:6834/1079090700 2024-04-19T04:50:25.928576+0000 2024-04-18T04:55:18.892 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:6833/2564667113 2024-04-19T04:47:00.847858+0000 2024-04-18T04:55:18.892 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:6832/2564667113 2024-04-19T04:47:00.847858+0000 2024-04-18T04:55:18.893 INFO:teuthology.orchestra.run.smithi120.stderr:listed 10 entries 2024-04-18T04:55:18.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.897+0000 7fadf4200640 1 -- 172.21.15.120:0/3250527630 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fadcc0666e0 msgr2=0x7fadcc068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:18.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.897+0000 7fadf4200640 1 --2- 172.21.15.120:0/3250527630 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fadcc0666e0 0x7fadcc068ba0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fade00b2000 tx=0x7fade0004740 comp rx=0 tx=0).stop 2024-04-18T04:55:18.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.897+0000 7fadf4200640 1 -- 172.21.15.120:0/3250527630 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fadec0cb570 msgr2=0x7fadec14e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:18.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.897+0000 7fadf4200640 1 --2- 172.21.15.120:0/3250527630 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fadec0cb570 0x7fadec14e420 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fade400b080 tx=0x7fade400b540 comp rx=0 tx=0).stop 2024-04-18T04:55:18.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.897+0000 7fadf4200640 1 -- 172.21.15.120:0/3250527630 shutdown_connections 2024-04-18T04:55:18.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.897+0000 7fadf4200640 1 --2- 172.21.15.120:0/3250527630 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fadcc0666e0 0x7fadcc068ba0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:18.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.897+0000 7fadf4200640 1 --2- 172.21.15.120:0/3250527630 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fadec0cb570 0x7fadec14e420 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:18.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.897+0000 7fadf4200640 1 --2- 172.21.15.120:0/3250527630 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fadec0c7850 0x7fadec1f01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:18.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.897+0000 7fadf4200640 1 --2- 172.21.15.120:0/3250527630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fadec0c66d0 0x7fadec1eed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:18.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.897+0000 7fadf4200640 1 -- 172.21.15.120:0/3250527630 >> 172.21.15.120:0/3250527630 conn(0x7fadec06b780 msgr2=0x7fadec070940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:18.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.897+0000 7fadf4200640 1 -- 172.21.15.120:0/3250527630 shutdown_connections 2024-04-18T04:55:18.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:18.897+0000 7fadf4200640 1 -- 172.21.15.120:0/3250527630 wait complete. 2024-04-18T04:55:18.912 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-18T04:55:18.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:55:18.912 DEBUG:teuthology.orchestra.run.smithi120:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-18T04:55:20.713 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi120.front.sepia.ceph.com 2024-04-18T04:55:20.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:55:20.714 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-18T04:55:21.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:55:21.720 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list 2024-04-18T04:55:28.310 INFO:teuthology.orchestra.run.smithi120.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-18T04:55:28.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:55:28.311 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-18T04:55:28.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T04:55:28.345 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link delete ceph-brx 2024-04-18T04:55:28.548 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-18T04:55:28.561 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-18T04:55:28.561 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T04:55:28.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.813+0000 7f567c000640 1 Processor -- start 2024-04-18T04:55:28.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.813+0000 7f567c000640 1 -- start start 2024-04-18T04:55:28.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.817+0000 7f567c000640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f567406ab90 0x7f567415cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:28.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.817+0000 7f567c000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f56740c47d0 0x7f56740c4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:28.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.817+0000 7f567c000640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f567406b000 con 0x7f56741538a0 2024-04-18T04:55:28.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.817+0000 7f567c000640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56740cb300 con 0x7f567406ab90 2024-04-18T04:55:28.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.817+0000 7f567c000640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f567415d0f0 con 0x7f56740c47d0 2024-04-18T04:55:28.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.817+0000 7f5679600640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f56741538a0 0x7f56740cf400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:35224/0 (socket says 172.21.15.120:35224) 2024-04-18T04:55:28.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.817+0000 7f5679600640 1 -- 172.21.15.120:0/285575930 learned_addr learned my addr 172.21.15.120:0/285575930 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:55:28.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.817+0000 7f567a000640 1 --2- 172.21.15.120:0/285575930 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f56740c47d0 0x7f56740c4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:28.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.817+0000 7f5678c00640 1 --2- 172.21.15.120:0/285575930 >> v2:172.21.15.132:3300/0 conn(0x7f567406ab90 0x7f567415cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:28.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.817+0000 7f5673e00640 1 -- 172.21.15.120:0/285575930 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3551234746 0 0) 0x7f567406b000 con 0x7f56741538a0 2024-04-18T04:55:28.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.817+0000 7f5673e00640 1 -- 172.21.15.120:0/285575930 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f565c003530 con 0x7f56741538a0 2024-04-18T04:55:28.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.817+0000 7f567a000640 1 -- 172.21.15.120:0/285575930 >> v2:172.21.15.132:3300/0 conn(0x7f567406ab90 msgr2=0x7f567415cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:28.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.817+0000 7f567a000640 1 --2- 172.21.15.120:0/285575930 >> v2:172.21.15.132:3300/0 conn(0x7f567406ab90 0x7f567415cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:28.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.817+0000 7f567a000640 1 -- 172.21.15.120:0/285575930 >> v1:172.21.15.120:6789/0 conn(0x7f56741538a0 legacy=0x7f56740cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:28.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.817+0000 7f567a000640 1 -- 172.21.15.120:0/285575930 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56740c5120 con 0x7f56740c47d0 2024-04-18T04:55:28.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.817+0000 7f5678c00640 1 --2- 172.21.15.120:0/285575930 >> v2:172.21.15.132:3300/0 conn(0x7f567406ab90 0x7f567415cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:55:28.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.821+0000 7f567a000640 1 --2- 172.21.15.120:0/285575930 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f56740c47d0 0x7f56740c4be0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f566c009d90 tx=0x7f566c01c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec34e3f857f5d3c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:28.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.821+0000 7f5673e00640 1 -- 172.21.15.120:0/285575930 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c0a5a00 con 0x7f56740c47d0 2024-04-18T04:55:28.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.821+0000 7f5673e00640 1 -- 172.21.15.120:0/285575930 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566c0a5b60 con 0x7f56740c47d0 2024-04-18T04:55:28.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.821+0000 7f5673e00640 1 -- 172.21.15.120:0/285575930 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c0ad440 con 0x7f56740c47d0 2024-04-18T04:55:28.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.821+0000 7f567c000640 1 -- 172.21.15.120:0/285575930 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f56740c47d0 msgr2=0x7f56740c4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:28.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.821+0000 7f567c000640 1 --2- 172.21.15.120:0/285575930 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f56740c47d0 0x7f56740c4be0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f566c009d90 tx=0x7f566c01c940 comp rx=0 tx=0).stop 2024-04-18T04:55:28.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.821+0000 7f567c000640 1 -- 172.21.15.120:0/285575930 shutdown_connections 2024-04-18T04:55:28.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.821+0000 7f567c000640 1 --2- 172.21.15.120:0/285575930 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f56740c47d0 0x7f56740c4be0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:28.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.821+0000 7f567c000640 1 --2- 172.21.15.120:0/285575930 >> v2:172.21.15.132:3300/0 conn(0x7f567406ab90 0x7f567415cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:28.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.821+0000 7f567c000640 1 -- 172.21.15.120:0/285575930 >> 172.21.15.120:0/285575930 conn(0x7f5674065fc0 msgr2=0x7f56740663d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:28.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.821+0000 7f567c000640 1 -- 172.21.15.120:0/285575930 shutdown_connections 2024-04-18T04:55:28.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.821+0000 7f567c000640 1 -- 172.21.15.120:0/285575930 wait complete. 2024-04-18T04:55:28.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.821+0000 7f567c000640 1 Processor -- start 2024-04-18T04:55:28.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.821+0000 7f567c000640 1 -- start start 2024-04-18T04:55:28.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.825+0000 7f567c000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f567406ab90 0x7f5674152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:28.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.825+0000 7f567c000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f56740c47d0 0x7f56741529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:28.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.825+0000 7f567c000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56741538a0 0x7f56741f1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:28.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.825+0000 7f567c000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56741f4f80 con 0x7f567406ab90 2024-04-18T04:55:28.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.825+0000 7f567c000640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56741457f0 con 0x7f56741538a0 2024-04-18T04:55:28.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.825+0000 7f567c000640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56741f51d0 con 0x7f56740c47d0 2024-04-18T04:55:28.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.825+0000 7f5679600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f567406ab90 0x7f5674152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:28.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.825+0000 7f5679600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f567406ab90 0x7f5674152460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43070/0 (socket says 172.21.15.120:43070) 2024-04-18T04:55:28.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.825+0000 7f5679600640 1 -- 172.21.15.120:0/1810738754 learned_addr learned my addr 172.21.15.120:0/1810738754 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:28.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.825+0000 7f5678c00640 1 --2- 172.21.15.120:0/1810738754 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f56740c47d0 0x7f56741529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:28.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.825+0000 7f567a000640 1 --2- 172.21.15.120:0/1810738754 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56741538a0 0x7f56741f1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:28.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.825+0000 7f5679600640 1 -- 172.21.15.120:0/1810738754 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f56740c47d0 msgr2=0x7f56741529a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:28.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.825+0000 7f5679600640 1 --2- 172.21.15.120:0/1810738754 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f56740c47d0 0x7f56741529a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:28.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.825+0000 7f5679600640 1 -- 172.21.15.120:0/1810738754 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56741538a0 msgr2=0x7f56741f1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:28.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.825+0000 7f5679600640 1 --2- 172.21.15.120:0/1810738754 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56741538a0 0x7f56741f1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:28.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.825+0000 7f5679600640 1 -- 172.21.15.120:0/1810738754 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5660009420 con 0x7f567406ab90 2024-04-18T04:55:28.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.825+0000 7f5678c00640 1 --2- 172.21.15.120:0/1810738754 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f56740c47d0 0x7f56741529a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:55:28.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.825+0000 7f567a000640 1 --2- 172.21.15.120:0/1810738754 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56741538a0 0x7f56741f1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:55:28.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.825+0000 7f5679600640 1 --2- 172.21.15.120:0/1810738754 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f567406ab90 0x7f5674152460 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f56680010f0 tx=0x7f566800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:28.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.825+0000 7f5671600640 1 -- 172.21.15.120:0/1810738754 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5668005cf0 con 0x7f567406ab90 2024-04-18T04:55:28.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.825+0000 7f5671600640 1 -- 172.21.15.120:0/1810738754 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5668005e70 con 0x7f567406ab90 2024-04-18T04:55:28.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.825+0000 7f567c000640 1 -- 172.21.15.120:0/1810738754 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f566c009a70 con 0x7f567406ab90 2024-04-18T04:55:28.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.825+0000 7f5671600640 1 -- 172.21.15.120:0/1810738754 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56680072d0 con 0x7f567406ab90 2024-04-18T04:55:28.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.825+0000 7f567c000640 1 -- 172.21.15.120:0/1810738754 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56741f5790 con 0x7f567406ab90 2024-04-18T04:55:28.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.825+0000 7f567c000640 1 -- 172.21.15.120:0/1810738754 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56741f1a60 con 0x7f567406ab90 2024-04-18T04:55:28.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.825+0000 7f5671600640 1 -- 172.21.15.120:0/1810738754 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5668007430 con 0x7f567406ab90 2024-04-18T04:55:28.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.829+0000 7f5671600640 1 --2- 172.21.15.120:0/1810738754 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f56540666c0 0x7f5654068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:28.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.829+0000 7f5671600640 1 -- 172.21.15.120:0/1810738754 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f5668083d70 con 0x7f567406ab90 2024-04-18T04:55:28.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.829+0000 7f5678c00640 1 --2- 172.21.15.120:0/1810738754 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f56540666c0 0x7f5654068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:28.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.829+0000 7f5678c00640 1 --2- 172.21.15.120:0/1810738754 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f56540666c0 0x7f5654068b80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5674152fe0 tx=0x7f5660008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:28.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:28.833+0000 7f5671600640 1 -- 172.21.15.120:0/1810738754 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f5668050ad0 con 0x7f567406ab90 2024-04-18T04:55:28.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.001+0000 7f567c000640 1 -- 172.21.15.120:0/1810738754 --> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f56740c42b0 con 0x7f56540666c0 2024-04-18T04:55:29.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.033+0000 7f5671600640 1 -- 172.21.15.120:0/1810738754 <== mgr.4113 v2:172.21.15.132:6832/27788 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371387 (secure 0 0 0) 0x7f5660009990 con 0x7f56540666c0 2024-04-18T04:55:29.033 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:55:29.036 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-04-18T04:55:29.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.037+0000 7f567c000640 1 -- 172.21.15.120:0/1810738754 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f56540666c0 msgr2=0x7f5654068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:29.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.037+0000 7f567c000640 1 --2- 172.21.15.120:0/1810738754 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f56540666c0 0x7f5654068b80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5674152fe0 tx=0x7f5660008040 comp rx=0 tx=0).stop 2024-04-18T04:55:29.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.037+0000 7f567c000640 1 -- 172.21.15.120:0/1810738754 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f567406ab90 msgr2=0x7f5674152460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:29.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.037+0000 7f567c000640 1 --2- 172.21.15.120:0/1810738754 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f567406ab90 0x7f5674152460 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f56680010f0 tx=0x7f566800c890 comp rx=0 tx=0).stop 2024-04-18T04:55:29.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.037+0000 7f567c000640 1 -- 172.21.15.120:0/1810738754 shutdown_connections 2024-04-18T04:55:29.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.037+0000 7f567c000640 1 --2- 172.21.15.120:0/1810738754 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f56540666c0 0x7f5654068b80 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:29.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.037+0000 7f567c000640 1 --2- 172.21.15.120:0/1810738754 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56741538a0 0x7f56741f1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:29.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.037+0000 7f567c000640 1 --2- 172.21.15.120:0/1810738754 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f56740c47d0 0x7f56741529a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:29.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.037+0000 7f567c000640 1 --2- 172.21.15.120:0/1810738754 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f567406ab90 0x7f5674152460 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:29.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.037+0000 7f567c000640 1 -- 172.21.15.120:0/1810738754 >> 172.21.15.120:0/1810738754 conn(0x7f5674065fc0 msgr2=0x7f56740cd640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:29.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.037+0000 7f567c000640 1 -- 172.21.15.120:0/1810738754 shutdown_connections 2024-04-18T04:55:29.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.037+0000 7f567c000640 1 -- 172.21.15.120:0/1810738754 wait complete. 2024-04-18T04:55:29.053 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":361,"stamp":"2024-04-18T04:55:27.051213+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6342770473,"num_objects":1776,"num_object_clones":0,"num_object_copies":6922,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1776,"num_whiteouts":0,"num_read":667,"num_read_kb":75003,"num_write":2197059,"num_write_kb":31245685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152237,"ondisk_log_size":152237,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12254880,"kb_used_data":6444388,"kb_used_omap":12,"kb_used_meta":5808947,"kb_avail":742719840,"statfs":{"total":773094113280,"available":760545116160,"internally_reserved":0,"allocated":6599053312,"data_stored":14186104382,"data_compressed":813709105,"data_compressed_allocated":3024576512,"data_compressed_original":10613321728,"omap_allocated":12743,"internal_metadata":5948362297},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,3,4,6,1,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":79,"apply_latency_ms":79,"commit_latency_ns":79000000,"apply_latency_ns":79000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6223783943,"num_objects":-1484,"num_object_clones":0,"num_object_copies":-5936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1484,"num_whiteouts":0,"num_read":2,"num_read_kb":20,"num_write":1537,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004727"},"pg_stats":[{"pgid":"2.1f","version":"30'20","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.054277+0000","last_change":"2024-04-18T04:44:29.891079+0000","last_active":"2024-04-18T04:53:26.054277+0000","last_peered":"2024-04-18T04:53:26.054277+0000","last_clean":"2024-04-18T04:53:26.054277+0000","last_became_active":"2024-04-18T04:44:29.890853+0000","last_became_peered":"2024-04-18T04:44:29.890853+0000","last_unstale":"2024-04-18T04:53:26.054277+0000","last_undegraded":"2024-04-18T04:53:26.054277+0000","last_fullsized":"2024-04-18T04:53:26.054277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:12:22.299583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":4124,"num_write":18,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"32'6","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:46.162203+0000","last_change":"2024-04-18T04:44:30.296344+0000","last_active":"2024-04-18T04:54:46.162203+0000","last_peered":"2024-04-18T04:54:46.162203+0000","last_clean":"2024-04-18T04:54:46.162203+0000","last_became_active":"2024-04-18T04:44:30.296064+0000","last_became_peered":"2024-04-18T04:44:30.296064+0000","last_unstale":"2024-04-18T04:54:46.162203+0000","last_undegraded":"2024-04-18T04:54:46.162203+0000","last_fullsized":"2024-04-18T04:54:46.162203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:53:32.250308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'3929","reported_seq":3953,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.210516+0000","last_change":"2024-04-18T04:44:34.306605+0000","last_active":"2024-04-18T04:55:26.210516+0000","last_peered":"2024-04-18T04:55:26.210516+0000","last_clean":"2024-04-18T04:55:26.210516+0000","last_became_active":"2024-04-18T04:44:34.306224+0000","last_became_peered":"2024-04-18T04:44:34.306224+0000","last_unstale":"2024-04-18T04:55:26.210516+0000","last_undegraded":"2024-04-18T04:55:26.210516+0000","last_fullsized":"2024-04-18T04:55:26.210516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":3929,"log_dups_size":0,"ondisk_log_size":3929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:13:15.107711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155371727,"num_objects":45,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":58047,"num_write_kb":822950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'23","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.190960+0000","last_change":"2024-04-18T04:44:29.881521+0000","last_active":"2024-04-18T04:53:26.190960+0000","last_peered":"2024-04-18T04:53:26.190960+0000","last_clean":"2024-04-18T04:53:26.190960+0000","last_became_active":"2024-04-18T04:44:29.881258+0000","last_became_peered":"2024-04-18T04:44:29.881258+0000","last_unstale":"2024-04-18T04:53:26.190960+0000","last_undegraded":"2024-04-18T04:53:26.190960+0000","last_fullsized":"2024-04-18T04:53:26.190960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:28:40.075960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":19,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'6","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.053986+0000","last_change":"2024-04-18T04:44:30.314205+0000","last_active":"2024-04-18T04:53:26.053986+0000","last_peered":"2024-04-18T04:53:26.053986+0000","last_clean":"2024-04-18T04:53:26.053986+0000","last_became_active":"2024-04-18T04:44:30.313987+0000","last_became_peered":"2024-04-18T04:44:30.313987+0000","last_unstale":"2024-04-18T04:53:26.053986+0000","last_undegraded":"2024-04-18T04:53:26.053986+0000","last_fullsized":"2024-04-18T04:53:26.053986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:55:31.107861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"32'5266","reported_seq":5294,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:23.537910+0000","last_change":"2024-04-18T04:44:34.339646+0000","last_active":"2024-04-18T04:55:23.537910+0000","last_peered":"2024-04-18T04:55:23.537910+0000","last_clean":"2024-04-18T04:55:23.537910+0000","last_became_active":"2024-04-18T04:44:34.338485+0000","last_became_peered":"2024-04-18T04:44:34.338485+0000","last_unstale":"2024-04-18T04:55:23.537910+0000","last_undegraded":"2024-04-18T04:55:23.537910+0000","last_fullsized":"2024-04-18T04:55:23.537910+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":5266,"log_dups_size":0,"ondisk_log_size":5266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:47:01.277301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":231330314,"num_objects":59,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":77953,"num_write_kb":1107856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"32'74","reported_seq":106,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:32.488186+0000","last_change":"2024-04-18T04:44:29.897785+0000","last_active":"2024-04-18T04:54:32.488186+0000","last_peered":"2024-04-18T04:54:32.488186+0000","last_clean":"2024-04-18T04:54:32.488186+0000","last_became_active":"2024-04-18T04:44:29.896520+0000","last_became_peered":"2024-04-18T04:44:29.896520+0000","last_unstale":"2024-04-18T04:54:32.488186+0000","last_undegraded":"2024-04-18T04:54:32.488186+0000","last_fullsized":"2024-04-18T04:54:32.488186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:25:52.871139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":14,"num_read_kb":8212,"num_write":66,"num_write_kb":8229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"32'9","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:20.586531+0000","last_change":"2024-04-18T04:44:30.300588+0000","last_active":"2024-04-18T04:55:20.586531+0000","last_peered":"2024-04-18T04:55:20.586531+0000","last_clean":"2024-04-18T04:55:20.586531+0000","last_became_active":"2024-04-18T04:44:30.299939+0000","last_became_peered":"2024-04-18T04:44:30.299939+0000","last_unstale":"2024-04-18T04:55:20.586531+0000","last_undegraded":"2024-04-18T04:55:20.586531+0000","last_fullsized":"2024-04-18T04:55:20.586531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:57:07.547985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"32'4853","reported_seq":4878,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:23.791287+0000","last_change":"2024-04-18T04:44:34.338794+0000","last_active":"2024-04-18T04:55:23.791287+0000","last_peered":"2024-04-18T04:55:23.791287+0000","last_clean":"2024-04-18T04:55:23.791287+0000","last_became_active":"2024-04-18T04:44:34.337938+0000","last_became_peered":"2024-04-18T04:44:34.337938+0000","last_unstale":"2024-04-18T04:55:23.791287+0000","last_undegraded":"2024-04-18T04:55:23.791287+0000","last_fullsized":"2024-04-18T04:55:23.791287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4853,"log_dups_size":0,"ondisk_log_size":4853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:48.827970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247469052,"num_objects":63,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":72176,"num_write_kb":1012843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"32'87","reported_seq":115,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:19.746989+0000","last_change":"2024-04-18T04:44:29.903118+0000","last_active":"2024-04-18T04:55:19.746989+0000","last_peered":"2024-04-18T04:55:19.746989+0000","last_clean":"2024-04-18T04:55:19.746989+0000","last_became_active":"2024-04-18T04:44:29.902611+0000","last_became_peered":"2024-04-18T04:44:29.902611+0000","last_unstale":"2024-04-18T04:55:19.746989+0000","last_undegraded":"2024-04-18T04:55:19.746989+0000","last_fullsized":"2024-04-18T04:55:19.746989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:38:42.595095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1375230,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":86,"num_write_kb":1389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"28'15","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.060272+0000","last_change":"2024-04-18T04:44:30.301328+0000","last_active":"2024-04-18T04:53:26.060272+0000","last_peered":"2024-04-18T04:53:26.060272+0000","last_clean":"2024-04-18T04:53:26.060272+0000","last_became_active":"2024-04-18T04:44:30.300303+0000","last_became_peered":"2024-04-18T04:44:30.300303+0000","last_unstale":"2024-04-18T04:53:26.060272+0000","last_undegraded":"2024-04-18T04:53:26.060272+0000","last_fullsized":"2024-04-18T04:53:26.060272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:24:11.941483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'4523","reported_seq":4551,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:23.615506+0000","last_change":"2024-04-18T04:44:34.327044+0000","last_active":"2024-04-18T04:55:23.615506+0000","last_peered":"2024-04-18T04:55:23.615506+0000","last_clean":"2024-04-18T04:55:23.615506+0000","last_became_active":"2024-04-18T04:44:34.326161+0000","last_became_peered":"2024-04-18T04:44:34.326161+0000","last_unstale":"2024-04-18T04:55:23.615506+0000","last_undegraded":"2024-04-18T04:55:23.615506+0000","last_fullsized":"2024-04-18T04:55:23.615506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4523,"log_dups_size":0,"ondisk_log_size":4523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:47:41.413530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197174860,"num_objects":53,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":5,"num_read_kb":1,"num_write":66992,"num_write_kb":936790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"32'6","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:22.738989+0000","last_change":"2024-04-18T04:44:30.296493+0000","last_active":"2024-04-18T04:55:22.738989+0000","last_peered":"2024-04-18T04:55:22.738989+0000","last_clean":"2024-04-18T04:55:22.738989+0000","last_became_active":"2024-04-18T04:44:30.295657+0000","last_became_peered":"2024-04-18T04:44:30.295657+0000","last_unstale":"2024-04-18T04:55:22.738989+0000","last_undegraded":"2024-04-18T04:55:22.738989+0000","last_fullsized":"2024-04-18T04:55:22.738989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:39:40.270643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"32'980","reported_seq":1012,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:09.820948+0000","last_change":"2024-04-18T04:44:29.900036+0000","last_active":"2024-04-18T04:55:09.820948+0000","last_peered":"2024-04-18T04:55:09.820948+0000","last_clean":"2024-04-18T04:55:09.820948+0000","last_became_active":"2024-04-18T04:44:29.899402+0000","last_became_peered":"2024-04-18T04:44:29.899402+0000","last_unstale":"2024-04-18T04:55:09.820948+0000","last_undegraded":"2024-04-18T04:55:09.820948+0000","last_fullsized":"2024-04-18T04:55:09.820948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":980,"log_dups_size":0,"ondisk_log_size":980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:45:51.681317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":4110,"num_write":977,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"32'4725","reported_seq":4753,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:23.877993+0000","last_change":"2024-04-18T04:44:34.320846+0000","last_active":"2024-04-18T04:55:23.877993+0000","last_peered":"2024-04-18T04:55:23.877993+0000","last_clean":"2024-04-18T04:55:23.877993+0000","last_became_active":"2024-04-18T04:44:34.319868+0000","last_became_peered":"2024-04-18T04:44:34.319868+0000","last_unstale":"2024-04-18T04:55:23.877993+0000","last_undegraded":"2024-04-18T04:55:23.877993+0000","last_fullsized":"2024-04-18T04:55:23.877993+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4725,"log_dups_size":0,"ondisk_log_size":4725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:08:30.863140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197139262,"num_objects":52,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":69834,"num_write_kb":985071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"32'5","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:13.500608+0000","last_change":"2024-04-18T04:44:30.271756+0000","last_active":"2024-04-18T04:55:13.500608+0000","last_peered":"2024-04-18T04:55:13.500608+0000","last_clean":"2024-04-18T04:55:13.500608+0000","last_became_active":"2024-04-18T04:44:30.271420+0000","last_became_peered":"2024-04-18T04:44:30.271420+0000","last_unstale":"2024-04-18T04:55:13.500608+0000","last_undegraded":"2024-04-18T04:55:13.500608+0000","last_fullsized":"2024-04-18T04:55:13.500608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:27:18.559327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"32'5","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:31.068025+0000","last_change":"2024-04-18T04:44:29.878416+0000","last_active":"2024-04-18T04:53:31.068025+0000","last_peered":"2024-04-18T04:53:31.068025+0000","last_clean":"2024-04-18T04:53:31.068025+0000","last_became_active":"2024-04-18T04:44:29.878139+0000","last_became_peered":"2024-04-18T04:44:29.878139+0000","last_unstale":"2024-04-18T04:53:31.068025+0000","last_undegraded":"2024-04-18T04:53:31.068025+0000","last_fullsized":"2024-04-18T04:53:31.068025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:19:00.769888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"32'4586","reported_seq":4611,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:23.796218+0000","last_change":"2024-04-18T04:44:34.346123+0000","last_active":"2024-04-18T04:55:23.796218+0000","last_peered":"2024-04-18T04:55:23.796218+0000","last_clean":"2024-04-18T04:55:23.796218+0000","last_became_active":"2024-04-18T04:44:34.345267+0000","last_became_peered":"2024-04-18T04:44:34.345267+0000","last_unstale":"2024-04-18T04:55:23.796218+0000","last_undegraded":"2024-04-18T04:55:23.796218+0000","last_fullsized":"2024-04-18T04:55:23.796218+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4586,"log_dups_size":0,"ondisk_log_size":4586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:14:08.078650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251671381,"num_objects":63,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":68070,"num_write_kb":992962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"32'7","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:21.521015+0000","last_change":"2024-04-18T04:44:30.274049+0000","last_active":"2024-04-18T04:55:21.521015+0000","last_peered":"2024-04-18T04:55:21.521015+0000","last_clean":"2024-04-18T04:55:21.521015+0000","last_became_active":"2024-04-18T04:44:30.273752+0000","last_became_peered":"2024-04-18T04:44:30.273752+0000","last_unstale":"2024-04-18T04:55:21.521015+0000","last_undegraded":"2024-04-18T04:55:21.521015+0000","last_fullsized":"2024-04-18T04:55:21.521015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:48:20.479069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'6","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:23.860662+0000","last_change":"2024-04-18T04:44:29.890569+0000","last_active":"2024-04-18T04:54:23.860662+0000","last_peered":"2024-04-18T04:54:23.860662+0000","last_clean":"2024-04-18T04:54:23.860662+0000","last_became_active":"2024-04-18T04:44:29.889684+0000","last_became_peered":"2024-04-18T04:44:29.889684+0000","last_unstale":"2024-04-18T04:54:23.860662+0000","last_undegraded":"2024-04-18T04:54:23.860662+0000","last_fullsized":"2024-04-18T04:54:23.860662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:53:00.230580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":8,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"32'4564","reported_seq":4589,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:22.935372+0000","last_change":"2024-04-18T04:44:34.313634+0000","last_active":"2024-04-18T04:55:22.935372+0000","last_peered":"2024-04-18T04:55:22.935372+0000","last_clean":"2024-04-18T04:55:22.935372+0000","last_became_active":"2024-04-18T04:44:34.313161+0000","last_became_peered":"2024-04-18T04:44:34.313161+0000","last_unstale":"2024-04-18T04:55:22.935372+0000","last_undegraded":"2024-04-18T04:55:22.935372+0000","last_fullsized":"2024-04-18T04:55:22.935372+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4564,"log_dups_size":0,"ondisk_log_size":4564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:01:07.805128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218109112,"num_objects":56,"num_object_clones":0,"num_object_copies":224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":67627,"num_write_kb":962979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'1","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.071440+0000","last_change":"2024-04-18T04:44:30.284805+0000","last_active":"2024-04-18T04:53:26.071440+0000","last_peered":"2024-04-18T04:53:26.071440+0000","last_clean":"2024-04-18T04:53:26.071440+0000","last_became_active":"2024-04-18T04:44:30.279238+0000","last_became_peered":"2024-04-18T04:44:30.279238+0000","last_unstale":"2024-04-18T04:53:26.071440+0000","last_undegraded":"2024-04-18T04:53:26.071440+0000","last_fullsized":"2024-04-18T04:53:26.071440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:59:24.067420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"30'20","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:24.361610+0000","last_change":"2024-04-18T04:44:29.890816+0000","last_active":"2024-04-18T04:54:24.361610+0000","last_peered":"2024-04-18T04:54:24.361610+0000","last_clean":"2024-04-18T04:54:24.361610+0000","last_became_active":"2024-04-18T04:44:29.890272+0000","last_became_peered":"2024-04-18T04:44:29.890272+0000","last_unstale":"2024-04-18T04:54:24.361610+0000","last_undegraded":"2024-04-18T04:54:24.361610+0000","last_fullsized":"2024-04-18T04:54:24.361610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:30:22.614083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":4108,"num_write":18,"num_write_kb":4103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"32'4368","reported_seq":4393,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:22.487363+0000","last_change":"2024-04-18T04:44:34.344973+0000","last_active":"2024-04-18T04:55:22.487363+0000","last_peered":"2024-04-18T04:55:22.487363+0000","last_clean":"2024-04-18T04:55:22.487363+0000","last_became_active":"2024-04-18T04:44:34.344007+0000","last_became_peered":"2024-04-18T04:44:34.344007+0000","last_unstale":"2024-04-18T04:55:22.487363+0000","last_undegraded":"2024-04-18T04:55:22.487363+0000","last_fullsized":"2024-04-18T04:55:22.487363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4368,"log_dups_size":0,"ondisk_log_size":4368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:56:43.476132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201580452,"num_objects":56,"num_object_clones":0,"num_object_copies":224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":64533,"num_write_kb":921811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"32'9","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:23.252520+0000","last_change":"2024-04-18T04:44:30.278193+0000","last_active":"2024-04-18T04:55:23.252520+0000","last_peered":"2024-04-18T04:55:23.252520+0000","last_clean":"2024-04-18T04:55:23.252520+0000","last_became_active":"2024-04-18T04:44:30.277916+0000","last_became_peered":"2024-04-18T04:44:30.277916+0000","last_unstale":"2024-04-18T04:55:23.252520+0000","last_undegraded":"2024-04-18T04:55:23.252520+0000","last_fullsized":"2024-04-18T04:55:23.252520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:57:19.783436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:23.867186+0000","last_change":"2024-04-18T04:44:29.896901+0000","last_active":"2024-04-18T04:54:23.867186+0000","last_peered":"2024-04-18T04:54:23.867186+0000","last_clean":"2024-04-18T04:54:23.867186+0000","last_became_active":"2024-04-18T04:44:29.896392+0000","last_became_peered":"2024-04-18T04:44:29.896392+0000","last_unstale":"2024-04-18T04:54:23.867186+0000","last_undegraded":"2024-04-18T04:54:23.867186+0000","last_fullsized":"2024-04-18T04:54:23.867186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:46:08.869450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"32'4413","reported_seq":4438,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:23.513912+0000","last_change":"2024-04-18T04:44:34.339233+0000","last_active":"2024-04-18T04:55:23.513912+0000","last_peered":"2024-04-18T04:55:23.513912+0000","last_clean":"2024-04-18T04:55:23.513912+0000","last_became_active":"2024-04-18T04:44:34.338294+0000","last_became_peered":"2024-04-18T04:44:34.338294+0000","last_unstale":"2024-04-18T04:55:23.513912+0000","last_undegraded":"2024-04-18T04:55:23.513912+0000","last_fullsized":"2024-04-18T04:55:23.513912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4413,"log_dups_size":0,"ondisk_log_size":4413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:20:35.738410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205673128,"num_objects":57,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":65514,"num_write_kb":938881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"32'6","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:50.279534+0000","last_change":"2024-04-18T04:45:12.045887+0000","last_active":"2024-04-18T04:53:50.279534+0000","last_peered":"2024-04-18T04:53:50.279534+0000","last_clean":"2024-04-18T04:53:50.279534+0000","last_became_active":"2024-04-18T04:45:12.045671+0000","last_became_peered":"2024-04-18T04:45:12.045671+0000","last_unstale":"2024-04-18T04:53:50.279534+0000","last_undegraded":"2024-04-18T04:53:50.279534+0000","last_fullsized":"2024-04-18T04:53:50.279534+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:22:58.022926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"32'97","reported_seq":128,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:17.961210+0000","last_change":"2024-04-18T04:44:29.894503+0000","last_active":"2024-04-18T04:55:17.961210+0000","last_peered":"2024-04-18T04:55:17.961210+0000","last_clean":"2024-04-18T04:55:17.961210+0000","last_became_active":"2024-04-18T04:44:29.894210+0000","last_became_peered":"2024-04-18T04:44:29.894210+0000","last_unstale":"2024-04-18T04:55:17.961210+0000","last_undegraded":"2024-04-18T04:55:17.961210+0000","last_fullsized":"2024-04-18T04:55:17.961210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:14:56.979204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":22,"num_write":220,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"32'4801","reported_seq":4830,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.490311+0000","last_change":"2024-04-18T04:44:34.305652+0000","last_active":"2024-04-18T04:55:26.490311+0000","last_peered":"2024-04-18T04:55:26.490311+0000","last_clean":"2024-04-18T04:55:26.490311+0000","last_became_active":"2024-04-18T04:44:34.305180+0000","last_became_peered":"2024-04-18T04:44:34.305180+0000","last_unstale":"2024-04-18T04:55:26.490311+0000","last_undegraded":"2024-04-18T04:55:26.490311+0000","last_fullsized":"2024-04-18T04:55:26.490311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4801,"log_dups_size":0,"ondisk_log_size":4801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:03:10.781821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171985668,"num_objects":47,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":70738,"num_write_kb":998644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'9","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.152733+0000","last_change":"2024-04-18T04:44:30.267158+0000","last_active":"2024-04-18T04:53:26.152733+0000","last_peered":"2024-04-18T04:53:26.152733+0000","last_clean":"2024-04-18T04:53:26.152733+0000","last_became_active":"2024-04-18T04:44:30.266814+0000","last_became_peered":"2024-04-18T04:44:30.266814+0000","last_unstale":"2024-04-18T04:53:26.152733+0000","last_undegraded":"2024-04-18T04:53:26.152733+0000","last_fullsized":"2024-04-18T04:53:26.152733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:16:02.152817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'4","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:31.064330+0000","last_change":"2024-04-18T04:44:29.898812+0000","last_active":"2024-04-18T04:53:31.064330+0000","last_peered":"2024-04-18T04:53:31.064330+0000","last_clean":"2024-04-18T04:53:31.064330+0000","last_became_active":"2024-04-18T04:44:29.897156+0000","last_became_peered":"2024-04-18T04:44:29.897156+0000","last_unstale":"2024-04-18T04:53:31.064330+0000","last_undegraded":"2024-04-18T04:53:31.064330+0000","last_fullsized":"2024-04-18T04:53:31.064330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:09:47.746394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":7,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"32'4341","reported_seq":4368,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.085562+0000","last_change":"2024-04-18T04:44:34.324721+0000","last_active":"2024-04-18T04:55:26.085562+0000","last_peered":"2024-04-18T04:55:26.085562+0000","last_clean":"2024-04-18T04:55:26.085562+0000","last_became_active":"2024-04-18T04:44:34.322925+0000","last_became_peered":"2024-04-18T04:44:34.322925+0000","last_unstale":"2024-04-18T04:55:26.085562+0000","last_undegraded":"2024-04-18T04:55:26.085562+0000","last_fullsized":"2024-04-18T04:55:26.085562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4341,"log_dups_size":0,"ondisk_log_size":4341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:11:59.682230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146853901,"num_objects":39,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":64187,"num_write_kb":906867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"32'6","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:15.171307+0000","last_change":"2024-04-18T04:44:30.281640+0000","last_active":"2024-04-18T04:55:15.171307+0000","last_peered":"2024-04-18T04:55:15.171307+0000","last_clean":"2024-04-18T04:55:15.171307+0000","last_became_active":"2024-04-18T04:44:30.280968+0000","last_became_peered":"2024-04-18T04:44:30.280968+0000","last_unstale":"2024-04-18T04:55:15.171307+0000","last_undegraded":"2024-04-18T04:55:15.171307+0000","last_fullsized":"2024-04-18T04:55:15.171307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:35:20.755711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"28'1","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.152863+0000","last_change":"2024-04-18T04:44:29.882715+0000","last_active":"2024-04-18T04:53:26.152863+0000","last_peered":"2024-04-18T04:53:26.152863+0000","last_clean":"2024-04-18T04:53:26.152863+0000","last_became_active":"2024-04-18T04:44:29.882335+0000","last_became_peered":"2024-04-18T04:44:29.882335+0000","last_unstale":"2024-04-18T04:53:26.152863+0000","last_undegraded":"2024-04-18T04:53:26.152863+0000","last_fullsized":"2024-04-18T04:53:26.152863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:32:59.709151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4587","reported_seq":4616,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:22.357437+0000","last_change":"2024-04-18T04:44:34.325029+0000","last_active":"2024-04-18T04:55:22.357437+0000","last_peered":"2024-04-18T04:55:22.357437+0000","last_clean":"2024-04-18T04:55:22.357437+0000","last_became_active":"2024-04-18T04:44:34.324082+0000","last_became_peered":"2024-04-18T04:44:34.324082+0000","last_unstale":"2024-04-18T04:55:22.357437+0000","last_undegraded":"2024-04-18T04:55:22.357437+0000","last_fullsized":"2024-04-18T04:55:22.357437+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4587,"log_dups_size":0,"ondisk_log_size":4587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:28:10.378037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201351186,"num_objects":53,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":67927,"num_write_kb":954001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"28'6","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.072025+0000","last_change":"2024-04-18T04:44:30.276174+0000","last_active":"2024-04-18T04:53:26.072025+0000","last_peered":"2024-04-18T04:53:26.072025+0000","last_clean":"2024-04-18T04:53:26.072025+0000","last_became_active":"2024-04-18T04:44:30.270878+0000","last_became_peered":"2024-04-18T04:44:30.270878+0000","last_unstale":"2024-04-18T04:53:26.072025+0000","last_undegraded":"2024-04-18T04:53:26.072025+0000","last_fullsized":"2024-04-18T04:53:26.072025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:35:12.296277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"30'27","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.060101+0000","last_change":"2024-04-18T04:44:29.896745+0000","last_active":"2024-04-18T04:53:26.060101+0000","last_peered":"2024-04-18T04:53:26.060101+0000","last_clean":"2024-04-18T04:53:26.060101+0000","last_became_active":"2024-04-18T04:44:29.896199+0000","last_became_peered":"2024-04-18T04:44:29.896199+0000","last_unstale":"2024-04-18T04:53:26.060101+0000","last_undegraded":"2024-04-18T04:53:26.060101+0000","last_fullsized":"2024-04-18T04:53:26.060101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:25:05.424668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":22,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"32'5184","reported_seq":5212,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:22.828376+0000","last_change":"2024-04-18T04:44:34.337429+0000","last_active":"2024-04-18T04:55:22.828376+0000","last_peered":"2024-04-18T04:55:22.828376+0000","last_clean":"2024-04-18T04:55:22.828376+0000","last_became_active":"2024-04-18T04:44:34.337089+0000","last_became_peered":"2024-04-18T04:44:34.337089+0000","last_unstale":"2024-04-18T04:55:22.828376+0000","last_undegraded":"2024-04-18T04:55:22.828376+0000","last_fullsized":"2024-04-18T04:55:22.828376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":5184,"log_dups_size":0,"ondisk_log_size":5184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:00:56.976431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272664724,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":76795,"num_write_kb":1090506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"32'9","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:37.740338+0000","last_change":"2024-04-18T04:44:30.270874+0000","last_active":"2024-04-18T04:54:37.740338+0000","last_peered":"2024-04-18T04:54:37.740338+0000","last_clean":"2024-04-18T04:54:37.740338+0000","last_became_active":"2024-04-18T04:44:30.270636+0000","last_became_peered":"2024-04-18T04:44:30.270636+0000","last_unstale":"2024-04-18T04:54:37.740338+0000","last_undegraded":"2024-04-18T04:54:37.740338+0000","last_fullsized":"2024-04-18T04:54:37.740338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:25:49.889554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"32'42","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:17.017144+0000","last_change":"2024-04-18T04:44:29.878607+0000","last_active":"2024-04-18T04:55:17.017144+0000","last_peered":"2024-04-18T04:55:17.017144+0000","last_clean":"2024-04-18T04:55:17.017144+0000","last_became_active":"2024-04-18T04:44:29.878330+0000","last_became_peered":"2024-04-18T04:44:29.878330+0000","last_unstale":"2024-04-18T04:55:17.017144+0000","last_undegraded":"2024-04-18T04:55:17.017144+0000","last_fullsized":"2024-04-18T04:55:17.017144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:09:18.088701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90443,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":42,"num_read_kb":118,"num_write":37,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'4354","reported_seq":4379,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:22.403928+0000","last_change":"2024-04-18T04:44:34.323315+0000","last_active":"2024-04-18T04:55:22.403928+0000","last_peered":"2024-04-18T04:55:22.403928+0000","last_clean":"2024-04-18T04:55:22.403928+0000","last_became_active":"2024-04-18T04:44:34.322983+0000","last_became_peered":"2024-04-18T04:44:34.322983+0000","last_unstale":"2024-04-18T04:55:22.403928+0000","last_undegraded":"2024-04-18T04:55:22.403928+0000","last_fullsized":"2024-04-18T04:55:22.403928+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4354,"log_dups_size":0,"ondisk_log_size":4354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:48:12.803273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247485990,"num_objects":63,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":64640,"num_write_kb":914612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"27'2","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.052645+0000","last_change":"2024-04-18T04:44:30.285533+0000","last_active":"2024-04-18T04:53:26.052645+0000","last_peered":"2024-04-18T04:53:26.052645+0000","last_clean":"2024-04-18T04:53:26.052645+0000","last_became_active":"2024-04-18T04:44:30.285113+0000","last_became_peered":"2024-04-18T04:44:30.285113+0000","last_unstale":"2024-04-18T04:53:26.052645+0000","last_undegraded":"2024-04-18T04:53:26.052645+0000","last_fullsized":"2024-04-18T04:53:26.052645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:37:20.367349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"32'29","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:35.068171+0000","last_change":"2024-04-18T04:44:29.890701+0000","last_active":"2024-04-18T04:53:35.068171+0000","last_peered":"2024-04-18T04:53:35.068171+0000","last_clean":"2024-04-18T04:53:35.068171+0000","last_became_active":"2024-04-18T04:44:29.890207+0000","last_became_peered":"2024-04-18T04:44:29.890207+0000","last_unstale":"2024-04-18T04:53:35.068171+0000","last_undegraded":"2024-04-18T04:53:35.068171+0000","last_fullsized":"2024-04-18T04:53:35.068171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:06:58.470725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":8204,"num_write":25,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"32'5213","reported_seq":5250,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.130337+0000","last_change":"2024-04-18T04:45:12.378646+0000","last_active":"2024-04-18T04:55:26.130337+0000","last_peered":"2024-04-18T04:55:26.130337+0000","last_clean":"2024-04-18T04:55:26.130337+0000","last_became_active":"2024-04-18T04:45:12.378263+0000","last_became_peered":"2024-04-18T04:45:12.378263+0000","last_unstale":"2024-04-18T04:55:26.130337+0000","last_undegraded":"2024-04-18T04:55:26.130337+0000","last_fullsized":"2024-04-18T04:55:26.130337+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":5213,"log_dups_size":0,"ondisk_log_size":5213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:59:31.439452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188934285,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":76573,"num_write_kb":1101398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"32'9","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:51.197830+0000","last_change":"2024-04-18T04:44:30.306826+0000","last_active":"2024-04-18T04:54:51.197830+0000","last_peered":"2024-04-18T04:54:51.197830+0000","last_clean":"2024-04-18T04:54:51.197830+0000","last_became_active":"2024-04-18T04:44:30.306320+0000","last_became_peered":"2024-04-18T04:44:30.306320+0000","last_unstale":"2024-04-18T04:54:51.197830+0000","last_undegraded":"2024-04-18T04:54:51.197830+0000","last_fullsized":"2024-04-18T04:54:51.197830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:47:38.564197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"25'3","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:23.242696+0000","last_change":"2024-04-18T04:44:29.888023+0000","last_active":"2024-04-18T04:54:23.242696+0000","last_peered":"2024-04-18T04:54:23.242696+0000","last_clean":"2024-04-18T04:54:23.242696+0000","last_became_active":"2024-04-18T04:44:29.887440+0000","last_became_peered":"2024-04-18T04:44:29.887440+0000","last_unstale":"2024-04-18T04:54:23.242696+0000","last_undegraded":"2024-04-18T04:54:23.242696+0000","last_fullsized":"2024-04-18T04:54:23.242696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:07:01.067445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":20,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":180,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.040633+0000","last_change":"2024-04-18T04:44:18.629794+0000","last_active":"2024-04-18T04:53:26.040633+0000","last_peered":"2024-04-18T04:53:26.040633+0000","last_clean":"2024-04-18T04:53:26.040633+0000","last_became_active":"2024-04-18T04:44:18.627792+0000","last_became_peered":"2024-04-18T04:44:18.627792+0000","last_unstale":"2024-04-18T04:53:26.040633+0000","last_undegraded":"2024-04-18T04:53:26.040633+0000","last_fullsized":"2024-04-18T04:53:26.040633+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:17.410146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:17.410146+0000","last_clean_scrub_stamp":"2024-04-18T04:44:17.410146+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:30:49.101656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"32'4199","reported_seq":4224,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:23.532373+0000","last_change":"2024-04-18T04:44:34.333286+0000","last_active":"2024-04-18T04:55:23.532373+0000","last_peered":"2024-04-18T04:55:23.532373+0000","last_clean":"2024-04-18T04:55:23.532373+0000","last_became_active":"2024-04-18T04:44:34.332520+0000","last_became_peered":"2024-04-18T04:44:34.332520+0000","last_unstale":"2024-04-18T04:55:23.532373+0000","last_undegraded":"2024-04-18T04:55:23.532373+0000","last_fullsized":"2024-04-18T04:55:23.532373+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4199,"log_dups_size":0,"ondisk_log_size":4199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:58:48.264040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201343870,"num_objects":53,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":62321,"num_write_kb":880557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"28'4","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.041507+0000","last_change":"2024-04-18T04:44:30.303602+0000","last_active":"2024-04-18T04:53:26.041507+0000","last_peered":"2024-04-18T04:53:26.041507+0000","last_clean":"2024-04-18T04:53:26.041507+0000","last_became_active":"2024-04-18T04:44:30.302157+0000","last_became_peered":"2024-04-18T04:44:30.302157+0000","last_unstale":"2024-04-18T04:53:26.041507+0000","last_undegraded":"2024-04-18T04:53:26.041507+0000","last_fullsized":"2024-04-18T04:53:26.041507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:09:57.582065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"32'6","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:35.662461+0000","last_change":"2024-04-18T04:44:29.890428+0000","last_active":"2024-04-18T04:53:35.662461+0000","last_peered":"2024-04-18T04:53:35.662461+0000","last_clean":"2024-04-18T04:53:35.662461+0000","last_became_active":"2024-04-18T04:44:29.890166+0000","last_became_peered":"2024-04-18T04:44:29.890166+0000","last_unstale":"2024-04-18T04:53:35.662461+0000","last_undegraded":"2024-04-18T04:53:35.662461+0000","last_fullsized":"2024-04-18T04:53:35.662461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:21:16.823377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":14,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"32'3601","reported_seq":3630,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:23.388786+0000","last_change":"2024-04-18T04:44:34.334071+0000","last_active":"2024-04-18T04:55:23.388786+0000","last_peered":"2024-04-18T04:55:23.388786+0000","last_clean":"2024-04-18T04:55:23.388786+0000","last_became_active":"2024-04-18T04:44:34.332695+0000","last_became_peered":"2024-04-18T04:44:34.332695+0000","last_unstale":"2024-04-18T04:55:23.388786+0000","last_undegraded":"2024-04-18T04:55:23.388786+0000","last_fullsized":"2024-04-18T04:55:23.388786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":3601,"log_dups_size":0,"ondisk_log_size":3601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:22:52.371921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197188047,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":53389,"num_write_kb":771461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'7","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.059834+0000","last_change":"2024-04-18T04:44:30.287908+0000","last_active":"2024-04-18T04:53:26.059834+0000","last_peered":"2024-04-18T04:53:26.059834+0000","last_clean":"2024-04-18T04:53:26.059834+0000","last_became_active":"2024-04-18T04:44:30.287217+0000","last_became_peered":"2024-04-18T04:44:30.287217+0000","last_unstale":"2024-04-18T04:53:26.059834+0000","last_undegraded":"2024-04-18T04:53:26.059834+0000","last_fullsized":"2024-04-18T04:53:26.059834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:47:14.962330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"30'24","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.057944+0000","last_change":"2024-04-18T04:44:29.886376+0000","last_active":"2024-04-18T04:53:26.057944+0000","last_peered":"2024-04-18T04:53:26.057944+0000","last_clean":"2024-04-18T04:53:26.057944+0000","last_became_active":"2024-04-18T04:44:29.886058+0000","last_became_peered":"2024-04-18T04:44:29.886058+0000","last_unstale":"2024-04-18T04:53:26.057944+0000","last_undegraded":"2024-04-18T04:53:26.057944+0000","last_fullsized":"2024-04-18T04:53:26.057944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:29:59.678071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":23,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"32'4528","reported_seq":4564,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.207971+0000","last_change":"2024-04-18T04:45:12.373987+0000","last_active":"2024-04-18T04:55:26.207971+0000","last_peered":"2024-04-18T04:55:26.207971+0000","last_clean":"2024-04-18T04:55:26.207971+0000","last_became_active":"2024-04-18T04:45:12.373269+0000","last_became_peered":"2024-04-18T04:45:12.373269+0000","last_unstale":"2024-04-18T04:55:26.207971+0000","last_undegraded":"2024-04-18T04:55:26.207971+0000","last_fullsized":"2024-04-18T04:55:26.207971+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4528,"log_dups_size":0,"ondisk_log_size":4528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:19:01.073786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155454305,"num_objects":45,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":66874,"num_write_kb":952859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"32'8","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:16.060876+0000","last_change":"2024-04-18T04:45:12.043098+0000","last_active":"2024-04-18T04:54:16.060876+0000","last_peered":"2024-04-18T04:54:16.060876+0000","last_clean":"2024-04-18T04:54:16.060876+0000","last_became_active":"2024-04-18T04:45:12.042803+0000","last_became_peered":"2024-04-18T04:45:12.042803+0000","last_unstale":"2024-04-18T04:54:16.060876+0000","last_undegraded":"2024-04-18T04:54:16.060876+0000","last_fullsized":"2024-04-18T04:54:16.060876+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:15:13.837607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"32'269","reported_seq":299,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:09.768555+0000","last_change":"2024-04-18T04:44:29.878650+0000","last_active":"2024-04-18T04:55:09.768555+0000","last_peered":"2024-04-18T04:55:09.768555+0000","last_clean":"2024-04-18T04:55:09.768555+0000","last_became_active":"2024-04-18T04:44:29.878361+0000","last_became_peered":"2024-04-18T04:44:29.878361+0000","last_unstale":"2024-04-18T04:55:09.768555+0000","last_undegraded":"2024-04-18T04:55:09.768555+0000","last_fullsized":"2024-04-18T04:55:09.768555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:57:41.162118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":678,"num_write":267,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"32'4352","reported_seq":4383,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:22.863158+0000","last_change":"2024-04-18T04:44:34.339023+0000","last_active":"2024-04-18T04:55:22.863158+0000","last_peered":"2024-04-18T04:55:22.863158+0000","last_clean":"2024-04-18T04:55:22.863158+0000","last_became_active":"2024-04-18T04:44:34.338042+0000","last_became_peered":"2024-04-18T04:44:34.338042+0000","last_unstale":"2024-04-18T04:55:22.863158+0000","last_undegraded":"2024-04-18T04:55:22.863158+0000","last_fullsized":"2024-04-18T04:55:22.863158+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4352,"log_dups_size":0,"ondisk_log_size":4352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:48:58.174635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218199081,"num_objects":59,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":64552,"num_write_kb":926956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'4","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.041326+0000","last_change":"2024-04-18T04:44:30.291740+0000","last_active":"2024-04-18T04:53:26.041326+0000","last_peered":"2024-04-18T04:53:26.041326+0000","last_clean":"2024-04-18T04:53:26.041326+0000","last_became_active":"2024-04-18T04:44:30.290379+0000","last_became_peered":"2024-04-18T04:44:30.290379+0000","last_unstale":"2024-04-18T04:53:26.041326+0000","last_undegraded":"2024-04-18T04:53:26.041326+0000","last_fullsized":"2024-04-18T04:53:26.041326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:44:25.111858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"31'9","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.071265+0000","last_change":"2024-04-18T04:44:29.882833+0000","last_active":"2024-04-18T04:53:26.071265+0000","last_peered":"2024-04-18T04:53:26.071265+0000","last_clean":"2024-04-18T04:53:26.071265+0000","last_became_active":"2024-04-18T04:44:29.881671+0000","last_became_peered":"2024-04-18T04:44:29.881671+0000","last_unstale":"2024-04-18T04:53:26.071265+0000","last_undegraded":"2024-04-18T04:53:26.071265+0000","last_fullsized":"2024-04-18T04:53:26.071265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:29:22.037641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"32'4072","reported_seq":4104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:23.852671+0000","last_change":"2024-04-18T04:44:34.342465+0000","last_active":"2024-04-18T04:55:23.852671+0000","last_peered":"2024-04-18T04:55:23.852671+0000","last_clean":"2024-04-18T04:55:23.852671+0000","last_became_active":"2024-04-18T04:44:34.340327+0000","last_became_peered":"2024-04-18T04:44:34.340327+0000","last_unstale":"2024-04-18T04:55:23.852671+0000","last_undegraded":"2024-04-18T04:55:23.852671+0000","last_fullsized":"2024-04-18T04:55:23.852671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4072,"log_dups_size":0,"ondisk_log_size":4072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:31:44.168899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180366523,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":60211,"num_write_kb":847949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"32'7","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:52.467687+0000","last_change":"2024-04-18T04:44:30.299403+0000","last_active":"2024-04-18T04:53:52.467687+0000","last_peered":"2024-04-18T04:53:52.467687+0000","last_clean":"2024-04-18T04:53:52.467687+0000","last_became_active":"2024-04-18T04:44:30.298417+0000","last_became_peered":"2024-04-18T04:44:30.298417+0000","last_unstale":"2024-04-18T04:53:52.467687+0000","last_undegraded":"2024-04-18T04:53:52.467687+0000","last_fullsized":"2024-04-18T04:53:52.467687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:43:24.120294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"30'18","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:23.250796+0000","last_change":"2024-04-18T04:44:29.875345+0000","last_active":"2024-04-18T04:54:23.250796+0000","last_peered":"2024-04-18T04:54:23.250796+0000","last_clean":"2024-04-18T04:54:23.250796+0000","last_became_active":"2024-04-18T04:44:29.875059+0000","last_became_peered":"2024-04-18T04:44:29.875059+0000","last_unstale":"2024-04-18T04:54:23.250796+0000","last_undegraded":"2024-04-18T04:54:23.250796+0000","last_fullsized":"2024-04-18T04:54:23.250796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:06:54.218096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":44,"num_read_kb":43,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"32'5049","reported_seq":5076,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.206877+0000","last_change":"2024-04-18T04:44:34.334498+0000","last_active":"2024-04-18T04:55:26.206877+0000","last_peered":"2024-04-18T04:55:26.206877+0000","last_clean":"2024-04-18T04:55:26.206877+0000","last_became_active":"2024-04-18T04:44:34.334192+0000","last_became_peered":"2024-04-18T04:44:34.334192+0000","last_unstale":"2024-04-18T04:55:26.206877+0000","last_undegraded":"2024-04-18T04:55:26.206877+0000","last_fullsized":"2024-04-18T04:55:26.206877+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":5049,"log_dups_size":0,"ondisk_log_size":5049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:15:49.669556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176506941,"num_objects":56,"num_object_clones":0,"num_object_copies":224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":74352,"num_write_kb":1061210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'6","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.072591+0000","last_change":"2024-04-18T04:44:30.298289+0000","last_active":"2024-04-18T04:53:26.072591+0000","last_peered":"2024-04-18T04:53:26.072591+0000","last_clean":"2024-04-18T04:53:26.072591+0000","last_became_active":"2024-04-18T04:44:30.295404+0000","last_became_peered":"2024-04-18T04:44:30.295404+0000","last_unstale":"2024-04-18T04:53:26.072591+0000","last_undegraded":"2024-04-18T04:53:26.072591+0000","last_fullsized":"2024-04-18T04:53:26.072591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:10:32.465032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"30'12","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.072652+0000","last_change":"2024-04-18T04:44:29.894196+0000","last_active":"2024-04-18T04:53:26.072652+0000","last_peered":"2024-04-18T04:53:26.072652+0000","last_clean":"2024-04-18T04:53:26.072652+0000","last_became_active":"2024-04-18T04:44:29.893668+0000","last_became_peered":"2024-04-18T04:44:29.893668+0000","last_unstale":"2024-04-18T04:53:26.072652+0000","last_undegraded":"2024-04-18T04:53:26.072652+0000","last_fullsized":"2024-04-18T04:53:26.072652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:39:03.812043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1711,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":11,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"32'5154","reported_seq":5191,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.412455+0000","last_change":"2024-04-18T04:45:12.057192+0000","last_active":"2024-04-18T04:55:26.412455+0000","last_peered":"2024-04-18T04:55:26.412455+0000","last_clean":"2024-04-18T04:55:26.412455+0000","last_became_active":"2024-04-18T04:45:12.056680+0000","last_became_peered":"2024-04-18T04:45:12.056680+0000","last_unstale":"2024-04-18T04:55:26.412455+0000","last_undegraded":"2024-04-18T04:55:26.412455+0000","last_fullsized":"2024-04-18T04:55:26.412455+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":5154,"log_dups_size":0,"ondisk_log_size":5154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:48:07.893811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155198053,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":76078,"num_write_kb":1080690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'18","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:19.728683+0000","last_change":"2024-04-18T04:44:30.289122+0000","last_active":"2024-04-18T04:55:19.728683+0000","last_peered":"2024-04-18T04:55:19.728683+0000","last_clean":"2024-04-18T04:55:19.728683+0000","last_became_active":"2024-04-18T04:44:30.288364+0000","last_became_peered":"2024-04-18T04:44:30.288364+0000","last_unstale":"2024-04-18T04:55:19.728683+0000","last_undegraded":"2024-04-18T04:55:19.728683+0000","last_fullsized":"2024-04-18T04:55:19.728683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:04:02.162723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"32'6","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:23.255678+0000","last_change":"2024-04-18T04:44:29.894521+0000","last_active":"2024-04-18T04:54:23.255678+0000","last_peered":"2024-04-18T04:54:23.255678+0000","last_clean":"2024-04-18T04:54:23.255678+0000","last_became_active":"2024-04-18T04:44:29.889150+0000","last_became_peered":"2024-04-18T04:44:29.889150+0000","last_unstale":"2024-04-18T04:54:23.255678+0000","last_undegraded":"2024-04-18T04:54:23.255678+0000","last_fullsized":"2024-04-18T04:54:23.255678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:39:13.323434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'4511","reported_seq":4540,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.478346+0000","last_change":"2024-04-18T04:44:34.305657+0000","last_active":"2024-04-18T04:55:26.478346+0000","last_peered":"2024-04-18T04:55:26.478346+0000","last_clean":"2024-04-18T04:55:26.478346+0000","last_became_active":"2024-04-18T04:44:34.305341+0000","last_became_peered":"2024-04-18T04:44:34.305341+0000","last_unstale":"2024-04-18T04:55:26.478346+0000","last_undegraded":"2024-04-18T04:55:26.478346+0000","last_fullsized":"2024-04-18T04:55:26.478346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4511,"log_dups_size":0,"ondisk_log_size":4511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:32:39.937173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134316344,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":66695,"num_write_kb":961503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'6","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.055595+0000","last_change":"2024-04-18T04:44:30.307042+0000","last_active":"2024-04-18T04:53:26.055595+0000","last_peered":"2024-04-18T04:53:26.055595+0000","last_clean":"2024-04-18T04:53:26.055595+0000","last_became_active":"2024-04-18T04:44:30.306726+0000","last_became_peered":"2024-04-18T04:44:30.306726+0000","last_unstale":"2024-04-18T04:53:26.055595+0000","last_undegraded":"2024-04-18T04:53:26.055595+0000","last_fullsized":"2024-04-18T04:53:26.055595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:55:33.543142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"30'34","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:23.851102+0000","last_change":"2024-04-18T04:44:29.887498+0000","last_active":"2024-04-18T04:54:23.851102+0000","last_peered":"2024-04-18T04:54:23.851102+0000","last_clean":"2024-04-18T04:54:23.851102+0000","last_became_active":"2024-04-18T04:44:29.887095+0000","last_became_peered":"2024-04-18T04:44:29.887095+0000","last_unstale":"2024-04-18T04:54:23.851102+0000","last_undegraded":"2024-04-18T04:54:23.851102+0000","last_fullsized":"2024-04-18T04:54:23.851102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:54:34.700562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":31,"num_read_kb":8224,"num_write":33,"num_write_kb":8211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"32'4732","reported_seq":4759,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:22.821589+0000","last_change":"2024-04-18T04:44:34.322042+0000","last_active":"2024-04-18T04:55:22.821589+0000","last_peered":"2024-04-18T04:55:22.821589+0000","last_clean":"2024-04-18T04:55:22.821589+0000","last_became_active":"2024-04-18T04:44:34.320776+0000","last_became_peered":"2024-04-18T04:44:34.320776+0000","last_unstale":"2024-04-18T04:55:22.821589+0000","last_undegraded":"2024-04-18T04:55:22.821589+0000","last_fullsized":"2024-04-18T04:55:22.821589+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4732,"log_dups_size":0,"ondisk_log_size":4732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:53:47.399337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222298112,"num_objects":53,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":70251,"num_write_kb":986201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"32'7","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:12.485852+0000","last_change":"2024-04-18T04:44:30.299413+0000","last_active":"2024-04-18T04:54:12.485852+0000","last_peered":"2024-04-18T04:54:12.485852+0000","last_clean":"2024-04-18T04:54:12.485852+0000","last_became_active":"2024-04-18T04:44:30.293185+0000","last_became_peered":"2024-04-18T04:44:30.293185+0000","last_unstale":"2024-04-18T04:54:12.485852+0000","last_undegraded":"2024-04-18T04:54:12.485852+0000","last_fullsized":"2024-04-18T04:54:12.485852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:43:53.831429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"32'227","reported_seq":261,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:11.183288+0000","last_change":"2024-04-18T04:44:29.893351+0000","last_active":"2024-04-18T04:55:11.183288+0000","last_peered":"2024-04-18T04:55:11.183288+0000","last_clean":"2024-04-18T04:55:11.183288+0000","last_became_active":"2024-04-18T04:44:29.892647+0000","last_became_peered":"2024-04-18T04:44:29.892647+0000","last_unstale":"2024-04-18T04:55:11.183288+0000","last_undegraded":"2024-04-18T04:55:11.183288+0000","last_fullsized":"2024-04-18T04:55:11.183288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:16:59.759149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":21,"num_read_kb":4116,"num_write":227,"num_write_kb":4214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"32'4331","reported_seq":4360,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:22.889391+0000","last_change":"2024-04-18T04:44:34.337866+0000","last_active":"2024-04-18T04:55:22.889391+0000","last_peered":"2024-04-18T04:55:22.889391+0000","last_clean":"2024-04-18T04:55:22.889391+0000","last_became_active":"2024-04-18T04:44:34.337486+0000","last_became_peered":"2024-04-18T04:44:34.337486+0000","last_unstale":"2024-04-18T04:55:22.889391+0000","last_undegraded":"2024-04-18T04:55:22.889391+0000","last_fullsized":"2024-04-18T04:55:22.889391+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4331,"log_dups_size":0,"ondisk_log_size":4331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:42:13.751926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234913921,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":6,"num_read_kb":1,"num_write":64249,"num_write_kb":903689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"32'7","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:53.690544+0000","last_change":"2024-04-18T04:44:30.308477+0000","last_active":"2024-04-18T04:53:53.690544+0000","last_peered":"2024-04-18T04:53:53.690544+0000","last_clean":"2024-04-18T04:53:53.690544+0000","last_became_active":"2024-04-18T04:44:30.307237+0000","last_became_peered":"2024-04-18T04:44:30.307237+0000","last_unstale":"2024-04-18T04:53:53.690544+0000","last_undegraded":"2024-04-18T04:53:53.690544+0000","last_fullsized":"2024-04-18T04:53:53.690544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:33:58.300542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"32'16","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:11.028702+0000","last_change":"2024-04-18T04:44:29.898488+0000","last_active":"2024-04-18T04:54:11.028702+0000","last_peered":"2024-04-18T04:54:11.028702+0000","last_clean":"2024-04-18T04:54:11.028702+0000","last_became_active":"2024-04-18T04:44:29.898113+0000","last_became_peered":"2024-04-18T04:44:29.898113+0000","last_unstale":"2024-04-18T04:54:11.028702+0000","last_undegraded":"2024-04-18T04:54:11.028702+0000","last_fullsized":"2024-04-18T04:54:11.028702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:11:14.585142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":17,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'5474","reported_seq":5501,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:23.585936+0000","last_change":"2024-04-18T04:44:34.344769+0000","last_active":"2024-04-18T04:55:23.585936+0000","last_peered":"2024-04-18T04:55:23.585936+0000","last_clean":"2024-04-18T04:55:23.585936+0000","last_became_active":"2024-04-18T04:44:34.343636+0000","last_became_peered":"2024-04-18T04:44:34.343636+0000","last_unstale":"2024-04-18T04:55:23.585936+0000","last_undegraded":"2024-04-18T04:55:23.585936+0000","last_fullsized":"2024-04-18T04:55:23.585936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":5474,"log_dups_size":0,"ondisk_log_size":5474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:45:09.481681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251864180,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":4,"num_read_kb":7,"num_write":80945,"num_write_kb":1156235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"28'9","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.054159+0000","last_change":"2024-04-18T04:44:30.290494+0000","last_active":"2024-04-18T04:53:26.054159+0000","last_peered":"2024-04-18T04:53:26.054159+0000","last_clean":"2024-04-18T04:53:26.054159+0000","last_became_active":"2024-04-18T04:44:30.290127+0000","last_became_peered":"2024-04-18T04:44:30.290127+0000","last_unstale":"2024-04-18T04:53:26.054159+0000","last_undegraded":"2024-04-18T04:53:26.054159+0000","last_fullsized":"2024-04-18T04:53:26.054159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:34:21.239813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'3","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:23.256537+0000","last_change":"2024-04-18T04:44:29.895686+0000","last_active":"2024-04-18T04:54:23.256537+0000","last_peered":"2024-04-18T04:54:23.256537+0000","last_clean":"2024-04-18T04:54:23.256537+0000","last_became_active":"2024-04-18T04:44:29.895083+0000","last_became_peered":"2024-04-18T04:44:29.895083+0000","last_unstale":"2024-04-18T04:54:23.256537+0000","last_undegraded":"2024-04-18T04:54:23.256537+0000","last_fullsized":"2024-04-18T04:54:23.256537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:27:17.897401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"32'4714","reported_seq":4742,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.504835+0000","last_change":"2024-04-18T04:44:34.338412+0000","last_active":"2024-04-18T04:55:26.504835+0000","last_peered":"2024-04-18T04:55:26.504835+0000","last_clean":"2024-04-18T04:55:26.504835+0000","last_became_active":"2024-04-18T04:44:34.338062+0000","last_became_peered":"2024-04-18T04:44:34.338062+0000","last_unstale":"2024-04-18T04:55:26.504835+0000","last_undegraded":"2024-04-18T04:55:26.504835+0000","last_fullsized":"2024-04-18T04:55:26.504835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4714,"log_dups_size":0,"ondisk_log_size":4714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:49:28.342905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146809673,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":69716,"num_write_kb":985522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"32'5","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:13.261662+0000","last_change":"2024-04-18T04:44:30.307946+0000","last_active":"2024-04-18T04:54:13.261662+0000","last_peered":"2024-04-18T04:54:13.261662+0000","last_clean":"2024-04-18T04:54:13.261662+0000","last_became_active":"2024-04-18T04:44:30.307168+0000","last_became_peered":"2024-04-18T04:44:30.307168+0000","last_unstale":"2024-04-18T04:54:13.261662+0000","last_undegraded":"2024-04-18T04:54:13.261662+0000","last_fullsized":"2024-04-18T04:54:13.261662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:43:56.218333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"32'9","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:11.183996+0000","last_change":"2024-04-18T04:44:29.903183+0000","last_active":"2024-04-18T04:55:11.183996+0000","last_peered":"2024-04-18T04:55:11.183996+0000","last_clean":"2024-04-18T04:55:11.183996+0000","last_became_active":"2024-04-18T04:44:29.902647+0000","last_became_peered":"2024-04-18T04:44:29.902647+0000","last_unstale":"2024-04-18T04:55:11.183996+0000","last_undegraded":"2024-04-18T04:55:11.183996+0000","last_fullsized":"2024-04-18T04:55:11.183996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:45:13.009571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"32'5912","reported_seq":5940,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.438465+0000","last_change":"2024-04-18T04:44:34.338653+0000","last_active":"2024-04-18T04:55:26.438465+0000","last_peered":"2024-04-18T04:55:26.438465+0000","last_clean":"2024-04-18T04:55:26.438465+0000","last_became_active":"2024-04-18T04:44:34.338288+0000","last_became_peered":"2024-04-18T04:44:34.338288+0000","last_unstale":"2024-04-18T04:55:26.438465+0000","last_undegraded":"2024-04-18T04:55:26.438465+0000","last_fullsized":"2024-04-18T04:55:26.438465+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":5912,"log_dups_size":0,"ondisk_log_size":5912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:58:27.654288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188767411,"num_objects":50,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":87637,"num_write_kb":1229683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"32'4038","reported_seq":4064,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:25.971766+0000","last_change":"2024-04-18T04:44:34.306999+0000","last_active":"2024-04-18T04:55:25.971766+0000","last_peered":"2024-04-18T04:55:25.971766+0000","last_clean":"2024-04-18T04:55:25.971766+0000","last_became_active":"2024-04-18T04:44:34.306657+0000","last_became_peered":"2024-04-18T04:44:34.306657+0000","last_unstale":"2024-04-18T04:55:25.971766+0000","last_undegraded":"2024-04-18T04:55:25.971766+0000","last_fullsized":"2024-04-18T04:55:25.971766+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4038,"log_dups_size":0,"ondisk_log_size":4038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:52:58.512928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134308908,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":59665,"num_write_kb":838973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'8","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:21.443487+0000","last_change":"2024-04-18T04:44:30.271947+0000","last_active":"2024-04-18T04:54:21.443487+0000","last_peered":"2024-04-18T04:54:21.443487+0000","last_clean":"2024-04-18T04:54:21.443487+0000","last_became_active":"2024-04-18T04:44:30.271619+0000","last_became_peered":"2024-04-18T04:44:30.271619+0000","last_unstale":"2024-04-18T04:54:21.443487+0000","last_undegraded":"2024-04-18T04:54:21.443487+0000","last_fullsized":"2024-04-18T04:54:21.443487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:32:11.612016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"32'51","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:35.414182+0000","last_change":"2024-04-18T04:44:29.897616+0000","last_active":"2024-04-18T04:53:35.414182+0000","last_peered":"2024-04-18T04:53:35.414182+0000","last_clean":"2024-04-18T04:53:35.414182+0000","last_became_active":"2024-04-18T04:44:29.889922+0000","last_became_peered":"2024-04-18T04:44:29.889922+0000","last_unstale":"2024-04-18T04:53:35.414182+0000","last_undegraded":"2024-04-18T04:53:35.414182+0000","last_fullsized":"2024-04-18T04:53:35.414182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:11:52.717768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":45,"num_write_kb":8216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4506","reported_seq":4537,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:23.335966+0000","last_change":"2024-04-18T04:44:34.333403+0000","last_active":"2024-04-18T04:55:23.335966+0000","last_peered":"2024-04-18T04:55:23.335966+0000","last_clean":"2024-04-18T04:55:23.335966+0000","last_became_active":"2024-04-18T04:44:34.332551+0000","last_became_peered":"2024-04-18T04:44:34.332551+0000","last_unstale":"2024-04-18T04:55:23.335966+0000","last_undegraded":"2024-04-18T04:55:23.335966+0000","last_fullsized":"2024-04-18T04:55:23.335966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4506,"log_dups_size":0,"ondisk_log_size":4506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:33:28.594002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234927233,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":66700,"num_write_kb":945017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"32'11","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:13.935887+0000","last_change":"2024-04-18T04:44:30.271099+0000","last_active":"2024-04-18T04:55:13.935887+0000","last_peered":"2024-04-18T04:55:13.935887+0000","last_clean":"2024-04-18T04:55:13.935887+0000","last_became_active":"2024-04-18T04:44:30.270804+0000","last_became_peered":"2024-04-18T04:44:30.270804+0000","last_unstale":"2024-04-18T04:55:13.935887+0000","last_undegraded":"2024-04-18T04:55:13.935887+0000","last_fullsized":"2024-04-18T04:55:13.935887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:18:27.955171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"30'3","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.330903+0000","last_change":"2024-04-18T04:44:29.895084+0000","last_active":"2024-04-18T04:53:26.330903+0000","last_peered":"2024-04-18T04:53:26.330903+0000","last_clean":"2024-04-18T04:53:26.330903+0000","last_became_active":"2024-04-18T04:44:29.894829+0000","last_became_peered":"2024-04-18T04:44:29.894829+0000","last_unstale":"2024-04-18T04:53:26.330903+0000","last_undegraded":"2024-04-18T04:53:26.330903+0000","last_fullsized":"2024-04-18T04:53:26.330903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:54.812428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"31'9","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.075642+0000","last_change":"2024-04-18T04:44:29.892826+0000","last_active":"2024-04-18T04:53:26.075642+0000","last_peered":"2024-04-18T04:53:26.075642+0000","last_clean":"2024-04-18T04:53:26.075642+0000","last_became_active":"2024-04-18T04:44:29.892282+0000","last_became_peered":"2024-04-18T04:44:29.892282+0000","last_unstale":"2024-04-18T04:53:26.075642+0000","last_undegraded":"2024-04-18T04:53:26.075642+0000","last_fullsized":"2024-04-18T04:53:26.075642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:02.844116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":4108,"num_write":6,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"32'7","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:31.494584+0000","last_change":"2024-04-18T04:44:30.285312+0000","last_active":"2024-04-18T04:54:31.494584+0000","last_peered":"2024-04-18T04:54:31.494584+0000","last_clean":"2024-04-18T04:54:31.494584+0000","last_became_active":"2024-04-18T04:44:30.285055+0000","last_became_peered":"2024-04-18T04:44:30.285055+0000","last_unstale":"2024-04-18T04:54:31.494584+0000","last_undegraded":"2024-04-18T04:54:31.494584+0000","last_fullsized":"2024-04-18T04:54:31.494584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:50:00.641018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"32'4854","reported_seq":4880,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.097110+0000","last_change":"2024-04-18T04:44:34.323352+0000","last_active":"2024-04-18T04:55:26.097110+0000","last_peered":"2024-04-18T04:55:26.097110+0000","last_clean":"2024-04-18T04:55:26.097110+0000","last_became_active":"2024-04-18T04:44:34.321645+0000","last_became_peered":"2024-04-18T04:44:34.321645+0000","last_unstale":"2024-04-18T04:55:26.097110+0000","last_undegraded":"2024-04-18T04:55:26.097110+0000","last_fullsized":"2024-04-18T04:55:26.097110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4854,"log_dups_size":0,"ondisk_log_size":4854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:33:27.387013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167802796,"num_objects":43,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":71773,"num_write_kb":1022773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"32'1260","reported_seq":1292,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:35.652289+0000","last_change":"2024-04-18T04:44:29.891865+0000","last_active":"2024-04-18T04:54:35.652289+0000","last_peered":"2024-04-18T04:54:35.652289+0000","last_clean":"2024-04-18T04:54:35.652289+0000","last_became_active":"2024-04-18T04:44:29.891610+0000","last_became_peered":"2024-04-18T04:44:29.891610+0000","last_unstale":"2024-04-18T04:54:35.652289+0000","last_undegraded":"2024-04-18T04:54:35.652289+0000","last_fullsized":"2024-04-18T04:54:35.652289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1260,"log_dups_size":0,"ondisk_log_size":1260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:36:42.266497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195509,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7,"num_read_kb":4100,"num_write":1254,"num_write_kb":4235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"32'7","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:11.290815+0000","last_change":"2024-04-18T04:44:30.279080+0000","last_active":"2024-04-18T04:55:11.290815+0000","last_peered":"2024-04-18T04:55:11.290815+0000","last_clean":"2024-04-18T04:55:11.290815+0000","last_became_active":"2024-04-18T04:44:30.278275+0000","last_became_peered":"2024-04-18T04:44:30.278275+0000","last_unstale":"2024-04-18T04:55:11.290815+0000","last_undegraded":"2024-04-18T04:55:11.290815+0000","last_fullsized":"2024-04-18T04:55:11.290815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:51:48.272703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'4526","reported_seq":4552,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.329304+0000","last_change":"2024-04-18T04:44:34.313835+0000","last_active":"2024-04-18T04:55:26.329304+0000","last_peered":"2024-04-18T04:55:26.329304+0000","last_clean":"2024-04-18T04:55:26.329304+0000","last_became_active":"2024-04-18T04:44:34.313416+0000","last_became_peered":"2024-04-18T04:44:34.313416+0000","last_unstale":"2024-04-18T04:55:26.329304+0000","last_undegraded":"2024-04-18T04:55:26.329304+0000","last_fullsized":"2024-04-18T04:55:26.329304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4526,"log_dups_size":0,"ondisk_log_size":4526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:57:47.245809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125956318,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":66433,"num_write_kb":963599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"32'11","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:58.615267+0000","last_change":"2024-04-18T04:44:30.297229+0000","last_active":"2024-04-18T04:54:58.615267+0000","last_peered":"2024-04-18T04:54:58.615267+0000","last_clean":"2024-04-18T04:54:58.615267+0000","last_became_active":"2024-04-18T04:44:30.296354+0000","last_became_peered":"2024-04-18T04:44:30.296354+0000","last_unstale":"2024-04-18T04:54:58.615267+0000","last_undegraded":"2024-04-18T04:54:58.615267+0000","last_fullsized":"2024-04-18T04:54:58.615267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:30:35.845106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"32'11","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:01.204805+0000","last_change":"2024-04-18T04:44:30.281213+0000","last_active":"2024-04-18T04:55:01.204805+0000","last_peered":"2024-04-18T04:55:01.204805+0000","last_clean":"2024-04-18T04:55:01.204805+0000","last_became_active":"2024-04-18T04:44:30.280941+0000","last_became_peered":"2024-04-18T04:44:30.280941+0000","last_unstale":"2024-04-18T04:55:01.204805+0000","last_undegraded":"2024-04-18T04:55:01.204805+0000","last_fullsized":"2024-04-18T04:55:01.204805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:15:37.795670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"28'6","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.059850+0000","last_change":"2024-04-18T04:44:30.288507+0000","last_active":"2024-04-18T04:53:26.059850+0000","last_peered":"2024-04-18T04:53:26.059850+0000","last_clean":"2024-04-18T04:53:26.059850+0000","last_became_active":"2024-04-18T04:44:30.287820+0000","last_became_peered":"2024-04-18T04:44:30.287820+0000","last_unstale":"2024-04-18T04:53:26.059850+0000","last_undegraded":"2024-04-18T04:53:26.059850+0000","last_fullsized":"2024-04-18T04:53:26.059850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:25:29.500586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"32'7","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:20.767557+0000","last_change":"2024-04-18T04:44:30.273278+0000","last_active":"2024-04-18T04:55:20.767557+0000","last_peered":"2024-04-18T04:55:20.767557+0000","last_clean":"2024-04-18T04:55:20.767557+0000","last_became_active":"2024-04-18T04:44:30.272973+0000","last_became_peered":"2024-04-18T04:44:30.272973+0000","last_unstale":"2024-04-18T04:55:20.767557+0000","last_undegraded":"2024-04-18T04:55:20.767557+0000","last_fullsized":"2024-04-18T04:55:20.767557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:37:02.421925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'5","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:16.520446+0000","last_change":"2024-04-18T04:44:30.298936+0000","last_active":"2024-04-18T04:55:16.520446+0000","last_peered":"2024-04-18T04:55:16.520446+0000","last_clean":"2024-04-18T04:55:16.520446+0000","last_became_active":"2024-04-18T04:44:30.298637+0000","last_became_peered":"2024-04-18T04:44:30.298637+0000","last_unstale":"2024-04-18T04:55:16.520446+0000","last_undegraded":"2024-04-18T04:55:16.520446+0000","last_fullsized":"2024-04-18T04:55:16.520446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:04:33.188772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"32'7","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:19.622852+0000","last_change":"2024-04-18T04:44:30.274613+0000","last_active":"2024-04-18T04:55:19.622852+0000","last_peered":"2024-04-18T04:55:19.622852+0000","last_clean":"2024-04-18T04:55:19.622852+0000","last_became_active":"2024-04-18T04:44:30.274328+0000","last_became_peered":"2024-04-18T04:44:30.274328+0000","last_unstale":"2024-04-18T04:55:19.622852+0000","last_undegraded":"2024-04-18T04:55:19.622852+0000","last_fullsized":"2024-04-18T04:55:19.622852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:55:41.700955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"28'9","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.073770+0000","last_change":"2024-04-18T04:44:30.309403+0000","last_active":"2024-04-18T04:53:26.073770+0000","last_peered":"2024-04-18T04:53:26.073770+0000","last_clean":"2024-04-18T04:53:26.073770+0000","last_became_active":"2024-04-18T04:44:30.308415+0000","last_became_peered":"2024-04-18T04:44:30.308415+0000","last_unstale":"2024-04-18T04:53:26.073770+0000","last_undegraded":"2024-04-18T04:53:26.073770+0000","last_fullsized":"2024-04-18T04:53:26.073770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:51:58.935503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'2","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.360123+0000","last_change":"2024-04-18T04:44:30.293996+0000","last_active":"2024-04-18T04:53:26.360123+0000","last_peered":"2024-04-18T04:53:26.360123+0000","last_clean":"2024-04-18T04:53:26.360123+0000","last_became_active":"2024-04-18T04:44:30.293748+0000","last_became_peered":"2024-04-18T04:44:30.293748+0000","last_unstale":"2024-04-18T04:53:26.360123+0000","last_undegraded":"2024-04-18T04:53:26.360123+0000","last_fullsized":"2024-04-18T04:53:26.360123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:18:32.116499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'6","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.083146+0000","last_change":"2024-04-18T04:45:12.040362+0000","last_active":"2024-04-18T04:53:26.083146+0000","last_peered":"2024-04-18T04:53:26.083146+0000","last_clean":"2024-04-18T04:53:26.083146+0000","last_became_active":"2024-04-18T04:45:12.040045+0000","last_became_peered":"2024-04-18T04:45:12.040045+0000","last_unstale":"2024-04-18T04:53:26.083146+0000","last_undegraded":"2024-04-18T04:53:26.083146+0000","last_fullsized":"2024-04-18T04:53:26.083146+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:18:21.482610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"27'6","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.330791+0000","last_change":"2024-04-18T04:44:30.285836+0000","last_active":"2024-04-18T04:53:26.330791+0000","last_peered":"2024-04-18T04:53:26.330791+0000","last_clean":"2024-04-18T04:53:26.330791+0000","last_became_active":"2024-04-18T04:44:30.285602+0000","last_became_peered":"2024-04-18T04:44:30.285602+0000","last_unstale":"2024-04-18T04:53:26.330791+0000","last_undegraded":"2024-04-18T04:53:26.330791+0000","last_fullsized":"2024-04-18T04:53:26.330791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:34:39.594780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"32'11","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:25.424434+0000","last_change":"2024-04-18T04:45:12.040347+0000","last_active":"2024-04-18T04:55:25.424434+0000","last_peered":"2024-04-18T04:55:25.424434+0000","last_clean":"2024-04-18T04:55:25.424434+0000","last_became_active":"2024-04-18T04:45:12.040023+0000","last_became_peered":"2024-04-18T04:45:12.040023+0000","last_unstale":"2024-04-18T04:55:25.424434+0000","last_undegraded":"2024-04-18T04:55:25.424434+0000","last_fullsized":"2024-04-18T04:55:25.424434+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:24.207082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"32'13","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:11.342743+0000","last_change":"2024-04-18T04:44:30.310229+0000","last_active":"2024-04-18T04:55:11.342743+0000","last_peered":"2024-04-18T04:55:11.342743+0000","last_clean":"2024-04-18T04:55:11.342743+0000","last_became_active":"2024-04-18T04:44:30.310045+0000","last_became_peered":"2024-04-18T04:44:30.310045+0000","last_unstale":"2024-04-18T04:55:11.342743+0000","last_undegraded":"2024-04-18T04:55:11.342743+0000","last_fullsized":"2024-04-18T04:55:11.342743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:22:55.588300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'6","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.073220+0000","last_change":"2024-04-18T04:44:30.305644+0000","last_active":"2024-04-18T04:53:26.073220+0000","last_peered":"2024-04-18T04:53:26.073220+0000","last_clean":"2024-04-18T04:53:26.073220+0000","last_became_active":"2024-04-18T04:44:30.304921+0000","last_became_peered":"2024-04-18T04:44:30.304921+0000","last_unstale":"2024-04-18T04:53:26.073220+0000","last_undegraded":"2024-04-18T04:53:26.073220+0000","last_fullsized":"2024-04-18T04:53:26.073220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:17:37.235711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"32'8","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:14.326934+0000","last_change":"2024-04-18T04:44:30.294105+0000","last_active":"2024-04-18T04:55:14.326934+0000","last_peered":"2024-04-18T04:55:14.326934+0000","last_clean":"2024-04-18T04:55:14.326934+0000","last_became_active":"2024-04-18T04:44:30.291742+0000","last_became_peered":"2024-04-18T04:44:30.291742+0000","last_unstale":"2024-04-18T04:55:14.326934+0000","last_undegraded":"2024-04-18T04:55:14.326934+0000","last_fullsized":"2024-04-18T04:55:14.326934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:43:26.428261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"32'13","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:14.192589+0000","last_change":"2024-04-18T04:44:30.296496+0000","last_active":"2024-04-18T04:55:14.192589+0000","last_peered":"2024-04-18T04:55:14.192589+0000","last_clean":"2024-04-18T04:55:14.192589+0000","last_became_active":"2024-04-18T04:44:30.296177+0000","last_became_peered":"2024-04-18T04:44:30.296177+0000","last_unstale":"2024-04-18T04:55:14.192589+0000","last_undegraded":"2024-04-18T04:55:14.192589+0000","last_fullsized":"2024-04-18T04:55:14.192589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:46:44.829326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"32'10","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:12.557481+0000","last_change":"2024-04-18T04:44:30.306568+0000","last_active":"2024-04-18T04:55:12.557481+0000","last_peered":"2024-04-18T04:55:12.557481+0000","last_clean":"2024-04-18T04:55:12.557481+0000","last_became_active":"2024-04-18T04:44:30.305674+0000","last_became_peered":"2024-04-18T04:44:30.305674+0000","last_unstale":"2024-04-18T04:55:12.557481+0000","last_undegraded":"2024-04-18T04:55:12.557481+0000","last_fullsized":"2024-04-18T04:55:12.557481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:58:10.740164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"32'9","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:53.219717+0000","last_change":"2024-04-18T04:44:30.307297+0000","last_active":"2024-04-18T04:53:53.219717+0000","last_peered":"2024-04-18T04:53:53.219717+0000","last_clean":"2024-04-18T04:53:53.219717+0000","last_became_active":"2024-04-18T04:44:30.305470+0000","last_became_peered":"2024-04-18T04:44:30.305470+0000","last_unstale":"2024-04-18T04:53:53.219717+0000","last_undegraded":"2024-04-18T04:53:53.219717+0000","last_fullsized":"2024-04-18T04:53:53.219717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:01:00.587115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"32'8","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:00.541342+0000","last_change":"2024-04-18T04:44:30.280849+0000","last_active":"2024-04-18T04:54:00.541342+0000","last_peered":"2024-04-18T04:54:00.541342+0000","last_clean":"2024-04-18T04:54:00.541342+0000","last_became_active":"2024-04-18T04:44:30.280535+0000","last_became_peered":"2024-04-18T04:44:30.280535+0000","last_unstale":"2024-04-18T04:54:00.541342+0000","last_undegraded":"2024-04-18T04:54:00.541342+0000","last_fullsized":"2024-04-18T04:54:00.541342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:01:06.241941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"28'6","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.055479+0000","last_change":"2024-04-18T04:44:30.278849+0000","last_active":"2024-04-18T04:53:26.055479+0000","last_peered":"2024-04-18T04:53:26.055479+0000","last_clean":"2024-04-18T04:53:26.055479+0000","last_became_active":"2024-04-18T04:44:30.278624+0000","last_became_peered":"2024-04-18T04:44:30.278624+0000","last_unstale":"2024-04-18T04:53:26.055479+0000","last_undegraded":"2024-04-18T04:53:26.055479+0000","last_fullsized":"2024-04-18T04:53:26.055479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:31:30.791150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"32'11","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:12.455040+0000","last_change":"2024-04-18T04:44:30.296148+0000","last_active":"2024-04-18T04:55:12.455040+0000","last_peered":"2024-04-18T04:55:12.455040+0000","last_clean":"2024-04-18T04:55:12.455040+0000","last_became_active":"2024-04-18T04:44:30.295754+0000","last_became_peered":"2024-04-18T04:44:30.295754+0000","last_unstale":"2024-04-18T04:55:12.455040+0000","last_undegraded":"2024-04-18T04:55:12.455040+0000","last_fullsized":"2024-04-18T04:55:12.455040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:39:53.809075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"32'4","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:13.881674+0000","last_change":"2024-04-18T04:44:30.298061+0000","last_active":"2024-04-18T04:54:13.881674+0000","last_peered":"2024-04-18T04:54:13.881674+0000","last_clean":"2024-04-18T04:54:13.881674+0000","last_became_active":"2024-04-18T04:44:30.297416+0000","last_became_peered":"2024-04-18T04:44:30.297416+0000","last_unstale":"2024-04-18T04:54:13.881674+0000","last_undegraded":"2024-04-18T04:54:13.881674+0000","last_fullsized":"2024-04-18T04:54:13.881674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:35:48.612670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"32'10","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:13.568254+0000","last_change":"2024-04-18T04:44:30.292802+0000","last_active":"2024-04-18T04:54:13.568254+0000","last_peered":"2024-04-18T04:54:13.568254+0000","last_clean":"2024-04-18T04:54:13.568254+0000","last_became_active":"2024-04-18T04:44:30.291939+0000","last_became_peered":"2024-04-18T04:44:30.291939+0000","last_unstale":"2024-04-18T04:54:13.568254+0000","last_undegraded":"2024-04-18T04:54:13.568254+0000","last_fullsized":"2024-04-18T04:54:13.568254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:33:04.689561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"32'13","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:17.021360+0000","last_change":"2024-04-18T04:44:30.309020+0000","last_active":"2024-04-18T04:55:17.021360+0000","last_peered":"2024-04-18T04:55:17.021360+0000","last_clean":"2024-04-18T04:55:17.021360+0000","last_became_active":"2024-04-18T04:44:30.307604+0000","last_became_peered":"2024-04-18T04:44:30.307604+0000","last_unstale":"2024-04-18T04:55:17.021360+0000","last_undegraded":"2024-04-18T04:55:17.021360+0000","last_fullsized":"2024-04-18T04:55:17.021360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:44:54.764284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"32'11","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:12.485930+0000","last_change":"2024-04-18T04:44:30.314533+0000","last_active":"2024-04-18T04:54:12.485930+0000","last_peered":"2024-04-18T04:54:12.485930+0000","last_clean":"2024-04-18T04:54:12.485930+0000","last_became_active":"2024-04-18T04:44:30.313985+0000","last_became_peered":"2024-04-18T04:44:30.313985+0000","last_unstale":"2024-04-18T04:54:12.485930+0000","last_undegraded":"2024-04-18T04:54:12.485930+0000","last_fullsized":"2024-04-18T04:54:12.485930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:02:03.941709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"32'7","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:30.364882+0000","last_change":"2024-04-18T04:44:30.309273+0000","last_active":"2024-04-18T04:54:30.364882+0000","last_peered":"2024-04-18T04:54:30.364882+0000","last_clean":"2024-04-18T04:54:30.364882+0000","last_became_active":"2024-04-18T04:44:30.309002+0000","last_became_peered":"2024-04-18T04:44:30.309002+0000","last_unstale":"2024-04-18T04:54:30.364882+0000","last_undegraded":"2024-04-18T04:54:30.364882+0000","last_fullsized":"2024-04-18T04:54:30.364882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:49:10.005359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'6","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.040583+0000","last_change":"2024-04-18T04:44:30.292371+0000","last_active":"2024-04-18T04:53:26.040583+0000","last_peered":"2024-04-18T04:53:26.040583+0000","last_clean":"2024-04-18T04:53:26.040583+0000","last_became_active":"2024-04-18T04:44:30.290504+0000","last_became_peered":"2024-04-18T04:44:30.290504+0000","last_unstale":"2024-04-18T04:53:26.040583+0000","last_undegraded":"2024-04-18T04:53:26.040583+0000","last_fullsized":"2024-04-18T04:53:26.040583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:11.998355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"32'8","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:13.246271+0000","last_change":"2024-04-18T04:44:30.299935+0000","last_active":"2024-04-18T04:55:13.246271+0000","last_peered":"2024-04-18T04:55:13.246271+0000","last_clean":"2024-04-18T04:55:13.246271+0000","last_became_active":"2024-04-18T04:44:30.290175+0000","last_became_peered":"2024-04-18T04:44:30.290175+0000","last_unstale":"2024-04-18T04:55:13.246271+0000","last_undegraded":"2024-04-18T04:55:13.246271+0000","last_fullsized":"2024-04-18T04:55:13.246271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:15:13.703423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"32'4","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:32.488111+0000","last_change":"2024-04-18T04:44:30.288940+0000","last_active":"2024-04-18T04:54:32.488111+0000","last_peered":"2024-04-18T04:54:32.488111+0000","last_clean":"2024-04-18T04:54:32.488111+0000","last_became_active":"2024-04-18T04:44:30.288131+0000","last_became_peered":"2024-04-18T04:44:30.288131+0000","last_unstale":"2024-04-18T04:54:32.488111+0000","last_undegraded":"2024-04-18T04:54:32.488111+0000","last_fullsized":"2024-04-18T04:54:32.488111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:31:08.895305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"32'6","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:33.275161+0000","last_change":"2024-04-18T04:44:30.288066+0000","last_active":"2024-04-18T04:54:33.275161+0000","last_peered":"2024-04-18T04:54:33.275161+0000","last_clean":"2024-04-18T04:54:33.275161+0000","last_became_active":"2024-04-18T04:44:30.287325+0000","last_became_peered":"2024-04-18T04:44:30.287325+0000","last_unstale":"2024-04-18T04:54:33.275161+0000","last_undegraded":"2024-04-18T04:54:33.275161+0000","last_fullsized":"2024-04-18T04:54:33.275161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:58:04.111225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"32'5","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:46.514757+0000","last_change":"2024-04-18T04:44:30.275485+0000","last_active":"2024-04-18T04:54:46.514757+0000","last_peered":"2024-04-18T04:54:46.514757+0000","last_clean":"2024-04-18T04:54:46.514757+0000","last_became_active":"2024-04-18T04:44:30.275118+0000","last_became_peered":"2024-04-18T04:44:30.275118+0000","last_unstale":"2024-04-18T04:54:46.514757+0000","last_undegraded":"2024-04-18T04:54:46.514757+0000","last_fullsized":"2024-04-18T04:54:46.514757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:25:09.625660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'2","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.060440+0000","last_change":"2024-04-18T04:44:30.277119+0000","last_active":"2024-04-18T04:53:26.060440+0000","last_peered":"2024-04-18T04:53:26.060440+0000","last_clean":"2024-04-18T04:53:26.060440+0000","last_became_active":"2024-04-18T04:44:30.276654+0000","last_became_peered":"2024-04-18T04:44:30.276654+0000","last_unstale":"2024-04-18T04:53:26.060440+0000","last_undegraded":"2024-04-18T04:53:26.060440+0000","last_fullsized":"2024-04-18T04:53:26.060440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:52.420199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"28'9","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.041740+0000","last_change":"2024-04-18T04:44:30.302905+0000","last_active":"2024-04-18T04:53:26.041740+0000","last_peered":"2024-04-18T04:53:26.041740+0000","last_clean":"2024-04-18T04:53:26.041740+0000","last_became_active":"2024-04-18T04:44:30.302180+0000","last_became_peered":"2024-04-18T04:44:30.302180+0000","last_unstale":"2024-04-18T04:53:26.041740+0000","last_undegraded":"2024-04-18T04:53:26.041740+0000","last_fullsized":"2024-04-18T04:53:26.041740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:41:53.211956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":6261016758,"num_objects":1685,"num_object_clones":0,"num_object_copies":6740,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1685,"num_whiteouts":0,"num_read":129,"num_read_kb":11,"num_write":2193447,"num_write_kb":31163048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6123642880,"data_stored":13062979584,"data_compressed":740843893,"data_compressed_allocated":2796531712,"data_compressed_original":9735868416,"omap_allocated":0,"internal_metadata":0},"log_size":148260,"ondisk_log_size":148260,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":482,"ondisk_log_size":482,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":81163347,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":422,"num_read_kb":74892,"num_write":3453,"num_write_kb":80221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":37847040,"data_stored":162326694,"data_compressed":18251382,"data_compressed_allocated":21430272,"data_compressed_original":146063360,"omap_allocated":0,"internal_metadata":0},"log_size":3378,"ondisk_log_size":3378,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66624,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509574,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1857768,"kb_used_data":892896,"kb_used_omap":1,"kb_used_meta":964862,"kb_avail":92514072,"statfs":{"total":96636764160,"available":94734409728,"internally_reserved":0,"allocated":914325504,"data_stored":1945598923,"data_compressed":111856752,"data_compressed_allocated":421683200,"data_compressed_original":1453170688,"omap_allocated":1592,"internal_metadata":988019144},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:54:39 2024","interfaces":[{"interface":"back","average":{"1min":4.0309999999999997,"5min":6.7530000000000001,"15min":3.347},"min":{"1min":0.52900000000000003,"5min":0.26200000000000001,"15min":0.252},"max":{"1min":15.353,"5min":76.096999999999994,"15min":76.096999999999994},"last":0.44},{"interface":"front","average":{"1min":4.7009999999999996,"5min":8.4860000000000007,"15min":3.7530000000000001},"min":{"1min":0.38500000000000001,"5min":0.254,"15min":0.254},"max":{"1min":15.515000000000001,"5min":184.16999999999999,"15min":184.16999999999999},"last":0.36299999999999999}]},{"osd":1,"last update":"Thu Apr 18 04:54:39 2024","interfaces":[{"interface":"back","average":{"1min":4.7480000000000002,"5min":7.343,"15min":4.3520000000000003},"min":{"1min":0.38700000000000001,"5min":0.34699999999999998,"15min":0.24299999999999999},"max":{"1min":18.978999999999999,"5min":85.109999999999999,"15min":153.59299999999999},"last":1.381},{"interface":"front","average":{"1min":5.1680000000000001,"5min":5.9489999999999998,"15min":4.0469999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.29199999999999998},"max":{"1min":20.414999999999999,"5min":88.606999999999999,"15min":153.94300000000001},"last":1.54}]},{"osd":2,"last update":"Thu Apr 18 04:54:39 2024","interfaces":[{"interface":"back","average":{"1min":3.8010000000000002,"5min":3.6190000000000002,"15min":2.6429999999999998},"min":{"1min":0.58899999999999997,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":19.745000000000001,"5min":23.867000000000001,"15min":162.59700000000001},"last":1.2749999999999999},{"interface":"front","average":{"1min":4.8499999999999996,"5min":4.5759999999999996,"15min":2.9590000000000001},"min":{"1min":0.46000000000000002,"5min":0.309,"15min":0.309},"max":{"1min":19.707999999999998,"5min":28.335000000000001,"15min":153.83500000000001},"last":2.8170000000000002}]},{"osd":4,"last update":"Thu Apr 18 04:54:39 2024","interfaces":[{"interface":"back","average":{"1min":3.2789999999999999,"5min":2.847,"15min":1.7450000000000001},"min":{"1min":0.433,"5min":0.43099999999999999,"15min":0.40000000000000002},"max":{"1min":12.050000000000001,"5min":31.974,"15min":31.974},"last":1.3069999999999999},{"interface":"front","average":{"1min":3.802,"5min":5.0670000000000002,"15min":2.718},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":15.006,"5min":50.536000000000001,"15min":50.536000000000001},"last":0.72999999999999998}]},{"osd":5,"last update":"Thu Apr 18 04:54:39 2024","interfaces":[{"interface":"back","average":{"1min":3.456,"5min":3.7509999999999999,"15min":2.3279999999999998},"min":{"1min":0.40899999999999997,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":12.981,"5min":40.915999999999997,"15min":40.915999999999997},"last":0.69399999999999995},{"interface":"front","average":{"1min":3.4169999999999998,"5min":2.6850000000000001,"15min":1.9710000000000001},"min":{"1min":0.59499999999999997,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":18.103000000000002,"5min":18.103000000000002,"15min":68.370000000000005},"last":0.78100000000000003}]},{"osd":6,"last update":"Thu Apr 18 04:54:39 2024","interfaces":[{"interface":"back","average":{"1min":3.3959999999999999,"5min":3.5880000000000001,"15min":2.2360000000000002},"min":{"1min":0.60899999999999999,"5min":0.45100000000000001,"15min":0.39900000000000002},"max":{"1min":17.058,"5min":28.748000000000001,"15min":48.765000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":3.4129999999999998,"5min":4.7320000000000002,"15min":2.593},"min":{"1min":0.68400000000000005,"5min":0.47199999999999998,"15min":0.38900000000000001},"max":{"1min":12.656000000000001,"5min":69.227999999999994,"15min":69.227999999999994},"last":1.2370000000000001}]},{"osd":7,"last update":"Thu Apr 18 04:54:39 2024","interfaces":[{"interface":"back","average":{"1min":3.77,"5min":3.2320000000000002,"15min":2.1030000000000002},"min":{"1min":0.49199999999999999,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":18.795000000000002,"5min":40.947000000000003,"15min":40.947000000000003},"last":1.337},{"interface":"front","average":{"1min":3.331,"5min":3.3410000000000002,"15min":2.2200000000000002},"min":{"1min":0.65000000000000002,"5min":0.54500000000000004,"15min":0.44400000000000001},"max":{"1min":17.122,"5min":19.512,"15min":68.329999999999998},"last":0.81999999999999995}]}]},{"osd":2,"up_from":15,"seq":64424509575,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1030932,"kb_used_data":479828,"kb_used_omap":1,"kb_used_meta":550334,"kb_avail":93340908,"statfs":{"total":96636764160,"available":95581089792,"internally_reserved":0,"allocated":491343872,"data_stored":1051780942,"data_compressed":60292170,"data_compressed_allocated":226811904,"data_compressed_original":787464192,"omap_allocated":1594,"internal_metadata":563542470},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":3.7570000000000001,"5min":4.9139999999999997,"15min":3.3690000000000002},"min":{"1min":0.66300000000000003,"5min":0.248,"15min":0.23300000000000001},"max":{"1min":15.831,"5min":37.567,"15min":120.402},"last":0.53500000000000003},{"interface":"front","average":{"1min":4.2869999999999999,"5min":5.6310000000000002,"15min":3.327},"min":{"1min":0.432,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":30.812999999999999,"5min":58.277999999999999,"15min":121.377},"last":1.2829999999999999}]},{"osd":1,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":3.4889999999999999,"5min":5.6909999999999998,"15min":3.7650000000000001},"min":{"1min":0.51100000000000001,"5min":0.32300000000000001,"15min":0.28399999999999997},"max":{"1min":8.5229999999999997,"5min":62.851999999999997,"15min":135.32400000000001},"last":1.595},{"interface":"front","average":{"1min":3.3100000000000001,"5min":5.548,"15min":3.8370000000000002},"min":{"1min":0.64100000000000001,"5min":0.35599999999999998,"15min":0.27600000000000002},"max":{"1min":11.401,"5min":60.741999999999997,"15min":178.08199999999999},"last":3.6899999999999999}]},{"osd":3,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":5.8479999999999999,"5min":5.0250000000000004,"15min":3.1509999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.35999999999999999},"max":{"1min":65.037000000000006,"5min":65.037000000000006,"15min":124.76300000000001},"last":1.425},{"interface":"front","average":{"1min":7.4370000000000003,"5min":5.7990000000000004,"15min":3.5},"min":{"1min":0.53700000000000003,"5min":0.36699999999999999,"15min":0.33000000000000002},"max":{"1min":70.861999999999995,"5min":70.861999999999995,"15min":145.47200000000001},"last":0.79100000000000004}]},{"osd":4,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":2.944,"5min":3.931,"15min":2.298},"min":{"1min":0.49399999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":10.182,"5min":37.420000000000002,"15min":37.420000000000002},"last":1.0669999999999999},{"interface":"front","average":{"1min":2.9249999999999998,"5min":3.5760000000000001,"15min":2.1749999999999998},"min":{"1min":0.65600000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":10.327999999999999,"5min":37.460000000000001,"15min":37.460000000000001},"last":1.1299999999999999}]},{"osd":5,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":3.0059999999999998,"5min":3.6850000000000001,"15min":2.1160000000000001},"min":{"1min":0.621,"5min":0.38,"15min":0.32700000000000001},"max":{"1min":10.250999999999999,"5min":37.5,"15min":37.5},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.6419999999999999,"5min":3.331,"15min":2.1219999999999999},"min":{"1min":0.44700000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":6.2000000000000002,"5min":28.143000000000001,"15min":28.143000000000001},"last":1.2330000000000001}]},{"osd":6,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":3.2109999999999999,"5min":3.5619999999999998,"15min":2.2469999999999999},"min":{"1min":0.74199999999999999,"5min":0.47499999999999998,"15min":0.441},"max":{"1min":10.359999999999999,"5min":24.103000000000002,"15min":34.506999999999998},"last":1.1559999999999999},{"interface":"front","average":{"1min":2.2200000000000002,"5min":3.75,"15min":2.2869999999999999},"min":{"1min":0.56200000000000006,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":5.6909999999999998,"5min":37.533000000000001,"15min":37.533000000000001},"last":1.4630000000000001}]},{"osd":7,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":2.5550000000000002,"5min":3.4169999999999998,"15min":2.0649999999999999},"min":{"1min":0.53200000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":6.0209999999999999,"5min":24.155000000000001,"15min":24.155000000000001},"last":3.3519999999999999},{"interface":"front","average":{"1min":1.5569999999999999,"5min":3.1360000000000001,"15min":2.125},"min":{"1min":0.52800000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":5.0099999999999998,"5min":26.064,"15min":34.576999999999998},"last":1.6279999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509572,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2149836,"kb_used_data":1180352,"kb_used_omap":1,"kb_used_meta":968766,"kb_avail":92222004,"statfs":{"total":96636764160,"available":94435332096,"internally_reserved":0,"allocated":1208680448,"data_stored":2610206427,"data_compressed":148825228,"data_compressed_allocated":553168896,"data_compressed_original":1954910208,"omap_allocated":1594,"internal_metadata":992016838},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:54:40 2024","interfaces":[{"interface":"back","average":{"1min":2.347,"5min":5.9189999999999996,"15min":3.3500000000000001},"min":{"1min":0.26000000000000001,"5min":0.22,"15min":0.22},"max":{"1min":11.497999999999999,"5min":124.096,"15min":124.096},"last":0.41899999999999998},{"interface":"front","average":{"1min":3.9830000000000001,"5min":7.2380000000000004,"15min":4.0640000000000001},"min":{"1min":0.44500000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":14.279,"5min":143.60300000000001,"15min":164.41},"last":0.46300000000000002}]},{"osd":2,"last update":"Thu Apr 18 04:54:40 2024","interfaces":[{"interface":"back","average":{"1min":3.79,"5min":4.7270000000000003,"15min":5.9119999999999999},"min":{"1min":0.48499999999999999,"5min":0.33700000000000002,"15min":0.29299999999999998},"max":{"1min":11.513,"5min":25.558,"15min":840.66700000000003},"last":0.39700000000000002},{"interface":"front","average":{"1min":3.036,"5min":5.9249999999999998,"15min":3.722},"min":{"1min":0.44600000000000001,"5min":0.33600000000000002,"15min":0.33400000000000002},"max":{"1min":11.717000000000001,"5min":114.47199999999999,"15min":164.477},"last":0.48099999999999998}]},{"osd":3,"last update":"Thu Apr 18 04:54:40 2024","interfaces":[{"interface":"back","average":{"1min":2.9220000000000002,"5min":6.6210000000000004,"15min":4.7510000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":11.66,"5min":88.673000000000002,"15min":164.50299999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":3.9239999999999999,"5min":8.1709999999999994,"15min":4.8360000000000003},"min":{"1min":0.5,"5min":0.39800000000000002,"15min":0.36899999999999999},"max":{"1min":14.032999999999999,"5min":151.82599999999999,"15min":151.82599999999999},"last":0.42899999999999999}]},{"osd":4,"last update":"Thu Apr 18 04:54:40 2024","interfaces":[{"interface":"back","average":{"1min":2.7000000000000002,"5min":3.851,"15min":2.637},"min":{"1min":0.45900000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":9.6219999999999999,"5min":23.478999999999999,"15min":52.072000000000003},"last":0.67000000000000004},{"interface":"front","average":{"1min":2.1459999999999999,"5min":4.5490000000000004,"15min":5.5670000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.34399999999999997},"max":{"1min":11.691000000000001,"5min":33.017000000000003,"15min":840.61500000000001},"last":0.747}]},{"osd":5,"last update":"Thu Apr 18 04:54:40 2024","interfaces":[{"interface":"back","average":{"1min":3.6099999999999999,"5min":5.6520000000000001,"15min":4.5860000000000003},"min":{"1min":0.46500000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":14.146000000000001,"5min":114.37,"15min":478.47000000000003},"last":0.63900000000000001},{"interface":"front","average":{"1min":3.887,"5min":4.1609999999999996,"15min":3.0859999999999999},"min":{"1min":0.52700000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":14.176,"5min":41.832000000000001,"15min":164.374},"last":0.78000000000000003}]},{"osd":6,"last update":"Thu Apr 18 04:54:40 2024","interfaces":[{"interface":"back","average":{"1min":3.242,"5min":4.0090000000000003,"15min":2.742},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":14.496,"5min":23.416,"15min":52.100999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":2.5070000000000001,"5min":4.0839999999999996,"15min":3.782},"min":{"1min":0.55500000000000005,"5min":0.49399999999999999,"15min":0.438},"max":{"1min":11.625,"5min":25.809999999999999,"15min":396.81},"last":0.65700000000000003}]},{"osd":7,"last update":"Thu Apr 18 04:54:40 2024","interfaces":[{"interface":"back","average":{"1min":3.6680000000000001,"5min":5.6479999999999997,"15min":3.581},"min":{"1min":0.499,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":14.105,"5min":100.565,"15min":164.447},"last":0.81299999999999994},{"interface":"front","average":{"1min":3.5190000000000001,"5min":3.996,"15min":2.698},"min":{"1min":0.48999999999999999,"5min":0.46200000000000002,"15min":0.45400000000000001},"max":{"1min":14.558,"5min":23.648,"15min":54.353000000000002},"last":0.73799999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542281,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1472068,"kb_used_data":823420,"kb_used_omap":1,"kb_used_meta":648638,"kb_avail":92899772,"statfs":{"total":96636764160,"available":95129366528,"internally_reserved":0,"allocated":843182080,"data_stored":1806379188,"data_compressed":103928359,"data_compressed_allocated":382578688,"data_compressed_original":1345990656,"omap_allocated":1589,"internal_metadata":664205771},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:54:27 2024","interfaces":[{"interface":"back","average":{"1min":17.356999999999999,"5min":5.6539999999999999,"15min":3.7490000000000001},"min":{"1min":0.34100000000000003,"5min":0.249,"15min":0.249},"max":{"1min":195.89500000000001,"5min":195.89500000000001,"15min":287.19600000000003},"last":1.298},{"interface":"front","average":{"1min":19.302,"5min":5.9539999999999997,"15min":4.0789999999999997},"min":{"1min":0.26800000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":196.149,"5min":196.149,"15min":289.23899999999998},"last":0.31900000000000001}]},{"osd":1,"last update":"Thu Apr 18 04:54:48 2024","interfaces":[{"interface":"back","average":{"1min":6.774,"5min":4.2729999999999997,"15min":3.5590000000000002},"min":{"1min":0.34799999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":90.055000000000007,"5min":90.055000000000007,"15min":303.83800000000002},"last":2.1739999999999999},{"interface":"front","average":{"1min":7.1840000000000002,"5min":5.3330000000000002,"15min":3.6709999999999998},"min":{"1min":0.45400000000000001,"5min":0.34499999999999997,"15min":0.32000000000000001},"max":{"1min":90.001999999999995,"5min":90.001999999999995,"15min":288.05799999999999},"last":2.2090000000000001}]},{"osd":2,"last update":"Thu Apr 18 04:54:48 2024","interfaces":[{"interface":"back","average":{"1min":6.0229999999999997,"5min":3.585,"15min":2.3010000000000002},"min":{"1min":0.374,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":91.088999999999999,"5min":91.088999999999999,"15min":91.088999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":6.2089999999999996,"5min":3.0259999999999998,"15min":1.8799999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":91.171999999999997,"5min":91.171999999999997,"15min":91.171999999999997},"last":3.7330000000000001}]},{"osd":3,"last update":"Thu Apr 18 04:54:48 2024","interfaces":[{"interface":"back","average":{"1min":7.5279999999999996,"5min":4.2400000000000002,"15min":3.7999999999999998},"min":{"1min":0.36699999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":89.393000000000001,"5min":89.393000000000001,"15min":308.36700000000002},"last":0.71399999999999997},{"interface":"front","average":{"1min":6.0540000000000003,"5min":3.7349999999999999,"15min":3.1829999999999998},"min":{"1min":0.36799999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":88.070999999999998,"5min":88.070999999999998,"15min":289.86099999999999},"last":0.63300000000000001}]},{"osd":4,"last update":"Thu Apr 18 04:54:27 2024","interfaces":[{"interface":"back","average":{"1min":2.7170000000000001,"5min":1.3200000000000001,"15min":1.1819999999999999},"min":{"1min":0.25900000000000001,"5min":0.252,"15min":0.252},"max":{"1min":41.567,"5min":41.567,"15min":41.567},"last":0.66400000000000003},{"interface":"front","average":{"1min":3.0529999999999999,"5min":1.343,"15min":1.1459999999999999},"min":{"1min":0.313,"5min":0.29699999999999999,"15min":0.247},"max":{"1min":45.646000000000001,"5min":45.646000000000001,"15min":45.646000000000001},"last":0.39400000000000002}]},{"osd":5,"last update":"Thu Apr 18 04:54:27 2024","interfaces":[{"interface":"back","average":{"1min":2.653,"5min":1.4319999999999999,"15min":1.1739999999999999},"min":{"1min":0.27300000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":41.595999999999997,"5min":41.595999999999997,"15min":41.595999999999997},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.155,"5min":1.0089999999999999,"15min":1.0389999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":5.8769999999999998,"5min":15.271000000000001,"15min":15.271000000000001},"last":1.843}]},{"osd":6,"last update":"Thu Apr 18 04:54:27 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.98799999999999999,"15min":1.0109999999999999},"min":{"1min":0.29999999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":5.1630000000000003,"5min":8.2390000000000008,"15min":8.2390000000000008},"last":0.42299999999999999},{"interface":"front","average":{"1min":1.052,"5min":1.0469999999999999,"15min":1.077},"min":{"1min":0.38600000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":5.9429999999999996,"5min":11.288,"15min":11.288},"last":0.69199999999999995}]}]},{"osd":6,"up_from":14,"seq":60129542279,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1689024,"kb_used_data":927160,"kb_used_omap":1,"kb_used_meta":761854,"kb_avail":92682816,"statfs":{"total":96636764160,"available":94907203584,"internally_reserved":0,"allocated":949411840,"data_stored":2052418772,"data_compressed":117144832,"data_compressed_allocated":436039680,"data_compressed_original":1539252224,"omap_allocated":1593,"internal_metadata":780138951},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":7.1710000000000003,"5min":2.77,"15min":1.667},"min":{"1min":0.36699999999999999,"5min":0.247,"15min":0.247},"max":{"1min":99.328999999999994,"5min":99.328999999999994,"15min":99.328999999999994},"last":0.90100000000000002},{"interface":"front","average":{"1min":7.202,"5min":3.3170000000000002,"15min":2.181},"min":{"1min":0.40300000000000002,"5min":0.309,"15min":0.309},"max":{"1min":99.287000000000006,"5min":99.287000000000006,"15min":99.287000000000006},"last":0.97599999999999998}]},{"osd":1,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":9.1219999999999999,"5min":5.085,"15min":2.8410000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":98.650999999999996,"5min":122.06999999999999,"15min":122.06999999999999},"last":1.2669999999999999},{"interface":"front","average":{"1min":8.6890000000000001,"5min":4.649,"15min":2.6880000000000002},"min":{"1min":0.42799999999999999,"5min":0.33300000000000002,"15min":0.32800000000000001},"max":{"1min":98.683999999999997,"5min":122.09,"15min":122.09},"last":1.2929999999999999}]},{"osd":2,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":2.702,"5min":2.7919999999999998,"15min":1.835},"min":{"1min":0.33600000000000002,"5min":0.31,"15min":0.31},"max":{"1min":13.101000000000001,"5min":38.557000000000002,"15min":41.764000000000003},"last":1.196},{"interface":"front","average":{"1min":2.1640000000000001,"5min":2.8300000000000001,"15min":1.8919999999999999},"min":{"1min":0.373,"5min":0.35799999999999998,"15min":0.35199999999999998},"max":{"1min":10.993,"5min":35.734000000000002,"15min":41.710000000000001},"last":1.0429999999999999}]},{"osd":3,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":8.2070000000000007,"5min":3.9660000000000002,"15min":2.9119999999999999},"min":{"1min":0.39400000000000002,"5min":0.312,"15min":0.29999999999999999},"max":{"1min":101.006,"5min":101.006,"15min":101.006},"last":1.1559999999999999},{"interface":"front","average":{"1min":8.2420000000000009,"5min":4.0410000000000004,"15min":2.9980000000000002},"min":{"1min":0.437,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":101.039,"5min":101.039,"15min":101.039},"last":1.226}]},{"osd":4,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":2.1829999999999998,"5min":1.6220000000000001,"15min":1.155},"min":{"1min":0.28599999999999998,"5min":0.217,"15min":0.217},"max":{"1min":17.401,"5min":19.481999999999999,"15min":19.481999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":2.2650000000000001,"5min":1.6200000000000001,"15min":1.234},"min":{"1min":0.33600000000000002,"5min":0.28199999999999997,"15min":0.26400000000000001},"max":{"1min":17.872,"5min":19.536999999999999,"15min":19.536999999999999},"last":0.93799999999999994}]},{"osd":5,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":0.90900000000000003,"15min":1.0389999999999999},"min":{"1min":0.27900000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":4.2050000000000001,"5min":13.538,"15min":13.538},"last":0.874},{"interface":"front","average":{"1min":1.05,"5min":0.95399999999999996,"15min":0.95199999999999996},"min":{"1min":0.35499999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":4.2350000000000003,"5min":8.7210000000000001,"15min":8.7210000000000001},"last":1.075}]},{"osd":7,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":0.93400000000000005,"15min":1.0740000000000001},"min":{"1min":0.314,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":4.266,"5min":7.5359999999999996,"15min":7.5359999999999996},"last":1.004},{"interface":"front","average":{"1min":1.496,"5min":0.96299999999999997,"15min":1.036},"min":{"1min":0.35199999999999998,"5min":0.33500000000000002,"15min":0.314},"max":{"1min":10.955,"5min":10.955,"15min":10.955},"last":1.1220000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542281,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1339128,"kb_used_data":744560,"kb_used_omap":1,"kb_used_meta":594558,"kb_avail":93032712,"statfs":{"total":96636764160,"available":95265497088,"internally_reserved":0,"allocated":762429440,"data_stored":1635972235,"data_compressed":93678787,"data_compressed_allocated":347312128,"data_compressed_original":1221066752,"omap_allocated":1593,"internal_metadata":608827847},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":6.1559999999999997,"5min":4.0069999999999997,"15min":2.343},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":81.960999999999999,"5min":84.305000000000007,"15min":84.305000000000007},"last":0.42699999999999999},{"interface":"front","average":{"1min":5.1970000000000001,"5min":4.0170000000000003,"15min":4.4409999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":82.180000000000007,"5min":86.994,"15min":553.95500000000004},"last":0.38}]},{"osd":1,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":5.4820000000000002,"5min":4.9640000000000004,"15min":4.6870000000000003},"min":{"1min":0.34899999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":81.361999999999995,"5min":87.989000000000004,"15min":553.36900000000003},"last":178.01499999999999},{"interface":"front","average":{"1min":5.7640000000000002,"5min":4.6989999999999998,"15min":4.3010000000000002},"min":{"1min":0.32500000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":95.162000000000006,"5min":95.162000000000006,"15min":501.11000000000001},"last":177.964}]},{"osd":2,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":6.2830000000000004,"15min":3.1280000000000001},"min":{"1min":0.40300000000000002,"5min":0.34599999999999997,"15min":0.29799999999999999},"max":{"1min":6.8399999999999999,"5min":262.99700000000001,"15min":262.99700000000001},"last":0.442},{"interface":"front","average":{"1min":1.298,"5min":6.6760000000000002,"15min":3.3050000000000002},"min":{"1min":0.377,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":5.4320000000000004,"5min":259.24099999999999,"15min":259.24099999999999},"last":0.39900000000000002}]},{"osd":3,"last update":"Thu Apr 18 04:54:39 2024","interfaces":[{"interface":"back","average":{"1min":5.4500000000000002,"5min":4.4909999999999997,"15min":2.6110000000000002},"min":{"1min":0.42099999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":84.394999999999996,"5min":84.394999999999996,"15min":84.394999999999996},"last":176.523},{"interface":"front","average":{"1min":5.54,"5min":4.593,"15min":2.8690000000000002},"min":{"1min":0.44900000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":83.763999999999996,"5min":86.834999999999994,"15min":86.834999999999994},"last":176.41999999999999}]},{"osd":4,"last update":"Thu Apr 18 04:54:39 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.749,"15min":0.83199999999999996},"min":{"1min":0.28100000000000003,"5min":0.246,"15min":0.246},"max":{"1min":1.2010000000000001,"5min":4.6440000000000001,"15min":4.6440000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":1.181,"15min":1.0600000000000001},"min":{"1min":0.36199999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":2.7599999999999998,"5min":12.888999999999999,"15min":12.888999999999999},"last":0.36499999999999999}]},{"osd":6,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.71599999999999997,"15min":0.874},"min":{"1min":0.31,"5min":0.252,"15min":0.252},"max":{"1min":3.306,"5min":4.6639999999999997,"15min":4.6639999999999997},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.96999999999999997,"15min":0.97899999999999998},"min":{"1min":0.32500000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":3.2850000000000001,"5min":12.694000000000001,"15min":12.694000000000001},"last":0.28100000000000003}]},{"osd":7,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.90500000000000003,"15min":1.018},"min":{"1min":0.34599999999999997,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.97599999999999998,"5min":12.74,"15min":12.74},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.89700000000000002,"5min":1.05,"15min":1.0429999999999999},"min":{"1min":0.40100000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":6.4630000000000001,"5min":27.658000000000001,"15min":27.658000000000001},"last":0.46600000000000003}]}]},{"osd":4,"up_from":14,"seq":60129542281,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1538492,"kb_used_data":817204,"kb_used_omap":1,"kb_used_meta":721278,"kb_avail":92833348,"statfs":{"total":96636764160,"available":95061348352,"internally_reserved":0,"allocated":836816896,"data_stored":1811192408,"data_compressed":103999266,"data_compressed_allocated":383492096,"data_compressed_original":1358073856,"omap_allocated":1594,"internal_metadata":738589126},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,0,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":10.712,"5min":5.7519999999999998,"15min":2.8180000000000001},"min":{"1min":0.27700000000000002,"5min":0.25700000000000001,"15min":0.254},"max":{"1min":148.048,"5min":148.048,"15min":148.048},"last":1.1879999999999999},{"interface":"front","average":{"1min":9.0670000000000002,"5min":5.4290000000000003,"15min":2.8690000000000002},"min":{"1min":0.34899999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":144.72999999999999,"5min":144.72999999999999,"15min":144.72999999999999},"last":2.972}]},{"osd":1,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":9.7420000000000009,"5min":8.516,"15min":4.0419999999999998},"min":{"1min":0.32200000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":158.56,"5min":158.56,"15min":158.56},"last":2.9470000000000001},{"interface":"front","average":{"1min":8.7690000000000001,"5min":7.3419999999999996,"15min":3.448},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":144.60400000000001,"5min":144.60400000000001,"15min":144.60400000000001},"last":0.33900000000000002}]},{"osd":2,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":3.9319999999999999,"15min":2.1949999999999998},"min":{"1min":0.379,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":4.5899999999999999,"5min":109.28,"15min":109.28},"last":0.36699999999999999},{"interface":"front","average":{"1min":1.264,"5min":4.2400000000000002,"15min":2.21},"min":{"1min":0.34599999999999997,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":4.5419999999999998,"5min":109.242,"15min":109.242},"last":2.9990000000000001}]},{"osd":3,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":9.5440000000000005,"5min":7.0369999999999999,"15min":3.4500000000000002},"min":{"1min":0.45600000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":147.625,"5min":147.625,"15min":147.625},"last":7.6470000000000002},{"interface":"front","average":{"1min":9.9489999999999998,"5min":6.0170000000000003,"15min":3.355},"min":{"1min":0.41299999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":147.01599999999999,"5min":147.01599999999999,"15min":147.01599999999999},"last":4.8380000000000001}]},{"osd":5,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":1.0860000000000001,"15min":1.0249999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":2.9670000000000001,"5min":19.143999999999998,"15min":19.143999999999998},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.80300000000000005,"5min":1.1120000000000001,"15min":1.0249999999999999},"min":{"1min":0.29099999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":2.48,"5min":27.402999999999999,"15min":27.402999999999999},"last":3.6659999999999999}]},{"osd":6,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.94899999999999995,"15min":1.0720000000000001},"min":{"1min":0.32700000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":3.113,"5min":8.8889999999999993,"15min":13.891999999999999},"last":1.1200000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":1.2330000000000001,"15min":1.133},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":2.5649999999999999,"5min":17.954999999999998,"15min":17.954999999999998},"last":2.9119999999999999}]},{"osd":7,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":1.484,"15min":1.1890000000000001},"min":{"1min":0.28899999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":3.0619999999999998,"5min":27.643000000000001,"15min":27.643000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.70799999999999996,"5min":1.2130000000000001,"15min":1.107},"min":{"1min":0.34999999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":3.0920000000000001,"5min":18.800999999999998,"15min":18.800999999999998},"last":0.84299999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574983,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1177632,"kb_used_data":578968,"kb_used_omap":1,"kb_used_meta":598654,"kb_avail":93194208,"statfs":{"total":96636764160,"available":95430868992,"internally_reserved":0,"allocated":592863232,"data_stored":1272555487,"data_compressed":73983711,"data_compressed_allocated":273489920,"data_compressed_original":953393152,"omap_allocated":1594,"internal_metadata":613022150},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,1,4,1,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 04:54:44 2024","interfaces":[{"interface":"back","average":{"1min":3.5670000000000002,"5min":5.9139999999999997,"15min":2.839},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":30.347000000000001,"5min":55.061,"15min":55.061},"last":7.1699999999999999},{"interface":"front","average":{"1min":3.3919999999999999,"5min":6.6890000000000001,"15min":3.1659999999999999},"min":{"1min":0.377,"5min":0.309,"15min":0.28899999999999998},"max":{"1min":11.872,"5min":115.45099999999999,"15min":115.45099999999999},"last":6.4859999999999998}]},{"osd":2,"last update":"Thu Apr 18 04:54:41 2024","interfaces":[{"interface":"back","average":{"1min":2.9929999999999999,"5min":3.1360000000000001,"15min":1.782},"min":{"1min":0.35699999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":8.7430000000000003,"5min":22.475000000000001,"15min":28.802},"last":6.1440000000000001},{"interface":"front","average":{"1min":2.6970000000000001,"5min":4.8710000000000004,"15min":2.4420000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.29399999999999998},"max":{"1min":9.7460000000000004,"5min":115.229,"15min":115.229},"last":7.0780000000000003}]},{"osd":3,"last update":"Thu Apr 18 04:54:41 2024","interfaces":[{"interface":"back","average":{"1min":3.5859999999999999,"5min":4.8010000000000002,"15min":2.4569999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":30.466000000000001,"5min":34.180999999999997,"15min":47.496000000000002},"last":10.289},{"interface":"front","average":{"1min":3.2829999999999999,"5min":5.1589999999999998,"15min":2.5310000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":19.003,"5min":115.729,"15min":115.729},"last":10.404}]},{"osd":4,"last update":"Thu Apr 18 04:54:26 2024","interfaces":[{"interface":"back","average":{"1min":1.837,"5min":3.0230000000000001,"15min":1.7749999999999999},"min":{"1min":0.38100000000000001,"5min":0.372,"15min":0.33000000000000002},"max":{"1min":6.5369999999999999,"5min":49.738999999999997,"15min":49.738999999999997},"last":6.7910000000000004},{"interface":"front","average":{"1min":3.7850000000000001,"5min":4.165,"15min":2.2429999999999999},"min":{"1min":0.47499999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":30.225000000000001,"5min":50.996000000000002,"15min":50.996000000000002},"last":10.247999999999999}]},{"osd":5,"last update":"Thu Apr 18 04:54:26 2024","interfaces":[{"interface":"back","average":{"1min":2.7949999999999999,"5min":3.0289999999999999,"15min":1.8069999999999999},"min":{"1min":0.437,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":7.6360000000000001,"5min":34.402999999999999,"15min":34.402999999999999},"last":6.851},{"interface":"front","average":{"1min":2.081,"5min":2.9049999999999998,"15min":1.847},"min":{"1min":0.51800000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":6.258,"5min":20.699000000000002,"15min":33.392000000000003},"last":6.8220000000000001}]},{"osd":6,"last update":"Thu Apr 18 04:54:26 2024","interfaces":[{"interface":"back","average":{"1min":3.3399999999999999,"5min":4.4859999999999998,"15min":2.355},"min":{"1min":0.60899999999999999,"5min":0.41999999999999998,"15min":0.40600000000000003},"max":{"1min":21.803000000000001,"5min":115.277,"15min":115.277},"last":6.8849999999999998},{"interface":"front","average":{"1min":4.3700000000000001,"5min":3.504,"15min":1.97},"min":{"1min":0.56299999999999994,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":30.279,"5min":48.652999999999999,"15min":48.652999999999999},"last":10.212999999999999}]},{"osd":7,"last update":"Thu Apr 18 04:54:26 2024","interfaces":[{"interface":"back","average":{"1min":2.6819999999999999,"5min":3.7240000000000002,"15min":2.129},"min":{"1min":0.48899999999999999,"5min":0.47099999999999997,"15min":0.437},"max":{"1min":7.2949999999999999,"5min":54.829000000000001,"15min":54.829000000000001},"last":6.7450000000000001},{"interface":"front","average":{"1min":4.0430000000000001,"5min":4.9459999999999997,"15min":2.5899999999999999},"min":{"1min":0.58599999999999997,"5min":0.49399999999999999,"15min":0.48699999999999999},"max":{"1min":30.315999999999999,"5min":115.31399999999999,"15min":115.31399999999999},"last":10.170999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33312,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33312,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3121152,"data_stored":20972180,"data_compressed":2483986,"data_compressed_allocated":2842624,"data_compressed_original":20709376,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3178496,"data_stored":20972464,"data_compressed":2531508,"data_compressed_allocated":2936832,"data_compressed_original":20754432,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1396736,"data_stored":4285475,"data_compressed":439103,"data_compressed_allocated":598016,"data_compressed_original":3510272,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6742016,"data_stored":16869536,"data_compressed":1734435,"data_compressed_allocated":2166784,"data_compressed_original":12316672,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6316032,"data_stored":29361965,"data_compressed":3215159,"data_compressed_allocated":3665920,"data_compressed_original":26726400,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":3235840,"data_stored":18153824,"data_compressed":2174151,"data_compressed_allocated":2514944,"data_compressed_original":17453056,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3473408,"data_stored":16779689,"data_compressed":2087260,"data_compressed_allocated":2478080,"data_compressed_original":15798272,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10383360,"data_stored":34931561,"data_compressed":3585780,"data_compressed_allocated":4227072,"data_compressed_original":28794880,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":515846144,"data_stored":1087262720,"data_compressed":62154190,"data_compressed_allocated":235966464,"data_compressed_original":807383040,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1153400832,"data_stored":2471641088,"data_compressed":139688025,"data_compressed_allocated":525225984,"data_compressed_original":1843466240,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":457523200,"data_stored":973942784,"data_compressed":55652416,"data_compressed_allocated":211103744,"data_compressed_original":727523328,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":778780672,"data_stored":1649655808,"data_compressed":94201311,"data_compressed_allocated":358633472,"data_compressed_original":1229508608,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":782118912,"data_stored":1681014784,"data_compressed":95116627,"data_compressed_allocated":357539840,"data_compressed_original":1256435712,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":724738048,"data_stored":1537974272,"data_compressed":87154553,"data_compressed_allocated":328507392,"data_compressed_original":1141743616,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":908517376,"data_stored":1951600640,"data_compressed":110133305,"data_compressed_allocated":414691328,"data_compressed_original":1457774592,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":802717696,"data_stored":1709887488,"data_compressed":96743466,"data_compressed_allocated":364863488,"data_compressed_original":1272033280,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T04:55:29.060 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T04:55:29.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.237+0000 7fe830600640 1 Processor -- start 2024-04-18T04:55:29.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.237+0000 7fe830600640 1 -- start start 2024-04-18T04:55:29.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.237+0000 7fe830600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8281538a0 0x7fe82806ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:29.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.237+0000 7fe830600640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe8280c47d0 0x7fe8280c4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:29.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.237+0000 7fe830600640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8280c5160 con 0x7fe82815cbb0 2024-04-18T04:55:29.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.237+0000 7fe830600640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8280cb300 con 0x7fe8280c47d0 2024-04-18T04:55:29.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.237+0000 7fe830600640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe82815d310 con 0x7fe8281538a0 2024-04-18T04:55:29.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.237+0000 7fe82e600640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe8280c47d0 0x7fe8280c4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:29.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.237+0000 7fe82e600640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe8280c47d0 0x7fe8280c4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43078/0 (socket says 172.21.15.120:43078) 2024-04-18T04:55:29.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.237+0000 7fe82e600640 1 -- 172.21.15.120:0/2276717858 learned_addr learned my addr 172.21.15.120:0/2276717858 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:29.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.237+0000 7fe82dc00640 1 --2- 172.21.15.120:0/2276717858 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8281538a0 0x7fe82806ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:29.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.237+0000 7fe82e600640 1 -- 172.21.15.120:0/2276717858 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8281538a0 msgr2=0x7fe82806ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:29.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.237+0000 7fe82e600640 1 --2- 172.21.15.120:0/2276717858 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8281538a0 0x7fe82806ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:29.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.237+0000 7fe82e600640 1 -- 172.21.15.120:0/2276717858 >> v1:172.21.15.132:6789/0 conn(0x7fe82815cbb0 legacy=0x7fe8280cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:29.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.237+0000 7fe82e600640 1 -- 172.21.15.120:0/2276717858 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe82815d5f0 con 0x7fe8280c47d0 2024-04-18T04:55:29.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.241+0000 7fe82e600640 1 --2- 172.21.15.120:0/2276717858 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8280c47d0 0x7fe8280c4c20 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fe820009e50 tx=0x7fe82001ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b258ff9b98893994 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:29.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.241+0000 7fe827e00640 1 -- 172.21.15.120:0/2276717858 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8200a58d0 con 0x7fe8280c47d0 2024-04-18T04:55:29.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.241+0000 7fe827e00640 1 -- 172.21.15.120:0/2276717858 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8200a5a30 con 0x7fe8280c47d0 2024-04-18T04:55:29.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.241+0000 7fe827e00640 1 -- 172.21.15.120:0/2276717858 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8200a5dc0 con 0x7fe8280c47d0 2024-04-18T04:55:29.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.241+0000 7fe830600640 1 -- 172.21.15.120:0/2276717858 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8280c47d0 msgr2=0x7fe8280c4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:29.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.241+0000 7fe830600640 1 --2- 172.21.15.120:0/2276717858 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8280c47d0 0x7fe8280c4c20 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fe820009e50 tx=0x7fe82001ca00 comp rx=0 tx=0).stop 2024-04-18T04:55:29.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.241+0000 7fe830600640 1 -- 172.21.15.120:0/2276717858 shutdown_connections 2024-04-18T04:55:29.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.241+0000 7fe830600640 1 --2- 172.21.15.120:0/2276717858 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8280c47d0 0x7fe8280c4c20 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:29.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.241+0000 7fe830600640 1 --2- 172.21.15.120:0/2276717858 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8281538a0 0x7fe82806ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:29.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.241+0000 7fe830600640 1 -- 172.21.15.120:0/2276717858 >> 172.21.15.120:0/2276717858 conn(0x7fe828065fc0 msgr2=0x7fe8280663d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:29.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.241+0000 7fe830600640 1 -- 172.21.15.120:0/2276717858 shutdown_connections 2024-04-18T04:55:29.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.241+0000 7fe830600640 1 -- 172.21.15.120:0/2276717858 wait complete. 2024-04-18T04:55:29.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.241+0000 7fe830600640 1 Processor -- start 2024-04-18T04:55:29.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.245+0000 7fe830600640 1 -- start start 2024-04-18T04:55:29.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.245+0000 7fe830600640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8280c47d0 0x7fe828154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:29.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.245+0000 7fe830600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8281538a0 0x7fe8281442f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:29.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.245+0000 7fe830600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe82815cbb0 0x7fe828145280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:29.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.245+0000 7fe830600640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe828155450 con 0x7fe82815cbb0 2024-04-18T04:55:29.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.245+0000 7fe830600640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8280caaf0 con 0x7fe8280c47d0 2024-04-18T04:55:29.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.245+0000 7fe830600640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8281f1640 con 0x7fe8281538a0 2024-04-18T04:55:29.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.245+0000 7fe82e600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe82815cbb0 0x7fe828145280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:29.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.245+0000 7fe82e600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe82815cbb0 0x7fe828145280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43086/0 (socket says 172.21.15.120:43086) 2024-04-18T04:55:29.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.245+0000 7fe82e600640 1 -- 172.21.15.120:0/2855331548 learned_addr learned my addr 172.21.15.120:0/2855331548 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:29.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.245+0000 7fe82dc00640 1 --2- 172.21.15.120:0/2855331548 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8280c47d0 0x7fe828154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:29.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.245+0000 7fe82d200640 1 --2- 172.21.15.120:0/2855331548 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8281538a0 0x7fe8281442f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:29.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.245+0000 7fe82e600640 1 -- 172.21.15.120:0/2855331548 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8281538a0 msgr2=0x7fe8281442f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:29.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.245+0000 7fe82e600640 1 --2- 172.21.15.120:0/2855331548 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8281538a0 0x7fe8281442f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:29.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.245+0000 7fe82e600640 1 -- 172.21.15.120:0/2855331548 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8280c47d0 msgr2=0x7fe828154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:29.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.245+0000 7fe82e600640 1 --2- 172.21.15.120:0/2855331548 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8280c47d0 0x7fe828154960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:29.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.245+0000 7fe82e600640 1 -- 172.21.15.120:0/2855331548 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe820009b30 con 0x7fe82815cbb0 2024-04-18T04:55:29.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.245+0000 7fe82d200640 1 --2- 172.21.15.120:0/2855331548 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8281538a0 0x7fe8281442f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:55:29.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.245+0000 7fe82e600640 1 --2- 172.21.15.120:0/2855331548 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe82815cbb0 0x7fe828145280 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fe82001a630 tx=0x7fe8200197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:29.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.245+0000 7fe825600640 1 -- 172.21.15.120:0/2855331548 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8200b8670 con 0x7fe82815cbb0 2024-04-18T04:55:29.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.245+0000 7fe825600640 1 -- 172.21.15.120:0/2855331548 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8200b87d0 con 0x7fe82815cbb0 2024-04-18T04:55:29.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.245+0000 7fe825600640 1 -- 172.21.15.120:0/2855331548 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8200b8b80 con 0x7fe82815cbb0 2024-04-18T04:55:29.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.245+0000 7fe830600640 1 -- 172.21.15.120:0/2855331548 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8281f2610 con 0x7fe82815cbb0 2024-04-18T04:55:29.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.245+0000 7fe830600640 1 -- 172.21.15.120:0/2855331548 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8281f2180 con 0x7fe82815cbb0 2024-04-18T04:55:29.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.245+0000 7fe830600640 1 -- 172.21.15.120:0/2855331548 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8281f2310 con 0x7fe82815cbb0 2024-04-18T04:55:29.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.249+0000 7fe825600640 1 -- 172.21.15.120:0/2855331548 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe8200b8ce0 con 0x7fe82815cbb0 2024-04-18T04:55:29.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.249+0000 7fe825600640 1 --2- 172.21.15.120:0/2855331548 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fe808066690 0x7fe808068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:29.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.249+0000 7fe825600640 1 -- 172.21.15.120:0/2855331548 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7fe82011fe90 con 0x7fe82815cbb0 2024-04-18T04:55:29.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.249+0000 7fe82dc00640 1 --2- 172.21.15.120:0/2855331548 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fe808066690 0x7fe808068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:29.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.249+0000 7fe82dc00640 1 --2- 172.21.15.120:0/2855331548 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fe808066690 0x7fe808068b50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe81c007a60 tx=0x7fe81c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:29.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.253+0000 7fe825600640 1 -- 172.21.15.120:0/2855331548 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fe8200ecd10 con 0x7fe82815cbb0 2024-04-18T04:55:29.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.417+0000 7fe830600640 1 -- 172.21.15.120:0/2855331548 --> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe828153c80 con 0x7fe808066690 2024-04-18T04:55:29.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.445+0000 7fe825600640 1 -- 172.21.15.120:0/2855331548 <== mgr.4113 v2:172.21.15.132:6832/27788 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371361 (secure 0 0 0) 0x7fe81c010990 con 0x7fe808066690 2024-04-18T04:55:29.445 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:55:29.447 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-04-18T04:55:29.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.449+0000 7fe830600640 1 -- 172.21.15.120:0/2855331548 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fe808066690 msgr2=0x7fe808068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:29.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.449+0000 7fe830600640 1 --2- 172.21.15.120:0/2855331548 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fe808066690 0x7fe808068b50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe81c007a60 tx=0x7fe81c008040 comp rx=0 tx=0).stop 2024-04-18T04:55:29.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.449+0000 7fe830600640 1 -- 172.21.15.120:0/2855331548 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe82815cbb0 msgr2=0x7fe828145280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:29.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.449+0000 7fe830600640 1 --2- 172.21.15.120:0/2855331548 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe82815cbb0 0x7fe828145280 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fe82001a630 tx=0x7fe8200197a0 comp rx=0 tx=0).stop 2024-04-18T04:55:29.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.449+0000 7fe830600640 1 -- 172.21.15.120:0/2855331548 shutdown_connections 2024-04-18T04:55:29.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.449+0000 7fe830600640 1 --2- 172.21.15.120:0/2855331548 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fe808066690 0x7fe808068b50 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:29.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.449+0000 7fe830600640 1 --2- 172.21.15.120:0/2855331548 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe82815cbb0 0x7fe828145280 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:29.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.449+0000 7fe830600640 1 --2- 172.21.15.120:0/2855331548 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8281538a0 0x7fe8281442f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:29.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.449+0000 7fe830600640 1 --2- 172.21.15.120:0/2855331548 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8280c47d0 0x7fe828154960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:29.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.449+0000 7fe830600640 1 -- 172.21.15.120:0/2855331548 >> 172.21.15.120:0/2855331548 conn(0x7fe828065fc0 msgr2=0x7fe8280ce6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:29.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.449+0000 7fe830600640 1 -- 172.21.15.120:0/2855331548 shutdown_connections 2024-04-18T04:55:29.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.449+0000 7fe830600640 1 -- 172.21.15.120:0/2855331548 wait complete. 2024-04-18T04:55:29.466 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":362,"stamp":"2024-04-18T04:55:29.052057+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4748936091,"num_objects":1396,"num_object_clones":0,"num_object_copies":5402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1396,"num_whiteouts":0,"num_read":667,"num_read_kb":75003,"num_write":2197443,"num_write_kb":31245688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152636,"ondisk_log_size":152636,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":10591380,"kb_used_data":4727452,"kb_used_omap":12,"kb_used_meta":5863091,"kb_avail":744383340,"statfs":{"total":773094113280,"available":762248540160,"internally_reserved":0,"allocated":4840910848,"data_stored":10369290018,"data_compressed":602296917,"data_compressed_allocated":2235453440,"data_compressed_original":7765532672,"omap_allocated":12743,"internal_metadata":6003805753},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,1,6,8,2,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":76,"apply_latency_ms":76,"commit_latency_ns":76000000,"apply_latency_ns":76000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6840363471,"num_objects":-1631,"num_object_clones":0,"num_object_copies":-6524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1631,"num_whiteouts":0,"num_read":1,"num_read_kb":2,"num_write":1687,"num_write_kb":569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004759"},"pg_stats":[{"pgid":"2.1f","version":"30'20","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.054277+0000","last_change":"2024-04-18T04:44:29.891079+0000","last_active":"2024-04-18T04:53:26.054277+0000","last_peered":"2024-04-18T04:53:26.054277+0000","last_clean":"2024-04-18T04:53:26.054277+0000","last_became_active":"2024-04-18T04:44:29.890853+0000","last_became_peered":"2024-04-18T04:44:29.890853+0000","last_unstale":"2024-04-18T04:53:26.054277+0000","last_undegraded":"2024-04-18T04:53:26.054277+0000","last_fullsized":"2024-04-18T04:53:26.054277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:12:22.299583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":4124,"num_write":18,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"32'6","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:46.162203+0000","last_change":"2024-04-18T04:44:30.296344+0000","last_active":"2024-04-18T04:54:46.162203+0000","last_peered":"2024-04-18T04:54:46.162203+0000","last_clean":"2024-04-18T04:54:46.162203+0000","last_became_active":"2024-04-18T04:44:30.296064+0000","last_became_peered":"2024-04-18T04:44:30.296064+0000","last_unstale":"2024-04-18T04:54:46.162203+0000","last_undegraded":"2024-04-18T04:54:46.162203+0000","last_fullsized":"2024-04-18T04:54:46.162203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:53:32.250308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'3929","reported_seq":3953,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.210516+0000","last_change":"2024-04-18T04:44:34.306605+0000","last_active":"2024-04-18T04:55:26.210516+0000","last_peered":"2024-04-18T04:55:26.210516+0000","last_clean":"2024-04-18T04:55:26.210516+0000","last_became_active":"2024-04-18T04:44:34.306224+0000","last_became_peered":"2024-04-18T04:44:34.306224+0000","last_unstale":"2024-04-18T04:55:26.210516+0000","last_undegraded":"2024-04-18T04:55:26.210516+0000","last_fullsized":"2024-04-18T04:55:26.210516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":3929,"log_dups_size":0,"ondisk_log_size":3929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:13:15.107711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155371727,"num_objects":45,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":58047,"num_write_kb":822950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'23","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.190960+0000","last_change":"2024-04-18T04:44:29.881521+0000","last_active":"2024-04-18T04:53:26.190960+0000","last_peered":"2024-04-18T04:53:26.190960+0000","last_clean":"2024-04-18T04:53:26.190960+0000","last_became_active":"2024-04-18T04:44:29.881258+0000","last_became_peered":"2024-04-18T04:44:29.881258+0000","last_unstale":"2024-04-18T04:53:26.190960+0000","last_undegraded":"2024-04-18T04:53:26.190960+0000","last_fullsized":"2024-04-18T04:53:26.190960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:28:40.075960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":19,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'6","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.053986+0000","last_change":"2024-04-18T04:44:30.314205+0000","last_active":"2024-04-18T04:53:26.053986+0000","last_peered":"2024-04-18T04:53:26.053986+0000","last_clean":"2024-04-18T04:53:26.053986+0000","last_became_active":"2024-04-18T04:44:30.313987+0000","last_became_peered":"2024-04-18T04:44:30.313987+0000","last_unstale":"2024-04-18T04:53:26.053986+0000","last_undegraded":"2024-04-18T04:53:26.053986+0000","last_fullsized":"2024-04-18T04:53:26.053986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:55:31.107861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"32'5285","reported_seq":5313,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:28.690001+0000","last_change":"2024-04-18T04:44:34.339646+0000","last_active":"2024-04-18T04:55:28.690001+0000","last_peered":"2024-04-18T04:55:28.690001+0000","last_clean":"2024-04-18T04:55:28.690001+0000","last_became_active":"2024-04-18T04:44:34.338485+0000","last_became_peered":"2024-04-18T04:44:34.338485+0000","last_unstale":"2024-04-18T04:55:28.690001+0000","last_undegraded":"2024-04-18T04:55:28.690001+0000","last_fullsized":"2024-04-18T04:55:28.690001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":5285,"log_dups_size":0,"ondisk_log_size":5285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:47:01.277301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151638538,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":77972,"num_write_kb":1107856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"32'74","reported_seq":106,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:32.488186+0000","last_change":"2024-04-18T04:44:29.897785+0000","last_active":"2024-04-18T04:54:32.488186+0000","last_peered":"2024-04-18T04:54:32.488186+0000","last_clean":"2024-04-18T04:54:32.488186+0000","last_became_active":"2024-04-18T04:44:29.896520+0000","last_became_peered":"2024-04-18T04:44:29.896520+0000","last_unstale":"2024-04-18T04:54:32.488186+0000","last_undegraded":"2024-04-18T04:54:32.488186+0000","last_fullsized":"2024-04-18T04:54:32.488186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:25:52.871139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":14,"num_read_kb":8212,"num_write":66,"num_write_kb":8229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"32'9","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:20.586531+0000","last_change":"2024-04-18T04:44:30.300588+0000","last_active":"2024-04-18T04:55:20.586531+0000","last_peered":"2024-04-18T04:55:20.586531+0000","last_clean":"2024-04-18T04:55:20.586531+0000","last_became_active":"2024-04-18T04:44:30.299939+0000","last_became_peered":"2024-04-18T04:44:30.299939+0000","last_unstale":"2024-04-18T04:55:20.586531+0000","last_undegraded":"2024-04-18T04:55:20.586531+0000","last_fullsized":"2024-04-18T04:55:20.586531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:57:07.547985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"32'4874","reported_seq":4899,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:28.452012+0000","last_change":"2024-04-18T04:44:34.338794+0000","last_active":"2024-04-18T04:55:28.452012+0000","last_peered":"2024-04-18T04:55:28.452012+0000","last_clean":"2024-04-18T04:55:28.452012+0000","last_became_active":"2024-04-18T04:44:34.337938+0000","last_became_peered":"2024-04-18T04:44:34.337938+0000","last_unstale":"2024-04-18T04:55:28.452012+0000","last_undegraded":"2024-04-18T04:55:28.452012+0000","last_fullsized":"2024-04-18T04:55:28.452012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4874,"log_dups_size":0,"ondisk_log_size":4874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:48.827970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159388668,"num_objects":42,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":72197,"num_write_kb":1012843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"32'88","reported_seq":116,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:20.710432+0000","last_change":"2024-04-18T04:44:29.903118+0000","last_active":"2024-04-18T04:55:20.710432+0000","last_peered":"2024-04-18T04:55:20.710432+0000","last_clean":"2024-04-18T04:55:20.710432+0000","last_became_active":"2024-04-18T04:44:29.902611+0000","last_became_peered":"2024-04-18T04:44:29.902611+0000","last_unstale":"2024-04-18T04:55:20.710432+0000","last_undegraded":"2024-04-18T04:55:20.710432+0000","last_fullsized":"2024-04-18T04:55:20.710432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:38:42.595095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":87,"num_write_kb":1391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"28'15","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.060272+0000","last_change":"2024-04-18T04:44:30.301328+0000","last_active":"2024-04-18T04:53:26.060272+0000","last_peered":"2024-04-18T04:53:26.060272+0000","last_clean":"2024-04-18T04:53:26.060272+0000","last_became_active":"2024-04-18T04:44:30.300303+0000","last_became_peered":"2024-04-18T04:44:30.300303+0000","last_unstale":"2024-04-18T04:53:26.060272+0000","last_undegraded":"2024-04-18T04:53:26.060272+0000","last_fullsized":"2024-04-18T04:53:26.060272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:24:11.941483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'4539","reported_seq":4567,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:28.022376+0000","last_change":"2024-04-18T04:44:34.327044+0000","last_active":"2024-04-18T04:55:28.022376+0000","last_peered":"2024-04-18T04:55:28.022376+0000","last_clean":"2024-04-18T04:55:28.022376+0000","last_became_active":"2024-04-18T04:44:34.326161+0000","last_became_peered":"2024-04-18T04:44:34.326161+0000","last_unstale":"2024-04-18T04:55:28.022376+0000","last_undegraded":"2024-04-18T04:55:28.022376+0000","last_fullsized":"2024-04-18T04:55:28.022376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:47:41.413530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130065996,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":5,"num_read_kb":1,"num_write":67008,"num_write_kb":936790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"32'6","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:22.738989+0000","last_change":"2024-04-18T04:44:30.296493+0000","last_active":"2024-04-18T04:55:22.738989+0000","last_peered":"2024-04-18T04:55:22.738989+0000","last_clean":"2024-04-18T04:55:22.738989+0000","last_became_active":"2024-04-18T04:44:30.295657+0000","last_became_peered":"2024-04-18T04:44:30.295657+0000","last_unstale":"2024-04-18T04:55:22.738989+0000","last_undegraded":"2024-04-18T04:55:22.738989+0000","last_fullsized":"2024-04-18T04:55:22.738989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:39:40.270643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"32'980","reported_seq":1012,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:09.820948+0000","last_change":"2024-04-18T04:44:29.900036+0000","last_active":"2024-04-18T04:55:09.820948+0000","last_peered":"2024-04-18T04:55:09.820948+0000","last_clean":"2024-04-18T04:55:09.820948+0000","last_became_active":"2024-04-18T04:44:29.899402+0000","last_became_peered":"2024-04-18T04:44:29.899402+0000","last_unstale":"2024-04-18T04:55:09.820948+0000","last_undegraded":"2024-04-18T04:55:09.820948+0000","last_fullsized":"2024-04-18T04:55:09.820948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":980,"log_dups_size":0,"ondisk_log_size":980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:45:51.681317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":4110,"num_write":977,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"32'4744","reported_seq":4772,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:28.550428+0000","last_change":"2024-04-18T04:44:34.320846+0000","last_active":"2024-04-18T04:55:28.550428+0000","last_peered":"2024-04-18T04:55:28.550428+0000","last_clean":"2024-04-18T04:55:28.550428+0000","last_became_active":"2024-04-18T04:44:34.319868+0000","last_became_peered":"2024-04-18T04:44:34.319868+0000","last_unstale":"2024-04-18T04:55:28.550428+0000","last_undegraded":"2024-04-18T04:55:28.550428+0000","last_fullsized":"2024-04-18T04:55:28.550428+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4744,"log_dups_size":0,"ondisk_log_size":4744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:08:30.863140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117447486,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":69853,"num_write_kb":985071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"32'5","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:13.500608+0000","last_change":"2024-04-18T04:44:30.271756+0000","last_active":"2024-04-18T04:55:13.500608+0000","last_peered":"2024-04-18T04:55:13.500608+0000","last_clean":"2024-04-18T04:55:13.500608+0000","last_became_active":"2024-04-18T04:44:30.271420+0000","last_became_peered":"2024-04-18T04:44:30.271420+0000","last_unstale":"2024-04-18T04:55:13.500608+0000","last_undegraded":"2024-04-18T04:55:13.500608+0000","last_fullsized":"2024-04-18T04:55:13.500608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:27:18.559327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"32'5","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:31.068025+0000","last_change":"2024-04-18T04:44:29.878416+0000","last_active":"2024-04-18T04:53:31.068025+0000","last_peered":"2024-04-18T04:53:31.068025+0000","last_clean":"2024-04-18T04:53:31.068025+0000","last_became_active":"2024-04-18T04:44:29.878139+0000","last_became_peered":"2024-04-18T04:44:29.878139+0000","last_unstale":"2024-04-18T04:53:31.068025+0000","last_undegraded":"2024-04-18T04:53:31.068025+0000","last_fullsized":"2024-04-18T04:53:31.068025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:19:00.769888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"32'4608","reported_seq":4633,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:28.604318+0000","last_change":"2024-04-18T04:44:34.346123+0000","last_active":"2024-04-18T04:55:28.604318+0000","last_peered":"2024-04-18T04:55:28.604318+0000","last_clean":"2024-04-18T04:55:28.604318+0000","last_became_active":"2024-04-18T04:44:34.345267+0000","last_became_peered":"2024-04-18T04:44:34.345267+0000","last_unstale":"2024-04-18T04:55:28.604318+0000","last_undegraded":"2024-04-18T04:55:28.604318+0000","last_fullsized":"2024-04-18T04:55:28.604318+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4608,"log_dups_size":0,"ondisk_log_size":4608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:14:08.078650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159396693,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":68092,"num_write_kb":992962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"32'7","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:21.521015+0000","last_change":"2024-04-18T04:44:30.274049+0000","last_active":"2024-04-18T04:55:21.521015+0000","last_peered":"2024-04-18T04:55:21.521015+0000","last_clean":"2024-04-18T04:55:21.521015+0000","last_became_active":"2024-04-18T04:44:30.273752+0000","last_became_peered":"2024-04-18T04:44:30.273752+0000","last_unstale":"2024-04-18T04:55:21.521015+0000","last_undegraded":"2024-04-18T04:55:21.521015+0000","last_fullsized":"2024-04-18T04:55:21.521015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:48:20.479069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'6","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:24.359306+0000","last_change":"2024-04-18T04:44:29.890569+0000","last_active":"2024-04-18T04:54:24.359306+0000","last_peered":"2024-04-18T04:54:24.359306+0000","last_clean":"2024-04-18T04:54:24.359306+0000","last_became_active":"2024-04-18T04:44:29.889684+0000","last_became_peered":"2024-04-18T04:44:29.889684+0000","last_unstale":"2024-04-18T04:54:24.359306+0000","last_undegraded":"2024-04-18T04:54:24.359306+0000","last_fullsized":"2024-04-18T04:54:24.359306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:53:00.230580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":8,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"32'4582","reported_seq":4607,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.596649+0000","last_change":"2024-04-18T04:44:34.313634+0000","last_active":"2024-04-18T04:55:26.596649+0000","last_peered":"2024-04-18T04:55:26.596649+0000","last_clean":"2024-04-18T04:55:26.596649+0000","last_became_active":"2024-04-18T04:44:34.313161+0000","last_became_peered":"2024-04-18T04:44:34.313161+0000","last_unstale":"2024-04-18T04:55:26.596649+0000","last_undegraded":"2024-04-18T04:55:26.596649+0000","last_fullsized":"2024-04-18T04:55:26.596649+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4582,"log_dups_size":0,"ondisk_log_size":4582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:01:07.805128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142611640,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":67645,"num_write_kb":962979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'1","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.071440+0000","last_change":"2024-04-18T04:44:30.284805+0000","last_active":"2024-04-18T04:53:26.071440+0000","last_peered":"2024-04-18T04:53:26.071440+0000","last_clean":"2024-04-18T04:53:26.071440+0000","last_became_active":"2024-04-18T04:44:30.279238+0000","last_became_peered":"2024-04-18T04:44:30.279238+0000","last_unstale":"2024-04-18T04:53:26.071440+0000","last_undegraded":"2024-04-18T04:53:26.071440+0000","last_fullsized":"2024-04-18T04:53:26.071440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:59:24.067420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"30'20","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:24.361610+0000","last_change":"2024-04-18T04:44:29.890816+0000","last_active":"2024-04-18T04:54:24.361610+0000","last_peered":"2024-04-18T04:54:24.361610+0000","last_clean":"2024-04-18T04:54:24.361610+0000","last_became_active":"2024-04-18T04:44:29.890272+0000","last_became_peered":"2024-04-18T04:44:29.890272+0000","last_unstale":"2024-04-18T04:54:24.361610+0000","last_undegraded":"2024-04-18T04:54:24.361610+0000","last_fullsized":"2024-04-18T04:54:24.361610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:30:22.614083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":4108,"num_write":18,"num_write_kb":4103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"32'4381","reported_seq":4406,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:28.643942+0000","last_change":"2024-04-18T04:44:34.344973+0000","last_active":"2024-04-18T04:55:28.643942+0000","last_peered":"2024-04-18T04:55:28.643942+0000","last_clean":"2024-04-18T04:55:28.643942+0000","last_became_active":"2024-04-18T04:44:34.344007+0000","last_became_peered":"2024-04-18T04:44:34.344007+0000","last_unstale":"2024-04-18T04:55:28.643942+0000","last_undegraded":"2024-04-18T04:55:28.643942+0000","last_fullsized":"2024-04-18T04:55:28.643942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4381,"log_dups_size":0,"ondisk_log_size":4381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:56:43.476132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147054500,"num_objects":43,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":64546,"num_write_kb":921811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"32'9","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:23.252520+0000","last_change":"2024-04-18T04:44:30.278193+0000","last_active":"2024-04-18T04:55:23.252520+0000","last_peered":"2024-04-18T04:55:23.252520+0000","last_clean":"2024-04-18T04:55:23.252520+0000","last_became_active":"2024-04-18T04:44:30.277916+0000","last_became_peered":"2024-04-18T04:44:30.277916+0000","last_unstale":"2024-04-18T04:55:23.252520+0000","last_undegraded":"2024-04-18T04:55:23.252520+0000","last_fullsized":"2024-04-18T04:55:23.252520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:57:19.783436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:23.867186+0000","last_change":"2024-04-18T04:44:29.896901+0000","last_active":"2024-04-18T04:54:23.867186+0000","last_peered":"2024-04-18T04:54:23.867186+0000","last_clean":"2024-04-18T04:54:23.867186+0000","last_became_active":"2024-04-18T04:44:29.896392+0000","last_became_peered":"2024-04-18T04:44:29.896392+0000","last_unstale":"2024-04-18T04:54:23.867186+0000","last_undegraded":"2024-04-18T04:54:23.867186+0000","last_fullsized":"2024-04-18T04:54:23.867186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:46:08.869450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"32'4430","reported_seq":4455,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:28.701482+0000","last_change":"2024-04-18T04:44:34.339233+0000","last_active":"2024-04-18T04:55:28.701482+0000","last_peered":"2024-04-18T04:55:28.701482+0000","last_clean":"2024-04-18T04:55:28.701482+0000","last_became_active":"2024-04-18T04:44:34.338294+0000","last_became_peered":"2024-04-18T04:44:34.338294+0000","last_unstale":"2024-04-18T04:55:28.701482+0000","last_undegraded":"2024-04-18T04:55:28.701482+0000","last_fullsized":"2024-04-18T04:55:28.701482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4430,"log_dups_size":0,"ondisk_log_size":4430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:20:35.738410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134369960,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":65531,"num_write_kb":938881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:11.458790+0000","last_change":"2024-04-18T04:45:12.045887+0000","last_active":"2024-04-18T04:55:11.458790+0000","last_peered":"2024-04-18T04:55:11.458790+0000","last_clean":"2024-04-18T04:55:11.458790+0000","last_became_active":"2024-04-18T04:45:12.045671+0000","last_became_peered":"2024-04-18T04:45:12.045671+0000","last_unstale":"2024-04-18T04:55:11.458790+0000","last_undegraded":"2024-04-18T04:55:11.458790+0000","last_fullsized":"2024-04-18T04:55:11.458790+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:22:58.022926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"32'98","reported_seq":129,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:19.758343+0000","last_change":"2024-04-18T04:44:29.894503+0000","last_active":"2024-04-18T04:55:19.758343+0000","last_peered":"2024-04-18T04:55:19.758343+0000","last_clean":"2024-04-18T04:55:19.758343+0000","last_became_active":"2024-04-18T04:44:29.894210+0000","last_became_peered":"2024-04-18T04:44:29.894210+0000","last_unstale":"2024-04-18T04:55:19.758343+0000","last_undegraded":"2024-04-18T04:55:19.758343+0000","last_fullsized":"2024-04-18T04:55:19.758343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:14:56.979204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":22,"num_write":222,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"32'4801","reported_seq":4830,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.490311+0000","last_change":"2024-04-18T04:44:34.305652+0000","last_active":"2024-04-18T04:55:26.490311+0000","last_peered":"2024-04-18T04:55:26.490311+0000","last_clean":"2024-04-18T04:55:26.490311+0000","last_became_active":"2024-04-18T04:44:34.305180+0000","last_became_peered":"2024-04-18T04:44:34.305180+0000","last_unstale":"2024-04-18T04:55:26.490311+0000","last_undegraded":"2024-04-18T04:55:26.490311+0000","last_fullsized":"2024-04-18T04:55:26.490311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4801,"log_dups_size":0,"ondisk_log_size":4801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:03:10.781821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171985668,"num_objects":47,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":70738,"num_write_kb":998644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'9","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.152733+0000","last_change":"2024-04-18T04:44:30.267158+0000","last_active":"2024-04-18T04:53:26.152733+0000","last_peered":"2024-04-18T04:53:26.152733+0000","last_clean":"2024-04-18T04:53:26.152733+0000","last_became_active":"2024-04-18T04:44:30.266814+0000","last_became_peered":"2024-04-18T04:44:30.266814+0000","last_unstale":"2024-04-18T04:53:26.152733+0000","last_undegraded":"2024-04-18T04:53:26.152733+0000","last_fullsized":"2024-04-18T04:53:26.152733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:16:02.152817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'4","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:31.064330+0000","last_change":"2024-04-18T04:44:29.898812+0000","last_active":"2024-04-18T04:53:31.064330+0000","last_peered":"2024-04-18T04:53:31.064330+0000","last_clean":"2024-04-18T04:53:31.064330+0000","last_became_active":"2024-04-18T04:44:29.897156+0000","last_became_peered":"2024-04-18T04:44:29.897156+0000","last_unstale":"2024-04-18T04:53:31.064330+0000","last_undegraded":"2024-04-18T04:53:31.064330+0000","last_fullsized":"2024-04-18T04:53:31.064330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:09:47.746394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":7,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"32'4341","reported_seq":4368,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.085562+0000","last_change":"2024-04-18T04:44:34.324721+0000","last_active":"2024-04-18T04:55:26.085562+0000","last_peered":"2024-04-18T04:55:26.085562+0000","last_clean":"2024-04-18T04:55:26.085562+0000","last_became_active":"2024-04-18T04:44:34.322925+0000","last_became_peered":"2024-04-18T04:44:34.322925+0000","last_unstale":"2024-04-18T04:55:26.085562+0000","last_undegraded":"2024-04-18T04:55:26.085562+0000","last_fullsized":"2024-04-18T04:55:26.085562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4341,"log_dups_size":0,"ondisk_log_size":4341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:11:59.682230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146853901,"num_objects":39,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":64187,"num_write_kb":906867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"32'6","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:15.171307+0000","last_change":"2024-04-18T04:44:30.281640+0000","last_active":"2024-04-18T04:55:15.171307+0000","last_peered":"2024-04-18T04:55:15.171307+0000","last_clean":"2024-04-18T04:55:15.171307+0000","last_became_active":"2024-04-18T04:44:30.280968+0000","last_became_peered":"2024-04-18T04:44:30.280968+0000","last_unstale":"2024-04-18T04:55:15.171307+0000","last_undegraded":"2024-04-18T04:55:15.171307+0000","last_fullsized":"2024-04-18T04:55:15.171307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:35:20.755711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"28'1","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.152863+0000","last_change":"2024-04-18T04:44:29.882715+0000","last_active":"2024-04-18T04:53:26.152863+0000","last_peered":"2024-04-18T04:53:26.152863+0000","last_clean":"2024-04-18T04:53:26.152863+0000","last_became_active":"2024-04-18T04:44:29.882335+0000","last_became_peered":"2024-04-18T04:44:29.882335+0000","last_unstale":"2024-04-18T04:53:26.152863+0000","last_undegraded":"2024-04-18T04:53:26.152863+0000","last_fullsized":"2024-04-18T04:53:26.152863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:32:59.709151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4605","reported_seq":4634,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.574135+0000","last_change":"2024-04-18T04:44:34.325029+0000","last_active":"2024-04-18T04:55:26.574135+0000","last_peered":"2024-04-18T04:55:26.574135+0000","last_clean":"2024-04-18T04:55:26.574135+0000","last_became_active":"2024-04-18T04:44:34.324082+0000","last_became_peered":"2024-04-18T04:44:34.324082+0000","last_unstale":"2024-04-18T04:55:26.574135+0000","last_undegraded":"2024-04-18T04:55:26.574135+0000","last_fullsized":"2024-04-18T04:55:26.574135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4605,"log_dups_size":0,"ondisk_log_size":4605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:28:10.378037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125853714,"num_objects":35,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":67945,"num_write_kb":954001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"32'8","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:24.111261+0000","last_change":"2024-04-18T04:44:30.276174+0000","last_active":"2024-04-18T04:55:24.111261+0000","last_peered":"2024-04-18T04:55:24.111261+0000","last_clean":"2024-04-18T04:55:24.111261+0000","last_became_active":"2024-04-18T04:44:30.270878+0000","last_became_peered":"2024-04-18T04:44:30.270878+0000","last_unstale":"2024-04-18T04:55:24.111261+0000","last_undegraded":"2024-04-18T04:55:24.111261+0000","last_fullsized":"2024-04-18T04:55:24.111261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:35:12.296277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"30'27","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.060101+0000","last_change":"2024-04-18T04:44:29.896745+0000","last_active":"2024-04-18T04:53:26.060101+0000","last_peered":"2024-04-18T04:53:26.060101+0000","last_clean":"2024-04-18T04:53:26.060101+0000","last_became_active":"2024-04-18T04:44:29.896199+0000","last_became_peered":"2024-04-18T04:44:29.896199+0000","last_unstale":"2024-04-18T04:53:26.060101+0000","last_undegraded":"2024-04-18T04:53:26.060101+0000","last_fullsized":"2024-04-18T04:53:26.060101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:25:05.424668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":22,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"32'5211","reported_seq":5239,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:27.144302+0000","last_change":"2024-04-18T04:44:34.337429+0000","last_active":"2024-04-18T04:55:27.144302+0000","last_peered":"2024-04-18T04:55:27.144302+0000","last_clean":"2024-04-18T04:55:27.144302+0000","last_became_active":"2024-04-18T04:44:34.337089+0000","last_became_peered":"2024-04-18T04:44:34.337089+0000","last_unstale":"2024-04-18T04:55:27.144302+0000","last_undegraded":"2024-04-18T04:55:27.144302+0000","last_fullsized":"2024-04-18T04:55:27.144302+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":5211,"log_dups_size":0,"ondisk_log_size":5211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:00:56.976431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159418516,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":76822,"num_write_kb":1090506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"32'9","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:37.740338+0000","last_change":"2024-04-18T04:44:30.270874+0000","last_active":"2024-04-18T04:54:37.740338+0000","last_peered":"2024-04-18T04:54:37.740338+0000","last_clean":"2024-04-18T04:54:37.740338+0000","last_became_active":"2024-04-18T04:44:30.270636+0000","last_became_peered":"2024-04-18T04:44:30.270636+0000","last_unstale":"2024-04-18T04:54:37.740338+0000","last_undegraded":"2024-04-18T04:54:37.740338+0000","last_fullsized":"2024-04-18T04:54:37.740338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:25:49.889554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"32'42","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:17.017144+0000","last_change":"2024-04-18T04:44:29.878607+0000","last_active":"2024-04-18T04:55:17.017144+0000","last_peered":"2024-04-18T04:55:17.017144+0000","last_clean":"2024-04-18T04:55:17.017144+0000","last_became_active":"2024-04-18T04:44:29.878330+0000","last_became_peered":"2024-04-18T04:44:29.878330+0000","last_unstale":"2024-04-18T04:55:17.017144+0000","last_undegraded":"2024-04-18T04:55:17.017144+0000","last_fullsized":"2024-04-18T04:55:17.017144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:09:18.088701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90443,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":42,"num_read_kb":118,"num_write":37,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'4379","reported_seq":4405,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:28.025953+0000","last_change":"2024-04-18T04:44:34.323315+0000","last_active":"2024-04-18T04:55:28.025953+0000","last_peered":"2024-04-18T04:55:28.025953+0000","last_clean":"2024-04-18T04:55:28.025953+0000","last_became_active":"2024-04-18T04:44:34.322983+0000","last_became_peered":"2024-04-18T04:44:34.322983+0000","last_unstale":"2024-04-18T04:55:28.025953+0000","last_undegraded":"2024-04-18T04:55:28.025953+0000","last_fullsized":"2024-04-18T04:55:28.025953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4379,"log_dups_size":0,"ondisk_log_size":4379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:48:12.803273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142628390,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":64665,"num_write_kb":914612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"27'2","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.052645+0000","last_change":"2024-04-18T04:44:30.285533+0000","last_active":"2024-04-18T04:53:26.052645+0000","last_peered":"2024-04-18T04:53:26.052645+0000","last_clean":"2024-04-18T04:53:26.052645+0000","last_became_active":"2024-04-18T04:44:30.285113+0000","last_became_peered":"2024-04-18T04:44:30.285113+0000","last_unstale":"2024-04-18T04:53:26.052645+0000","last_undegraded":"2024-04-18T04:53:26.052645+0000","last_fullsized":"2024-04-18T04:53:26.052645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:37:20.367349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"32'29","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:35.068171+0000","last_change":"2024-04-18T04:44:29.890701+0000","last_active":"2024-04-18T04:53:35.068171+0000","last_peered":"2024-04-18T04:53:35.068171+0000","last_clean":"2024-04-18T04:53:35.068171+0000","last_became_active":"2024-04-18T04:44:29.890207+0000","last_became_peered":"2024-04-18T04:44:29.890207+0000","last_unstale":"2024-04-18T04:53:35.068171+0000","last_undegraded":"2024-04-18T04:53:35.068171+0000","last_fullsized":"2024-04-18T04:53:35.068171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:06:58.470725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":8204,"num_write":25,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"32'5213","reported_seq":5250,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.130337+0000","last_change":"2024-04-18T04:45:12.378646+0000","last_active":"2024-04-18T04:55:26.130337+0000","last_peered":"2024-04-18T04:55:26.130337+0000","last_clean":"2024-04-18T04:55:26.130337+0000","last_became_active":"2024-04-18T04:45:12.378263+0000","last_became_peered":"2024-04-18T04:45:12.378263+0000","last_unstale":"2024-04-18T04:55:26.130337+0000","last_undegraded":"2024-04-18T04:55:26.130337+0000","last_fullsized":"2024-04-18T04:55:26.130337+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":5213,"log_dups_size":0,"ondisk_log_size":5213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:59:31.439452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188934285,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":76573,"num_write_kb":1101398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"32'9","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:51.197830+0000","last_change":"2024-04-18T04:44:30.306826+0000","last_active":"2024-04-18T04:54:51.197830+0000","last_peered":"2024-04-18T04:54:51.197830+0000","last_clean":"2024-04-18T04:54:51.197830+0000","last_became_active":"2024-04-18T04:44:30.306320+0000","last_became_peered":"2024-04-18T04:44:30.306320+0000","last_unstale":"2024-04-18T04:54:51.197830+0000","last_undegraded":"2024-04-18T04:54:51.197830+0000","last_fullsized":"2024-04-18T04:54:51.197830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:47:38.564197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"25'3","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:23.242696+0000","last_change":"2024-04-18T04:44:29.888023+0000","last_active":"2024-04-18T04:54:23.242696+0000","last_peered":"2024-04-18T04:54:23.242696+0000","last_clean":"2024-04-18T04:54:23.242696+0000","last_became_active":"2024-04-18T04:44:29.887440+0000","last_became_peered":"2024-04-18T04:44:29.887440+0000","last_unstale":"2024-04-18T04:54:23.242696+0000","last_undegraded":"2024-04-18T04:54:23.242696+0000","last_fullsized":"2024-04-18T04:54:23.242696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:07:01.067445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":20,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":180,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.040633+0000","last_change":"2024-04-18T04:44:18.629794+0000","last_active":"2024-04-18T04:53:26.040633+0000","last_peered":"2024-04-18T04:53:26.040633+0000","last_clean":"2024-04-18T04:53:26.040633+0000","last_became_active":"2024-04-18T04:44:18.627792+0000","last_became_peered":"2024-04-18T04:44:18.627792+0000","last_unstale":"2024-04-18T04:53:26.040633+0000","last_undegraded":"2024-04-18T04:53:26.040633+0000","last_fullsized":"2024-04-18T04:53:26.040633+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:17.410146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:17.410146+0000","last_clean_scrub_stamp":"2024-04-18T04:44:17.410146+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:30:49.101656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"32'4220","reported_seq":4245,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:28.528663+0000","last_change":"2024-04-18T04:44:34.333286+0000","last_active":"2024-04-18T04:55:28.528663+0000","last_peered":"2024-04-18T04:55:28.528663+0000","last_clean":"2024-04-18T04:55:28.528663+0000","last_became_active":"2024-04-18T04:44:34.332520+0000","last_became_peered":"2024-04-18T04:44:34.332520+0000","last_unstale":"2024-04-18T04:55:28.528663+0000","last_undegraded":"2024-04-18T04:55:28.528663+0000","last_fullsized":"2024-04-18T04:55:28.528663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4220,"log_dups_size":0,"ondisk_log_size":4220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:58:48.264040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113263486,"num_objects":32,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":62342,"num_write_kb":880557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"32'6","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:23.472187+0000","last_change":"2024-04-18T04:44:30.303602+0000","last_active":"2024-04-18T04:55:23.472187+0000","last_peered":"2024-04-18T04:55:23.472187+0000","last_clean":"2024-04-18T04:55:23.472187+0000","last_became_active":"2024-04-18T04:44:30.302157+0000","last_became_peered":"2024-04-18T04:44:30.302157+0000","last_unstale":"2024-04-18T04:55:23.472187+0000","last_undegraded":"2024-04-18T04:55:23.472187+0000","last_fullsized":"2024-04-18T04:55:23.472187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:09:57.582065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"32'6","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:35.662461+0000","last_change":"2024-04-18T04:44:29.890428+0000","last_active":"2024-04-18T04:53:35.662461+0000","last_peered":"2024-04-18T04:53:35.662461+0000","last_clean":"2024-04-18T04:53:35.662461+0000","last_became_active":"2024-04-18T04:44:29.890166+0000","last_became_peered":"2024-04-18T04:44:29.890166+0000","last_unstale":"2024-04-18T04:53:35.662461+0000","last_undegraded":"2024-04-18T04:53:35.662461+0000","last_fullsized":"2024-04-18T04:53:35.662461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:21:16.823377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":14,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"32'3624","reported_seq":3654,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:28.684335+0000","last_change":"2024-04-18T04:44:34.334071+0000","last_active":"2024-04-18T04:55:28.684335+0000","last_peered":"2024-04-18T04:55:28.684335+0000","last_clean":"2024-04-18T04:55:28.684335+0000","last_became_active":"2024-04-18T04:44:34.332695+0000","last_became_peered":"2024-04-18T04:44:34.332695+0000","last_unstale":"2024-04-18T04:55:28.684335+0000","last_undegraded":"2024-04-18T04:55:28.684335+0000","last_fullsized":"2024-04-18T04:55:28.684335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":3624,"log_dups_size":0,"ondisk_log_size":3624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:22:52.371921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100719055,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":53412,"num_write_kb":771461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'7","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.059834+0000","last_change":"2024-04-18T04:44:30.287908+0000","last_active":"2024-04-18T04:53:26.059834+0000","last_peered":"2024-04-18T04:53:26.059834+0000","last_clean":"2024-04-18T04:53:26.059834+0000","last_became_active":"2024-04-18T04:44:30.287217+0000","last_became_peered":"2024-04-18T04:44:30.287217+0000","last_unstale":"2024-04-18T04:53:26.059834+0000","last_undegraded":"2024-04-18T04:53:26.059834+0000","last_fullsized":"2024-04-18T04:53:26.059834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:47:14.962330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"30'24","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.057944+0000","last_change":"2024-04-18T04:44:29.886376+0000","last_active":"2024-04-18T04:53:26.057944+0000","last_peered":"2024-04-18T04:53:26.057944+0000","last_clean":"2024-04-18T04:53:26.057944+0000","last_became_active":"2024-04-18T04:44:29.886058+0000","last_became_peered":"2024-04-18T04:44:29.886058+0000","last_unstale":"2024-04-18T04:53:26.057944+0000","last_undegraded":"2024-04-18T04:53:26.057944+0000","last_fullsized":"2024-04-18T04:53:26.057944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:29:59.678071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":23,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"32'4528","reported_seq":4564,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.207971+0000","last_change":"2024-04-18T04:45:12.373987+0000","last_active":"2024-04-18T04:55:26.207971+0000","last_peered":"2024-04-18T04:55:26.207971+0000","last_clean":"2024-04-18T04:55:26.207971+0000","last_became_active":"2024-04-18T04:45:12.373269+0000","last_became_peered":"2024-04-18T04:45:12.373269+0000","last_unstale":"2024-04-18T04:55:26.207971+0000","last_undegraded":"2024-04-18T04:55:26.207971+0000","last_fullsized":"2024-04-18T04:55:26.207971+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4528,"log_dups_size":0,"ondisk_log_size":4528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:19:01.073786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155454305,"num_objects":45,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":66874,"num_write_kb":952859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"32'8","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:16.060876+0000","last_change":"2024-04-18T04:45:12.043098+0000","last_active":"2024-04-18T04:54:16.060876+0000","last_peered":"2024-04-18T04:54:16.060876+0000","last_clean":"2024-04-18T04:54:16.060876+0000","last_became_active":"2024-04-18T04:45:12.042803+0000","last_became_peered":"2024-04-18T04:45:12.042803+0000","last_unstale":"2024-04-18T04:54:16.060876+0000","last_undegraded":"2024-04-18T04:54:16.060876+0000","last_fullsized":"2024-04-18T04:54:16.060876+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:15:13.837607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"32'269","reported_seq":299,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:09.768555+0000","last_change":"2024-04-18T04:44:29.878650+0000","last_active":"2024-04-18T04:55:09.768555+0000","last_peered":"2024-04-18T04:55:09.768555+0000","last_clean":"2024-04-18T04:55:09.768555+0000","last_became_active":"2024-04-18T04:44:29.878361+0000","last_became_peered":"2024-04-18T04:44:29.878361+0000","last_unstale":"2024-04-18T04:55:09.768555+0000","last_undegraded":"2024-04-18T04:55:09.768555+0000","last_fullsized":"2024-04-18T04:55:09.768555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:57:41.162118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":678,"num_write":267,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"32'4376","reported_seq":4408,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:27.143593+0000","last_change":"2024-04-18T04:44:34.339023+0000","last_active":"2024-04-18T04:55:27.143593+0000","last_peered":"2024-04-18T04:55:27.143593+0000","last_clean":"2024-04-18T04:55:27.143593+0000","last_became_active":"2024-04-18T04:44:34.338042+0000","last_became_peered":"2024-04-18T04:44:34.338042+0000","last_unstale":"2024-04-18T04:55:27.143593+0000","last_undegraded":"2024-04-18T04:55:27.143593+0000","last_fullsized":"2024-04-18T04:55:27.143593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4376,"log_dups_size":0,"ondisk_log_size":4376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:48:58.174635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117535785,"num_objects":35,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":64576,"num_write_kb":926956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'4","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.041326+0000","last_change":"2024-04-18T04:44:30.291740+0000","last_active":"2024-04-18T04:53:26.041326+0000","last_peered":"2024-04-18T04:53:26.041326+0000","last_clean":"2024-04-18T04:53:26.041326+0000","last_became_active":"2024-04-18T04:44:30.290379+0000","last_became_peered":"2024-04-18T04:44:30.290379+0000","last_unstale":"2024-04-18T04:53:26.041326+0000","last_undegraded":"2024-04-18T04:53:26.041326+0000","last_fullsized":"2024-04-18T04:53:26.041326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:44:25.111858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"31'9","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.071265+0000","last_change":"2024-04-18T04:44:29.882833+0000","last_active":"2024-04-18T04:53:26.071265+0000","last_peered":"2024-04-18T04:53:26.071265+0000","last_clean":"2024-04-18T04:53:26.071265+0000","last_became_active":"2024-04-18T04:44:29.881671+0000","last_became_peered":"2024-04-18T04:44:29.881671+0000","last_unstale":"2024-04-18T04:53:26.071265+0000","last_undegraded":"2024-04-18T04:53:26.071265+0000","last_fullsized":"2024-04-18T04:53:26.071265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:29:22.037641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"32'4089","reported_seq":4122,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:28.286106+0000","last_change":"2024-04-18T04:44:34.342465+0000","last_active":"2024-04-18T04:55:28.286106+0000","last_peered":"2024-04-18T04:55:28.286106+0000","last_clean":"2024-04-18T04:55:28.286106+0000","last_became_active":"2024-04-18T04:44:34.340327+0000","last_became_peered":"2024-04-18T04:44:34.340327+0000","last_unstale":"2024-04-18T04:55:28.286106+0000","last_undegraded":"2024-04-18T04:55:28.286106+0000","last_fullsized":"2024-04-18T04:55:28.286106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4089,"log_dups_size":0,"ondisk_log_size":4089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:31:44.168899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109063355,"num_objects":32,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":60228,"num_write_kb":847949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"32'8","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:16.049759+0000","last_change":"2024-04-18T04:44:30.299403+0000","last_active":"2024-04-18T04:55:16.049759+0000","last_peered":"2024-04-18T04:55:16.049759+0000","last_clean":"2024-04-18T04:55:16.049759+0000","last_became_active":"2024-04-18T04:44:30.298417+0000","last_became_peered":"2024-04-18T04:44:30.298417+0000","last_unstale":"2024-04-18T04:55:16.049759+0000","last_undegraded":"2024-04-18T04:55:16.049759+0000","last_fullsized":"2024-04-18T04:55:16.049759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:43:24.120294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"30'18","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:23.250796+0000","last_change":"2024-04-18T04:44:29.875345+0000","last_active":"2024-04-18T04:54:23.250796+0000","last_peered":"2024-04-18T04:54:23.250796+0000","last_clean":"2024-04-18T04:54:23.250796+0000","last_became_active":"2024-04-18T04:44:29.875059+0000","last_became_peered":"2024-04-18T04:44:29.875059+0000","last_unstale":"2024-04-18T04:54:23.250796+0000","last_undegraded":"2024-04-18T04:54:23.250796+0000","last_fullsized":"2024-04-18T04:54:23.250796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:06:54.218096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":44,"num_read_kb":43,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"32'5049","reported_seq":5076,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.206877+0000","last_change":"2024-04-18T04:44:34.334498+0000","last_active":"2024-04-18T04:55:26.206877+0000","last_peered":"2024-04-18T04:55:26.206877+0000","last_clean":"2024-04-18T04:55:26.206877+0000","last_became_active":"2024-04-18T04:44:34.334192+0000","last_became_peered":"2024-04-18T04:44:34.334192+0000","last_unstale":"2024-04-18T04:55:26.206877+0000","last_undegraded":"2024-04-18T04:55:26.206877+0000","last_fullsized":"2024-04-18T04:55:26.206877+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":5049,"log_dups_size":0,"ondisk_log_size":5049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:15:49.669556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176506941,"num_objects":56,"num_object_clones":0,"num_object_copies":224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":74352,"num_write_kb":1061210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'6","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.072591+0000","last_change":"2024-04-18T04:44:30.298289+0000","last_active":"2024-04-18T04:53:26.072591+0000","last_peered":"2024-04-18T04:53:26.072591+0000","last_clean":"2024-04-18T04:53:26.072591+0000","last_became_active":"2024-04-18T04:44:30.295404+0000","last_became_peered":"2024-04-18T04:44:30.295404+0000","last_unstale":"2024-04-18T04:53:26.072591+0000","last_undegraded":"2024-04-18T04:53:26.072591+0000","last_fullsized":"2024-04-18T04:53:26.072591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:10:32.465032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"30'12","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.072652+0000","last_change":"2024-04-18T04:44:29.894196+0000","last_active":"2024-04-18T04:53:26.072652+0000","last_peered":"2024-04-18T04:53:26.072652+0000","last_clean":"2024-04-18T04:53:26.072652+0000","last_became_active":"2024-04-18T04:44:29.893668+0000","last_became_peered":"2024-04-18T04:44:29.893668+0000","last_unstale":"2024-04-18T04:53:26.072652+0000","last_undegraded":"2024-04-18T04:53:26.072652+0000","last_fullsized":"2024-04-18T04:53:26.072652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:39:03.812043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1711,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":11,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"32'5154","reported_seq":5191,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.412455+0000","last_change":"2024-04-18T04:45:12.057192+0000","last_active":"2024-04-18T04:55:26.412455+0000","last_peered":"2024-04-18T04:55:26.412455+0000","last_clean":"2024-04-18T04:55:26.412455+0000","last_became_active":"2024-04-18T04:45:12.056680+0000","last_became_peered":"2024-04-18T04:45:12.056680+0000","last_unstale":"2024-04-18T04:55:26.412455+0000","last_undegraded":"2024-04-18T04:55:26.412455+0000","last_fullsized":"2024-04-18T04:55:26.412455+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":5154,"log_dups_size":0,"ondisk_log_size":5154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:48:07.893811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155198053,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":76078,"num_write_kb":1080690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'19","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:20.352066+0000","last_change":"2024-04-18T04:44:30.289122+0000","last_active":"2024-04-18T04:55:20.352066+0000","last_peered":"2024-04-18T04:55:20.352066+0000","last_clean":"2024-04-18T04:55:20.352066+0000","last_became_active":"2024-04-18T04:44:30.288364+0000","last_became_peered":"2024-04-18T04:44:30.288364+0000","last_unstale":"2024-04-18T04:55:20.352066+0000","last_undegraded":"2024-04-18T04:55:20.352066+0000","last_fullsized":"2024-04-18T04:55:20.352066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:04:02.162723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"32'6","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:23.255678+0000","last_change":"2024-04-18T04:44:29.894521+0000","last_active":"2024-04-18T04:54:23.255678+0000","last_peered":"2024-04-18T04:54:23.255678+0000","last_clean":"2024-04-18T04:54:23.255678+0000","last_became_active":"2024-04-18T04:44:29.889150+0000","last_became_peered":"2024-04-18T04:44:29.889150+0000","last_unstale":"2024-04-18T04:54:23.255678+0000","last_undegraded":"2024-04-18T04:54:23.255678+0000","last_fullsized":"2024-04-18T04:54:23.255678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:39:13.323434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'4511","reported_seq":4540,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.478346+0000","last_change":"2024-04-18T04:44:34.305657+0000","last_active":"2024-04-18T04:55:26.478346+0000","last_peered":"2024-04-18T04:55:26.478346+0000","last_clean":"2024-04-18T04:55:26.478346+0000","last_became_active":"2024-04-18T04:44:34.305341+0000","last_became_peered":"2024-04-18T04:44:34.305341+0000","last_unstale":"2024-04-18T04:55:26.478346+0000","last_undegraded":"2024-04-18T04:55:26.478346+0000","last_fullsized":"2024-04-18T04:55:26.478346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4511,"log_dups_size":0,"ondisk_log_size":4511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:32:39.937173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134316344,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":66695,"num_write_kb":961503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'6","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.055595+0000","last_change":"2024-04-18T04:44:30.307042+0000","last_active":"2024-04-18T04:53:26.055595+0000","last_peered":"2024-04-18T04:53:26.055595+0000","last_clean":"2024-04-18T04:53:26.055595+0000","last_became_active":"2024-04-18T04:44:30.306726+0000","last_became_peered":"2024-04-18T04:44:30.306726+0000","last_unstale":"2024-04-18T04:53:26.055595+0000","last_undegraded":"2024-04-18T04:53:26.055595+0000","last_fullsized":"2024-04-18T04:53:26.055595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:55:33.543142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"30'34","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:23.851102+0000","last_change":"2024-04-18T04:44:29.887498+0000","last_active":"2024-04-18T04:54:23.851102+0000","last_peered":"2024-04-18T04:54:23.851102+0000","last_clean":"2024-04-18T04:54:23.851102+0000","last_became_active":"2024-04-18T04:44:29.887095+0000","last_became_peered":"2024-04-18T04:44:29.887095+0000","last_unstale":"2024-04-18T04:54:23.851102+0000","last_undegraded":"2024-04-18T04:54:23.851102+0000","last_fullsized":"2024-04-18T04:54:23.851102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:54:34.700562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":31,"num_read_kb":8224,"num_write":33,"num_write_kb":8211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"32'4753","reported_seq":4780,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.447430+0000","last_change":"2024-04-18T04:44:34.322042+0000","last_active":"2024-04-18T04:55:26.447430+0000","last_peered":"2024-04-18T04:55:26.447430+0000","last_clean":"2024-04-18T04:55:26.447430+0000","last_became_active":"2024-04-18T04:44:34.320776+0000","last_became_peered":"2024-04-18T04:44:34.320776+0000","last_unstale":"2024-04-18T04:55:26.447430+0000","last_undegraded":"2024-04-18T04:55:26.447430+0000","last_fullsized":"2024-04-18T04:55:26.447430+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4753,"log_dups_size":0,"ondisk_log_size":4753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:53:47.399337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":70272,"num_write_kb":986201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"32'7","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:12.485852+0000","last_change":"2024-04-18T04:44:30.299413+0000","last_active":"2024-04-18T04:54:12.485852+0000","last_peered":"2024-04-18T04:54:12.485852+0000","last_clean":"2024-04-18T04:54:12.485852+0000","last_became_active":"2024-04-18T04:44:30.293185+0000","last_became_peered":"2024-04-18T04:44:30.293185+0000","last_unstale":"2024-04-18T04:54:12.485852+0000","last_undegraded":"2024-04-18T04:54:12.485852+0000","last_fullsized":"2024-04-18T04:54:12.485852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:43:53.831429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"32'227","reported_seq":261,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:11.183288+0000","last_change":"2024-04-18T04:44:29.893351+0000","last_active":"2024-04-18T04:55:11.183288+0000","last_peered":"2024-04-18T04:55:11.183288+0000","last_clean":"2024-04-18T04:55:11.183288+0000","last_became_active":"2024-04-18T04:44:29.892647+0000","last_became_peered":"2024-04-18T04:44:29.892647+0000","last_unstale":"2024-04-18T04:55:11.183288+0000","last_undegraded":"2024-04-18T04:55:11.183288+0000","last_fullsized":"2024-04-18T04:55:11.183288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:16:59.759149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":21,"num_read_kb":4116,"num_write":227,"num_write_kb":4214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"32'4351","reported_seq":4380,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:27.183407+0000","last_change":"2024-04-18T04:44:34.337866+0000","last_active":"2024-04-18T04:55:27.183407+0000","last_peered":"2024-04-18T04:55:27.183407+0000","last_clean":"2024-04-18T04:55:27.183407+0000","last_became_active":"2024-04-18T04:44:34.337486+0000","last_became_peered":"2024-04-18T04:44:34.337486+0000","last_unstale":"2024-04-18T04:55:27.183407+0000","last_undegraded":"2024-04-18T04:55:27.183407+0000","last_fullsized":"2024-04-18T04:55:27.183407+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4351,"log_dups_size":0,"ondisk_log_size":4351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:42:13.751926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151027841,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":6,"num_read_kb":1,"num_write":64269,"num_write_kb":903689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"32'8","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:13.017999+0000","last_change":"2024-04-18T04:44:30.308477+0000","last_active":"2024-04-18T04:55:13.017999+0000","last_peered":"2024-04-18T04:55:13.017999+0000","last_clean":"2024-04-18T04:55:13.017999+0000","last_became_active":"2024-04-18T04:44:30.307237+0000","last_became_peered":"2024-04-18T04:44:30.307237+0000","last_unstale":"2024-04-18T04:55:13.017999+0000","last_undegraded":"2024-04-18T04:55:13.017999+0000","last_fullsized":"2024-04-18T04:55:13.017999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:33:58.300542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"32'17","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:11.182386+0000","last_change":"2024-04-18T04:44:29.898488+0000","last_active":"2024-04-18T04:55:11.182386+0000","last_peered":"2024-04-18T04:55:11.182386+0000","last_clean":"2024-04-18T04:55:11.182386+0000","last_became_active":"2024-04-18T04:44:29.898113+0000","last_became_peered":"2024-04-18T04:44:29.898113+0000","last_unstale":"2024-04-18T04:55:11.182386+0000","last_undegraded":"2024-04-18T04:55:11.182386+0000","last_fullsized":"2024-04-18T04:55:11.182386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:11:14.585142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":18,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'5497","reported_seq":5524,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:28.605942+0000","last_change":"2024-04-18T04:44:34.344769+0000","last_active":"2024-04-18T04:55:28.605942+0000","last_peered":"2024-04-18T04:55:28.605942+0000","last_clean":"2024-04-18T04:55:28.605942+0000","last_became_active":"2024-04-18T04:44:34.343636+0000","last_became_peered":"2024-04-18T04:44:34.343636+0000","last_unstale":"2024-04-18T04:55:28.605942+0000","last_undegraded":"2024-04-18T04:55:28.605942+0000","last_fullsized":"2024-04-18T04:55:28.605942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":5497,"log_dups_size":0,"ondisk_log_size":5497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:45:09.481681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155395188,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":4,"num_read_kb":7,"num_write":80968,"num_write_kb":1156235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"28'9","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.054159+0000","last_change":"2024-04-18T04:44:30.290494+0000","last_active":"2024-04-18T04:53:26.054159+0000","last_peered":"2024-04-18T04:53:26.054159+0000","last_clean":"2024-04-18T04:53:26.054159+0000","last_became_active":"2024-04-18T04:44:30.290127+0000","last_became_peered":"2024-04-18T04:44:30.290127+0000","last_unstale":"2024-04-18T04:53:26.054159+0000","last_undegraded":"2024-04-18T04:53:26.054159+0000","last_fullsized":"2024-04-18T04:53:26.054159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:34:21.239813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'3","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:23.256537+0000","last_change":"2024-04-18T04:44:29.895686+0000","last_active":"2024-04-18T04:54:23.256537+0000","last_peered":"2024-04-18T04:54:23.256537+0000","last_clean":"2024-04-18T04:54:23.256537+0000","last_became_active":"2024-04-18T04:44:29.895083+0000","last_became_peered":"2024-04-18T04:44:29.895083+0000","last_unstale":"2024-04-18T04:54:23.256537+0000","last_undegraded":"2024-04-18T04:54:23.256537+0000","last_fullsized":"2024-04-18T04:54:23.256537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:27:17.897401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"32'4714","reported_seq":4742,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.504835+0000","last_change":"2024-04-18T04:44:34.338412+0000","last_active":"2024-04-18T04:55:26.504835+0000","last_peered":"2024-04-18T04:55:26.504835+0000","last_clean":"2024-04-18T04:55:26.504835+0000","last_became_active":"2024-04-18T04:44:34.338062+0000","last_became_peered":"2024-04-18T04:44:34.338062+0000","last_unstale":"2024-04-18T04:55:26.504835+0000","last_undegraded":"2024-04-18T04:55:26.504835+0000","last_fullsized":"2024-04-18T04:55:26.504835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4714,"log_dups_size":0,"ondisk_log_size":4714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:49:28.342905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146809673,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":69716,"num_write_kb":985522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"32'5","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:13.261662+0000","last_change":"2024-04-18T04:44:30.307946+0000","last_active":"2024-04-18T04:54:13.261662+0000","last_peered":"2024-04-18T04:54:13.261662+0000","last_clean":"2024-04-18T04:54:13.261662+0000","last_became_active":"2024-04-18T04:44:30.307168+0000","last_became_peered":"2024-04-18T04:44:30.307168+0000","last_unstale":"2024-04-18T04:54:13.261662+0000","last_undegraded":"2024-04-18T04:54:13.261662+0000","last_fullsized":"2024-04-18T04:54:13.261662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:43:56.218333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"32'9","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:11.183996+0000","last_change":"2024-04-18T04:44:29.903183+0000","last_active":"2024-04-18T04:55:11.183996+0000","last_peered":"2024-04-18T04:55:11.183996+0000","last_clean":"2024-04-18T04:55:11.183996+0000","last_became_active":"2024-04-18T04:44:29.902647+0000","last_became_peered":"2024-04-18T04:44:29.902647+0000","last_unstale":"2024-04-18T04:55:11.183996+0000","last_undegraded":"2024-04-18T04:55:11.183996+0000","last_fullsized":"2024-04-18T04:55:11.183996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:45:13.009571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"32'5912","reported_seq":5940,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.438465+0000","last_change":"2024-04-18T04:44:34.338653+0000","last_active":"2024-04-18T04:55:26.438465+0000","last_peered":"2024-04-18T04:55:26.438465+0000","last_clean":"2024-04-18T04:55:26.438465+0000","last_became_active":"2024-04-18T04:44:34.338288+0000","last_became_peered":"2024-04-18T04:44:34.338288+0000","last_unstale":"2024-04-18T04:55:26.438465+0000","last_undegraded":"2024-04-18T04:55:26.438465+0000","last_fullsized":"2024-04-18T04:55:26.438465+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":5912,"log_dups_size":0,"ondisk_log_size":5912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:58:27.654288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188767411,"num_objects":50,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":87637,"num_write_kb":1229683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"32'4038","reported_seq":4064,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:25.971766+0000","last_change":"2024-04-18T04:44:34.306999+0000","last_active":"2024-04-18T04:55:25.971766+0000","last_peered":"2024-04-18T04:55:25.971766+0000","last_clean":"2024-04-18T04:55:25.971766+0000","last_became_active":"2024-04-18T04:44:34.306657+0000","last_became_peered":"2024-04-18T04:44:34.306657+0000","last_unstale":"2024-04-18T04:55:25.971766+0000","last_undegraded":"2024-04-18T04:55:25.971766+0000","last_fullsized":"2024-04-18T04:55:25.971766+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4038,"log_dups_size":0,"ondisk_log_size":4038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:52:58.512928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134308908,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":59665,"num_write_kb":838973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'8","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:21.443487+0000","last_change":"2024-04-18T04:44:30.271947+0000","last_active":"2024-04-18T04:54:21.443487+0000","last_peered":"2024-04-18T04:54:21.443487+0000","last_clean":"2024-04-18T04:54:21.443487+0000","last_became_active":"2024-04-18T04:44:30.271619+0000","last_became_peered":"2024-04-18T04:44:30.271619+0000","last_unstale":"2024-04-18T04:54:21.443487+0000","last_undegraded":"2024-04-18T04:54:21.443487+0000","last_fullsized":"2024-04-18T04:54:21.443487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:32:11.612016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"32'51","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:35.414182+0000","last_change":"2024-04-18T04:44:29.897616+0000","last_active":"2024-04-18T04:53:35.414182+0000","last_peered":"2024-04-18T04:53:35.414182+0000","last_clean":"2024-04-18T04:53:35.414182+0000","last_became_active":"2024-04-18T04:44:29.889922+0000","last_became_peered":"2024-04-18T04:44:29.889922+0000","last_unstale":"2024-04-18T04:53:35.414182+0000","last_undegraded":"2024-04-18T04:53:35.414182+0000","last_fullsized":"2024-04-18T04:53:35.414182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:11:52.717768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":45,"num_write_kb":8216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4522","reported_seq":4553,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.305383+0000","last_change":"2024-04-18T04:44:34.333403+0000","last_active":"2024-04-18T04:55:26.305383+0000","last_peered":"2024-04-18T04:55:26.305383+0000","last_clean":"2024-04-18T04:55:26.305383+0000","last_became_active":"2024-04-18T04:44:34.332551+0000","last_became_peered":"2024-04-18T04:44:34.332551+0000","last_unstale":"2024-04-18T04:55:26.305383+0000","last_undegraded":"2024-04-18T04:55:26.305383+0000","last_fullsized":"2024-04-18T04:55:26.305383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4522,"log_dups_size":0,"ondisk_log_size":4522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:33:28.594002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167818369,"num_objects":45,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":66716,"num_write_kb":945017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"32'11","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:13.935887+0000","last_change":"2024-04-18T04:44:30.271099+0000","last_active":"2024-04-18T04:55:13.935887+0000","last_peered":"2024-04-18T04:55:13.935887+0000","last_clean":"2024-04-18T04:55:13.935887+0000","last_became_active":"2024-04-18T04:44:30.270804+0000","last_became_peered":"2024-04-18T04:44:30.270804+0000","last_unstale":"2024-04-18T04:55:13.935887+0000","last_undegraded":"2024-04-18T04:55:13.935887+0000","last_fullsized":"2024-04-18T04:55:13.935887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:18:27.955171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"30'3","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.330903+0000","last_change":"2024-04-18T04:44:29.895084+0000","last_active":"2024-04-18T04:53:26.330903+0000","last_peered":"2024-04-18T04:53:26.330903+0000","last_clean":"2024-04-18T04:53:26.330903+0000","last_became_active":"2024-04-18T04:44:29.894829+0000","last_became_peered":"2024-04-18T04:44:29.894829+0000","last_unstale":"2024-04-18T04:53:26.330903+0000","last_undegraded":"2024-04-18T04:53:26.330903+0000","last_fullsized":"2024-04-18T04:53:26.330903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:54.812428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"31'9","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.075642+0000","last_change":"2024-04-18T04:44:29.892826+0000","last_active":"2024-04-18T04:53:26.075642+0000","last_peered":"2024-04-18T04:53:26.075642+0000","last_clean":"2024-04-18T04:53:26.075642+0000","last_became_active":"2024-04-18T04:44:29.892282+0000","last_became_peered":"2024-04-18T04:44:29.892282+0000","last_unstale":"2024-04-18T04:53:26.075642+0000","last_undegraded":"2024-04-18T04:53:26.075642+0000","last_fullsized":"2024-04-18T04:53:26.075642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:02.844116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":4108,"num_write":6,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"32'7","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:31.494584+0000","last_change":"2024-04-18T04:44:30.285312+0000","last_active":"2024-04-18T04:54:31.494584+0000","last_peered":"2024-04-18T04:54:31.494584+0000","last_clean":"2024-04-18T04:54:31.494584+0000","last_became_active":"2024-04-18T04:44:30.285055+0000","last_became_peered":"2024-04-18T04:44:30.285055+0000","last_unstale":"2024-04-18T04:54:31.494584+0000","last_undegraded":"2024-04-18T04:54:31.494584+0000","last_fullsized":"2024-04-18T04:54:31.494584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:50:00.641018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"32'4854","reported_seq":4880,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.097110+0000","last_change":"2024-04-18T04:44:34.323352+0000","last_active":"2024-04-18T04:55:26.097110+0000","last_peered":"2024-04-18T04:55:26.097110+0000","last_clean":"2024-04-18T04:55:26.097110+0000","last_became_active":"2024-04-18T04:44:34.321645+0000","last_became_peered":"2024-04-18T04:44:34.321645+0000","last_unstale":"2024-04-18T04:55:26.097110+0000","last_undegraded":"2024-04-18T04:55:26.097110+0000","last_fullsized":"2024-04-18T04:55:26.097110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4854,"log_dups_size":0,"ondisk_log_size":4854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:33:27.387013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167802796,"num_objects":43,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":71773,"num_write_kb":1022773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"32'1260","reported_seq":1292,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:35.652289+0000","last_change":"2024-04-18T04:44:29.891865+0000","last_active":"2024-04-18T04:54:35.652289+0000","last_peered":"2024-04-18T04:54:35.652289+0000","last_clean":"2024-04-18T04:54:35.652289+0000","last_became_active":"2024-04-18T04:44:29.891610+0000","last_became_peered":"2024-04-18T04:44:29.891610+0000","last_unstale":"2024-04-18T04:54:35.652289+0000","last_undegraded":"2024-04-18T04:54:35.652289+0000","last_fullsized":"2024-04-18T04:54:35.652289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1260,"log_dups_size":0,"ondisk_log_size":1260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:36:42.266497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195509,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7,"num_read_kb":4100,"num_write":1254,"num_write_kb":4235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"32'7","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:11.290815+0000","last_change":"2024-04-18T04:44:30.279080+0000","last_active":"2024-04-18T04:55:11.290815+0000","last_peered":"2024-04-18T04:55:11.290815+0000","last_clean":"2024-04-18T04:55:11.290815+0000","last_became_active":"2024-04-18T04:44:30.278275+0000","last_became_peered":"2024-04-18T04:44:30.278275+0000","last_unstale":"2024-04-18T04:55:11.290815+0000","last_undegraded":"2024-04-18T04:55:11.290815+0000","last_fullsized":"2024-04-18T04:55:11.290815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:51:48.272703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'4526","reported_seq":4552,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.329304+0000","last_change":"2024-04-18T04:44:34.313835+0000","last_active":"2024-04-18T04:55:26.329304+0000","last_peered":"2024-04-18T04:55:26.329304+0000","last_clean":"2024-04-18T04:55:26.329304+0000","last_became_active":"2024-04-18T04:44:34.313416+0000","last_became_peered":"2024-04-18T04:44:34.313416+0000","last_unstale":"2024-04-18T04:55:26.329304+0000","last_undegraded":"2024-04-18T04:55:26.329304+0000","last_fullsized":"2024-04-18T04:55:26.329304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4526,"log_dups_size":0,"ondisk_log_size":4526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:57:47.245809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125956318,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":66433,"num_write_kb":963599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"32'13","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:25.041653+0000","last_change":"2024-04-18T04:44:30.297229+0000","last_active":"2024-04-18T04:55:25.041653+0000","last_peered":"2024-04-18T04:55:25.041653+0000","last_clean":"2024-04-18T04:55:25.041653+0000","last_became_active":"2024-04-18T04:44:30.296354+0000","last_became_peered":"2024-04-18T04:44:30.296354+0000","last_unstale":"2024-04-18T04:55:25.041653+0000","last_undegraded":"2024-04-18T04:55:25.041653+0000","last_fullsized":"2024-04-18T04:55:25.041653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:30:35.845106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"32'11","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:01.204805+0000","last_change":"2024-04-18T04:44:30.281213+0000","last_active":"2024-04-18T04:55:01.204805+0000","last_peered":"2024-04-18T04:55:01.204805+0000","last_clean":"2024-04-18T04:55:01.204805+0000","last_became_active":"2024-04-18T04:44:30.280941+0000","last_became_peered":"2024-04-18T04:44:30.280941+0000","last_unstale":"2024-04-18T04:55:01.204805+0000","last_undegraded":"2024-04-18T04:55:01.204805+0000","last_fullsized":"2024-04-18T04:55:01.204805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:15:37.795670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"32'7","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:58.280219+0000","last_change":"2024-04-18T04:44:30.288507+0000","last_active":"2024-04-18T04:54:58.280219+0000","last_peered":"2024-04-18T04:54:58.280219+0000","last_clean":"2024-04-18T04:54:58.280219+0000","last_became_active":"2024-04-18T04:44:30.287820+0000","last_became_peered":"2024-04-18T04:44:30.287820+0000","last_unstale":"2024-04-18T04:54:58.280219+0000","last_undegraded":"2024-04-18T04:54:58.280219+0000","last_fullsized":"2024-04-18T04:54:58.280219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:25:29.500586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"32'7","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:20.767557+0000","last_change":"2024-04-18T04:44:30.273278+0000","last_active":"2024-04-18T04:55:20.767557+0000","last_peered":"2024-04-18T04:55:20.767557+0000","last_clean":"2024-04-18T04:55:20.767557+0000","last_became_active":"2024-04-18T04:44:30.272973+0000","last_became_peered":"2024-04-18T04:44:30.272973+0000","last_unstale":"2024-04-18T04:55:20.767557+0000","last_undegraded":"2024-04-18T04:55:20.767557+0000","last_fullsized":"2024-04-18T04:55:20.767557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:37:02.421925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'5","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:16.520446+0000","last_change":"2024-04-18T04:44:30.298936+0000","last_active":"2024-04-18T04:55:16.520446+0000","last_peered":"2024-04-18T04:55:16.520446+0000","last_clean":"2024-04-18T04:55:16.520446+0000","last_became_active":"2024-04-18T04:44:30.298637+0000","last_became_peered":"2024-04-18T04:44:30.298637+0000","last_unstale":"2024-04-18T04:55:16.520446+0000","last_undegraded":"2024-04-18T04:55:16.520446+0000","last_fullsized":"2024-04-18T04:55:16.520446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:04:33.188772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"32'7","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:19.622852+0000","last_change":"2024-04-18T04:44:30.274613+0000","last_active":"2024-04-18T04:55:19.622852+0000","last_peered":"2024-04-18T04:55:19.622852+0000","last_clean":"2024-04-18T04:55:19.622852+0000","last_became_active":"2024-04-18T04:44:30.274328+0000","last_became_peered":"2024-04-18T04:44:30.274328+0000","last_unstale":"2024-04-18T04:55:19.622852+0000","last_undegraded":"2024-04-18T04:55:19.622852+0000","last_fullsized":"2024-04-18T04:55:19.622852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:55:41.700955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"32'10","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:23.715434+0000","last_change":"2024-04-18T04:44:30.309403+0000","last_active":"2024-04-18T04:55:23.715434+0000","last_peered":"2024-04-18T04:55:23.715434+0000","last_clean":"2024-04-18T04:55:23.715434+0000","last_became_active":"2024-04-18T04:44:30.308415+0000","last_became_peered":"2024-04-18T04:44:30.308415+0000","last_unstale":"2024-04-18T04:55:23.715434+0000","last_undegraded":"2024-04-18T04:55:23.715434+0000","last_fullsized":"2024-04-18T04:55:23.715434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:51:58.935503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'2","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.360123+0000","last_change":"2024-04-18T04:44:30.293996+0000","last_active":"2024-04-18T04:53:26.360123+0000","last_peered":"2024-04-18T04:53:26.360123+0000","last_clean":"2024-04-18T04:53:26.360123+0000","last_became_active":"2024-04-18T04:44:30.293748+0000","last_became_peered":"2024-04-18T04:44:30.293748+0000","last_unstale":"2024-04-18T04:53:26.360123+0000","last_undegraded":"2024-04-18T04:53:26.360123+0000","last_fullsized":"2024-04-18T04:53:26.360123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:18:32.116499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'6","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.083146+0000","last_change":"2024-04-18T04:45:12.040362+0000","last_active":"2024-04-18T04:53:26.083146+0000","last_peered":"2024-04-18T04:53:26.083146+0000","last_clean":"2024-04-18T04:53:26.083146+0000","last_became_active":"2024-04-18T04:45:12.040045+0000","last_became_peered":"2024-04-18T04:45:12.040045+0000","last_unstale":"2024-04-18T04:53:26.083146+0000","last_undegraded":"2024-04-18T04:53:26.083146+0000","last_fullsized":"2024-04-18T04:53:26.083146+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:18:21.482610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"27'6","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.330791+0000","last_change":"2024-04-18T04:44:30.285836+0000","last_active":"2024-04-18T04:53:26.330791+0000","last_peered":"2024-04-18T04:53:26.330791+0000","last_clean":"2024-04-18T04:53:26.330791+0000","last_became_active":"2024-04-18T04:44:30.285602+0000","last_became_peered":"2024-04-18T04:44:30.285602+0000","last_unstale":"2024-04-18T04:53:26.330791+0000","last_undegraded":"2024-04-18T04:53:26.330791+0000","last_fullsized":"2024-04-18T04:53:26.330791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:34:39.594780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"32'11","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:25.424434+0000","last_change":"2024-04-18T04:45:12.040347+0000","last_active":"2024-04-18T04:55:25.424434+0000","last_peered":"2024-04-18T04:55:25.424434+0000","last_clean":"2024-04-18T04:55:25.424434+0000","last_became_active":"2024-04-18T04:45:12.040023+0000","last_became_peered":"2024-04-18T04:45:12.040023+0000","last_unstale":"2024-04-18T04:55:25.424434+0000","last_undegraded":"2024-04-18T04:55:25.424434+0000","last_fullsized":"2024-04-18T04:55:25.424434+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:24.207082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"32'13","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:11.342743+0000","last_change":"2024-04-18T04:44:30.310229+0000","last_active":"2024-04-18T04:55:11.342743+0000","last_peered":"2024-04-18T04:55:11.342743+0000","last_clean":"2024-04-18T04:55:11.342743+0000","last_became_active":"2024-04-18T04:44:30.310045+0000","last_became_peered":"2024-04-18T04:44:30.310045+0000","last_unstale":"2024-04-18T04:55:11.342743+0000","last_undegraded":"2024-04-18T04:55:11.342743+0000","last_fullsized":"2024-04-18T04:55:11.342743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:22:55.588300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"32'7","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:33.397879+0000","last_change":"2024-04-18T04:44:30.305644+0000","last_active":"2024-04-18T04:53:33.397879+0000","last_peered":"2024-04-18T04:53:33.397879+0000","last_clean":"2024-04-18T04:53:33.397879+0000","last_became_active":"2024-04-18T04:44:30.304921+0000","last_became_peered":"2024-04-18T04:44:30.304921+0000","last_unstale":"2024-04-18T04:53:33.397879+0000","last_undegraded":"2024-04-18T04:53:33.397879+0000","last_fullsized":"2024-04-18T04:53:33.397879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:17:37.235711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"32'8","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:14.326934+0000","last_change":"2024-04-18T04:44:30.294105+0000","last_active":"2024-04-18T04:55:14.326934+0000","last_peered":"2024-04-18T04:55:14.326934+0000","last_clean":"2024-04-18T04:55:14.326934+0000","last_became_active":"2024-04-18T04:44:30.291742+0000","last_became_peered":"2024-04-18T04:44:30.291742+0000","last_unstale":"2024-04-18T04:55:14.326934+0000","last_undegraded":"2024-04-18T04:55:14.326934+0000","last_fullsized":"2024-04-18T04:55:14.326934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:43:26.428261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"32'13","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:14.192589+0000","last_change":"2024-04-18T04:44:30.296496+0000","last_active":"2024-04-18T04:55:14.192589+0000","last_peered":"2024-04-18T04:55:14.192589+0000","last_clean":"2024-04-18T04:55:14.192589+0000","last_became_active":"2024-04-18T04:44:30.296177+0000","last_became_peered":"2024-04-18T04:44:30.296177+0000","last_unstale":"2024-04-18T04:55:14.192589+0000","last_undegraded":"2024-04-18T04:55:14.192589+0000","last_fullsized":"2024-04-18T04:55:14.192589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:46:44.829326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"32'10","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:12.557481+0000","last_change":"2024-04-18T04:44:30.306568+0000","last_active":"2024-04-18T04:55:12.557481+0000","last_peered":"2024-04-18T04:55:12.557481+0000","last_clean":"2024-04-18T04:55:12.557481+0000","last_became_active":"2024-04-18T04:44:30.305674+0000","last_became_peered":"2024-04-18T04:44:30.305674+0000","last_unstale":"2024-04-18T04:55:12.557481+0000","last_undegraded":"2024-04-18T04:55:12.557481+0000","last_fullsized":"2024-04-18T04:55:12.557481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:58:10.740164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"32'9","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:53.219717+0000","last_change":"2024-04-18T04:44:30.307297+0000","last_active":"2024-04-18T04:53:53.219717+0000","last_peered":"2024-04-18T04:53:53.219717+0000","last_clean":"2024-04-18T04:53:53.219717+0000","last_became_active":"2024-04-18T04:44:30.305470+0000","last_became_peered":"2024-04-18T04:44:30.305470+0000","last_unstale":"2024-04-18T04:53:53.219717+0000","last_undegraded":"2024-04-18T04:53:53.219717+0000","last_fullsized":"2024-04-18T04:53:53.219717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:01:00.587115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"32'8","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:00.541342+0000","last_change":"2024-04-18T04:44:30.280849+0000","last_active":"2024-04-18T04:54:00.541342+0000","last_peered":"2024-04-18T04:54:00.541342+0000","last_clean":"2024-04-18T04:54:00.541342+0000","last_became_active":"2024-04-18T04:44:30.280535+0000","last_became_peered":"2024-04-18T04:44:30.280535+0000","last_unstale":"2024-04-18T04:54:00.541342+0000","last_undegraded":"2024-04-18T04:54:00.541342+0000","last_fullsized":"2024-04-18T04:54:00.541342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:01:06.241941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"28'6","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.055479+0000","last_change":"2024-04-18T04:44:30.278849+0000","last_active":"2024-04-18T04:53:26.055479+0000","last_peered":"2024-04-18T04:53:26.055479+0000","last_clean":"2024-04-18T04:53:26.055479+0000","last_became_active":"2024-04-18T04:44:30.278624+0000","last_became_peered":"2024-04-18T04:44:30.278624+0000","last_unstale":"2024-04-18T04:53:26.055479+0000","last_undegraded":"2024-04-18T04:53:26.055479+0000","last_fullsized":"2024-04-18T04:53:26.055479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:31:30.791150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"32'11","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:12.455040+0000","last_change":"2024-04-18T04:44:30.296148+0000","last_active":"2024-04-18T04:55:12.455040+0000","last_peered":"2024-04-18T04:55:12.455040+0000","last_clean":"2024-04-18T04:55:12.455040+0000","last_became_active":"2024-04-18T04:44:30.295754+0000","last_became_peered":"2024-04-18T04:44:30.295754+0000","last_unstale":"2024-04-18T04:55:12.455040+0000","last_undegraded":"2024-04-18T04:55:12.455040+0000","last_fullsized":"2024-04-18T04:55:12.455040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:39:53.809075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"32'4","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:13.881674+0000","last_change":"2024-04-18T04:44:30.298061+0000","last_active":"2024-04-18T04:54:13.881674+0000","last_peered":"2024-04-18T04:54:13.881674+0000","last_clean":"2024-04-18T04:54:13.881674+0000","last_became_active":"2024-04-18T04:44:30.297416+0000","last_became_peered":"2024-04-18T04:44:30.297416+0000","last_unstale":"2024-04-18T04:54:13.881674+0000","last_undegraded":"2024-04-18T04:54:13.881674+0000","last_fullsized":"2024-04-18T04:54:13.881674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:35:48.612670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"32'10","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:13.568254+0000","last_change":"2024-04-18T04:44:30.292802+0000","last_active":"2024-04-18T04:54:13.568254+0000","last_peered":"2024-04-18T04:54:13.568254+0000","last_clean":"2024-04-18T04:54:13.568254+0000","last_became_active":"2024-04-18T04:44:30.291939+0000","last_became_peered":"2024-04-18T04:44:30.291939+0000","last_unstale":"2024-04-18T04:54:13.568254+0000","last_undegraded":"2024-04-18T04:54:13.568254+0000","last_fullsized":"2024-04-18T04:54:13.568254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:33:04.689561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"32'14","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:23.368193+0000","last_change":"2024-04-18T04:44:30.309020+0000","last_active":"2024-04-18T04:55:23.368193+0000","last_peered":"2024-04-18T04:55:23.368193+0000","last_clean":"2024-04-18T04:55:23.368193+0000","last_became_active":"2024-04-18T04:44:30.307604+0000","last_became_peered":"2024-04-18T04:44:30.307604+0000","last_unstale":"2024-04-18T04:55:23.368193+0000","last_undegraded":"2024-04-18T04:55:23.368193+0000","last_fullsized":"2024-04-18T04:55:23.368193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:44:54.764284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"32'11","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:12.485930+0000","last_change":"2024-04-18T04:44:30.314533+0000","last_active":"2024-04-18T04:54:12.485930+0000","last_peered":"2024-04-18T04:54:12.485930+0000","last_clean":"2024-04-18T04:54:12.485930+0000","last_became_active":"2024-04-18T04:44:30.313985+0000","last_became_peered":"2024-04-18T04:44:30.313985+0000","last_unstale":"2024-04-18T04:54:12.485930+0000","last_undegraded":"2024-04-18T04:54:12.485930+0000","last_fullsized":"2024-04-18T04:54:12.485930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:02:03.941709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"32'7","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:30.364882+0000","last_change":"2024-04-18T04:44:30.309273+0000","last_active":"2024-04-18T04:54:30.364882+0000","last_peered":"2024-04-18T04:54:30.364882+0000","last_clean":"2024-04-18T04:54:30.364882+0000","last_became_active":"2024-04-18T04:44:30.309002+0000","last_became_peered":"2024-04-18T04:44:30.309002+0000","last_unstale":"2024-04-18T04:54:30.364882+0000","last_undegraded":"2024-04-18T04:54:30.364882+0000","last_fullsized":"2024-04-18T04:54:30.364882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:49:10.005359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'6","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.040583+0000","last_change":"2024-04-18T04:44:30.292371+0000","last_active":"2024-04-18T04:53:26.040583+0000","last_peered":"2024-04-18T04:53:26.040583+0000","last_clean":"2024-04-18T04:53:26.040583+0000","last_became_active":"2024-04-18T04:44:30.290504+0000","last_became_peered":"2024-04-18T04:44:30.290504+0000","last_unstale":"2024-04-18T04:53:26.040583+0000","last_undegraded":"2024-04-18T04:53:26.040583+0000","last_fullsized":"2024-04-18T04:53:26.040583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:11.998355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"32'8","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:13.246271+0000","last_change":"2024-04-18T04:44:30.299935+0000","last_active":"2024-04-18T04:55:13.246271+0000","last_peered":"2024-04-18T04:55:13.246271+0000","last_clean":"2024-04-18T04:55:13.246271+0000","last_became_active":"2024-04-18T04:44:30.290175+0000","last_became_peered":"2024-04-18T04:44:30.290175+0000","last_unstale":"2024-04-18T04:55:13.246271+0000","last_undegraded":"2024-04-18T04:55:13.246271+0000","last_fullsized":"2024-04-18T04:55:13.246271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:15:13.703423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"32'4","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:32.488111+0000","last_change":"2024-04-18T04:44:30.288940+0000","last_active":"2024-04-18T04:54:32.488111+0000","last_peered":"2024-04-18T04:54:32.488111+0000","last_clean":"2024-04-18T04:54:32.488111+0000","last_became_active":"2024-04-18T04:44:30.288131+0000","last_became_peered":"2024-04-18T04:44:30.288131+0000","last_unstale":"2024-04-18T04:54:32.488111+0000","last_undegraded":"2024-04-18T04:54:32.488111+0000","last_fullsized":"2024-04-18T04:54:32.488111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:31:08.895305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"32'7","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:17.401285+0000","last_change":"2024-04-18T04:44:30.288066+0000","last_active":"2024-04-18T04:55:17.401285+0000","last_peered":"2024-04-18T04:55:17.401285+0000","last_clean":"2024-04-18T04:55:17.401285+0000","last_became_active":"2024-04-18T04:44:30.287325+0000","last_became_peered":"2024-04-18T04:44:30.287325+0000","last_unstale":"2024-04-18T04:55:17.401285+0000","last_undegraded":"2024-04-18T04:55:17.401285+0000","last_fullsized":"2024-04-18T04:55:17.401285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:58:04.111225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"32'5","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:46.514757+0000","last_change":"2024-04-18T04:44:30.275485+0000","last_active":"2024-04-18T04:54:46.514757+0000","last_peered":"2024-04-18T04:54:46.514757+0000","last_clean":"2024-04-18T04:54:46.514757+0000","last_became_active":"2024-04-18T04:44:30.275118+0000","last_became_peered":"2024-04-18T04:44:30.275118+0000","last_unstale":"2024-04-18T04:54:46.514757+0000","last_undegraded":"2024-04-18T04:54:46.514757+0000","last_fullsized":"2024-04-18T04:54:46.514757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:25:09.625660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'2","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.060440+0000","last_change":"2024-04-18T04:44:30.277119+0000","last_active":"2024-04-18T04:53:26.060440+0000","last_peered":"2024-04-18T04:53:26.060440+0000","last_clean":"2024-04-18T04:53:26.060440+0000","last_became_active":"2024-04-18T04:44:30.276654+0000","last_became_peered":"2024-04-18T04:44:30.276654+0000","last_unstale":"2024-04-18T04:53:26.060440+0000","last_undegraded":"2024-04-18T04:53:26.060440+0000","last_fullsized":"2024-04-18T04:53:26.060440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:52.420199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"32'10","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:57.496321+0000","last_change":"2024-04-18T04:44:30.302905+0000","last_active":"2024-04-18T04:54:57.496321+0000","last_peered":"2024-04-18T04:54:57.496321+0000","last_clean":"2024-04-18T04:54:57.496321+0000","last_became_active":"2024-04-18T04:44:30.302180+0000","last_became_peered":"2024-04-18T04:44:30.302180+0000","last_unstale":"2024-04-18T04:54:57.496321+0000","last_undegraded":"2024-04-18T04:54:57.496321+0000","last_fullsized":"2024-04-18T04:54:57.496321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:41:53.211956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":4667181238,"num_objects":1305,"num_object_clones":0,"num_object_copies":5220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1305,"num_whiteouts":0,"num_read":129,"num_read_kb":11,"num_write":2193827,"num_write_kb":31163048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4494757888,"data_stored":9516695552,"data_compressed":545312913,"data_compressed_allocated":2071355392,"data_compressed_original":7093293056,"omap_allocated":0,"internal_metadata":0},"log_size":148640,"ondisk_log_size":148640,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":498,"ondisk_log_size":498,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":81164485,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":422,"num_read_kb":74892,"num_write":3457,"num_write_kb":80224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":37855232,"data_stored":162328970,"data_compressed":18251382,"data_compressed_allocated":21430272,"data_compressed_original":146063360,"omap_allocated":0,"internal_metadata":0},"log_size":3381,"ondisk_log_size":3381,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66624,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509574,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1857768,"kb_used_data":892896,"kb_used_omap":1,"kb_used_meta":964862,"kb_avail":92514072,"statfs":{"total":96636764160,"available":94734409728,"internally_reserved":0,"allocated":914325504,"data_stored":1945598923,"data_compressed":111856752,"data_compressed_allocated":421683200,"data_compressed_original":1453170688,"omap_allocated":1592,"internal_metadata":988019144},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:54:39 2024","interfaces":[{"interface":"back","average":{"1min":4.0309999999999997,"5min":6.7530000000000001,"15min":3.347},"min":{"1min":0.52900000000000003,"5min":0.26200000000000001,"15min":0.252},"max":{"1min":15.353,"5min":76.096999999999994,"15min":76.096999999999994},"last":0.44},{"interface":"front","average":{"1min":4.7009999999999996,"5min":8.4860000000000007,"15min":3.7530000000000001},"min":{"1min":0.38500000000000001,"5min":0.254,"15min":0.254},"max":{"1min":15.515000000000001,"5min":184.16999999999999,"15min":184.16999999999999},"last":0.36299999999999999}]},{"osd":1,"last update":"Thu Apr 18 04:54:39 2024","interfaces":[{"interface":"back","average":{"1min":4.7480000000000002,"5min":7.343,"15min":4.3520000000000003},"min":{"1min":0.38700000000000001,"5min":0.34699999999999998,"15min":0.24299999999999999},"max":{"1min":18.978999999999999,"5min":85.109999999999999,"15min":153.59299999999999},"last":1.381},{"interface":"front","average":{"1min":5.1680000000000001,"5min":5.9489999999999998,"15min":4.0469999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.29199999999999998},"max":{"1min":20.414999999999999,"5min":88.606999999999999,"15min":153.94300000000001},"last":1.54}]},{"osd":2,"last update":"Thu Apr 18 04:54:39 2024","interfaces":[{"interface":"back","average":{"1min":3.8010000000000002,"5min":3.6190000000000002,"15min":2.6429999999999998},"min":{"1min":0.58899999999999997,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":19.745000000000001,"5min":23.867000000000001,"15min":162.59700000000001},"last":1.2749999999999999},{"interface":"front","average":{"1min":4.8499999999999996,"5min":4.5759999999999996,"15min":2.9590000000000001},"min":{"1min":0.46000000000000002,"5min":0.309,"15min":0.309},"max":{"1min":19.707999999999998,"5min":28.335000000000001,"15min":153.83500000000001},"last":2.8170000000000002}]},{"osd":4,"last update":"Thu Apr 18 04:54:39 2024","interfaces":[{"interface":"back","average":{"1min":3.2789999999999999,"5min":2.847,"15min":1.7450000000000001},"min":{"1min":0.433,"5min":0.43099999999999999,"15min":0.40000000000000002},"max":{"1min":12.050000000000001,"5min":31.974,"15min":31.974},"last":1.3069999999999999},{"interface":"front","average":{"1min":3.802,"5min":5.0670000000000002,"15min":2.718},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":15.006,"5min":50.536000000000001,"15min":50.536000000000001},"last":0.72999999999999998}]},{"osd":5,"last update":"Thu Apr 18 04:54:39 2024","interfaces":[{"interface":"back","average":{"1min":3.456,"5min":3.7509999999999999,"15min":2.3279999999999998},"min":{"1min":0.40899999999999997,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":12.981,"5min":40.915999999999997,"15min":40.915999999999997},"last":0.69399999999999995},{"interface":"front","average":{"1min":3.4169999999999998,"5min":2.6850000000000001,"15min":1.9710000000000001},"min":{"1min":0.59499999999999997,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":18.103000000000002,"5min":18.103000000000002,"15min":68.370000000000005},"last":0.78100000000000003}]},{"osd":6,"last update":"Thu Apr 18 04:54:39 2024","interfaces":[{"interface":"back","average":{"1min":3.3959999999999999,"5min":3.5880000000000001,"15min":2.2360000000000002},"min":{"1min":0.60899999999999999,"5min":0.45100000000000001,"15min":0.39900000000000002},"max":{"1min":17.058,"5min":28.748000000000001,"15min":48.765000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":3.4129999999999998,"5min":4.7320000000000002,"15min":2.593},"min":{"1min":0.68400000000000005,"5min":0.47199999999999998,"15min":0.38900000000000001},"max":{"1min":12.656000000000001,"5min":69.227999999999994,"15min":69.227999999999994},"last":1.2370000000000001}]},{"osd":7,"last update":"Thu Apr 18 04:54:39 2024","interfaces":[{"interface":"back","average":{"1min":3.77,"5min":3.2320000000000002,"15min":2.1030000000000002},"min":{"1min":0.49199999999999999,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":18.795000000000002,"5min":40.947000000000003,"15min":40.947000000000003},"last":1.337},{"interface":"front","average":{"1min":3.331,"5min":3.3410000000000002,"15min":2.2200000000000002},"min":{"1min":0.65000000000000002,"5min":0.54500000000000004,"15min":0.44400000000000001},"max":{"1min":17.122,"5min":19.512,"15min":68.329999999999998},"last":0.81999999999999995}]}]},{"osd":2,"up_from":15,"seq":64424509575,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1030932,"kb_used_data":479828,"kb_used_omap":1,"kb_used_meta":550334,"kb_avail":93340908,"statfs":{"total":96636764160,"available":95581089792,"internally_reserved":0,"allocated":491343872,"data_stored":1051780942,"data_compressed":60292170,"data_compressed_allocated":226811904,"data_compressed_original":787464192,"omap_allocated":1594,"internal_metadata":563542470},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":3.7570000000000001,"5min":4.9139999999999997,"15min":3.3690000000000002},"min":{"1min":0.66300000000000003,"5min":0.248,"15min":0.23300000000000001},"max":{"1min":15.831,"5min":37.567,"15min":120.402},"last":0.53500000000000003},{"interface":"front","average":{"1min":4.2869999999999999,"5min":5.6310000000000002,"15min":3.327},"min":{"1min":0.432,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":30.812999999999999,"5min":58.277999999999999,"15min":121.377},"last":1.2829999999999999}]},{"osd":1,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":3.4889999999999999,"5min":5.6909999999999998,"15min":3.7650000000000001},"min":{"1min":0.51100000000000001,"5min":0.32300000000000001,"15min":0.28399999999999997},"max":{"1min":8.5229999999999997,"5min":62.851999999999997,"15min":135.32400000000001},"last":1.595},{"interface":"front","average":{"1min":3.3100000000000001,"5min":5.548,"15min":3.8370000000000002},"min":{"1min":0.64100000000000001,"5min":0.35599999999999998,"15min":0.27600000000000002},"max":{"1min":11.401,"5min":60.741999999999997,"15min":178.08199999999999},"last":3.6899999999999999}]},{"osd":3,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":5.8479999999999999,"5min":5.0250000000000004,"15min":3.1509999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.35999999999999999},"max":{"1min":65.037000000000006,"5min":65.037000000000006,"15min":124.76300000000001},"last":1.425},{"interface":"front","average":{"1min":7.4370000000000003,"5min":5.7990000000000004,"15min":3.5},"min":{"1min":0.53700000000000003,"5min":0.36699999999999999,"15min":0.33000000000000002},"max":{"1min":70.861999999999995,"5min":70.861999999999995,"15min":145.47200000000001},"last":0.79100000000000004}]},{"osd":4,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":2.944,"5min":3.931,"15min":2.298},"min":{"1min":0.49399999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":10.182,"5min":37.420000000000002,"15min":37.420000000000002},"last":1.0669999999999999},{"interface":"front","average":{"1min":2.9249999999999998,"5min":3.5760000000000001,"15min":2.1749999999999998},"min":{"1min":0.65600000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":10.327999999999999,"5min":37.460000000000001,"15min":37.460000000000001},"last":1.1299999999999999}]},{"osd":5,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":3.0059999999999998,"5min":3.6850000000000001,"15min":2.1160000000000001},"min":{"1min":0.621,"5min":0.38,"15min":0.32700000000000001},"max":{"1min":10.250999999999999,"5min":37.5,"15min":37.5},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.6419999999999999,"5min":3.331,"15min":2.1219999999999999},"min":{"1min":0.44700000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":6.2000000000000002,"5min":28.143000000000001,"15min":28.143000000000001},"last":1.2330000000000001}]},{"osd":6,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":3.2109999999999999,"5min":3.5619999999999998,"15min":2.2469999999999999},"min":{"1min":0.74199999999999999,"5min":0.47499999999999998,"15min":0.441},"max":{"1min":10.359999999999999,"5min":24.103000000000002,"15min":34.506999999999998},"last":1.1559999999999999},{"interface":"front","average":{"1min":2.2200000000000002,"5min":3.75,"15min":2.2869999999999999},"min":{"1min":0.56200000000000006,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":5.6909999999999998,"5min":37.533000000000001,"15min":37.533000000000001},"last":1.4630000000000001}]},{"osd":7,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":2.5550000000000002,"5min":3.4169999999999998,"15min":2.0649999999999999},"min":{"1min":0.53200000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":6.0209999999999999,"5min":24.155000000000001,"15min":24.155000000000001},"last":3.3519999999999999},{"interface":"front","average":{"1min":1.5569999999999999,"5min":3.1360000000000001,"15min":2.125},"min":{"1min":0.52800000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":5.0099999999999998,"5min":26.064,"15min":34.576999999999998},"last":1.6279999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509573,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1698744,"kb_used_data":724208,"kb_used_omap":1,"kb_used_meta":974526,"kb_avail":92673096,"statfs":{"total":96636764160,"available":94897250304,"internally_reserved":0,"allocated":741588992,"data_stored":1603573467,"data_compressed":92844173,"data_compressed_allocated":343928832,"data_compressed_original":1206128640,"omap_allocated":1594,"internal_metadata":997915078},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,1,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:54:40 2024","interfaces":[{"interface":"back","average":{"1min":2.347,"5min":5.9189999999999996,"15min":3.3500000000000001},"min":{"1min":0.26000000000000001,"5min":0.22,"15min":0.22},"max":{"1min":11.497999999999999,"5min":124.096,"15min":124.096},"last":0.28799999999999998},{"interface":"front","average":{"1min":3.9830000000000001,"5min":7.2380000000000004,"15min":4.0640000000000001},"min":{"1min":0.44500000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":14.279,"5min":143.60300000000001,"15min":164.41},"last":6.6260000000000003}]},{"osd":2,"last update":"Thu Apr 18 04:54:40 2024","interfaces":[{"interface":"back","average":{"1min":3.79,"5min":4.7270000000000003,"15min":5.9119999999999999},"min":{"1min":0.48499999999999999,"5min":0.33700000000000002,"15min":0.29299999999999998},"max":{"1min":11.513,"5min":25.558,"15min":840.66700000000003},"last":7.407},{"interface":"front","average":{"1min":3.036,"5min":5.9249999999999998,"15min":3.722},"min":{"1min":0.44600000000000001,"5min":0.33600000000000002,"15min":0.33400000000000002},"max":{"1min":11.717000000000001,"5min":114.47199999999999,"15min":164.477},"last":2.3860000000000001}]},{"osd":3,"last update":"Thu Apr 18 04:54:40 2024","interfaces":[{"interface":"back","average":{"1min":2.9220000000000002,"5min":6.6210000000000004,"15min":4.7510000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":11.66,"5min":88.673000000000002,"15min":164.50299999999999},"last":13.221},{"interface":"front","average":{"1min":3.9239999999999999,"5min":8.1709999999999994,"15min":4.8360000000000003},"min":{"1min":0.5,"5min":0.39800000000000002,"15min":0.36899999999999999},"max":{"1min":14.032999999999999,"5min":151.82599999999999,"15min":151.82599999999999},"last":9.2409999999999997}]},{"osd":4,"last update":"Thu Apr 18 04:54:40 2024","interfaces":[{"interface":"back","average":{"1min":2.7000000000000002,"5min":3.851,"15min":2.637},"min":{"1min":0.45900000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":9.6219999999999999,"5min":23.478999999999999,"15min":52.072000000000003},"last":3.3740000000000001},{"interface":"front","average":{"1min":2.1459999999999999,"5min":4.5490000000000004,"15min":5.5670000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.34399999999999997},"max":{"1min":11.691000000000001,"5min":33.017000000000003,"15min":840.61500000000001},"last":0.41799999999999998}]},{"osd":5,"last update":"Thu Apr 18 04:54:40 2024","interfaces":[{"interface":"back","average":{"1min":3.6099999999999999,"5min":5.6520000000000001,"15min":4.5860000000000003},"min":{"1min":0.46500000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":14.146000000000001,"5min":114.37,"15min":478.47000000000003},"last":0.69999999999999996},{"interface":"front","average":{"1min":3.887,"5min":4.1609999999999996,"15min":3.0859999999999999},"min":{"1min":0.52700000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":14.176,"5min":41.832000000000001,"15min":164.374},"last":0.75900000000000001}]},{"osd":6,"last update":"Thu Apr 18 04:54:40 2024","interfaces":[{"interface":"back","average":{"1min":3.242,"5min":4.0090000000000003,"15min":2.742},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":14.496,"5min":23.416,"15min":52.100999999999999},"last":3.4159999999999999},{"interface":"front","average":{"1min":2.5070000000000001,"5min":4.0839999999999996,"15min":3.782},"min":{"1min":0.55500000000000005,"5min":0.49399999999999999,"15min":0.438},"max":{"1min":11.625,"5min":25.809999999999999,"15min":396.81},"last":0.45100000000000001}]},{"osd":7,"last update":"Thu Apr 18 04:54:40 2024","interfaces":[{"interface":"back","average":{"1min":3.6680000000000001,"5min":5.6479999999999997,"15min":3.581},"min":{"1min":0.499,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":14.105,"5min":100.565,"15min":164.447},"last":0.73399999999999999},{"interface":"front","average":{"1min":3.5190000000000001,"5min":3.996,"15min":2.698},"min":{"1min":0.48999999999999999,"5min":0.46200000000000002,"15min":0.45400000000000001},"max":{"1min":14.558,"5min":23.648,"15min":54.353000000000002},"last":3.4430000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542282,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1144540,"kb_used_data":491796,"kb_used_omap":1,"kb_used_meta":652734,"kb_avail":93227300,"statfs":{"total":96636764160,"available":95464755200,"internally_reserved":0,"allocated":503599104,"data_stored":1076571430,"data_compressed":63080786,"data_compressed_allocated":230240256,"data_compressed_original":803430400,"omap_allocated":1589,"internal_metadata":668400075},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:54:27 2024","interfaces":[{"interface":"back","average":{"1min":17.356999999999999,"5min":5.6539999999999999,"15min":3.7490000000000001},"min":{"1min":0.34100000000000003,"5min":0.249,"15min":0.249},"max":{"1min":195.89500000000001,"5min":195.89500000000001,"15min":287.19600000000003},"last":0.40200000000000002},{"interface":"front","average":{"1min":19.302,"5min":5.9539999999999997,"15min":4.0789999999999997},"min":{"1min":0.26800000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":196.149,"5min":196.149,"15min":289.23899999999998},"last":0.60899999999999999}]},{"osd":1,"last update":"Thu Apr 18 04:54:48 2024","interfaces":[{"interface":"back","average":{"1min":6.774,"5min":4.2729999999999997,"15min":3.5590000000000002},"min":{"1min":0.34799999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":90.055000000000007,"5min":90.055000000000007,"15min":303.83800000000002},"last":9.5960000000000001},{"interface":"front","average":{"1min":7.1840000000000002,"5min":5.3330000000000002,"15min":3.6709999999999998},"min":{"1min":0.45400000000000001,"5min":0.34499999999999997,"15min":0.32000000000000001},"max":{"1min":90.001999999999995,"5min":90.001999999999995,"15min":288.05799999999999},"last":9.5800000000000001}]},{"osd":2,"last update":"Thu Apr 18 04:54:48 2024","interfaces":[{"interface":"back","average":{"1min":6.0229999999999997,"5min":3.585,"15min":2.3010000000000002},"min":{"1min":0.374,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":91.088999999999999,"5min":91.088999999999999,"15min":91.088999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":6.2089999999999996,"5min":3.0259999999999998,"15min":1.8799999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":91.171999999999997,"5min":91.171999999999997,"15min":91.171999999999997},"last":1.52}]},{"osd":3,"last update":"Thu Apr 18 04:54:48 2024","interfaces":[{"interface":"back","average":{"1min":7.5279999999999996,"5min":4.2400000000000002,"15min":3.7999999999999998},"min":{"1min":0.36699999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":89.393000000000001,"5min":89.393000000000001,"15min":308.36700000000002},"last":0.63800000000000001},{"interface":"front","average":{"1min":6.0540000000000003,"5min":3.7349999999999999,"15min":3.1829999999999998},"min":{"1min":0.36799999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":88.070999999999998,"5min":88.070999999999998,"15min":289.86099999999999},"last":2.149}]},{"osd":4,"last update":"Thu Apr 18 04:54:27 2024","interfaces":[{"interface":"back","average":{"1min":2.7170000000000001,"5min":1.3200000000000001,"15min":1.1819999999999999},"min":{"1min":0.25900000000000001,"5min":0.252,"15min":0.252},"max":{"1min":41.567,"5min":41.567,"15min":41.567},"last":0.36599999999999999},{"interface":"front","average":{"1min":3.0529999999999999,"5min":1.343,"15min":1.1459999999999999},"min":{"1min":0.313,"5min":0.29699999999999999,"15min":0.247},"max":{"1min":45.646000000000001,"5min":45.646000000000001,"15min":45.646000000000001},"last":0.35099999999999998}]},{"osd":5,"last update":"Thu Apr 18 04:54:27 2024","interfaces":[{"interface":"back","average":{"1min":2.653,"5min":1.4319999999999999,"15min":1.1739999999999999},"min":{"1min":0.27300000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":41.595999999999997,"5min":41.595999999999997,"15min":41.595999999999997},"last":0.30499999999999999},{"interface":"front","average":{"1min":1.155,"5min":1.0089999999999999,"15min":1.0389999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":5.8769999999999998,"5min":15.271000000000001,"15min":15.271000000000001},"last":0.72099999999999997}]},{"osd":6,"last update":"Thu Apr 18 04:54:27 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.98799999999999999,"15min":1.0109999999999999},"min":{"1min":0.29999999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":5.1630000000000003,"5min":8.2390000000000008,"15min":8.2390000000000008},"last":0.32000000000000001},{"interface":"front","average":{"1min":1.052,"5min":1.0469999999999999,"15min":1.077},"min":{"1min":0.38600000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":5.9429999999999996,"5min":11.288,"15min":11.288},"last":0.74399999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542280,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1353544,"kb_used_data":587584,"kb_used_omap":1,"kb_used_meta":765950,"kb_avail":93018296,"statfs":{"total":96636764160,"available":95250735104,"internally_reserved":0,"allocated":601686016,"data_stored":1278569684,"data_compressed":74589765,"data_compressed_allocated":278536192,"data_compressed_original":955625472,"omap_allocated":1593,"internal_metadata":784333255},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,2,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":7.1710000000000003,"5min":2.77,"15min":1.667},"min":{"1min":0.36699999999999999,"5min":0.247,"15min":0.247},"max":{"1min":99.328999999999994,"5min":99.328999999999994,"15min":99.328999999999994},"last":1.7589999999999999},{"interface":"front","average":{"1min":7.202,"5min":3.3170000000000002,"15min":2.181},"min":{"1min":0.40300000000000002,"5min":0.309,"15min":0.309},"max":{"1min":99.287000000000006,"5min":99.287000000000006,"15min":99.287000000000006},"last":1.794}]},{"osd":1,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":9.1219999999999999,"5min":5.085,"15min":2.8410000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":98.650999999999996,"5min":122.06999999999999,"15min":122.06999999999999},"last":5.3890000000000002},{"interface":"front","average":{"1min":8.6890000000000001,"5min":4.649,"15min":2.6880000000000002},"min":{"1min":0.42799999999999999,"5min":0.33300000000000002,"15min":0.32800000000000001},"max":{"1min":98.683999999999997,"5min":122.09,"15min":122.09},"last":5.4009999999999998}]},{"osd":2,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":2.702,"5min":2.7919999999999998,"15min":1.835},"min":{"1min":0.33600000000000002,"5min":0.31,"15min":0.31},"max":{"1min":13.101000000000001,"5min":38.557000000000002,"15min":41.764000000000003},"last":1.502},{"interface":"front","average":{"1min":2.1640000000000001,"5min":2.8300000000000001,"15min":1.8919999999999999},"min":{"1min":0.373,"5min":0.35799999999999998,"15min":0.35199999999999998},"max":{"1min":10.993,"5min":35.734000000000002,"15min":41.710000000000001},"last":1.1439999999999999}]},{"osd":3,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":8.2070000000000007,"5min":3.9660000000000002,"15min":2.9119999999999999},"min":{"1min":0.39400000000000002,"5min":0.312,"15min":0.29999999999999999},"max":{"1min":101.006,"5min":101.006,"15min":101.006},"last":0.68999999999999995},{"interface":"front","average":{"1min":8.2420000000000009,"5min":4.0410000000000004,"15min":2.9980000000000002},"min":{"1min":0.437,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":101.039,"5min":101.039,"15min":101.039},"last":0.71899999999999997}]},{"osd":4,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":2.1829999999999998,"5min":1.6220000000000001,"15min":1.155},"min":{"1min":0.28599999999999998,"5min":0.217,"15min":0.217},"max":{"1min":17.401,"5min":19.481999999999999,"15min":19.481999999999999},"last":1.087},{"interface":"front","average":{"1min":2.2650000000000001,"5min":1.6200000000000001,"15min":1.234},"min":{"1min":0.33600000000000002,"5min":0.28199999999999997,"15min":0.26400000000000001},"max":{"1min":17.872,"5min":19.536999999999999,"15min":19.536999999999999},"last":1.115}]},{"osd":5,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":0.90900000000000003,"15min":1.0389999999999999},"min":{"1min":0.27900000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":4.2050000000000001,"5min":13.538,"15min":13.538},"last":0.312},{"interface":"front","average":{"1min":1.05,"5min":0.95399999999999996,"15min":0.95199999999999996},"min":{"1min":0.35499999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":4.2350000000000003,"5min":8.7210000000000001,"15min":8.7210000000000001},"last":0.34699999999999998}]},{"osd":7,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":0.93400000000000005,"15min":1.0740000000000001},"min":{"1min":0.314,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":4.266,"5min":7.5359999999999996,"15min":7.5359999999999996},"last":0.38100000000000001},{"interface":"front","average":{"1min":1.496,"5min":0.96299999999999997,"15min":1.036},"min":{"1min":0.35199999999999998,"5min":0.33500000000000002,"15min":0.314},"max":{"1min":10.955,"5min":10.955,"15min":10.955},"last":0.42399999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542282,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1071984,"kb_used_data":459368,"kb_used_omap":1,"kb_used_meta":612606,"kb_avail":93299856,"statfs":{"total":96636764160,"available":95539052544,"internally_reserved":0,"allocated":470392832,"data_stored":1011022077,"data_compressed":58951669,"data_compressed_allocated":217178112,"data_compressed_original":758022144,"omap_allocated":1593,"internal_metadata":627308999},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":6.1559999999999997,"5min":4.0069999999999997,"15min":2.343},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":81.960999999999999,"5min":84.305000000000007,"15min":84.305000000000007},"last":0.53000000000000003},{"interface":"front","average":{"1min":5.1970000000000001,"5min":4.0170000000000003,"15min":4.4409999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":82.180000000000007,"5min":86.994,"15min":553.95500000000004},"last":0.57399999999999995}]},{"osd":1,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":5.4820000000000002,"5min":4.9640000000000004,"15min":4.6870000000000003},"min":{"1min":0.34899999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":81.361999999999995,"5min":87.989000000000004,"15min":553.36900000000003},"last":0.432},{"interface":"front","average":{"1min":5.7640000000000002,"5min":4.6989999999999998,"15min":4.3010000000000002},"min":{"1min":0.32500000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":95.162000000000006,"5min":95.162000000000006,"15min":501.11000000000001},"last":0.52100000000000002}]},{"osd":2,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":6.2830000000000004,"15min":3.1280000000000001},"min":{"1min":0.40300000000000002,"5min":0.34599999999999997,"15min":0.29799999999999999},"max":{"1min":6.8399999999999999,"5min":262.99700000000001,"15min":262.99700000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":1.298,"5min":6.6760000000000002,"15min":3.3050000000000002},"min":{"1min":0.377,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":5.4320000000000004,"5min":259.24099999999999,"15min":259.24099999999999},"last":0.44500000000000001}]},{"osd":3,"last update":"Thu Apr 18 04:54:39 2024","interfaces":[{"interface":"back","average":{"1min":5.4500000000000002,"5min":4.4909999999999997,"15min":2.6110000000000002},"min":{"1min":0.42099999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":84.394999999999996,"5min":84.394999999999996,"15min":84.394999999999996},"last":0.48299999999999998},{"interface":"front","average":{"1min":5.54,"5min":4.593,"15min":2.8690000000000002},"min":{"1min":0.44900000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":83.763999999999996,"5min":86.834999999999994,"15min":86.834999999999994},"last":0.51400000000000001}]},{"osd":4,"last update":"Thu Apr 18 04:54:39 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.749,"15min":0.83199999999999996},"min":{"1min":0.28100000000000003,"5min":0.246,"15min":0.246},"max":{"1min":1.2010000000000001,"5min":4.6440000000000001,"15min":4.6440000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":1.181,"15min":1.0600000000000001},"min":{"1min":0.36199999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":2.7599999999999998,"5min":12.888999999999999,"15min":12.888999999999999},"last":0.498}]},{"osd":6,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.71599999999999997,"15min":0.874},"min":{"1min":0.31,"5min":0.252,"15min":0.252},"max":{"1min":3.306,"5min":4.6639999999999997,"15min":4.6639999999999997},"last":58.222000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.96999999999999997,"15min":0.97899999999999998},"min":{"1min":0.32500000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":3.2850000000000001,"5min":12.694000000000001,"15min":12.694000000000001},"last":58.314999999999998}]},{"osd":7,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.90500000000000003,"15min":1.018},"min":{"1min":0.34599999999999997,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.97599999999999998,"5min":12.74,"15min":12.74},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.89700000000000002,"5min":1.05,"15min":1.0429999999999999},"min":{"1min":0.40100000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":6.4630000000000001,"5min":27.658000000000001,"15min":27.658000000000001},"last":0.59899999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542282,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1256236,"kb_used_data":512804,"kb_used_omap":1,"kb_used_meta":743422,"kb_avail":93115604,"statfs":{"total":96636764160,"available":95350378496,"internally_reserved":0,"allocated":525111296,"data_stored":1129618008,"data_compressed":66697891,"data_compressed_allocated":243585024,"data_compressed_original":848297984,"omap_allocated":1594,"internal_metadata":761264582},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":10.712,"5min":5.7519999999999998,"15min":2.8180000000000001},"min":{"1min":0.27700000000000002,"5min":0.25700000000000001,"15min":0.254},"max":{"1min":148.048,"5min":148.048,"15min":148.048},"last":0.52500000000000002},{"interface":"front","average":{"1min":9.0670000000000002,"5min":5.4290000000000003,"15min":2.8690000000000002},"min":{"1min":0.34899999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":144.72999999999999,"5min":144.72999999999999,"15min":144.72999999999999},"last":0.81599999999999995}]},{"osd":1,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":9.7420000000000009,"5min":8.516,"15min":4.0419999999999998},"min":{"1min":0.32200000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":158.56,"5min":158.56,"15min":158.56},"last":0.64000000000000001},{"interface":"front","average":{"1min":8.7690000000000001,"5min":7.3419999999999996,"15min":3.448},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":144.60400000000001,"5min":144.60400000000001,"15min":144.60400000000001},"last":0.96299999999999997}]},{"osd":2,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":3.9319999999999999,"15min":2.1949999999999998},"min":{"1min":0.379,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":4.5899999999999999,"5min":109.28,"15min":109.28},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.264,"5min":4.2400000000000002,"15min":2.21},"min":{"1min":0.34599999999999997,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":4.5419999999999998,"5min":109.242,"15min":109.242},"last":0.74099999999999999}]},{"osd":3,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":9.5440000000000005,"5min":7.0369999999999999,"15min":3.4500000000000002},"min":{"1min":0.45600000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":147.625,"5min":147.625,"15min":147.625},"last":1.129},{"interface":"front","average":{"1min":9.9489999999999998,"5min":6.0170000000000003,"15min":3.355},"min":{"1min":0.41299999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":147.01599999999999,"5min":147.01599999999999,"15min":147.01599999999999},"last":0.90900000000000003}]},{"osd":5,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":1.0860000000000001,"15min":1.0249999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":2.9670000000000001,"5min":19.143999999999998,"15min":19.143999999999998},"last":1.2410000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":1.1120000000000001,"15min":1.0249999999999999},"min":{"1min":0.29099999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":2.48,"5min":27.402999999999999,"15min":27.402999999999999},"last":1.208}]},{"osd":6,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.94899999999999995,"15min":1.0720000000000001},"min":{"1min":0.32700000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":3.113,"5min":8.8889999999999993,"15min":13.891999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":1.2330000000000001,"15min":1.133},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":2.5649999999999999,"5min":17.954999999999998,"15min":17.954999999999998},"last":1.0189999999999999}]},{"osd":7,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":1.484,"15min":1.1890000000000001},"min":{"1min":0.28899999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":3.0619999999999998,"5min":27.643000000000001,"15min":27.643000000000001},"last":1.3220000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":1.2130000000000001,"15min":1.107},"min":{"1min":0.34999999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":3.0920000000000001,"5min":18.800999999999998,"15min":18.800999999999998},"last":1.389}]}]},{"osd":0,"up_from":13,"seq":55834574983,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1177632,"kb_used_data":578968,"kb_used_omap":1,"kb_used_meta":598654,"kb_avail":93194208,"statfs":{"total":96636764160,"available":95430868992,"internally_reserved":0,"allocated":592863232,"data_stored":1272555487,"data_compressed":73983711,"data_compressed_allocated":273489920,"data_compressed_original":953393152,"omap_allocated":1594,"internal_metadata":613022150},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,1,4,1,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 04:54:44 2024","interfaces":[{"interface":"back","average":{"1min":3.5670000000000002,"5min":5.9139999999999997,"15min":2.839},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":30.347000000000001,"5min":55.061,"15min":55.061},"last":7.1699999999999999},{"interface":"front","average":{"1min":3.3919999999999999,"5min":6.6890000000000001,"15min":3.1659999999999999},"min":{"1min":0.377,"5min":0.309,"15min":0.28899999999999998},"max":{"1min":11.872,"5min":115.45099999999999,"15min":115.45099999999999},"last":6.4859999999999998}]},{"osd":2,"last update":"Thu Apr 18 04:54:41 2024","interfaces":[{"interface":"back","average":{"1min":2.9929999999999999,"5min":3.1360000000000001,"15min":1.782},"min":{"1min":0.35699999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":8.7430000000000003,"5min":22.475000000000001,"15min":28.802},"last":6.1440000000000001},{"interface":"front","average":{"1min":2.6970000000000001,"5min":4.8710000000000004,"15min":2.4420000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.29399999999999998},"max":{"1min":9.7460000000000004,"5min":115.229,"15min":115.229},"last":7.0780000000000003}]},{"osd":3,"last update":"Thu Apr 18 04:54:41 2024","interfaces":[{"interface":"back","average":{"1min":3.5859999999999999,"5min":4.8010000000000002,"15min":2.4569999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":30.466000000000001,"5min":34.180999999999997,"15min":47.496000000000002},"last":10.289},{"interface":"front","average":{"1min":3.2829999999999999,"5min":5.1589999999999998,"15min":2.5310000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":19.003,"5min":115.729,"15min":115.729},"last":10.404}]},{"osd":4,"last update":"Thu Apr 18 04:54:26 2024","interfaces":[{"interface":"back","average":{"1min":1.837,"5min":3.0230000000000001,"15min":1.7749999999999999},"min":{"1min":0.38100000000000001,"5min":0.372,"15min":0.33000000000000002},"max":{"1min":6.5369999999999999,"5min":49.738999999999997,"15min":49.738999999999997},"last":6.7910000000000004},{"interface":"front","average":{"1min":3.7850000000000001,"5min":4.165,"15min":2.2429999999999999},"min":{"1min":0.47499999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":30.225000000000001,"5min":50.996000000000002,"15min":50.996000000000002},"last":10.247999999999999}]},{"osd":5,"last update":"Thu Apr 18 04:54:26 2024","interfaces":[{"interface":"back","average":{"1min":2.7949999999999999,"5min":3.0289999999999999,"15min":1.8069999999999999},"min":{"1min":0.437,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":7.6360000000000001,"5min":34.402999999999999,"15min":34.402999999999999},"last":6.851},{"interface":"front","average":{"1min":2.081,"5min":2.9049999999999998,"15min":1.847},"min":{"1min":0.51800000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":6.258,"5min":20.699000000000002,"15min":33.392000000000003},"last":6.8220000000000001}]},{"osd":6,"last update":"Thu Apr 18 04:54:26 2024","interfaces":[{"interface":"back","average":{"1min":3.3399999999999999,"5min":4.4859999999999998,"15min":2.355},"min":{"1min":0.60899999999999999,"5min":0.41999999999999998,"15min":0.40600000000000003},"max":{"1min":21.803000000000001,"5min":115.277,"15min":115.277},"last":6.8849999999999998},{"interface":"front","average":{"1min":4.3700000000000001,"5min":3.504,"15min":1.97},"min":{"1min":0.56299999999999994,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":30.279,"5min":48.652999999999999,"15min":48.652999999999999},"last":10.212999999999999}]},{"osd":7,"last update":"Thu Apr 18 04:54:26 2024","interfaces":[{"interface":"back","average":{"1min":2.6819999999999999,"5min":3.7240000000000002,"15min":2.129},"min":{"1min":0.48899999999999999,"5min":0.47099999999999997,"15min":0.437},"max":{"1min":7.2949999999999999,"5min":54.829000000000001,"15min":54.829000000000001},"last":6.7450000000000001},{"interface":"front","average":{"1min":4.0430000000000001,"5min":4.9459999999999997,"15min":2.5899999999999999},"min":{"1min":0.58599999999999997,"5min":0.49399999999999999,"15min":0.48699999999999999},"max":{"1min":30.315999999999999,"5min":115.31399999999999,"15min":115.31399999999999},"last":10.170999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33312,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33312,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3121152,"data_stored":20972180,"data_compressed":2483986,"data_compressed_allocated":2842624,"data_compressed_original":20709376,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3178496,"data_stored":20972464,"data_compressed":2531508,"data_compressed_allocated":2936832,"data_compressed_original":20754432,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1396736,"data_stored":4285475,"data_compressed":439103,"data_compressed_allocated":598016,"data_compressed_original":3510272,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6742016,"data_stored":16869536,"data_compressed":1734435,"data_compressed_allocated":2166784,"data_compressed_original":12316672,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6316032,"data_stored":29361965,"data_compressed":3215159,"data_compressed_allocated":3665920,"data_compressed_original":26726400,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":3239936,"data_stored":18154962,"data_compressed":2174151,"data_compressed_allocated":2514944,"data_compressed_original":17453056,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3473408,"data_stored":16779689,"data_compressed":2087260,"data_compressed_allocated":2478080,"data_compressed_original":15798272,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10387456,"data_stored":34932699,"data_compressed":3585780,"data_compressed_allocated":4227072,"data_compressed_original":28794880,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":515846144,"data_stored":1087262720,"data_compressed":62154190,"data_compressed_allocated":235966464,"data_compressed_original":807383040,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":729620480,"data_stored":1555185664,"data_compressed":89019788,"data_compressed_allocated":336809984,"data_compressed_original":1162375168,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":457523200,"data_stored":973942784,"data_compressed":55652416,"data_compressed_allocated":211103744,"data_compressed_original":727523328,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":778780672,"data_stored":1649655808,"data_compressed":94201311,"data_compressed_allocated":358633472,"data_compressed_original":1229508608,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":499666944,"data_stored":1060257792,"data_compressed":61328121,"data_compressed_allocated":232415232,"data_compressed_original":793006080,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":457633792,"data_stored":963354624,"data_compressed":55258268,"data_compressed_allocated":209719296,"data_compressed_original":715440128,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":571973632,"data_stored":1205014528,"data_compressed":69334817,"data_compressed_allocated":264728576,"data_compressed_original":897769472,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":483713024,"data_stored":1022021632,"data_compressed":58364002,"data_compressed_allocated":221978624,"data_compressed_original":760287232,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T04:55:29.471 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-18T04:55:29.471 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T04:55:29.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.701+0000 7fbd4f600640 1 Processor -- start 2024-04-18T04:55:29.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.701+0000 7fbd4f600640 1 -- start start 2024-04-18T04:55:29.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.705+0000 7fbd4f600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbd480c83e0 0x7fbd4806c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:29.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.705+0000 7fbd4f600640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbd481562a0 0x7fbd4814fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:29.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.705+0000 7fbd4f600640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fbd480c6210 0x7fbd4806b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:29.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.705+0000 7fbd4f600640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd4806cb30 con 0x7fbd480c6210 2024-04-18T04:55:29.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.705+0000 7fbd4f600640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd480c6f00 con 0x7fbd481562a0 2024-04-18T04:55:29.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.705+0000 7fbd4f600640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd480c57c0 con 0x7fbd480c83e0 2024-04-18T04:55:29.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.705+0000 7fbd4cc00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbd480c83e0 0x7fbd4806c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:29.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.705+0000 7fbd4d600640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fbd480c6210 0x7fbd4806b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:29.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.705+0000 7fbd4cc00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbd480c83e0 0x7fbd4806c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:44932/0 (socket says 172.21.15.120:44932) 2024-04-18T04:55:29.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.705+0000 7fbd4cc00640 1 -- 172.21.15.120:0/1271545870 learned_addr learned my addr 172.21.15.120:0/1271545870 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:29.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.705+0000 7fbd4d600640 1 -- 172.21.15.120:0/1271545870 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbd480c83e0 msgr2=0x7fbd4806c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:29.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.705+0000 7fbd4d600640 1 --2- 172.21.15.120:0/1271545870 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbd480c83e0 0x7fbd4806c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:29.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.705+0000 7fbd4d600640 1 -- 172.21.15.120:0/1271545870 >> v2:172.21.15.132:3300/0 conn(0x7fbd481562a0 msgr2=0x7fbd4814fab0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-18T04:55:29.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.705+0000 7fbd4d600640 1 --2- 172.21.15.120:0/1271545870 >> v2:172.21.15.132:3300/0 conn(0x7fbd481562a0 0x7fbd4814fab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:29.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.705+0000 7fbd4d600640 1 -- 172.21.15.120:0/1271545870 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd480c5d80 con 0x7fbd480c6210 2024-04-18T04:55:29.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.721+0000 7fbd4d600640 1 --2- 172.21.15.120:0/1271545870 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd480c6210 0x7fbd4806b660 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fbd4806ed60 tx=0x7fbd4001f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc52a912dc6cfa91 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:29.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.721+0000 7fbd47400640 1 -- 172.21.15.120:0/1271545870 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd400b0440 con 0x7fbd480c6210 2024-04-18T04:55:29.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.721+0000 7fbd47400640 1 -- 172.21.15.120:0/1271545870 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd400b05a0 con 0x7fbd480c6210 2024-04-18T04:55:29.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.721+0000 7fbd47400640 1 -- 172.21.15.120:0/1271545870 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd400b0930 con 0x7fbd480c6210 2024-04-18T04:55:29.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.725+0000 7fbd4f600640 1 -- 172.21.15.120:0/1271545870 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd480c6210 msgr2=0x7fbd4806b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:29.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.725+0000 7fbd4f600640 1 --2- 172.21.15.120:0/1271545870 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd480c6210 0x7fbd4806b660 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fbd4806ed60 tx=0x7fbd4001f130 comp rx=0 tx=0).stop 2024-04-18T04:55:29.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.729+0000 7fbd4f600640 1 -- 172.21.15.120:0/1271545870 shutdown_connections 2024-04-18T04:55:29.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.729+0000 7fbd4f600640 1 --2- 172.21.15.120:0/1271545870 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd480c6210 0x7fbd4806b660 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:29.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.729+0000 7fbd4f600640 1 --2- 172.21.15.120:0/1271545870 >> v2:172.21.15.132:3300/0 conn(0x7fbd481562a0 0x7fbd4814fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:29.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.729+0000 7fbd4f600640 1 --2- 172.21.15.120:0/1271545870 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbd480c83e0 0x7fbd4806c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:29.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.729+0000 7fbd4f600640 1 -- 172.21.15.120:0/1271545870 >> 172.21.15.120:0/1271545870 conn(0x7fbd480c78c0 msgr2=0x7fbd480c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:29.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.729+0000 7fbd4f600640 1 -- 172.21.15.120:0/1271545870 shutdown_connections 2024-04-18T04:55:29.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.729+0000 7fbd4f600640 1 -- 172.21.15.120:0/1271545870 wait complete. 2024-04-18T04:55:29.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.733+0000 7fbd4f600640 1 Processor -- start 2024-04-18T04:55:29.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.733+0000 7fbd4f600640 1 -- start start 2024-04-18T04:55:29.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.737+0000 7fbd4f600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbd480c6210 0x7fbd480c0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:29.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.737+0000 7fbd4f600640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd480c83e0 0x7fbd481fd240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:29.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.737+0000 7fbd4cc00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbd480c6210 0x7fbd480c0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:29.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.737+0000 7fbd47e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd480c83e0 0x7fbd481fd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:29.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.737+0000 7fbd47e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd480c83e0 0x7fbd481fd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:49788/0 (socket says 172.21.15.120:49788) 2024-04-18T04:55:29.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.737+0000 7fbd4cc00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbd480c6210 0x7fbd480c0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:44934/0 (socket says 172.21.15.120:44934) 2024-04-18T04:55:29.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.737+0000 7fbd47e00640 1 -- 172.21.15.120:0/3168516122 learned_addr learned my addr 172.21.15.120:0/3168516122 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:29.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.737+0000 7fbd4f600640 1 --2- 172.21.15.120:0/3168516122 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd481562a0 0x7fbd481fc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:29.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.737+0000 7fbd4d600640 1 --2- 172.21.15.120:0/3168516122 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd481562a0 0x7fbd481fc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:29.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.737+0000 7fbd4f600640 1 -- 172.21.15.120:0/3168516122 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd480c0080 con 0x7fbd481562a0 2024-04-18T04:55:29.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.737+0000 7fbd4f600640 1 -- 172.21.15.120:0/3168516122 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd481fd780 con 0x7fbd480c83e0 2024-04-18T04:55:29.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.737+0000 7fbd4f600640 1 -- 172.21.15.120:0/3168516122 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd481fcd90 con 0x7fbd480c6210 2024-04-18T04:55:29.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.737+0000 7fbd4cc00640 1 -- 172.21.15.120:0/3168516122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd480c83e0 msgr2=0x7fbd481fd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:29.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.737+0000 7fbd4cc00640 1 --2- 172.21.15.120:0/3168516122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd480c83e0 0x7fbd481fd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:29.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.737+0000 7fbd4cc00640 1 -- 172.21.15.120:0/3168516122 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd481562a0 msgr2=0x7fbd481fc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:29.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.737+0000 7fbd4cc00640 1 --2- 172.21.15.120:0/3168516122 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd481562a0 0x7fbd481fc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:29.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.737+0000 7fbd4cc00640 1 -- 172.21.15.120:0/3168516122 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd40009a70 con 0x7fbd480c6210 2024-04-18T04:55:29.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.741+0000 7fbd4cc00640 1 --2- 172.21.15.120:0/3168516122 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbd480c6210 0x7fbd480c0d40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbd3800e870 tx=0x7fbd3800ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:29.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.741+0000 7fbd44c00640 1 -- 172.21.15.120:0/3168516122 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3800c940 con 0x7fbd480c6210 2024-04-18T04:55:29.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.741+0000 7fbd44c00640 1 -- 172.21.15.120:0/3168516122 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3800caa0 con 0x7fbd480c6210 2024-04-18T04:55:29.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.741+0000 7fbd44c00640 1 -- 172.21.15.120:0/3168516122 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3800ce30 con 0x7fbd480c6210 2024-04-18T04:55:29.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.741+0000 7fbd4f600640 1 -- 172.21.15.120:0/3168516122 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd48159300 con 0x7fbd480c6210 2024-04-18T04:55:29.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.741+0000 7fbd4f600640 1 -- 172.21.15.120:0/3168516122 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd481598b0 con 0x7fbd480c6210 2024-04-18T04:55:29.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.741+0000 7fbd4f600640 1 -- 172.21.15.120:0/3168516122 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd48072a70 con 0x7fbd480c6210 2024-04-18T04:55:29.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.745+0000 7fbd44c00640 1 -- 172.21.15.120:0/3168516122 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbd38026480 con 0x7fbd480c6210 2024-04-18T04:55:29.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.745+0000 7fbd44c00640 1 --2- 172.21.15.120:0/3168516122 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fbd280666e0 0x7fbd28068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:29.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.745+0000 7fbd44c00640 1 -- 172.21.15.120:0/3168516122 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7fbd38085100 con 0x7fbd480c6210 2024-04-18T04:55:29.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.745+0000 7fbd47e00640 1 --2- 172.21.15.120:0/3168516122 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fbd280666e0 0x7fbd28068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:29.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.745+0000 7fbd47e00640 1 --2- 172.21.15.120:0/3168516122 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fbd280666e0 0x7fbd28068ba0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbd4814ed40 tx=0x7fbd34008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:29.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:29.753+0000 7fbd44c00640 1 -- 172.21.15.120:0/3168516122 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fbd38051f00 con 0x7fbd480c6210 2024-04-18T04:55:30.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.069+0000 7fbd4f600640 1 -- 172.21.15.120:0/3168516122 --> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbd480c7430 con 0x7fbd280666e0 2024-04-18T04:55:30.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.081+0000 7fbd44c00640 1 -- 172.21.15.120:0/3168516122 <== mgr.4113 v2:172.21.15.132:6832/27788 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371361 (secure 0 0 0) 0x7fbd34009e00 con 0x7fbd280666e0 2024-04-18T04:55:30.082 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:55:30.085 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-04-18T04:55:30.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.085+0000 7fbd4f600640 1 -- 172.21.15.120:0/3168516122 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fbd280666e0 msgr2=0x7fbd28068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:30.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.085+0000 7fbd4f600640 1 --2- 172.21.15.120:0/3168516122 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fbd280666e0 0x7fbd28068ba0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbd4814ed40 tx=0x7fbd34008040 comp rx=0 tx=0).stop 2024-04-18T04:55:30.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.085+0000 7fbd4f600640 1 -- 172.21.15.120:0/3168516122 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbd480c6210 msgr2=0x7fbd480c0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:30.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.085+0000 7fbd4f600640 1 --2- 172.21.15.120:0/3168516122 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbd480c6210 0x7fbd480c0d40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbd3800e870 tx=0x7fbd3800ed30 comp rx=0 tx=0).stop 2024-04-18T04:55:30.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.085+0000 7fbd4f600640 1 -- 172.21.15.120:0/3168516122 shutdown_connections 2024-04-18T04:55:30.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.085+0000 7fbd4f600640 1 --2- 172.21.15.120:0/3168516122 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fbd280666e0 0x7fbd28068ba0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:30.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.085+0000 7fbd4f600640 1 --2- 172.21.15.120:0/3168516122 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd481562a0 0x7fbd481fc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:30.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.085+0000 7fbd4f600640 1 --2- 172.21.15.120:0/3168516122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd480c83e0 0x7fbd481fd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:30.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.085+0000 7fbd4f600640 1 --2- 172.21.15.120:0/3168516122 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbd480c6210 0x7fbd480c0d40 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:30.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.085+0000 7fbd4f600640 1 -- 172.21.15.120:0/3168516122 >> 172.21.15.120:0/3168516122 conn(0x7fbd480c78c0 msgr2=0x7fbd4814e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:30.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.085+0000 7fbd4f600640 1 -- 172.21.15.120:0/3168516122 shutdown_connections 2024-04-18T04:55:30.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.085+0000 7fbd4f600640 1 -- 172.21.15.120:0/3168516122 wait complete. 2024-04-18T04:55:30.104 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":362,"stamp":"2024-04-18T04:55:29.052057+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4748936091,"num_objects":1396,"num_object_clones":0,"num_object_copies":5402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1396,"num_whiteouts":0,"num_read":667,"num_read_kb":75003,"num_write":2197443,"num_write_kb":31245688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152636,"ondisk_log_size":152636,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":10591380,"kb_used_data":4727452,"kb_used_omap":12,"kb_used_meta":5863091,"kb_avail":744383340,"statfs":{"total":773094113280,"available":762248540160,"internally_reserved":0,"allocated":4840910848,"data_stored":10369290018,"data_compressed":602296917,"data_compressed_allocated":2235453440,"data_compressed_original":7765532672,"omap_allocated":12743,"internal_metadata":6003805753},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,1,6,8,2,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":76,"apply_latency_ms":76,"commit_latency_ns":76000000,"apply_latency_ns":76000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6840363471,"num_objects":-1631,"num_object_clones":0,"num_object_copies":-6524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1631,"num_whiteouts":0,"num_read":1,"num_read_kb":2,"num_write":1687,"num_write_kb":569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004759"},"pg_stats":[{"pgid":"2.1f","version":"30'20","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.054277+0000","last_change":"2024-04-18T04:44:29.891079+0000","last_active":"2024-04-18T04:53:26.054277+0000","last_peered":"2024-04-18T04:53:26.054277+0000","last_clean":"2024-04-18T04:53:26.054277+0000","last_became_active":"2024-04-18T04:44:29.890853+0000","last_became_peered":"2024-04-18T04:44:29.890853+0000","last_unstale":"2024-04-18T04:53:26.054277+0000","last_undegraded":"2024-04-18T04:53:26.054277+0000","last_fullsized":"2024-04-18T04:53:26.054277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:12:22.299583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":4124,"num_write":18,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"32'6","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:46.162203+0000","last_change":"2024-04-18T04:44:30.296344+0000","last_active":"2024-04-18T04:54:46.162203+0000","last_peered":"2024-04-18T04:54:46.162203+0000","last_clean":"2024-04-18T04:54:46.162203+0000","last_became_active":"2024-04-18T04:44:30.296064+0000","last_became_peered":"2024-04-18T04:44:30.296064+0000","last_unstale":"2024-04-18T04:54:46.162203+0000","last_undegraded":"2024-04-18T04:54:46.162203+0000","last_fullsized":"2024-04-18T04:54:46.162203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:53:32.250308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'3929","reported_seq":3953,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.210516+0000","last_change":"2024-04-18T04:44:34.306605+0000","last_active":"2024-04-18T04:55:26.210516+0000","last_peered":"2024-04-18T04:55:26.210516+0000","last_clean":"2024-04-18T04:55:26.210516+0000","last_became_active":"2024-04-18T04:44:34.306224+0000","last_became_peered":"2024-04-18T04:44:34.306224+0000","last_unstale":"2024-04-18T04:55:26.210516+0000","last_undegraded":"2024-04-18T04:55:26.210516+0000","last_fullsized":"2024-04-18T04:55:26.210516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":3929,"log_dups_size":0,"ondisk_log_size":3929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:13:15.107711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155371727,"num_objects":45,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":58047,"num_write_kb":822950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'23","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.190960+0000","last_change":"2024-04-18T04:44:29.881521+0000","last_active":"2024-04-18T04:53:26.190960+0000","last_peered":"2024-04-18T04:53:26.190960+0000","last_clean":"2024-04-18T04:53:26.190960+0000","last_became_active":"2024-04-18T04:44:29.881258+0000","last_became_peered":"2024-04-18T04:44:29.881258+0000","last_unstale":"2024-04-18T04:53:26.190960+0000","last_undegraded":"2024-04-18T04:53:26.190960+0000","last_fullsized":"2024-04-18T04:53:26.190960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:28:40.075960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":19,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'6","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.053986+0000","last_change":"2024-04-18T04:44:30.314205+0000","last_active":"2024-04-18T04:53:26.053986+0000","last_peered":"2024-04-18T04:53:26.053986+0000","last_clean":"2024-04-18T04:53:26.053986+0000","last_became_active":"2024-04-18T04:44:30.313987+0000","last_became_peered":"2024-04-18T04:44:30.313987+0000","last_unstale":"2024-04-18T04:53:26.053986+0000","last_undegraded":"2024-04-18T04:53:26.053986+0000","last_fullsized":"2024-04-18T04:53:26.053986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:55:31.107861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"32'5285","reported_seq":5313,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:28.690001+0000","last_change":"2024-04-18T04:44:34.339646+0000","last_active":"2024-04-18T04:55:28.690001+0000","last_peered":"2024-04-18T04:55:28.690001+0000","last_clean":"2024-04-18T04:55:28.690001+0000","last_became_active":"2024-04-18T04:44:34.338485+0000","last_became_peered":"2024-04-18T04:44:34.338485+0000","last_unstale":"2024-04-18T04:55:28.690001+0000","last_undegraded":"2024-04-18T04:55:28.690001+0000","last_fullsized":"2024-04-18T04:55:28.690001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":5285,"log_dups_size":0,"ondisk_log_size":5285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:47:01.277301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151638538,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":77972,"num_write_kb":1107856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"32'74","reported_seq":106,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:32.488186+0000","last_change":"2024-04-18T04:44:29.897785+0000","last_active":"2024-04-18T04:54:32.488186+0000","last_peered":"2024-04-18T04:54:32.488186+0000","last_clean":"2024-04-18T04:54:32.488186+0000","last_became_active":"2024-04-18T04:44:29.896520+0000","last_became_peered":"2024-04-18T04:44:29.896520+0000","last_unstale":"2024-04-18T04:54:32.488186+0000","last_undegraded":"2024-04-18T04:54:32.488186+0000","last_fullsized":"2024-04-18T04:54:32.488186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:25:52.871139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":14,"num_read_kb":8212,"num_write":66,"num_write_kb":8229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"32'9","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:20.586531+0000","last_change":"2024-04-18T04:44:30.300588+0000","last_active":"2024-04-18T04:55:20.586531+0000","last_peered":"2024-04-18T04:55:20.586531+0000","last_clean":"2024-04-18T04:55:20.586531+0000","last_became_active":"2024-04-18T04:44:30.299939+0000","last_became_peered":"2024-04-18T04:44:30.299939+0000","last_unstale":"2024-04-18T04:55:20.586531+0000","last_undegraded":"2024-04-18T04:55:20.586531+0000","last_fullsized":"2024-04-18T04:55:20.586531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:57:07.547985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"32'4874","reported_seq":4899,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:28.452012+0000","last_change":"2024-04-18T04:44:34.338794+0000","last_active":"2024-04-18T04:55:28.452012+0000","last_peered":"2024-04-18T04:55:28.452012+0000","last_clean":"2024-04-18T04:55:28.452012+0000","last_became_active":"2024-04-18T04:44:34.337938+0000","last_became_peered":"2024-04-18T04:44:34.337938+0000","last_unstale":"2024-04-18T04:55:28.452012+0000","last_undegraded":"2024-04-18T04:55:28.452012+0000","last_fullsized":"2024-04-18T04:55:28.452012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4874,"log_dups_size":0,"ondisk_log_size":4874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:48.827970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159388668,"num_objects":42,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":72197,"num_write_kb":1012843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"32'88","reported_seq":116,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:20.710432+0000","last_change":"2024-04-18T04:44:29.903118+0000","last_active":"2024-04-18T04:55:20.710432+0000","last_peered":"2024-04-18T04:55:20.710432+0000","last_clean":"2024-04-18T04:55:20.710432+0000","last_became_active":"2024-04-18T04:44:29.902611+0000","last_became_peered":"2024-04-18T04:44:29.902611+0000","last_unstale":"2024-04-18T04:55:20.710432+0000","last_undegraded":"2024-04-18T04:55:20.710432+0000","last_fullsized":"2024-04-18T04:55:20.710432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:38:42.595095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":87,"num_write_kb":1391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"28'15","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.060272+0000","last_change":"2024-04-18T04:44:30.301328+0000","last_active":"2024-04-18T04:53:26.060272+0000","last_peered":"2024-04-18T04:53:26.060272+0000","last_clean":"2024-04-18T04:53:26.060272+0000","last_became_active":"2024-04-18T04:44:30.300303+0000","last_became_peered":"2024-04-18T04:44:30.300303+0000","last_unstale":"2024-04-18T04:53:26.060272+0000","last_undegraded":"2024-04-18T04:53:26.060272+0000","last_fullsized":"2024-04-18T04:53:26.060272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:24:11.941483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'4539","reported_seq":4567,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:28.022376+0000","last_change":"2024-04-18T04:44:34.327044+0000","last_active":"2024-04-18T04:55:28.022376+0000","last_peered":"2024-04-18T04:55:28.022376+0000","last_clean":"2024-04-18T04:55:28.022376+0000","last_became_active":"2024-04-18T04:44:34.326161+0000","last_became_peered":"2024-04-18T04:44:34.326161+0000","last_unstale":"2024-04-18T04:55:28.022376+0000","last_undegraded":"2024-04-18T04:55:28.022376+0000","last_fullsized":"2024-04-18T04:55:28.022376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:47:41.413530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130065996,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":5,"num_read_kb":1,"num_write":67008,"num_write_kb":936790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"32'6","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:22.738989+0000","last_change":"2024-04-18T04:44:30.296493+0000","last_active":"2024-04-18T04:55:22.738989+0000","last_peered":"2024-04-18T04:55:22.738989+0000","last_clean":"2024-04-18T04:55:22.738989+0000","last_became_active":"2024-04-18T04:44:30.295657+0000","last_became_peered":"2024-04-18T04:44:30.295657+0000","last_unstale":"2024-04-18T04:55:22.738989+0000","last_undegraded":"2024-04-18T04:55:22.738989+0000","last_fullsized":"2024-04-18T04:55:22.738989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:39:40.270643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"32'980","reported_seq":1012,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:09.820948+0000","last_change":"2024-04-18T04:44:29.900036+0000","last_active":"2024-04-18T04:55:09.820948+0000","last_peered":"2024-04-18T04:55:09.820948+0000","last_clean":"2024-04-18T04:55:09.820948+0000","last_became_active":"2024-04-18T04:44:29.899402+0000","last_became_peered":"2024-04-18T04:44:29.899402+0000","last_unstale":"2024-04-18T04:55:09.820948+0000","last_undegraded":"2024-04-18T04:55:09.820948+0000","last_fullsized":"2024-04-18T04:55:09.820948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":980,"log_dups_size":0,"ondisk_log_size":980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:45:51.681317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":4110,"num_write":977,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"32'4744","reported_seq":4772,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:28.550428+0000","last_change":"2024-04-18T04:44:34.320846+0000","last_active":"2024-04-18T04:55:28.550428+0000","last_peered":"2024-04-18T04:55:28.550428+0000","last_clean":"2024-04-18T04:55:28.550428+0000","last_became_active":"2024-04-18T04:44:34.319868+0000","last_became_peered":"2024-04-18T04:44:34.319868+0000","last_unstale":"2024-04-18T04:55:28.550428+0000","last_undegraded":"2024-04-18T04:55:28.550428+0000","last_fullsized":"2024-04-18T04:55:28.550428+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4744,"log_dups_size":0,"ondisk_log_size":4744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:08:30.863140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117447486,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":69853,"num_write_kb":985071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"32'5","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:13.500608+0000","last_change":"2024-04-18T04:44:30.271756+0000","last_active":"2024-04-18T04:55:13.500608+0000","last_peered":"2024-04-18T04:55:13.500608+0000","last_clean":"2024-04-18T04:55:13.500608+0000","last_became_active":"2024-04-18T04:44:30.271420+0000","last_became_peered":"2024-04-18T04:44:30.271420+0000","last_unstale":"2024-04-18T04:55:13.500608+0000","last_undegraded":"2024-04-18T04:55:13.500608+0000","last_fullsized":"2024-04-18T04:55:13.500608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:27:18.559327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"32'5","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:31.068025+0000","last_change":"2024-04-18T04:44:29.878416+0000","last_active":"2024-04-18T04:53:31.068025+0000","last_peered":"2024-04-18T04:53:31.068025+0000","last_clean":"2024-04-18T04:53:31.068025+0000","last_became_active":"2024-04-18T04:44:29.878139+0000","last_became_peered":"2024-04-18T04:44:29.878139+0000","last_unstale":"2024-04-18T04:53:31.068025+0000","last_undegraded":"2024-04-18T04:53:31.068025+0000","last_fullsized":"2024-04-18T04:53:31.068025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:19:00.769888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"32'4608","reported_seq":4633,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:28.604318+0000","last_change":"2024-04-18T04:44:34.346123+0000","last_active":"2024-04-18T04:55:28.604318+0000","last_peered":"2024-04-18T04:55:28.604318+0000","last_clean":"2024-04-18T04:55:28.604318+0000","last_became_active":"2024-04-18T04:44:34.345267+0000","last_became_peered":"2024-04-18T04:44:34.345267+0000","last_unstale":"2024-04-18T04:55:28.604318+0000","last_undegraded":"2024-04-18T04:55:28.604318+0000","last_fullsized":"2024-04-18T04:55:28.604318+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4608,"log_dups_size":0,"ondisk_log_size":4608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:14:08.078650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159396693,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":68092,"num_write_kb":992962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"32'7","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:21.521015+0000","last_change":"2024-04-18T04:44:30.274049+0000","last_active":"2024-04-18T04:55:21.521015+0000","last_peered":"2024-04-18T04:55:21.521015+0000","last_clean":"2024-04-18T04:55:21.521015+0000","last_became_active":"2024-04-18T04:44:30.273752+0000","last_became_peered":"2024-04-18T04:44:30.273752+0000","last_unstale":"2024-04-18T04:55:21.521015+0000","last_undegraded":"2024-04-18T04:55:21.521015+0000","last_fullsized":"2024-04-18T04:55:21.521015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:48:20.479069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'6","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:24.359306+0000","last_change":"2024-04-18T04:44:29.890569+0000","last_active":"2024-04-18T04:54:24.359306+0000","last_peered":"2024-04-18T04:54:24.359306+0000","last_clean":"2024-04-18T04:54:24.359306+0000","last_became_active":"2024-04-18T04:44:29.889684+0000","last_became_peered":"2024-04-18T04:44:29.889684+0000","last_unstale":"2024-04-18T04:54:24.359306+0000","last_undegraded":"2024-04-18T04:54:24.359306+0000","last_fullsized":"2024-04-18T04:54:24.359306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:53:00.230580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":8,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"32'4582","reported_seq":4607,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.596649+0000","last_change":"2024-04-18T04:44:34.313634+0000","last_active":"2024-04-18T04:55:26.596649+0000","last_peered":"2024-04-18T04:55:26.596649+0000","last_clean":"2024-04-18T04:55:26.596649+0000","last_became_active":"2024-04-18T04:44:34.313161+0000","last_became_peered":"2024-04-18T04:44:34.313161+0000","last_unstale":"2024-04-18T04:55:26.596649+0000","last_undegraded":"2024-04-18T04:55:26.596649+0000","last_fullsized":"2024-04-18T04:55:26.596649+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4582,"log_dups_size":0,"ondisk_log_size":4582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:01:07.805128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142611640,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":67645,"num_write_kb":962979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'1","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.071440+0000","last_change":"2024-04-18T04:44:30.284805+0000","last_active":"2024-04-18T04:53:26.071440+0000","last_peered":"2024-04-18T04:53:26.071440+0000","last_clean":"2024-04-18T04:53:26.071440+0000","last_became_active":"2024-04-18T04:44:30.279238+0000","last_became_peered":"2024-04-18T04:44:30.279238+0000","last_unstale":"2024-04-18T04:53:26.071440+0000","last_undegraded":"2024-04-18T04:53:26.071440+0000","last_fullsized":"2024-04-18T04:53:26.071440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:59:24.067420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"30'20","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:24.361610+0000","last_change":"2024-04-18T04:44:29.890816+0000","last_active":"2024-04-18T04:54:24.361610+0000","last_peered":"2024-04-18T04:54:24.361610+0000","last_clean":"2024-04-18T04:54:24.361610+0000","last_became_active":"2024-04-18T04:44:29.890272+0000","last_became_peered":"2024-04-18T04:44:29.890272+0000","last_unstale":"2024-04-18T04:54:24.361610+0000","last_undegraded":"2024-04-18T04:54:24.361610+0000","last_fullsized":"2024-04-18T04:54:24.361610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:30:22.614083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":4108,"num_write":18,"num_write_kb":4103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"32'4381","reported_seq":4406,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:28.643942+0000","last_change":"2024-04-18T04:44:34.344973+0000","last_active":"2024-04-18T04:55:28.643942+0000","last_peered":"2024-04-18T04:55:28.643942+0000","last_clean":"2024-04-18T04:55:28.643942+0000","last_became_active":"2024-04-18T04:44:34.344007+0000","last_became_peered":"2024-04-18T04:44:34.344007+0000","last_unstale":"2024-04-18T04:55:28.643942+0000","last_undegraded":"2024-04-18T04:55:28.643942+0000","last_fullsized":"2024-04-18T04:55:28.643942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4381,"log_dups_size":0,"ondisk_log_size":4381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:56:43.476132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147054500,"num_objects":43,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":64546,"num_write_kb":921811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"32'9","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:23.252520+0000","last_change":"2024-04-18T04:44:30.278193+0000","last_active":"2024-04-18T04:55:23.252520+0000","last_peered":"2024-04-18T04:55:23.252520+0000","last_clean":"2024-04-18T04:55:23.252520+0000","last_became_active":"2024-04-18T04:44:30.277916+0000","last_became_peered":"2024-04-18T04:44:30.277916+0000","last_unstale":"2024-04-18T04:55:23.252520+0000","last_undegraded":"2024-04-18T04:55:23.252520+0000","last_fullsized":"2024-04-18T04:55:23.252520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:57:19.783436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:23.867186+0000","last_change":"2024-04-18T04:44:29.896901+0000","last_active":"2024-04-18T04:54:23.867186+0000","last_peered":"2024-04-18T04:54:23.867186+0000","last_clean":"2024-04-18T04:54:23.867186+0000","last_became_active":"2024-04-18T04:44:29.896392+0000","last_became_peered":"2024-04-18T04:44:29.896392+0000","last_unstale":"2024-04-18T04:54:23.867186+0000","last_undegraded":"2024-04-18T04:54:23.867186+0000","last_fullsized":"2024-04-18T04:54:23.867186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:46:08.869450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"32'4430","reported_seq":4455,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:28.701482+0000","last_change":"2024-04-18T04:44:34.339233+0000","last_active":"2024-04-18T04:55:28.701482+0000","last_peered":"2024-04-18T04:55:28.701482+0000","last_clean":"2024-04-18T04:55:28.701482+0000","last_became_active":"2024-04-18T04:44:34.338294+0000","last_became_peered":"2024-04-18T04:44:34.338294+0000","last_unstale":"2024-04-18T04:55:28.701482+0000","last_undegraded":"2024-04-18T04:55:28.701482+0000","last_fullsized":"2024-04-18T04:55:28.701482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4430,"log_dups_size":0,"ondisk_log_size":4430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:20:35.738410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134369960,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":65531,"num_write_kb":938881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:11.458790+0000","last_change":"2024-04-18T04:45:12.045887+0000","last_active":"2024-04-18T04:55:11.458790+0000","last_peered":"2024-04-18T04:55:11.458790+0000","last_clean":"2024-04-18T04:55:11.458790+0000","last_became_active":"2024-04-18T04:45:12.045671+0000","last_became_peered":"2024-04-18T04:45:12.045671+0000","last_unstale":"2024-04-18T04:55:11.458790+0000","last_undegraded":"2024-04-18T04:55:11.458790+0000","last_fullsized":"2024-04-18T04:55:11.458790+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:22:58.022926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"32'98","reported_seq":129,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:19.758343+0000","last_change":"2024-04-18T04:44:29.894503+0000","last_active":"2024-04-18T04:55:19.758343+0000","last_peered":"2024-04-18T04:55:19.758343+0000","last_clean":"2024-04-18T04:55:19.758343+0000","last_became_active":"2024-04-18T04:44:29.894210+0000","last_became_peered":"2024-04-18T04:44:29.894210+0000","last_unstale":"2024-04-18T04:55:19.758343+0000","last_undegraded":"2024-04-18T04:55:19.758343+0000","last_fullsized":"2024-04-18T04:55:19.758343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:14:56.979204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":22,"num_write":222,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"32'4801","reported_seq":4830,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.490311+0000","last_change":"2024-04-18T04:44:34.305652+0000","last_active":"2024-04-18T04:55:26.490311+0000","last_peered":"2024-04-18T04:55:26.490311+0000","last_clean":"2024-04-18T04:55:26.490311+0000","last_became_active":"2024-04-18T04:44:34.305180+0000","last_became_peered":"2024-04-18T04:44:34.305180+0000","last_unstale":"2024-04-18T04:55:26.490311+0000","last_undegraded":"2024-04-18T04:55:26.490311+0000","last_fullsized":"2024-04-18T04:55:26.490311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4801,"log_dups_size":0,"ondisk_log_size":4801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:03:10.781821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171985668,"num_objects":47,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":70738,"num_write_kb":998644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'9","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.152733+0000","last_change":"2024-04-18T04:44:30.267158+0000","last_active":"2024-04-18T04:53:26.152733+0000","last_peered":"2024-04-18T04:53:26.152733+0000","last_clean":"2024-04-18T04:53:26.152733+0000","last_became_active":"2024-04-18T04:44:30.266814+0000","last_became_peered":"2024-04-18T04:44:30.266814+0000","last_unstale":"2024-04-18T04:53:26.152733+0000","last_undegraded":"2024-04-18T04:53:26.152733+0000","last_fullsized":"2024-04-18T04:53:26.152733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:16:02.152817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'4","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:31.064330+0000","last_change":"2024-04-18T04:44:29.898812+0000","last_active":"2024-04-18T04:53:31.064330+0000","last_peered":"2024-04-18T04:53:31.064330+0000","last_clean":"2024-04-18T04:53:31.064330+0000","last_became_active":"2024-04-18T04:44:29.897156+0000","last_became_peered":"2024-04-18T04:44:29.897156+0000","last_unstale":"2024-04-18T04:53:31.064330+0000","last_undegraded":"2024-04-18T04:53:31.064330+0000","last_fullsized":"2024-04-18T04:53:31.064330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:09:47.746394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":7,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"32'4341","reported_seq":4368,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.085562+0000","last_change":"2024-04-18T04:44:34.324721+0000","last_active":"2024-04-18T04:55:26.085562+0000","last_peered":"2024-04-18T04:55:26.085562+0000","last_clean":"2024-04-18T04:55:26.085562+0000","last_became_active":"2024-04-18T04:44:34.322925+0000","last_became_peered":"2024-04-18T04:44:34.322925+0000","last_unstale":"2024-04-18T04:55:26.085562+0000","last_undegraded":"2024-04-18T04:55:26.085562+0000","last_fullsized":"2024-04-18T04:55:26.085562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4341,"log_dups_size":0,"ondisk_log_size":4341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:11:59.682230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146853901,"num_objects":39,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":64187,"num_write_kb":906867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"32'6","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:15.171307+0000","last_change":"2024-04-18T04:44:30.281640+0000","last_active":"2024-04-18T04:55:15.171307+0000","last_peered":"2024-04-18T04:55:15.171307+0000","last_clean":"2024-04-18T04:55:15.171307+0000","last_became_active":"2024-04-18T04:44:30.280968+0000","last_became_peered":"2024-04-18T04:44:30.280968+0000","last_unstale":"2024-04-18T04:55:15.171307+0000","last_undegraded":"2024-04-18T04:55:15.171307+0000","last_fullsized":"2024-04-18T04:55:15.171307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:35:20.755711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"28'1","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.152863+0000","last_change":"2024-04-18T04:44:29.882715+0000","last_active":"2024-04-18T04:53:26.152863+0000","last_peered":"2024-04-18T04:53:26.152863+0000","last_clean":"2024-04-18T04:53:26.152863+0000","last_became_active":"2024-04-18T04:44:29.882335+0000","last_became_peered":"2024-04-18T04:44:29.882335+0000","last_unstale":"2024-04-18T04:53:26.152863+0000","last_undegraded":"2024-04-18T04:53:26.152863+0000","last_fullsized":"2024-04-18T04:53:26.152863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:32:59.709151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4605","reported_seq":4634,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.574135+0000","last_change":"2024-04-18T04:44:34.325029+0000","last_active":"2024-04-18T04:55:26.574135+0000","last_peered":"2024-04-18T04:55:26.574135+0000","last_clean":"2024-04-18T04:55:26.574135+0000","last_became_active":"2024-04-18T04:44:34.324082+0000","last_became_peered":"2024-04-18T04:44:34.324082+0000","last_unstale":"2024-04-18T04:55:26.574135+0000","last_undegraded":"2024-04-18T04:55:26.574135+0000","last_fullsized":"2024-04-18T04:55:26.574135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4605,"log_dups_size":0,"ondisk_log_size":4605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:28:10.378037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125853714,"num_objects":35,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":67945,"num_write_kb":954001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"32'8","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:24.111261+0000","last_change":"2024-04-18T04:44:30.276174+0000","last_active":"2024-04-18T04:55:24.111261+0000","last_peered":"2024-04-18T04:55:24.111261+0000","last_clean":"2024-04-18T04:55:24.111261+0000","last_became_active":"2024-04-18T04:44:30.270878+0000","last_became_peered":"2024-04-18T04:44:30.270878+0000","last_unstale":"2024-04-18T04:55:24.111261+0000","last_undegraded":"2024-04-18T04:55:24.111261+0000","last_fullsized":"2024-04-18T04:55:24.111261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:35:12.296277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"30'27","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.060101+0000","last_change":"2024-04-18T04:44:29.896745+0000","last_active":"2024-04-18T04:53:26.060101+0000","last_peered":"2024-04-18T04:53:26.060101+0000","last_clean":"2024-04-18T04:53:26.060101+0000","last_became_active":"2024-04-18T04:44:29.896199+0000","last_became_peered":"2024-04-18T04:44:29.896199+0000","last_unstale":"2024-04-18T04:53:26.060101+0000","last_undegraded":"2024-04-18T04:53:26.060101+0000","last_fullsized":"2024-04-18T04:53:26.060101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:25:05.424668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":22,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"32'5211","reported_seq":5239,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:27.144302+0000","last_change":"2024-04-18T04:44:34.337429+0000","last_active":"2024-04-18T04:55:27.144302+0000","last_peered":"2024-04-18T04:55:27.144302+0000","last_clean":"2024-04-18T04:55:27.144302+0000","last_became_active":"2024-04-18T04:44:34.337089+0000","last_became_peered":"2024-04-18T04:44:34.337089+0000","last_unstale":"2024-04-18T04:55:27.144302+0000","last_undegraded":"2024-04-18T04:55:27.144302+0000","last_fullsized":"2024-04-18T04:55:27.144302+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":5211,"log_dups_size":0,"ondisk_log_size":5211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:00:56.976431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159418516,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":76822,"num_write_kb":1090506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"32'9","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:37.740338+0000","last_change":"2024-04-18T04:44:30.270874+0000","last_active":"2024-04-18T04:54:37.740338+0000","last_peered":"2024-04-18T04:54:37.740338+0000","last_clean":"2024-04-18T04:54:37.740338+0000","last_became_active":"2024-04-18T04:44:30.270636+0000","last_became_peered":"2024-04-18T04:44:30.270636+0000","last_unstale":"2024-04-18T04:54:37.740338+0000","last_undegraded":"2024-04-18T04:54:37.740338+0000","last_fullsized":"2024-04-18T04:54:37.740338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:25:49.889554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"32'42","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:17.017144+0000","last_change":"2024-04-18T04:44:29.878607+0000","last_active":"2024-04-18T04:55:17.017144+0000","last_peered":"2024-04-18T04:55:17.017144+0000","last_clean":"2024-04-18T04:55:17.017144+0000","last_became_active":"2024-04-18T04:44:29.878330+0000","last_became_peered":"2024-04-18T04:44:29.878330+0000","last_unstale":"2024-04-18T04:55:17.017144+0000","last_undegraded":"2024-04-18T04:55:17.017144+0000","last_fullsized":"2024-04-18T04:55:17.017144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:09:18.088701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90443,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":42,"num_read_kb":118,"num_write":37,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'4379","reported_seq":4405,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:28.025953+0000","last_change":"2024-04-18T04:44:34.323315+0000","last_active":"2024-04-18T04:55:28.025953+0000","last_peered":"2024-04-18T04:55:28.025953+0000","last_clean":"2024-04-18T04:55:28.025953+0000","last_became_active":"2024-04-18T04:44:34.322983+0000","last_became_peered":"2024-04-18T04:44:34.322983+0000","last_unstale":"2024-04-18T04:55:28.025953+0000","last_undegraded":"2024-04-18T04:55:28.025953+0000","last_fullsized":"2024-04-18T04:55:28.025953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4379,"log_dups_size":0,"ondisk_log_size":4379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:48:12.803273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142628390,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":64665,"num_write_kb":914612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"27'2","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.052645+0000","last_change":"2024-04-18T04:44:30.285533+0000","last_active":"2024-04-18T04:53:26.052645+0000","last_peered":"2024-04-18T04:53:26.052645+0000","last_clean":"2024-04-18T04:53:26.052645+0000","last_became_active":"2024-04-18T04:44:30.285113+0000","last_became_peered":"2024-04-18T04:44:30.285113+0000","last_unstale":"2024-04-18T04:53:26.052645+0000","last_undegraded":"2024-04-18T04:53:26.052645+0000","last_fullsized":"2024-04-18T04:53:26.052645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:37:20.367349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"32'29","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:35.068171+0000","last_change":"2024-04-18T04:44:29.890701+0000","last_active":"2024-04-18T04:53:35.068171+0000","last_peered":"2024-04-18T04:53:35.068171+0000","last_clean":"2024-04-18T04:53:35.068171+0000","last_became_active":"2024-04-18T04:44:29.890207+0000","last_became_peered":"2024-04-18T04:44:29.890207+0000","last_unstale":"2024-04-18T04:53:35.068171+0000","last_undegraded":"2024-04-18T04:53:35.068171+0000","last_fullsized":"2024-04-18T04:53:35.068171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:06:58.470725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":8204,"num_write":25,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"32'5213","reported_seq":5250,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.130337+0000","last_change":"2024-04-18T04:45:12.378646+0000","last_active":"2024-04-18T04:55:26.130337+0000","last_peered":"2024-04-18T04:55:26.130337+0000","last_clean":"2024-04-18T04:55:26.130337+0000","last_became_active":"2024-04-18T04:45:12.378263+0000","last_became_peered":"2024-04-18T04:45:12.378263+0000","last_unstale":"2024-04-18T04:55:26.130337+0000","last_undegraded":"2024-04-18T04:55:26.130337+0000","last_fullsized":"2024-04-18T04:55:26.130337+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":5213,"log_dups_size":0,"ondisk_log_size":5213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:59:31.439452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188934285,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":76573,"num_write_kb":1101398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"32'9","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:51.197830+0000","last_change":"2024-04-18T04:44:30.306826+0000","last_active":"2024-04-18T04:54:51.197830+0000","last_peered":"2024-04-18T04:54:51.197830+0000","last_clean":"2024-04-18T04:54:51.197830+0000","last_became_active":"2024-04-18T04:44:30.306320+0000","last_became_peered":"2024-04-18T04:44:30.306320+0000","last_unstale":"2024-04-18T04:54:51.197830+0000","last_undegraded":"2024-04-18T04:54:51.197830+0000","last_fullsized":"2024-04-18T04:54:51.197830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:47:38.564197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"25'3","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:23.242696+0000","last_change":"2024-04-18T04:44:29.888023+0000","last_active":"2024-04-18T04:54:23.242696+0000","last_peered":"2024-04-18T04:54:23.242696+0000","last_clean":"2024-04-18T04:54:23.242696+0000","last_became_active":"2024-04-18T04:44:29.887440+0000","last_became_peered":"2024-04-18T04:44:29.887440+0000","last_unstale":"2024-04-18T04:54:23.242696+0000","last_undegraded":"2024-04-18T04:54:23.242696+0000","last_fullsized":"2024-04-18T04:54:23.242696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:07:01.067445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":20,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":180,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.040633+0000","last_change":"2024-04-18T04:44:18.629794+0000","last_active":"2024-04-18T04:53:26.040633+0000","last_peered":"2024-04-18T04:53:26.040633+0000","last_clean":"2024-04-18T04:53:26.040633+0000","last_became_active":"2024-04-18T04:44:18.627792+0000","last_became_peered":"2024-04-18T04:44:18.627792+0000","last_unstale":"2024-04-18T04:53:26.040633+0000","last_undegraded":"2024-04-18T04:53:26.040633+0000","last_fullsized":"2024-04-18T04:53:26.040633+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:17.410146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:17.410146+0000","last_clean_scrub_stamp":"2024-04-18T04:44:17.410146+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:30:49.101656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"32'4220","reported_seq":4245,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:28.528663+0000","last_change":"2024-04-18T04:44:34.333286+0000","last_active":"2024-04-18T04:55:28.528663+0000","last_peered":"2024-04-18T04:55:28.528663+0000","last_clean":"2024-04-18T04:55:28.528663+0000","last_became_active":"2024-04-18T04:44:34.332520+0000","last_became_peered":"2024-04-18T04:44:34.332520+0000","last_unstale":"2024-04-18T04:55:28.528663+0000","last_undegraded":"2024-04-18T04:55:28.528663+0000","last_fullsized":"2024-04-18T04:55:28.528663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4220,"log_dups_size":0,"ondisk_log_size":4220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:58:48.264040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113263486,"num_objects":32,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":62342,"num_write_kb":880557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"32'6","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:23.472187+0000","last_change":"2024-04-18T04:44:30.303602+0000","last_active":"2024-04-18T04:55:23.472187+0000","last_peered":"2024-04-18T04:55:23.472187+0000","last_clean":"2024-04-18T04:55:23.472187+0000","last_became_active":"2024-04-18T04:44:30.302157+0000","last_became_peered":"2024-04-18T04:44:30.302157+0000","last_unstale":"2024-04-18T04:55:23.472187+0000","last_undegraded":"2024-04-18T04:55:23.472187+0000","last_fullsized":"2024-04-18T04:55:23.472187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:09:57.582065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"32'6","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:35.662461+0000","last_change":"2024-04-18T04:44:29.890428+0000","last_active":"2024-04-18T04:53:35.662461+0000","last_peered":"2024-04-18T04:53:35.662461+0000","last_clean":"2024-04-18T04:53:35.662461+0000","last_became_active":"2024-04-18T04:44:29.890166+0000","last_became_peered":"2024-04-18T04:44:29.890166+0000","last_unstale":"2024-04-18T04:53:35.662461+0000","last_undegraded":"2024-04-18T04:53:35.662461+0000","last_fullsized":"2024-04-18T04:53:35.662461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:21:16.823377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":14,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"32'3624","reported_seq":3654,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:28.684335+0000","last_change":"2024-04-18T04:44:34.334071+0000","last_active":"2024-04-18T04:55:28.684335+0000","last_peered":"2024-04-18T04:55:28.684335+0000","last_clean":"2024-04-18T04:55:28.684335+0000","last_became_active":"2024-04-18T04:44:34.332695+0000","last_became_peered":"2024-04-18T04:44:34.332695+0000","last_unstale":"2024-04-18T04:55:28.684335+0000","last_undegraded":"2024-04-18T04:55:28.684335+0000","last_fullsized":"2024-04-18T04:55:28.684335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":3624,"log_dups_size":0,"ondisk_log_size":3624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:22:52.371921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100719055,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":53412,"num_write_kb":771461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'7","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.059834+0000","last_change":"2024-04-18T04:44:30.287908+0000","last_active":"2024-04-18T04:53:26.059834+0000","last_peered":"2024-04-18T04:53:26.059834+0000","last_clean":"2024-04-18T04:53:26.059834+0000","last_became_active":"2024-04-18T04:44:30.287217+0000","last_became_peered":"2024-04-18T04:44:30.287217+0000","last_unstale":"2024-04-18T04:53:26.059834+0000","last_undegraded":"2024-04-18T04:53:26.059834+0000","last_fullsized":"2024-04-18T04:53:26.059834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:47:14.962330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"30'24","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.057944+0000","last_change":"2024-04-18T04:44:29.886376+0000","last_active":"2024-04-18T04:53:26.057944+0000","last_peered":"2024-04-18T04:53:26.057944+0000","last_clean":"2024-04-18T04:53:26.057944+0000","last_became_active":"2024-04-18T04:44:29.886058+0000","last_became_peered":"2024-04-18T04:44:29.886058+0000","last_unstale":"2024-04-18T04:53:26.057944+0000","last_undegraded":"2024-04-18T04:53:26.057944+0000","last_fullsized":"2024-04-18T04:53:26.057944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:29:59.678071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":23,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"32'4528","reported_seq":4564,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.207971+0000","last_change":"2024-04-18T04:45:12.373987+0000","last_active":"2024-04-18T04:55:26.207971+0000","last_peered":"2024-04-18T04:55:26.207971+0000","last_clean":"2024-04-18T04:55:26.207971+0000","last_became_active":"2024-04-18T04:45:12.373269+0000","last_became_peered":"2024-04-18T04:45:12.373269+0000","last_unstale":"2024-04-18T04:55:26.207971+0000","last_undegraded":"2024-04-18T04:55:26.207971+0000","last_fullsized":"2024-04-18T04:55:26.207971+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4528,"log_dups_size":0,"ondisk_log_size":4528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:19:01.073786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155454305,"num_objects":45,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":66874,"num_write_kb":952859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"32'8","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:16.060876+0000","last_change":"2024-04-18T04:45:12.043098+0000","last_active":"2024-04-18T04:54:16.060876+0000","last_peered":"2024-04-18T04:54:16.060876+0000","last_clean":"2024-04-18T04:54:16.060876+0000","last_became_active":"2024-04-18T04:45:12.042803+0000","last_became_peered":"2024-04-18T04:45:12.042803+0000","last_unstale":"2024-04-18T04:54:16.060876+0000","last_undegraded":"2024-04-18T04:54:16.060876+0000","last_fullsized":"2024-04-18T04:54:16.060876+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:15:13.837607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"32'269","reported_seq":299,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:09.768555+0000","last_change":"2024-04-18T04:44:29.878650+0000","last_active":"2024-04-18T04:55:09.768555+0000","last_peered":"2024-04-18T04:55:09.768555+0000","last_clean":"2024-04-18T04:55:09.768555+0000","last_became_active":"2024-04-18T04:44:29.878361+0000","last_became_peered":"2024-04-18T04:44:29.878361+0000","last_unstale":"2024-04-18T04:55:09.768555+0000","last_undegraded":"2024-04-18T04:55:09.768555+0000","last_fullsized":"2024-04-18T04:55:09.768555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:57:41.162118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":678,"num_write":267,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"32'4376","reported_seq":4408,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:27.143593+0000","last_change":"2024-04-18T04:44:34.339023+0000","last_active":"2024-04-18T04:55:27.143593+0000","last_peered":"2024-04-18T04:55:27.143593+0000","last_clean":"2024-04-18T04:55:27.143593+0000","last_became_active":"2024-04-18T04:44:34.338042+0000","last_became_peered":"2024-04-18T04:44:34.338042+0000","last_unstale":"2024-04-18T04:55:27.143593+0000","last_undegraded":"2024-04-18T04:55:27.143593+0000","last_fullsized":"2024-04-18T04:55:27.143593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4376,"log_dups_size":0,"ondisk_log_size":4376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:48:58.174635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117535785,"num_objects":35,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":64576,"num_write_kb":926956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'4","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.041326+0000","last_change":"2024-04-18T04:44:30.291740+0000","last_active":"2024-04-18T04:53:26.041326+0000","last_peered":"2024-04-18T04:53:26.041326+0000","last_clean":"2024-04-18T04:53:26.041326+0000","last_became_active":"2024-04-18T04:44:30.290379+0000","last_became_peered":"2024-04-18T04:44:30.290379+0000","last_unstale":"2024-04-18T04:53:26.041326+0000","last_undegraded":"2024-04-18T04:53:26.041326+0000","last_fullsized":"2024-04-18T04:53:26.041326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:44:25.111858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"31'9","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.071265+0000","last_change":"2024-04-18T04:44:29.882833+0000","last_active":"2024-04-18T04:53:26.071265+0000","last_peered":"2024-04-18T04:53:26.071265+0000","last_clean":"2024-04-18T04:53:26.071265+0000","last_became_active":"2024-04-18T04:44:29.881671+0000","last_became_peered":"2024-04-18T04:44:29.881671+0000","last_unstale":"2024-04-18T04:53:26.071265+0000","last_undegraded":"2024-04-18T04:53:26.071265+0000","last_fullsized":"2024-04-18T04:53:26.071265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:29:22.037641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"32'4089","reported_seq":4122,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:28.286106+0000","last_change":"2024-04-18T04:44:34.342465+0000","last_active":"2024-04-18T04:55:28.286106+0000","last_peered":"2024-04-18T04:55:28.286106+0000","last_clean":"2024-04-18T04:55:28.286106+0000","last_became_active":"2024-04-18T04:44:34.340327+0000","last_became_peered":"2024-04-18T04:44:34.340327+0000","last_unstale":"2024-04-18T04:55:28.286106+0000","last_undegraded":"2024-04-18T04:55:28.286106+0000","last_fullsized":"2024-04-18T04:55:28.286106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4089,"log_dups_size":0,"ondisk_log_size":4089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:31:44.168899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109063355,"num_objects":32,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":60228,"num_write_kb":847949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"32'8","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:16.049759+0000","last_change":"2024-04-18T04:44:30.299403+0000","last_active":"2024-04-18T04:55:16.049759+0000","last_peered":"2024-04-18T04:55:16.049759+0000","last_clean":"2024-04-18T04:55:16.049759+0000","last_became_active":"2024-04-18T04:44:30.298417+0000","last_became_peered":"2024-04-18T04:44:30.298417+0000","last_unstale":"2024-04-18T04:55:16.049759+0000","last_undegraded":"2024-04-18T04:55:16.049759+0000","last_fullsized":"2024-04-18T04:55:16.049759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:43:24.120294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"30'18","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:23.250796+0000","last_change":"2024-04-18T04:44:29.875345+0000","last_active":"2024-04-18T04:54:23.250796+0000","last_peered":"2024-04-18T04:54:23.250796+0000","last_clean":"2024-04-18T04:54:23.250796+0000","last_became_active":"2024-04-18T04:44:29.875059+0000","last_became_peered":"2024-04-18T04:44:29.875059+0000","last_unstale":"2024-04-18T04:54:23.250796+0000","last_undegraded":"2024-04-18T04:54:23.250796+0000","last_fullsized":"2024-04-18T04:54:23.250796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:06:54.218096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":44,"num_read_kb":43,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"32'5049","reported_seq":5076,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.206877+0000","last_change":"2024-04-18T04:44:34.334498+0000","last_active":"2024-04-18T04:55:26.206877+0000","last_peered":"2024-04-18T04:55:26.206877+0000","last_clean":"2024-04-18T04:55:26.206877+0000","last_became_active":"2024-04-18T04:44:34.334192+0000","last_became_peered":"2024-04-18T04:44:34.334192+0000","last_unstale":"2024-04-18T04:55:26.206877+0000","last_undegraded":"2024-04-18T04:55:26.206877+0000","last_fullsized":"2024-04-18T04:55:26.206877+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":5049,"log_dups_size":0,"ondisk_log_size":5049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:15:49.669556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176506941,"num_objects":56,"num_object_clones":0,"num_object_copies":224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":74352,"num_write_kb":1061210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'6","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.072591+0000","last_change":"2024-04-18T04:44:30.298289+0000","last_active":"2024-04-18T04:53:26.072591+0000","last_peered":"2024-04-18T04:53:26.072591+0000","last_clean":"2024-04-18T04:53:26.072591+0000","last_became_active":"2024-04-18T04:44:30.295404+0000","last_became_peered":"2024-04-18T04:44:30.295404+0000","last_unstale":"2024-04-18T04:53:26.072591+0000","last_undegraded":"2024-04-18T04:53:26.072591+0000","last_fullsized":"2024-04-18T04:53:26.072591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:10:32.465032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"30'12","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.072652+0000","last_change":"2024-04-18T04:44:29.894196+0000","last_active":"2024-04-18T04:53:26.072652+0000","last_peered":"2024-04-18T04:53:26.072652+0000","last_clean":"2024-04-18T04:53:26.072652+0000","last_became_active":"2024-04-18T04:44:29.893668+0000","last_became_peered":"2024-04-18T04:44:29.893668+0000","last_unstale":"2024-04-18T04:53:26.072652+0000","last_undegraded":"2024-04-18T04:53:26.072652+0000","last_fullsized":"2024-04-18T04:53:26.072652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:39:03.812043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1711,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":11,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"32'5154","reported_seq":5191,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.412455+0000","last_change":"2024-04-18T04:45:12.057192+0000","last_active":"2024-04-18T04:55:26.412455+0000","last_peered":"2024-04-18T04:55:26.412455+0000","last_clean":"2024-04-18T04:55:26.412455+0000","last_became_active":"2024-04-18T04:45:12.056680+0000","last_became_peered":"2024-04-18T04:45:12.056680+0000","last_unstale":"2024-04-18T04:55:26.412455+0000","last_undegraded":"2024-04-18T04:55:26.412455+0000","last_fullsized":"2024-04-18T04:55:26.412455+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":5154,"log_dups_size":0,"ondisk_log_size":5154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:48:07.893811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155198053,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":76078,"num_write_kb":1080690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'19","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:20.352066+0000","last_change":"2024-04-18T04:44:30.289122+0000","last_active":"2024-04-18T04:55:20.352066+0000","last_peered":"2024-04-18T04:55:20.352066+0000","last_clean":"2024-04-18T04:55:20.352066+0000","last_became_active":"2024-04-18T04:44:30.288364+0000","last_became_peered":"2024-04-18T04:44:30.288364+0000","last_unstale":"2024-04-18T04:55:20.352066+0000","last_undegraded":"2024-04-18T04:55:20.352066+0000","last_fullsized":"2024-04-18T04:55:20.352066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:04:02.162723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"32'6","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:23.255678+0000","last_change":"2024-04-18T04:44:29.894521+0000","last_active":"2024-04-18T04:54:23.255678+0000","last_peered":"2024-04-18T04:54:23.255678+0000","last_clean":"2024-04-18T04:54:23.255678+0000","last_became_active":"2024-04-18T04:44:29.889150+0000","last_became_peered":"2024-04-18T04:44:29.889150+0000","last_unstale":"2024-04-18T04:54:23.255678+0000","last_undegraded":"2024-04-18T04:54:23.255678+0000","last_fullsized":"2024-04-18T04:54:23.255678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:39:13.323434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'4511","reported_seq":4540,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.478346+0000","last_change":"2024-04-18T04:44:34.305657+0000","last_active":"2024-04-18T04:55:26.478346+0000","last_peered":"2024-04-18T04:55:26.478346+0000","last_clean":"2024-04-18T04:55:26.478346+0000","last_became_active":"2024-04-18T04:44:34.305341+0000","last_became_peered":"2024-04-18T04:44:34.305341+0000","last_unstale":"2024-04-18T04:55:26.478346+0000","last_undegraded":"2024-04-18T04:55:26.478346+0000","last_fullsized":"2024-04-18T04:55:26.478346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4511,"log_dups_size":0,"ondisk_log_size":4511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:32:39.937173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134316344,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":66695,"num_write_kb":961503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'6","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.055595+0000","last_change":"2024-04-18T04:44:30.307042+0000","last_active":"2024-04-18T04:53:26.055595+0000","last_peered":"2024-04-18T04:53:26.055595+0000","last_clean":"2024-04-18T04:53:26.055595+0000","last_became_active":"2024-04-18T04:44:30.306726+0000","last_became_peered":"2024-04-18T04:44:30.306726+0000","last_unstale":"2024-04-18T04:53:26.055595+0000","last_undegraded":"2024-04-18T04:53:26.055595+0000","last_fullsized":"2024-04-18T04:53:26.055595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:55:33.543142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"30'34","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:23.851102+0000","last_change":"2024-04-18T04:44:29.887498+0000","last_active":"2024-04-18T04:54:23.851102+0000","last_peered":"2024-04-18T04:54:23.851102+0000","last_clean":"2024-04-18T04:54:23.851102+0000","last_became_active":"2024-04-18T04:44:29.887095+0000","last_became_peered":"2024-04-18T04:44:29.887095+0000","last_unstale":"2024-04-18T04:54:23.851102+0000","last_undegraded":"2024-04-18T04:54:23.851102+0000","last_fullsized":"2024-04-18T04:54:23.851102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:54:34.700562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":31,"num_read_kb":8224,"num_write":33,"num_write_kb":8211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"32'4753","reported_seq":4780,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.447430+0000","last_change":"2024-04-18T04:44:34.322042+0000","last_active":"2024-04-18T04:55:26.447430+0000","last_peered":"2024-04-18T04:55:26.447430+0000","last_clean":"2024-04-18T04:55:26.447430+0000","last_became_active":"2024-04-18T04:44:34.320776+0000","last_became_peered":"2024-04-18T04:44:34.320776+0000","last_unstale":"2024-04-18T04:55:26.447430+0000","last_undegraded":"2024-04-18T04:55:26.447430+0000","last_fullsized":"2024-04-18T04:55:26.447430+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4753,"log_dups_size":0,"ondisk_log_size":4753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:53:47.399337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":70272,"num_write_kb":986201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"32'7","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:12.485852+0000","last_change":"2024-04-18T04:44:30.299413+0000","last_active":"2024-04-18T04:54:12.485852+0000","last_peered":"2024-04-18T04:54:12.485852+0000","last_clean":"2024-04-18T04:54:12.485852+0000","last_became_active":"2024-04-18T04:44:30.293185+0000","last_became_peered":"2024-04-18T04:44:30.293185+0000","last_unstale":"2024-04-18T04:54:12.485852+0000","last_undegraded":"2024-04-18T04:54:12.485852+0000","last_fullsized":"2024-04-18T04:54:12.485852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:43:53.831429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"32'227","reported_seq":261,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:11.183288+0000","last_change":"2024-04-18T04:44:29.893351+0000","last_active":"2024-04-18T04:55:11.183288+0000","last_peered":"2024-04-18T04:55:11.183288+0000","last_clean":"2024-04-18T04:55:11.183288+0000","last_became_active":"2024-04-18T04:44:29.892647+0000","last_became_peered":"2024-04-18T04:44:29.892647+0000","last_unstale":"2024-04-18T04:55:11.183288+0000","last_undegraded":"2024-04-18T04:55:11.183288+0000","last_fullsized":"2024-04-18T04:55:11.183288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:16:59.759149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":21,"num_read_kb":4116,"num_write":227,"num_write_kb":4214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"32'4351","reported_seq":4380,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:27.183407+0000","last_change":"2024-04-18T04:44:34.337866+0000","last_active":"2024-04-18T04:55:27.183407+0000","last_peered":"2024-04-18T04:55:27.183407+0000","last_clean":"2024-04-18T04:55:27.183407+0000","last_became_active":"2024-04-18T04:44:34.337486+0000","last_became_peered":"2024-04-18T04:44:34.337486+0000","last_unstale":"2024-04-18T04:55:27.183407+0000","last_undegraded":"2024-04-18T04:55:27.183407+0000","last_fullsized":"2024-04-18T04:55:27.183407+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4351,"log_dups_size":0,"ondisk_log_size":4351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:42:13.751926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151027841,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":6,"num_read_kb":1,"num_write":64269,"num_write_kb":903689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"32'8","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:13.017999+0000","last_change":"2024-04-18T04:44:30.308477+0000","last_active":"2024-04-18T04:55:13.017999+0000","last_peered":"2024-04-18T04:55:13.017999+0000","last_clean":"2024-04-18T04:55:13.017999+0000","last_became_active":"2024-04-18T04:44:30.307237+0000","last_became_peered":"2024-04-18T04:44:30.307237+0000","last_unstale":"2024-04-18T04:55:13.017999+0000","last_undegraded":"2024-04-18T04:55:13.017999+0000","last_fullsized":"2024-04-18T04:55:13.017999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:33:58.300542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"32'17","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:11.182386+0000","last_change":"2024-04-18T04:44:29.898488+0000","last_active":"2024-04-18T04:55:11.182386+0000","last_peered":"2024-04-18T04:55:11.182386+0000","last_clean":"2024-04-18T04:55:11.182386+0000","last_became_active":"2024-04-18T04:44:29.898113+0000","last_became_peered":"2024-04-18T04:44:29.898113+0000","last_unstale":"2024-04-18T04:55:11.182386+0000","last_undegraded":"2024-04-18T04:55:11.182386+0000","last_fullsized":"2024-04-18T04:55:11.182386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:11:14.585142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":18,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'5497","reported_seq":5524,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:28.605942+0000","last_change":"2024-04-18T04:44:34.344769+0000","last_active":"2024-04-18T04:55:28.605942+0000","last_peered":"2024-04-18T04:55:28.605942+0000","last_clean":"2024-04-18T04:55:28.605942+0000","last_became_active":"2024-04-18T04:44:34.343636+0000","last_became_peered":"2024-04-18T04:44:34.343636+0000","last_unstale":"2024-04-18T04:55:28.605942+0000","last_undegraded":"2024-04-18T04:55:28.605942+0000","last_fullsized":"2024-04-18T04:55:28.605942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":5497,"log_dups_size":0,"ondisk_log_size":5497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:45:09.481681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155395188,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":4,"num_read_kb":7,"num_write":80968,"num_write_kb":1156235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"28'9","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.054159+0000","last_change":"2024-04-18T04:44:30.290494+0000","last_active":"2024-04-18T04:53:26.054159+0000","last_peered":"2024-04-18T04:53:26.054159+0000","last_clean":"2024-04-18T04:53:26.054159+0000","last_became_active":"2024-04-18T04:44:30.290127+0000","last_became_peered":"2024-04-18T04:44:30.290127+0000","last_unstale":"2024-04-18T04:53:26.054159+0000","last_undegraded":"2024-04-18T04:53:26.054159+0000","last_fullsized":"2024-04-18T04:53:26.054159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:34:21.239813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'3","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:23.256537+0000","last_change":"2024-04-18T04:44:29.895686+0000","last_active":"2024-04-18T04:54:23.256537+0000","last_peered":"2024-04-18T04:54:23.256537+0000","last_clean":"2024-04-18T04:54:23.256537+0000","last_became_active":"2024-04-18T04:44:29.895083+0000","last_became_peered":"2024-04-18T04:44:29.895083+0000","last_unstale":"2024-04-18T04:54:23.256537+0000","last_undegraded":"2024-04-18T04:54:23.256537+0000","last_fullsized":"2024-04-18T04:54:23.256537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:27:17.897401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"32'4714","reported_seq":4742,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.504835+0000","last_change":"2024-04-18T04:44:34.338412+0000","last_active":"2024-04-18T04:55:26.504835+0000","last_peered":"2024-04-18T04:55:26.504835+0000","last_clean":"2024-04-18T04:55:26.504835+0000","last_became_active":"2024-04-18T04:44:34.338062+0000","last_became_peered":"2024-04-18T04:44:34.338062+0000","last_unstale":"2024-04-18T04:55:26.504835+0000","last_undegraded":"2024-04-18T04:55:26.504835+0000","last_fullsized":"2024-04-18T04:55:26.504835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4714,"log_dups_size":0,"ondisk_log_size":4714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:49:28.342905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146809673,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":69716,"num_write_kb":985522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"32'5","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:13.261662+0000","last_change":"2024-04-18T04:44:30.307946+0000","last_active":"2024-04-18T04:54:13.261662+0000","last_peered":"2024-04-18T04:54:13.261662+0000","last_clean":"2024-04-18T04:54:13.261662+0000","last_became_active":"2024-04-18T04:44:30.307168+0000","last_became_peered":"2024-04-18T04:44:30.307168+0000","last_unstale":"2024-04-18T04:54:13.261662+0000","last_undegraded":"2024-04-18T04:54:13.261662+0000","last_fullsized":"2024-04-18T04:54:13.261662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:43:56.218333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"32'9","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:11.183996+0000","last_change":"2024-04-18T04:44:29.903183+0000","last_active":"2024-04-18T04:55:11.183996+0000","last_peered":"2024-04-18T04:55:11.183996+0000","last_clean":"2024-04-18T04:55:11.183996+0000","last_became_active":"2024-04-18T04:44:29.902647+0000","last_became_peered":"2024-04-18T04:44:29.902647+0000","last_unstale":"2024-04-18T04:55:11.183996+0000","last_undegraded":"2024-04-18T04:55:11.183996+0000","last_fullsized":"2024-04-18T04:55:11.183996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:45:13.009571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"32'5912","reported_seq":5940,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.438465+0000","last_change":"2024-04-18T04:44:34.338653+0000","last_active":"2024-04-18T04:55:26.438465+0000","last_peered":"2024-04-18T04:55:26.438465+0000","last_clean":"2024-04-18T04:55:26.438465+0000","last_became_active":"2024-04-18T04:44:34.338288+0000","last_became_peered":"2024-04-18T04:44:34.338288+0000","last_unstale":"2024-04-18T04:55:26.438465+0000","last_undegraded":"2024-04-18T04:55:26.438465+0000","last_fullsized":"2024-04-18T04:55:26.438465+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":5912,"log_dups_size":0,"ondisk_log_size":5912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:58:27.654288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188767411,"num_objects":50,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":87637,"num_write_kb":1229683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"32'4038","reported_seq":4064,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:25.971766+0000","last_change":"2024-04-18T04:44:34.306999+0000","last_active":"2024-04-18T04:55:25.971766+0000","last_peered":"2024-04-18T04:55:25.971766+0000","last_clean":"2024-04-18T04:55:25.971766+0000","last_became_active":"2024-04-18T04:44:34.306657+0000","last_became_peered":"2024-04-18T04:44:34.306657+0000","last_unstale":"2024-04-18T04:55:25.971766+0000","last_undegraded":"2024-04-18T04:55:25.971766+0000","last_fullsized":"2024-04-18T04:55:25.971766+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4038,"log_dups_size":0,"ondisk_log_size":4038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:52:58.512928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134308908,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":59665,"num_write_kb":838973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'8","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:21.443487+0000","last_change":"2024-04-18T04:44:30.271947+0000","last_active":"2024-04-18T04:54:21.443487+0000","last_peered":"2024-04-18T04:54:21.443487+0000","last_clean":"2024-04-18T04:54:21.443487+0000","last_became_active":"2024-04-18T04:44:30.271619+0000","last_became_peered":"2024-04-18T04:44:30.271619+0000","last_unstale":"2024-04-18T04:54:21.443487+0000","last_undegraded":"2024-04-18T04:54:21.443487+0000","last_fullsized":"2024-04-18T04:54:21.443487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:32:11.612016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"32'51","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:35.414182+0000","last_change":"2024-04-18T04:44:29.897616+0000","last_active":"2024-04-18T04:53:35.414182+0000","last_peered":"2024-04-18T04:53:35.414182+0000","last_clean":"2024-04-18T04:53:35.414182+0000","last_became_active":"2024-04-18T04:44:29.889922+0000","last_became_peered":"2024-04-18T04:44:29.889922+0000","last_unstale":"2024-04-18T04:53:35.414182+0000","last_undegraded":"2024-04-18T04:53:35.414182+0000","last_fullsized":"2024-04-18T04:53:35.414182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:11:52.717768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":45,"num_write_kb":8216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4522","reported_seq":4553,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.305383+0000","last_change":"2024-04-18T04:44:34.333403+0000","last_active":"2024-04-18T04:55:26.305383+0000","last_peered":"2024-04-18T04:55:26.305383+0000","last_clean":"2024-04-18T04:55:26.305383+0000","last_became_active":"2024-04-18T04:44:34.332551+0000","last_became_peered":"2024-04-18T04:44:34.332551+0000","last_unstale":"2024-04-18T04:55:26.305383+0000","last_undegraded":"2024-04-18T04:55:26.305383+0000","last_fullsized":"2024-04-18T04:55:26.305383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4522,"log_dups_size":0,"ondisk_log_size":4522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:33:28.594002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167818369,"num_objects":45,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":66716,"num_write_kb":945017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"32'11","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:13.935887+0000","last_change":"2024-04-18T04:44:30.271099+0000","last_active":"2024-04-18T04:55:13.935887+0000","last_peered":"2024-04-18T04:55:13.935887+0000","last_clean":"2024-04-18T04:55:13.935887+0000","last_became_active":"2024-04-18T04:44:30.270804+0000","last_became_peered":"2024-04-18T04:44:30.270804+0000","last_unstale":"2024-04-18T04:55:13.935887+0000","last_undegraded":"2024-04-18T04:55:13.935887+0000","last_fullsized":"2024-04-18T04:55:13.935887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:18:27.955171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"30'3","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.330903+0000","last_change":"2024-04-18T04:44:29.895084+0000","last_active":"2024-04-18T04:53:26.330903+0000","last_peered":"2024-04-18T04:53:26.330903+0000","last_clean":"2024-04-18T04:53:26.330903+0000","last_became_active":"2024-04-18T04:44:29.894829+0000","last_became_peered":"2024-04-18T04:44:29.894829+0000","last_unstale":"2024-04-18T04:53:26.330903+0000","last_undegraded":"2024-04-18T04:53:26.330903+0000","last_fullsized":"2024-04-18T04:53:26.330903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:54.812428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"31'9","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.075642+0000","last_change":"2024-04-18T04:44:29.892826+0000","last_active":"2024-04-18T04:53:26.075642+0000","last_peered":"2024-04-18T04:53:26.075642+0000","last_clean":"2024-04-18T04:53:26.075642+0000","last_became_active":"2024-04-18T04:44:29.892282+0000","last_became_peered":"2024-04-18T04:44:29.892282+0000","last_unstale":"2024-04-18T04:53:26.075642+0000","last_undegraded":"2024-04-18T04:53:26.075642+0000","last_fullsized":"2024-04-18T04:53:26.075642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:02.844116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":4108,"num_write":6,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"32'7","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:31.494584+0000","last_change":"2024-04-18T04:44:30.285312+0000","last_active":"2024-04-18T04:54:31.494584+0000","last_peered":"2024-04-18T04:54:31.494584+0000","last_clean":"2024-04-18T04:54:31.494584+0000","last_became_active":"2024-04-18T04:44:30.285055+0000","last_became_peered":"2024-04-18T04:44:30.285055+0000","last_unstale":"2024-04-18T04:54:31.494584+0000","last_undegraded":"2024-04-18T04:54:31.494584+0000","last_fullsized":"2024-04-18T04:54:31.494584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:50:00.641018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"32'4854","reported_seq":4880,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.097110+0000","last_change":"2024-04-18T04:44:34.323352+0000","last_active":"2024-04-18T04:55:26.097110+0000","last_peered":"2024-04-18T04:55:26.097110+0000","last_clean":"2024-04-18T04:55:26.097110+0000","last_became_active":"2024-04-18T04:44:34.321645+0000","last_became_peered":"2024-04-18T04:44:34.321645+0000","last_unstale":"2024-04-18T04:55:26.097110+0000","last_undegraded":"2024-04-18T04:55:26.097110+0000","last_fullsized":"2024-04-18T04:55:26.097110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4854,"log_dups_size":0,"ondisk_log_size":4854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:33:27.387013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167802796,"num_objects":43,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":71773,"num_write_kb":1022773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"32'1260","reported_seq":1292,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:35.652289+0000","last_change":"2024-04-18T04:44:29.891865+0000","last_active":"2024-04-18T04:54:35.652289+0000","last_peered":"2024-04-18T04:54:35.652289+0000","last_clean":"2024-04-18T04:54:35.652289+0000","last_became_active":"2024-04-18T04:44:29.891610+0000","last_became_peered":"2024-04-18T04:44:29.891610+0000","last_unstale":"2024-04-18T04:54:35.652289+0000","last_undegraded":"2024-04-18T04:54:35.652289+0000","last_fullsized":"2024-04-18T04:54:35.652289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1260,"log_dups_size":0,"ondisk_log_size":1260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:36:42.266497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195509,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7,"num_read_kb":4100,"num_write":1254,"num_write_kb":4235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"32'7","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:11.290815+0000","last_change":"2024-04-18T04:44:30.279080+0000","last_active":"2024-04-18T04:55:11.290815+0000","last_peered":"2024-04-18T04:55:11.290815+0000","last_clean":"2024-04-18T04:55:11.290815+0000","last_became_active":"2024-04-18T04:44:30.278275+0000","last_became_peered":"2024-04-18T04:44:30.278275+0000","last_unstale":"2024-04-18T04:55:11.290815+0000","last_undegraded":"2024-04-18T04:55:11.290815+0000","last_fullsized":"2024-04-18T04:55:11.290815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:51:48.272703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'4526","reported_seq":4552,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.329304+0000","last_change":"2024-04-18T04:44:34.313835+0000","last_active":"2024-04-18T04:55:26.329304+0000","last_peered":"2024-04-18T04:55:26.329304+0000","last_clean":"2024-04-18T04:55:26.329304+0000","last_became_active":"2024-04-18T04:44:34.313416+0000","last_became_peered":"2024-04-18T04:44:34.313416+0000","last_unstale":"2024-04-18T04:55:26.329304+0000","last_undegraded":"2024-04-18T04:55:26.329304+0000","last_fullsized":"2024-04-18T04:55:26.329304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4526,"log_dups_size":0,"ondisk_log_size":4526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:57:47.245809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125956318,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":66433,"num_write_kb":963599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"32'13","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:25.041653+0000","last_change":"2024-04-18T04:44:30.297229+0000","last_active":"2024-04-18T04:55:25.041653+0000","last_peered":"2024-04-18T04:55:25.041653+0000","last_clean":"2024-04-18T04:55:25.041653+0000","last_became_active":"2024-04-18T04:44:30.296354+0000","last_became_peered":"2024-04-18T04:44:30.296354+0000","last_unstale":"2024-04-18T04:55:25.041653+0000","last_undegraded":"2024-04-18T04:55:25.041653+0000","last_fullsized":"2024-04-18T04:55:25.041653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:30:35.845106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"32'11","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:01.204805+0000","last_change":"2024-04-18T04:44:30.281213+0000","last_active":"2024-04-18T04:55:01.204805+0000","last_peered":"2024-04-18T04:55:01.204805+0000","last_clean":"2024-04-18T04:55:01.204805+0000","last_became_active":"2024-04-18T04:44:30.280941+0000","last_became_peered":"2024-04-18T04:44:30.280941+0000","last_unstale":"2024-04-18T04:55:01.204805+0000","last_undegraded":"2024-04-18T04:55:01.204805+0000","last_fullsized":"2024-04-18T04:55:01.204805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:15:37.795670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"32'7","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:58.280219+0000","last_change":"2024-04-18T04:44:30.288507+0000","last_active":"2024-04-18T04:54:58.280219+0000","last_peered":"2024-04-18T04:54:58.280219+0000","last_clean":"2024-04-18T04:54:58.280219+0000","last_became_active":"2024-04-18T04:44:30.287820+0000","last_became_peered":"2024-04-18T04:44:30.287820+0000","last_unstale":"2024-04-18T04:54:58.280219+0000","last_undegraded":"2024-04-18T04:54:58.280219+0000","last_fullsized":"2024-04-18T04:54:58.280219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:25:29.500586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"32'7","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:20.767557+0000","last_change":"2024-04-18T04:44:30.273278+0000","last_active":"2024-04-18T04:55:20.767557+0000","last_peered":"2024-04-18T04:55:20.767557+0000","last_clean":"2024-04-18T04:55:20.767557+0000","last_became_active":"2024-04-18T04:44:30.272973+0000","last_became_peered":"2024-04-18T04:44:30.272973+0000","last_unstale":"2024-04-18T04:55:20.767557+0000","last_undegraded":"2024-04-18T04:55:20.767557+0000","last_fullsized":"2024-04-18T04:55:20.767557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:37:02.421925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'5","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:16.520446+0000","last_change":"2024-04-18T04:44:30.298936+0000","last_active":"2024-04-18T04:55:16.520446+0000","last_peered":"2024-04-18T04:55:16.520446+0000","last_clean":"2024-04-18T04:55:16.520446+0000","last_became_active":"2024-04-18T04:44:30.298637+0000","last_became_peered":"2024-04-18T04:44:30.298637+0000","last_unstale":"2024-04-18T04:55:16.520446+0000","last_undegraded":"2024-04-18T04:55:16.520446+0000","last_fullsized":"2024-04-18T04:55:16.520446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:04:33.188772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"32'7","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:19.622852+0000","last_change":"2024-04-18T04:44:30.274613+0000","last_active":"2024-04-18T04:55:19.622852+0000","last_peered":"2024-04-18T04:55:19.622852+0000","last_clean":"2024-04-18T04:55:19.622852+0000","last_became_active":"2024-04-18T04:44:30.274328+0000","last_became_peered":"2024-04-18T04:44:30.274328+0000","last_unstale":"2024-04-18T04:55:19.622852+0000","last_undegraded":"2024-04-18T04:55:19.622852+0000","last_fullsized":"2024-04-18T04:55:19.622852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:55:41.700955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"32'10","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:23.715434+0000","last_change":"2024-04-18T04:44:30.309403+0000","last_active":"2024-04-18T04:55:23.715434+0000","last_peered":"2024-04-18T04:55:23.715434+0000","last_clean":"2024-04-18T04:55:23.715434+0000","last_became_active":"2024-04-18T04:44:30.308415+0000","last_became_peered":"2024-04-18T04:44:30.308415+0000","last_unstale":"2024-04-18T04:55:23.715434+0000","last_undegraded":"2024-04-18T04:55:23.715434+0000","last_fullsized":"2024-04-18T04:55:23.715434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:51:58.935503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'2","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.360123+0000","last_change":"2024-04-18T04:44:30.293996+0000","last_active":"2024-04-18T04:53:26.360123+0000","last_peered":"2024-04-18T04:53:26.360123+0000","last_clean":"2024-04-18T04:53:26.360123+0000","last_became_active":"2024-04-18T04:44:30.293748+0000","last_became_peered":"2024-04-18T04:44:30.293748+0000","last_unstale":"2024-04-18T04:53:26.360123+0000","last_undegraded":"2024-04-18T04:53:26.360123+0000","last_fullsized":"2024-04-18T04:53:26.360123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:18:32.116499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'6","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.083146+0000","last_change":"2024-04-18T04:45:12.040362+0000","last_active":"2024-04-18T04:53:26.083146+0000","last_peered":"2024-04-18T04:53:26.083146+0000","last_clean":"2024-04-18T04:53:26.083146+0000","last_became_active":"2024-04-18T04:45:12.040045+0000","last_became_peered":"2024-04-18T04:45:12.040045+0000","last_unstale":"2024-04-18T04:53:26.083146+0000","last_undegraded":"2024-04-18T04:53:26.083146+0000","last_fullsized":"2024-04-18T04:53:26.083146+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:18:21.482610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"27'6","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.330791+0000","last_change":"2024-04-18T04:44:30.285836+0000","last_active":"2024-04-18T04:53:26.330791+0000","last_peered":"2024-04-18T04:53:26.330791+0000","last_clean":"2024-04-18T04:53:26.330791+0000","last_became_active":"2024-04-18T04:44:30.285602+0000","last_became_peered":"2024-04-18T04:44:30.285602+0000","last_unstale":"2024-04-18T04:53:26.330791+0000","last_undegraded":"2024-04-18T04:53:26.330791+0000","last_fullsized":"2024-04-18T04:53:26.330791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:34:39.594780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"32'11","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:25.424434+0000","last_change":"2024-04-18T04:45:12.040347+0000","last_active":"2024-04-18T04:55:25.424434+0000","last_peered":"2024-04-18T04:55:25.424434+0000","last_clean":"2024-04-18T04:55:25.424434+0000","last_became_active":"2024-04-18T04:45:12.040023+0000","last_became_peered":"2024-04-18T04:45:12.040023+0000","last_unstale":"2024-04-18T04:55:25.424434+0000","last_undegraded":"2024-04-18T04:55:25.424434+0000","last_fullsized":"2024-04-18T04:55:25.424434+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:24.207082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"32'13","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:11.342743+0000","last_change":"2024-04-18T04:44:30.310229+0000","last_active":"2024-04-18T04:55:11.342743+0000","last_peered":"2024-04-18T04:55:11.342743+0000","last_clean":"2024-04-18T04:55:11.342743+0000","last_became_active":"2024-04-18T04:44:30.310045+0000","last_became_peered":"2024-04-18T04:44:30.310045+0000","last_unstale":"2024-04-18T04:55:11.342743+0000","last_undegraded":"2024-04-18T04:55:11.342743+0000","last_fullsized":"2024-04-18T04:55:11.342743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:22:55.588300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"32'7","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:33.397879+0000","last_change":"2024-04-18T04:44:30.305644+0000","last_active":"2024-04-18T04:53:33.397879+0000","last_peered":"2024-04-18T04:53:33.397879+0000","last_clean":"2024-04-18T04:53:33.397879+0000","last_became_active":"2024-04-18T04:44:30.304921+0000","last_became_peered":"2024-04-18T04:44:30.304921+0000","last_unstale":"2024-04-18T04:53:33.397879+0000","last_undegraded":"2024-04-18T04:53:33.397879+0000","last_fullsized":"2024-04-18T04:53:33.397879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:17:37.235711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"32'8","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:14.326934+0000","last_change":"2024-04-18T04:44:30.294105+0000","last_active":"2024-04-18T04:55:14.326934+0000","last_peered":"2024-04-18T04:55:14.326934+0000","last_clean":"2024-04-18T04:55:14.326934+0000","last_became_active":"2024-04-18T04:44:30.291742+0000","last_became_peered":"2024-04-18T04:44:30.291742+0000","last_unstale":"2024-04-18T04:55:14.326934+0000","last_undegraded":"2024-04-18T04:55:14.326934+0000","last_fullsized":"2024-04-18T04:55:14.326934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:43:26.428261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"32'13","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:14.192589+0000","last_change":"2024-04-18T04:44:30.296496+0000","last_active":"2024-04-18T04:55:14.192589+0000","last_peered":"2024-04-18T04:55:14.192589+0000","last_clean":"2024-04-18T04:55:14.192589+0000","last_became_active":"2024-04-18T04:44:30.296177+0000","last_became_peered":"2024-04-18T04:44:30.296177+0000","last_unstale":"2024-04-18T04:55:14.192589+0000","last_undegraded":"2024-04-18T04:55:14.192589+0000","last_fullsized":"2024-04-18T04:55:14.192589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:46:44.829326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"32'10","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:12.557481+0000","last_change":"2024-04-18T04:44:30.306568+0000","last_active":"2024-04-18T04:55:12.557481+0000","last_peered":"2024-04-18T04:55:12.557481+0000","last_clean":"2024-04-18T04:55:12.557481+0000","last_became_active":"2024-04-18T04:44:30.305674+0000","last_became_peered":"2024-04-18T04:44:30.305674+0000","last_unstale":"2024-04-18T04:55:12.557481+0000","last_undegraded":"2024-04-18T04:55:12.557481+0000","last_fullsized":"2024-04-18T04:55:12.557481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:58:10.740164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"32'9","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:53.219717+0000","last_change":"2024-04-18T04:44:30.307297+0000","last_active":"2024-04-18T04:53:53.219717+0000","last_peered":"2024-04-18T04:53:53.219717+0000","last_clean":"2024-04-18T04:53:53.219717+0000","last_became_active":"2024-04-18T04:44:30.305470+0000","last_became_peered":"2024-04-18T04:44:30.305470+0000","last_unstale":"2024-04-18T04:53:53.219717+0000","last_undegraded":"2024-04-18T04:53:53.219717+0000","last_fullsized":"2024-04-18T04:53:53.219717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:01:00.587115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"32'8","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:00.541342+0000","last_change":"2024-04-18T04:44:30.280849+0000","last_active":"2024-04-18T04:54:00.541342+0000","last_peered":"2024-04-18T04:54:00.541342+0000","last_clean":"2024-04-18T04:54:00.541342+0000","last_became_active":"2024-04-18T04:44:30.280535+0000","last_became_peered":"2024-04-18T04:44:30.280535+0000","last_unstale":"2024-04-18T04:54:00.541342+0000","last_undegraded":"2024-04-18T04:54:00.541342+0000","last_fullsized":"2024-04-18T04:54:00.541342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:01:06.241941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"28'6","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.055479+0000","last_change":"2024-04-18T04:44:30.278849+0000","last_active":"2024-04-18T04:53:26.055479+0000","last_peered":"2024-04-18T04:53:26.055479+0000","last_clean":"2024-04-18T04:53:26.055479+0000","last_became_active":"2024-04-18T04:44:30.278624+0000","last_became_peered":"2024-04-18T04:44:30.278624+0000","last_unstale":"2024-04-18T04:53:26.055479+0000","last_undegraded":"2024-04-18T04:53:26.055479+0000","last_fullsized":"2024-04-18T04:53:26.055479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:31:30.791150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"32'11","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:12.455040+0000","last_change":"2024-04-18T04:44:30.296148+0000","last_active":"2024-04-18T04:55:12.455040+0000","last_peered":"2024-04-18T04:55:12.455040+0000","last_clean":"2024-04-18T04:55:12.455040+0000","last_became_active":"2024-04-18T04:44:30.295754+0000","last_became_peered":"2024-04-18T04:44:30.295754+0000","last_unstale":"2024-04-18T04:55:12.455040+0000","last_undegraded":"2024-04-18T04:55:12.455040+0000","last_fullsized":"2024-04-18T04:55:12.455040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:39:53.809075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"32'4","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:13.881674+0000","last_change":"2024-04-18T04:44:30.298061+0000","last_active":"2024-04-18T04:54:13.881674+0000","last_peered":"2024-04-18T04:54:13.881674+0000","last_clean":"2024-04-18T04:54:13.881674+0000","last_became_active":"2024-04-18T04:44:30.297416+0000","last_became_peered":"2024-04-18T04:44:30.297416+0000","last_unstale":"2024-04-18T04:54:13.881674+0000","last_undegraded":"2024-04-18T04:54:13.881674+0000","last_fullsized":"2024-04-18T04:54:13.881674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:35:48.612670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"32'10","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:13.568254+0000","last_change":"2024-04-18T04:44:30.292802+0000","last_active":"2024-04-18T04:54:13.568254+0000","last_peered":"2024-04-18T04:54:13.568254+0000","last_clean":"2024-04-18T04:54:13.568254+0000","last_became_active":"2024-04-18T04:44:30.291939+0000","last_became_peered":"2024-04-18T04:44:30.291939+0000","last_unstale":"2024-04-18T04:54:13.568254+0000","last_undegraded":"2024-04-18T04:54:13.568254+0000","last_fullsized":"2024-04-18T04:54:13.568254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:33:04.689561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"32'14","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:23.368193+0000","last_change":"2024-04-18T04:44:30.309020+0000","last_active":"2024-04-18T04:55:23.368193+0000","last_peered":"2024-04-18T04:55:23.368193+0000","last_clean":"2024-04-18T04:55:23.368193+0000","last_became_active":"2024-04-18T04:44:30.307604+0000","last_became_peered":"2024-04-18T04:44:30.307604+0000","last_unstale":"2024-04-18T04:55:23.368193+0000","last_undegraded":"2024-04-18T04:55:23.368193+0000","last_fullsized":"2024-04-18T04:55:23.368193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:44:54.764284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"32'11","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:12.485930+0000","last_change":"2024-04-18T04:44:30.314533+0000","last_active":"2024-04-18T04:54:12.485930+0000","last_peered":"2024-04-18T04:54:12.485930+0000","last_clean":"2024-04-18T04:54:12.485930+0000","last_became_active":"2024-04-18T04:44:30.313985+0000","last_became_peered":"2024-04-18T04:44:30.313985+0000","last_unstale":"2024-04-18T04:54:12.485930+0000","last_undegraded":"2024-04-18T04:54:12.485930+0000","last_fullsized":"2024-04-18T04:54:12.485930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:02:03.941709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"32'7","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:30.364882+0000","last_change":"2024-04-18T04:44:30.309273+0000","last_active":"2024-04-18T04:54:30.364882+0000","last_peered":"2024-04-18T04:54:30.364882+0000","last_clean":"2024-04-18T04:54:30.364882+0000","last_became_active":"2024-04-18T04:44:30.309002+0000","last_became_peered":"2024-04-18T04:44:30.309002+0000","last_unstale":"2024-04-18T04:54:30.364882+0000","last_undegraded":"2024-04-18T04:54:30.364882+0000","last_fullsized":"2024-04-18T04:54:30.364882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:49:10.005359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'6","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.040583+0000","last_change":"2024-04-18T04:44:30.292371+0000","last_active":"2024-04-18T04:53:26.040583+0000","last_peered":"2024-04-18T04:53:26.040583+0000","last_clean":"2024-04-18T04:53:26.040583+0000","last_became_active":"2024-04-18T04:44:30.290504+0000","last_became_peered":"2024-04-18T04:44:30.290504+0000","last_unstale":"2024-04-18T04:53:26.040583+0000","last_undegraded":"2024-04-18T04:53:26.040583+0000","last_fullsized":"2024-04-18T04:53:26.040583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:11.998355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"32'8","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:13.246271+0000","last_change":"2024-04-18T04:44:30.299935+0000","last_active":"2024-04-18T04:55:13.246271+0000","last_peered":"2024-04-18T04:55:13.246271+0000","last_clean":"2024-04-18T04:55:13.246271+0000","last_became_active":"2024-04-18T04:44:30.290175+0000","last_became_peered":"2024-04-18T04:44:30.290175+0000","last_unstale":"2024-04-18T04:55:13.246271+0000","last_undegraded":"2024-04-18T04:55:13.246271+0000","last_fullsized":"2024-04-18T04:55:13.246271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:15:13.703423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"32'4","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:32.488111+0000","last_change":"2024-04-18T04:44:30.288940+0000","last_active":"2024-04-18T04:54:32.488111+0000","last_peered":"2024-04-18T04:54:32.488111+0000","last_clean":"2024-04-18T04:54:32.488111+0000","last_became_active":"2024-04-18T04:44:30.288131+0000","last_became_peered":"2024-04-18T04:44:30.288131+0000","last_unstale":"2024-04-18T04:54:32.488111+0000","last_undegraded":"2024-04-18T04:54:32.488111+0000","last_fullsized":"2024-04-18T04:54:32.488111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:31:08.895305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"32'7","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:17.401285+0000","last_change":"2024-04-18T04:44:30.288066+0000","last_active":"2024-04-18T04:55:17.401285+0000","last_peered":"2024-04-18T04:55:17.401285+0000","last_clean":"2024-04-18T04:55:17.401285+0000","last_became_active":"2024-04-18T04:44:30.287325+0000","last_became_peered":"2024-04-18T04:44:30.287325+0000","last_unstale":"2024-04-18T04:55:17.401285+0000","last_undegraded":"2024-04-18T04:55:17.401285+0000","last_fullsized":"2024-04-18T04:55:17.401285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:58:04.111225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"32'5","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:46.514757+0000","last_change":"2024-04-18T04:44:30.275485+0000","last_active":"2024-04-18T04:54:46.514757+0000","last_peered":"2024-04-18T04:54:46.514757+0000","last_clean":"2024-04-18T04:54:46.514757+0000","last_became_active":"2024-04-18T04:44:30.275118+0000","last_became_peered":"2024-04-18T04:44:30.275118+0000","last_unstale":"2024-04-18T04:54:46.514757+0000","last_undegraded":"2024-04-18T04:54:46.514757+0000","last_fullsized":"2024-04-18T04:54:46.514757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:25:09.625660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'2","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.060440+0000","last_change":"2024-04-18T04:44:30.277119+0000","last_active":"2024-04-18T04:53:26.060440+0000","last_peered":"2024-04-18T04:53:26.060440+0000","last_clean":"2024-04-18T04:53:26.060440+0000","last_became_active":"2024-04-18T04:44:30.276654+0000","last_became_peered":"2024-04-18T04:44:30.276654+0000","last_unstale":"2024-04-18T04:53:26.060440+0000","last_undegraded":"2024-04-18T04:53:26.060440+0000","last_fullsized":"2024-04-18T04:53:26.060440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:52.420199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"32'10","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:57.496321+0000","last_change":"2024-04-18T04:44:30.302905+0000","last_active":"2024-04-18T04:54:57.496321+0000","last_peered":"2024-04-18T04:54:57.496321+0000","last_clean":"2024-04-18T04:54:57.496321+0000","last_became_active":"2024-04-18T04:44:30.302180+0000","last_became_peered":"2024-04-18T04:44:30.302180+0000","last_unstale":"2024-04-18T04:54:57.496321+0000","last_undegraded":"2024-04-18T04:54:57.496321+0000","last_fullsized":"2024-04-18T04:54:57.496321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:41:53.211956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":4667181238,"num_objects":1305,"num_object_clones":0,"num_object_copies":5220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1305,"num_whiteouts":0,"num_read":129,"num_read_kb":11,"num_write":2193827,"num_write_kb":31163048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4494757888,"data_stored":9516695552,"data_compressed":545312913,"data_compressed_allocated":2071355392,"data_compressed_original":7093293056,"omap_allocated":0,"internal_metadata":0},"log_size":148640,"ondisk_log_size":148640,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":498,"ondisk_log_size":498,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":81164485,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":422,"num_read_kb":74892,"num_write":3457,"num_write_kb":80224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":37855232,"data_stored":162328970,"data_compressed":18251382,"data_compressed_allocated":21430272,"data_compressed_original":146063360,"omap_allocated":0,"internal_metadata":0},"log_size":3381,"ondisk_log_size":3381,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66624,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509574,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1857768,"kb_used_data":892896,"kb_used_omap":1,"kb_used_meta":964862,"kb_avail":92514072,"statfs":{"total":96636764160,"available":94734409728,"internally_reserved":0,"allocated":914325504,"data_stored":1945598923,"data_compressed":111856752,"data_compressed_allocated":421683200,"data_compressed_original":1453170688,"omap_allocated":1592,"internal_metadata":988019144},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:54:39 2024","interfaces":[{"interface":"back","average":{"1min":4.0309999999999997,"5min":6.7530000000000001,"15min":3.347},"min":{"1min":0.52900000000000003,"5min":0.26200000000000001,"15min":0.252},"max":{"1min":15.353,"5min":76.096999999999994,"15min":76.096999999999994},"last":0.44},{"interface":"front","average":{"1min":4.7009999999999996,"5min":8.4860000000000007,"15min":3.7530000000000001},"min":{"1min":0.38500000000000001,"5min":0.254,"15min":0.254},"max":{"1min":15.515000000000001,"5min":184.16999999999999,"15min":184.16999999999999},"last":0.36299999999999999}]},{"osd":1,"last update":"Thu Apr 18 04:54:39 2024","interfaces":[{"interface":"back","average":{"1min":4.7480000000000002,"5min":7.343,"15min":4.3520000000000003},"min":{"1min":0.38700000000000001,"5min":0.34699999999999998,"15min":0.24299999999999999},"max":{"1min":18.978999999999999,"5min":85.109999999999999,"15min":153.59299999999999},"last":1.381},{"interface":"front","average":{"1min":5.1680000000000001,"5min":5.9489999999999998,"15min":4.0469999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.29199999999999998},"max":{"1min":20.414999999999999,"5min":88.606999999999999,"15min":153.94300000000001},"last":1.54}]},{"osd":2,"last update":"Thu Apr 18 04:54:39 2024","interfaces":[{"interface":"back","average":{"1min":3.8010000000000002,"5min":3.6190000000000002,"15min":2.6429999999999998},"min":{"1min":0.58899999999999997,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":19.745000000000001,"5min":23.867000000000001,"15min":162.59700000000001},"last":1.2749999999999999},{"interface":"front","average":{"1min":4.8499999999999996,"5min":4.5759999999999996,"15min":2.9590000000000001},"min":{"1min":0.46000000000000002,"5min":0.309,"15min":0.309},"max":{"1min":19.707999999999998,"5min":28.335000000000001,"15min":153.83500000000001},"last":2.8170000000000002}]},{"osd":4,"last update":"Thu Apr 18 04:54:39 2024","interfaces":[{"interface":"back","average":{"1min":3.2789999999999999,"5min":2.847,"15min":1.7450000000000001},"min":{"1min":0.433,"5min":0.43099999999999999,"15min":0.40000000000000002},"max":{"1min":12.050000000000001,"5min":31.974,"15min":31.974},"last":1.3069999999999999},{"interface":"front","average":{"1min":3.802,"5min":5.0670000000000002,"15min":2.718},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":15.006,"5min":50.536000000000001,"15min":50.536000000000001},"last":0.72999999999999998}]},{"osd":5,"last update":"Thu Apr 18 04:54:39 2024","interfaces":[{"interface":"back","average":{"1min":3.456,"5min":3.7509999999999999,"15min":2.3279999999999998},"min":{"1min":0.40899999999999997,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":12.981,"5min":40.915999999999997,"15min":40.915999999999997},"last":0.69399999999999995},{"interface":"front","average":{"1min":3.4169999999999998,"5min":2.6850000000000001,"15min":1.9710000000000001},"min":{"1min":0.59499999999999997,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":18.103000000000002,"5min":18.103000000000002,"15min":68.370000000000005},"last":0.78100000000000003}]},{"osd":6,"last update":"Thu Apr 18 04:54:39 2024","interfaces":[{"interface":"back","average":{"1min":3.3959999999999999,"5min":3.5880000000000001,"15min":2.2360000000000002},"min":{"1min":0.60899999999999999,"5min":0.45100000000000001,"15min":0.39900000000000002},"max":{"1min":17.058,"5min":28.748000000000001,"15min":48.765000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":3.4129999999999998,"5min":4.7320000000000002,"15min":2.593},"min":{"1min":0.68400000000000005,"5min":0.47199999999999998,"15min":0.38900000000000001},"max":{"1min":12.656000000000001,"5min":69.227999999999994,"15min":69.227999999999994},"last":1.2370000000000001}]},{"osd":7,"last update":"Thu Apr 18 04:54:39 2024","interfaces":[{"interface":"back","average":{"1min":3.77,"5min":3.2320000000000002,"15min":2.1030000000000002},"min":{"1min":0.49199999999999999,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":18.795000000000002,"5min":40.947000000000003,"15min":40.947000000000003},"last":1.337},{"interface":"front","average":{"1min":3.331,"5min":3.3410000000000002,"15min":2.2200000000000002},"min":{"1min":0.65000000000000002,"5min":0.54500000000000004,"15min":0.44400000000000001},"max":{"1min":17.122,"5min":19.512,"15min":68.329999999999998},"last":0.81999999999999995}]}]},{"osd":2,"up_from":15,"seq":64424509575,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1030932,"kb_used_data":479828,"kb_used_omap":1,"kb_used_meta":550334,"kb_avail":93340908,"statfs":{"total":96636764160,"available":95581089792,"internally_reserved":0,"allocated":491343872,"data_stored":1051780942,"data_compressed":60292170,"data_compressed_allocated":226811904,"data_compressed_original":787464192,"omap_allocated":1594,"internal_metadata":563542470},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":3.7570000000000001,"5min":4.9139999999999997,"15min":3.3690000000000002},"min":{"1min":0.66300000000000003,"5min":0.248,"15min":0.23300000000000001},"max":{"1min":15.831,"5min":37.567,"15min":120.402},"last":0.53500000000000003},{"interface":"front","average":{"1min":4.2869999999999999,"5min":5.6310000000000002,"15min":3.327},"min":{"1min":0.432,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":30.812999999999999,"5min":58.277999999999999,"15min":121.377},"last":1.2829999999999999}]},{"osd":1,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":3.4889999999999999,"5min":5.6909999999999998,"15min":3.7650000000000001},"min":{"1min":0.51100000000000001,"5min":0.32300000000000001,"15min":0.28399999999999997},"max":{"1min":8.5229999999999997,"5min":62.851999999999997,"15min":135.32400000000001},"last":1.595},{"interface":"front","average":{"1min":3.3100000000000001,"5min":5.548,"15min":3.8370000000000002},"min":{"1min":0.64100000000000001,"5min":0.35599999999999998,"15min":0.27600000000000002},"max":{"1min":11.401,"5min":60.741999999999997,"15min":178.08199999999999},"last":3.6899999999999999}]},{"osd":3,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":5.8479999999999999,"5min":5.0250000000000004,"15min":3.1509999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.35999999999999999},"max":{"1min":65.037000000000006,"5min":65.037000000000006,"15min":124.76300000000001},"last":1.425},{"interface":"front","average":{"1min":7.4370000000000003,"5min":5.7990000000000004,"15min":3.5},"min":{"1min":0.53700000000000003,"5min":0.36699999999999999,"15min":0.33000000000000002},"max":{"1min":70.861999999999995,"5min":70.861999999999995,"15min":145.47200000000001},"last":0.79100000000000004}]},{"osd":4,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":2.944,"5min":3.931,"15min":2.298},"min":{"1min":0.49399999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":10.182,"5min":37.420000000000002,"15min":37.420000000000002},"last":1.0669999999999999},{"interface":"front","average":{"1min":2.9249999999999998,"5min":3.5760000000000001,"15min":2.1749999999999998},"min":{"1min":0.65600000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":10.327999999999999,"5min":37.460000000000001,"15min":37.460000000000001},"last":1.1299999999999999}]},{"osd":5,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":3.0059999999999998,"5min":3.6850000000000001,"15min":2.1160000000000001},"min":{"1min":0.621,"5min":0.38,"15min":0.32700000000000001},"max":{"1min":10.250999999999999,"5min":37.5,"15min":37.5},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.6419999999999999,"5min":3.331,"15min":2.1219999999999999},"min":{"1min":0.44700000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":6.2000000000000002,"5min":28.143000000000001,"15min":28.143000000000001},"last":1.2330000000000001}]},{"osd":6,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":3.2109999999999999,"5min":3.5619999999999998,"15min":2.2469999999999999},"min":{"1min":0.74199999999999999,"5min":0.47499999999999998,"15min":0.441},"max":{"1min":10.359999999999999,"5min":24.103000000000002,"15min":34.506999999999998},"last":1.1559999999999999},{"interface":"front","average":{"1min":2.2200000000000002,"5min":3.75,"15min":2.2869999999999999},"min":{"1min":0.56200000000000006,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":5.6909999999999998,"5min":37.533000000000001,"15min":37.533000000000001},"last":1.4630000000000001}]},{"osd":7,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":2.5550000000000002,"5min":3.4169999999999998,"15min":2.0649999999999999},"min":{"1min":0.53200000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":6.0209999999999999,"5min":24.155000000000001,"15min":24.155000000000001},"last":3.3519999999999999},{"interface":"front","average":{"1min":1.5569999999999999,"5min":3.1360000000000001,"15min":2.125},"min":{"1min":0.52800000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":5.0099999999999998,"5min":26.064,"15min":34.576999999999998},"last":1.6279999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509573,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1698744,"kb_used_data":724208,"kb_used_omap":1,"kb_used_meta":974526,"kb_avail":92673096,"statfs":{"total":96636764160,"available":94897250304,"internally_reserved":0,"allocated":741588992,"data_stored":1603573467,"data_compressed":92844173,"data_compressed_allocated":343928832,"data_compressed_original":1206128640,"omap_allocated":1594,"internal_metadata":997915078},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,1,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:54:40 2024","interfaces":[{"interface":"back","average":{"1min":2.347,"5min":5.9189999999999996,"15min":3.3500000000000001},"min":{"1min":0.26000000000000001,"5min":0.22,"15min":0.22},"max":{"1min":11.497999999999999,"5min":124.096,"15min":124.096},"last":0.28799999999999998},{"interface":"front","average":{"1min":3.9830000000000001,"5min":7.2380000000000004,"15min":4.0640000000000001},"min":{"1min":0.44500000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":14.279,"5min":143.60300000000001,"15min":164.41},"last":6.6260000000000003}]},{"osd":2,"last update":"Thu Apr 18 04:54:40 2024","interfaces":[{"interface":"back","average":{"1min":3.79,"5min":4.7270000000000003,"15min":5.9119999999999999},"min":{"1min":0.48499999999999999,"5min":0.33700000000000002,"15min":0.29299999999999998},"max":{"1min":11.513,"5min":25.558,"15min":840.66700000000003},"last":7.407},{"interface":"front","average":{"1min":3.036,"5min":5.9249999999999998,"15min":3.722},"min":{"1min":0.44600000000000001,"5min":0.33600000000000002,"15min":0.33400000000000002},"max":{"1min":11.717000000000001,"5min":114.47199999999999,"15min":164.477},"last":2.3860000000000001}]},{"osd":3,"last update":"Thu Apr 18 04:54:40 2024","interfaces":[{"interface":"back","average":{"1min":2.9220000000000002,"5min":6.6210000000000004,"15min":4.7510000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":11.66,"5min":88.673000000000002,"15min":164.50299999999999},"last":13.221},{"interface":"front","average":{"1min":3.9239999999999999,"5min":8.1709999999999994,"15min":4.8360000000000003},"min":{"1min":0.5,"5min":0.39800000000000002,"15min":0.36899999999999999},"max":{"1min":14.032999999999999,"5min":151.82599999999999,"15min":151.82599999999999},"last":9.2409999999999997}]},{"osd":4,"last update":"Thu Apr 18 04:54:40 2024","interfaces":[{"interface":"back","average":{"1min":2.7000000000000002,"5min":3.851,"15min":2.637},"min":{"1min":0.45900000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":9.6219999999999999,"5min":23.478999999999999,"15min":52.072000000000003},"last":3.3740000000000001},{"interface":"front","average":{"1min":2.1459999999999999,"5min":4.5490000000000004,"15min":5.5670000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.34399999999999997},"max":{"1min":11.691000000000001,"5min":33.017000000000003,"15min":840.61500000000001},"last":0.41799999999999998}]},{"osd":5,"last update":"Thu Apr 18 04:54:40 2024","interfaces":[{"interface":"back","average":{"1min":3.6099999999999999,"5min":5.6520000000000001,"15min":4.5860000000000003},"min":{"1min":0.46500000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":14.146000000000001,"5min":114.37,"15min":478.47000000000003},"last":0.69999999999999996},{"interface":"front","average":{"1min":3.887,"5min":4.1609999999999996,"15min":3.0859999999999999},"min":{"1min":0.52700000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":14.176,"5min":41.832000000000001,"15min":164.374},"last":0.75900000000000001}]},{"osd":6,"last update":"Thu Apr 18 04:54:40 2024","interfaces":[{"interface":"back","average":{"1min":3.242,"5min":4.0090000000000003,"15min":2.742},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":14.496,"5min":23.416,"15min":52.100999999999999},"last":3.4159999999999999},{"interface":"front","average":{"1min":2.5070000000000001,"5min":4.0839999999999996,"15min":3.782},"min":{"1min":0.55500000000000005,"5min":0.49399999999999999,"15min":0.438},"max":{"1min":11.625,"5min":25.809999999999999,"15min":396.81},"last":0.45100000000000001}]},{"osd":7,"last update":"Thu Apr 18 04:54:40 2024","interfaces":[{"interface":"back","average":{"1min":3.6680000000000001,"5min":5.6479999999999997,"15min":3.581},"min":{"1min":0.499,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":14.105,"5min":100.565,"15min":164.447},"last":0.73399999999999999},{"interface":"front","average":{"1min":3.5190000000000001,"5min":3.996,"15min":2.698},"min":{"1min":0.48999999999999999,"5min":0.46200000000000002,"15min":0.45400000000000001},"max":{"1min":14.558,"5min":23.648,"15min":54.353000000000002},"last":3.4430000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542282,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1144540,"kb_used_data":491796,"kb_used_omap":1,"kb_used_meta":652734,"kb_avail":93227300,"statfs":{"total":96636764160,"available":95464755200,"internally_reserved":0,"allocated":503599104,"data_stored":1076571430,"data_compressed":63080786,"data_compressed_allocated":230240256,"data_compressed_original":803430400,"omap_allocated":1589,"internal_metadata":668400075},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:54:27 2024","interfaces":[{"interface":"back","average":{"1min":17.356999999999999,"5min":5.6539999999999999,"15min":3.7490000000000001},"min":{"1min":0.34100000000000003,"5min":0.249,"15min":0.249},"max":{"1min":195.89500000000001,"5min":195.89500000000001,"15min":287.19600000000003},"last":0.40200000000000002},{"interface":"front","average":{"1min":19.302,"5min":5.9539999999999997,"15min":4.0789999999999997},"min":{"1min":0.26800000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":196.149,"5min":196.149,"15min":289.23899999999998},"last":0.60899999999999999}]},{"osd":1,"last update":"Thu Apr 18 04:54:48 2024","interfaces":[{"interface":"back","average":{"1min":6.774,"5min":4.2729999999999997,"15min":3.5590000000000002},"min":{"1min":0.34799999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":90.055000000000007,"5min":90.055000000000007,"15min":303.83800000000002},"last":9.5960000000000001},{"interface":"front","average":{"1min":7.1840000000000002,"5min":5.3330000000000002,"15min":3.6709999999999998},"min":{"1min":0.45400000000000001,"5min":0.34499999999999997,"15min":0.32000000000000001},"max":{"1min":90.001999999999995,"5min":90.001999999999995,"15min":288.05799999999999},"last":9.5800000000000001}]},{"osd":2,"last update":"Thu Apr 18 04:54:48 2024","interfaces":[{"interface":"back","average":{"1min":6.0229999999999997,"5min":3.585,"15min":2.3010000000000002},"min":{"1min":0.374,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":91.088999999999999,"5min":91.088999999999999,"15min":91.088999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":6.2089999999999996,"5min":3.0259999999999998,"15min":1.8799999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":91.171999999999997,"5min":91.171999999999997,"15min":91.171999999999997},"last":1.52}]},{"osd":3,"last update":"Thu Apr 18 04:54:48 2024","interfaces":[{"interface":"back","average":{"1min":7.5279999999999996,"5min":4.2400000000000002,"15min":3.7999999999999998},"min":{"1min":0.36699999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":89.393000000000001,"5min":89.393000000000001,"15min":308.36700000000002},"last":0.63800000000000001},{"interface":"front","average":{"1min":6.0540000000000003,"5min":3.7349999999999999,"15min":3.1829999999999998},"min":{"1min":0.36799999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":88.070999999999998,"5min":88.070999999999998,"15min":289.86099999999999},"last":2.149}]},{"osd":4,"last update":"Thu Apr 18 04:54:27 2024","interfaces":[{"interface":"back","average":{"1min":2.7170000000000001,"5min":1.3200000000000001,"15min":1.1819999999999999},"min":{"1min":0.25900000000000001,"5min":0.252,"15min":0.252},"max":{"1min":41.567,"5min":41.567,"15min":41.567},"last":0.36599999999999999},{"interface":"front","average":{"1min":3.0529999999999999,"5min":1.343,"15min":1.1459999999999999},"min":{"1min":0.313,"5min":0.29699999999999999,"15min":0.247},"max":{"1min":45.646000000000001,"5min":45.646000000000001,"15min":45.646000000000001},"last":0.35099999999999998}]},{"osd":5,"last update":"Thu Apr 18 04:54:27 2024","interfaces":[{"interface":"back","average":{"1min":2.653,"5min":1.4319999999999999,"15min":1.1739999999999999},"min":{"1min":0.27300000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":41.595999999999997,"5min":41.595999999999997,"15min":41.595999999999997},"last":0.30499999999999999},{"interface":"front","average":{"1min":1.155,"5min":1.0089999999999999,"15min":1.0389999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":5.8769999999999998,"5min":15.271000000000001,"15min":15.271000000000001},"last":0.72099999999999997}]},{"osd":6,"last update":"Thu Apr 18 04:54:27 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.98799999999999999,"15min":1.0109999999999999},"min":{"1min":0.29999999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":5.1630000000000003,"5min":8.2390000000000008,"15min":8.2390000000000008},"last":0.32000000000000001},{"interface":"front","average":{"1min":1.052,"5min":1.0469999999999999,"15min":1.077},"min":{"1min":0.38600000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":5.9429999999999996,"5min":11.288,"15min":11.288},"last":0.74399999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542280,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1353544,"kb_used_data":587584,"kb_used_omap":1,"kb_used_meta":765950,"kb_avail":93018296,"statfs":{"total":96636764160,"available":95250735104,"internally_reserved":0,"allocated":601686016,"data_stored":1278569684,"data_compressed":74589765,"data_compressed_allocated":278536192,"data_compressed_original":955625472,"omap_allocated":1593,"internal_metadata":784333255},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,2,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":7.1710000000000003,"5min":2.77,"15min":1.667},"min":{"1min":0.36699999999999999,"5min":0.247,"15min":0.247},"max":{"1min":99.328999999999994,"5min":99.328999999999994,"15min":99.328999999999994},"last":1.7589999999999999},{"interface":"front","average":{"1min":7.202,"5min":3.3170000000000002,"15min":2.181},"min":{"1min":0.40300000000000002,"5min":0.309,"15min":0.309},"max":{"1min":99.287000000000006,"5min":99.287000000000006,"15min":99.287000000000006},"last":1.794}]},{"osd":1,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":9.1219999999999999,"5min":5.085,"15min":2.8410000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":98.650999999999996,"5min":122.06999999999999,"15min":122.06999999999999},"last":5.3890000000000002},{"interface":"front","average":{"1min":8.6890000000000001,"5min":4.649,"15min":2.6880000000000002},"min":{"1min":0.42799999999999999,"5min":0.33300000000000002,"15min":0.32800000000000001},"max":{"1min":98.683999999999997,"5min":122.09,"15min":122.09},"last":5.4009999999999998}]},{"osd":2,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":2.702,"5min":2.7919999999999998,"15min":1.835},"min":{"1min":0.33600000000000002,"5min":0.31,"15min":0.31},"max":{"1min":13.101000000000001,"5min":38.557000000000002,"15min":41.764000000000003},"last":1.502},{"interface":"front","average":{"1min":2.1640000000000001,"5min":2.8300000000000001,"15min":1.8919999999999999},"min":{"1min":0.373,"5min":0.35799999999999998,"15min":0.35199999999999998},"max":{"1min":10.993,"5min":35.734000000000002,"15min":41.710000000000001},"last":1.1439999999999999}]},{"osd":3,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":8.2070000000000007,"5min":3.9660000000000002,"15min":2.9119999999999999},"min":{"1min":0.39400000000000002,"5min":0.312,"15min":0.29999999999999999},"max":{"1min":101.006,"5min":101.006,"15min":101.006},"last":0.68999999999999995},{"interface":"front","average":{"1min":8.2420000000000009,"5min":4.0410000000000004,"15min":2.9980000000000002},"min":{"1min":0.437,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":101.039,"5min":101.039,"15min":101.039},"last":0.71899999999999997}]},{"osd":4,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":2.1829999999999998,"5min":1.6220000000000001,"15min":1.155},"min":{"1min":0.28599999999999998,"5min":0.217,"15min":0.217},"max":{"1min":17.401,"5min":19.481999999999999,"15min":19.481999999999999},"last":1.087},{"interface":"front","average":{"1min":2.2650000000000001,"5min":1.6200000000000001,"15min":1.234},"min":{"1min":0.33600000000000002,"5min":0.28199999999999997,"15min":0.26400000000000001},"max":{"1min":17.872,"5min":19.536999999999999,"15min":19.536999999999999},"last":1.115}]},{"osd":5,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":0.90900000000000003,"15min":1.0389999999999999},"min":{"1min":0.27900000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":4.2050000000000001,"5min":13.538,"15min":13.538},"last":0.312},{"interface":"front","average":{"1min":1.05,"5min":0.95399999999999996,"15min":0.95199999999999996},"min":{"1min":0.35499999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":4.2350000000000003,"5min":8.7210000000000001,"15min":8.7210000000000001},"last":0.34699999999999998}]},{"osd":7,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":0.93400000000000005,"15min":1.0740000000000001},"min":{"1min":0.314,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":4.266,"5min":7.5359999999999996,"15min":7.5359999999999996},"last":0.38100000000000001},{"interface":"front","average":{"1min":1.496,"5min":0.96299999999999997,"15min":1.036},"min":{"1min":0.35199999999999998,"5min":0.33500000000000002,"15min":0.314},"max":{"1min":10.955,"5min":10.955,"15min":10.955},"last":0.42399999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542282,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1071984,"kb_used_data":459368,"kb_used_omap":1,"kb_used_meta":612606,"kb_avail":93299856,"statfs":{"total":96636764160,"available":95539052544,"internally_reserved":0,"allocated":470392832,"data_stored":1011022077,"data_compressed":58951669,"data_compressed_allocated":217178112,"data_compressed_original":758022144,"omap_allocated":1593,"internal_metadata":627308999},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":6.1559999999999997,"5min":4.0069999999999997,"15min":2.343},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":81.960999999999999,"5min":84.305000000000007,"15min":84.305000000000007},"last":0.53000000000000003},{"interface":"front","average":{"1min":5.1970000000000001,"5min":4.0170000000000003,"15min":4.4409999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":82.180000000000007,"5min":86.994,"15min":553.95500000000004},"last":0.57399999999999995}]},{"osd":1,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":5.4820000000000002,"5min":4.9640000000000004,"15min":4.6870000000000003},"min":{"1min":0.34899999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":81.361999999999995,"5min":87.989000000000004,"15min":553.36900000000003},"last":0.432},{"interface":"front","average":{"1min":5.7640000000000002,"5min":4.6989999999999998,"15min":4.3010000000000002},"min":{"1min":0.32500000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":95.162000000000006,"5min":95.162000000000006,"15min":501.11000000000001},"last":0.52100000000000002}]},{"osd":2,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":6.2830000000000004,"15min":3.1280000000000001},"min":{"1min":0.40300000000000002,"5min":0.34599999999999997,"15min":0.29799999999999999},"max":{"1min":6.8399999999999999,"5min":262.99700000000001,"15min":262.99700000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":1.298,"5min":6.6760000000000002,"15min":3.3050000000000002},"min":{"1min":0.377,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":5.4320000000000004,"5min":259.24099999999999,"15min":259.24099999999999},"last":0.44500000000000001}]},{"osd":3,"last update":"Thu Apr 18 04:54:39 2024","interfaces":[{"interface":"back","average":{"1min":5.4500000000000002,"5min":4.4909999999999997,"15min":2.6110000000000002},"min":{"1min":0.42099999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":84.394999999999996,"5min":84.394999999999996,"15min":84.394999999999996},"last":0.48299999999999998},{"interface":"front","average":{"1min":5.54,"5min":4.593,"15min":2.8690000000000002},"min":{"1min":0.44900000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":83.763999999999996,"5min":86.834999999999994,"15min":86.834999999999994},"last":0.51400000000000001}]},{"osd":4,"last update":"Thu Apr 18 04:54:39 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.749,"15min":0.83199999999999996},"min":{"1min":0.28100000000000003,"5min":0.246,"15min":0.246},"max":{"1min":1.2010000000000001,"5min":4.6440000000000001,"15min":4.6440000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":1.181,"15min":1.0600000000000001},"min":{"1min":0.36199999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":2.7599999999999998,"5min":12.888999999999999,"15min":12.888999999999999},"last":0.498}]},{"osd":6,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.71599999999999997,"15min":0.874},"min":{"1min":0.31,"5min":0.252,"15min":0.252},"max":{"1min":3.306,"5min":4.6639999999999997,"15min":4.6639999999999997},"last":58.222000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.96999999999999997,"15min":0.97899999999999998},"min":{"1min":0.32500000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":3.2850000000000001,"5min":12.694000000000001,"15min":12.694000000000001},"last":58.314999999999998}]},{"osd":7,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.90500000000000003,"15min":1.018},"min":{"1min":0.34599999999999997,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.97599999999999998,"5min":12.74,"15min":12.74},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.89700000000000002,"5min":1.05,"15min":1.0429999999999999},"min":{"1min":0.40100000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":6.4630000000000001,"5min":27.658000000000001,"15min":27.658000000000001},"last":0.59899999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542282,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1256236,"kb_used_data":512804,"kb_used_omap":1,"kb_used_meta":743422,"kb_avail":93115604,"statfs":{"total":96636764160,"available":95350378496,"internally_reserved":0,"allocated":525111296,"data_stored":1129618008,"data_compressed":66697891,"data_compressed_allocated":243585024,"data_compressed_original":848297984,"omap_allocated":1594,"internal_metadata":761264582},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":10.712,"5min":5.7519999999999998,"15min":2.8180000000000001},"min":{"1min":0.27700000000000002,"5min":0.25700000000000001,"15min":0.254},"max":{"1min":148.048,"5min":148.048,"15min":148.048},"last":0.52500000000000002},{"interface":"front","average":{"1min":9.0670000000000002,"5min":5.4290000000000003,"15min":2.8690000000000002},"min":{"1min":0.34899999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":144.72999999999999,"5min":144.72999999999999,"15min":144.72999999999999},"last":0.81599999999999995}]},{"osd":1,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":9.7420000000000009,"5min":8.516,"15min":4.0419999999999998},"min":{"1min":0.32200000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":158.56,"5min":158.56,"15min":158.56},"last":0.64000000000000001},{"interface":"front","average":{"1min":8.7690000000000001,"5min":7.3419999999999996,"15min":3.448},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":144.60400000000001,"5min":144.60400000000001,"15min":144.60400000000001},"last":0.96299999999999997}]},{"osd":2,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":3.9319999999999999,"15min":2.1949999999999998},"min":{"1min":0.379,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":4.5899999999999999,"5min":109.28,"15min":109.28},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.264,"5min":4.2400000000000002,"15min":2.21},"min":{"1min":0.34599999999999997,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":4.5419999999999998,"5min":109.242,"15min":109.242},"last":0.74099999999999999}]},{"osd":3,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":9.5440000000000005,"5min":7.0369999999999999,"15min":3.4500000000000002},"min":{"1min":0.45600000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":147.625,"5min":147.625,"15min":147.625},"last":1.129},{"interface":"front","average":{"1min":9.9489999999999998,"5min":6.0170000000000003,"15min":3.355},"min":{"1min":0.41299999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":147.01599999999999,"5min":147.01599999999999,"15min":147.01599999999999},"last":0.90900000000000003}]},{"osd":5,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":1.0860000000000001,"15min":1.0249999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":2.9670000000000001,"5min":19.143999999999998,"15min":19.143999999999998},"last":1.2410000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":1.1120000000000001,"15min":1.0249999999999999},"min":{"1min":0.29099999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":2.48,"5min":27.402999999999999,"15min":27.402999999999999},"last":1.208}]},{"osd":6,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.94899999999999995,"15min":1.0720000000000001},"min":{"1min":0.32700000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":3.113,"5min":8.8889999999999993,"15min":13.891999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":1.2330000000000001,"15min":1.133},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":2.5649999999999999,"5min":17.954999999999998,"15min":17.954999999999998},"last":1.0189999999999999}]},{"osd":7,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":1.484,"15min":1.1890000000000001},"min":{"1min":0.28899999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":3.0619999999999998,"5min":27.643000000000001,"15min":27.643000000000001},"last":1.3220000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":1.2130000000000001,"15min":1.107},"min":{"1min":0.34999999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":3.0920000000000001,"5min":18.800999999999998,"15min":18.800999999999998},"last":1.389}]}]},{"osd":0,"up_from":13,"seq":55834574983,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1177632,"kb_used_data":578968,"kb_used_omap":1,"kb_used_meta":598654,"kb_avail":93194208,"statfs":{"total":96636764160,"available":95430868992,"internally_reserved":0,"allocated":592863232,"data_stored":1272555487,"data_compressed":73983711,"data_compressed_allocated":273489920,"data_compressed_original":953393152,"omap_allocated":1594,"internal_metadata":613022150},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,1,4,1,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 04:54:44 2024","interfaces":[{"interface":"back","average":{"1min":3.5670000000000002,"5min":5.9139999999999997,"15min":2.839},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":30.347000000000001,"5min":55.061,"15min":55.061},"last":7.1699999999999999},{"interface":"front","average":{"1min":3.3919999999999999,"5min":6.6890000000000001,"15min":3.1659999999999999},"min":{"1min":0.377,"5min":0.309,"15min":0.28899999999999998},"max":{"1min":11.872,"5min":115.45099999999999,"15min":115.45099999999999},"last":6.4859999999999998}]},{"osd":2,"last update":"Thu Apr 18 04:54:41 2024","interfaces":[{"interface":"back","average":{"1min":2.9929999999999999,"5min":3.1360000000000001,"15min":1.782},"min":{"1min":0.35699999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":8.7430000000000003,"5min":22.475000000000001,"15min":28.802},"last":6.1440000000000001},{"interface":"front","average":{"1min":2.6970000000000001,"5min":4.8710000000000004,"15min":2.4420000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.29399999999999998},"max":{"1min":9.7460000000000004,"5min":115.229,"15min":115.229},"last":7.0780000000000003}]},{"osd":3,"last update":"Thu Apr 18 04:54:41 2024","interfaces":[{"interface":"back","average":{"1min":3.5859999999999999,"5min":4.8010000000000002,"15min":2.4569999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":30.466000000000001,"5min":34.180999999999997,"15min":47.496000000000002},"last":10.289},{"interface":"front","average":{"1min":3.2829999999999999,"5min":5.1589999999999998,"15min":2.5310000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":19.003,"5min":115.729,"15min":115.729},"last":10.404}]},{"osd":4,"last update":"Thu Apr 18 04:54:26 2024","interfaces":[{"interface":"back","average":{"1min":1.837,"5min":3.0230000000000001,"15min":1.7749999999999999},"min":{"1min":0.38100000000000001,"5min":0.372,"15min":0.33000000000000002},"max":{"1min":6.5369999999999999,"5min":49.738999999999997,"15min":49.738999999999997},"last":6.7910000000000004},{"interface":"front","average":{"1min":3.7850000000000001,"5min":4.165,"15min":2.2429999999999999},"min":{"1min":0.47499999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":30.225000000000001,"5min":50.996000000000002,"15min":50.996000000000002},"last":10.247999999999999}]},{"osd":5,"last update":"Thu Apr 18 04:54:26 2024","interfaces":[{"interface":"back","average":{"1min":2.7949999999999999,"5min":3.0289999999999999,"15min":1.8069999999999999},"min":{"1min":0.437,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":7.6360000000000001,"5min":34.402999999999999,"15min":34.402999999999999},"last":6.851},{"interface":"front","average":{"1min":2.081,"5min":2.9049999999999998,"15min":1.847},"min":{"1min":0.51800000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":6.258,"5min":20.699000000000002,"15min":33.392000000000003},"last":6.8220000000000001}]},{"osd":6,"last update":"Thu Apr 18 04:54:26 2024","interfaces":[{"interface":"back","average":{"1min":3.3399999999999999,"5min":4.4859999999999998,"15min":2.355},"min":{"1min":0.60899999999999999,"5min":0.41999999999999998,"15min":0.40600000000000003},"max":{"1min":21.803000000000001,"5min":115.277,"15min":115.277},"last":6.8849999999999998},{"interface":"front","average":{"1min":4.3700000000000001,"5min":3.504,"15min":1.97},"min":{"1min":0.56299999999999994,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":30.279,"5min":48.652999999999999,"15min":48.652999999999999},"last":10.212999999999999}]},{"osd":7,"last update":"Thu Apr 18 04:54:26 2024","interfaces":[{"interface":"back","average":{"1min":2.6819999999999999,"5min":3.7240000000000002,"15min":2.129},"min":{"1min":0.48899999999999999,"5min":0.47099999999999997,"15min":0.437},"max":{"1min":7.2949999999999999,"5min":54.829000000000001,"15min":54.829000000000001},"last":6.7450000000000001},{"interface":"front","average":{"1min":4.0430000000000001,"5min":4.9459999999999997,"15min":2.5899999999999999},"min":{"1min":0.58599999999999997,"5min":0.49399999999999999,"15min":0.48699999999999999},"max":{"1min":30.315999999999999,"5min":115.31399999999999,"15min":115.31399999999999},"last":10.170999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33312,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33312,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3121152,"data_stored":20972180,"data_compressed":2483986,"data_compressed_allocated":2842624,"data_compressed_original":20709376,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3178496,"data_stored":20972464,"data_compressed":2531508,"data_compressed_allocated":2936832,"data_compressed_original":20754432,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1396736,"data_stored":4285475,"data_compressed":439103,"data_compressed_allocated":598016,"data_compressed_original":3510272,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6742016,"data_stored":16869536,"data_compressed":1734435,"data_compressed_allocated":2166784,"data_compressed_original":12316672,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6316032,"data_stored":29361965,"data_compressed":3215159,"data_compressed_allocated":3665920,"data_compressed_original":26726400,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":3239936,"data_stored":18154962,"data_compressed":2174151,"data_compressed_allocated":2514944,"data_compressed_original":17453056,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3473408,"data_stored":16779689,"data_compressed":2087260,"data_compressed_allocated":2478080,"data_compressed_original":15798272,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10387456,"data_stored":34932699,"data_compressed":3585780,"data_compressed_allocated":4227072,"data_compressed_original":28794880,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":515846144,"data_stored":1087262720,"data_compressed":62154190,"data_compressed_allocated":235966464,"data_compressed_original":807383040,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":729620480,"data_stored":1555185664,"data_compressed":89019788,"data_compressed_allocated":336809984,"data_compressed_original":1162375168,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":457523200,"data_stored":973942784,"data_compressed":55652416,"data_compressed_allocated":211103744,"data_compressed_original":727523328,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":778780672,"data_stored":1649655808,"data_compressed":94201311,"data_compressed_allocated":358633472,"data_compressed_original":1229508608,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":499666944,"data_stored":1060257792,"data_compressed":61328121,"data_compressed_allocated":232415232,"data_compressed_original":793006080,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":457633792,"data_stored":963354624,"data_compressed":55258268,"data_compressed_allocated":209719296,"data_compressed_original":715440128,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":571973632,"data_stored":1205014528,"data_compressed":69334817,"data_compressed_allocated":264728576,"data_compressed_original":897769472,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":483713024,"data_stored":1022021632,"data_compressed":58364002,"data_compressed_allocated":221978624,"data_compressed_original":760287232,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T04:55:30.109 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T04:55:30.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.293+0000 7f24aca00640 1 Processor -- start 2024-04-18T04:55:30.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.293+0000 7f24aca00640 1 -- start start 2024-04-18T04:55:30.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.293+0000 7f24aca00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f24a8150340 0x7f24a8156430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:30.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.293+0000 7f24aca00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f24a8156970 0x7f24a80c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:30.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.293+0000 7f24aca00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24a806f9b0 con 0x7f24a80c7480 2024-04-18T04:55:30.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.293+0000 7f24aca00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24a80c0520 con 0x7f24a8156970 2024-04-18T04:55:30.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.293+0000 7f24aca00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a80c0800 con 0x7f24a8150340 2024-04-18T04:55:30.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.293+0000 7f249d400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f24a8156970 0x7f24a80c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:30.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.293+0000 7f24a5e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f24a8150340 0x7f24a8156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:30.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.293+0000 7f249d400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f24a8156970 0x7f24a80c68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:49802/0 (socket says 172.21.15.120:49802) 2024-04-18T04:55:30.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.293+0000 7f249d400640 1 -- 172.21.15.120:0/1446416968 learned_addr learned my addr 172.21.15.120:0/1446416968 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:30.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.297+0000 7f24a5e00640 1 -- 172.21.15.120:0/1446416968 >> v2:172.21.15.132:3300/0 conn(0x7f24a8156970 msgr2=0x7f24a80c68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:30.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.297+0000 7f24a5e00640 1 --2- 172.21.15.120:0/1446416968 >> v2:172.21.15.132:3300/0 conn(0x7f24a8156970 0x7f24a80c68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:30.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.297+0000 7f24a5e00640 1 -- 172.21.15.120:0/1446416968 >> v1:172.21.15.132:6789/0 conn(0x7f24a80c7480 legacy=0x7f24a8159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:30.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.297+0000 7f24a5e00640 1 -- 172.21.15.120:0/1446416968 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a806fc20 con 0x7f24a8150340 2024-04-18T04:55:30.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.297+0000 7f249d400640 1 --2- 172.21.15.120:0/1446416968 >> v2:172.21.15.132:3300/0 conn(0x7f24a8156970 0x7f24a80c68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:55:30.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.297+0000 7f24a5e00640 1 --2- 172.21.15.120:0/1446416968 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f24a8150340 0x7f24a8156430 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f24980097c0 tx=0x7f249801ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3119ba9e5befc2fb server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:30.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.297+0000 7f24a5400640 1 -- 172.21.15.120:0/1446416968 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24980a8990 con 0x7f24a8150340 2024-04-18T04:55:30.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.297+0000 7f24a5400640 1 -- 172.21.15.120:0/1446416968 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24980a8af0 con 0x7f24a8150340 2024-04-18T04:55:30.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.297+0000 7f24a5400640 1 -- 172.21.15.120:0/1446416968 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24980a8e80 con 0x7f24a8150340 2024-04-18T04:55:30.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.301+0000 7f24aca00640 1 -- 172.21.15.120:0/1446416968 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f24a8150340 msgr2=0x7f24a8156430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:30.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.301+0000 7f24aca00640 1 --2- 172.21.15.120:0/1446416968 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f24a8150340 0x7f24a8156430 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f24980097c0 tx=0x7f249801ec90 comp rx=0 tx=0).stop 2024-04-18T04:55:30.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.301+0000 7f24aca00640 1 -- 172.21.15.120:0/1446416968 shutdown_connections 2024-04-18T04:55:30.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.301+0000 7f24aca00640 1 --2- 172.21.15.120:0/1446416968 >> v2:172.21.15.132:3300/0 conn(0x7f24a8156970 0x7f24a80c68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:30.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.301+0000 7f24aca00640 1 --2- 172.21.15.120:0/1446416968 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f24a8150340 0x7f24a8156430 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:30.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.301+0000 7f24aca00640 1 -- 172.21.15.120:0/1446416968 >> 172.21.15.120:0/1446416968 conn(0x7f24a80c78c0 msgr2=0x7f24a80c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:30.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.301+0000 7f24aca00640 1 -- 172.21.15.120:0/1446416968 shutdown_connections 2024-04-18T04:55:30.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.301+0000 7f24aca00640 1 -- 172.21.15.120:0/1446416968 wait complete. 2024-04-18T04:55:30.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.301+0000 7f24aca00640 1 Processor -- start 2024-04-18T04:55:30.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.301+0000 7f24aca00640 1 -- start start 2024-04-18T04:55:30.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.301+0000 7f24aca00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f24a80c7480 0x7f24a80ca540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:30.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.301+0000 7f24aca00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24a8150340 0x7f24a8154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:30.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.301+0000 7f24aca00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24a81ef770 0x7f24a8155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:30.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.301+0000 7f24aca00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a81e4780 con 0x7f24a8150340 2024-04-18T04:55:30.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.301+0000 7f24aca00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a81efc60 con 0x7f24a81ef770 2024-04-18T04:55:30.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.301+0000 7f24aca00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a814df40 con 0x7f24a80c7480 2024-04-18T04:55:30.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.301+0000 7f249d400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24a8150340 0x7f24a8154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:30.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.301+0000 7f249d400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24a8150340 0x7f24a8154cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43108/0 (socket says 172.21.15.120:43108) 2024-04-18T04:55:30.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.301+0000 7f249d400640 1 -- 172.21.15.120:0/668154925 learned_addr learned my addr 172.21.15.120:0/668154925 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:30.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.301+0000 7f24a5e00640 1 --2- 172.21.15.120:0/668154925 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f24a80c7480 0x7f24a80ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:30.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.301+0000 7f24a6800640 1 --2- 172.21.15.120:0/668154925 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24a81ef770 0x7f24a8155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:30.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.301+0000 7f249d400640 1 -- 172.21.15.120:0/668154925 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f24a80c7480 msgr2=0x7f24a80ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:30.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.301+0000 7f249d400640 1 --2- 172.21.15.120:0/668154925 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f24a80c7480 0x7f24a80ca540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:30.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.301+0000 7f249d400640 1 -- 172.21.15.120:0/668154925 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24a81ef770 msgr2=0x7f24a8155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:30.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.301+0000 7f249d400640 1 --2- 172.21.15.120:0/668154925 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24a81ef770 0x7f24a8155210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:30.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.301+0000 7f249d400640 1 -- 172.21.15.120:0/668154925 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2490009b30 con 0x7f24a8150340 2024-04-18T04:55:30.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.305+0000 7f249d400640 1 --2- 172.21.15.120:0/668154925 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24a8150340 0x7f24a8154cd0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f249000efc0 tx=0x7f249000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:30.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.305+0000 7f249ea00640 1 -- 172.21.15.120:0/668154925 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249000ce60 con 0x7f24a8150340 2024-04-18T04:55:30.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.305+0000 7f249ea00640 1 -- 172.21.15.120:0/668154925 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249000f040 con 0x7f24a8150340 2024-04-18T04:55:30.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.305+0000 7f24aca00640 1 -- 172.21.15.120:0/668154925 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2498009420 con 0x7f24a8150340 2024-04-18T04:55:30.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.305+0000 7f249ea00640 1 -- 172.21.15.120:0/668154925 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2490014680 con 0x7f24a8150340 2024-04-18T04:55:30.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.305+0000 7f24aca00640 1 -- 172.21.15.120:0/668154925 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a81e44a0 con 0x7f24a8150340 2024-04-18T04:55:30.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.305+0000 7f24aca00640 1 -- 172.21.15.120:0/668154925 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24a80726d0 con 0x7f24a8150340 2024-04-18T04:55:30.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.305+0000 7f249ea00640 1 -- 172.21.15.120:0/668154925 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f24900147e0 con 0x7f24a8150340 2024-04-18T04:55:30.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.305+0000 7f249ea00640 1 --2- 172.21.15.120:0/668154925 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2484066690 0x7f2484068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:30.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.305+0000 7f249ea00640 1 -- 172.21.15.120:0/668154925 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f2490085210 con 0x7f24a8150340 2024-04-18T04:55:30.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.305+0000 7f24a5e00640 1 --2- 172.21.15.120:0/668154925 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2484066690 0x7f2484068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:30.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.309+0000 7f24a5e00640 1 --2- 172.21.15.120:0/668154925 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2484066690 0x7f2484068b50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f24980b2000 tx=0x7f2498008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:30.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.309+0000 7f249ea00640 1 -- 172.21.15.120:0/668154925 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f2490051f80 con 0x7f24a8150340 2024-04-18T04:55:30.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.469+0000 7f24aca00640 1 -- 172.21.15.120:0/668154925 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f24a8073e10 con 0x7f24a8150340 2024-04-18T04:55:30.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.473+0000 7f249ea00640 1 -- 172.21.15.120:0/668154925 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+18910 (secure 0 0 0) 0x7f24900555a0 con 0x7f24a8150340 2024-04-18T04:55:30.469 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:55:30.470 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":32,"fsid":"8e73592f-08e2-4957-a98f-9d044cec4ba5","created":"2024-04-18T04:44:06.139983+0000","modified":"2024-04-18T04:53:26.031496+0000","last_up_change":"2024-04-18T04:44:17.410146+0000","last_in_change":"2024-04-18T04:44:08.470250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T04:44:16.864728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T04:44:28.825773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T04:44:29.245857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-18T04:44:32.314302+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a80903bd-d9be-4fb9-af99-6125cb26bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":27468},{"type":"v1","addr":"172.21.15.120:6801","nonce":27468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":27468},{"type":"v1","addr":"172.21.15.120:6803","nonce":27468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":27468},{"type":"v1","addr":"172.21.15.120:6807","nonce":27468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":27468},{"type":"v1","addr":"172.21.15.120:6805","nonce":27468}]},"public_addr":"172.21.15.120:6801/27468","cluster_addr":"172.21.15.120:6803/27468","heartbeat_back_addr":"172.21.15.120:6807/27468","heartbeat_front_addr":"172.21.15.120:6805/27468","state":["exists","up"]},{"osd":1,"uuid":"8f5f004b-6870-4c78-8d50-9622e631ec25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":27470},{"type":"v1","addr":"172.21.15.120:6823","nonce":27470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":27470},{"type":"v1","addr":"172.21.15.120:6827","nonce":27470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":27470},{"type":"v1","addr":"172.21.15.120:6831","nonce":27470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":27470},{"type":"v1","addr":"172.21.15.120:6829","nonce":27470}]},"public_addr":"172.21.15.120:6823/27470","cluster_addr":"172.21.15.120:6827/27470","heartbeat_back_addr":"172.21.15.120:6831/27470","heartbeat_front_addr":"172.21.15.120:6829/27470","state":["exists","up"]},{"osd":2,"uuid":"6e228a2b-6103-4301-a8b5-ee81dbb1f920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":27471},{"type":"v1","addr":"172.21.15.120:6817","nonce":27471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":27471},{"type":"v1","addr":"172.21.15.120:6819","nonce":27471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":27471},{"type":"v1","addr":"172.21.15.120:6826","nonce":27471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":27471},{"type":"v1","addr":"172.21.15.120:6822","nonce":27471}]},"public_addr":"172.21.15.120:6817/27471","cluster_addr":"172.21.15.120:6819/27471","heartbeat_back_addr":"172.21.15.120:6826/27471","heartbeat_front_addr":"172.21.15.120:6822/27471","state":["exists","up"]},{"osd":3,"uuid":"7a5cabd7-d898-4e32-a03c-25b46e790134","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":27469},{"type":"v1","addr":"172.21.15.120:6809","nonce":27469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":27469},{"type":"v1","addr":"172.21.15.120:6811","nonce":27469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":27469},{"type":"v1","addr":"172.21.15.120:6815","nonce":27469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":27469},{"type":"v1","addr":"172.21.15.120:6813","nonce":27469}]},"public_addr":"172.21.15.120:6809/27469","cluster_addr":"172.21.15.120:6811/27469","heartbeat_back_addr":"172.21.15.120:6815/27469","heartbeat_front_addr":"172.21.15.120:6813/27469","state":["exists","up"]},{"osd":4,"uuid":"8e9f530f-6bab-4b23-a1a3-a71362fefcc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":28102},{"type":"v1","addr":"172.21.15.132:6825","nonce":28102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":28102},{"type":"v1","addr":"172.21.15.132:6827","nonce":28102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":28102},{"type":"v1","addr":"172.21.15.132:6831","nonce":28102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":28102},{"type":"v1","addr":"172.21.15.132:6829","nonce":28102}]},"public_addr":"172.21.15.132:6825/28102","cluster_addr":"172.21.15.132:6827/28102","heartbeat_back_addr":"172.21.15.132:6831/28102","heartbeat_front_addr":"172.21.15.132:6829/28102","state":["exists","up"]},{"osd":5,"uuid":"2243fabe-cc81-40cf-91bc-f106fe275a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":28104},{"type":"v1","addr":"172.21.15.132:6809","nonce":28104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":28104},{"type":"v1","addr":"172.21.15.132:6811","nonce":28104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":28104},{"type":"v1","addr":"172.21.15.132:6815","nonce":28104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":28104},{"type":"v1","addr":"172.21.15.132:6813","nonce":28104}]},"public_addr":"172.21.15.132:6809/28104","cluster_addr":"172.21.15.132:6811/28104","heartbeat_back_addr":"172.21.15.132:6815/28104","heartbeat_front_addr":"172.21.15.132:6813/28104","state":["exists","up"]},{"osd":6,"uuid":"c093a5ed-25c8-41a7-a20d-606a1a1661e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":28103},{"type":"v1","addr":"172.21.15.132:6801","nonce":28103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":28103},{"type":"v1","addr":"172.21.15.132:6803","nonce":28103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":28103},{"type":"v1","addr":"172.21.15.132:6807","nonce":28103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":28103},{"type":"v1","addr":"172.21.15.132:6805","nonce":28103}]},"public_addr":"172.21.15.132:6801/28103","cluster_addr":"172.21.15.132:6803/28103","heartbeat_back_addr":"172.21.15.132:6807/28103","heartbeat_front_addr":"172.21.15.132:6805/28103","state":["exists","up"]},{"osd":7,"uuid":"c37426b7-1080-4434-9f3e-a3afbbdc0fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":28129},{"type":"v1","addr":"172.21.15.132:6817","nonce":28129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":28129},{"type":"v1","addr":"172.21.15.132:6819","nonce":28129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":28129},{"type":"v1","addr":"172.21.15.132:6823","nonce":28129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":28129},{"type":"v1","addr":"172.21.15.132:6821","nonce":28129}]},"public_addr":"172.21.15.132:6817/28129","cluster_addr":"172.21.15.132:6819/28129","heartbeat_back_addr":"172.21.15.132:6823/28129","heartbeat_front_addr":"172.21.15.132:6821/28129","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.053825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.289753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.274645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.146361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.943883+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.701955+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.851076+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.800782+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":1}]},{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.132:6835/396956733":"2024-04-19T04:53:26.031128+0000","172.21.15.132:6834/396956733":"2024-04-19T04:53:26.031128+0000","172.21.15.120:6837/76856194":"2024-04-19T04:52:05.993392+0000","172.21.15.120:6835/76856194":"2024-04-19T04:52:05.993392+0000","172.21.15.120:6836/1079090700":"2024-04-19T04:50:25.928576+0000","172.21.15.132:6835/1552155328":"2024-04-19T04:48:30.875534+0000","172.21.15.132:6834/1552155328":"2024-04-19T04:48:30.875534+0000","172.21.15.120:6834/1079090700":"2024-04-19T04:50:25.928576+0000","172.21.15.120:6833/2564667113":"2024-04-19T04:47:00.847858+0000","172.21.15.120:6832/2564667113":"2024-04-19T04:47:00.847858+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T04:55:30.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.473+0000 7f24aca00640 1 -- 172.21.15.120:0/668154925 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2484066690 msgr2=0x7f2484068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:30.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.473+0000 7f24aca00640 1 --2- 172.21.15.120:0/668154925 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2484066690 0x7f2484068b50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f24980b2000 tx=0x7f2498008040 comp rx=0 tx=0).stop 2024-04-18T04:55:30.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.473+0000 7f24aca00640 1 -- 172.21.15.120:0/668154925 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24a8150340 msgr2=0x7f24a8154cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:30.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.473+0000 7f24aca00640 1 --2- 172.21.15.120:0/668154925 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24a8150340 0x7f24a8154cd0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f249000efc0 tx=0x7f249000c490 comp rx=0 tx=0).stop 2024-04-18T04:55:30.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.473+0000 7f24aca00640 1 -- 172.21.15.120:0/668154925 shutdown_connections 2024-04-18T04:55:30.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.473+0000 7f24aca00640 1 --2- 172.21.15.120:0/668154925 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f2484066690 0x7f2484068b50 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:30.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.473+0000 7f24aca00640 1 --2- 172.21.15.120:0/668154925 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24a81ef770 0x7f24a8155210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:30.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.473+0000 7f24aca00640 1 --2- 172.21.15.120:0/668154925 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24a8150340 0x7f24a8154cd0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:30.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.473+0000 7f24aca00640 1 --2- 172.21.15.120:0/668154925 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f24a80c7480 0x7f24a80ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:30.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.473+0000 7f24aca00640 1 -- 172.21.15.120:0/668154925 >> 172.21.15.120:0/668154925 conn(0x7f24a80c78c0 msgr2=0x7f24a80c7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:30.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.473+0000 7f24aca00640 1 -- 172.21.15.120:0/668154925 shutdown_connections 2024-04-18T04:55:30.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:30.473+0000 7f24aca00640 1 -- 172.21.15.120:0/668154925 wait complete. 2024-04-18T04:55:31.492 INFO:tasks.ceph:Scrubbing osd.0 2024-04-18T04:55:31.492 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-18T04:55:31.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.757+0000 7f4496200640 1 Processor -- start 2024-04-18T04:55:31.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.761+0000 7f4496200640 1 -- start start 2024-04-18T04:55:31.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.761+0000 7f4496200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f44900723f0 0x7f449014fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:31.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.761+0000 7f4496200640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f44900c84b0 0x7f4490158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:31.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.761+0000 7f4496200640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f449006aad0 con 0x7f44900c57c0 2024-04-18T04:55:31.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.761+0000 7f4496200640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4490070f70 con 0x7f44900c84b0 2024-04-18T04:55:31.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.761+0000 7f4496200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4490070240 con 0x7f44900723f0 2024-04-18T04:55:31.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.761+0000 7f448f400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f44900723f0 0x7f449014fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:31.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.761+0000 7f448f400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f44900723f0 0x7f449014fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:42676/0 (socket says 172.21.15.120:42676) 2024-04-18T04:55:31.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.761+0000 7f448f400640 1 -- 172.21.15.120:0/684819185 learned_addr learned my addr 172.21.15.120:0/684819185 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:31.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.761+0000 7f448fe00640 1 --2- 172.21.15.120:0/684819185 >> v2:172.21.15.120:3300/0 conn(0x7f44900c84b0 0x7f4490158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:31.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.761+0000 7f448f400640 1 -- 172.21.15.120:0/684819185 >> v2:172.21.15.120:3300/0 conn(0x7f44900c84b0 msgr2=0x7f4490158ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:31.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.761+0000 7f448f400640 1 --2- 172.21.15.120:0/684819185 >> v2:172.21.15.120:3300/0 conn(0x7f44900c84b0 0x7f4490158ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:31.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.761+0000 7f448f400640 1 -- 172.21.15.120:0/684819185 >> v1:172.21.15.120:6789/0 conn(0x7f44900c57c0 legacy=0x7f44900c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:31.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.761+0000 7f448f400640 1 -- 172.21.15.120:0/684819185 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4490070490 con 0x7f44900723f0 2024-04-18T04:55:31.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.769+0000 7f448f400640 1 --2- 172.21.15.120:0/684819185 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f44900723f0 0x7f449014fa50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4480009870 tx=0x7f448001c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36022654b63d4e45 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:31.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.769+0000 7f448e000640 1 -- 172.21.15.120:0/684819185 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44800ac620 con 0x7f44900723f0 2024-04-18T04:55:31.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.769+0000 7f448e000640 1 -- 172.21.15.120:0/684819185 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44800ac780 con 0x7f44900723f0 2024-04-18T04:55:31.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.769+0000 7f448e000640 1 -- 172.21.15.120:0/684819185 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44800acb10 con 0x7f44900723f0 2024-04-18T04:55:31.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.769+0000 7f4496200640 1 -- 172.21.15.120:0/684819185 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f44900723f0 msgr2=0x7f449014fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:31.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.769+0000 7f4496200640 1 --2- 172.21.15.120:0/684819185 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f44900723f0 0x7f449014fa50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4480009870 tx=0x7f448001c4f0 comp rx=0 tx=0).stop 2024-04-18T04:55:31.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.769+0000 7f4496200640 1 -- 172.21.15.120:0/684819185 shutdown_connections 2024-04-18T04:55:31.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.769+0000 7f4496200640 1 --2- 172.21.15.120:0/684819185 >> v2:172.21.15.120:3300/0 conn(0x7f44900c84b0 0x7f4490158ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:31.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.769+0000 7f4496200640 1 --2- 172.21.15.120:0/684819185 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f44900723f0 0x7f449014fa50 secure :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4480009870 tx=0x7f448001c4f0 comp rx=0 tx=0).stop 2024-04-18T04:55:31.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.769+0000 7f4496200640 1 -- 172.21.15.120:0/684819185 >> 172.21.15.120:0/684819185 conn(0x7f44900c79c0 msgr2=0x7f44900c7da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:31.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.769+0000 7f4496200640 1 -- 172.21.15.120:0/684819185 shutdown_connections 2024-04-18T04:55:31.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.769+0000 7f4496200640 1 -- 172.21.15.120:0/684819185 wait complete. 2024-04-18T04:55:31.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.773+0000 7f4496200640 1 Processor -- start 2024-04-18T04:55:31.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.773+0000 7f4496200640 1 -- start start 2024-04-18T04:55:31.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.773+0000 7f4496200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44900c57c0 0x7f4490150b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:31.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.773+0000 7f4496200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44900c84b0 0x7f44901524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:31.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.773+0000 7f4496200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f44900c4f00 0x7f44900c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:31.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.773+0000 7f4496200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44900bf1b0 con 0x7f44900c57c0 2024-04-18T04:55:31.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.773+0000 7f4496200640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4490151180 con 0x7f44900c84b0 2024-04-18T04:55:31.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.773+0000 7f4496200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4490151420 con 0x7f44900c4f00 2024-04-18T04:55:31.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.777+0000 7f448ea00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44900c84b0 0x7f44901524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:31.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.777+0000 7f448ea00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44900c84b0 0x7f44901524a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:55068/0 (socket says 172.21.15.120:55068) 2024-04-18T04:55:31.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.777+0000 7f448ea00640 1 -- 172.21.15.120:0/2896505675 learned_addr learned my addr 172.21.15.120:0/2896505675 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:31.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.777+0000 7f448fe00640 1 --2- 172.21.15.120:0/2896505675 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f44900c4f00 0x7f44900c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:31.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.777+0000 7f448f400640 1 --2- 172.21.15.120:0/2896505675 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44900c57c0 0x7f4490150b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:31.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.777+0000 7f448f400640 1 -- 172.21.15.120:0/2896505675 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f44900c4f00 msgr2=0x7f44900c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:31.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.777+0000 7f448f400640 1 --2- 172.21.15.120:0/2896505675 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f44900c4f00 0x7f44900c98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:31.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.777+0000 7f448f400640 1 -- 172.21.15.120:0/2896505675 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44900c84b0 msgr2=0x7f44901524a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:31.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.777+0000 7f448f400640 1 --2- 172.21.15.120:0/2896505675 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44900c84b0 0x7f44901524a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:31.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.777+0000 7f448f400640 1 -- 172.21.15.120:0/2896505675 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44800094d0 con 0x7f44900c57c0 2024-04-18T04:55:31.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.777+0000 7f448f400640 1 --2- 172.21.15.120:0/2896505675 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44900c57c0 0x7f4490150b60 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f44800ac000 tx=0x7f4480019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:31.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.781+0000 7f4487400640 1 -- 172.21.15.120:0/2896505675 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44800ba070 con 0x7f44900c57c0 2024-04-18T04:55:31.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.781+0000 7f4487400640 1 -- 172.21.15.120:0/2896505675 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44800ac520 con 0x7f44900c57c0 2024-04-18T04:55:31.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.781+0000 7f4487400640 1 -- 172.21.15.120:0/2896505675 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44800b5680 con 0x7f44900c57c0 2024-04-18T04:55:31.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.781+0000 7f4496200640 1 -- 172.21.15.120:0/2896505675 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44901516e0 con 0x7f44900c57c0 2024-04-18T04:55:31.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.781+0000 7f4496200640 1 -- 172.21.15.120:0/2896505675 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4490151ca0 con 0x7f44900c57c0 2024-04-18T04:55:31.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.781+0000 7f4484c00640 1 -- 172.21.15.120:0/2896505675 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f44900c68f0 con 0x7f44900c57c0 2024-04-18T04:55:31.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.789+0000 7f4487400640 1 -- 172.21.15.120:0/2896505675 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f44800b3070 con 0x7f44900c57c0 2024-04-18T04:55:31.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.793+0000 7f4487400640 1 --2- 172.21.15.120:0/2896505675 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4470066790 0x7f4470068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:31.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.793+0000 7f4487400640 1 -- 172.21.15.120:0/2896505675 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f448011e940 con 0x7f44900c57c0 2024-04-18T04:55:31.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.793+0000 7f4487400640 1 --2- 172.21.15.120:0/2896505675 >> [v2:172.21.15.120:6800/27468,v1:172.21.15.120:6801/27468] conn(0x7f4470070480 0x7f4470072920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:31.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.793+0000 7f4487400640 1 -- 172.21.15.120:0/2896505675 --> [v2:172.21.15.120:6800/27468,v1:172.21.15.120:6801/27468] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4470072ff0 con 0x7f4470070480 2024-04-18T04:55:31.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.793+0000 7f4487400640 1 -- 172.21.15.120:0/2896505675 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f448011ecf0 con 0x7f44900c57c0 2024-04-18T04:55:31.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.793+0000 7f448ea00640 1 --2- 172.21.15.120:0/2896505675 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4470066790 0x7f4470068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:31.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.797+0000 7f448fe00640 1 --2- 172.21.15.120:0/2896505675 >> [v2:172.21.15.120:6800/27468,v1:172.21.15.120:6801/27468] conn(0x7f4470070480 0x7f4470072920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:31.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.797+0000 7f448fe00640 1 --2- 172.21.15.120:0/2896505675 >> [v2:172.21.15.120:6800/27468,v1:172.21.15.120:6801/27468] conn(0x7f4470070480 0x7f4470072920 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:31.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.801+0000 7f4487400640 1 -- 172.21.15.120:0/2896505675 <== osd.0 v2:172.21.15.120:6800/27468 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f4470072ff0 con 0x7f4470070480 2024-04-18T04:55:31.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.801+0000 7f448ea00640 1 --2- 172.21.15.120:0/2896505675 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4470066790 0x7f4470068c50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f44900ca130 tx=0x7f447c007ed0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:31.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.821+0000 7f4484c00640 1 -- 172.21.15.120:0/2896505675 --> [v2:172.21.15.120:6800/27468,v1:172.21.15.120:6801/27468] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4490067070 con 0x7f4470070480 2024-04-18T04:55:31.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.829+0000 7f4487400640 1 -- 172.21.15.120:0/2896505675 <== osd.0 v2:172.21.15.120:6800/27468 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f4490067070 con 0x7f4470070480 2024-04-18T04:55:31.825 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-18T04:55:31.826 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T04:55:31.826 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-18T04:55:31.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.833+0000 7f4484c00640 1 -- 172.21.15.120:0/2896505675 >> [v2:172.21.15.120:6800/27468,v1:172.21.15.120:6801/27468] conn(0x7f4470070480 msgr2=0x7f4470072920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:31.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.833+0000 7f4484c00640 1 --2- 172.21.15.120:0/2896505675 >> [v2:172.21.15.120:6800/27468,v1:172.21.15.120:6801/27468] conn(0x7f4470070480 0x7f4470072920 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:31.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.833+0000 7f4484c00640 1 -- 172.21.15.120:0/2896505675 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4470066790 msgr2=0x7f4470068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:31.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.833+0000 7f4484c00640 1 --2- 172.21.15.120:0/2896505675 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f4470066790 0x7f4470068c50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f44900ca130 tx=0x7f447c007ed0 comp rx=0 tx=0).stop 2024-04-18T04:55:31.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.833+0000 7f4484c00640 1 -- 172.21.15.120:0/2896505675 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44900c57c0 msgr2=0x7f4490150b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:31.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.833+0000 7f4484c00640 1 --2- 172.21.15.120:0/2896505675 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44900c57c0 0x7f4490150b60 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f44800ac000 tx=0x7f4480019290 comp rx=0 tx=0).stop 2024-04-18T04:55:31.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.833+0000 7f448fe00640 1 -- 172.21.15.120:0/2896505675 reap_dead start 2024-04-18T04:55:31.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.833+0000 7f4484c00640 1 -- 172.21.15.120:0/2896505675 shutdown_connections 2024-04-18T04:55:31.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.833+0000 7f4484c00640 1 -- 172.21.15.120:0/2896505675 >> 172.21.15.120:0/2896505675 conn(0x7f44900c79c0 msgr2=0x7f44901599c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:31.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.833+0000 7f4484c00640 1 -- 172.21.15.120:0/2896505675 shutdown_connections 2024-04-18T04:55:31.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:31.837+0000 7f4484c00640 1 -- 172.21.15.120:0/2896505675 wait complete. 2024-04-18T04:55:31.885 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-18T04:55:32.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.181+0000 7f0bab200640 1 Processor -- start 2024-04-18T04:55:32.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.181+0000 7f0bab200640 1 -- start start 2024-04-18T04:55:32.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.185+0000 7f0bab200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0ba406ae20 0x7f0ba4159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:32.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.185+0000 7f0bab200640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ba40c4dc0 con 0x7f0ba40c9890 2024-04-18T04:55:32.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.185+0000 7f0ba3400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0ba406ae20 0x7f0ba4159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:32.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.185+0000 7f0ba3400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0ba406ae20 0x7f0ba4159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:42700/0 (socket says 172.21.15.120:42700) 2024-04-18T04:55:32.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.185+0000 7f0ba3400640 1 -- 172.21.15.120:0/1666885878 learned_addr learned my addr 172.21.15.120:0/1666885878 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:32.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.185+0000 7f0ba2a00640 1 -- 172.21.15.120:0/1666885878 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 879297121 0 0) 0x7f0ba40c4dc0 con 0x7f0ba40c9890 2024-04-18T04:55:32.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.185+0000 7f0bab200640 1 -- 172.21.15.120:0/1666885878 --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ba4153c80 con 0x7f0ba41538a0 2024-04-18T04:55:32.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.185+0000 7f0bab200640 1 -- 172.21.15.120:0/1666885878 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba40b2040 con 0x7f0ba406ae20 2024-04-18T04:55:32.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.185+0000 7f0ba2a00640 1 -- 172.21.15.120:0/1666885878 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b88003530 con 0x7f0ba40c9890 2024-04-18T04:55:32.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.189+0000 7f0ba2a00640 1 -- 172.21.15.120:0/1666885878 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 109010451 0 0) 0x7f0ba4153c80 con 0x7f0ba41538a0 2024-04-18T04:55:32.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.189+0000 7f0ba2a00640 1 -- 172.21.15.120:0/1666885878 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ba40c4dc0 con 0x7f0ba41538a0 2024-04-18T04:55:32.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.189+0000 7f0ba2a00640 1 -- 172.21.15.120:0/1666885878 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3526009361 0 0) 0x7f0b88003530 con 0x7f0ba40c9890 2024-04-18T04:55:32.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.189+0000 7f0ba2a00640 1 -- 172.21.15.120:0/1666885878 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0ba406ae20 msgr2=0x7f0ba4159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:32.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.189+0000 7f0ba2a00640 1 --2- 172.21.15.120:0/1666885878 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0ba406ae20 0x7f0ba4159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:32.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.189+0000 7f0ba2a00640 1 -- 172.21.15.120:0/1666885878 >> v1:172.21.15.132:6789/0 conn(0x7f0ba41538a0 legacy=0x7f0ba40cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:32.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.189+0000 7f0ba2a00640 1 -- 172.21.15.120:0/1666885878 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba40c3ed0 con 0x7f0ba40c9890 2024-04-18T04:55:32.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.189+0000 7f0ba3400640 1 --2- 172.21.15.120:0/1666885878 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0ba406ae20 0x7f0ba4159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:55:32.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.189+0000 7f0ba2a00640 1 -- 172.21.15.120:0/1666885878 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7f0b94001680 con 0x7f0ba40c9890 2024-04-18T04:55:32.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.189+0000 7f0ba2a00640 1 -- 172.21.15.120:0/1666885878 >> v1:172.21.15.120:6789/0 conn(0x7f0ba40c9890 legacy=0x7f0ba415aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:32.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.189+0000 7f0ba2a00640 1 --2- 172.21.15.120:0/1666885878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b88003b40 0x7f0b88003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:32.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.189+0000 7f0ba2a00640 1 --2- 172.21.15.120:0/1666885878 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0ba406ae20 0x7f0b880047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:32.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.189+0000 7f0ba2a00640 1 --2- 172.21.15.120:0/1666885878 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b88004d10 0x7f0b88005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:32.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.189+0000 7f0ba2a00640 1 -- 172.21.15.120:0/1666885878 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba40b2040 con 0x7f0b88004d10 2024-04-18T04:55:32.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.189+0000 7f0ba2a00640 1 -- 172.21.15.120:0/1666885878 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8800b990 con 0x7f0b88003b40 2024-04-18T04:55:32.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.189+0000 7f0ba2a00640 1 -- 172.21.15.120:0/1666885878 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8800bb50 con 0x7f0ba406ae20 2024-04-18T04:55:32.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.189+0000 7f0ba3400640 1 --2- 172.21.15.120:0/1666885878 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0ba406ae20 0x7f0b880047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:32.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.189+0000 7f0ba9200640 1 --2- 172.21.15.120:0/1666885878 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b88004d10 0x7f0b88005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:32.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.189+0000 7f0ba3400640 1 -- 172.21.15.120:0/1666885878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b88003b40 msgr2=0x7f0b88003f20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-18T04:55:32.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.189+0000 7f0ba3400640 1 --2- 172.21.15.120:0/1666885878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b88003b40 0x7f0b88003f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:32.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.189+0000 7f0ba3400640 1 -- 172.21.15.120:0/1666885878 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b88004d10 msgr2=0x7f0b88005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:32.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.189+0000 7f0ba3400640 1 --2- 172.21.15.120:0/1666885878 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b88004d10 0x7f0b88005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:32.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.189+0000 7f0ba3400640 1 -- 172.21.15.120:0/1666885878 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b88003530 con 0x7f0ba406ae20 2024-04-18T04:55:32.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.193+0000 7f0ba3400640 1 --2- 172.21.15.120:0/1666885878 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0ba406ae20 0x7f0b880047d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0b90009ab0 tx=0x7f0b9001c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a07857e3f7d62f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:32.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.193+0000 7f0ba2a00640 1 -- 172.21.15.120:0/1666885878 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b900a5830 con 0x7f0ba406ae20 2024-04-18T04:55:32.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.193+0000 7f0ba2a00640 1 -- 172.21.15.120:0/1666885878 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b900a5990 con 0x7f0ba406ae20 2024-04-18T04:55:32.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.193+0000 7f0ba2a00640 1 -- 172.21.15.120:0/1666885878 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b900a5d60 con 0x7f0ba406ae20 2024-04-18T04:55:32.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.197+0000 7f0bab200640 1 -- 172.21.15.120:0/1666885878 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0ba406ae20 msgr2=0x7f0b880047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:32.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.197+0000 7f0bab200640 1 --2- 172.21.15.120:0/1666885878 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0ba406ae20 0x7f0b880047d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0b90009ab0 tx=0x7f0b9001c830 comp rx=0 tx=0).stop 2024-04-18T04:55:32.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.197+0000 7f0ba9200640 1 -- 172.21.15.120:0/1666885878 reap_dead start 2024-04-18T04:55:32.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.197+0000 7f0bab200640 1 -- 172.21.15.120:0/1666885878 shutdown_connections 2024-04-18T04:55:32.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.197+0000 7f0bab200640 1 -- 172.21.15.120:0/1666885878 >> 172.21.15.120:0/1666885878 conn(0x7f0ba4065fc0 msgr2=0x7f0ba40663d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:32.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.197+0000 7f0bab200640 1 -- 172.21.15.120:0/1666885878 shutdown_connections 2024-04-18T04:55:32.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.197+0000 7f0bab200640 1 -- 172.21.15.120:0/1666885878 wait complete. 2024-04-18T04:55:32.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.197+0000 7f0bab200640 1 Processor -- start 2024-04-18T04:55:32.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.197+0000 7f0bab200640 1 -- start start 2024-04-18T04:55:32.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.201+0000 7f0bab200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ba406ae20 0x7f0ba41efca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:32.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.201+0000 7f0bab200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0ba40c6210 0x7f0ba4150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:32.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.201+0000 7f0bab200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ba4153e10 0x7f0ba4156860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:32.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.201+0000 7f0bab200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba40c66e0 con 0x7f0ba4153e10 2024-04-18T04:55:32.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.201+0000 7f0bab200640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba40c69c0 con 0x7f0ba406ae20 2024-04-18T04:55:32.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.201+0000 7f0bab200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba40c6ca0 con 0x7f0ba40c6210 2024-04-18T04:55:32.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.201+0000 7f0ba3e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ba406ae20 0x7f0ba41efca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:32.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.201+0000 7f0ba3e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ba406ae20 0x7f0ba41efca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:55098/0 (socket says 172.21.15.120:55098) 2024-04-18T04:55:32.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.201+0000 7f0ba3e00640 1 -- 172.21.15.120:0/2952594422 learned_addr learned my addr 172.21.15.120:0/2952594422 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:32.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.201+0000 7f0ba3400640 1 --2- 172.21.15.120:0/2952594422 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0ba40c6210 0x7f0ba4150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:32.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.201+0000 7f0ba3400640 1 -- 172.21.15.120:0/2952594422 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ba406ae20 msgr2=0x7f0ba41efca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:32.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.201+0000 7f0ba3400640 1 --2- 172.21.15.120:0/2952594422 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ba406ae20 0x7f0ba41efca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:32.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.201+0000 7f0ba3400640 1 -- 172.21.15.120:0/2952594422 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ba4153e10 msgr2=0x7f0ba4156860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T04:55:32.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.201+0000 7f0ba3400640 1 --2- 172.21.15.120:0/2952594422 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ba4153e10 0x7f0ba4156860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:32.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.201+0000 7f0ba3400640 1 -- 172.21.15.120:0/2952594422 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba41ef4a0 con 0x7f0ba40c6210 2024-04-18T04:55:32.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.201+0000 7f0ba3400640 1 --2- 172.21.15.120:0/2952594422 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0ba40c6210 0x7f0ba4150fe0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0b900ac000 tx=0x7f0b90009240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:32.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.201+0000 7f0b9be00640 1 -- 172.21.15.120:0/2952594422 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b900ad850 con 0x7f0ba40c6210 2024-04-18T04:55:32.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.201+0000 7f0b9be00640 1 -- 172.21.15.120:0/2952594422 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b900ad9b0 con 0x7f0ba40c6210 2024-04-18T04:55:32.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.201+0000 7f0b9be00640 1 -- 172.21.15.120:0/2952594422 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b900add60 con 0x7f0ba40c6210 2024-04-18T04:55:32.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.201+0000 7f0bab200640 1 -- 172.21.15.120:0/2952594422 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ba41ef780 con 0x7f0ba40c6210 2024-04-18T04:55:32.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.201+0000 7f0bab200640 1 -- 172.21.15.120:0/2952594422 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba41ef150 con 0x7f0ba40c6210 2024-04-18T04:55:32.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.205+0000 7f0b99600640 1 -- 172.21.15.120:0/2952594422 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ba4072a70 con 0x7f0ba40c6210 2024-04-18T04:55:32.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.209+0000 7f0b9be00640 1 -- 172.21.15.120:0/2952594422 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0b900b4040 con 0x7f0ba40c6210 2024-04-18T04:55:32.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.209+0000 7f0b9be00640 1 --2- 172.21.15.120:0/2952594422 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0b84066710 0x7f0b84068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:32.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.209+0000 7f0ba3e00640 1 --2- 172.21.15.120:0/2952594422 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0b84066710 0x7f0b84068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:32.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.209+0000 7f0b9be00640 1 -- 172.21.15.120:0/2952594422 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f0b9000f000 con 0x7f0ba40c6210 2024-04-18T04:55:32.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.209+0000 7f0ba3e00640 1 --2- 172.21.15.120:0/2952594422 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0b84066710 0x7f0b84068bd0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c002180 tx=0x7f0b9c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:32.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.213+0000 7f0b9be00640 1 -- 172.21.15.120:0/2952594422 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f0b900eb440 con 0x7f0ba40c6210 2024-04-18T04:55:32.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.545+0000 7f0b99600640 1 -- 172.21.15.120:0/2952594422 --> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ba40c4770 con 0x7f0b84066710 2024-04-18T04:55:32.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.545+0000 7f0b9be00640 1 -- 172.21.15.120:0/2952594422 <== mgr.4113 v2:172.21.15.132:6832/27788 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0b9c00fcc0 con 0x7f0b84066710 2024-04-18T04:55:32.543 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 0 to deep-scrub 2024-04-18T04:55:32.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.549+0000 7f0b99600640 1 -- 172.21.15.120:0/2952594422 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0b84066710 msgr2=0x7f0b84068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:32.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.549+0000 7f0b99600640 1 --2- 172.21.15.120:0/2952594422 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0b84066710 0x7f0b84068bd0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c002180 tx=0x7f0b9c009040 comp rx=0 tx=0).stop 2024-04-18T04:55:32.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.549+0000 7f0b99600640 1 -- 172.21.15.120:0/2952594422 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0ba40c6210 msgr2=0x7f0ba4150fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:32.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.549+0000 7f0b99600640 1 --2- 172.21.15.120:0/2952594422 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0ba40c6210 0x7f0ba4150fe0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0b900ac000 tx=0x7f0b90009240 comp rx=0 tx=0).stop 2024-04-18T04:55:32.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.549+0000 7f0b99600640 1 -- 172.21.15.120:0/2952594422 shutdown_connections 2024-04-18T04:55:32.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.549+0000 7f0b99600640 1 --2- 172.21.15.120:0/2952594422 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f0b84066710 0x7f0b84068bd0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:32.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.549+0000 7f0b99600640 1 --2- 172.21.15.120:0/2952594422 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ba4153e10 0x7f0ba4156860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:32.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.549+0000 7f0b99600640 1 --2- 172.21.15.120:0/2952594422 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0ba40c6210 0x7f0ba4150fe0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:32.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.549+0000 7f0b99600640 1 --2- 172.21.15.120:0/2952594422 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ba406ae20 0x7f0ba41efca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:32.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.549+0000 7f0b99600640 1 -- 172.21.15.120:0/2952594422 >> 172.21.15.120:0/2952594422 conn(0x7f0ba4065fc0 msgr2=0x7f0ba414e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:32.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.549+0000 7f0b99600640 1 -- 172.21.15.120:0/2952594422 shutdown_connections 2024-04-18T04:55:32.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.549+0000 7f0b99600640 1 -- 172.21.15.120:0/2952594422 wait complete. 2024-04-18T04:55:32.565 INFO:tasks.ceph:Scrubbing osd.1 2024-04-18T04:55:32.565 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-18T04:55:32.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.709+0000 7f94cb000640 1 Processor -- start 2024-04-18T04:55:32.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.709+0000 7f94cb000640 1 -- start start 2024-04-18T04:55:32.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.709+0000 7f94cb000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94c41538c0 0x7f94c415a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:32.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.709+0000 7f94cb000640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f94c40c46e0 0x7f94c40c4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:32.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.709+0000 7f94cb000640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94c415a650 con 0x7f94c40c9a40 2024-04-18T04:55:32.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.709+0000 7f94cb000640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94c40c5ed0 con 0x7f94c40c46e0 2024-04-18T04:55:32.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.709+0000 7f94cb000640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c40c4250 con 0x7f94c41538c0 2024-04-18T04:55:32.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.709+0000 7f94c9000640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f94c40c46e0 0x7f94c40c4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:32.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.709+0000 7f94c9000640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f94c40c46e0 0x7f94c40c4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53556/0 (socket says 172.21.15.120:53556) 2024-04-18T04:55:32.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.709+0000 7f94c9000640 1 -- 172.21.15.120:0/1768840354 learned_addr learned my addr 172.21.15.120:0/1768840354 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:32.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.709+0000 7f94c3e00640 1 --2- 172.21.15.120:0/1768840354 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94c41538c0 0x7f94c415a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:32.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.713+0000 7f94c9000640 1 -- 172.21.15.120:0/1768840354 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94c41538c0 msgr2=0x7f94c415a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:32.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.713+0000 7f94c9000640 1 --2- 172.21.15.120:0/1768840354 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94c41538c0 0x7f94c415a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:32.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.713+0000 7f94c9000640 1 -- 172.21.15.120:0/1768840354 >> v1:172.21.15.120:6789/0 conn(0x7f94c40c9a40 legacy=0x7f94c406a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:32.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.713+0000 7f94c9000640 1 -- 172.21.15.120:0/1768840354 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c40c50a0 con 0x7f94c40c46e0 2024-04-18T04:55:32.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.713+0000 7f94c3e00640 1 --2- 172.21.15.120:0/1768840354 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94c41538c0 0x7f94c415a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:55:32.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.713+0000 7f94c9000640 1 --2- 172.21.15.120:0/1768840354 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94c40c46e0 0x7f94c40c4b60 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f94bc009e50 tx=0x7f94bc01f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1065b7aaca63eae7 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:32.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.713+0000 7f94c3400640 1 -- 172.21.15.120:0/1768840354 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94bc0af400 con 0x7f94c40c46e0 2024-04-18T04:55:32.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.713+0000 7f94c3400640 1 -- 172.21.15.120:0/1768840354 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94bc0ab050 con 0x7f94c40c46e0 2024-04-18T04:55:32.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.713+0000 7f94c3400640 1 -- 172.21.15.120:0/1768840354 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94bc0af780 con 0x7f94c40c46e0 2024-04-18T04:55:32.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.713+0000 7f94cb000640 1 -- 172.21.15.120:0/1768840354 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94c40c46e0 msgr2=0x7f94c40c4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:32.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.713+0000 7f94cb000640 1 --2- 172.21.15.120:0/1768840354 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94c40c46e0 0x7f94c40c4b60 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f94bc009e50 tx=0x7f94bc01f210 comp rx=0 tx=0).stop 2024-04-18T04:55:32.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.713+0000 7f94cb000640 1 -- 172.21.15.120:0/1768840354 shutdown_connections 2024-04-18T04:55:32.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.713+0000 7f94cb000640 1 --2- 172.21.15.120:0/1768840354 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94c40c46e0 0x7f94c40c4b60 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:32.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.713+0000 7f94cb000640 1 --2- 172.21.15.120:0/1768840354 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94c41538c0 0x7f94c415a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:32.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.713+0000 7f94cb000640 1 -- 172.21.15.120:0/1768840354 >> 172.21.15.120:0/1768840354 conn(0x7f94c406c270 msgr2=0x7f94c406c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:32.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.713+0000 7f94cb000640 1 -- 172.21.15.120:0/1768840354 shutdown_connections 2024-04-18T04:55:32.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.713+0000 7f94cb000640 1 -- 172.21.15.120:0/1768840354 wait complete. 2024-04-18T04:55:32.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.717+0000 7f94cb000640 1 Processor -- start 2024-04-18T04:55:32.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.717+0000 7f94cb000640 1 -- start start 2024-04-18T04:55:32.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.717+0000 7f94cb000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94c40c46e0 0x7f94c41eedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:32.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.717+0000 7f94cb000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94c40c9a40 0x7f94c4150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:32.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.717+0000 7f94cb000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94c41538c0 0x7f94c414fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:32.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.717+0000 7f94cb000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c414e8e0 con 0x7f94c41538c0 2024-04-18T04:55:32.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.717+0000 7f94cb000640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c414ebc0 con 0x7f94c40c9a40 2024-04-18T04:55:32.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.717+0000 7f94cb000640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c414eea0 con 0x7f94c40c46e0 2024-04-18T04:55:32.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.717+0000 7f94c9000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94c41538c0 0x7f94c414fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:32.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.717+0000 7f94c9000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94c41538c0 0x7f94c414fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53558/0 (socket says 172.21.15.120:53558) 2024-04-18T04:55:32.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.717+0000 7f94c9000640 1 -- 172.21.15.120:0/37091608 learned_addr learned my addr 172.21.15.120:0/37091608 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:32.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.717+0000 7f94c3e00640 1 --2- 172.21.15.120:0/37091608 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94c40c46e0 0x7f94c41eedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:32.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.717+0000 7f94bbe00640 1 --2- 172.21.15.120:0/37091608 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94c40c9a40 0x7f94c4150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:32.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.717+0000 7f94c9000640 1 -- 172.21.15.120:0/37091608 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94c40c46e0 msgr2=0x7f94c41eedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:32.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.717+0000 7f94c9000640 1 --2- 172.21.15.120:0/37091608 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94c40c46e0 0x7f94c41eedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:32.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.717+0000 7f94c9000640 1 -- 172.21.15.120:0/37091608 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94c40c9a40 msgr2=0x7f94c4150860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:32.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.717+0000 7f94c9000640 1 --2- 172.21.15.120:0/37091608 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94c40c9a40 0x7f94c4150860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:32.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.717+0000 7f94c9000640 1 -- 172.21.15.120:0/37091608 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94bc009b30 con 0x7f94c41538c0 2024-04-18T04:55:32.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.717+0000 7f94c9000640 1 --2- 172.21.15.120:0/37091608 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94c41538c0 0x7f94c414fc60 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f94bc01ce40 tx=0x7f94bc01bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:32.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.717+0000 7f94c0c00640 1 -- 172.21.15.120:0/37091608 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94bc0c0070 con 0x7f94c41538c0 2024-04-18T04:55:32.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.717+0000 7f94c0c00640 1 -- 172.21.15.120:0/37091608 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94bc009510 con 0x7f94c41538c0 2024-04-18T04:55:32.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.717+0000 7f94c0c00640 1 -- 172.21.15.120:0/37091608 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94bc0afda0 con 0x7f94c41538c0 2024-04-18T04:55:32.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.717+0000 7f94cb000640 1 -- 172.21.15.120:0/37091608 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94c414f180 con 0x7f94c41538c0 2024-04-18T04:55:32.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.721+0000 7f94cb000640 1 -- 172.21.15.120:0/37091608 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94c414f740 con 0x7f94c41538c0 2024-04-18T04:55:32.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.721+0000 7f94cb000640 1 -- 172.21.15.120:0/37091608 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f94c415d600 con 0x7f94c41538c0 2024-04-18T04:55:32.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.721+0000 7f94c0c00640 1 -- 172.21.15.120:0/37091608 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f94bc0b6040 con 0x7f94c41538c0 2024-04-18T04:55:32.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.721+0000 7f94c0c00640 1 --2- 172.21.15.120:0/37091608 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f94a00666c0 0x7f94a0068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:32.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.721+0000 7f94c0c00640 1 -- 172.21.15.120:0/37091608 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f94bc122e10 con 0x7f94c41538c0 2024-04-18T04:55:32.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.721+0000 7f94c0c00640 1 --2- 172.21.15.120:0/37091608 >> [v2:172.21.15.120:6821/27470,v1:172.21.15.120:6823/27470] conn(0x7f94a0070330 0x7f94a00727d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:32.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.721+0000 7f94c0c00640 1 -- 172.21.15.120:0/37091608 --> [v2:172.21.15.120:6821/27470,v1:172.21.15.120:6823/27470] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f94a0072ea0 con 0x7f94a0070330 2024-04-18T04:55:32.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.721+0000 7f94c0c00640 1 -- 172.21.15.120:0/37091608 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94bc123180 con 0x7f94c41538c0 2024-04-18T04:55:32.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.721+0000 7f94c3e00640 1 --2- 172.21.15.120:0/37091608 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f94a00666c0 0x7f94a0068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:32.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.725+0000 7f94bbe00640 1 --2- 172.21.15.120:0/37091608 >> [v2:172.21.15.120:6821/27470,v1:172.21.15.120:6823/27470] conn(0x7f94a0070330 0x7f94a00727d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:32.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.725+0000 7f94bbe00640 1 --2- 172.21.15.120:0/37091608 >> [v2:172.21.15.120:6821/27470,v1:172.21.15.120:6823/27470] conn(0x7f94a0070330 0x7f94a00727d0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:32.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.725+0000 7f94c3e00640 1 --2- 172.21.15.120:0/37091608 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f94a00666c0 0x7f94a0068b80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f94b40045f0 tx=0x7f94b4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:32.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.725+0000 7f94c0c00640 1 -- 172.21.15.120:0/37091608 <== osd.1 v2:172.21.15.120:6821/27470 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f94a0072ea0 con 0x7f94a0070330 2024-04-18T04:55:32.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.737+0000 7f94cb000640 1 -- 172.21.15.120:0/37091608 --> [v2:172.21.15.120:6821/27470,v1:172.21.15.120:6823/27470] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f94c415d320 con 0x7f94a0070330 2024-04-18T04:55:32.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.737+0000 7f94c0c00640 1 -- 172.21.15.120:0/37091608 <== osd.1 v2:172.21.15.120:6821/27470 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f94ac0050e0 con 0x7f94a0070330 2024-04-18T04:55:32.735 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-18T04:55:32.735 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T04:55:32.735 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-18T04:55:32.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.737+0000 7f94cb000640 1 -- 172.21.15.120:0/37091608 >> [v2:172.21.15.120:6821/27470,v1:172.21.15.120:6823/27470] conn(0x7f94a0070330 msgr2=0x7f94a00727d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:32.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.737+0000 7f94cb000640 1 --2- 172.21.15.120:0/37091608 >> [v2:172.21.15.120:6821/27470,v1:172.21.15.120:6823/27470] conn(0x7f94a0070330 0x7f94a00727d0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:32.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.737+0000 7f94cb000640 1 -- 172.21.15.120:0/37091608 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f94a00666c0 msgr2=0x7f94a0068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:32.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.737+0000 7f94cb000640 1 --2- 172.21.15.120:0/37091608 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f94a00666c0 0x7f94a0068b80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f94b40045f0 tx=0x7f94b4008040 comp rx=0 tx=0).stop 2024-04-18T04:55:32.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.737+0000 7f94cb000640 1 -- 172.21.15.120:0/37091608 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94c41538c0 msgr2=0x7f94c414fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:32.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.737+0000 7f94cb000640 1 --2- 172.21.15.120:0/37091608 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94c41538c0 0x7f94c414fc60 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f94bc01ce40 tx=0x7f94bc01bfb0 comp rx=0 tx=0).stop 2024-04-18T04:55:32.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.737+0000 7f94c9000640 1 -- 172.21.15.120:0/37091608 reap_dead start 2024-04-18T04:55:32.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.737+0000 7f94cb000640 1 -- 172.21.15.120:0/37091608 shutdown_connections 2024-04-18T04:55:32.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.737+0000 7f94cb000640 1 -- 172.21.15.120:0/37091608 >> 172.21.15.120:0/37091608 conn(0x7f94c406c270 msgr2=0x7f94c4152840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:32.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.737+0000 7f94cb000640 1 -- 172.21.15.120:0/37091608 shutdown_connections 2024-04-18T04:55:32.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.737+0000 7f94cb000640 1 -- 172.21.15.120:0/37091608 wait complete. 2024-04-18T04:55:32.754 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-18T04:55:32.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.893+0000 7f62fd200640 1 Processor -- start 2024-04-18T04:55:32.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.897+0000 7f62fd200640 1 -- start start 2024-04-18T04:55:32.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.897+0000 7f62fd200640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f62f80c7210 0x7f62f8162b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:32.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.897+0000 7f62fd200640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62f80702c0 con 0x7f62f80c6e30 2024-04-18T04:55:32.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.897+0000 7f62fd200640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62f80c5d00 con 0x7f62f806f6f0 2024-04-18T04:55:32.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.897+0000 7f62fd200640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f80c5fc0 con 0x7f62f80c7210 2024-04-18T04:55:32.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.897+0000 7f62f7400640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f62f80c6e30 0x7f62f8151060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:54708/0 (socket says 172.21.15.120:54708) 2024-04-18T04:55:32.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.897+0000 7f62f7400640 1 -- 172.21.15.120:0/2495683375 learned_addr learned my addr 172.21.15.120:0/2495683375 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:55:32.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.897+0000 7f62f7e00640 1 --2- 172.21.15.120:0/2495683375 >> v2:172.21.15.132:3300/0 conn(0x7f62f80c7210 0x7f62f8162b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:32.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.897+0000 7f62f6000640 1 -- 172.21.15.120:0/2495683375 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4096627842 0 0) 0x7f62f80702c0 con 0x7f62f80c6e30 2024-04-18T04:55:32.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.897+0000 7f62f6000640 1 -- 172.21.15.120:0/2495683375 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62dc003530 con 0x7f62f80c6e30 2024-04-18T04:55:32.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.897+0000 7f62f6000640 1 -- 172.21.15.120:0/2495683375 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3937277953 0 0) 0x7f62dc003530 con 0x7f62f80c6e30 2024-04-18T04:55:32.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.897+0000 7f62f6000640 1 -- 172.21.15.120:0/2495683375 >> v2:172.21.15.132:3300/0 conn(0x7f62f80c7210 msgr2=0x7f62f8162b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:32.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.897+0000 7f62f6000640 1 --2- 172.21.15.120:0/2495683375 >> v2:172.21.15.132:3300/0 conn(0x7f62f80c7210 0x7f62f8162b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:32.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.897+0000 7f62f6000640 1 -- 172.21.15.120:0/2495683375 >> v1:172.21.15.132:6789/0 conn(0x7f62f806f6f0 legacy=0x7f62f8070750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:32.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.897+0000 7f62f6000640 1 -- 172.21.15.120:0/2495683375 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f80c62a0 con 0x7f62f80c6e30 2024-04-18T04:55:32.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.897+0000 7f62f6000640 1 -- 172.21.15.120:0/2495683375 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7f62e8001680 con 0x7f62f80c6e30 2024-04-18T04:55:32.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.897+0000 7f62f6000640 1 -- 172.21.15.120:0/2495683375 >> v1:172.21.15.120:6789/0 conn(0x7f62f80c6e30 legacy=0x7f62f8151060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:32.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.897+0000 7f62f6000640 1 --2- 172.21.15.120:0/2495683375 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f62dc003980 0x7f62dc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:32.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.897+0000 7f62f6000640 1 --2- 172.21.15.120:0/2495683375 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62dc0047d0 0x7f62dc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:32.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.897+0000 7f62f6000640 1 --2- 172.21.15.120:0/2495683375 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f62dc005190 0x7f62dc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:32.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.897+0000 7f62f6000640 1 -- 172.21.15.120:0/2495683375 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f80c5fc0 con 0x7f62dc005190 2024-04-18T04:55:32.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.897+0000 7f62f6000640 1 -- 172.21.15.120:0/2495683375 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62dc00c040 con 0x7f62dc0047d0 2024-04-18T04:55:32.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.897+0000 7f62f6000640 1 -- 172.21.15.120:0/2495683375 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62dc00c200 con 0x7f62dc003980 2024-04-18T04:55:32.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.897+0000 7f62f7e00640 1 --2- 172.21.15.120:0/2495683375 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f62dc005190 0x7f62dc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:32.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.897+0000 7f62f6a00640 1 --2- 172.21.15.120:0/2495683375 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62dc0047d0 0x7f62dc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:32.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.897+0000 7f62f7400640 1 --2- 172.21.15.120:0/2495683375 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f62dc003980 0x7f62dc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:32.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.897+0000 7f62f7e00640 1 -- 172.21.15.120:0/2495683375 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f62dc003980 msgr2=0x7f62dc003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:32.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.897+0000 7f62f7e00640 1 --2- 172.21.15.120:0/2495683375 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f62dc003980 0x7f62dc003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:32.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.897+0000 7f62f7e00640 1 -- 172.21.15.120:0/2495683375 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62dc0047d0 msgr2=0x7f62dc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:32.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.897+0000 7f62f7e00640 1 --2- 172.21.15.120:0/2495683375 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62dc0047d0 0x7f62dc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:32.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.897+0000 7f62f7e00640 1 -- 172.21.15.120:0/2495683375 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62dc003530 con 0x7f62dc005190 2024-04-18T04:55:32.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.897+0000 7f62f7400640 1 --2- 172.21.15.120:0/2495683375 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f62dc003980 0x7f62dc003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:55:32.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.897+0000 7f62f6a00640 1 --2- 172.21.15.120:0/2495683375 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62dc0047d0 0x7f62dc004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:55:32.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.901+0000 7f62f7e00640 1 -- 172.21.15.120:0/2495683375 reap_dead start 2024-04-18T04:55:32.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.901+0000 7f62f7e00640 1 --2- 172.21.15.120:0/2495683375 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f62dc005190 0x7f62dc00b990 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f62f0009f90 tx=0x7f62f001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8caabee2090b2f29 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:32.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.901+0000 7f62f6000640 1 -- 172.21.15.120:0/2495683375 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f00a5c90 con 0x7f62dc005190 2024-04-18T04:55:32.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.901+0000 7f62f6000640 1 -- 172.21.15.120:0/2495683375 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f000f040 con 0x7f62dc005190 2024-04-18T04:55:32.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.901+0000 7f62f6000640 1 -- 172.21.15.120:0/2495683375 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f00ad440 con 0x7f62dc005190 2024-04-18T04:55:32.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.901+0000 7f62fd200640 1 -- 172.21.15.120:0/2495683375 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f62dc005190 msgr2=0x7f62dc00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:32.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.901+0000 7f62fd200640 1 --2- 172.21.15.120:0/2495683375 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f62dc005190 0x7f62dc00b990 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f62f0009f90 tx=0x7f62f001cc80 comp rx=0 tx=0).stop 2024-04-18T04:55:32.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.901+0000 7f62fd200640 1 -- 172.21.15.120:0/2495683375 shutdown_connections 2024-04-18T04:55:32.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.901+0000 7f62fd200640 1 --2- 172.21.15.120:0/2495683375 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f62dc005190 0x7f62dc00b990 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:32.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.901+0000 7f62fd200640 1 -- 172.21.15.120:0/2495683375 >> 172.21.15.120:0/2495683375 conn(0x7f62f806d000 msgr2=0x7f62f806d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:32.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.901+0000 7f62fd200640 1 -- 172.21.15.120:0/2495683375 shutdown_connections 2024-04-18T04:55:32.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.901+0000 7f62fd200640 1 -- 172.21.15.120:0/2495683375 wait complete. 2024-04-18T04:55:32.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.905+0000 7f62fd200640 1 Processor -- start 2024-04-18T04:55:32.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.905+0000 7f62fd200640 1 -- start start 2024-04-18T04:55:32.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.905+0000 7f62fd200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f62dc005190 0x7f62f81486d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:32.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.905+0000 7f62fd200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f62f81521e0 0x7f62f8148c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:32.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.905+0000 7f62fd200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62f814ea90 0x7f62f81eecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:32.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.905+0000 7f62fd200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f8152b90 con 0x7f62dc005190 2024-04-18T04:55:32.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.905+0000 7f62fd200640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f81526a0 con 0x7f62f814ea90 2024-04-18T04:55:32.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.905+0000 7f62fd200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f81528b0 con 0x7f62f81521e0 2024-04-18T04:55:32.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.905+0000 7f62f7400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f62dc005190 0x7f62f81486d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:32.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.905+0000 7f62f7400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f62dc005190 0x7f62f81486d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53566/0 (socket says 172.21.15.120:53566) 2024-04-18T04:55:32.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.905+0000 7f62f7400640 1 -- 172.21.15.120:0/912375798 learned_addr learned my addr 172.21.15.120:0/912375798 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:32.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.905+0000 7f62f6a00640 1 --2- 172.21.15.120:0/912375798 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f62f81521e0 0x7f62f8148c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:32.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.905+0000 7f62f7e00640 1 --2- 172.21.15.120:0/912375798 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62f814ea90 0x7f62f81eecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:32.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.905+0000 7f62f7400640 1 -- 172.21.15.120:0/912375798 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f62f81521e0 msgr2=0x7f62f8148c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:32.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.905+0000 7f62f7400640 1 --2- 172.21.15.120:0/912375798 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f62f81521e0 0x7f62f8148c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:32.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.905+0000 7f62f7400640 1 -- 172.21.15.120:0/912375798 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62f814ea90 msgr2=0x7f62f81eecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:32.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.905+0000 7f62f7400640 1 --2- 172.21.15.120:0/912375798 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62f814ea90 0x7f62f81eecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:32.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.905+0000 7f62f7400640 1 -- 172.21.15.120:0/912375798 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f80ada20 con 0x7f62dc005190 2024-04-18T04:55:32.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.905+0000 7f62f6a00640 1 --2- 172.21.15.120:0/912375798 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f62f81521e0 0x7f62f8148c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:55:32.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.905+0000 7f62f7400640 1 --2- 172.21.15.120:0/912375798 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f62dc005190 0x7f62f81486d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f62e800e780 tx=0x7f62e800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:32.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.905+0000 7f62ef400640 1 -- 172.21.15.120:0/912375798 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e800c6c0 con 0x7f62dc005190 2024-04-18T04:55:32.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.905+0000 7f62ef400640 1 -- 172.21.15.120:0/912375798 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e800c820 con 0x7f62dc005190 2024-04-18T04:55:32.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.905+0000 7f62ef400640 1 -- 172.21.15.120:0/912375798 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e800cb90 con 0x7f62dc005190 2024-04-18T04:55:32.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.905+0000 7f62fd200640 1 -- 172.21.15.120:0/912375798 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62f80add00 con 0x7f62dc005190 2024-04-18T04:55:32.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.905+0000 7f62fd200640 1 -- 172.21.15.120:0/912375798 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f8152e90 con 0x7f62dc005190 2024-04-18T04:55:32.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.905+0000 7f62fd200640 1 -- 172.21.15.120:0/912375798 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62f81530b0 con 0x7f62dc005190 2024-04-18T04:55:32.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.909+0000 7f62ef400640 1 -- 172.21.15.120:0/912375798 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f62e800ccf0 con 0x7f62dc005190 2024-04-18T04:55:32.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.909+0000 7f62ef400640 1 --2- 172.21.15.120:0/912375798 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f62d80666c0 0x7f62d8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:32.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.909+0000 7f62ef400640 1 -- 172.21.15.120:0/912375798 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f62e8084340 con 0x7f62dc005190 2024-04-18T04:55:32.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.909+0000 7f62f6a00640 1 --2- 172.21.15.120:0/912375798 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f62d80666c0 0x7f62d8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:32.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.909+0000 7f62f6a00640 1 --2- 172.21.15.120:0/912375798 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f62d80666c0 0x7f62d8068b80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f62e4000c10 tx=0x7f62e4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:32.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:32.913+0000 7f62ef400640 1 -- 172.21.15.120:0/912375798 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f62f81530b0 con 0x7f62dc005190 2024-04-18T04:55:33.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.069+0000 7f62fd200640 1 -- 172.21.15.120:0/912375798 --> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f62f80b0da0 con 0x7f62d80666c0 2024-04-18T04:55:33.069 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 1 to deep-scrub 2024-04-18T04:55:33.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.073+0000 7f62ef400640 1 -- 172.21.15.120:0/912375798 <== mgr.4113 v2:172.21.15.132:6832/27788 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f62f80b0da0 con 0x7f62d80666c0 2024-04-18T04:55:33.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.073+0000 7f62fd200640 1 -- 172.21.15.120:0/912375798 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f62d80666c0 msgr2=0x7f62d8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:33.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.073+0000 7f62fd200640 1 --2- 172.21.15.120:0/912375798 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f62d80666c0 0x7f62d8068b80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f62e4000c10 tx=0x7f62e4009040 comp rx=0 tx=0).stop 2024-04-18T04:55:33.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.073+0000 7f62fd200640 1 -- 172.21.15.120:0/912375798 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f62dc005190 msgr2=0x7f62f81486d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:33.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.073+0000 7f62fd200640 1 --2- 172.21.15.120:0/912375798 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f62dc005190 0x7f62f81486d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f62e800e780 tx=0x7f62e800eb80 comp rx=0 tx=0).stop 2024-04-18T04:55:33.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.073+0000 7f62fd200640 1 -- 172.21.15.120:0/912375798 shutdown_connections 2024-04-18T04:55:33.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.073+0000 7f62fd200640 1 --2- 172.21.15.120:0/912375798 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f62d80666c0 0x7f62d8068b80 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:33.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.073+0000 7f62fd200640 1 --2- 172.21.15.120:0/912375798 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62f814ea90 0x7f62f81eecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:33.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.073+0000 7f62fd200640 1 --2- 172.21.15.120:0/912375798 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f62f81521e0 0x7f62f8148c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:33.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.073+0000 7f62fd200640 1 --2- 172.21.15.120:0/912375798 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f62dc005190 0x7f62f81486d0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:33.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.073+0000 7f62fd200640 1 -- 172.21.15.120:0/912375798 >> 172.21.15.120:0/912375798 conn(0x7f62f806d000 msgr2=0x7f62f814f190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:33.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.073+0000 7f62fd200640 1 -- 172.21.15.120:0/912375798 shutdown_connections 2024-04-18T04:55:33.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.073+0000 7f62fd200640 1 -- 172.21.15.120:0/912375798 wait complete. 2024-04-18T04:55:33.309 INFO:tasks.ceph:Scrubbing osd.2 2024-04-18T04:55:33.309 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-18T04:55:33.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.589+0000 7f902f800640 1 Processor -- start 2024-04-18T04:55:33.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.589+0000 7f902f800640 1 -- start start 2024-04-18T04:55:33.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.589+0000 7f902f800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9028153a70 0x7f9028159840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:33.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.589+0000 7f902f800640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f90280cab70 0x7f90280cc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:33.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.589+0000 7f902f800640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90280c4410 con 0x7f90280cc750 2024-04-18T04:55:33.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.589+0000 7f902f800640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f902815a790 con 0x7f90280cab70 2024-04-18T04:55:33.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.589+0000 7f902f800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90280cbd80 con 0x7f9028153a70 2024-04-18T04:55:33.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.589+0000 7f902d800640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f90280cc750 0x7f90280c9d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:38932/0 (socket says 172.21.15.120:38932) 2024-04-18T04:55:33.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.593+0000 7f902d800640 1 -- 172.21.15.120:0/1237823407 learned_addr learned my addr 172.21.15.120:0/1237823407 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:55:33.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.593+0000 7f9027e00640 1 --2- 172.21.15.120:0/1237823407 >> v2:172.21.15.132:3300/0 conn(0x7f90280cab70 0x7f90280cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:33.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.593+0000 7f902ce00640 1 --2- 172.21.15.120:0/1237823407 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9028153a70 0x7f9028159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:33.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.597+0000 7f9027400640 1 -- 172.21.15.120:0/1237823407 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 460201299 0 0) 0x7f90280c4410 con 0x7f90280cc750 2024-04-18T04:55:33.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.597+0000 7f9027400640 1 -- 172.21.15.120:0/1237823407 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9010003530 con 0x7f90280cc750 2024-04-18T04:55:33.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.597+0000 7f902ce00640 1 -- 172.21.15.120:0/1237823407 >> v2:172.21.15.132:3300/0 conn(0x7f90280cab70 msgr2=0x7f90280cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:33.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.597+0000 7f902ce00640 1 --2- 172.21.15.120:0/1237823407 >> v2:172.21.15.132:3300/0 conn(0x7f90280cab70 0x7f90280cc210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:33.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.597+0000 7f9027400640 1 -- 172.21.15.120:0/1237823407 <== mon.1 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 446242173 0 0) 0x7f9010003530 con 0x7f90280cc750 2024-04-18T04:55:33.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.597+0000 7f902ce00640 1 -- 172.21.15.120:0/1237823407 >> v1:172.21.15.132:6789/0 conn(0x7f90280cc750 legacy=0x7f90280c9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:33.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.597+0000 7f902ce00640 1 -- 172.21.15.120:0/1237823407 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f902815a1d0 con 0x7f9028153a70 2024-04-18T04:55:33.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.597+0000 7f9027e00640 1 --2- 172.21.15.120:0/1237823407 >> v2:172.21.15.132:3300/0 conn(0x7f90280cab70 0x7f90280cc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:55:33.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.601+0000 7f902ce00640 1 --2- 172.21.15.120:0/1237823407 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9028153a70 0x7f9028159840 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f901c0097c0 tx=0x7f901c01c390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c03bc2d6a5fd6b2d server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:33.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.605+0000 7f9027400640 1 -- 172.21.15.120:0/1237823407 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9020001a00 con 0x7f9028153a70 2024-04-18T04:55:33.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.605+0000 7f9027400640 1 -- 172.21.15.120:0/1237823407 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f901c0a7050 con 0x7f9028153a70 2024-04-18T04:55:33.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.605+0000 7f9027400640 1 -- 172.21.15.120:0/1237823407 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901c0ab620 con 0x7f9028153a70 2024-04-18T04:55:33.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.605+0000 7f902f800640 1 -- 172.21.15.120:0/1237823407 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9028153a70 msgr2=0x7f9028159840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:33.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.605+0000 7f902f800640 1 --2- 172.21.15.120:0/1237823407 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9028153a70 0x7f9028159840 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f901c0097c0 tx=0x7f901c01c390 comp rx=0 tx=0).stop 2024-04-18T04:55:33.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.605+0000 7f902f800640 1 -- 172.21.15.120:0/1237823407 shutdown_connections 2024-04-18T04:55:33.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.605+0000 7f902f800640 1 --2- 172.21.15.120:0/1237823407 >> v2:172.21.15.132:3300/0 conn(0x7f90280cab70 0x7f90280cc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:33.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.605+0000 7f902f800640 1 --2- 172.21.15.120:0/1237823407 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9028153a70 0x7f9028159840 secure :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f901c0097c0 tx=0x7f901c01c390 comp rx=0 tx=0).stop 2024-04-18T04:55:33.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.605+0000 7f902f800640 1 -- 172.21.15.120:0/1237823407 >> 172.21.15.120:0/1237823407 conn(0x7f9028065f90 msgr2=0x7f90280663a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:33.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.605+0000 7f902f800640 1 -- 172.21.15.120:0/1237823407 shutdown_connections 2024-04-18T04:55:33.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.605+0000 7f902f800640 1 -- 172.21.15.120:0/1237823407 wait complete. 2024-04-18T04:55:33.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.609+0000 7f902f800640 1 Processor -- start 2024-04-18T04:55:33.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.613+0000 7f902f800640 1 -- start start 2024-04-18T04:55:33.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.621+0000 7f902f800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f90280cab70 0x7f90281f57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:33.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.621+0000 7f902f800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f90280cc750 0x7f90280cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:33.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.621+0000 7f902f800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9028159490 0x7f902813cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:33.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.621+0000 7f902f800640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902813e6e0 con 0x7f90280cc750 2024-04-18T04:55:33.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.621+0000 7f902f800640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90281f5d10 con 0x7f9028159490 2024-04-18T04:55:33.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.621+0000 7f902f800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90281579f0 con 0x7f90280cab70 2024-04-18T04:55:33.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.621+0000 7f902ce00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f90280cab70 0x7f90281f57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:33.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.621+0000 7f9027e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f90280cc750 0x7f90280cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:33.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.621+0000 7f9027e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f90280cc750 0x7f90280cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53580/0 (socket says 172.21.15.120:53580) 2024-04-18T04:55:33.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.621+0000 7f9027e00640 1 -- 172.21.15.120:0/3673776573 learned_addr learned my addr 172.21.15.120:0/3673776573 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:33.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.625+0000 7f9027e00640 1 -- 172.21.15.120:0/3673776573 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f90280cab70 msgr2=0x7f90281f57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:33.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.625+0000 7f9027e00640 1 --2- 172.21.15.120:0/3673776573 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f90280cab70 0x7f90281f57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:33.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.625+0000 7f9027e00640 1 -- 172.21.15.120:0/3673776573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9028159490 msgr2=0x7f902813cc20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-18T04:55:33.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.625+0000 7f9027e00640 1 --2- 172.21.15.120:0/3673776573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9028159490 0x7f902813cc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:33.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.625+0000 7f9027e00640 1 -- 172.21.15.120:0/3673776573 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f901c009420 con 0x7f90280cc750 2024-04-18T04:55:33.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.625+0000 7f9027e00640 1 --2- 172.21.15.120:0/3673776573 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f90280cc750 0x7f90280cdcf0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f901400e810 tx=0x7f901400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:33.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.629+0000 7f9024c00640 1 -- 172.21.15.120:0/3673776573 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901400c8d0 con 0x7f90280cc750 2024-04-18T04:55:33.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.629+0000 7f9024c00640 1 -- 172.21.15.120:0/3673776573 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f901400ca30 con 0x7f90280cc750 2024-04-18T04:55:33.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.629+0000 7f9024c00640 1 -- 172.21.15.120:0/3673776573 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901400cdc0 con 0x7f90280cc750 2024-04-18T04:55:33.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.629+0000 7f902f800640 1 -- 172.21.15.120:0/3673776573 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9028157cd0 con 0x7f90280cc750 2024-04-18T04:55:33.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.629+0000 7f902f800640 1 -- 172.21.15.120:0/3673776573 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90281589b0 con 0x7f90280cc750 2024-04-18T04:55:33.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.629+0000 7f902f800640 1 -- 172.21.15.120:0/3673776573 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9004000fd0 con 0x7f90280cc750 2024-04-18T04:55:33.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.637+0000 7f9024c00640 1 -- 172.21.15.120:0/3673776573 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9014013410 con 0x7f90280cc750 2024-04-18T04:55:33.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.637+0000 7f9024c00640 1 --2- 172.21.15.120:0/3673776573 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9008066760 0x7f9008068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:33.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.641+0000 7f9024c00640 1 -- 172.21.15.120:0/3673776573 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f9014084b50 con 0x7f90280cc750 2024-04-18T04:55:33.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.641+0000 7f902ce00640 1 --2- 172.21.15.120:0/3673776573 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9008066760 0x7f9008068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:33.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.641+0000 7f9024c00640 1 --2- 172.21.15.120:0/3673776573 >> [v2:172.21.15.120:6816/27471,v1:172.21.15.120:6817/27471] conn(0x7f9008070450 0x7f90080728f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:33.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.641+0000 7f9024c00640 1 -- 172.21.15.120:0/3673776573 --> [v2:172.21.15.120:6816/27471,v1:172.21.15.120:6817/27471] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9008072fc0 con 0x7f9008070450 2024-04-18T04:55:33.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.641+0000 7f9024c00640 1 -- 172.21.15.120:0/3673776573 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9014084f00 con 0x7f90280cc750 2024-04-18T04:55:33.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.641+0000 7f902d800640 1 --2- 172.21.15.120:0/3673776573 >> [v2:172.21.15.120:6816/27471,v1:172.21.15.120:6817/27471] conn(0x7f9008070450 0x7f90080728f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:33.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.641+0000 7f902ce00640 1 --2- 172.21.15.120:0/3673776573 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9008066760 0x7f9008068c20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f901c0ad000 tx=0x7f901c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:33.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.641+0000 7f902d800640 1 --2- 172.21.15.120:0/3673776573 >> [v2:172.21.15.120:6816/27471,v1:172.21.15.120:6817/27471] conn(0x7f9008070450 0x7f90080728f0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:33.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.641+0000 7f9024c00640 1 -- 172.21.15.120:0/3673776573 <== osd.2 v2:172.21.15.120:6816/27471 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f9008072fc0 con 0x7f9008070450 2024-04-18T04:55:33.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.657+0000 7f902f800640 1 -- 172.21.15.120:0/3673776573 --> [v2:172.21.15.120:6816/27471,v1:172.21.15.120:6817/27471] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9004002ce0 con 0x7f9008070450 2024-04-18T04:55:33.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.657+0000 7f9024c00640 1 -- 172.21.15.120:0/3673776573 <== osd.2 v2:172.21.15.120:6816/27471 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9004002ce0 con 0x7f9008070450 2024-04-18T04:55:33.656 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-18T04:55:33.656 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T04:55:33.656 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-18T04:55:33.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.657+0000 7f902f800640 1 -- 172.21.15.120:0/3673776573 >> [v2:172.21.15.120:6816/27471,v1:172.21.15.120:6817/27471] conn(0x7f9008070450 msgr2=0x7f90080728f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:33.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.657+0000 7f902f800640 1 --2- 172.21.15.120:0/3673776573 >> [v2:172.21.15.120:6816/27471,v1:172.21.15.120:6817/27471] conn(0x7f9008070450 0x7f90080728f0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:33.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.657+0000 7f902f800640 1 -- 172.21.15.120:0/3673776573 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9008066760 msgr2=0x7f9008068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:33.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.661+0000 7f902f800640 1 --2- 172.21.15.120:0/3673776573 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9008066760 0x7f9008068c20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f901c0ad000 tx=0x7f901c008040 comp rx=0 tx=0).stop 2024-04-18T04:55:33.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.661+0000 7f902f800640 1 -- 172.21.15.120:0/3673776573 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f90280cc750 msgr2=0x7f90280cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:33.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.661+0000 7f902f800640 1 --2- 172.21.15.120:0/3673776573 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f90280cc750 0x7f90280cdcf0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f901400e810 tx=0x7f901400ecd0 comp rx=0 tx=0).stop 2024-04-18T04:55:33.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.661+0000 7f902d800640 1 -- 172.21.15.120:0/3673776573 reap_dead start 2024-04-18T04:55:33.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.661+0000 7f902f800640 1 -- 172.21.15.120:0/3673776573 shutdown_connections 2024-04-18T04:55:33.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.661+0000 7f902f800640 1 -- 172.21.15.120:0/3673776573 >> 172.21.15.120:0/3673776573 conn(0x7f9028065f90 msgr2=0x7f902806a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:33.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.661+0000 7f902f800640 1 -- 172.21.15.120:0/3673776573 shutdown_connections 2024-04-18T04:55:33.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.661+0000 7f902f800640 1 -- 172.21.15.120:0/3673776573 wait complete. 2024-04-18T04:55:33.676 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-18T04:55:33.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.821+0000 7fae81200640 1 Processor -- start 2024-04-18T04:55:33.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.821+0000 7fae81200640 1 -- start start 2024-04-18T04:55:33.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.821+0000 7fae81200640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fae7c1537d0 0x7fae7c0c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:33.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.821+0000 7fae81200640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fae7c0ca5b0 0x7fae7c065c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:33.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.821+0000 7fae81200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fae7c066170 0x7fae7c159870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:33.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.821+0000 7fae81200640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae7c15da10 con 0x7fae7c0ca5b0 2024-04-18T04:55:33.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.821+0000 7fae81200640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae7c15cbb0 con 0x7fae7c1537d0 2024-04-18T04:55:33.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.821+0000 7fae81200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c15ce90 con 0x7fae7c066170 2024-04-18T04:55:33.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.821+0000 7fae7aa00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fae7c0ca5b0 0x7fae7c065c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:33.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.821+0000 7fae7aa00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fae7c0ca5b0 0x7fae7c065c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53590/0 (socket says 172.21.15.120:53590) 2024-04-18T04:55:33.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.821+0000 7fae7aa00640 1 -- 172.21.15.120:0/1545612113 learned_addr learned my addr 172.21.15.120:0/1545612113 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:33.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.821+0000 7fae7b400640 1 --2- 172.21.15.120:0/1545612113 >> v2:172.21.15.132:3300/0 conn(0x7fae7c1537d0 0x7fae7c0c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:33.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.821+0000 7fae7be00640 1 --2- 172.21.15.120:0/1545612113 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fae7c066170 0x7fae7c159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:33.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.821+0000 7fae7aa00640 1 -- 172.21.15.120:0/1545612113 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fae7c066170 msgr2=0x7fae7c159870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:33.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.821+0000 7fae7aa00640 1 --2- 172.21.15.120:0/1545612113 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fae7c066170 0x7fae7c159870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:33.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.821+0000 7fae7aa00640 1 -- 172.21.15.120:0/1545612113 >> v2:172.21.15.132:3300/0 conn(0x7fae7c1537d0 msgr2=0x7fae7c0c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:33.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.821+0000 7fae7aa00640 1 --2- 172.21.15.120:0/1545612113 >> v2:172.21.15.132:3300/0 conn(0x7fae7c1537d0 0x7fae7c0c96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:33.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.821+0000 7fae7aa00640 1 -- 172.21.15.120:0/1545612113 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7c15d170 con 0x7fae7c0ca5b0 2024-04-18T04:55:33.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.829+0000 7fae7aa00640 1 --2- 172.21.15.120:0/1545612113 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae7c0ca5b0 0x7fae7c065c30 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fae7c0cbbc0 tx=0x7fae6801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15893e7474a202eb server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:33.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.829+0000 7fae7a000640 1 -- 172.21.15.120:0/1545612113 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae680a89d0 con 0x7fae7c0ca5b0 2024-04-18T04:55:33.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.833+0000 7fae7a000640 1 -- 172.21.15.120:0/1545612113 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae680a8b30 con 0x7fae7c0ca5b0 2024-04-18T04:55:33.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.833+0000 7fae7a000640 1 -- 172.21.15.120:0/1545612113 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae680b0440 con 0x7fae7c0ca5b0 2024-04-18T04:55:33.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.833+0000 7fae81200640 1 -- 172.21.15.120:0/1545612113 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae7c0ca5b0 msgr2=0x7fae7c065c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:33.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.833+0000 7fae81200640 1 --2- 172.21.15.120:0/1545612113 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae7c0ca5b0 0x7fae7c065c30 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fae7c0cbbc0 tx=0x7fae6801ed10 comp rx=0 tx=0).stop 2024-04-18T04:55:33.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.833+0000 7fae81200640 1 -- 172.21.15.120:0/1545612113 shutdown_connections 2024-04-18T04:55:33.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.833+0000 7fae81200640 1 --2- 172.21.15.120:0/1545612113 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fae7c066170 0x7fae7c159870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:33.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.833+0000 7fae81200640 1 --2- 172.21.15.120:0/1545612113 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae7c0ca5b0 0x7fae7c065c30 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:33.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.833+0000 7fae81200640 1 --2- 172.21.15.120:0/1545612113 >> v2:172.21.15.132:3300/0 conn(0x7fae7c1537d0 0x7fae7c0c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:33.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.833+0000 7fae81200640 1 -- 172.21.15.120:0/1545612113 >> 172.21.15.120:0/1545612113 conn(0x7fae7c06a270 msgr2=0x7fae7c06a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:33.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.833+0000 7fae81200640 1 -- 172.21.15.120:0/1545612113 shutdown_connections 2024-04-18T04:55:33.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.833+0000 7fae81200640 1 -- 172.21.15.120:0/1545612113 wait complete. 2024-04-18T04:55:33.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.837+0000 7fae81200640 1 Processor -- start 2024-04-18T04:55:33.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.837+0000 7fae81200640 1 -- start start 2024-04-18T04:55:33.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.837+0000 7fae81200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae7c066170 0x7fae7c15bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:33.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.837+0000 7fae81200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae7c0ca5b0 0x7fae7c0c8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:33.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.837+0000 7fae81200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fae7c1537d0 0x7fae7c14b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:33.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.837+0000 7fae81200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c14e960 con 0x7fae7c066170 2024-04-18T04:55:33.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.837+0000 7fae81200640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c0c6770 con 0x7fae7c0ca5b0 2024-04-18T04:55:33.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.837+0000 7fae81200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c14d290 con 0x7fae7c1537d0 2024-04-18T04:55:33.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.837+0000 7fae7b400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae7c066170 0x7fae7c15bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:33.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.837+0000 7fae7b400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae7c066170 0x7fae7c15bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53606/0 (socket says 172.21.15.120:53606) 2024-04-18T04:55:33.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.837+0000 7fae7b400640 1 -- 172.21.15.120:0/259202274 learned_addr learned my addr 172.21.15.120:0/259202274 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:33.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.837+0000 7fae7be00640 1 --2- 172.21.15.120:0/259202274 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fae7c1537d0 0x7fae7c14b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:33.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.841+0000 7fae7b400640 1 -- 172.21.15.120:0/259202274 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fae7c1537d0 msgr2=0x7fae7c14b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:33.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.841+0000 7fae7b400640 1 --2- 172.21.15.120:0/259202274 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fae7c1537d0 0x7fae7c14b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:33.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.841+0000 7fae7b400640 1 -- 172.21.15.120:0/259202274 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae7c0ca5b0 msgr2=0x7fae7c0c8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:33.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.841+0000 7fae7b400640 1 --2- 172.21.15.120:0/259202274 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae7c0ca5b0 0x7fae7c0c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:33.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.841+0000 7fae7b400640 1 -- 172.21.15.120:0/259202274 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae680094d0 con 0x7fae7c066170 2024-04-18T04:55:33.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.841+0000 7fae7b400640 1 --2- 172.21.15.120:0/259202274 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae7c066170 0x7fae7c15bcd0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fae6c00e870 tx=0x7fae6c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:33.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.841+0000 7fae73400640 1 -- 172.21.15.120:0/259202274 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c009510 con 0x7fae7c066170 2024-04-18T04:55:33.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.841+0000 7fae73400640 1 -- 172.21.15.120:0/259202274 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6c00eec0 con 0x7fae7c066170 2024-04-18T04:55:33.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.841+0000 7fae73400640 1 -- 172.21.15.120:0/259202274 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c00cb40 con 0x7fae7c066170 2024-04-18T04:55:33.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.841+0000 7fae81200640 1 -- 172.21.15.120:0/259202274 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae7c0c6120 con 0x7fae7c066170 2024-04-18T04:55:33.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.841+0000 7fae81200640 1 -- 172.21.15.120:0/259202274 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae7c14eb90 con 0x7fae7c066170 2024-04-18T04:55:33.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.845+0000 7fae81200640 1 -- 172.21.15.120:0/259202274 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae7c0728f0 con 0x7fae7c066170 2024-04-18T04:55:33.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.845+0000 7fae73400640 1 -- 172.21.15.120:0/259202274 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fae6c00cca0 con 0x7fae7c066170 2024-04-18T04:55:33.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.849+0000 7fae73400640 1 --2- 172.21.15.120:0/259202274 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fae5c066690 0x7fae5c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:33.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.849+0000 7fae73400640 1 -- 172.21.15.120:0/259202274 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7fae6c084760 con 0x7fae7c066170 2024-04-18T04:55:33.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.849+0000 7fae7aa00640 1 --2- 172.21.15.120:0/259202274 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fae5c066690 0x7fae5c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:33.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.853+0000 7fae7aa00640 1 --2- 172.21.15.120:0/259202274 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fae5c066690 0x7fae5c068b50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fae680b2000 tx=0x7fae68004740 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:33.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:33.857+0000 7fae73400640 1 -- 172.21.15.120:0/259202274 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fae6c051600 con 0x7fae7c066170 2024-04-18T04:55:34.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.065+0000 7fae81200640 1 -- 172.21.15.120:0/259202274 --> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fae7c153bb0 con 0x7fae5c066690 2024-04-18T04:55:34.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.065+0000 7fae73400640 1 -- 172.21.15.120:0/259202274 <== mgr.4113 v2:172.21.15.132:6832/27788 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fae680a88f0 con 0x7fae5c066690 2024-04-18T04:55:34.063 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 2 to deep-scrub 2024-04-18T04:55:34.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.069+0000 7fae81200640 1 -- 172.21.15.120:0/259202274 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fae5c066690 msgr2=0x7fae5c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:34.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.069+0000 7fae81200640 1 --2- 172.21.15.120:0/259202274 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fae5c066690 0x7fae5c068b50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fae680b2000 tx=0x7fae68004740 comp rx=0 tx=0).stop 2024-04-18T04:55:34.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.069+0000 7fae81200640 1 -- 172.21.15.120:0/259202274 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae7c066170 msgr2=0x7fae7c15bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:34.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.069+0000 7fae81200640 1 --2- 172.21.15.120:0/259202274 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae7c066170 0x7fae7c15bcd0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fae6c00e870 tx=0x7fae6c00ec70 comp rx=0 tx=0).stop 2024-04-18T04:55:34.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.069+0000 7fae81200640 1 -- 172.21.15.120:0/259202274 shutdown_connections 2024-04-18T04:55:34.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.069+0000 7fae81200640 1 --2- 172.21.15.120:0/259202274 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fae5c066690 0x7fae5c068b50 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:34.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.069+0000 7fae81200640 1 --2- 172.21.15.120:0/259202274 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fae7c1537d0 0x7fae7c14b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:34.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.069+0000 7fae81200640 1 --2- 172.21.15.120:0/259202274 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae7c0ca5b0 0x7fae7c0c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:34.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.069+0000 7fae81200640 1 --2- 172.21.15.120:0/259202274 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae7c066170 0x7fae7c15bcd0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:34.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.069+0000 7fae81200640 1 -- 172.21.15.120:0/259202274 >> 172.21.15.120:0/259202274 conn(0x7fae7c06a270 msgr2=0x7fae7c0c3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:34.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.069+0000 7fae81200640 1 -- 172.21.15.120:0/259202274 shutdown_connections 2024-04-18T04:55:34.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.069+0000 7fae81200640 1 -- 172.21.15.120:0/259202274 wait complete. 2024-04-18T04:55:34.086 INFO:tasks.ceph:Scrubbing osd.3 2024-04-18T04:55:34.086 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-18T04:55:34.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.229+0000 7fed5ae00640 1 Processor -- start 2024-04-18T04:55:34.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.229+0000 7fed5ae00640 1 -- start start 2024-04-18T04:55:34.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.233+0000 7fed5ae00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fed540c9690 0x7fed540c6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:34.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.233+0000 7fed5ae00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed54157f90 con 0x7fed540cdb50 2024-04-18T04:55:34.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.233+0000 7fed5ae00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed54157680 con 0x7fed5406e680 2024-04-18T04:55:34.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.233+0000 7fed5ae00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed540c5f00 con 0x7fed540c9690 2024-04-18T04:55:34.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.233+0000 7fed53400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fed540c9690 0x7fed540c6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:34.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.233+0000 7fed53400640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fed540c9690 0x7fed540c6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53614/0 (socket says 172.21.15.120:53614) 2024-04-18T04:55:34.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.233+0000 7fed53400640 1 -- 172.21.15.120:0/3910335957 learned_addr learned my addr 172.21.15.120:0/3910335957 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:34.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.233+0000 7fed53400640 1 -- 172.21.15.120:0/3910335957 >> v1:172.21.15.132:6789/0 conn(0x7fed5406e680 legacy=0x7fed540c4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:34.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.233+0000 7fed53400640 1 -- 172.21.15.120:0/3910335957 >> v1:172.21.15.120:6789/0 conn(0x7fed540cdb50 legacy=0x7fed54161f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:34.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.233+0000 7fed53400640 1 -- 172.21.15.120:0/3910335957 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed540c7ff0 con 0x7fed540c9690 2024-04-18T04:55:34.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.237+0000 7fed53400640 1 --2- 172.21.15.120:0/3910335957 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fed540c9690 0x7fed540c6aa0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fed40009870 tx=0x7fed4001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d102c6b8d6828a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:34.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.237+0000 7fed52a00640 1 -- 172.21.15.120:0/3910335957 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed400ab600 con 0x7fed540c9690 2024-04-18T04:55:34.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.237+0000 7fed52a00640 1 -- 172.21.15.120:0/3910335957 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed400a7050 con 0x7fed540c9690 2024-04-18T04:55:34.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.237+0000 7fed52a00640 1 -- 172.21.15.120:0/3910335957 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed400ab980 con 0x7fed540c9690 2024-04-18T04:55:34.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.237+0000 7fed5ae00640 1 -- 172.21.15.120:0/3910335957 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fed540c9690 msgr2=0x7fed540c6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:34.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.237+0000 7fed5ae00640 1 --2- 172.21.15.120:0/3910335957 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fed540c9690 0x7fed540c6aa0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fed40009870 tx=0x7fed4001c520 comp rx=0 tx=0).stop 2024-04-18T04:55:34.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.237+0000 7fed5ae00640 1 -- 172.21.15.120:0/3910335957 shutdown_connections 2024-04-18T04:55:34.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.237+0000 7fed5ae00640 1 --2- 172.21.15.120:0/3910335957 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fed540c9690 0x7fed540c6aa0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:34.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.237+0000 7fed5ae00640 1 -- 172.21.15.120:0/3910335957 >> 172.21.15.120:0/3910335957 conn(0x7fed540cd030 msgr2=0x7fed540cd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:34.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.237+0000 7fed5ae00640 1 -- 172.21.15.120:0/3910335957 shutdown_connections 2024-04-18T04:55:34.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.237+0000 7fed5ae00640 1 -- 172.21.15.120:0/3910335957 wait complete. 2024-04-18T04:55:34.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.237+0000 7fed5ae00640 1 Processor -- start 2024-04-18T04:55:34.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.237+0000 7fed5ae00640 1 -- start start 2024-04-18T04:55:34.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.237+0000 7fed5ae00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed5406e680 0x7fed541f22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:34.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.237+0000 7fed5ae00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fed540c9690 0x7fed54159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:34.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.241+0000 7fed5ae00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fed540cdb50 0x7fed5415b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:34.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.241+0000 7fed5ae00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed541587e0 con 0x7fed540cdb50 2024-04-18T04:55:34.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.241+0000 7fed5ae00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed541f2b00 con 0x7fed5406e680 2024-04-18T04:55:34.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.241+0000 7fed5ae00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed541f2de0 con 0x7fed540c9690 2024-04-18T04:55:34.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.241+0000 7fed58e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fed540cdb50 0x7fed5415b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:34.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.241+0000 7fed58e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fed540cdb50 0x7fed5415b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53622/0 (socket says 172.21.15.120:53622) 2024-04-18T04:55:34.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.241+0000 7fed58e00640 1 -- 172.21.15.120:0/2218977651 learned_addr learned my addr 172.21.15.120:0/2218977651 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:34.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.241+0000 7fed53400640 1 --2- 172.21.15.120:0/2218977651 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fed540c9690 0x7fed54159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:34.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.241+0000 7fed53e00640 1 --2- 172.21.15.120:0/2218977651 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed5406e680 0x7fed541f22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:34.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.241+0000 7fed58e00640 1 -- 172.21.15.120:0/2218977651 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fed540c9690 msgr2=0x7fed54159230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:34.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.241+0000 7fed58e00640 1 --2- 172.21.15.120:0/2218977651 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fed540c9690 0x7fed54159230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:34.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.241+0000 7fed58e00640 1 -- 172.21.15.120:0/2218977651 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed5406e680 msgr2=0x7fed541f22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:34.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.241+0000 7fed58e00640 1 --2- 172.21.15.120:0/2218977651 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed5406e680 0x7fed541f22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:34.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.241+0000 7fed58e00640 1 -- 172.21.15.120:0/2218977651 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed400094d0 con 0x7fed540cdb50 2024-04-18T04:55:34.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.241+0000 7fed58e00640 1 --2- 172.21.15.120:0/2218977651 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fed540cdb50 0x7fed5415b0e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fed4c00c770 tx=0x7fed4c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:34.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.241+0000 7fed4be00640 1 -- 172.21.15.120:0/2218977651 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4c003b80 con 0x7fed540cdb50 2024-04-18T04:55:34.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.241+0000 7fed4be00640 1 -- 172.21.15.120:0/2218977651 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4c003ce0 con 0x7fed540cdb50 2024-04-18T04:55:34.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.241+0000 7fed4be00640 1 -- 172.21.15.120:0/2218977651 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4c00aa90 con 0x7fed540cdb50 2024-04-18T04:55:34.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.241+0000 7fed5ae00640 1 -- 172.21.15.120:0/2218977651 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed541585a0 con 0x7fed540cdb50 2024-04-18T04:55:34.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.241+0000 7fed5ae00640 1 -- 172.21.15.120:0/2218977651 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed54158a30 con 0x7fed540cdb50 2024-04-18T04:55:34.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.241+0000 7fed5ae00640 1 -- 172.21.15.120:0/2218977651 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fed54158420 con 0x7fed540cdb50 2024-04-18T04:55:34.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.241+0000 7fed4be00640 1 -- 172.21.15.120:0/2218977651 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fed4c00abf0 con 0x7fed540cdb50 2024-04-18T04:55:34.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.241+0000 7fed4be00640 1 --2- 172.21.15.120:0/2218977651 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fed34066690 0x7fed34068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:34.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.245+0000 7fed4be00640 1 -- 172.21.15.120:0/2218977651 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7fed4c0846a0 con 0x7fed540cdb50 2024-04-18T04:55:34.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.245+0000 7fed4be00640 1 --2- 172.21.15.120:0/2218977651 >> [v2:172.21.15.120:6808/27469,v1:172.21.15.120:6809/27469] conn(0x7fed34070300 0x7fed340727a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:34.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.245+0000 7fed4be00640 1 -- 172.21.15.120:0/2218977651 --> [v2:172.21.15.120:6808/27469,v1:172.21.15.120:6809/27469] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fed34072e70 con 0x7fed34070300 2024-04-18T04:55:34.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.245+0000 7fed4be00640 1 -- 172.21.15.120:0/2218977651 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fed4c086c80 con 0x7fed540cdb50 2024-04-18T04:55:34.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.245+0000 7fed53e00640 1 --2- 172.21.15.120:0/2218977651 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fed34066690 0x7fed34068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:34.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.245+0000 7fed53400640 1 --2- 172.21.15.120:0/2218977651 >> [v2:172.21.15.120:6808/27469,v1:172.21.15.120:6809/27469] conn(0x7fed34070300 0x7fed340727a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:34.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.245+0000 7fed53400640 1 --2- 172.21.15.120:0/2218977651 >> [v2:172.21.15.120:6808/27469,v1:172.21.15.120:6809/27469] conn(0x7fed34070300 0x7fed340727a0 crc :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:34.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.245+0000 7fed53e00640 1 --2- 172.21.15.120:0/2218977651 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fed34066690 0x7fed34068b50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fed4400b810 tx=0x7fed44008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:34.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.245+0000 7fed4be00640 1 -- 172.21.15.120:0/2218977651 <== osd.3 v2:172.21.15.120:6808/27469 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fed34072e70 con 0x7fed34070300 2024-04-18T04:55:34.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.257+0000 7fed5ae00640 1 -- 172.21.15.120:0/2218977651 --> [v2:172.21.15.120:6808/27469,v1:172.21.15.120:6809/27469] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fed5406ea60 con 0x7fed34070300 2024-04-18T04:55:34.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.257+0000 7fed4be00640 1 -- 172.21.15.120:0/2218977651 <== osd.3 v2:172.21.15.120:6808/27469 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fed400ab400 con 0x7fed34070300 2024-04-18T04:55:34.255 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-18T04:55:34.256 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T04:55:34.256 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-18T04:55:34.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.257+0000 7fed5ae00640 1 -- 172.21.15.120:0/2218977651 >> [v2:172.21.15.120:6808/27469,v1:172.21.15.120:6809/27469] conn(0x7fed34070300 msgr2=0x7fed340727a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:34.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.257+0000 7fed5ae00640 1 --2- 172.21.15.120:0/2218977651 >> [v2:172.21.15.120:6808/27469,v1:172.21.15.120:6809/27469] conn(0x7fed34070300 0x7fed340727a0 crc :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:34.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.257+0000 7fed5ae00640 1 -- 172.21.15.120:0/2218977651 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fed34066690 msgr2=0x7fed34068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:34.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.257+0000 7fed5ae00640 1 --2- 172.21.15.120:0/2218977651 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fed34066690 0x7fed34068b50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fed4400b810 tx=0x7fed44008040 comp rx=0 tx=0).stop 2024-04-18T04:55:34.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.257+0000 7fed5ae00640 1 -- 172.21.15.120:0/2218977651 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fed540cdb50 msgr2=0x7fed5415b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:34.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.257+0000 7fed5ae00640 1 --2- 172.21.15.120:0/2218977651 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fed540cdb50 0x7fed5415b0e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fed4c00c770 tx=0x7fed4c00cc30 comp rx=0 tx=0).stop 2024-04-18T04:55:34.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.257+0000 7fed58e00640 1 -- 172.21.15.120:0/2218977651 reap_dead start 2024-04-18T04:55:34.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.257+0000 7fed5ae00640 1 -- 172.21.15.120:0/2218977651 shutdown_connections 2024-04-18T04:55:34.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.257+0000 7fed5ae00640 1 -- 172.21.15.120:0/2218977651 >> 172.21.15.120:0/2218977651 conn(0x7fed540cd030 msgr2=0x7fed54151410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:34.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.257+0000 7fed5ae00640 1 -- 172.21.15.120:0/2218977651 shutdown_connections 2024-04-18T04:55:34.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.257+0000 7fed5ae00640 1 -- 172.21.15.120:0/2218977651 wait complete. 2024-04-18T04:55:34.275 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-18T04:55:34.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.545+0000 7f3972a00640 1 Processor -- start 2024-04-18T04:55:34.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.545+0000 7f3972a00640 1 -- start start 2024-04-18T04:55:34.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.545+0000 7f3972a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f396c157cd0 0x7f396c0c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:34.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.545+0000 7f3972a00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f396c06f350 con 0x7f396c06e210 2024-04-18T04:55:34.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.545+0000 7f3972a00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f396c071750 con 0x7f396c06ab10 2024-04-18T04:55:34.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.545+0000 7f3972a00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f396c0c7310 con 0x7f396c157cd0 2024-04-18T04:55:34.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.549+0000 7f396b400640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f396c06e210 0x7f396c0cc100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:54734/0 (socket says 172.21.15.120:54734) 2024-04-18T04:55:34.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.549+0000 7f396b400640 1 -- 172.21.15.120:0/3547349672 learned_addr learned my addr 172.21.15.120:0/3547349672 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:55:34.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.549+0000 7f396be00640 1 --2- 172.21.15.120:0/3547349672 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f396c157cd0 0x7f396c0c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:34.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.549+0000 7f396be00640 1 -- 172.21.15.120:0/3547349672 >> v1:172.21.15.132:6789/0 conn(0x7f396c06ab10 legacy=0x7f396c071be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:34.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.549+0000 7f396be00640 1 -- 172.21.15.120:0/3547349672 >> v1:172.21.15.120:6789/0 conn(0x7f396c06e210 legacy=0x7f396c0cc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:34.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.549+0000 7f396be00640 1 -- 172.21.15.120:0/3547349672 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f396c15e970 con 0x7f396c157cd0 2024-04-18T04:55:34.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.553+0000 7f396be00640 1 --2- 172.21.15.120:0/3547349672 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f396c157cd0 0x7f396c0c68d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f395c0097f0 tx=0x7f395c01ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb0c3e755586510 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:34.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.553+0000 7f396aa00640 1 -- 172.21.15.120:0/3547349672 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395c0a89d0 con 0x7f396c157cd0 2024-04-18T04:55:34.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.553+0000 7f396aa00640 1 -- 172.21.15.120:0/3547349672 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395c0a8b30 con 0x7f396c157cd0 2024-04-18T04:55:34.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.553+0000 7f396aa00640 1 -- 172.21.15.120:0/3547349672 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395c0b0440 con 0x7f396c157cd0 2024-04-18T04:55:34.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.553+0000 7f3972a00640 1 -- 172.21.15.120:0/3547349672 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f396c157cd0 msgr2=0x7f396c0c68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:34.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.553+0000 7f3972a00640 1 --2- 172.21.15.120:0/3547349672 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f396c157cd0 0x7f396c0c68d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f395c0097f0 tx=0x7f395c01ecd0 comp rx=0 tx=0).stop 2024-04-18T04:55:34.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.553+0000 7f3972a00640 1 -- 172.21.15.120:0/3547349672 shutdown_connections 2024-04-18T04:55:34.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.553+0000 7f3972a00640 1 --2- 172.21.15.120:0/3547349672 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f396c157cd0 0x7f396c0c68d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:34.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.553+0000 7f3972a00640 1 -- 172.21.15.120:0/3547349672 >> 172.21.15.120:0/3547349672 conn(0x7f396c06b1a0 msgr2=0x7f396c06b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:34.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.553+0000 7f3972a00640 1 -- 172.21.15.120:0/3547349672 shutdown_connections 2024-04-18T04:55:34.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.553+0000 7f3972a00640 1 -- 172.21.15.120:0/3547349672 wait complete. 2024-04-18T04:55:34.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.557+0000 7f3972a00640 1 Processor -- start 2024-04-18T04:55:34.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.557+0000 7f3972a00640 1 -- start start 2024-04-18T04:55:34.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.557+0000 7f3972a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f396c06ab10 0x7f396c15d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:34.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.557+0000 7f3972a00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f396c06e210 0x7f396c153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:34.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.557+0000 7f3972a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f396c157cd0 0x7f396c160440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:34.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.557+0000 7f3972a00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396c15d430 con 0x7f396c06ab10 2024-04-18T04:55:34.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.557+0000 7f3972a00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396c15f680 con 0x7f396c06e210 2024-04-18T04:55:34.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.557+0000 7f3972a00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f396c15f960 con 0x7f396c157cd0 2024-04-18T04:55:34.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.557+0000 7f396be00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f396c06ab10 0x7f396c15d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:34.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.557+0000 7f396be00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f396c06ab10 0x7f396c15d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53624/0 (socket says 172.21.15.120:53624) 2024-04-18T04:55:34.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.557+0000 7f396be00640 1 -- 172.21.15.120:0/3351724152 learned_addr learned my addr 172.21.15.120:0/3351724152 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:34.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.557+0000 7f396b400640 1 --2- 172.21.15.120:0/3351724152 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f396c06e210 0x7f396c153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:34.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.557+0000 7f396be00640 1 -- 172.21.15.120:0/3351724152 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f396c157cd0 msgr2=0x7f396c160440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:34.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.557+0000 7f396be00640 1 --2- 172.21.15.120:0/3351724152 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f396c157cd0 0x7f396c160440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:34.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.557+0000 7f396be00640 1 -- 172.21.15.120:0/3351724152 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f396c06e210 msgr2=0x7f396c153230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:34.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.557+0000 7f396be00640 1 --2- 172.21.15.120:0/3351724152 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f396c06e210 0x7f396c153230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:34.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.557+0000 7f396be00640 1 -- 172.21.15.120:0/3351724152 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f395c009420 con 0x7f396c06ab10 2024-04-18T04:55:34.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.561+0000 7f396be00640 1 --2- 172.21.15.120:0/3351724152 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f396c06ab10 0x7f396c15d7b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f395c009740 tx=0x7f395c01ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:34.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.565+0000 7f3963e00640 1 -- 172.21.15.120:0/3351724152 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395c0bb640 con 0x7f396c06ab10 2024-04-18T04:55:34.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.565+0000 7f3963e00640 1 -- 172.21.15.120:0/3351724152 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395c0bb7c0 con 0x7f396c06ab10 2024-04-18T04:55:34.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.565+0000 7f3963e00640 1 -- 172.21.15.120:0/3351724152 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395c0bbb70 con 0x7f396c06ab10 2024-04-18T04:55:34.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.565+0000 7f3972a00640 1 -- 172.21.15.120:0/3351724152 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f396c15e740 con 0x7f396c06ab10 2024-04-18T04:55:34.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.565+0000 7f3972a00640 1 -- 172.21.15.120:0/3351724152 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f396c1f3ef0 con 0x7f396c06ab10 2024-04-18T04:55:34.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.569+0000 7f3961600640 1 -- 172.21.15.120:0/3351724152 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f396c067590 con 0x7f396c06ab10 2024-04-18T04:55:34.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.569+0000 7f3963e00640 1 -- 172.21.15.120:0/3351724152 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f395c0b7040 con 0x7f396c06ab10 2024-04-18T04:55:34.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.573+0000 7f3963e00640 1 --2- 172.21.15.120:0/3351724152 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f394c066760 0x7f394c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:34.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.573+0000 7f3963e00640 1 -- 172.21.15.120:0/3351724152 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f395c122a30 con 0x7f396c06ab10 2024-04-18T04:55:34.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.573+0000 7f396b400640 1 --2- 172.21.15.120:0/3351724152 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f394c066760 0x7f394c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:34.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.573+0000 7f396b400640 1 --2- 172.21.15.120:0/3351724152 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f394c066760 0x7f394c068c20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f396c155670 tx=0x7f3958009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:34.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.577+0000 7f3963e00640 1 -- 172.21.15.120:0/3351724152 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f395c0ef780 con 0x7f396c06ab10 2024-04-18T04:55:34.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.745+0000 7f3961600640 1 -- 172.21.15.120:0/3351724152 --> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f396c15e5c0 con 0x7f394c066760 2024-04-18T04:55:34.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.745+0000 7f3963e00640 1 -- 172.21.15.120:0/3351724152 <== mgr.4113 v2:172.21.15.132:6832/27788 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3958001530 con 0x7f394c066760 2024-04-18T04:55:34.744 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 3 to deep-scrub 2024-04-18T04:55:34.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.753+0000 7f3961600640 1 -- 172.21.15.120:0/3351724152 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f394c066760 msgr2=0x7f394c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:34.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.753+0000 7f3961600640 1 --2- 172.21.15.120:0/3351724152 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f394c066760 0x7f394c068c20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f396c155670 tx=0x7f3958009040 comp rx=0 tx=0).stop 2024-04-18T04:55:34.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.753+0000 7f3961600640 1 -- 172.21.15.120:0/3351724152 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f396c06ab10 msgr2=0x7f396c15d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:34.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.753+0000 7f3961600640 1 --2- 172.21.15.120:0/3351724152 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f396c06ab10 0x7f396c15d7b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f395c009740 tx=0x7f395c01ba70 comp rx=0 tx=0).stop 2024-04-18T04:55:34.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.753+0000 7f3961600640 1 -- 172.21.15.120:0/3351724152 shutdown_connections 2024-04-18T04:55:34.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.753+0000 7f3961600640 1 --2- 172.21.15.120:0/3351724152 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f394c066760 0x7f394c068c20 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:34.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.753+0000 7f3961600640 1 --2- 172.21.15.120:0/3351724152 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f396c157cd0 0x7f396c160440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:34.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.753+0000 7f3961600640 1 --2- 172.21.15.120:0/3351724152 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f396c06e210 0x7f396c153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:34.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.753+0000 7f3961600640 1 --2- 172.21.15.120:0/3351724152 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f396c06ab10 0x7f396c15d7b0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:34.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.753+0000 7f3961600640 1 -- 172.21.15.120:0/3351724152 >> 172.21.15.120:0/3351724152 conn(0x7f396c06b1a0 msgr2=0x7f396c0cc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:34.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.753+0000 7f3961600640 1 -- 172.21.15.120:0/3351724152 shutdown_connections 2024-04-18T04:55:34.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:34.753+0000 7f3961600640 1 -- 172.21.15.120:0/3351724152 wait complete. 2024-04-18T04:55:34.824 INFO:tasks.ceph:Scrubbing osd.4 2024-04-18T04:55:34.824 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-18T04:55:35.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.105+0000 7f6eb2c00640 1 Processor -- start 2024-04-18T04:55:35.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.109+0000 7f6eb2c00640 1 -- start start 2024-04-18T04:55:35.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.109+0000 7f6eb2c00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6eac071fc0 0x7f6eac069ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:35.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.109+0000 7f6eb2c00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eac15e740 con 0x7f6eac157b10 2024-04-18T04:55:35.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.109+0000 7f6eb2c00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eac15db50 con 0x7f6eac0c4f70 2024-04-18T04:55:35.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.109+0000 7f6eb2c00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac072440 con 0x7f6eac071fc0 2024-04-18T04:55:35.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.113+0000 7f6eab400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6eac071fc0 0x7f6eac069ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:35.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.113+0000 7f6eab400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6eac071fc0 0x7f6eac069ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:42830/0 (socket says 172.21.15.120:42830) 2024-04-18T04:55:35.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.113+0000 7f6eab400640 1 -- 172.21.15.120:0/4187448613 learned_addr learned my addr 172.21.15.120:0/4187448613 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:35.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.113+0000 7f6eaaa00640 1 -- 172.21.15.120:0/4187448613 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4009990115 0 0) 0x7f6eac15e740 con 0x7f6eac157b10 2024-04-18T04:55:35.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.113+0000 7f6eaaa00640 1 -- 172.21.15.120:0/4187448613 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e90003530 con 0x7f6eac157b10 2024-04-18T04:55:35.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.113+0000 7f6eaaa00640 1 -- 172.21.15.120:0/4187448613 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2103937815 0 0) 0x7f6e90003530 con 0x7f6eac157b10 2024-04-18T04:55:35.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.113+0000 7f6eaaa00640 1 -- 172.21.15.120:0/4187448613 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6eac071fc0 msgr2=0x7f6eac069ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:35.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.113+0000 7f6eaaa00640 1 --2- 172.21.15.120:0/4187448613 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6eac071fc0 0x7f6eac069ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:35.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.113+0000 7f6eaaa00640 1 -- 172.21.15.120:0/4187448613 >> v1:172.21.15.132:6789/0 conn(0x7f6eac0c4f70 legacy=0x7f6eac1684d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:35.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.113+0000 7f6eaaa00640 1 -- 172.21.15.120:0/4187448613 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eac15de10 con 0x7f6eac157b10 2024-04-18T04:55:35.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.113+0000 7f6eaaa00640 1 -- 172.21.15.120:0/4187448613 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7f6ea4001a00 con 0x7f6eac157b10 2024-04-18T04:55:35.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.113+0000 7f6eaaa00640 1 -- 172.21.15.120:0/4187448613 >> v1:172.21.15.120:6789/0 conn(0x7f6eac157b10 legacy=0x7f6eac06fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:35.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.113+0000 7f6eaaa00640 1 --2- 172.21.15.120:0/4187448613 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e900039b0 0x7f6e90003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:35.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.113+0000 7f6eaaa00640 1 --2- 172.21.15.120:0/4187448613 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6e900047d0 0x7f6e90004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:35.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.113+0000 7f6eaaa00640 1 --2- 172.21.15.120:0/4187448613 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e90005190 0x7f6e9000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:35.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.113+0000 7f6eaaa00640 1 -- 172.21.15.120:0/4187448613 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac072440 con 0x7f6e90005190 2024-04-18T04:55:35.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.117+0000 7f6eaaa00640 1 -- 172.21.15.120:0/4187448613 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9000c090 con 0x7f6e900039b0 2024-04-18T04:55:35.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.117+0000 7f6eaaa00640 1 -- 172.21.15.120:0/4187448613 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9000c250 con 0x7f6e900047d0 2024-04-18T04:55:35.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.117+0000 7f6eabe00640 1 --2- 172.21.15.120:0/4187448613 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e900039b0 0x7f6e90003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:35.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.117+0000 7f6eabe00640 1 -- 172.21.15.120:0/4187448613 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6e900047d0 msgr2=0x7f6e90004c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:55:35.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.117+0000 7f6eabe00640 1 --2- 172.21.15.120:0/4187448613 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6e900047d0 0x7f6e90004c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:35.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.117+0000 7f6eabe00640 1 -- 172.21.15.120:0/4187448613 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e90005190 msgr2=0x7f6e9000b990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:55:35.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.117+0000 7f6eabe00640 1 --2- 172.21.15.120:0/4187448613 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e90005190 0x7f6e9000b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:35.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.117+0000 7f6eabe00640 1 -- 172.21.15.120:0/4187448613 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e90003530 con 0x7f6e900039b0 2024-04-18T04:55:35.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.129+0000 7f6eabe00640 1 --2- 172.21.15.120:0/4187448613 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e900039b0 0x7f6e90003db0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6ea400c490 tx=0x7f6ea401ce80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a72a83531391148 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:35.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.129+0000 7f6eaaa00640 1 -- 172.21.15.120:0/4187448613 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea40a5d80 con 0x7f6e900039b0 2024-04-18T04:55:35.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.129+0000 7f6eaaa00640 1 -- 172.21.15.120:0/4187448613 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea40ad440 con 0x7f6e900039b0 2024-04-18T04:55:35.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.129+0000 7f6eaaa00640 1 -- 172.21.15.120:0/4187448613 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea40ad8b0 con 0x7f6e900039b0 2024-04-18T04:55:35.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.137+0000 7f6eb2c00640 1 -- 172.21.15.120:0/4187448613 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e900039b0 msgr2=0x7f6e90003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:35.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.137+0000 7f6eb2c00640 1 --2- 172.21.15.120:0/4187448613 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e900039b0 0x7f6e90003db0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6ea400c490 tx=0x7f6ea401ce80 comp rx=0 tx=0).stop 2024-04-18T04:55:35.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.137+0000 7f6eb0c00640 1 -- 172.21.15.120:0/4187448613 reap_dead start 2024-04-18T04:55:35.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.137+0000 7f6eb2c00640 1 -- 172.21.15.120:0/4187448613 shutdown_connections 2024-04-18T04:55:35.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.137+0000 7f6eb2c00640 1 -- 172.21.15.120:0/4187448613 >> 172.21.15.120:0/4187448613 conn(0x7f6eac0c79c0 msgr2=0x7f6eac0c7da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:35.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.137+0000 7f6eb2c00640 1 -- 172.21.15.120:0/4187448613 shutdown_connections 2024-04-18T04:55:35.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.137+0000 7f6eb2c00640 1 -- 172.21.15.120:0/4187448613 wait complete. 2024-04-18T04:55:35.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.141+0000 7f6eb2c00640 1 Processor -- start 2024-04-18T04:55:35.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.141+0000 7f6eb2c00640 1 -- start start 2024-04-18T04:55:35.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.141+0000 7f6eb2c00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6eac06be40 0x7f6eac15b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:35.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.141+0000 7f6eb2c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6eac15bed0 0x7f6eac0c3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:35.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.141+0000 7f6eb2c00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6eac0c35d0 0x7f6eac14c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:35.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.141+0000 7f6eabe00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6eac06be40 0x7f6eac15b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:35.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.141+0000 7f6eabe00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6eac06be40 0x7f6eac15b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:42838/0 (socket says 172.21.15.120:42838) 2024-04-18T04:55:35.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.141+0000 7f6eabe00640 1 -- 172.21.15.120:0/2435663160 learned_addr learned my addr 172.21.15.120:0/2435663160 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:35.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.141+0000 7f6eb2c00640 1 -- 172.21.15.120:0/2435663160 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac15c4d0 con 0x7f6eac15bed0 2024-04-18T04:55:35.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.141+0000 7f6eb2c00640 1 -- 172.21.15.120:0/2435663160 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac15d780 con 0x7f6eac0c35d0 2024-04-18T04:55:35.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.141+0000 7f6eb2c00640 1 -- 172.21.15.120:0/2435663160 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac1ff270 con 0x7f6eac06be40 2024-04-18T04:55:35.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.141+0000 7f6eb0c00640 1 --2- 172.21.15.120:0/2435663160 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6eac0c35d0 0x7f6eac14c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:35.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.145+0000 7f6eabe00640 1 -- 172.21.15.120:0/2435663160 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6eac0c35d0 msgr2=0x7f6eac14c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:35.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.145+0000 7f6eabe00640 1 --2- 172.21.15.120:0/2435663160 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6eac0c35d0 0x7f6eac14c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:35.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.145+0000 7f6eabe00640 1 -- 172.21.15.120:0/2435663160 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6eac15bed0 msgr2=0x7f6eac0c3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:35.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.145+0000 7f6eabe00640 1 --2- 172.21.15.120:0/2435663160 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6eac15bed0 0x7f6eac0c3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:35.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.145+0000 7f6eabe00640 1 -- 172.21.15.120:0/2435663160 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eac1ff550 con 0x7f6eac06be40 2024-04-18T04:55:35.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.145+0000 7f6eabe00640 1 --2- 172.21.15.120:0/2435663160 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6eac06be40 0x7f6eac15b990 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6ea401d720 tx=0x7f6e90005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:35.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.145+0000 7f6ea3e00640 1 -- 172.21.15.120:0/2435663160 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea4003d90 con 0x7f6eac06be40 2024-04-18T04:55:35.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.145+0000 7f6ea3e00640 1 -- 172.21.15.120:0/2435663160 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea40050c0 con 0x7f6eac06be40 2024-04-18T04:55:35.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.145+0000 7f6ea3e00640 1 -- 172.21.15.120:0/2435663160 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea4003d90 con 0x7f6eac06be40 2024-04-18T04:55:35.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.145+0000 7f6eb2c00640 1 -- 172.21.15.120:0/2435663160 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eac1ff830 con 0x7f6eac06be40 2024-04-18T04:55:35.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.145+0000 7f6eb2c00640 1 -- 172.21.15.120:0/2435663160 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eac200030 con 0x7f6eac06be40 2024-04-18T04:55:35.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.145+0000 7f6eb2c00640 1 -- 172.21.15.120:0/2435663160 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6eac0c8600 con 0x7f6eac06be40 2024-04-18T04:55:35.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.149+0000 7f6ea3e00640 1 -- 172.21.15.120:0/2435663160 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6ea40b4040 con 0x7f6eac06be40 2024-04-18T04:55:35.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.149+0000 7f6ea3e00640 1 --2- 172.21.15.120:0/2435663160 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6e8c066750 0x7f6e8c068c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:35.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.149+0000 7f6eab400640 1 --2- 172.21.15.120:0/2435663160 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6e8c066750 0x7f6e8c068c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:35.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.153+0000 7f6ea3e00640 1 -- 172.21.15.120:0/2435663160 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f6ea411e680 con 0x7f6eac06be40 2024-04-18T04:55:35.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.153+0000 7f6eab400640 1 --2- 172.21.15.120:0/2435663160 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6e8c066750 0x7f6e8c068c10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6eac0bed10 tx=0x7f6e98008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:35.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.153+0000 7f6ea3e00640 1 --2- 172.21.15.120:0/2435663160 >> [v2:172.21.15.132:6824/28102,v1:172.21.15.132:6825/28102] conn(0x7f6e8c070340 0x7f6e8c0727e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:35.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.153+0000 7f6ea3e00640 1 -- 172.21.15.120:0/2435663160 --> [v2:172.21.15.132:6824/28102,v1:172.21.15.132:6825/28102] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6e8c072eb0 con 0x7f6e8c070340 2024-04-18T04:55:35.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.153+0000 7f6ea3e00640 1 -- 172.21.15.120:0/2435663160 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ea4003d90 con 0x7f6eac06be40 2024-04-18T04:55:35.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.153+0000 7f6eb0c00640 1 --2- 172.21.15.120:0/2435663160 >> [v2:172.21.15.132:6824/28102,v1:172.21.15.132:6825/28102] conn(0x7f6e8c070340 0x7f6e8c0727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:35.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.165+0000 7f6eb0c00640 1 --2- 172.21.15.120:0/2435663160 >> [v2:172.21.15.132:6824/28102,v1:172.21.15.132:6825/28102] conn(0x7f6e8c070340 0x7f6e8c0727e0 crc :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:35.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.165+0000 7f6ea3e00640 1 -- 172.21.15.120:0/2435663160 <== osd.4 v2:172.21.15.132:6824/28102 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f6e8c072eb0 con 0x7f6e8c070340 2024-04-18T04:55:35.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.197+0000 7f6eb2c00640 1 -- 172.21.15.120:0/2435663160 --> [v2:172.21.15.132:6824/28102,v1:172.21.15.132:6825/28102] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6eac15e3d0 con 0x7f6e8c070340 2024-04-18T04:55:35.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.197+0000 7f6ea3e00640 1 -- 172.21.15.120:0/2435663160 <== osd.4 v2:172.21.15.132:6824/28102 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f6e9c0076a0 con 0x7f6e8c070340 2024-04-18T04:55:35.196 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-18T04:55:35.196 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T04:55:35.196 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-18T04:55:35.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.201+0000 7f6eb2c00640 1 -- 172.21.15.120:0/2435663160 >> [v2:172.21.15.132:6824/28102,v1:172.21.15.132:6825/28102] conn(0x7f6e8c070340 msgr2=0x7f6e8c0727e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:35.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.201+0000 7f6eb2c00640 1 --2- 172.21.15.120:0/2435663160 >> [v2:172.21.15.132:6824/28102,v1:172.21.15.132:6825/28102] conn(0x7f6e8c070340 0x7f6e8c0727e0 crc :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:35.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.201+0000 7f6eb2c00640 1 -- 172.21.15.120:0/2435663160 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6e8c066750 msgr2=0x7f6e8c068c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:35.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.201+0000 7f6eb2c00640 1 --2- 172.21.15.120:0/2435663160 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6e8c066750 0x7f6e8c068c10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6eac0bed10 tx=0x7f6e98008040 comp rx=0 tx=0).stop 2024-04-18T04:55:35.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.201+0000 7f6eb2c00640 1 -- 172.21.15.120:0/2435663160 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6eac06be40 msgr2=0x7f6eac15b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:35.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.201+0000 7f6eb2c00640 1 --2- 172.21.15.120:0/2435663160 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6eac06be40 0x7f6eac15b990 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6ea401d720 tx=0x7f6e90005800 comp rx=0 tx=0).stop 2024-04-18T04:55:35.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.201+0000 7f6eb0c00640 1 -- 172.21.15.120:0/2435663160 reap_dead start 2024-04-18T04:55:35.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.201+0000 7f6eb2c00640 1 -- 172.21.15.120:0/2435663160 shutdown_connections 2024-04-18T04:55:35.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.201+0000 7f6eb2c00640 1 -- 172.21.15.120:0/2435663160 >> 172.21.15.120:0/2435663160 conn(0x7f6eac0c79c0 msgr2=0x7f6eac154b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:35.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.201+0000 7f6eb2c00640 1 -- 172.21.15.120:0/2435663160 shutdown_connections 2024-04-18T04:55:35.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.201+0000 7f6eb2c00640 1 -- 172.21.15.120:0/2435663160 wait complete. 2024-04-18T04:55:35.235 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-18T04:55:35.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.377+0000 7fb746200640 1 Processor -- start 2024-04-18T04:55:35.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.377+0000 7fb746200640 1 -- start start 2024-04-18T04:55:35.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.377+0000 7fb746200640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb7400c2860 0x7fb74006de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:35.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.381+0000 7fb746200640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb74015c9c0 con 0x7fb74006e380 2024-04-18T04:55:35.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.381+0000 7fb746200640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7400c8440 con 0x7fb7401535c0 2024-04-18T04:55:35.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.381+0000 7fb746200640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb74015cc30 con 0x7fb7400c2860 2024-04-18T04:55:35.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.381+0000 7fb73fe00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb7400c2860 0x7fb74006de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:35.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.381+0000 7fb73fe00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb7400c2860 0x7fb74006de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53646/0 (socket says 172.21.15.120:53646) 2024-04-18T04:55:35.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.381+0000 7fb73fe00640 1 -- 172.21.15.120:0/1261834655 learned_addr learned my addr 172.21.15.120:0/1261834655 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:35.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.381+0000 7fb73fe00640 1 -- 172.21.15.120:0/1261834655 >> v1:172.21.15.132:6789/0 conn(0x7fb7401535c0 legacy=0x7fb7400c7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:35.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.381+0000 7fb73fe00640 1 -- 172.21.15.120:0/1261834655 >> v1:172.21.15.120:6789/0 conn(0x7fb74006e380 legacy=0x7fb740159680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:35.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.381+0000 7fb73fe00640 1 -- 172.21.15.120:0/1261834655 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb74015cf10 con 0x7fb7400c2860 2024-04-18T04:55:35.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.381+0000 7fb73fe00640 1 --2- 172.21.15.120:0/1261834655 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7400c2860 0x7fb74006de40 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb72c009870 tx=0x7fb72c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb5dca3a479b83db server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:35.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.385+0000 7fb73f400640 1 -- 172.21.15.120:0/1261834655 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c0ab670 con 0x7fb7400c2860 2024-04-18T04:55:35.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.385+0000 7fb73f400640 1 -- 172.21.15.120:0/1261834655 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb72c0ab7d0 con 0x7fb7400c2860 2024-04-18T04:55:35.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.385+0000 7fb73f400640 1 -- 172.21.15.120:0/1261834655 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c0abb60 con 0x7fb7400c2860 2024-04-18T04:55:35.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.385+0000 7fb746200640 1 -- 172.21.15.120:0/1261834655 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7400c2860 msgr2=0x7fb74006de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:35.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.385+0000 7fb746200640 1 --2- 172.21.15.120:0/1261834655 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7400c2860 0x7fb74006de40 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb72c009870 tx=0x7fb72c01c560 comp rx=0 tx=0).stop 2024-04-18T04:55:35.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.385+0000 7fb746200640 1 -- 172.21.15.120:0/1261834655 shutdown_connections 2024-04-18T04:55:35.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.385+0000 7fb746200640 1 --2- 172.21.15.120:0/1261834655 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7400c2860 0x7fb74006de40 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:35.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.385+0000 7fb746200640 1 -- 172.21.15.120:0/1261834655 >> 172.21.15.120:0/1261834655 conn(0x7fb7400cbb20 msgr2=0x7fb7400cbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:35.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.385+0000 7fb746200640 1 -- 172.21.15.120:0/1261834655 shutdown_connections 2024-04-18T04:55:35.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.385+0000 7fb746200640 1 -- 172.21.15.120:0/1261834655 wait complete. 2024-04-18T04:55:35.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.385+0000 7fb746200640 1 Processor -- start 2024-04-18T04:55:35.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.385+0000 7fb746200640 1 -- start start 2024-04-18T04:55:35.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.385+0000 7fb746200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb74006e380 0x7fb740147ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:35.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.385+0000 7fb746200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb7400c2860 0x7fb74014a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:35.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.385+0000 7fb746200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb7401535c0 0x7fb74014ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:35.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.385+0000 7fb746200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74014a070 con 0x7fb74006e380 2024-04-18T04:55:35.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.385+0000 7fb746200640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb740158a90 con 0x7fb7400c2860 2024-04-18T04:55:35.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.385+0000 7fb746200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb740157e80 con 0x7fb7401535c0 2024-04-18T04:55:35.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.385+0000 7fb744e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb74006e380 0x7fb740147ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:35.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.385+0000 7fb744e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb74006e380 0x7fb740147ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53658/0 (socket says 172.21.15.120:53658) 2024-04-18T04:55:35.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.385+0000 7fb744e00640 1 -- 172.21.15.120:0/2187607712 learned_addr learned my addr 172.21.15.120:0/2187607712 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:35.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.385+0000 7fb73fe00640 1 --2- 172.21.15.120:0/2187607712 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb7400c2860 0x7fb74014a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:35.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.385+0000 7fb745800640 1 --2- 172.21.15.120:0/2187607712 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb7401535c0 0x7fb74014ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:35.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.385+0000 7fb744e00640 1 -- 172.21.15.120:0/2187607712 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb7401535c0 msgr2=0x7fb74014ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:35.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.385+0000 7fb744e00640 1 --2- 172.21.15.120:0/2187607712 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb7401535c0 0x7fb74014ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:35.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.385+0000 7fb744e00640 1 -- 172.21.15.120:0/2187607712 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb7400c2860 msgr2=0x7fb74014a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:35.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.385+0000 7fb744e00640 1 --2- 172.21.15.120:0/2187607712 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb7400c2860 0x7fb74014a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:35.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.385+0000 7fb744e00640 1 -- 172.21.15.120:0/2187607712 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb72c0094d0 con 0x7fb74006e380 2024-04-18T04:55:35.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.389+0000 7fb744e00640 1 --2- 172.21.15.120:0/2187607712 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb74006e380 0x7fb740147ad0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb73400c3c0 tx=0x7fb73400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:35.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.389+0000 7fb73cc00640 1 -- 172.21.15.120:0/2187607712 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7340052d0 con 0x7fb74006e380 2024-04-18T04:55:35.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.389+0000 7fb73cc00640 1 -- 172.21.15.120:0/2187607712 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb734005430 con 0x7fb74006e380 2024-04-18T04:55:35.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.389+0000 7fb746200640 1 -- 172.21.15.120:0/2187607712 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb740158160 con 0x7fb74006e380 2024-04-18T04:55:35.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.389+0000 7fb73cc00640 1 -- 172.21.15.120:0/2187607712 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb734003840 con 0x7fb74006e380 2024-04-18T04:55:35.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.389+0000 7fb746200640 1 -- 172.21.15.120:0/2187607712 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb740158720 con 0x7fb74006e380 2024-04-18T04:55:35.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.389+0000 7fb746200640 1 -- 172.21.15.120:0/2187607712 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb740067070 con 0x7fb74006e380 2024-04-18T04:55:35.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.389+0000 7fb73cc00640 1 -- 172.21.15.120:0/2187607712 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb7340039a0 con 0x7fb74006e380 2024-04-18T04:55:35.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.389+0000 7fb73cc00640 1 --2- 172.21.15.120:0/2187607712 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb720066690 0x7fb720068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:35.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.389+0000 7fb73cc00640 1 -- 172.21.15.120:0/2187607712 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7fb734083d60 con 0x7fb74006e380 2024-04-18T04:55:35.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.389+0000 7fb73fe00640 1 --2- 172.21.15.120:0/2187607712 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb720066690 0x7fb720068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:35.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.393+0000 7fb73fe00640 1 --2- 172.21.15.120:0/2187607712 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb720066690 0x7fb720068b50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb72c0af000 tx=0x7fb72c0a7000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:35.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.393+0000 7fb73cc00640 1 -- 172.21.15.120:0/2187607712 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fb734050a30 con 0x7fb74006e380 2024-04-18T04:55:35.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.685+0000 7fb746200640 1 -- 172.21.15.120:0/2187607712 --> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fb7401539a0 con 0x7fb720066690 2024-04-18T04:55:35.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.685+0000 7fb73cc00640 1 -- 172.21.15.120:0/2187607712 <== mgr.4113 v2:172.21.15.132:6832/27788 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb72c0ab9c0 con 0x7fb720066690 2024-04-18T04:55:35.689 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 4 to deep-scrub 2024-04-18T04:55:35.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.697+0000 7fb746200640 1 -- 172.21.15.120:0/2187607712 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb720066690 msgr2=0x7fb720068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:35.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.697+0000 7fb746200640 1 --2- 172.21.15.120:0/2187607712 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb720066690 0x7fb720068b50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb72c0af000 tx=0x7fb72c0a7000 comp rx=0 tx=0).stop 2024-04-18T04:55:35.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.697+0000 7fb746200640 1 -- 172.21.15.120:0/2187607712 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb74006e380 msgr2=0x7fb740147ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:35.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.697+0000 7fb746200640 1 --2- 172.21.15.120:0/2187607712 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb74006e380 0x7fb740147ad0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb73400c3c0 tx=0x7fb73400c880 comp rx=0 tx=0).stop 2024-04-18T04:55:35.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.697+0000 7fb746200640 1 -- 172.21.15.120:0/2187607712 shutdown_connections 2024-04-18T04:55:35.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.697+0000 7fb746200640 1 --2- 172.21.15.120:0/2187607712 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb720066690 0x7fb720068b50 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:35.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.697+0000 7fb746200640 1 --2- 172.21.15.120:0/2187607712 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb7401535c0 0x7fb74014ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:35.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.697+0000 7fb746200640 1 --2- 172.21.15.120:0/2187607712 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb7400c2860 0x7fb74014a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:35.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.697+0000 7fb746200640 1 --2- 172.21.15.120:0/2187607712 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb74006e380 0x7fb740147ad0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:35.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.697+0000 7fb746200640 1 -- 172.21.15.120:0/2187607712 >> 172.21.15.120:0/2187607712 conn(0x7fb7400cbb20 msgr2=0x7fb74006a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:35.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.697+0000 7fb746200640 1 -- 172.21.15.120:0/2187607712 shutdown_connections 2024-04-18T04:55:35.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:35.697+0000 7fb746200640 1 -- 172.21.15.120:0/2187607712 wait complete. 2024-04-18T04:55:35.753 INFO:tasks.ceph:Scrubbing osd.5 2024-04-18T04:55:35.754 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-18T04:55:36.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.113+0000 7f79e6c00640 1 Processor -- start 2024-04-18T04:55:36.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.113+0000 7f79e6c00640 1 -- start start 2024-04-18T04:55:36.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.117+0000 7f79e6c00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f79e0070c40 0x7f79e00c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:36.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.117+0000 7f79e6c00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f79e006fc70 0x7f79e0155c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:36.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.117+0000 7f79e6c00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e0159bb0 con 0x7f79e014fe40 2024-04-18T04:55:36.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.117+0000 7f79e6c00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e0072030 con 0x7f79e0070c40 2024-04-18T04:55:36.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.117+0000 7f79e6c00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e015a0e0 con 0x7f79e006fc70 2024-04-18T04:55:36.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.117+0000 7f79dfe00640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f79e014fe40 0x7f79e0070530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:54766/0 (socket says 172.21.15.120:54766) 2024-04-18T04:55:36.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.117+0000 7f79e4c00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f79e006fc70 0x7f79e0155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:36.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.117+0000 7f79e4c00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f79e006fc70 0x7f79e0155c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:42862/0 (socket says 172.21.15.120:42862) 2024-04-18T04:55:36.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.117+0000 7f79e4c00640 1 -- 172.21.15.120:0/2736623682 learned_addr learned my addr 172.21.15.120:0/2736623682 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:36.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.117+0000 7f79df400640 1 --2- 172.21.15.120:0/2736623682 >> v2:172.21.15.132:3300/0 conn(0x7f79e0070c40 0x7f79e00c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:36.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.117+0000 7f79e4c00640 1 -- 172.21.15.120:0/2736623682 >> v2:172.21.15.132:3300/0 conn(0x7f79e0070c40 msgr2=0x7f79e00c6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:36.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.117+0000 7f79e4c00640 1 --2- 172.21.15.120:0/2736623682 >> v2:172.21.15.132:3300/0 conn(0x7f79e0070c40 0x7f79e00c6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:36.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.117+0000 7f79e4c00640 1 -- 172.21.15.120:0/2736623682 >> v1:172.21.15.120:6789/0 conn(0x7f79e014fe40 legacy=0x7f79e0070530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:36.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.117+0000 7f79e4c00640 1 -- 172.21.15.120:0/2736623682 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e006a960 con 0x7f79e006fc70 2024-04-18T04:55:36.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.129+0000 7f79e4c00640 1 --2- 172.21.15.120:0/2736623682 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f79e006fc70 0x7f79e0155c30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f79d0009870 tx=0x7f79d0020980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffe597a574fb5ef6 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:36.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.129+0000 7f79dea00640 1 -- 172.21.15.120:0/2736623682 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d00a9990 con 0x7f79e006fc70 2024-04-18T04:55:36.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.129+0000 7f79dea00640 1 -- 172.21.15.120:0/2736623682 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d00a9af0 con 0x7f79e006fc70 2024-04-18T04:55:36.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.129+0000 7f79dea00640 1 -- 172.21.15.120:0/2736623682 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d00a9e80 con 0x7f79e006fc70 2024-04-18T04:55:36.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.129+0000 7f79e6c00640 1 -- 172.21.15.120:0/2736623682 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f79e006fc70 msgr2=0x7f79e0155c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:36.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.129+0000 7f79e6c00640 1 --2- 172.21.15.120:0/2736623682 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f79e006fc70 0x7f79e0155c30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f79d0009870 tx=0x7f79d0020980 comp rx=0 tx=0).stop 2024-04-18T04:55:36.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.129+0000 7f79e6c00640 1 -- 172.21.15.120:0/2736623682 shutdown_connections 2024-04-18T04:55:36.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.129+0000 7f79e6c00640 1 --2- 172.21.15.120:0/2736623682 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f79e006fc70 0x7f79e0155c30 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:36.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.129+0000 7f79e6c00640 1 --2- 172.21.15.120:0/2736623682 >> v2:172.21.15.132:3300/0 conn(0x7f79e0070c40 0x7f79e00c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:36.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.129+0000 7f79e6c00640 1 -- 172.21.15.120:0/2736623682 >> 172.21.15.120:0/2736623682 conn(0x7f79e00c79c0 msgr2=0x7f79e00c7da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:36.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.137+0000 7f79e6c00640 1 -- 172.21.15.120:0/2736623682 shutdown_connections 2024-04-18T04:55:36.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.137+0000 7f79e6c00640 1 -- 172.21.15.120:0/2736623682 wait complete. 2024-04-18T04:55:36.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.141+0000 7f79e6c00640 1 Processor -- start 2024-04-18T04:55:36.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.141+0000 7f79e6c00640 1 -- start start 2024-04-18T04:55:36.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.141+0000 7f79e6c00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f79e006fc70 0x7f79e00c04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:36.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.141+0000 7f79e6c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f79e0070c40 0x7f79e00c9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:36.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.141+0000 7f79e6c00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f79e014fe40 0x7f79e0144100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:36.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.141+0000 7f79e6c00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e01ee2b0 con 0x7f79e0070c40 2024-04-18T04:55:36.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.141+0000 7f79e6c00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e014c380 con 0x7f79e014fe40 2024-04-18T04:55:36.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.141+0000 7f79e6c00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e01ed970 con 0x7f79e006fc70 2024-04-18T04:55:36.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.145+0000 7f79e4c00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f79e014fe40 0x7f79e0144100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:36.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.145+0000 7f79e4c00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f79e014fe40 0x7f79e0144100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:55226/0 (socket says 172.21.15.120:55226) 2024-04-18T04:55:36.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.145+0000 7f79e4c00640 1 -- 172.21.15.120:0/1401253719 learned_addr learned my addr 172.21.15.120:0/1401253719 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:36.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.145+0000 7f79dfe00640 1 --2- 172.21.15.120:0/1401253719 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f79e006fc70 0x7f79e00c04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:36.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.145+0000 7f79e4c00640 1 -- 172.21.15.120:0/1401253719 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f79e006fc70 msgr2=0x7f79e00c04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:36.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.145+0000 7f79e4c00640 1 --2- 172.21.15.120:0/1401253719 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f79e006fc70 0x7f79e00c04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:36.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.145+0000 7f79e4c00640 1 -- 172.21.15.120:0/1401253719 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f79e0070c40 msgr2=0x7f79e00c9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:36.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.145+0000 7f79e4c00640 1 --2- 172.21.15.120:0/1401253719 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f79e0070c40 0x7f79e00c9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:36.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.145+0000 7f79e4c00640 1 -- 172.21.15.120:0/1401253719 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d00094d0 con 0x7f79e014fe40 2024-04-18T04:55:36.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.145+0000 7f79e4c00640 1 --2- 172.21.15.120:0/1401253719 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f79e014fe40 0x7f79e0144100 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f79d001f030 tx=0x7f79d001d720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:36.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.145+0000 7f79d7e00640 1 -- 172.21.15.120:0/1401253719 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d00a9790 con 0x7f79e014fe40 2024-04-18T04:55:36.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.145+0000 7f79d7e00640 1 -- 172.21.15.120:0/1401253719 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d00a9910 con 0x7f79e014fe40 2024-04-18T04:55:36.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.145+0000 7f79d7e00640 1 -- 172.21.15.120:0/1401253719 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d00bec60 con 0x7f79e014fe40 2024-04-18T04:55:36.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.145+0000 7f79e6c00640 1 -- 172.21.15.120:0/1401253719 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e01f1060 con 0x7f79e014fe40 2024-04-18T04:55:36.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.145+0000 7f79e6c00640 1 -- 172.21.15.120:0/1401253719 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e01eded0 con 0x7f79e014fe40 2024-04-18T04:55:36.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.145+0000 7f79e6c00640 1 -- 172.21.15.120:0/1401253719 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f79b8000fd0 con 0x7f79e014fe40 2024-04-18T04:55:36.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.149+0000 7f79d7e00640 1 -- 172.21.15.120:0/1401253719 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f79d0010400 con 0x7f79e014fe40 2024-04-18T04:55:36.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.149+0000 7f79d7e00640 1 --2- 172.21.15.120:0/1401253719 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f79c0066690 0x7f79c0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:36.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.153+0000 7f79d7e00640 1 -- 172.21.15.120:0/1401253719 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f79d0127c60 con 0x7f79e014fe40 2024-04-18T04:55:36.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.153+0000 7f79d7e00640 1 --2- 172.21.15.120:0/1401253719 >> [v2:172.21.15.132:6808/28104,v1:172.21.15.132:6809/28104] conn(0x7f79c0070300 0x7f79c00727a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:36.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.153+0000 7f79d7e00640 1 -- 172.21.15.120:0/1401253719 --> [v2:172.21.15.132:6808/28104,v1:172.21.15.132:6809/28104] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f79c0072e70 con 0x7f79c0070300 2024-04-18T04:55:36.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.153+0000 7f79d7e00640 1 -- 172.21.15.120:0/1401253719 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79d012d070 con 0x7f79e014fe40 2024-04-18T04:55:36.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.153+0000 7f79dfe00640 1 --2- 172.21.15.120:0/1401253719 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f79c0066690 0x7f79c0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:36.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.153+0000 7f79df400640 1 --2- 172.21.15.120:0/1401253719 >> [v2:172.21.15.132:6808/28104,v1:172.21.15.132:6809/28104] conn(0x7f79c0070300 0x7f79c00727a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:36.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.153+0000 7f79dfe00640 1 --2- 172.21.15.120:0/1401253719 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f79c0066690 0x7f79c0068b50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f79d800c440 tx=0x7f79d8009690 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:36.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.153+0000 7f79df400640 1 --2- 172.21.15.120:0/1401253719 >> [v2:172.21.15.132:6808/28104,v1:172.21.15.132:6809/28104] conn(0x7f79c0070300 0x7f79c00727a0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:36.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.157+0000 7f79d7e00640 1 -- 172.21.15.120:0/1401253719 <== osd.5 v2:172.21.15.132:6808/28104 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f79c0072e70 con 0x7f79c0070300 2024-04-18T04:55:36.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.181+0000 7f79e6c00640 1 -- 172.21.15.120:0/1401253719 --> [v2:172.21.15.132:6808/28104,v1:172.21.15.132:6809/28104] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f79b8002ce0 con 0x7f79c0070300 2024-04-18T04:55:36.183 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-18T04:55:36.183 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T04:55:36.183 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-18T04:55:36.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.185+0000 7f79d7e00640 1 -- 172.21.15.120:0/1401253719 <== osd.5 v2:172.21.15.132:6808/28104 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f79b8002ce0 con 0x7f79c0070300 2024-04-18T04:55:36.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.185+0000 7f79e6c00640 1 -- 172.21.15.120:0/1401253719 >> [v2:172.21.15.132:6808/28104,v1:172.21.15.132:6809/28104] conn(0x7f79c0070300 msgr2=0x7f79c00727a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:36.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.185+0000 7f79e6c00640 1 --2- 172.21.15.120:0/1401253719 >> [v2:172.21.15.132:6808/28104,v1:172.21.15.132:6809/28104] conn(0x7f79c0070300 0x7f79c00727a0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:36.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.185+0000 7f79e6c00640 1 -- 172.21.15.120:0/1401253719 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f79c0066690 msgr2=0x7f79c0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:36.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.185+0000 7f79e6c00640 1 --2- 172.21.15.120:0/1401253719 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f79c0066690 0x7f79c0068b50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f79d800c440 tx=0x7f79d8009690 comp rx=0 tx=0).stop 2024-04-18T04:55:36.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.185+0000 7f79e6c00640 1 -- 172.21.15.120:0/1401253719 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f79e014fe40 msgr2=0x7f79e0144100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:36.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.185+0000 7f79e6c00640 1 --2- 172.21.15.120:0/1401253719 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f79e014fe40 0x7f79e0144100 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f79d001f030 tx=0x7f79d001d720 comp rx=0 tx=0).stop 2024-04-18T04:55:36.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.185+0000 7f79e4c00640 1 -- 172.21.15.120:0/1401253719 reap_dead start 2024-04-18T04:55:36.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.189+0000 7f79e6c00640 1 -- 172.21.15.120:0/1401253719 shutdown_connections 2024-04-18T04:55:36.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.189+0000 7f79e6c00640 1 -- 172.21.15.120:0/1401253719 >> 172.21.15.120:0/1401253719 conn(0x7f79e00c79c0 msgr2=0x7f79e006c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:36.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.193+0000 7f79e6c00640 1 -- 172.21.15.120:0/1401253719 shutdown_connections 2024-04-18T04:55:36.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.193+0000 7f79e6c00640 1 -- 172.21.15.120:0/1401253719 wait complete. 2024-04-18T04:55:36.217 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-18T04:55:36.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.513+0000 7fcce1a00640 1 Processor -- start 2024-04-18T04:55:36.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.513+0000 7fcce1a00640 1 -- start start 2024-04-18T04:55:36.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.513+0000 7fcce1a00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fccdc1538a0 0x7fccdc159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:36.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.513+0000 7fcce1a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fccdc0c9890 0x7fccdc15aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:36.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.513+0000 7fcce1a00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccdc0c4dc0 con 0x7fccdc06ae20 2024-04-18T04:55:36.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.513+0000 7fcce1a00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccdc0b2040 con 0x7fccdc1538a0 2024-04-18T04:55:36.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.513+0000 7fcce1a00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc15a4e0 con 0x7fccdc0c9890 2024-04-18T04:55:36.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.513+0000 7fccda000640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fccdc06ae20 0x7fccdc0cf3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:38974/0 (socket says 172.21.15.120:38974) 2024-04-18T04:55:36.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.513+0000 7fccda000640 1 -- 172.21.15.120:0/995607849 learned_addr learned my addr 172.21.15.120:0/995607849 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:55:36.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.513+0000 7fccdaa00640 1 --2- 172.21.15.120:0/995607849 >> v2:172.21.15.132:3300/0 conn(0x7fccdc1538a0 0x7fccdc159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:36.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.513+0000 7fccdb400640 1 --2- 172.21.15.120:0/995607849 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fccdc0c9890 0x7fccdc15aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:36.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.513+0000 7fccd9600640 1 -- 172.21.15.120:0/995607849 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1257853342 0 0) 0x7fccdc0c4dc0 con 0x7fccdc06ae20 2024-04-18T04:55:36.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.513+0000 7fccd9600640 1 -- 172.21.15.120:0/995607849 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccc0003530 con 0x7fccdc06ae20 2024-04-18T04:55:36.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.513+0000 7fccdaa00640 1 -- 172.21.15.120:0/995607849 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fccdc0c9890 msgr2=0x7fccdc15aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:36.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.513+0000 7fccdaa00640 1 --2- 172.21.15.120:0/995607849 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fccdc0c9890 0x7fccdc15aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:36.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.513+0000 7fccdaa00640 1 -- 172.21.15.120:0/995607849 >> v1:172.21.15.132:6789/0 conn(0x7fccdc06ae20 legacy=0x7fccdc0cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:36.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.513+0000 7fccdaa00640 1 -- 172.21.15.120:0/995607849 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccdc153c80 con 0x7fccdc1538a0 2024-04-18T04:55:36.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.513+0000 7fccdb400640 1 --2- 172.21.15.120:0/995607849 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fccdc0c9890 0x7fccdc15aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T04:55:36.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.517+0000 7fccdaa00640 1 --2- 172.21.15.120:0/995607849 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fccdc1538a0 0x7fccdc159fa0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fcccc0097c0 tx=0x7fcccc01ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=446f8a815c1f5915 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:36.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.517+0000 7fccd9600640 1 -- 172.21.15.120:0/995607849 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcccc0a8990 con 0x7fccdc1538a0 2024-04-18T04:55:36.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.517+0000 7fccd9600640 1 -- 172.21.15.120:0/995607849 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcccc0a8af0 con 0x7fccdc1538a0 2024-04-18T04:55:36.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.517+0000 7fccd9600640 1 -- 172.21.15.120:0/995607849 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcccc0a8e80 con 0x7fccdc1538a0 2024-04-18T04:55:36.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.521+0000 7fcce1a00640 1 -- 172.21.15.120:0/995607849 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fccdc1538a0 msgr2=0x7fccdc159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:36.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.521+0000 7fcce1a00640 1 --2- 172.21.15.120:0/995607849 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fccdc1538a0 0x7fccdc159fa0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fcccc0097c0 tx=0x7fcccc01ec90 comp rx=0 tx=0).stop 2024-04-18T04:55:36.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.521+0000 7fcce1a00640 1 -- 172.21.15.120:0/995607849 shutdown_connections 2024-04-18T04:55:36.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.521+0000 7fcce1a00640 1 --2- 172.21.15.120:0/995607849 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fccdc0c9890 0x7fccdc15aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:36.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.521+0000 7fcce1a00640 1 --2- 172.21.15.120:0/995607849 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fccdc1538a0 0x7fccdc159fa0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:36.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.521+0000 7fcce1a00640 1 -- 172.21.15.120:0/995607849 >> 172.21.15.120:0/995607849 conn(0x7fccdc065fc0 msgr2=0x7fccdc0663d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:36.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.521+0000 7fcce1a00640 1 -- 172.21.15.120:0/995607849 shutdown_connections 2024-04-18T04:55:36.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.521+0000 7fcce1a00640 1 -- 172.21.15.120:0/995607849 wait complete. 2024-04-18T04:55:36.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.521+0000 7fcce1a00640 1 Processor -- start 2024-04-18T04:55:36.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.521+0000 7fcce1a00640 1 -- start start 2024-04-18T04:55:36.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.521+0000 7fcce1a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fccdc06ae20 0x7fccdc0c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:36.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.521+0000 7fcce1a00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fccdc0c9890 0x7fccdc140d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:36.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.521+0000 7fcce1a00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fccdc1538a0 0x7fccdc0b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:36.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.521+0000 7fcce1a00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc0b2660 con 0x7fccdc06ae20 2024-04-18T04:55:36.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.521+0000 7fcce1a00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc0c7c70 con 0x7fccdc0c9890 2024-04-18T04:55:36.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.521+0000 7fcce1a00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc1594f0 con 0x7fccdc1538a0 2024-04-18T04:55:36.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.525+0000 7fccda000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fccdc0c9890 0x7fccdc140d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:36.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.525+0000 7fccdaa00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fccdc06ae20 0x7fccdc0c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:36.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.525+0000 7fccda000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fccdc0c9890 0x7fccdc140d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:55252/0 (socket says 172.21.15.120:55252) 2024-04-18T04:55:36.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.525+0000 7fccda000640 1 -- 172.21.15.120:0/1552847780 learned_addr learned my addr 172.21.15.120:0/1552847780 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:36.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.525+0000 7fccda000640 1 -- 172.21.15.120:0/1552847780 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fccdc1538a0 msgr2=0x7fccdc0b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:36.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.525+0000 7fccda000640 1 --2- 172.21.15.120:0/1552847780 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fccdc1538a0 0x7fccdc0b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:36.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.525+0000 7fccda000640 1 -- 172.21.15.120:0/1552847780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fccdc06ae20 msgr2=0x7fccdc0c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:36.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.525+0000 7fccda000640 1 --2- 172.21.15.120:0/1552847780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fccdc06ae20 0x7fccdc0c9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:36.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.525+0000 7fccda000640 1 -- 172.21.15.120:0/1552847780 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd4009a70 con 0x7fccdc0c9890 2024-04-18T04:55:36.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.525+0000 7fccda000640 1 --2- 172.21.15.120:0/1552847780 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fccdc0c9890 0x7fccdc140d00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fccc800c450 tx=0x7fccc800c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:36.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.525+0000 7fccd2a00640 1 -- 172.21.15.120:0/1552847780 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc8005cf0 con 0x7fccdc0c9890 2024-04-18T04:55:36.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.525+0000 7fccd2a00640 1 -- 172.21.15.120:0/1552847780 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc8005e50 con 0x7fccdc0c9890 2024-04-18T04:55:36.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.525+0000 7fccd2a00640 1 -- 172.21.15.120:0/1552847780 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc8007290 con 0x7fccdc0c9890 2024-04-18T04:55:36.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.525+0000 7fcce1a00640 1 -- 172.21.15.120:0/1552847780 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcccc009420 con 0x7fccdc0c9890 2024-04-18T04:55:36.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.525+0000 7fcce1a00640 1 -- 172.21.15.120:0/1552847780 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccdc0cbe30 con 0x7fccdc0c9890 2024-04-18T04:55:36.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.525+0000 7fccd2a00640 1 -- 172.21.15.120:0/1552847780 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fccc80073f0 con 0x7fccdc0c9890 2024-04-18T04:55:36.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.529+0000 7fcce1a00640 1 -- 172.21.15.120:0/1552847780 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccdc0c79b0 con 0x7fccdc0c9890 2024-04-18T04:55:36.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.529+0000 7fccd2a00640 1 --2- 172.21.15.120:0/1552847780 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fccbc066690 0x7fccbc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:36.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.529+0000 7fccd2a00640 1 -- 172.21.15.120:0/1552847780 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7fccc8083bb0 con 0x7fccdc0c9890 2024-04-18T04:55:36.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.529+0000 7fccdaa00640 1 --2- 172.21.15.120:0/1552847780 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fccbc066690 0x7fccbc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:36.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.529+0000 7fccdaa00640 1 --2- 172.21.15.120:0/1552847780 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fccbc066690 0x7fccbc068b50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcccc0b2000 tx=0x7fcccc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:36.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.533+0000 7fccd2a00640 1 -- 172.21.15.120:0/1552847780 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fccc80509c0 con 0x7fccdc0c9890 2024-04-18T04:55:36.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.689+0000 7fcce1a00640 1 -- 172.21.15.120:0/1552847780 --> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fccdc0c4490 con 0x7fccbc066690 2024-04-18T04:55:36.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.693+0000 7fccd2a00640 1 -- 172.21.15.120:0/1552847780 <== mgr.4113 v2:172.21.15.132:6832/27788 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcccc0b0440 con 0x7fccbc066690 2024-04-18T04:55:36.688 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 5 to deep-scrub 2024-04-18T04:55:36.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.693+0000 7fcce1a00640 1 -- 172.21.15.120:0/1552847780 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fccbc066690 msgr2=0x7fccbc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:36.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.693+0000 7fcce1a00640 1 --2- 172.21.15.120:0/1552847780 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fccbc066690 0x7fccbc068b50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcccc0b2000 tx=0x7fcccc008040 comp rx=0 tx=0).stop 2024-04-18T04:55:36.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.693+0000 7fcce1a00640 1 -- 172.21.15.120:0/1552847780 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fccdc0c9890 msgr2=0x7fccdc140d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:36.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.693+0000 7fcce1a00640 1 --2- 172.21.15.120:0/1552847780 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fccdc0c9890 0x7fccdc140d00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fccc800c450 tx=0x7fccc800c910 comp rx=0 tx=0).stop 2024-04-18T04:55:36.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.693+0000 7fcce1a00640 1 -- 172.21.15.120:0/1552847780 shutdown_connections 2024-04-18T04:55:36.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.693+0000 7fcce1a00640 1 --2- 172.21.15.120:0/1552847780 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fccbc066690 0x7fccbc068b50 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:36.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.693+0000 7fcce1a00640 1 --2- 172.21.15.120:0/1552847780 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fccdc1538a0 0x7fccdc0b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:36.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.693+0000 7fcce1a00640 1 --2- 172.21.15.120:0/1552847780 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fccdc0c9890 0x7fccdc140d00 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:36.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.693+0000 7fcce1a00640 1 --2- 172.21.15.120:0/1552847780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fccdc06ae20 0x7fccdc0c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:36.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.693+0000 7fcce1a00640 1 -- 172.21.15.120:0/1552847780 >> 172.21.15.120:0/1552847780 conn(0x7fccdc065fc0 msgr2=0x7fccdc152360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:36.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.693+0000 7fcce1a00640 1 -- 172.21.15.120:0/1552847780 shutdown_connections 2024-04-18T04:55:36.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.693+0000 7fcce1a00640 1 -- 172.21.15.120:0/1552847780 wait complete. 2024-04-18T04:55:36.710 INFO:tasks.ceph:Scrubbing osd.6 2024-04-18T04:55:36.711 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-18T04:55:36.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.857+0000 7efcc1800640 1 Processor -- start 2024-04-18T04:55:36.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.857+0000 7efcc1800640 1 -- start start 2024-04-18T04:55:36.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.857+0000 7efcc1800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efcbc0c6260 0x7efcbc157e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:36.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.857+0000 7efcc1800640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7efcbc0c2b00 0x7efcbc0c2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:36.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.857+0000 7efcc1800640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcbc0c3470 con 0x7efcbc0c6640 2024-04-18T04:55:36.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.857+0000 7efcc1800640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcbc1583a0 con 0x7efcbc0c2b00 2024-04-18T04:55:36.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.857+0000 7efcc1800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc0c56e0 con 0x7efcbc0c6260 2024-04-18T04:55:36.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.857+0000 7efcbaa00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efcbc0c6260 0x7efcbc157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:36.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.857+0000 7efcbaa00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efcbc0c6260 0x7efcbc157e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.120:42888/0 (socket says 172.21.15.120:42888) 2024-04-18T04:55:36.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.857+0000 7efcbaa00640 1 -- 172.21.15.120:0/3282080036 learned_addr learned my addr 172.21.15.120:0/3282080036 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:36.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.857+0000 7efcbb400640 1 --2- 172.21.15.120:0/3282080036 >> v2:172.21.15.120:3300/0 conn(0x7efcbc0c2b00 0x7efcbc0c2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:36.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.861+0000 7efcbaa00640 1 -- 172.21.15.120:0/3282080036 >> v2:172.21.15.120:3300/0 conn(0x7efcbc0c2b00 msgr2=0x7efcbc0c2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:36.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.861+0000 7efcbaa00640 1 --2- 172.21.15.120:0/3282080036 >> v2:172.21.15.120:3300/0 conn(0x7efcbc0c2b00 0x7efcbc0c2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:36.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.861+0000 7efcbaa00640 1 -- 172.21.15.120:0/3282080036 >> v1:172.21.15.120:6789/0 conn(0x7efcbc0c6640 legacy=0x7efcbc151250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:36.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.861+0000 7efcbaa00640 1 -- 172.21.15.120:0/3282080036 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcbc0c5980 con 0x7efcbc0c6260 2024-04-18T04:55:36.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.861+0000 7efcbaa00640 1 --2- 172.21.15.120:0/3282080036 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efcbc0c6260 0x7efcbc157e60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efcac009870 tx=0x7efcac01ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d20c9dc4ac64903f server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:36.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.861+0000 7efcb9600640 1 -- 172.21.15.120:0/3282080036 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcac0a8a50 con 0x7efcbc0c6260 2024-04-18T04:55:36.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.861+0000 7efcb9600640 1 -- 172.21.15.120:0/3282080036 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcac0a8bb0 con 0x7efcbc0c6260 2024-04-18T04:55:36.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.861+0000 7efcb9600640 1 -- 172.21.15.120:0/3282080036 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcac0b0440 con 0x7efcbc0c6260 2024-04-18T04:55:36.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.865+0000 7efcc1800640 1 -- 172.21.15.120:0/3282080036 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efcbc0c6260 msgr2=0x7efcbc157e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:36.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.865+0000 7efcc1800640 1 --2- 172.21.15.120:0/3282080036 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efcbc0c6260 0x7efcbc157e60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efcac009870 tx=0x7efcac01ed50 comp rx=0 tx=0).stop 2024-04-18T04:55:36.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.865+0000 7efcc1800640 1 -- 172.21.15.120:0/3282080036 shutdown_connections 2024-04-18T04:55:36.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.865+0000 7efcc1800640 1 --2- 172.21.15.120:0/3282080036 >> v2:172.21.15.120:3300/0 conn(0x7efcbc0c2b00 0x7efcbc0c2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:36.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.865+0000 7efcc1800640 1 --2- 172.21.15.120:0/3282080036 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efcbc0c6260 0x7efcbc157e60 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:36.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.865+0000 7efcc1800640 1 -- 172.21.15.120:0/3282080036 >> 172.21.15.120:0/3282080036 conn(0x7efcbc069ec0 msgr2=0x7efcbc06a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:36.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.865+0000 7efcc1800640 1 -- 172.21.15.120:0/3282080036 shutdown_connections 2024-04-18T04:55:36.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.865+0000 7efcc1800640 1 -- 172.21.15.120:0/3282080036 wait complete. 2024-04-18T04:55:36.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.865+0000 7efcc1800640 1 Processor -- start 2024-04-18T04:55:36.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.865+0000 7efcc1800640 1 -- start start 2024-04-18T04:55:36.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.869+0000 7efcc1800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efcbc0c2b00 0x7efcbc154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:36.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.869+0000 7efcc1800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcbc0c6260 0x7efcbc0c96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:36.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.869+0000 7efcc1800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efcbc0c6640 0x7efcbc0caa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:36.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.869+0000 7efcc1800640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc1ef700 con 0x7efcbc0c6260 2024-04-18T04:55:36.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.869+0000 7efcc1800640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc1efb90 con 0x7efcbc0c2b00 2024-04-18T04:55:36.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.869+0000 7efcc1800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc0ca2e0 con 0x7efcbc0c6640 2024-04-18T04:55:36.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.869+0000 7efcba000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcbc0c6260 0x7efcbc0c96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:36.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.869+0000 7efcba000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcbc0c6260 0x7efcbc0c96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53696/0 (socket says 172.21.15.120:53696) 2024-04-18T04:55:36.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.869+0000 7efcba000640 1 -- 172.21.15.120:0/2999130813 learned_addr learned my addr 172.21.15.120:0/2999130813 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:36.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.869+0000 7efcbaa00640 1 --2- 172.21.15.120:0/2999130813 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efcbc0c2b00 0x7efcbc154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:36.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.869+0000 7efcbb400640 1 --2- 172.21.15.120:0/2999130813 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efcbc0c6640 0x7efcbc0caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:36.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.869+0000 7efcba000640 1 -- 172.21.15.120:0/2999130813 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efcbc0c6640 msgr2=0x7efcbc0caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:36.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.869+0000 7efcba000640 1 --2- 172.21.15.120:0/2999130813 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efcbc0c6640 0x7efcbc0caa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:36.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.869+0000 7efcba000640 1 -- 172.21.15.120:0/2999130813 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efcbc0c2b00 msgr2=0x7efcbc154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:36.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.869+0000 7efcba000640 1 --2- 172.21.15.120:0/2999130813 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efcbc0c2b00 0x7efcbc154700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:36.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.869+0000 7efcba000640 1 -- 172.21.15.120:0/2999130813 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcac0094d0 con 0x7efcbc0c6260 2024-04-18T04:55:36.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.869+0000 7efcba000640 1 --2- 172.21.15.120:0/2999130813 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcbc0c6260 0x7efcbc0c96e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7efca800c340 tx=0x7efca800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:36.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.869+0000 7efcb2a00640 1 -- 172.21.15.120:0/2999130813 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca80052d0 con 0x7efcbc0c6260 2024-04-18T04:55:36.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.869+0000 7efcb2a00640 1 -- 172.21.15.120:0/2999130813 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca8005430 con 0x7efcbc0c6260 2024-04-18T04:55:36.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.869+0000 7efcc1800640 1 -- 172.21.15.120:0/2999130813 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcbc1eee10 con 0x7efcbc0c6260 2024-04-18T04:55:36.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.869+0000 7efcb2a00640 1 -- 172.21.15.120:0/2999130813 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca8007260 con 0x7efcbc0c6260 2024-04-18T04:55:36.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.869+0000 7efcc1800640 1 -- 172.21.15.120:0/2999130813 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcbc0ca000 con 0x7efcbc0c6260 2024-04-18T04:55:36.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.869+0000 7efcc1800640 1 -- 172.21.15.120:0/2999130813 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efcbc15af90 con 0x7efcbc0c6260 2024-04-18T04:55:36.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.873+0000 7efcb2a00640 1 -- 172.21.15.120:0/2999130813 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efca80073c0 con 0x7efcbc0c6260 2024-04-18T04:55:36.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.873+0000 7efcb2a00640 1 --2- 172.21.15.120:0/2999130813 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7efc9c0666c0 0x7efc9c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:36.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.873+0000 7efcb2a00640 1 -- 172.21.15.120:0/2999130813 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7efca8083a10 con 0x7efcbc0c6260 2024-04-18T04:55:36.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.873+0000 7efcb2a00640 1 --2- 172.21.15.120:0/2999130813 >> [v2:172.21.15.132:6800/28103,v1:172.21.15.132:6801/28103] conn(0x7efc9c070330 0x7efc9c0727d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:36.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.873+0000 7efcb2a00640 1 -- 172.21.15.120:0/2999130813 --> [v2:172.21.15.132:6800/28103,v1:172.21.15.132:6801/28103] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efc9c072ea0 con 0x7efc9c070330 2024-04-18T04:55:36.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.873+0000 7efcb2a00640 1 -- 172.21.15.120:0/2999130813 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7efca80882a0 con 0x7efcbc0c6260 2024-04-18T04:55:36.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.873+0000 7efcbaa00640 1 --2- 172.21.15.120:0/2999130813 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7efc9c0666c0 0x7efc9c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:36.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.873+0000 7efcbb400640 1 --2- 172.21.15.120:0/2999130813 >> [v2:172.21.15.132:6800/28103,v1:172.21.15.132:6801/28103] conn(0x7efc9c070330 0x7efc9c0727d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:36.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.873+0000 7efcbaa00640 1 --2- 172.21.15.120:0/2999130813 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7efc9c0666c0 0x7efc9c068b80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7efcac0b2000 tx=0x7efcac0aa070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:36.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.873+0000 7efcbb400640 1 --2- 172.21.15.120:0/2999130813 >> [v2:172.21.15.132:6800/28103,v1:172.21.15.132:6801/28103] conn(0x7efc9c070330 0x7efc9c0727d0 crc :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:36.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.877+0000 7efcb2a00640 1 -- 172.21.15.120:0/2999130813 <== osd.6 v2:172.21.15.132:6800/28103 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7efc9c072ea0 con 0x7efc9c070330 2024-04-18T04:55:36.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.889+0000 7efcc1800640 1 -- 172.21.15.120:0/2999130813 --> [v2:172.21.15.132:6800/28103,v1:172.21.15.132:6801/28103] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7efcbc15acb0 con 0x7efc9c070330 2024-04-18T04:55:36.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.889+0000 7efcb2a00640 1 -- 172.21.15.120:0/2999130813 <== osd.6 v2:172.21.15.132:6800/28103 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7efcb400f040 con 0x7efc9c070330 2024-04-18T04:55:36.886 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-18T04:55:36.887 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T04:55:36.887 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-18T04:55:36.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.889+0000 7efcc1800640 1 -- 172.21.15.120:0/2999130813 >> [v2:172.21.15.132:6800/28103,v1:172.21.15.132:6801/28103] conn(0x7efc9c070330 msgr2=0x7efc9c0727d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:36.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.889+0000 7efcc1800640 1 --2- 172.21.15.120:0/2999130813 >> [v2:172.21.15.132:6800/28103,v1:172.21.15.132:6801/28103] conn(0x7efc9c070330 0x7efc9c0727d0 crc :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:36.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.889+0000 7efcc1800640 1 -- 172.21.15.120:0/2999130813 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7efc9c0666c0 msgr2=0x7efc9c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:36.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.889+0000 7efcc1800640 1 --2- 172.21.15.120:0/2999130813 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7efc9c0666c0 0x7efc9c068b80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7efcac0b2000 tx=0x7efcac0aa070 comp rx=0 tx=0).stop 2024-04-18T04:55:36.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.889+0000 7efcc1800640 1 -- 172.21.15.120:0/2999130813 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcbc0c6260 msgr2=0x7efcbc0c96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:36.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.889+0000 7efcc1800640 1 --2- 172.21.15.120:0/2999130813 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcbc0c6260 0x7efcbc0c96e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7efca800c340 tx=0x7efca800c800 comp rx=0 tx=0).stop 2024-04-18T04:55:36.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.889+0000 7efcbb400640 1 -- 172.21.15.120:0/2999130813 reap_dead start 2024-04-18T04:55:36.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.889+0000 7efcc1800640 1 -- 172.21.15.120:0/2999130813 shutdown_connections 2024-04-18T04:55:36.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.889+0000 7efcc1800640 1 -- 172.21.15.120:0/2999130813 >> 172.21.15.120:0/2999130813 conn(0x7efcbc069ec0 msgr2=0x7efcbc14dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:36.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.889+0000 7efcc1800640 1 -- 172.21.15.120:0/2999130813 shutdown_connections 2024-04-18T04:55:36.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:36.889+0000 7efcc1800640 1 -- 172.21.15.120:0/2999130813 wait complete. 2024-04-18T04:55:36.906 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-18T04:55:37.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.049+0000 7f7b03e00640 1 Processor -- start 2024-04-18T04:55:37.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.049+0000 7f7b03e00640 1 -- start start 2024-04-18T04:55:37.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.053+0000 7f7b03e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7b040c84f0 0x7f7b04161610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:37.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.053+0000 7f7b03e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7b04161b50 0x7f7b040c5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:37.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.053+0000 7f7b03e00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b04160ea0 con 0x7f7b040c8110 2024-04-18T04:55:37.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.053+0000 7f7b03e00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b040c7a70 con 0x7f7b040c84f0 2024-04-18T04:55:37.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.053+0000 7f7b03e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b04161180 con 0x7f7b04161b50 2024-04-18T04:55:37.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.053+0000 7f7afbe00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7b040c84f0 0x7f7b04161610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:37.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.053+0000 7f7afbe00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7b040c84f0 0x7f7b04161610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53700/0 (socket says 172.21.15.120:53700) 2024-04-18T04:55:37.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.053+0000 7f7afbe00640 1 -- 172.21.15.120:0/755373677 learned_addr learned my addr 172.21.15.120:0/755373677 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:37.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.053+0000 7f7b03400640 1 --2- 172.21.15.120:0/755373677 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7b04161b50 0x7f7b040c5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:37.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.053+0000 7f7afbe00640 1 -- 172.21.15.120:0/755373677 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7b04161b50 msgr2=0x7f7b040c5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:37.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.053+0000 7f7afbe00640 1 --2- 172.21.15.120:0/755373677 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7b04161b50 0x7f7b040c5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:37.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.053+0000 7f7afbe00640 1 -- 172.21.15.120:0/755373677 >> v1:172.21.15.132:6789/0 conn(0x7f7b040c8110 legacy=0x7f7b04065bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:37.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.053+0000 7f7afbe00640 1 -- 172.21.15.120:0/755373677 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b0415e8c0 con 0x7f7b040c84f0 2024-04-18T04:55:37.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.057+0000 7f7afbe00640 1 --2- 172.21.15.120:0/755373677 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b040c84f0 0x7f7b04161610 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7aec0098a0 tx=0x7f7aec01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15179e80aef02b94 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:37.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.057+0000 7f7b02000640 1 -- 172.21.15.120:0/755373677 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aec0aa670 con 0x7f7b040c84f0 2024-04-18T04:55:37.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.057+0000 7f7b02000640 1 -- 172.21.15.120:0/755373677 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aec0aa7d0 con 0x7f7b040c84f0 2024-04-18T04:55:37.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.057+0000 7f7b02000640 1 -- 172.21.15.120:0/755373677 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aec0aab60 con 0x7f7b040c84f0 2024-04-18T04:55:37.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.057+0000 7f7b03e00640 1 -- 172.21.15.120:0/755373677 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b040c84f0 msgr2=0x7f7b04161610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:37.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.057+0000 7f7b03e00640 1 --2- 172.21.15.120:0/755373677 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b040c84f0 0x7f7b04161610 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7aec0098a0 tx=0x7f7aec01c510 comp rx=0 tx=0).stop 2024-04-18T04:55:37.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.057+0000 7f7b03e00640 1 -- 172.21.15.120:0/755373677 shutdown_connections 2024-04-18T04:55:37.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.057+0000 7f7b03e00640 1 --2- 172.21.15.120:0/755373677 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7b04161b50 0x7f7b040c5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:37.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.057+0000 7f7b03e00640 1 --2- 172.21.15.120:0/755373677 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b040c84f0 0x7f7b04161610 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:37.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.057+0000 7f7b03e00640 1 -- 172.21.15.120:0/755373677 >> 172.21.15.120:0/755373677 conn(0x7f7b04069ec0 msgr2=0x7f7b0406a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:37.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.057+0000 7f7b03e00640 1 -- 172.21.15.120:0/755373677 shutdown_connections 2024-04-18T04:55:37.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.057+0000 7f7b03e00640 1 -- 172.21.15.120:0/755373677 wait complete. 2024-04-18T04:55:37.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.057+0000 7f7b03e00640 1 Processor -- start 2024-04-18T04:55:37.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.057+0000 7f7b03e00640 1 -- start start 2024-04-18T04:55:37.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.057+0000 7f7b03e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b040c8110 0x7f7b04146910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:37.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.057+0000 7f7b03e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b040c84f0 0x7f7b041403b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:37.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.061+0000 7f7b03e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7b04161b50 0x7f7b040cb280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:37.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.061+0000 7f7b03e00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b041408f0 con 0x7f7b040c84f0 2024-04-18T04:55:37.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.061+0000 7f7b03e00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0413f2a0 con 0x7f7b040c8110 2024-04-18T04:55:37.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.061+0000 7f7b03e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0413efd0 con 0x7f7b04161b50 2024-04-18T04:55:37.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.061+0000 7f7afbe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b040c84f0 0x7f7b041403b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:37.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.061+0000 7f7b03400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7b04161b50 0x7f7b040cb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:37.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.061+0000 7f7afbe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b040c84f0 0x7f7b041403b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53704/0 (socket says 172.21.15.120:53704) 2024-04-18T04:55:37.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.061+0000 7f7afbe00640 1 -- 172.21.15.120:0/3788940202 learned_addr learned my addr 172.21.15.120:0/3788940202 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:37.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.061+0000 7f7b02a00640 1 --2- 172.21.15.120:0/3788940202 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b040c8110 0x7f7b04146910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:37.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.061+0000 7f7afbe00640 1 -- 172.21.15.120:0/3788940202 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7b04161b50 msgr2=0x7f7b040cb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:37.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.061+0000 7f7afbe00640 1 --2- 172.21.15.120:0/3788940202 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7b04161b50 0x7f7b040cb280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:37.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.061+0000 7f7afbe00640 1 -- 172.21.15.120:0/3788940202 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b040c8110 msgr2=0x7f7b04146910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:37.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.061+0000 7f7afbe00640 1 --2- 172.21.15.120:0/3788940202 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b040c8110 0x7f7b04146910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:37.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.061+0000 7f7afbe00640 1 -- 172.21.15.120:0/3788940202 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aec0094d0 con 0x7f7b040c84f0 2024-04-18T04:55:37.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.061+0000 7f7afbe00640 1 --2- 172.21.15.120:0/3788940202 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b040c84f0 0x7f7b041403b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7aec01a140 tx=0x7f7aec01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:37.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.061+0000 7f7afaa00640 1 -- 172.21.15.120:0/3788940202 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aec0b3800 con 0x7f7b040c84f0 2024-04-18T04:55:37.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.061+0000 7f7afaa00640 1 -- 172.21.15.120:0/3788940202 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aec0b3960 con 0x7f7b040c84f0 2024-04-18T04:55:37.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.061+0000 7f7b03e00640 1 -- 172.21.15.120:0/3788940202 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b0413f4f0 con 0x7f7b040c84f0 2024-04-18T04:55:37.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.061+0000 7f7afaa00640 1 -- 172.21.15.120:0/3788940202 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aec0b3d10 con 0x7f7b040c84f0 2024-04-18T04:55:37.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.061+0000 7f7b03e00640 1 -- 172.21.15.120:0/3788940202 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b0413e980 con 0x7f7b040c84f0 2024-04-18T04:55:37.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.061+0000 7f7b03e00640 1 -- 172.21.15.120:0/3788940202 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b04140150 con 0x7f7b040c84f0 2024-04-18T04:55:37.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.061+0000 7f7afaa00640 1 -- 172.21.15.120:0/3788940202 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7aec0c6390 con 0x7f7b040c84f0 2024-04-18T04:55:37.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.065+0000 7f7afaa00640 1 --2- 172.21.15.120:0/3788940202 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7ae0066690 0x7f7ae0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:37.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.065+0000 7f7afaa00640 1 -- 172.21.15.120:0/3788940202 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f7aec11f320 con 0x7f7b040c84f0 2024-04-18T04:55:37.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.065+0000 7f7b02a00640 1 --2- 172.21.15.120:0/3788940202 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7ae0066690 0x7f7ae0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:37.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.065+0000 7f7b02a00640 1 --2- 172.21.15.120:0/3788940202 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7ae0066690 0x7f7ae0068b50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7af4007fd0 tx=0x7f7af4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:37.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.065+0000 7f7afaa00640 1 -- 172.21.15.120:0/3788940202 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f7aec0ec240 con 0x7f7b040c84f0 2024-04-18T04:55:37.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.229+0000 7f7b03e00640 1 -- 172.21.15.120:0/3788940202 --> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b04071990 con 0x7f7ae0066690 2024-04-18T04:55:37.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.229+0000 7f7afaa00640 1 -- 172.21.15.120:0/3788940202 <== mgr.4113 v2:172.21.15.132:6832/27788 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7af40014f0 con 0x7f7ae0066690 2024-04-18T04:55:37.228 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 6 to deep-scrub 2024-04-18T04:55:37.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.233+0000 7f7b03e00640 1 -- 172.21.15.120:0/3788940202 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7ae0066690 msgr2=0x7f7ae0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:37.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.233+0000 7f7b03e00640 1 --2- 172.21.15.120:0/3788940202 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7ae0066690 0x7f7ae0068b50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7af4007fd0 tx=0x7f7af4009040 comp rx=0 tx=0).stop 2024-04-18T04:55:37.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.233+0000 7f7b03e00640 1 -- 172.21.15.120:0/3788940202 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b040c84f0 msgr2=0x7f7b041403b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:37.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.233+0000 7f7b03e00640 1 --2- 172.21.15.120:0/3788940202 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b040c84f0 0x7f7b041403b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7aec01a140 tx=0x7f7aec01ad50 comp rx=0 tx=0).stop 2024-04-18T04:55:37.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.233+0000 7f7b03e00640 1 -- 172.21.15.120:0/3788940202 shutdown_connections 2024-04-18T04:55:37.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.233+0000 7f7b03e00640 1 --2- 172.21.15.120:0/3788940202 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7ae0066690 0x7f7ae0068b50 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:37.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.233+0000 7f7b03e00640 1 --2- 172.21.15.120:0/3788940202 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7b04161b50 0x7f7b040cb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:37.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.233+0000 7f7b03e00640 1 --2- 172.21.15.120:0/3788940202 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b040c84f0 0x7f7b041403b0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:37.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.233+0000 7f7b03e00640 1 --2- 172.21.15.120:0/3788940202 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b040c8110 0x7f7b04146910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:37.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.233+0000 7f7b03e00640 1 -- 172.21.15.120:0/3788940202 >> 172.21.15.120:0/3788940202 conn(0x7f7b04069ec0 msgr2=0x7f7b04065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:37.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.233+0000 7f7b03e00640 1 -- 172.21.15.120:0/3788940202 shutdown_connections 2024-04-18T04:55:37.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.233+0000 7f7b03e00640 1 -- 172.21.15.120:0/3788940202 wait complete. 2024-04-18T04:55:37.250 INFO:tasks.ceph:Scrubbing osd.7 2024-04-18T04:55:37.250 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-18T04:55:37.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.405+0000 7f5d9ea00640 1 Processor -- start 2024-04-18T04:55:37.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.405+0000 7f5d9ea00640 1 -- start start 2024-04-18T04:55:37.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.409+0000 7f5d9ea00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5d9806c680 0x7f5d9806bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:37.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.409+0000 7f5d9ea00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d980adf40 con 0x7f5d980c57c0 2024-04-18T04:55:37.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.409+0000 7f5d9ea00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d980b0480 con 0x7f5d980ae3d0 2024-04-18T04:55:37.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.409+0000 7f5d9ea00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d980ad930 con 0x7f5d9806c680 2024-04-18T04:55:37.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.409+0000 7f5d97400640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f5d980c57c0 0x7f5d9815a160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:54786/0 (socket says 172.21.15.120:54786) 2024-04-18T04:55:37.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.409+0000 7f5d97400640 1 -- 172.21.15.120:0/3748409649 learned_addr learned my addr 172.21.15.120:0/3748409649 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:55:37.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.409+0000 7f5d97e00640 1 --2- 172.21.15.120:0/3748409649 >> v2:172.21.15.132:3300/0 conn(0x7f5d9806c680 0x7f5d9806bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:37.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.409+0000 7f5d96a00640 1 -- 172.21.15.120:0/3748409649 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1278830913 0 0) 0x7f5d980adf40 con 0x7f5d980c57c0 2024-04-18T04:55:37.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.409+0000 7f5d96a00640 1 -- 172.21.15.120:0/3748409649 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d7c003530 con 0x7f5d980c57c0 2024-04-18T04:55:37.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.409+0000 7f5d97e00640 1 -- 172.21.15.120:0/3748409649 >> v1:172.21.15.132:6789/0 conn(0x7f5d980ae3d0 legacy=0x7f5d98069ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:37.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.409+0000 7f5d97e00640 1 -- 172.21.15.120:0/3748409649 >> v1:172.21.15.120:6789/0 conn(0x7f5d980c57c0 legacy=0x7f5d9815a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:37.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.409+0000 7f5d97e00640 1 -- 172.21.15.120:0/3748409649 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d980afec0 con 0x7f5d9806c680 2024-04-18T04:55:37.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.413+0000 7f5d97e00640 1 --2- 172.21.15.120:0/3748409649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d9806c680 0x7f5d9806bbe0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5d840097c0 tx=0x7f5d8401ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70abe4b587bab8c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:37.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.413+0000 7f5d96a00640 1 -- 172.21.15.120:0/3748409649 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d840a8990 con 0x7f5d9806c680 2024-04-18T04:55:37.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.437+0000 7f5d96a00640 1 -- 172.21.15.120:0/3748409649 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d840a8af0 con 0x7f5d9806c680 2024-04-18T04:55:37.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.437+0000 7f5d96a00640 1 -- 172.21.15.120:0/3748409649 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d840a8e60 con 0x7f5d9806c680 2024-04-18T04:55:37.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.441+0000 7f5d9ea00640 1 -- 172.21.15.120:0/3748409649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d9806c680 msgr2=0x7f5d9806bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:37.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.441+0000 7f5d9ea00640 1 --2- 172.21.15.120:0/3748409649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d9806c680 0x7f5d9806bbe0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5d840097c0 tx=0x7f5d8401ec90 comp rx=0 tx=0).stop 2024-04-18T04:55:37.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.441+0000 7f5d9ea00640 1 -- 172.21.15.120:0/3748409649 shutdown_connections 2024-04-18T04:55:37.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.441+0000 7f5d9ea00640 1 --2- 172.21.15.120:0/3748409649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d9806c680 0x7f5d9806bbe0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:37.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.441+0000 7f5d9ea00640 1 -- 172.21.15.120:0/3748409649 >> 172.21.15.120:0/3748409649 conn(0x7f5d980c79c0 msgr2=0x7f5d980c7da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:37.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.441+0000 7f5d9ea00640 1 -- 172.21.15.120:0/3748409649 shutdown_connections 2024-04-18T04:55:37.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.441+0000 7f5d9ea00640 1 -- 172.21.15.120:0/3748409649 wait complete. 2024-04-18T04:55:37.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.441+0000 7f5d9ea00640 1 Processor -- start 2024-04-18T04:55:37.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.441+0000 7f5d9ea00640 1 -- start start 2024-04-18T04:55:37.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.445+0000 7f5d9ea00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5d9806c680 0x7f5d980c1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:37.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.445+0000 7f5d9ea00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d980ae3d0 0x7f5d980c0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:37.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.445+0000 7f5d9ea00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d980c57c0 0x7f5d980c0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:37.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.445+0000 7f5d9ea00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d980c63f0 con 0x7f5d980ae3d0 2024-04-18T04:55:37.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.445+0000 7f5d9ea00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d981e6440 con 0x7f5d980c57c0 2024-04-18T04:55:37.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.445+0000 7f5d9ea00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d981ef980 con 0x7f5d9806c680 2024-04-18T04:55:37.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.445+0000 7f5d97400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d980ae3d0 0x7f5d980c0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:37.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.445+0000 7f5d97400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d980ae3d0 0x7f5d980c0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53712/0 (socket says 172.21.15.120:53712) 2024-04-18T04:55:37.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.445+0000 7f5d97400640 1 -- 172.21.15.120:0/2089806315 learned_addr learned my addr 172.21.15.120:0/2089806315 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:37.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.445+0000 7f5d97400640 1 -- 172.21.15.120:0/2089806315 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5d9806c680 msgr2=0x7f5d980c1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:37.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.445+0000 7f5d97400640 1 --2- 172.21.15.120:0/2089806315 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5d9806c680 0x7f5d980c1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:37.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.445+0000 7f5d97400640 1 -- 172.21.15.120:0/2089806315 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d980c57c0 msgr2=0x7f5d980c0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:37.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.445+0000 7f5d97400640 1 --2- 172.21.15.120:0/2089806315 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d980c57c0 0x7f5d980c0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:37.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.445+0000 7f5d97400640 1 -- 172.21.15.120:0/2089806315 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d84009420 con 0x7f5d980ae3d0 2024-04-18T04:55:37.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.445+0000 7f5d97400640 1 --2- 172.21.15.120:0/2089806315 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d980ae3d0 0x7f5d980c0820 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5d9000cbc0 tx=0x7f5d9000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:37.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.449+0000 7f5d8fe00640 1 -- 172.21.15.120:0/2089806315 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9000ad40 con 0x7f5d980ae3d0 2024-04-18T04:55:37.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.449+0000 7f5d8fe00640 1 -- 172.21.15.120:0/2089806315 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d90012400 con 0x7f5d980ae3d0 2024-04-18T04:55:37.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.449+0000 7f5d9ea00640 1 -- 172.21.15.120:0/2089806315 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d981efc60 con 0x7f5d980ae3d0 2024-04-18T04:55:37.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.449+0000 7f5d8fe00640 1 -- 172.21.15.120:0/2089806315 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9000aea0 con 0x7f5d980ae3d0 2024-04-18T04:55:37.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.449+0000 7f5d9ea00640 1 -- 172.21.15.120:0/2089806315 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d98153300 con 0x7f5d980ae3d0 2024-04-18T04:55:37.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.449+0000 7f5d9ea00640 1 -- 172.21.15.120:0/2089806315 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5d980ae860 con 0x7f5d980ae3d0 2024-04-18T04:55:37.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.457+0000 7f5d8fe00640 1 -- 172.21.15.120:0/2089806315 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5d90007070 con 0x7f5d980ae3d0 2024-04-18T04:55:37.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.457+0000 7f5d8fe00640 1 --2- 172.21.15.120:0/2089806315 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f5d78066760 0x7f5d78068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:37.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.457+0000 7f5d8fe00640 1 -- 172.21.15.120:0/2089806315 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f5d90084e10 con 0x7f5d980ae3d0 2024-04-18T04:55:37.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.457+0000 7f5d8fe00640 1 --2- 172.21.15.120:0/2089806315 >> [v2:172.21.15.132:6816/28129,v1:172.21.15.132:6817/28129] conn(0x7f5d78070450 0x7f5d780728f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:37.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.457+0000 7f5d8fe00640 1 -- 172.21.15.120:0/2089806315 --> [v2:172.21.15.132:6816/28129,v1:172.21.15.132:6817/28129] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5d78072fc0 con 0x7f5d78070450 2024-04-18T04:55:37.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.457+0000 7f5d8fe00640 1 -- 172.21.15.120:0/2089806315 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d900851c0 con 0x7f5d980ae3d0 2024-04-18T04:55:37.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.457+0000 7f5d9ca00640 1 --2- 172.21.15.120:0/2089806315 >> [v2:172.21.15.132:6816/28129,v1:172.21.15.132:6817/28129] conn(0x7f5d78070450 0x7f5d780728f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:37.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.457+0000 7f5d97e00640 1 --2- 172.21.15.120:0/2089806315 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f5d78066760 0x7f5d78068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:37.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.461+0000 7f5d9ca00640 1 --2- 172.21.15.120:0/2089806315 >> [v2:172.21.15.132:6816/28129,v1:172.21.15.132:6817/28129] conn(0x7f5d78070450 0x7f5d780728f0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:37.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.461+0000 7f5d97e00640 1 --2- 172.21.15.120:0/2089806315 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f5d78066760 0x7f5d78068c20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5d840b2000 tx=0x7f5d84004740 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:37.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.461+0000 7f5d8fe00640 1 -- 172.21.15.120:0/2089806315 <== osd.7 v2:172.21.15.132:6816/28129 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f5d78072fc0 con 0x7f5d78070450 2024-04-18T04:55:37.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.489+0000 7f5d9ea00640 1 -- 172.21.15.120:0/2089806315 --> [v2:172.21.15.132:6816/28129,v1:172.21.15.132:6817/28129] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5d980adbd0 con 0x7f5d78070450 2024-04-18T04:55:37.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.489+0000 7f5d8fe00640 1 -- 172.21.15.120:0/2089806315 <== osd.7 v2:172.21.15.132:6816/28129 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f5d880050b0 con 0x7f5d78070450 2024-04-18T04:55:37.486 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-18T04:55:37.486 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T04:55:37.486 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-18T04:55:37.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.489+0000 7f5d9ea00640 1 -- 172.21.15.120:0/2089806315 >> [v2:172.21.15.132:6816/28129,v1:172.21.15.132:6817/28129] conn(0x7f5d78070450 msgr2=0x7f5d780728f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:37.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.489+0000 7f5d9ea00640 1 --2- 172.21.15.120:0/2089806315 >> [v2:172.21.15.132:6816/28129,v1:172.21.15.132:6817/28129] conn(0x7f5d78070450 0x7f5d780728f0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:37.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.489+0000 7f5d9ea00640 1 -- 172.21.15.120:0/2089806315 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f5d78066760 msgr2=0x7f5d78068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:37.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.489+0000 7f5d9ea00640 1 --2- 172.21.15.120:0/2089806315 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f5d78066760 0x7f5d78068c20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5d840b2000 tx=0x7f5d84004740 comp rx=0 tx=0).stop 2024-04-18T04:55:37.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.489+0000 7f5d9ea00640 1 -- 172.21.15.120:0/2089806315 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d980ae3d0 msgr2=0x7f5d980c0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:37.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.489+0000 7f5d9ea00640 1 --2- 172.21.15.120:0/2089806315 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d980ae3d0 0x7f5d980c0820 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5d9000cbc0 tx=0x7f5d9000a430 comp rx=0 tx=0).stop 2024-04-18T04:55:37.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.489+0000 7f5d9ca00640 1 -- 172.21.15.120:0/2089806315 reap_dead start 2024-04-18T04:55:37.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.489+0000 7f5d9ea00640 1 -- 172.21.15.120:0/2089806315 shutdown_connections 2024-04-18T04:55:37.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.489+0000 7f5d9ea00640 1 -- 172.21.15.120:0/2089806315 >> 172.21.15.120:0/2089806315 conn(0x7f5d980c79c0 msgr2=0x7f5d98159160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:37.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.493+0000 7f5d9ea00640 1 -- 172.21.15.120:0/2089806315 shutdown_connections 2024-04-18T04:55:37.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.493+0000 7f5d9ea00640 1 -- 172.21.15.120:0/2089806315 wait complete. 2024-04-18T04:55:37.562 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-18T04:55:37.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.877+0000 7ffb9f200640 1 Processor -- start 2024-04-18T04:55:37.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.885+0000 7ffb9f200640 1 -- start start 2024-04-18T04:55:37.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.889+0000 7ffb9f200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb9000e2b0 0x7ffb900d4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:37.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.889+0000 7ffb9f200640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ffb90046d80 0x7ffb900d5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:37.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.889+0000 7ffb9f200640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb900dbd50 con 0x7ffb9004b270 2024-04-18T04:55:37.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.889+0000 7ffb9f200640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb900468f0 con 0x7ffb90046d80 2024-04-18T04:55:37.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.889+0000 7ffb9f200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb900dbab0 con 0x7ffb9000e2b0 2024-04-18T04:55:37.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.889+0000 7ffb97e00640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ffb9004b270 0x7ffb90005ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.120:39006/0 (socket says 172.21.15.120:39006) 2024-04-18T04:55:37.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.889+0000 7ffb97e00640 1 -- 172.21.15.120:0/17863878 learned_addr learned my addr 172.21.15.120:0/17863878 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:55:37.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.889+0000 7ffb97400640 1 --2- 172.21.15.120:0/17863878 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb9000e2b0 0x7ffb900d4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:37.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.889+0000 7ffb96a00640 1 -- 172.21.15.120:0/17863878 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2331083513 0 0) 0x7ffb900dbd50 con 0x7ffb9004b270 2024-04-18T04:55:37.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.889+0000 7ffb96a00640 1 -- 172.21.15.120:0/17863878 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb80003530 con 0x7ffb9004b270 2024-04-18T04:55:37.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.889+0000 7ffb96a00640 1 -- 172.21.15.120:0/17863878 <== mon.1 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1521243966 0 0) 0x7ffb80003530 con 0x7ffb9004b270 2024-04-18T04:55:37.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.889+0000 7ffb96a00640 1 -- 172.21.15.120:0/17863878 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb9000e2b0 msgr2=0x7ffb900d4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:37.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.889+0000 7ffb96a00640 1 --2- 172.21.15.120:0/17863878 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb9000e2b0 0x7ffb900d4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:37.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.889+0000 7ffb96a00640 1 -- 172.21.15.120:0/17863878 >> v2:172.21.15.132:3300/0 conn(0x7ffb90046d80 msgr2=0x7ffb900d5090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T04:55:37.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.889+0000 7ffb96a00640 1 --2- 172.21.15.120:0/17863878 >> v2:172.21.15.132:3300/0 conn(0x7ffb90046d80 0x7ffb900d5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:37.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.889+0000 7ffb96a00640 1 -- 172.21.15.120:0/17863878 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb90045fc0 con 0x7ffb9004b270 2024-04-18T04:55:37.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.889+0000 7ffb96a00640 1 -- 172.21.15.120:0/17863878 <== mon.1 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7ffb8c001680 con 0x7ffb9004b270 2024-04-18T04:55:37.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.889+0000 7ffb96a00640 1 -- 172.21.15.120:0/17863878 >> v1:172.21.15.132:6789/0 conn(0x7ffb9004b270 legacy=0x7ffb90005ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:37.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.889+0000 7ffb96a00640 1 --2- 172.21.15.120:0/17863878 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb80003980 0x7ffb80003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:37.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.889+0000 7ffb96a00640 1 --2- 172.21.15.120:0/17863878 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb9000e2b0 0x7ffb800047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:37.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.889+0000 7ffb96a00640 1 --2- 172.21.15.120:0/17863878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb80004d10 0x7ffb80005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:37.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.889+0000 7ffb96a00640 1 -- 172.21.15.120:0/17863878 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb900468f0 con 0x7ffb80003980 2024-04-18T04:55:37.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.889+0000 7ffb96a00640 1 -- 172.21.15.120:0/17863878 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb900dbab0 con 0x7ffb80004d10 2024-04-18T04:55:37.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.889+0000 7ffb96a00640 1 -- 172.21.15.120:0/17863878 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb80014380 con 0x7ffb9000e2b0 2024-04-18T04:55:37.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.893+0000 7ffb97e00640 1 --2- 172.21.15.120:0/17863878 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb80003980 0x7ffb80003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:37.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.893+0000 7ffb9d200640 1 --2- 172.21.15.120:0/17863878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb80004d10 0x7ffb80005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:37.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.893+0000 7ffb97400640 1 --2- 172.21.15.120:0/17863878 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb9000e2b0 0x7ffb800047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:37.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.893+0000 7ffb9d200640 1 -- 172.21.15.120:0/17863878 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb9000e2b0 msgr2=0x7ffb800047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:37.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.893+0000 7ffb9d200640 1 --2- 172.21.15.120:0/17863878 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb9000e2b0 0x7ffb800047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:37.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.893+0000 7ffb9d200640 1 -- 172.21.15.120:0/17863878 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb80003980 msgr2=0x7ffb80003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:37.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.893+0000 7ffb9d200640 1 --2- 172.21.15.120:0/17863878 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb80003980 0x7ffb80003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:37.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.893+0000 7ffb9d200640 1 -- 172.21.15.120:0/17863878 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb80003530 con 0x7ffb80004d10 2024-04-18T04:55:37.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.897+0000 7ffb9d200640 1 --2- 172.21.15.120:0/17863878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb80004d10 0x7ffb80005190 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ffb840097e0 tx=0x7ffb8401c2f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=909cc9488854a856 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:37.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.897+0000 7ffb96a00640 1 -- 172.21.15.120:0/17863878 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb840ab600 con 0x7ffb80004d10 2024-04-18T04:55:37.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.897+0000 7ffb96a00640 1 -- 172.21.15.120:0/17863878 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb840a7050 con 0x7ffb80004d10 2024-04-18T04:55:37.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.897+0000 7ffb96a00640 1 -- 172.21.15.120:0/17863878 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb840ab600 con 0x7ffb80004d10 2024-04-18T04:55:37.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.901+0000 7ffb9f200640 1 -- 172.21.15.120:0/17863878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb80004d10 msgr2=0x7ffb80005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:37.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.901+0000 7ffb9f200640 1 --2- 172.21.15.120:0/17863878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb80004d10 0x7ffb80005190 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ffb840097e0 tx=0x7ffb8401c2f0 comp rx=0 tx=0).stop 2024-04-18T04:55:37.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.901+0000 7ffb9d200640 1 -- 172.21.15.120:0/17863878 reap_dead start 2024-04-18T04:55:37.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.901+0000 7ffb9f200640 1 -- 172.21.15.120:0/17863878 shutdown_connections 2024-04-18T04:55:37.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.901+0000 7ffb9f200640 1 -- 172.21.15.120:0/17863878 >> 172.21.15.120:0/17863878 conn(0x7ffb90050190 msgr2=0x7ffb900505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:37.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.901+0000 7ffb9f200640 1 -- 172.21.15.120:0/17863878 shutdown_connections 2024-04-18T04:55:37.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.901+0000 7ffb9f200640 1 -- 172.21.15.120:0/17863878 wait complete. 2024-04-18T04:55:37.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.905+0000 7ffb9f200640 1 Processor -- start 2024-04-18T04:55:37.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.905+0000 7ffb9f200640 1 -- start start 2024-04-18T04:55:37.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.909+0000 7ffb9f200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb80004d10 0x7ffb901765e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:37.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.909+0000 7ffb9f200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb90049650 0x7ffb900cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:37.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.909+0000 7ffb9f200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb900d1a00 0x7ffb900cf940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:37.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.909+0000 7ffb9f200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb900d0b80 con 0x7ffb900d1a00 2024-04-18T04:55:37.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.909+0000 7ffb9f200640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb900cbe40 con 0x7ffb90049650 2024-04-18T04:55:37.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.909+0000 7ffb9f200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb900d1740 con 0x7ffb80004d10 2024-04-18T04:55:37.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.909+0000 7ffb97400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb90049650 0x7ffb900cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:37.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.909+0000 7ffb97400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb90049650 0x7ffb900cc2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.120:55300/0 (socket says 172.21.15.120:55300) 2024-04-18T04:55:37.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.909+0000 7ffb97400640 1 -- 172.21.15.120:0/1007113097 learned_addr learned my addr 172.21.15.120:0/1007113097 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:37.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.909+0000 7ffb9d200640 1 --2- 172.21.15.120:0/1007113097 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb900d1a00 0x7ffb900cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:37.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.909+0000 7ffb97400640 1 -- 172.21.15.120:0/1007113097 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb80004d10 msgr2=0x7ffb901765e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-18T04:55:37.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.909+0000 7ffb97400640 1 --2- 172.21.15.120:0/1007113097 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb80004d10 0x7ffb901765e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:37.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.909+0000 7ffb97400640 1 -- 172.21.15.120:0/1007113097 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb900d1a00 msgr2=0x7ffb900cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:37.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.909+0000 7ffb97400640 1 --2- 172.21.15.120:0/1007113097 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb900d1a00 0x7ffb900cf940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:37.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.909+0000 7ffb97400640 1 -- 172.21.15.120:0/1007113097 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb901774f0 con 0x7ffb90049650 2024-04-18T04:55:37.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.909+0000 7ffb97400640 1 --2- 172.21.15.120:0/1007113097 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb90049650 0x7ffb900cc2d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ffb9804fab0 tx=0x7ffb98067b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:37.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.913+0000 7ffb8be00640 1 -- 172.21.15.120:0/1007113097 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb98090070 con 0x7ffb90049650 2024-04-18T04:55:37.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.913+0000 7ffb8be00640 1 -- 172.21.15.120:0/1007113097 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb98091040 con 0x7ffb90049650 2024-04-18T04:55:37.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.913+0000 7ffb8be00640 1 -- 172.21.15.120:0/1007113097 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb98068380 con 0x7ffb90049650 2024-04-18T04:55:37.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.913+0000 7ffb9f200640 1 -- 172.21.15.120:0/1007113097 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb9004a0d0 con 0x7ffb90049650 2024-04-18T04:55:37.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.913+0000 7ffb9f200640 1 -- 172.21.15.120:0/1007113097 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb90176f30 con 0x7ffb90049650 2024-04-18T04:55:37.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.917+0000 7ffb9f200640 1 -- 172.21.15.120:0/1007113097 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb900053a0 con 0x7ffb90049650 2024-04-18T04:55:37.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.917+0000 7ffb8be00640 1 -- 172.21.15.120:0/1007113097 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ffb98096460 con 0x7ffb90049650 2024-04-18T04:55:37.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.917+0000 7ffb8be00640 1 --2- 172.21.15.120:0/1007113097 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ffb780666e0 0x7ffb78068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:37.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.921+0000 7ffb8be00640 1 -- 172.21.15.120:0/1007113097 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7ffb980fef40 con 0x7ffb90049650 2024-04-18T04:55:37.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.921+0000 7ffb97e00640 1 --2- 172.21.15.120:0/1007113097 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ffb780666e0 0x7ffb78068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:37.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.921+0000 7ffb97e00640 1 --2- 172.21.15.120:0/1007113097 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ffb780666e0 0x7ffb78068ba0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c001060 tx=0x7ffb8c000ff0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:37.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:37.929+0000 7ffb8be00640 1 -- 172.21.15.120:0/1007113097 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7ffb98130be0 con 0x7ffb90049650 2024-04-18T04:55:38.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.245+0000 7ffb9f200640 1 -- 172.21.15.120:0/1007113097 --> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb90045cc0 con 0x7ffb780666e0 2024-04-18T04:55:38.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.245+0000 7ffb8be00640 1 -- 172.21.15.120:0/1007113097 <== mgr.4113 v2:172.21.15.132:6832/27788 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ffb90045cc0 con 0x7ffb780666e0 2024-04-18T04:55:38.243 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 7 to deep-scrub 2024-04-18T04:55:38.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.249+0000 7ffb9f200640 1 -- 172.21.15.120:0/1007113097 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ffb780666e0 msgr2=0x7ffb78068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:38.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.249+0000 7ffb9f200640 1 --2- 172.21.15.120:0/1007113097 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ffb780666e0 0x7ffb78068ba0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c001060 tx=0x7ffb8c000ff0 comp rx=0 tx=0).stop 2024-04-18T04:55:38.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.249+0000 7ffb9f200640 1 -- 172.21.15.120:0/1007113097 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb90049650 msgr2=0x7ffb900cc2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:38.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.249+0000 7ffb9f200640 1 --2- 172.21.15.120:0/1007113097 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb90049650 0x7ffb900cc2d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ffb9804fab0 tx=0x7ffb98067b50 comp rx=0 tx=0).stop 2024-04-18T04:55:38.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.249+0000 7ffb9f200640 1 -- 172.21.15.120:0/1007113097 shutdown_connections 2024-04-18T04:55:38.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.249+0000 7ffb9f200640 1 --2- 172.21.15.120:0/1007113097 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ffb780666e0 0x7ffb78068ba0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:38.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.249+0000 7ffb9f200640 1 --2- 172.21.15.120:0/1007113097 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb900d1a00 0x7ffb900cf940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:38.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.249+0000 7ffb9f200640 1 --2- 172.21.15.120:0/1007113097 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb90049650 0x7ffb900cc2d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:38.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.249+0000 7ffb9f200640 1 --2- 172.21.15.120:0/1007113097 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb80004d10 0x7ffb901765e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:38.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.249+0000 7ffb9f200640 1 -- 172.21.15.120:0/1007113097 >> 172.21.15.120:0/1007113097 conn(0x7ffb90050190 msgr2=0x7ffb900d95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:38.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.249+0000 7ffb9f200640 1 -- 172.21.15.120:0/1007113097 shutdown_connections 2024-04-18T04:55:38.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.249+0000 7ffb9f200640 1 -- 172.21.15.120:0/1007113097 wait complete. 2024-04-18T04:55:38.270 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T04:55:38.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.413+0000 7fb10d000640 1 Processor -- start 2024-04-18T04:55:38.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.413+0000 7fb10d000640 1 -- start start 2024-04-18T04:55:38.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.417+0000 7fb10d000640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb108071c10 0x7fb108164e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:38.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.417+0000 7fb10d000640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1080c1580 con 0x7fb1080c0e80 2024-04-18T04:55:38.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.417+0000 7fb10d000640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1080c1cf0 con 0x7fb108071120 2024-04-18T04:55:38.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.417+0000 7fb10d000640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1080c6c30 con 0x7fb108071c10 2024-04-18T04:55:38.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.417+0000 7fb0ffe00640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fb1080c0e80 0x7fb108071500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:54800/0 (socket says 172.21.15.120:54800) 2024-04-18T04:55:38.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.417+0000 7fb0ffe00640 1 -- 172.21.15.120:0/3553488199 learned_addr learned my addr 172.21.15.120:0/3553488199 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:55:38.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.417+0000 7fb107e00640 1 --2- 172.21.15.120:0/3553488199 >> v2:172.21.15.132:3300/0 conn(0x7fb108071c10 0x7fb108164e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:38.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.417+0000 7fb106a00640 1 -- 172.21.15.120:0/3553488199 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3016565581 0 0) 0x7fb1080c1580 con 0x7fb1080c0e80 2024-04-18T04:55:38.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.417+0000 7fb106a00640 1 -- 172.21.15.120:0/3553488199 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0ec003530 con 0x7fb1080c0e80 2024-04-18T04:55:38.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.417+0000 7fb106a00640 1 -- 172.21.15.120:0/3553488199 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3379152388 0 0) 0x7fb0ec003530 con 0x7fb1080c0e80 2024-04-18T04:55:38.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.417+0000 7fb106a00640 1 -- 172.21.15.120:0/3553488199 >> v2:172.21.15.132:3300/0 conn(0x7fb108071c10 msgr2=0x7fb108164e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:38.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.417+0000 7fb106a00640 1 --2- 172.21.15.120:0/3553488199 >> v2:172.21.15.132:3300/0 conn(0x7fb108071c10 0x7fb108164e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:38.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.417+0000 7fb106a00640 1 -- 172.21.15.120:0/3553488199 >> v1:172.21.15.132:6789/0 conn(0x7fb108071120 legacy=0x7fb1080c6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:38.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.417+0000 7fb106a00640 1 -- 172.21.15.120:0/3553488199 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1080c1fb0 con 0x7fb1080c0e80 2024-04-18T04:55:38.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.417+0000 7fb106a00640 1 -- 172.21.15.120:0/3553488199 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7fb0f0001680 con 0x7fb1080c0e80 2024-04-18T04:55:38.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.417+0000 7fb106a00640 1 -- 172.21.15.120:0/3553488199 >> v1:172.21.15.120:6789/0 conn(0x7fb1080c0e80 legacy=0x7fb108071500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:38.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.417+0000 7fb106a00640 1 --2- 172.21.15.120:0/3553488199 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0ec003980 0x7fb0ec003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:38.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.417+0000 7fb106a00640 1 --2- 172.21.15.120:0/3553488199 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0ec0047d0 0x7fb0ec004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:38.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.417+0000 7fb106a00640 1 --2- 172.21.15.120:0/3553488199 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb0ec005190 0x7fb0ec00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:38.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.417+0000 7fb106a00640 1 -- 172.21.15.120:0/3553488199 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1080c6c30 con 0x7fb0ec003980 2024-04-18T04:55:38.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.417+0000 7fb106a00640 1 -- 172.21.15.120:0/3553488199 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ec00c040 con 0x7fb0ec0047d0 2024-04-18T04:55:38.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.417+0000 7fb106a00640 1 -- 172.21.15.120:0/3553488199 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ec00c200 con 0x7fb0ec005190 2024-04-18T04:55:38.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.417+0000 7fb107400640 1 --2- 172.21.15.120:0/3553488199 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0ec003980 0x7fb0ec003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:38.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.417+0000 7fb0ffe00640 1 --2- 172.21.15.120:0/3553488199 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0ec0047d0 0x7fb0ec004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:38.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.417+0000 7fb107e00640 1 --2- 172.21.15.120:0/3553488199 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb0ec005190 0x7fb0ec00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:38.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.417+0000 7fb107400640 1 -- 172.21.15.120:0/3553488199 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb0ec005190 msgr2=0x7fb0ec00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:38.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.417+0000 7fb107400640 1 --2- 172.21.15.120:0/3553488199 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb0ec005190 0x7fb0ec00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:38.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.417+0000 7fb107400640 1 -- 172.21.15.120:0/3553488199 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0ec0047d0 msgr2=0x7fb0ec004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:38.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.417+0000 7fb107400640 1 --2- 172.21.15.120:0/3553488199 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0ec0047d0 0x7fb0ec004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:38.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.417+0000 7fb107400640 1 -- 172.21.15.120:0/3553488199 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ec003530 con 0x7fb0ec003980 2024-04-18T04:55:38.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.417+0000 7fb107e00640 1 --2- 172.21.15.120:0/3553488199 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb0ec005190 0x7fb0ec00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:55:38.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.417+0000 7fb107e00640 1 -- 172.21.15.120:0/3553488199 reap_dead start 2024-04-18T04:55:38.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.421+0000 7fb107400640 1 --2- 172.21.15.120:0/3553488199 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0ec003980 0x7fb0ec003da0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8001780 tx=0x7fb0f801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f757ddeb75fe162 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:38.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.421+0000 7fb106a00640 1 -- 172.21.15.120:0/3553488199 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f80052d0 con 0x7fb0ec003980 2024-04-18T04:55:38.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.421+0000 7fb106a00640 1 -- 172.21.15.120:0/3553488199 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f80a7050 con 0x7fb0ec003980 2024-04-18T04:55:38.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.421+0000 7fb106a00640 1 -- 172.21.15.120:0/3553488199 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f8003600 con 0x7fb0ec003980 2024-04-18T04:55:38.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.421+0000 7fb10d000640 1 -- 172.21.15.120:0/3553488199 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0ec003980 msgr2=0x7fb0ec003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:38.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.421+0000 7fb10d000640 1 --2- 172.21.15.120:0/3553488199 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0ec003980 0x7fb0ec003da0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8001780 tx=0x7fb0f801c400 comp rx=0 tx=0).stop 2024-04-18T04:55:38.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.421+0000 7fb10d000640 1 -- 172.21.15.120:0/3553488199 shutdown_connections 2024-04-18T04:55:38.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.421+0000 7fb10d000640 1 --2- 172.21.15.120:0/3553488199 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0ec003980 0x7fb0ec003da0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:38.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.421+0000 7fb10d000640 1 -- 172.21.15.120:0/3553488199 >> 172.21.15.120:0/3553488199 conn(0x7fb1080c8620 msgr2=0x7fb1080c8a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:38.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.421+0000 7fb10d000640 1 -- 172.21.15.120:0/3553488199 shutdown_connections 2024-04-18T04:55:38.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.421+0000 7fb10d000640 1 -- 172.21.15.120:0/3553488199 wait complete. 2024-04-18T04:55:38.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.421+0000 7fb10d000640 1 Processor -- start 2024-04-18T04:55:38.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.421+0000 7fb10d000640 1 -- start start 2024-04-18T04:55:38.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.425+0000 7fb10d000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0ec003980 0x7fb1081526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:38.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.425+0000 7fb10d000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb1081efbf0 0x7fb1081e2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:38.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.425+0000 7fb10d000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb10814ed90 0x7fb10814c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:38.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.425+0000 7fb10d000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1081f3050 con 0x7fb0ec003980 2024-04-18T04:55:38.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.425+0000 7fb10d000640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1081f2740 con 0x7fb10814ed90 2024-04-18T04:55:38.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.425+0000 7fb10d000640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb108152d80 con 0x7fb1081efbf0 2024-04-18T04:55:38.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.425+0000 7fb107400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0ec003980 0x7fb1081526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:38.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.425+0000 7fb107400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0ec003980 0x7fb1081526f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53754/0 (socket says 172.21.15.120:53754) 2024-04-18T04:55:38.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.425+0000 7fb107400640 1 -- 172.21.15.120:0/2075470081 learned_addr learned my addr 172.21.15.120:0/2075470081 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:38.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.425+0000 7fb0ffe00640 1 --2- 172.21.15.120:0/2075470081 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb1081efbf0 0x7fb1081e2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:38.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.425+0000 7fb107e00640 1 --2- 172.21.15.120:0/2075470081 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb10814ed90 0x7fb10814c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:38.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.425+0000 7fb107400640 1 -- 172.21.15.120:0/2075470081 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb1081efbf0 msgr2=0x7fb1081e2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:38.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.425+0000 7fb107400640 1 --2- 172.21.15.120:0/2075470081 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb1081efbf0 0x7fb1081e2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:38.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.425+0000 7fb107400640 1 -- 172.21.15.120:0/2075470081 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb10814ed90 msgr2=0x7fb10814c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:38.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.425+0000 7fb107400640 1 --2- 172.21.15.120:0/2075470081 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb10814ed90 0x7fb10814c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:38.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.425+0000 7fb107400640 1 -- 172.21.15.120:0/2075470081 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1081f0050 con 0x7fb0ec003980 2024-04-18T04:55:38.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.425+0000 7fb0ffe00640 1 --2- 172.21.15.120:0/2075470081 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb1081efbf0 0x7fb1081e2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:55:38.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.425+0000 7fb107e00640 1 --2- 172.21.15.120:0/2075470081 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb10814ed90 0x7fb10814c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:55:38.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.425+0000 7fb107400640 1 --2- 172.21.15.120:0/2075470081 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0ec003980 0x7fb1081526f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb0f801c230 tx=0x7fb0ec005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:38.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.425+0000 7fb0ff400640 1 -- 172.21.15.120:0/2075470081 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f8003e40 con 0x7fb0ec003980 2024-04-18T04:55:38.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.425+0000 7fb0ff400640 1 -- 172.21.15.120:0/2075470081 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f8007030 con 0x7fb0ec003980 2024-04-18T04:55:38.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.425+0000 7fb10d000640 1 -- 172.21.15.120:0/2075470081 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb108153040 con 0x7fb0ec003980 2024-04-18T04:55:38.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.425+0000 7fb0ff400640 1 -- 172.21.15.120:0/2075470081 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f80073c0 con 0x7fb0ec003980 2024-04-18T04:55:38.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.425+0000 7fb10d000640 1 -- 172.21.15.120:0/2075470081 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1081f2c70 con 0x7fb0ec003980 2024-04-18T04:55:38.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.425+0000 7fb10d000640 1 -- 172.21.15.120:0/2075470081 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1080728f0 con 0x7fb0ec003980 2024-04-18T04:55:38.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.429+0000 7fb0ff400640 1 -- 172.21.15.120:0/2075470081 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb0f8007520 con 0x7fb0ec003980 2024-04-18T04:55:38.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.429+0000 7fb0ff400640 1 --2- 172.21.15.120:0/2075470081 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb0e40666c0 0x7fb0e4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:38.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.429+0000 7fb0ff400640 1 -- 172.21.15.120:0/2075470081 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7fb0f811eba0 con 0x7fb0ec003980 2024-04-18T04:55:38.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.429+0000 7fb0ffe00640 1 --2- 172.21.15.120:0/2075470081 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb0e40666c0 0x7fb0e4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:38.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.429+0000 7fb0ffe00640 1 --2- 172.21.15.120:0/2075470081 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb0e40666c0 0x7fb0e4068b80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb10806cc50 tx=0x7fb0f0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:38.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.437+0000 7fb0ff400640 1 -- 172.21.15.120:0/2075470081 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fb0f80eb900 con 0x7fb0ec003980 2024-04-18T04:55:38.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.593+0000 7fb10d000640 1 -- 172.21.15.120:0/2075470081 --> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb108159db0 con 0x7fb0e40666c0 2024-04-18T04:55:38.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.621+0000 7fb0ff400640 1 -- 172.21.15.120:0/2075470081 <== mgr.4113 v2:172.21.15.132:6832/27788 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+369652 (secure 0 0 0) 0x7fb0f0013870 con 0x7fb0e40666c0 2024-04-18T04:55:38.623 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:55:38.625 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-04-18T04:55:38.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.625+0000 7fb10d000640 1 -- 172.21.15.120:0/2075470081 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb0e40666c0 msgr2=0x7fb0e4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:38.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.625+0000 7fb10d000640 1 --2- 172.21.15.120:0/2075470081 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb0e40666c0 0x7fb0e4068b80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb10806cc50 tx=0x7fb0f0009040 comp rx=0 tx=0).stop 2024-04-18T04:55:38.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.625+0000 7fb10d000640 1 -- 172.21.15.120:0/2075470081 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0ec003980 msgr2=0x7fb1081526f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:38.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.625+0000 7fb10d000640 1 --2- 172.21.15.120:0/2075470081 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0ec003980 0x7fb1081526f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb0f801c230 tx=0x7fb0ec005800 comp rx=0 tx=0).stop 2024-04-18T04:55:38.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.625+0000 7fb10d000640 1 -- 172.21.15.120:0/2075470081 shutdown_connections 2024-04-18T04:55:38.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.625+0000 7fb10d000640 1 --2- 172.21.15.120:0/2075470081 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fb0e40666c0 0x7fb0e4068b80 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:38.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.625+0000 7fb10d000640 1 --2- 172.21.15.120:0/2075470081 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb10814ed90 0x7fb10814c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:38.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.625+0000 7fb10d000640 1 --2- 172.21.15.120:0/2075470081 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb1081efbf0 0x7fb1081e2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:38.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.625+0000 7fb10d000640 1 --2- 172.21.15.120:0/2075470081 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0ec003980 0x7fb1081526f0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:38.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.625+0000 7fb10d000640 1 -- 172.21.15.120:0/2075470081 >> 172.21.15.120:0/2075470081 conn(0x7fb1080c8620 msgr2=0x7fb108071500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:38.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.625+0000 7fb10d000640 1 -- 172.21.15.120:0/2075470081 shutdown_connections 2024-04-18T04:55:38.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:38.625+0000 7fb10d000640 1 -- 172.21.15.120:0/2075470081 wait complete. 2024-04-18T04:55:38.644 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":366,"stamp":"2024-04-18T04:55:37.054893+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1947141019,"num_objects":728,"num_object_clones":0,"num_object_copies":2730,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":728,"num_whiteouts":0,"num_read":667,"num_read_kb":75003,"num_write":2198111,"num_write_kb":31245688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153338,"ondisk_log_size":153338,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8085364,"kb_used_data":2132104,"kb_used_omap":12,"kb_used_meta":5948659,"kb_avail":746889356,"statfs":{"total":773094113280,"available":764814700544,"internally_reserved":0,"allocated":2183274496,"data_stored":4713271074,"data_compressed":278467487,"data_compressed_allocated":1015795712,"data_compressed_original":3547492352,"omap_allocated":12743,"internal_metadata":6091427385},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,1,1,6],"upper_bound":128},"perf_stat":{"commit_latency_ms":83,"apply_latency_ms":83,"commit_latency_ns":83000000,"apply_latency_ns":83000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5804915598,"num_objects":-1384,"num_object_clones":0,"num_object_copies":-5536,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1384,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1388,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004692"},"pg_stats":[{"pgid":"2.1f","version":"32'25","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:34.453339+0000","last_change":"2024-04-18T04:55:34.453464+0000","last_active":"2024-04-18T04:55:34.453339+0000","last_peered":"2024-04-18T04:55:34.453339+0000","last_clean":"2024-04-18T04:55:34.453339+0000","last_became_active":"2024-04-18T04:44:29.890853+0000","last_became_peered":"2024-04-18T04:44:29.890853+0000","last_unstale":"2024-04-18T04:55:34.453339+0000","last_undegraded":"2024-04-18T04:55:34.453339+0000","last_fullsized":"2024-04-18T04:55:34.453339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2024-04-18T04:55:34.453305+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2024-04-18T04:55:34.453305+0000","last_clean_scrub_stamp":"2024-04-18T04:55:34.453305+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:34:55.135020+0000","scrub_duration":0.023886489,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":4124,"num_write":18,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"32'6","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.524904+0000","last_change":"2024-04-18T04:44:30.296344+0000","last_active":"2024-04-18T04:55:26.524904+0000","last_peered":"2024-04-18T04:55:26.524904+0000","last_clean":"2024-04-18T04:55:26.524904+0000","last_became_active":"2024-04-18T04:44:30.296064+0000","last_became_peered":"2024-04-18T04:44:30.296064+0000","last_unstale":"2024-04-18T04:55:26.524904+0000","last_undegraded":"2024-04-18T04:55:26.524904+0000","last_fullsized":"2024-04-18T04:55:26.524904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'3961","reported_seq":3986,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:36.127851+0000","last_change":"2024-04-18T04:44:34.306605+0000","last_active":"2024-04-18T04:55:36.127851+0000","last_peered":"2024-04-18T04:55:36.127851+0000","last_clean":"2024-04-18T04:55:36.127851+0000","last_became_active":"2024-04-18T04:44:34.306224+0000","last_became_peered":"2024-04-18T04:44:34.306224+0000","last_unstale":"2024-04-18T04:55:36.127851+0000","last_undegraded":"2024-04-18T04:55:36.127851+0000","last_fullsized":"2024-04-18T04:55:36.127851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":3961,"log_dups_size":0,"ondisk_log_size":3961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21153999,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":58079,"num_write_kb":822950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'23","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:46.162227+0000","last_change":"2024-04-18T04:44:29.881521+0000","last_active":"2024-04-18T04:54:46.162227+0000","last_peered":"2024-04-18T04:54:46.162227+0000","last_clean":"2024-04-18T04:54:46.162227+0000","last_became_active":"2024-04-18T04:44:29.881258+0000","last_became_peered":"2024-04-18T04:44:29.881258+0000","last_unstale":"2024-04-18T04:54:46.162227+0000","last_undegraded":"2024-04-18T04:54:46.162227+0000","last_fullsized":"2024-04-18T04:54:46.162227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":19,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'6","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:46.514814+0000","last_change":"2024-04-18T04:44:30.314205+0000","last_active":"2024-04-18T04:54:46.514814+0000","last_peered":"2024-04-18T04:54:46.514814+0000","last_clean":"2024-04-18T04:54:46.514814+0000","last_became_active":"2024-04-18T04:44:30.313987+0000","last_became_peered":"2024-04-18T04:44:30.313987+0000","last_unstale":"2024-04-18T04:54:46.514814+0000","last_undegraded":"2024-04-18T04:54:46.514814+0000","last_fullsized":"2024-04-18T04:54:46.514814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"32'5298","reported_seq":5326,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:32.370877+0000","last_change":"2024-04-18T04:44:34.339646+0000","last_active":"2024-04-18T04:55:32.370877+0000","last_peered":"2024-04-18T04:55:32.370877+0000","last_clean":"2024-04-18T04:55:32.370877+0000","last_became_active":"2024-04-18T04:44:34.338485+0000","last_became_peered":"2024-04-18T04:44:34.338485+0000","last_unstale":"2024-04-18T04:55:32.370877+0000","last_undegraded":"2024-04-18T04:55:32.370877+0000","last_fullsized":"2024-04-18T04:55:32.370877+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":5298,"log_dups_size":0,"ondisk_log_size":5298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:47:01.277301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97112586,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":77985,"num_write_kb":1107856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"32'74","reported_seq":106,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:32.488186+0000","last_change":"2024-04-18T04:44:29.897785+0000","last_active":"2024-04-18T04:54:32.488186+0000","last_peered":"2024-04-18T04:54:32.488186+0000","last_clean":"2024-04-18T04:54:32.488186+0000","last_became_active":"2024-04-18T04:44:29.896520+0000","last_became_peered":"2024-04-18T04:44:29.896520+0000","last_unstale":"2024-04-18T04:54:32.488186+0000","last_undegraded":"2024-04-18T04:54:32.488186+0000","last_fullsized":"2024-04-18T04:54:32.488186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:25:52.871139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":14,"num_read_kb":8212,"num_write":66,"num_write_kb":8229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"32'9","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:20.586531+0000","last_change":"2024-04-18T04:44:30.300588+0000","last_active":"2024-04-18T04:55:20.586531+0000","last_peered":"2024-04-18T04:55:20.586531+0000","last_clean":"2024-04-18T04:55:20.586531+0000","last_became_active":"2024-04-18T04:44:30.299939+0000","last_became_peered":"2024-04-18T04:44:30.299939+0000","last_unstale":"2024-04-18T04:55:20.586531+0000","last_undegraded":"2024-04-18T04:55:20.586531+0000","last_fullsized":"2024-04-18T04:55:20.586531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:57:07.547985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"32'4890","reported_seq":4915,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:33.572129+0000","last_change":"2024-04-18T04:44:34.338794+0000","last_active":"2024-04-18T04:55:33.572129+0000","last_peered":"2024-04-18T04:55:33.572129+0000","last_clean":"2024-04-18T04:55:33.572129+0000","last_became_active":"2024-04-18T04:44:34.337938+0000","last_became_peered":"2024-04-18T04:44:34.337938+0000","last_unstale":"2024-04-18T04:55:33.572129+0000","last_undegraded":"2024-04-18T04:55:33.572129+0000","last_fullsized":"2024-04-18T04:55:33.572129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4890,"log_dups_size":0,"ondisk_log_size":4890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:48.827970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92279804,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":72213,"num_write_kb":1012843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"32'88","reported_seq":116,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:20.710432+0000","last_change":"2024-04-18T04:44:29.903118+0000","last_active":"2024-04-18T04:55:20.710432+0000","last_peered":"2024-04-18T04:55:20.710432+0000","last_clean":"2024-04-18T04:55:20.710432+0000","last_became_active":"2024-04-18T04:44:29.902611+0000","last_became_peered":"2024-04-18T04:44:29.902611+0000","last_unstale":"2024-04-18T04:55:20.710432+0000","last_undegraded":"2024-04-18T04:55:20.710432+0000","last_fullsized":"2024-04-18T04:55:20.710432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:38:42.595095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":87,"num_write_kb":1391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"28'15","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.060272+0000","last_change":"2024-04-18T04:44:30.301328+0000","last_active":"2024-04-18T04:53:26.060272+0000","last_peered":"2024-04-18T04:53:26.060272+0000","last_clean":"2024-04-18T04:53:26.060272+0000","last_became_active":"2024-04-18T04:44:30.300303+0000","last_became_peered":"2024-04-18T04:44:30.300303+0000","last_unstale":"2024-04-18T04:53:26.060272+0000","last_undegraded":"2024-04-18T04:53:26.060272+0000","last_fullsized":"2024-04-18T04:53:26.060272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:24:11.941483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'4556","reported_seq":4584,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:33.517367+0000","last_change":"2024-04-18T04:44:34.327044+0000","last_active":"2024-04-18T04:55:33.517367+0000","last_peered":"2024-04-18T04:55:33.517367+0000","last_clean":"2024-04-18T04:55:33.517367+0000","last_became_active":"2024-04-18T04:44:34.326161+0000","last_became_peered":"2024-04-18T04:44:34.326161+0000","last_unstale":"2024-04-18T04:55:33.517367+0000","last_undegraded":"2024-04-18T04:55:33.517367+0000","last_fullsized":"2024-04-18T04:55:33.517367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4556,"log_dups_size":0,"ondisk_log_size":4556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:47:41.413530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58762828,"num_objects":20,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":5,"num_read_kb":1,"num_write":67025,"num_write_kb":936790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"32'7","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:23.715382+0000","last_change":"2024-04-18T04:44:30.296493+0000","last_active":"2024-04-18T04:55:23.715382+0000","last_peered":"2024-04-18T04:55:23.715382+0000","last_clean":"2024-04-18T04:55:23.715382+0000","last_became_active":"2024-04-18T04:44:30.295657+0000","last_became_peered":"2024-04-18T04:44:30.295657+0000","last_unstale":"2024-04-18T04:55:23.715382+0000","last_undegraded":"2024-04-18T04:55:23.715382+0000","last_fullsized":"2024-04-18T04:55:23.715382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:39:40.270643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"32'980","reported_seq":1012,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:09.820948+0000","last_change":"2024-04-18T04:44:29.900036+0000","last_active":"2024-04-18T04:55:09.820948+0000","last_peered":"2024-04-18T04:55:09.820948+0000","last_clean":"2024-04-18T04:55:09.820948+0000","last_became_active":"2024-04-18T04:44:29.899402+0000","last_became_peered":"2024-04-18T04:44:29.899402+0000","last_unstale":"2024-04-18T04:55:09.820948+0000","last_undegraded":"2024-04-18T04:55:09.820948+0000","last_fullsized":"2024-04-18T04:55:09.820948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":980,"log_dups_size":0,"ondisk_log_size":980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:45:51.681317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":4110,"num_write":977,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"32'4755","reported_seq":4783,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:33.617209+0000","last_change":"2024-04-18T04:44:34.320846+0000","last_active":"2024-04-18T04:55:33.617209+0000","last_peered":"2024-04-18T04:55:33.617209+0000","last_clean":"2024-04-18T04:55:33.617209+0000","last_became_active":"2024-04-18T04:44:34.319868+0000","last_became_peered":"2024-04-18T04:44:34.319868+0000","last_unstale":"2024-04-18T04:55:33.617209+0000","last_undegraded":"2024-04-18T04:55:33.617209+0000","last_fullsized":"2024-04-18T04:55:33.617209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4755,"log_dups_size":0,"ondisk_log_size":4755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:08:30.863140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71310142,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":69864,"num_write_kb":985071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"32'5","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:23.854011+0000","last_change":"2024-04-18T04:44:30.271756+0000","last_active":"2024-04-18T04:55:23.854011+0000","last_peered":"2024-04-18T04:55:23.854011+0000","last_clean":"2024-04-18T04:55:23.854011+0000","last_became_active":"2024-04-18T04:44:30.271420+0000","last_became_peered":"2024-04-18T04:44:30.271420+0000","last_unstale":"2024-04-18T04:55:23.854011+0000","last_undegraded":"2024-04-18T04:55:23.854011+0000","last_fullsized":"2024-04-18T04:55:23.854011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"32'5","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:23.588306+0000","last_change":"2024-04-18T04:44:29.878416+0000","last_active":"2024-04-18T04:54:23.588306+0000","last_peered":"2024-04-18T04:54:23.588306+0000","last_clean":"2024-04-18T04:54:23.588306+0000","last_became_active":"2024-04-18T04:44:29.878139+0000","last_became_peered":"2024-04-18T04:44:29.878139+0000","last_unstale":"2024-04-18T04:54:23.588306+0000","last_undegraded":"2024-04-18T04:54:23.588306+0000","last_fullsized":"2024-04-18T04:54:23.588306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:19:00.769888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"32'4623","reported_seq":4648,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:33.170423+0000","last_change":"2024-04-18T04:44:34.346123+0000","last_active":"2024-04-18T04:55:33.170423+0000","last_peered":"2024-04-18T04:55:33.170423+0000","last_clean":"2024-04-18T04:55:33.170423+0000","last_became_active":"2024-04-18T04:44:34.345267+0000","last_became_peered":"2024-04-18T04:44:34.345267+0000","last_unstale":"2024-04-18T04:55:33.170423+0000","last_undegraded":"2024-04-18T04:55:33.170423+0000","last_fullsized":"2024-04-18T04:55:33.170423+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4623,"log_dups_size":0,"ondisk_log_size":4623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:14:08.078650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96482133,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":68107,"num_write_kb":992962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"32'7","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:24.401126+0000","last_change":"2024-04-18T04:44:30.274049+0000","last_active":"2024-04-18T04:55:24.401126+0000","last_peered":"2024-04-18T04:55:24.401126+0000","last_clean":"2024-04-18T04:55:24.401126+0000","last_became_active":"2024-04-18T04:44:30.273752+0000","last_became_peered":"2024-04-18T04:44:30.273752+0000","last_unstale":"2024-04-18T04:55:24.401126+0000","last_undegraded":"2024-04-18T04:55:24.401126+0000","last_fullsized":"2024-04-18T04:55:24.401126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'6","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:24.359306+0000","last_change":"2024-04-18T04:44:29.890569+0000","last_active":"2024-04-18T04:54:24.359306+0000","last_peered":"2024-04-18T04:54:24.359306+0000","last_clean":"2024-04-18T04:54:24.359306+0000","last_became_active":"2024-04-18T04:44:29.889684+0000","last_became_peered":"2024-04-18T04:44:29.889684+0000","last_unstale":"2024-04-18T04:54:24.359306+0000","last_undegraded":"2024-04-18T04:54:24.359306+0000","last_fullsized":"2024-04-18T04:54:24.359306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:53:00.230580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":8,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"32'4595","reported_seq":4620,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:32.097432+0000","last_change":"2024-04-18T04:44:34.313634+0000","last_active":"2024-04-18T04:55:32.097432+0000","last_peered":"2024-04-18T04:55:32.097432+0000","last_clean":"2024-04-18T04:55:32.097432+0000","last_became_active":"2024-04-18T04:44:34.313161+0000","last_became_peered":"2024-04-18T04:44:34.313161+0000","last_unstale":"2024-04-18T04:55:32.097432+0000","last_undegraded":"2024-04-18T04:55:32.097432+0000","last_fullsized":"2024-04-18T04:55:32.097432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4595,"log_dups_size":0,"ondisk_log_size":4595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:01:07.805128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88085688,"num_objects":25,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":67658,"num_write_kb":962979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'1","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.071440+0000","last_change":"2024-04-18T04:44:30.284805+0000","last_active":"2024-04-18T04:53:26.071440+0000","last_peered":"2024-04-18T04:53:26.071440+0000","last_clean":"2024-04-18T04:53:26.071440+0000","last_became_active":"2024-04-18T04:44:30.279238+0000","last_became_peered":"2024-04-18T04:44:30.279238+0000","last_unstale":"2024-04-18T04:53:26.071440+0000","last_undegraded":"2024-04-18T04:53:26.071440+0000","last_fullsized":"2024-04-18T04:53:26.071440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:59:24.067420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"30'20","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:24.361610+0000","last_change":"2024-04-18T04:44:29.890816+0000","last_active":"2024-04-18T04:54:24.361610+0000","last_peered":"2024-04-18T04:54:24.361610+0000","last_clean":"2024-04-18T04:54:24.361610+0000","last_became_active":"2024-04-18T04:44:29.890272+0000","last_became_peered":"2024-04-18T04:44:29.890272+0000","last_unstale":"2024-04-18T04:54:24.361610+0000","last_undegraded":"2024-04-18T04:54:24.361610+0000","last_fullsized":"2024-04-18T04:54:24.361610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:30:22.614083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":4108,"num_write":18,"num_write_kb":4103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"32'4397","reported_seq":4422,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:33.875217+0000","last_change":"2024-04-18T04:44:34.344973+0000","last_active":"2024-04-18T04:55:33.875217+0000","last_peered":"2024-04-18T04:55:33.875217+0000","last_clean":"2024-04-18T04:55:33.875217+0000","last_became_active":"2024-04-18T04:44:34.344007+0000","last_became_peered":"2024-04-18T04:44:34.344007+0000","last_unstale":"2024-04-18T04:55:33.875217+0000","last_undegraded":"2024-04-18T04:55:33.875217+0000","last_fullsized":"2024-04-18T04:55:33.875217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4397,"log_dups_size":0,"ondisk_log_size":4397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:56:43.476132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79945636,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":64562,"num_write_kb":921811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"32'10","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:32.549043+0000","last_change":"2024-04-18T04:44:30.278193+0000","last_active":"2024-04-18T04:55:32.549043+0000","last_peered":"2024-04-18T04:55:32.549043+0000","last_clean":"2024-04-18T04:55:32.549043+0000","last_became_active":"2024-04-18T04:44:30.277916+0000","last_became_peered":"2024-04-18T04:44:30.277916+0000","last_unstale":"2024-04-18T04:55:32.549043+0000","last_undegraded":"2024-04-18T04:55:32.549043+0000","last_fullsized":"2024-04-18T04:55:32.549043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:23.867186+0000","last_change":"2024-04-18T04:44:29.896901+0000","last_active":"2024-04-18T04:54:23.867186+0000","last_peered":"2024-04-18T04:54:23.867186+0000","last_clean":"2024-04-18T04:54:23.867186+0000","last_became_active":"2024-04-18T04:44:29.896392+0000","last_became_peered":"2024-04-18T04:44:29.896392+0000","last_unstale":"2024-04-18T04:54:23.867186+0000","last_undegraded":"2024-04-18T04:54:23.867186+0000","last_fullsized":"2024-04-18T04:54:23.867186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:46:08.869450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"32'4445","reported_seq":4470,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:33.826470+0000","last_change":"2024-04-18T04:44:34.339233+0000","last_active":"2024-04-18T04:55:33.826470+0000","last_peered":"2024-04-18T04:55:33.826470+0000","last_clean":"2024-04-18T04:55:33.826470+0000","last_became_active":"2024-04-18T04:44:34.338294+0000","last_became_peered":"2024-04-18T04:44:34.338294+0000","last_unstale":"2024-04-18T04:55:33.826470+0000","last_undegraded":"2024-04-18T04:55:33.826470+0000","last_fullsized":"2024-04-18T04:55:33.826470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4445,"log_dups_size":0,"ondisk_log_size":4445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:20:35.738410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71455400,"num_objects":25,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":65546,"num_write_kb":938881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"32'8","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:23.981596+0000","last_change":"2024-04-18T04:45:12.045887+0000","last_active":"2024-04-18T04:55:23.981596+0000","last_peered":"2024-04-18T04:55:23.981596+0000","last_clean":"2024-04-18T04:55:23.981596+0000","last_became_active":"2024-04-18T04:45:12.045671+0000","last_became_peered":"2024-04-18T04:45:12.045671+0000","last_unstale":"2024-04-18T04:55:23.981596+0000","last_undegraded":"2024-04-18T04:55:23.981596+0000","last_fullsized":"2024-04-18T04:55:23.981596+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:22:58.022926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"32'98","reported_seq":129,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:19.758343+0000","last_change":"2024-04-18T04:44:29.894503+0000","last_active":"2024-04-18T04:55:19.758343+0000","last_peered":"2024-04-18T04:55:19.758343+0000","last_clean":"2024-04-18T04:55:19.758343+0000","last_became_active":"2024-04-18T04:44:29.894210+0000","last_became_peered":"2024-04-18T04:44:29.894210+0000","last_unstale":"2024-04-18T04:55:19.758343+0000","last_undegraded":"2024-04-18T04:55:19.758343+0000","last_fullsized":"2024-04-18T04:55:19.758343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:14:56.979204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":22,"num_write":222,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"32'4833","reported_seq":4863,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:36.418682+0000","last_change":"2024-04-18T04:44:34.305652+0000","last_active":"2024-04-18T04:55:36.418682+0000","last_peered":"2024-04-18T04:55:36.418682+0000","last_clean":"2024-04-18T04:55:36.418682+0000","last_became_active":"2024-04-18T04:44:34.305180+0000","last_became_peered":"2024-04-18T04:44:34.305180+0000","last_unstale":"2024-04-18T04:55:36.418682+0000","last_undegraded":"2024-04-18T04:55:36.418682+0000","last_fullsized":"2024-04-18T04:55:36.418682+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4833,"log_dups_size":0,"ondisk_log_size":4833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37767940,"num_objects":15,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":70770,"num_write_kb":998644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'9","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.152733+0000","last_change":"2024-04-18T04:44:30.267158+0000","last_active":"2024-04-18T04:53:26.152733+0000","last_peered":"2024-04-18T04:53:26.152733+0000","last_clean":"2024-04-18T04:53:26.152733+0000","last_became_active":"2024-04-18T04:44:30.266814+0000","last_became_peered":"2024-04-18T04:44:30.266814+0000","last_unstale":"2024-04-18T04:53:26.152733+0000","last_undegraded":"2024-04-18T04:53:26.152733+0000","last_fullsized":"2024-04-18T04:53:26.152733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:16:02.152817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'4","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:31.064330+0000","last_change":"2024-04-18T04:44:29.898812+0000","last_active":"2024-04-18T04:53:31.064330+0000","last_peered":"2024-04-18T04:53:31.064330+0000","last_clean":"2024-04-18T04:53:31.064330+0000","last_became_active":"2024-04-18T04:44:29.897156+0000","last_became_peered":"2024-04-18T04:44:29.897156+0000","last_unstale":"2024-04-18T04:53:31.064330+0000","last_undegraded":"2024-04-18T04:53:31.064330+0000","last_fullsized":"2024-04-18T04:53:31.064330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:09:47.746394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":7,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"32'4366","reported_seq":4394,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:36.308341+0000","last_change":"2024-04-18T04:44:34.324721+0000","last_active":"2024-04-18T04:55:36.308341+0000","last_peered":"2024-04-18T04:55:36.308341+0000","last_clean":"2024-04-18T04:55:36.308341+0000","last_became_active":"2024-04-18T04:44:34.322925+0000","last_became_peered":"2024-04-18T04:44:34.322925+0000","last_unstale":"2024-04-18T04:55:36.308341+0000","last_undegraded":"2024-04-18T04:55:36.308341+0000","last_fullsized":"2024-04-18T04:55:36.308341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4366,"log_dups_size":0,"ondisk_log_size":4366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41996301,"num_objects":14,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":64212,"num_write_kb":906867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"32'6","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:15.171307+0000","last_change":"2024-04-18T04:44:30.281640+0000","last_active":"2024-04-18T04:55:15.171307+0000","last_peered":"2024-04-18T04:55:15.171307+0000","last_clean":"2024-04-18T04:55:15.171307+0000","last_became_active":"2024-04-18T04:44:30.280968+0000","last_became_peered":"2024-04-18T04:44:30.280968+0000","last_unstale":"2024-04-18T04:55:15.171307+0000","last_undegraded":"2024-04-18T04:55:15.171307+0000","last_fullsized":"2024-04-18T04:55:15.171307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:35:20.755711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"28'1","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.152863+0000","last_change":"2024-04-18T04:44:29.882715+0000","last_active":"2024-04-18T04:53:26.152863+0000","last_peered":"2024-04-18T04:53:26.152863+0000","last_clean":"2024-04-18T04:53:26.152863+0000","last_became_active":"2024-04-18T04:44:29.882335+0000","last_became_peered":"2024-04-18T04:44:29.882335+0000","last_unstale":"2024-04-18T04:53:26.152863+0000","last_undegraded":"2024-04-18T04:53:26.152863+0000","last_fullsized":"2024-04-18T04:53:26.152863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:32:59.709151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4619","reported_seq":4648,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:32.342605+0000","last_change":"2024-04-18T04:44:34.325029+0000","last_active":"2024-04-18T04:55:32.342605+0000","last_peered":"2024-04-18T04:55:32.342605+0000","last_clean":"2024-04-18T04:55:32.342605+0000","last_became_active":"2024-04-18T04:44:34.324082+0000","last_became_peered":"2024-04-18T04:44:34.324082+0000","last_unstale":"2024-04-18T04:55:32.342605+0000","last_undegraded":"2024-04-18T04:55:32.342605+0000","last_fullsized":"2024-04-18T04:55:32.342605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4619,"log_dups_size":0,"ondisk_log_size":4619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:28:10.378037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67133458,"num_objects":21,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":67959,"num_write_kb":954001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"32'8","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:24.111261+0000","last_change":"2024-04-18T04:44:30.276174+0000","last_active":"2024-04-18T04:55:24.111261+0000","last_peered":"2024-04-18T04:55:24.111261+0000","last_clean":"2024-04-18T04:55:24.111261+0000","last_became_active":"2024-04-18T04:44:30.270878+0000","last_became_peered":"2024-04-18T04:44:30.270878+0000","last_unstale":"2024-04-18T04:55:24.111261+0000","last_undegraded":"2024-04-18T04:55:24.111261+0000","last_fullsized":"2024-04-18T04:55:24.111261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:35:12.296277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"30'27","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.060101+0000","last_change":"2024-04-18T04:44:29.896745+0000","last_active":"2024-04-18T04:53:26.060101+0000","last_peered":"2024-04-18T04:53:26.060101+0000","last_clean":"2024-04-18T04:53:26.060101+0000","last_became_active":"2024-04-18T04:44:29.896199+0000","last_became_peered":"2024-04-18T04:44:29.896199+0000","last_unstale":"2024-04-18T04:53:26.060101+0000","last_undegraded":"2024-04-18T04:53:26.060101+0000","last_fullsized":"2024-04-18T04:53:26.060101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:25:05.424668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":22,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"32'5227","reported_seq":5255,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:32.414087+0000","last_change":"2024-04-18T04:44:34.337429+0000","last_active":"2024-04-18T04:55:32.414087+0000","last_peered":"2024-04-18T04:55:32.414087+0000","last_clean":"2024-04-18T04:55:32.414087+0000","last_became_active":"2024-04-18T04:44:34.337089+0000","last_became_peered":"2024-04-18T04:44:34.337089+0000","last_unstale":"2024-04-18T04:55:32.414087+0000","last_undegraded":"2024-04-18T04:55:32.414087+0000","last_fullsized":"2024-04-18T04:55:32.414087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":5227,"log_dups_size":0,"ondisk_log_size":5227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:00:56.976431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92309652,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":76838,"num_write_kb":1090506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"32'10","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:15.312140+0000","last_change":"2024-04-18T04:44:30.270874+0000","last_active":"2024-04-18T04:55:15.312140+0000","last_peered":"2024-04-18T04:55:15.312140+0000","last_clean":"2024-04-18T04:55:15.312140+0000","last_became_active":"2024-04-18T04:44:30.270636+0000","last_became_peered":"2024-04-18T04:44:30.270636+0000","last_unstale":"2024-04-18T04:55:15.312140+0000","last_undegraded":"2024-04-18T04:55:15.312140+0000","last_fullsized":"2024-04-18T04:55:15.312140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:25:49.889554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"32'42","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:17.024741+0000","last_change":"2024-04-18T04:44:29.878607+0000","last_active":"2024-04-18T04:55:17.024741+0000","last_peered":"2024-04-18T04:55:17.024741+0000","last_clean":"2024-04-18T04:55:17.024741+0000","last_became_active":"2024-04-18T04:44:29.878330+0000","last_became_peered":"2024-04-18T04:44:29.878330+0000","last_unstale":"2024-04-18T04:55:17.024741+0000","last_undegraded":"2024-04-18T04:55:17.024741+0000","last_fullsized":"2024-04-18T04:55:17.024741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90443,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":42,"num_read_kb":118,"num_write":37,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'4399","reported_seq":4425,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:32.434524+0000","last_change":"2024-04-18T04:44:34.323315+0000","last_active":"2024-04-18T04:55:32.434524+0000","last_peered":"2024-04-18T04:55:32.434524+0000","last_clean":"2024-04-18T04:55:32.434524+0000","last_became_active":"2024-04-18T04:44:34.322983+0000","last_became_peered":"2024-04-18T04:44:34.322983+0000","last_unstale":"2024-04-18T04:55:32.434524+0000","last_undegraded":"2024-04-18T04:55:32.434524+0000","last_fullsized":"2024-04-18T04:55:32.434524+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4399,"log_dups_size":0,"ondisk_log_size":4399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:48:12.803273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58742310,"num_objects":18,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":64685,"num_write_kb":914612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"27'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:46.514645+0000","last_change":"2024-04-18T04:44:30.285533+0000","last_active":"2024-04-18T04:54:46.514645+0000","last_peered":"2024-04-18T04:54:46.514645+0000","last_clean":"2024-04-18T04:54:46.514645+0000","last_became_active":"2024-04-18T04:44:30.285113+0000","last_became_peered":"2024-04-18T04:44:30.285113+0000","last_unstale":"2024-04-18T04:54:46.514645+0000","last_undegraded":"2024-04-18T04:54:46.514645+0000","last_fullsized":"2024-04-18T04:54:46.514645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"32'29","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:35.068171+0000","last_change":"2024-04-18T04:44:29.890701+0000","last_active":"2024-04-18T04:53:35.068171+0000","last_peered":"2024-04-18T04:53:35.068171+0000","last_clean":"2024-04-18T04:53:35.068171+0000","last_became_active":"2024-04-18T04:44:29.890207+0000","last_became_peered":"2024-04-18T04:44:29.890207+0000","last_unstale":"2024-04-18T04:53:35.068171+0000","last_undegraded":"2024-04-18T04:53:35.068171+0000","last_fullsized":"2024-04-18T04:53:35.068171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:06:58.470725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":8204,"num_write":25,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"32'5251","reported_seq":5289,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:35.561653+0000","last_change":"2024-04-18T04:45:12.378646+0000","last_active":"2024-04-18T04:55:35.561653+0000","last_peered":"2024-04-18T04:55:35.561653+0000","last_clean":"2024-04-18T04:55:35.561653+0000","last_became_active":"2024-04-18T04:45:12.378263+0000","last_became_peered":"2024-04-18T04:45:12.378263+0000","last_unstale":"2024-04-18T04:55:35.561653+0000","last_undegraded":"2024-04-18T04:55:35.561653+0000","last_fullsized":"2024-04-18T04:55:35.561653+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":5251,"log_dups_size":0,"ondisk_log_size":5251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29550733,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":76611,"num_write_kb":1101398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"32'9","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:19.994041+0000","last_change":"2024-04-18T04:44:30.306826+0000","last_active":"2024-04-18T04:55:19.994041+0000","last_peered":"2024-04-18T04:55:19.994041+0000","last_clean":"2024-04-18T04:55:19.994041+0000","last_became_active":"2024-04-18T04:44:30.306320+0000","last_became_peered":"2024-04-18T04:44:30.306320+0000","last_unstale":"2024-04-18T04:55:19.994041+0000","last_undegraded":"2024-04-18T04:55:19.994041+0000","last_fullsized":"2024-04-18T04:55:19.994041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"25'3","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:23.242696+0000","last_change":"2024-04-18T04:44:29.888023+0000","last_active":"2024-04-18T04:54:23.242696+0000","last_peered":"2024-04-18T04:54:23.242696+0000","last_clean":"2024-04-18T04:54:23.242696+0000","last_became_active":"2024-04-18T04:44:29.887440+0000","last_became_peered":"2024-04-18T04:44:29.887440+0000","last_unstale":"2024-04-18T04:54:23.242696+0000","last_undegraded":"2024-04-18T04:54:23.242696+0000","last_fullsized":"2024-04-18T04:54:23.242696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:07:01.067445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":20,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":180,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.040633+0000","last_change":"2024-04-18T04:44:18.629794+0000","last_active":"2024-04-18T04:53:26.040633+0000","last_peered":"2024-04-18T04:53:26.040633+0000","last_clean":"2024-04-18T04:53:26.040633+0000","last_became_active":"2024-04-18T04:44:18.627792+0000","last_became_peered":"2024-04-18T04:44:18.627792+0000","last_unstale":"2024-04-18T04:53:26.040633+0000","last_undegraded":"2024-04-18T04:53:26.040633+0000","last_fullsized":"2024-04-18T04:53:26.040633+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:17.410146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:17.410146+0000","last_clean_scrub_stamp":"2024-04-18T04:44:17.410146+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:30:49.101656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"32'4232","reported_seq":4257,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:32.419927+0000","last_change":"2024-04-18T04:44:34.333286+0000","last_active":"2024-04-18T04:55:32.419927+0000","last_peered":"2024-04-18T04:55:32.419927+0000","last_clean":"2024-04-18T04:55:32.419927+0000","last_became_active":"2024-04-18T04:44:34.332520+0000","last_became_peered":"2024-04-18T04:44:34.332520+0000","last_unstale":"2024-04-18T04:55:32.419927+0000","last_undegraded":"2024-04-18T04:55:32.419927+0000","last_fullsized":"2024-04-18T04:55:32.419927+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4232,"log_dups_size":0,"ondisk_log_size":4232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:58:48.264040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62931838,"num_objects":20,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":62354,"num_write_kb":880557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"32'6","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:23.472187+0000","last_change":"2024-04-18T04:44:30.303602+0000","last_active":"2024-04-18T04:55:23.472187+0000","last_peered":"2024-04-18T04:55:23.472187+0000","last_clean":"2024-04-18T04:55:23.472187+0000","last_became_active":"2024-04-18T04:44:30.302157+0000","last_became_peered":"2024-04-18T04:44:30.302157+0000","last_unstale":"2024-04-18T04:55:23.472187+0000","last_undegraded":"2024-04-18T04:55:23.472187+0000","last_fullsized":"2024-04-18T04:55:23.472187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:09:57.582065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"32'6","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:11.213415+0000","last_change":"2024-04-18T04:44:29.890428+0000","last_active":"2024-04-18T04:55:11.213415+0000","last_peered":"2024-04-18T04:55:11.213415+0000","last_clean":"2024-04-18T04:55:11.213415+0000","last_became_active":"2024-04-18T04:44:29.890166+0000","last_became_peered":"2024-04-18T04:44:29.890166+0000","last_unstale":"2024-04-18T04:55:11.213415+0000","last_undegraded":"2024-04-18T04:55:11.213415+0000","last_fullsized":"2024-04-18T04:55:11.213415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":14,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"32'3638","reported_seq":3668,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:33.319938+0000","last_change":"2024-04-18T04:44:34.334071+0000","last_active":"2024-04-18T04:55:33.319938+0000","last_peered":"2024-04-18T04:55:33.319938+0000","last_clean":"2024-04-18T04:55:33.319938+0000","last_became_active":"2024-04-18T04:44:34.332695+0000","last_became_peered":"2024-04-18T04:44:34.332695+0000","last_unstale":"2024-04-18T04:55:33.319938+0000","last_undegraded":"2024-04-18T04:55:33.319938+0000","last_fullsized":"2024-04-18T04:55:33.319938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":3638,"log_dups_size":0,"ondisk_log_size":3638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:22:52.371921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41998799,"num_objects":14,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":53426,"num_write_kb":771461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'7","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.059834+0000","last_change":"2024-04-18T04:44:30.287908+0000","last_active":"2024-04-18T04:53:26.059834+0000","last_peered":"2024-04-18T04:53:26.059834+0000","last_clean":"2024-04-18T04:53:26.059834+0000","last_became_active":"2024-04-18T04:44:30.287217+0000","last_became_peered":"2024-04-18T04:44:30.287217+0000","last_unstale":"2024-04-18T04:53:26.059834+0000","last_undegraded":"2024-04-18T04:53:26.059834+0000","last_fullsized":"2024-04-18T04:53:26.059834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:47:14.962330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"30'24","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.057944+0000","last_change":"2024-04-18T04:44:29.886376+0000","last_active":"2024-04-18T04:53:26.057944+0000","last_peered":"2024-04-18T04:53:26.057944+0000","last_clean":"2024-04-18T04:53:26.057944+0000","last_became_active":"2024-04-18T04:44:29.886058+0000","last_became_peered":"2024-04-18T04:44:29.886058+0000","last_unstale":"2024-04-18T04:53:26.057944+0000","last_undegraded":"2024-04-18T04:53:26.057944+0000","last_fullsized":"2024-04-18T04:53:26.057944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:29:59.678071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":23,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"32'4556","reported_seq":4594,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:36.442831+0000","last_change":"2024-04-18T04:45:12.373987+0000","last_active":"2024-04-18T04:55:36.442831+0000","last_peered":"2024-04-18T04:55:36.442831+0000","last_clean":"2024-04-18T04:55:36.442831+0000","last_became_active":"2024-04-18T04:45:12.373269+0000","last_became_peered":"2024-04-18T04:45:12.373269+0000","last_unstale":"2024-04-18T04:55:36.442831+0000","last_undegraded":"2024-04-18T04:55:36.442831+0000","last_fullsized":"2024-04-18T04:55:36.442831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4556,"log_dups_size":0,"ondisk_log_size":4556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38013793,"num_objects":17,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":66902,"num_write_kb":952859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"32'8","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:17.263042+0000","last_change":"2024-04-18T04:45:12.043098+0000","last_active":"2024-04-18T04:55:17.263042+0000","last_peered":"2024-04-18T04:55:17.263042+0000","last_clean":"2024-04-18T04:55:17.263042+0000","last_became_active":"2024-04-18T04:45:12.042803+0000","last_became_peered":"2024-04-18T04:45:12.042803+0000","last_unstale":"2024-04-18T04:55:17.263042+0000","last_undegraded":"2024-04-18T04:55:17.263042+0000","last_fullsized":"2024-04-18T04:55:17.263042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"32'269","reported_seq":300,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:09.818236+0000","last_change":"2024-04-18T04:44:29.878650+0000","last_active":"2024-04-18T04:55:09.818236+0000","last_peered":"2024-04-18T04:55:09.818236+0000","last_clean":"2024-04-18T04:55:09.818236+0000","last_became_active":"2024-04-18T04:44:29.878361+0000","last_became_peered":"2024-04-18T04:44:29.878361+0000","last_unstale":"2024-04-18T04:55:09.818236+0000","last_undegraded":"2024-04-18T04:55:09.818236+0000","last_fullsized":"2024-04-18T04:55:09.818236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":678,"num_write":267,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"32'4391","reported_seq":4423,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:32.358270+0000","last_change":"2024-04-18T04:44:34.339023+0000","last_active":"2024-04-18T04:55:32.358270+0000","last_peered":"2024-04-18T04:55:32.358270+0000","last_clean":"2024-04-18T04:55:32.358270+0000","last_became_active":"2024-04-18T04:44:34.338042+0000","last_became_peered":"2024-04-18T04:44:34.338042+0000","last_unstale":"2024-04-18T04:55:32.358270+0000","last_undegraded":"2024-04-18T04:55:32.358270+0000","last_fullsized":"2024-04-18T04:55:32.358270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4391,"log_dups_size":0,"ondisk_log_size":4391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:48:58.174635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54621225,"num_objects":20,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":64591,"num_write_kb":926956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'4","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.041326+0000","last_change":"2024-04-18T04:44:30.291740+0000","last_active":"2024-04-18T04:53:26.041326+0000","last_peered":"2024-04-18T04:53:26.041326+0000","last_clean":"2024-04-18T04:53:26.041326+0000","last_became_active":"2024-04-18T04:44:30.290379+0000","last_became_peered":"2024-04-18T04:44:30.290379+0000","last_unstale":"2024-04-18T04:53:26.041326+0000","last_undegraded":"2024-04-18T04:53:26.041326+0000","last_fullsized":"2024-04-18T04:53:26.041326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:44:25.111858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"31'9","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.071265+0000","last_change":"2024-04-18T04:44:29.882833+0000","last_active":"2024-04-18T04:53:26.071265+0000","last_peered":"2024-04-18T04:53:26.071265+0000","last_clean":"2024-04-18T04:53:26.071265+0000","last_became_active":"2024-04-18T04:44:29.881671+0000","last_became_peered":"2024-04-18T04:44:29.881671+0000","last_unstale":"2024-04-18T04:53:26.071265+0000","last_undegraded":"2024-04-18T04:53:26.071265+0000","last_fullsized":"2024-04-18T04:53:26.071265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:29:22.037641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"32'4099","reported_seq":4132,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:32.133337+0000","last_change":"2024-04-18T04:44:34.342465+0000","last_active":"2024-04-18T04:55:32.133337+0000","last_peered":"2024-04-18T04:55:32.133337+0000","last_clean":"2024-04-18T04:55:32.133337+0000","last_became_active":"2024-04-18T04:44:34.340327+0000","last_became_peered":"2024-04-18T04:44:34.340327+0000","last_unstale":"2024-04-18T04:55:32.133337+0000","last_undegraded":"2024-04-18T04:55:32.133337+0000","last_fullsized":"2024-04-18T04:55:32.133337+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4099,"log_dups_size":0,"ondisk_log_size":4099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:31:44.168899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67120315,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":60238,"num_write_kb":847949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"32'10","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:28.374310+0000","last_change":"2024-04-18T04:44:30.299403+0000","last_active":"2024-04-18T04:55:28.374310+0000","last_peered":"2024-04-18T04:55:28.374310+0000","last_clean":"2024-04-18T04:55:28.374310+0000","last_became_active":"2024-04-18T04:44:30.298417+0000","last_became_peered":"2024-04-18T04:44:30.298417+0000","last_unstale":"2024-04-18T04:55:28.374310+0000","last_undegraded":"2024-04-18T04:55:28.374310+0000","last_fullsized":"2024-04-18T04:55:28.374310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:43:24.120294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"30'18","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:23.865215+0000","last_change":"2024-04-18T04:44:29.875345+0000","last_active":"2024-04-18T04:54:23.865215+0000","last_peered":"2024-04-18T04:54:23.865215+0000","last_clean":"2024-04-18T04:54:23.865215+0000","last_became_active":"2024-04-18T04:44:29.875059+0000","last_became_peered":"2024-04-18T04:44:29.875059+0000","last_unstale":"2024-04-18T04:54:23.865215+0000","last_undegraded":"2024-04-18T04:54:23.865215+0000","last_fullsized":"2024-04-18T04:54:23.865215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":44,"num_read_kb":43,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"32'5085","reported_seq":5113,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:36.261901+0000","last_change":"2024-04-18T04:44:34.334498+0000","last_active":"2024-04-18T04:55:36.261901+0000","last_peered":"2024-04-18T04:55:36.261901+0000","last_clean":"2024-04-18T04:55:36.261901+0000","last_became_active":"2024-04-18T04:44:34.334192+0000","last_became_peered":"2024-04-18T04:44:34.334192+0000","last_unstale":"2024-04-18T04:55:36.261901+0000","last_undegraded":"2024-04-18T04:55:36.261901+0000","last_fullsized":"2024-04-18T04:55:36.261901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":5085,"log_dups_size":0,"ondisk_log_size":5085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25511997,"num_objects":20,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":74388,"num_write_kb":1061210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'6","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.072591+0000","last_change":"2024-04-18T04:44:30.298289+0000","last_active":"2024-04-18T04:53:26.072591+0000","last_peered":"2024-04-18T04:53:26.072591+0000","last_clean":"2024-04-18T04:53:26.072591+0000","last_became_active":"2024-04-18T04:44:30.295404+0000","last_became_peered":"2024-04-18T04:44:30.295404+0000","last_unstale":"2024-04-18T04:53:26.072591+0000","last_undegraded":"2024-04-18T04:53:26.072591+0000","last_fullsized":"2024-04-18T04:53:26.072591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:10:32.465032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"30'12","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.072652+0000","last_change":"2024-04-18T04:44:29.894196+0000","last_active":"2024-04-18T04:53:26.072652+0000","last_peered":"2024-04-18T04:53:26.072652+0000","last_clean":"2024-04-18T04:53:26.072652+0000","last_became_active":"2024-04-18T04:44:29.893668+0000","last_became_peered":"2024-04-18T04:44:29.893668+0000","last_unstale":"2024-04-18T04:53:26.072652+0000","last_undegraded":"2024-04-18T04:53:26.072652+0000","last_fullsized":"2024-04-18T04:53:26.072652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:39:03.812043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1711,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":11,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"32'5178","reported_seq":5216,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:36.182761+0000","last_change":"2024-04-18T04:45:12.057192+0000","last_active":"2024-04-18T04:55:36.182761+0000","last_peered":"2024-04-18T04:55:36.182761+0000","last_clean":"2024-04-18T04:55:36.182761+0000","last_became_active":"2024-04-18T04:45:12.056680+0000","last_became_peered":"2024-04-18T04:45:12.056680+0000","last_unstale":"2024-04-18T04:55:36.182761+0000","last_undegraded":"2024-04-18T04:55:36.182761+0000","last_fullsized":"2024-04-18T04:55:36.182761+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":5178,"log_dups_size":0,"ondisk_log_size":5178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54534757,"num_objects":16,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":76102,"num_write_kb":1080690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'19","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:20.352066+0000","last_change":"2024-04-18T04:44:30.289122+0000","last_active":"2024-04-18T04:55:20.352066+0000","last_peered":"2024-04-18T04:55:20.352066+0000","last_clean":"2024-04-18T04:55:20.352066+0000","last_became_active":"2024-04-18T04:44:30.288364+0000","last_became_peered":"2024-04-18T04:44:30.288364+0000","last_unstale":"2024-04-18T04:55:20.352066+0000","last_undegraded":"2024-04-18T04:55:20.352066+0000","last_fullsized":"2024-04-18T04:55:20.352066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:04:02.162723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"32'6","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:23.255678+0000","last_change":"2024-04-18T04:44:29.894521+0000","last_active":"2024-04-18T04:54:23.255678+0000","last_peered":"2024-04-18T04:54:23.255678+0000","last_clean":"2024-04-18T04:54:23.255678+0000","last_became_active":"2024-04-18T04:44:29.889150+0000","last_became_peered":"2024-04-18T04:44:29.889150+0000","last_unstale":"2024-04-18T04:54:23.255678+0000","last_undegraded":"2024-04-18T04:54:23.255678+0000","last_fullsized":"2024-04-18T04:54:23.255678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:39:13.323434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'4538","reported_seq":4568,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:36.056514+0000","last_change":"2024-04-18T04:44:34.305657+0000","last_active":"2024-04-18T04:55:36.056514+0000","last_peered":"2024-04-18T04:55:36.056514+0000","last_clean":"2024-04-18T04:55:36.056514+0000","last_became_active":"2024-04-18T04:44:34.305341+0000","last_became_peered":"2024-04-18T04:44:34.305341+0000","last_unstale":"2024-04-18T04:55:36.056514+0000","last_undegraded":"2024-04-18T04:55:36.056514+0000","last_fullsized":"2024-04-18T04:55:36.056514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4538,"log_dups_size":0,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21070136,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":66722,"num_write_kb":961503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'6","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:55.994113+0000","last_change":"2024-04-18T04:44:30.307042+0000","last_active":"2024-04-18T04:53:55.994113+0000","last_peered":"2024-04-18T04:53:55.994113+0000","last_clean":"2024-04-18T04:53:55.994113+0000","last_became_active":"2024-04-18T04:44:30.306726+0000","last_became_peered":"2024-04-18T04:44:30.306726+0000","last_unstale":"2024-04-18T04:53:55.994113+0000","last_undegraded":"2024-04-18T04:53:55.994113+0000","last_fullsized":"2024-04-18T04:53:55.994113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"32'40","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:35.470515+0000","last_change":"2024-04-18T04:55:35.470607+0000","last_active":"2024-04-18T04:55:35.470515+0000","last_peered":"2024-04-18T04:55:35.470515+0000","last_clean":"2024-04-18T04:55:35.470515+0000","last_became_active":"2024-04-18T04:44:29.887095+0000","last_became_peered":"2024-04-18T04:44:29.887095+0000","last_unstale":"2024-04-18T04:55:35.470515+0000","last_undegraded":"2024-04-18T04:55:35.470515+0000","last_fullsized":"2024-04-18T04:55:35.470515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'40","last_scrub_stamp":"2024-04-18T04:55:35.470495+0000","last_deep_scrub":"32'40","last_deep_scrub_stamp":"2024-04-18T04:55:35.470495+0000","last_clean_scrub_stamp":"2024-04-18T04:55:35.470495+0000","objects_scrubbed":6,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:22:22.552307+0000","scrub_duration":0.035712923000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":31,"num_read_kb":8224,"num_write":33,"num_write_kb":8211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"32'4770","reported_seq":4797,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:31.943674+0000","last_change":"2024-04-18T04:44:34.322042+0000","last_active":"2024-04-18T04:55:31.943674+0000","last_peered":"2024-04-18T04:55:31.943674+0000","last_clean":"2024-04-18T04:55:31.943674+0000","last_became_active":"2024-04-18T04:44:34.320776+0000","last_became_peered":"2024-04-18T04:44:34.320776+0000","last_unstale":"2024-04-18T04:55:31.943674+0000","last_undegraded":"2024-04-18T04:55:31.943674+0000","last_fullsized":"2024-04-18T04:55:31.943674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4770,"log_dups_size":0,"ondisk_log_size":4770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:53:47.399337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":70289,"num_write_kb":986201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"32'7","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:12.485852+0000","last_change":"2024-04-18T04:44:30.299413+0000","last_active":"2024-04-18T04:54:12.485852+0000","last_peered":"2024-04-18T04:54:12.485852+0000","last_clean":"2024-04-18T04:54:12.485852+0000","last_became_active":"2024-04-18T04:44:30.293185+0000","last_became_peered":"2024-04-18T04:44:30.293185+0000","last_unstale":"2024-04-18T04:54:12.485852+0000","last_undegraded":"2024-04-18T04:54:12.485852+0000","last_fullsized":"2024-04-18T04:54:12.485852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:43:53.831429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"32'227","reported_seq":261,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:11.183288+0000","last_change":"2024-04-18T04:44:29.893351+0000","last_active":"2024-04-18T04:55:11.183288+0000","last_peered":"2024-04-18T04:55:11.183288+0000","last_clean":"2024-04-18T04:55:11.183288+0000","last_became_active":"2024-04-18T04:44:29.892647+0000","last_became_peered":"2024-04-18T04:44:29.892647+0000","last_unstale":"2024-04-18T04:55:11.183288+0000","last_undegraded":"2024-04-18T04:55:11.183288+0000","last_fullsized":"2024-04-18T04:55:11.183288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:16:59.759149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":21,"num_read_kb":4116,"num_write":227,"num_write_kb":4214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"32'4364","reported_seq":4393,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:31.508732+0000","last_change":"2024-04-18T04:44:34.337866+0000","last_active":"2024-04-18T04:55:31.508732+0000","last_peered":"2024-04-18T04:55:31.508732+0000","last_clean":"2024-04-18T04:55:31.508732+0000","last_became_active":"2024-04-18T04:44:34.337486+0000","last_became_peered":"2024-04-18T04:44:34.337486+0000","last_unstale":"2024-04-18T04:55:31.508732+0000","last_undegraded":"2024-04-18T04:55:31.508732+0000","last_fullsized":"2024-04-18T04:55:31.508732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4364,"log_dups_size":0,"ondisk_log_size":4364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:42:13.751926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96501889,"num_objects":31,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":6,"num_read_kb":1,"num_write":64282,"num_write_kb":903689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"32'9","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.021820+0000","last_change":"2024-04-18T04:44:30.308477+0000","last_active":"2024-04-18T04:55:26.021820+0000","last_peered":"2024-04-18T04:55:26.021820+0000","last_clean":"2024-04-18T04:55:26.021820+0000","last_became_active":"2024-04-18T04:44:30.307237+0000","last_became_peered":"2024-04-18T04:44:30.307237+0000","last_unstale":"2024-04-18T04:55:26.021820+0000","last_undegraded":"2024-04-18T04:55:26.021820+0000","last_fullsized":"2024-04-18T04:55:26.021820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:33:58.300542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"32'17","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:11.182386+0000","last_change":"2024-04-18T04:44:29.898488+0000","last_active":"2024-04-18T04:55:11.182386+0000","last_peered":"2024-04-18T04:55:11.182386+0000","last_clean":"2024-04-18T04:55:11.182386+0000","last_became_active":"2024-04-18T04:44:29.898113+0000","last_became_peered":"2024-04-18T04:44:29.898113+0000","last_unstale":"2024-04-18T04:55:11.182386+0000","last_undegraded":"2024-04-18T04:55:11.182386+0000","last_fullsized":"2024-04-18T04:55:11.182386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:11:14.585142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":18,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'5514","reported_seq":5541,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:33.631705+0000","last_change":"2024-04-18T04:44:34.344769+0000","last_active":"2024-04-18T04:55:33.631705+0000","last_peered":"2024-04-18T04:55:33.631705+0000","last_clean":"2024-04-18T04:55:33.631705+0000","last_became_active":"2024-04-18T04:44:34.343636+0000","last_became_peered":"2024-04-18T04:44:34.343636+0000","last_unstale":"2024-04-18T04:55:33.631705+0000","last_undegraded":"2024-04-18T04:55:33.631705+0000","last_fullsized":"2024-04-18T04:55:33.631705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":5514,"log_dups_size":0,"ondisk_log_size":5514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:45:09.481681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84092020,"num_objects":29,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":4,"num_read_kb":7,"num_write":80985,"num_write_kb":1156235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"32'11","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:32.549002+0000","last_change":"2024-04-18T04:44:30.290494+0000","last_active":"2024-04-18T04:55:32.549002+0000","last_peered":"2024-04-18T04:55:32.549002+0000","last_clean":"2024-04-18T04:55:32.549002+0000","last_became_active":"2024-04-18T04:44:30.290127+0000","last_became_peered":"2024-04-18T04:44:30.290127+0000","last_unstale":"2024-04-18T04:55:32.549002+0000","last_undegraded":"2024-04-18T04:55:32.549002+0000","last_fullsized":"2024-04-18T04:55:32.549002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'3","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:23.256537+0000","last_change":"2024-04-18T04:44:29.895686+0000","last_active":"2024-04-18T04:54:23.256537+0000","last_peered":"2024-04-18T04:54:23.256537+0000","last_clean":"2024-04-18T04:54:23.256537+0000","last_became_active":"2024-04-18T04:44:29.895083+0000","last_became_peered":"2024-04-18T04:44:29.895083+0000","last_unstale":"2024-04-18T04:54:23.256537+0000","last_undegraded":"2024-04-18T04:54:23.256537+0000","last_fullsized":"2024-04-18T04:54:23.256537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:27:17.897401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"32'4740","reported_seq":4769,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:36.163812+0000","last_change":"2024-04-18T04:44:34.338412+0000","last_active":"2024-04-18T04:55:36.163812+0000","last_peered":"2024-04-18T04:55:36.163812+0000","last_clean":"2024-04-18T04:55:36.163812+0000","last_became_active":"2024-04-18T04:44:34.338062+0000","last_became_peered":"2024-04-18T04:44:34.338062+0000","last_unstale":"2024-04-18T04:55:36.163812+0000","last_undegraded":"2024-04-18T04:55:36.163812+0000","last_fullsized":"2024-04-18T04:55:36.163812+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4740,"log_dups_size":0,"ondisk_log_size":4740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37757769,"num_objects":15,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":69742,"num_write_kb":985522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"32'5","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:13.261662+0000","last_change":"2024-04-18T04:44:30.307946+0000","last_active":"2024-04-18T04:54:13.261662+0000","last_peered":"2024-04-18T04:54:13.261662+0000","last_clean":"2024-04-18T04:54:13.261662+0000","last_became_active":"2024-04-18T04:44:30.307168+0000","last_became_peered":"2024-04-18T04:44:30.307168+0000","last_unstale":"2024-04-18T04:54:13.261662+0000","last_undegraded":"2024-04-18T04:54:13.261662+0000","last_fullsized":"2024-04-18T04:54:13.261662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:43:56.218333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"32'9","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:11.183996+0000","last_change":"2024-04-18T04:44:29.903183+0000","last_active":"2024-04-18T04:55:11.183996+0000","last_peered":"2024-04-18T04:55:11.183996+0000","last_clean":"2024-04-18T04:55:11.183996+0000","last_became_active":"2024-04-18T04:44:29.902647+0000","last_became_peered":"2024-04-18T04:44:29.902647+0000","last_unstale":"2024-04-18T04:55:11.183996+0000","last_undegraded":"2024-04-18T04:55:11.183996+0000","last_fullsized":"2024-04-18T04:55:11.183996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:45:13.009571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"32'5944","reported_seq":5973,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:36.320007+0000","last_change":"2024-04-18T04:44:34.338653+0000","last_active":"2024-04-18T04:55:36.320007+0000","last_peered":"2024-04-18T04:55:36.320007+0000","last_clean":"2024-04-18T04:55:36.320007+0000","last_became_active":"2024-04-18T04:44:34.338288+0000","last_became_peered":"2024-04-18T04:44:34.338288+0000","last_unstale":"2024-04-18T04:55:36.320007+0000","last_undegraded":"2024-04-18T04:55:36.320007+0000","last_fullsized":"2024-04-18T04:55:36.320007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":5944,"log_dups_size":0,"ondisk_log_size":5944,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54549683,"num_objects":18,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":87669,"num_write_kb":1229683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"32'4064","reported_seq":4093,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:35.840610+0000","last_change":"2024-04-18T04:44:34.306999+0000","last_active":"2024-04-18T04:55:35.840610+0000","last_peered":"2024-04-18T04:55:35.840610+0000","last_clean":"2024-04-18T04:55:35.840610+0000","last_became_active":"2024-04-18T04:44:34.306657+0000","last_became_peered":"2024-04-18T04:44:34.306657+0000","last_unstale":"2024-04-18T04:55:35.840610+0000","last_undegraded":"2024-04-18T04:55:35.840610+0000","last_fullsized":"2024-04-18T04:55:35.840610+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4064,"log_dups_size":0,"ondisk_log_size":4064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25257004,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":59691,"num_write_kb":838973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'8","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:21.443487+0000","last_change":"2024-04-18T04:44:30.271947+0000","last_active":"2024-04-18T04:54:21.443487+0000","last_peered":"2024-04-18T04:54:21.443487+0000","last_clean":"2024-04-18T04:54:21.443487+0000","last_became_active":"2024-04-18T04:44:30.271619+0000","last_became_peered":"2024-04-18T04:44:30.271619+0000","last_unstale":"2024-04-18T04:54:21.443487+0000","last_undegraded":"2024-04-18T04:54:21.443487+0000","last_fullsized":"2024-04-18T04:54:21.443487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:32:11.612016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"32'51","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:35.414182+0000","last_change":"2024-04-18T04:44:29.897616+0000","last_active":"2024-04-18T04:53:35.414182+0000","last_peered":"2024-04-18T04:53:35.414182+0000","last_clean":"2024-04-18T04:53:35.414182+0000","last_became_active":"2024-04-18T04:44:29.889922+0000","last_became_peered":"2024-04-18T04:44:29.889922+0000","last_unstale":"2024-04-18T04:53:35.414182+0000","last_undegraded":"2024-04-18T04:53:35.414182+0000","last_fullsized":"2024-04-18T04:53:35.414182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:11:52.717768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":45,"num_write_kb":8216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4541","reported_seq":4572,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:32.397972+0000","last_change":"2024-04-18T04:44:34.333403+0000","last_active":"2024-04-18T04:55:32.397972+0000","last_peered":"2024-04-18T04:55:32.397972+0000","last_clean":"2024-04-18T04:55:32.397972+0000","last_became_active":"2024-04-18T04:44:34.332551+0000","last_became_peered":"2024-04-18T04:44:34.332551+0000","last_unstale":"2024-04-18T04:55:32.397972+0000","last_undegraded":"2024-04-18T04:55:32.397972+0000","last_fullsized":"2024-04-18T04:55:32.397972+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4541,"log_dups_size":0,"ondisk_log_size":4541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:33:28.594002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88126593,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":66735,"num_write_kb":945017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"32'13","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:31.472210+0000","last_change":"2024-04-18T04:44:30.271099+0000","last_active":"2024-04-18T04:55:31.472210+0000","last_peered":"2024-04-18T04:55:31.472210+0000","last_clean":"2024-04-18T04:55:31.472210+0000","last_became_active":"2024-04-18T04:44:30.270804+0000","last_became_peered":"2024-04-18T04:44:30.270804+0000","last_unstale":"2024-04-18T04:55:31.472210+0000","last_undegraded":"2024-04-18T04:55:31.472210+0000","last_fullsized":"2024-04-18T04:55:31.472210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"30'3","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:20.042428+0000","last_change":"2024-04-18T04:44:29.895084+0000","last_active":"2024-04-18T04:54:20.042428+0000","last_peered":"2024-04-18T04:54:20.042428+0000","last_clean":"2024-04-18T04:54:20.042428+0000","last_became_active":"2024-04-18T04:44:29.894829+0000","last_became_peered":"2024-04-18T04:44:29.894829+0000","last_unstale":"2024-04-18T04:54:20.042428+0000","last_undegraded":"2024-04-18T04:54:20.042428+0000","last_fullsized":"2024-04-18T04:54:20.042428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"31'9","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.075642+0000","last_change":"2024-04-18T04:44:29.892826+0000","last_active":"2024-04-18T04:53:26.075642+0000","last_peered":"2024-04-18T04:53:26.075642+0000","last_clean":"2024-04-18T04:53:26.075642+0000","last_became_active":"2024-04-18T04:44:29.892282+0000","last_became_peered":"2024-04-18T04:44:29.892282+0000","last_unstale":"2024-04-18T04:53:26.075642+0000","last_undegraded":"2024-04-18T04:53:26.075642+0000","last_fullsized":"2024-04-18T04:53:26.075642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:02.844116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":4108,"num_write":6,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"32'8","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:27.127345+0000","last_change":"2024-04-18T04:44:30.285312+0000","last_active":"2024-04-18T04:55:27.127345+0000","last_peered":"2024-04-18T04:55:27.127345+0000","last_clean":"2024-04-18T04:55:27.127345+0000","last_became_active":"2024-04-18T04:44:30.285055+0000","last_became_peered":"2024-04-18T04:44:30.285055+0000","last_unstale":"2024-04-18T04:55:27.127345+0000","last_undegraded":"2024-04-18T04:55:27.127345+0000","last_fullsized":"2024-04-18T04:55:27.127345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"32'4887","reported_seq":4914,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:35.843781+0000","last_change":"2024-04-18T04:44:34.323352+0000","last_active":"2024-04-18T04:55:35.843781+0000","last_peered":"2024-04-18T04:55:35.843781+0000","last_clean":"2024-04-18T04:55:35.843781+0000","last_became_active":"2024-04-18T04:44:34.321645+0000","last_became_peered":"2024-04-18T04:44:34.321645+0000","last_unstale":"2024-04-18T04:55:35.843781+0000","last_undegraded":"2024-04-18T04:55:35.843781+0000","last_fullsized":"2024-04-18T04:55:35.843781+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4887,"log_dups_size":0,"ondisk_log_size":4887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29390764,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":71806,"num_write_kb":1022773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"32'1260","reported_seq":1293,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:20.711407+0000","last_change":"2024-04-18T04:44:29.891865+0000","last_active":"2024-04-18T04:55:20.711407+0000","last_peered":"2024-04-18T04:55:20.711407+0000","last_clean":"2024-04-18T04:55:20.711407+0000","last_became_active":"2024-04-18T04:44:29.891610+0000","last_became_peered":"2024-04-18T04:44:29.891610+0000","last_unstale":"2024-04-18T04:55:20.711407+0000","last_undegraded":"2024-04-18T04:55:20.711407+0000","last_fullsized":"2024-04-18T04:55:20.711407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":1260,"log_dups_size":0,"ondisk_log_size":1260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195509,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7,"num_read_kb":4100,"num_write":1254,"num_write_kb":4235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"32'7","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:11.290815+0000","last_change":"2024-04-18T04:44:30.279080+0000","last_active":"2024-04-18T04:55:11.290815+0000","last_peered":"2024-04-18T04:55:11.290815+0000","last_clean":"2024-04-18T04:55:11.290815+0000","last_became_active":"2024-04-18T04:44:30.278275+0000","last_became_peered":"2024-04-18T04:44:30.278275+0000","last_unstale":"2024-04-18T04:55:11.290815+0000","last_undegraded":"2024-04-18T04:55:11.290815+0000","last_fullsized":"2024-04-18T04:55:11.290815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:51:48.272703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'4552","reported_seq":4579,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:36.163622+0000","last_change":"2024-04-18T04:44:34.313835+0000","last_active":"2024-04-18T04:55:36.163622+0000","last_peered":"2024-04-18T04:55:36.163622+0000","last_clean":"2024-04-18T04:55:36.163622+0000","last_became_active":"2024-04-18T04:44:34.313416+0000","last_became_peered":"2024-04-18T04:44:34.313416+0000","last_unstale":"2024-04-18T04:55:36.163622+0000","last_undegraded":"2024-04-18T04:55:36.163622+0000","last_fullsized":"2024-04-18T04:55:36.163622+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4552,"log_dups_size":0,"ondisk_log_size":4552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16904414,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":66459,"num_write_kb":963599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"32'14","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:28.268985+0000","last_change":"2024-04-18T04:44:30.297229+0000","last_active":"2024-04-18T04:55:28.268985+0000","last_peered":"2024-04-18T04:55:28.268985+0000","last_clean":"2024-04-18T04:55:28.268985+0000","last_became_active":"2024-04-18T04:44:30.296354+0000","last_became_peered":"2024-04-18T04:44:30.296354+0000","last_unstale":"2024-04-18T04:55:28.268985+0000","last_undegraded":"2024-04-18T04:55:28.268985+0000","last_fullsized":"2024-04-18T04:55:28.268985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:30:35.845106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"32'11","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:19.470009+0000","last_change":"2024-04-18T04:44:30.281213+0000","last_active":"2024-04-18T04:55:19.470009+0000","last_peered":"2024-04-18T04:55:19.470009+0000","last_clean":"2024-04-18T04:55:19.470009+0000","last_became_active":"2024-04-18T04:44:30.280941+0000","last_became_peered":"2024-04-18T04:44:30.280941+0000","last_unstale":"2024-04-18T04:55:19.470009+0000","last_undegraded":"2024-04-18T04:55:19.470009+0000","last_fullsized":"2024-04-18T04:55:19.470009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"32'8","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:26.129887+0000","last_change":"2024-04-18T04:44:30.288507+0000","last_active":"2024-04-18T04:55:26.129887+0000","last_peered":"2024-04-18T04:55:26.129887+0000","last_clean":"2024-04-18T04:55:26.129887+0000","last_became_active":"2024-04-18T04:44:30.287820+0000","last_became_peered":"2024-04-18T04:44:30.287820+0000","last_unstale":"2024-04-18T04:55:26.129887+0000","last_undegraded":"2024-04-18T04:55:26.129887+0000","last_fullsized":"2024-04-18T04:55:26.129887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:25:29.500586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"32'7","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:33.440557+0000","last_change":"2024-04-18T04:55:33.440693+0000","last_active":"2024-04-18T04:55:33.440557+0000","last_peered":"2024-04-18T04:55:33.440557+0000","last_clean":"2024-04-18T04:55:33.440557+0000","last_became_active":"2024-04-18T04:44:30.272973+0000","last_became_peered":"2024-04-18T04:44:30.272973+0000","last_unstale":"2024-04-18T04:55:33.440557+0000","last_undegraded":"2024-04-18T04:55:33.440557+0000","last_fullsized":"2024-04-18T04:55:33.440557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-04-18T04:55:33.440498+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-04-18T04:55:33.440498+0000","last_clean_scrub_stamp":"2024-04-18T04:55:33.440498+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:02:28.528382+0000","scrub_duration":0.0040422899999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'6","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:31.048656+0000","last_change":"2024-04-18T04:44:30.298936+0000","last_active":"2024-04-18T04:55:31.048656+0000","last_peered":"2024-04-18T04:55:31.048656+0000","last_clean":"2024-04-18T04:55:31.048656+0000","last_became_active":"2024-04-18T04:44:30.298637+0000","last_became_peered":"2024-04-18T04:44:30.298637+0000","last_unstale":"2024-04-18T04:55:31.048656+0000","last_undegraded":"2024-04-18T04:55:31.048656+0000","last_fullsized":"2024-04-18T04:55:31.048656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"32'8","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:22.984263+0000","last_change":"2024-04-18T04:44:30.274613+0000","last_active":"2024-04-18T04:55:22.984263+0000","last_peered":"2024-04-18T04:55:22.984263+0000","last_clean":"2024-04-18T04:55:22.984263+0000","last_became_active":"2024-04-18T04:44:30.274328+0000","last_became_peered":"2024-04-18T04:44:30.274328+0000","last_unstale":"2024-04-18T04:55:22.984263+0000","last_undegraded":"2024-04-18T04:55:22.984263+0000","last_fullsized":"2024-04-18T04:55:22.984263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:55:41.700955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"32'10","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:23.715434+0000","last_change":"2024-04-18T04:44:30.309403+0000","last_active":"2024-04-18T04:55:23.715434+0000","last_peered":"2024-04-18T04:55:23.715434+0000","last_clean":"2024-04-18T04:55:23.715434+0000","last_became_active":"2024-04-18T04:44:30.308415+0000","last_became_peered":"2024-04-18T04:44:30.308415+0000","last_unstale":"2024-04-18T04:55:23.715434+0000","last_undegraded":"2024-04-18T04:55:23.715434+0000","last_fullsized":"2024-04-18T04:55:23.715434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:51:58.935503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"32'3","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:31.670686+0000","last_change":"2024-04-18T04:44:30.293996+0000","last_active":"2024-04-18T04:55:31.670686+0000","last_peered":"2024-04-18T04:55:31.670686+0000","last_clean":"2024-04-18T04:55:31.670686+0000","last_became_active":"2024-04-18T04:44:30.293748+0000","last_became_peered":"2024-04-18T04:44:30.293748+0000","last_unstale":"2024-04-18T04:55:31.670686+0000","last_undegraded":"2024-04-18T04:55:31.670686+0000","last_fullsized":"2024-04-18T04:55:31.670686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'6","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:56.025488+0000","last_change":"2024-04-18T04:45:12.040362+0000","last_active":"2024-04-18T04:53:56.025488+0000","last_peered":"2024-04-18T04:53:56.025488+0000","last_clean":"2024-04-18T04:53:56.025488+0000","last_became_active":"2024-04-18T04:45:12.040045+0000","last_became_peered":"2024-04-18T04:45:12.040045+0000","last_unstale":"2024-04-18T04:53:56.025488+0000","last_undegraded":"2024-04-18T04:53:56.025488+0000","last_fullsized":"2024-04-18T04:53:56.025488+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"27'6","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:31.969356+0000","last_change":"2024-04-18T04:44:30.285836+0000","last_active":"2024-04-18T04:53:31.969356+0000","last_peered":"2024-04-18T04:53:31.969356+0000","last_clean":"2024-04-18T04:53:31.969356+0000","last_became_active":"2024-04-18T04:44:30.285602+0000","last_became_peered":"2024-04-18T04:44:30.285602+0000","last_unstale":"2024-04-18T04:53:31.969356+0000","last_undegraded":"2024-04-18T04:53:31.969356+0000","last_fullsized":"2024-04-18T04:53:31.969356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"32'12","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:33.144334+0000","last_change":"2024-04-18T04:45:12.040347+0000","last_active":"2024-04-18T04:55:33.144334+0000","last_peered":"2024-04-18T04:55:33.144334+0000","last_clean":"2024-04-18T04:55:33.144334+0000","last_became_active":"2024-04-18T04:45:12.040023+0000","last_became_peered":"2024-04-18T04:45:12.040023+0000","last_unstale":"2024-04-18T04:55:33.144334+0000","last_undegraded":"2024-04-18T04:55:33.144334+0000","last_fullsized":"2024-04-18T04:55:33.144334+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"32'13","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:21.261126+0000","last_change":"2024-04-18T04:44:30.310229+0000","last_active":"2024-04-18T04:55:21.261126+0000","last_peered":"2024-04-18T04:55:21.261126+0000","last_clean":"2024-04-18T04:55:21.261126+0000","last_became_active":"2024-04-18T04:44:30.310045+0000","last_became_peered":"2024-04-18T04:44:30.310045+0000","last_unstale":"2024-04-18T04:55:21.261126+0000","last_undegraded":"2024-04-18T04:55:21.261126+0000","last_fullsized":"2024-04-18T04:55:21.261126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"32'7","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:33.397879+0000","last_change":"2024-04-18T04:44:30.305644+0000","last_active":"2024-04-18T04:53:33.397879+0000","last_peered":"2024-04-18T04:53:33.397879+0000","last_clean":"2024-04-18T04:53:33.397879+0000","last_became_active":"2024-04-18T04:44:30.304921+0000","last_became_peered":"2024-04-18T04:44:30.304921+0000","last_unstale":"2024-04-18T04:53:33.397879+0000","last_undegraded":"2024-04-18T04:53:33.397879+0000","last_fullsized":"2024-04-18T04:53:33.397879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:17:37.235711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"32'9","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:17.160376+0000","last_change":"2024-04-18T04:44:30.294105+0000","last_active":"2024-04-18T04:55:17.160376+0000","last_peered":"2024-04-18T04:55:17.160376+0000","last_clean":"2024-04-18T04:55:17.160376+0000","last_became_active":"2024-04-18T04:44:30.291742+0000","last_became_peered":"2024-04-18T04:44:30.291742+0000","last_unstale":"2024-04-18T04:55:17.160376+0000","last_undegraded":"2024-04-18T04:55:17.160376+0000","last_fullsized":"2024-04-18T04:55:17.160376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:43:26.428261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"32'13","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:19.338982+0000","last_change":"2024-04-18T04:44:30.296496+0000","last_active":"2024-04-18T04:55:19.338982+0000","last_peered":"2024-04-18T04:55:19.338982+0000","last_clean":"2024-04-18T04:55:19.338982+0000","last_became_active":"2024-04-18T04:44:30.296177+0000","last_became_peered":"2024-04-18T04:44:30.296177+0000","last_unstale":"2024-04-18T04:55:19.338982+0000","last_undegraded":"2024-04-18T04:55:19.338982+0000","last_fullsized":"2024-04-18T04:55:19.338982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"32'10","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:12.557481+0000","last_change":"2024-04-18T04:44:30.306568+0000","last_active":"2024-04-18T04:55:12.557481+0000","last_peered":"2024-04-18T04:55:12.557481+0000","last_clean":"2024-04-18T04:55:12.557481+0000","last_became_active":"2024-04-18T04:44:30.305674+0000","last_became_peered":"2024-04-18T04:44:30.305674+0000","last_unstale":"2024-04-18T04:55:12.557481+0000","last_undegraded":"2024-04-18T04:55:12.557481+0000","last_fullsized":"2024-04-18T04:55:12.557481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:58:10.740164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"32'9","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:53.219717+0000","last_change":"2024-04-18T04:44:30.307297+0000","last_active":"2024-04-18T04:53:53.219717+0000","last_peered":"2024-04-18T04:53:53.219717+0000","last_clean":"2024-04-18T04:53:53.219717+0000","last_became_active":"2024-04-18T04:44:30.305470+0000","last_became_peered":"2024-04-18T04:44:30.305470+0000","last_unstale":"2024-04-18T04:53:53.219717+0000","last_undegraded":"2024-04-18T04:53:53.219717+0000","last_fullsized":"2024-04-18T04:53:53.219717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:01:00.587115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"32'8","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:00.541342+0000","last_change":"2024-04-18T04:44:30.280849+0000","last_active":"2024-04-18T04:54:00.541342+0000","last_peered":"2024-04-18T04:54:00.541342+0000","last_clean":"2024-04-18T04:54:00.541342+0000","last_became_active":"2024-04-18T04:44:30.280535+0000","last_became_peered":"2024-04-18T04:44:30.280535+0000","last_unstale":"2024-04-18T04:54:00.541342+0000","last_undegraded":"2024-04-18T04:54:00.541342+0000","last_fullsized":"2024-04-18T04:54:00.541342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:01:06.241941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"28'6","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:55.994098+0000","last_change":"2024-04-18T04:44:30.278849+0000","last_active":"2024-04-18T04:53:55.994098+0000","last_peered":"2024-04-18T04:53:55.994098+0000","last_clean":"2024-04-18T04:53:55.994098+0000","last_became_active":"2024-04-18T04:44:30.278624+0000","last_became_peered":"2024-04-18T04:44:30.278624+0000","last_unstale":"2024-04-18T04:53:55.994098+0000","last_undegraded":"2024-04-18T04:53:55.994098+0000","last_fullsized":"2024-04-18T04:53:55.994098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"32'11","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:23.582924+0000","last_change":"2024-04-18T04:44:30.296148+0000","last_active":"2024-04-18T04:55:23.582924+0000","last_peered":"2024-04-18T04:55:23.582924+0000","last_clean":"2024-04-18T04:55:23.582924+0000","last_became_active":"2024-04-18T04:44:30.295754+0000","last_became_peered":"2024-04-18T04:44:30.295754+0000","last_unstale":"2024-04-18T04:55:23.582924+0000","last_undegraded":"2024-04-18T04:55:23.582924+0000","last_fullsized":"2024-04-18T04:55:23.582924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"32'4","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:13.881674+0000","last_change":"2024-04-18T04:44:30.298061+0000","last_active":"2024-04-18T04:54:13.881674+0000","last_peered":"2024-04-18T04:54:13.881674+0000","last_clean":"2024-04-18T04:54:13.881674+0000","last_became_active":"2024-04-18T04:44:30.297416+0000","last_became_peered":"2024-04-18T04:44:30.297416+0000","last_unstale":"2024-04-18T04:54:13.881674+0000","last_undegraded":"2024-04-18T04:54:13.881674+0000","last_fullsized":"2024-04-18T04:54:13.881674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:35:48.612670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"32'10","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:13.568254+0000","last_change":"2024-04-18T04:44:30.292802+0000","last_active":"2024-04-18T04:54:13.568254+0000","last_peered":"2024-04-18T04:54:13.568254+0000","last_clean":"2024-04-18T04:54:13.568254+0000","last_became_active":"2024-04-18T04:44:30.291939+0000","last_became_peered":"2024-04-18T04:44:30.291939+0000","last_unstale":"2024-04-18T04:54:13.568254+0000","last_undegraded":"2024-04-18T04:54:13.568254+0000","last_fullsized":"2024-04-18T04:54:13.568254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:33:04.689561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"32'15","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:24.491056+0000","last_change":"2024-04-18T04:44:30.309020+0000","last_active":"2024-04-18T04:55:24.491056+0000","last_peered":"2024-04-18T04:55:24.491056+0000","last_clean":"2024-04-18T04:55:24.491056+0000","last_became_active":"2024-04-18T04:44:30.307604+0000","last_became_peered":"2024-04-18T04:44:30.307604+0000","last_unstale":"2024-04-18T04:55:24.491056+0000","last_undegraded":"2024-04-18T04:55:24.491056+0000","last_fullsized":"2024-04-18T04:55:24.491056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:44:54.764284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"32'11","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:12.485930+0000","last_change":"2024-04-18T04:44:30.314533+0000","last_active":"2024-04-18T04:54:12.485930+0000","last_peered":"2024-04-18T04:54:12.485930+0000","last_clean":"2024-04-18T04:54:12.485930+0000","last_became_active":"2024-04-18T04:44:30.313985+0000","last_became_peered":"2024-04-18T04:44:30.313985+0000","last_unstale":"2024-04-18T04:54:12.485930+0000","last_undegraded":"2024-04-18T04:54:12.485930+0000","last_fullsized":"2024-04-18T04:54:12.485930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:02:03.941709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"32'8","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:29.810210+0000","last_change":"2024-04-18T04:44:30.309273+0000","last_active":"2024-04-18T04:55:29.810210+0000","last_peered":"2024-04-18T04:55:29.810210+0000","last_clean":"2024-04-18T04:55:29.810210+0000","last_became_active":"2024-04-18T04:44:30.309002+0000","last_became_peered":"2024-04-18T04:44:30.309002+0000","last_unstale":"2024-04-18T04:55:29.810210+0000","last_undegraded":"2024-04-18T04:55:29.810210+0000","last_fullsized":"2024-04-18T04:55:29.810210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'6","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.040583+0000","last_change":"2024-04-18T04:44:30.292371+0000","last_active":"2024-04-18T04:53:26.040583+0000","last_peered":"2024-04-18T04:53:26.040583+0000","last_clean":"2024-04-18T04:53:26.040583+0000","last_became_active":"2024-04-18T04:44:30.290504+0000","last_became_peered":"2024-04-18T04:44:30.290504+0000","last_unstale":"2024-04-18T04:53:26.040583+0000","last_undegraded":"2024-04-18T04:53:26.040583+0000","last_fullsized":"2024-04-18T04:53:26.040583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:11.998355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"32'8","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:13.246271+0000","last_change":"2024-04-18T04:44:30.299935+0000","last_active":"2024-04-18T04:55:13.246271+0000","last_peered":"2024-04-18T04:55:13.246271+0000","last_clean":"2024-04-18T04:55:13.246271+0000","last_became_active":"2024-04-18T04:44:30.290175+0000","last_became_peered":"2024-04-18T04:44:30.290175+0000","last_unstale":"2024-04-18T04:55:13.246271+0000","last_undegraded":"2024-04-18T04:55:13.246271+0000","last_fullsized":"2024-04-18T04:55:13.246271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:15:13.703423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"32'4","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:32.488111+0000","last_change":"2024-04-18T04:44:30.288940+0000","last_active":"2024-04-18T04:54:32.488111+0000","last_peered":"2024-04-18T04:54:32.488111+0000","last_clean":"2024-04-18T04:54:32.488111+0000","last_became_active":"2024-04-18T04:44:30.288131+0000","last_became_peered":"2024-04-18T04:44:30.288131+0000","last_unstale":"2024-04-18T04:54:32.488111+0000","last_undegraded":"2024-04-18T04:54:32.488111+0000","last_fullsized":"2024-04-18T04:54:32.488111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:31:08.895305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"32'9","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:28.692141+0000","last_change":"2024-04-18T04:44:30.288066+0000","last_active":"2024-04-18T04:55:28.692141+0000","last_peered":"2024-04-18T04:55:28.692141+0000","last_clean":"2024-04-18T04:55:28.692141+0000","last_became_active":"2024-04-18T04:44:30.287325+0000","last_became_peered":"2024-04-18T04:44:30.287325+0000","last_unstale":"2024-04-18T04:55:28.692141+0000","last_undegraded":"2024-04-18T04:55:28.692141+0000","last_fullsized":"2024-04-18T04:55:28.692141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:58:04.111225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"32'5","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:20.475046+0000","last_change":"2024-04-18T04:44:30.275485+0000","last_active":"2024-04-18T04:55:20.475046+0000","last_peered":"2024-04-18T04:55:20.475046+0000","last_clean":"2024-04-18T04:55:20.475046+0000","last_became_active":"2024-04-18T04:44:30.275118+0000","last_became_peered":"2024-04-18T04:44:30.275118+0000","last_unstale":"2024-04-18T04:55:20.475046+0000","last_undegraded":"2024-04-18T04:55:20.475046+0000","last_fullsized":"2024-04-18T04:55:20.475046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'2","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:53:26.060440+0000","last_change":"2024-04-18T04:44:30.277119+0000","last_active":"2024-04-18T04:53:26.060440+0000","last_peered":"2024-04-18T04:53:26.060440+0000","last_clean":"2024-04-18T04:53:26.060440+0000","last_became_active":"2024-04-18T04:44:30.276654+0000","last_became_peered":"2024-04-18T04:44:30.276654+0000","last_unstale":"2024-04-18T04:53:26.060440+0000","last_undegraded":"2024-04-18T04:53:26.060440+0000","last_fullsized":"2024-04-18T04:53:26.060440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:52.420199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"32'10","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:54:57.496321+0000","last_change":"2024-04-18T04:44:30.302905+0000","last_active":"2024-04-18T04:54:57.496321+0000","last_peered":"2024-04-18T04:54:57.496321+0000","last_clean":"2024-04-18T04:54:57.496321+0000","last_became_active":"2024-04-18T04:44:30.302180+0000","last_became_peered":"2024-04-18T04:44:30.302180+0000","last_unstale":"2024-04-18T04:54:57.496321+0000","last_undegraded":"2024-04-18T04:54:57.496321+0000","last_fullsized":"2024-04-18T04:54:57.496321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:41:53.211956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1865386166,"num_objects":637,"num_object_clones":0,"num_object_copies":2548,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":637,"num_whiteouts":0,"num_read":129,"num_read_kb":11,"num_write":2194495,"num_write_kb":31163048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1894326272,"data_stored":4045225984,"data_compressed":231428316,"data_compressed_allocated":881168384,"data_compressed_original":3032068096,"omap_allocated":0,"internal_metadata":0},"log_size":149308,"ondisk_log_size":149308,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":521,"ondisk_log_size":521,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":81164485,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":422,"num_read_kb":74892,"num_write":3457,"num_write_kb":80224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":37855232,"data_stored":162328970,"data_compressed":18251382,"data_compressed_allocated":21430272,"data_compressed_original":146063360,"omap_allocated":0,"internal_metadata":0},"log_size":3392,"ondisk_log_size":3392,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66624,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509576,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1233600,"kb_used_data":267520,"kb_used_omap":1,"kb_used_meta":964862,"kb_avail":93138240,"statfs":{"total":96636764160,"available":95373557760,"internally_reserved":0,"allocated":273940480,"data_stored":580352971,"data_compressed":33727414,"data_compressed_allocated":126205952,"data_compressed_original":432832512,"omap_allocated":1592,"internal_metadata":988019144},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:54:39 2024","interfaces":[{"interface":"back","average":{"1min":4.0309999999999997,"5min":6.7530000000000001,"15min":3.347},"min":{"1min":0.52900000000000003,"5min":0.26200000000000001,"15min":0.252},"max":{"1min":15.353,"5min":76.096999999999994,"15min":76.096999999999994},"last":0.40899999999999997},{"interface":"front","average":{"1min":4.7009999999999996,"5min":8.4860000000000007,"15min":3.7530000000000001},"min":{"1min":0.38500000000000001,"5min":0.254,"15min":0.254},"max":{"1min":15.515000000000001,"5min":184.16999999999999,"15min":184.16999999999999},"last":0.438}]},{"osd":1,"last update":"Thu Apr 18 04:54:39 2024","interfaces":[{"interface":"back","average":{"1min":4.7480000000000002,"5min":7.343,"15min":4.3520000000000003},"min":{"1min":0.38700000000000001,"5min":0.34699999999999998,"15min":0.24299999999999999},"max":{"1min":18.978999999999999,"5min":85.109999999999999,"15min":153.59299999999999},"last":0.374},{"interface":"front","average":{"1min":5.1680000000000001,"5min":5.9489999999999998,"15min":4.0469999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.29199999999999998},"max":{"1min":20.414999999999999,"5min":88.606999999999999,"15min":153.94300000000001},"last":0.47699999999999998}]},{"osd":2,"last update":"Thu Apr 18 04:54:39 2024","interfaces":[{"interface":"back","average":{"1min":3.8010000000000002,"5min":3.6190000000000002,"15min":2.6429999999999998},"min":{"1min":0.58899999999999997,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":19.745000000000001,"5min":23.867000000000001,"15min":162.59700000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":4.8499999999999996,"5min":4.5759999999999996,"15min":2.9590000000000001},"min":{"1min":0.46000000000000002,"5min":0.309,"15min":0.309},"max":{"1min":19.707999999999998,"5min":28.335000000000001,"15min":153.83500000000001},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Apr 18 04:54:39 2024","interfaces":[{"interface":"back","average":{"1min":3.2789999999999999,"5min":2.847,"15min":1.7450000000000001},"min":{"1min":0.433,"5min":0.43099999999999999,"15min":0.40000000000000002},"max":{"1min":12.050000000000001,"5min":31.974,"15min":31.974},"last":0.72999999999999998},{"interface":"front","average":{"1min":3.802,"5min":5.0670000000000002,"15min":2.718},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":15.006,"5min":50.536000000000001,"15min":50.536000000000001},"last":0.61399999999999999}]},{"osd":5,"last update":"Thu Apr 18 04:54:39 2024","interfaces":[{"interface":"back","average":{"1min":3.456,"5min":3.7509999999999999,"15min":2.3279999999999998},"min":{"1min":0.40899999999999997,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":12.981,"5min":40.915999999999997,"15min":40.915999999999997},"last":0.63600000000000001},{"interface":"front","average":{"1min":3.4169999999999998,"5min":2.6850000000000001,"15min":1.9710000000000001},"min":{"1min":0.59499999999999997,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":18.103000000000002,"5min":18.103000000000002,"15min":68.370000000000005},"last":0.56499999999999995}]},{"osd":6,"last update":"Thu Apr 18 04:54:39 2024","interfaces":[{"interface":"back","average":{"1min":3.3959999999999999,"5min":3.5880000000000001,"15min":2.2360000000000002},"min":{"1min":0.60899999999999999,"5min":0.45100000000000001,"15min":0.39900000000000002},"max":{"1min":17.058,"5min":28.748000000000001,"15min":48.765000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":3.4129999999999998,"5min":4.7320000000000002,"15min":2.593},"min":{"1min":0.68400000000000005,"5min":0.47199999999999998,"15min":0.38900000000000001},"max":{"1min":12.656000000000001,"5min":69.227999999999994,"15min":69.227999999999994},"last":0.81200000000000006}]},{"osd":7,"last update":"Thu Apr 18 04:54:39 2024","interfaces":[{"interface":"back","average":{"1min":3.77,"5min":3.2320000000000002,"15min":2.1030000000000002},"min":{"1min":0.49199999999999999,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":18.795000000000002,"5min":40.947000000000003,"15min":40.947000000000003},"last":0.68600000000000005},{"interface":"front","average":{"1min":3.331,"5min":3.3410000000000002,"15min":2.2200000000000002},"min":{"1min":0.65000000000000002,"5min":0.54500000000000004,"15min":0.44400000000000001},"max":{"1min":17.122,"5min":19.512,"15min":68.329999999999998},"last":0.65500000000000003}]}]},{"osd":2,"up_from":15,"seq":64424509577,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":662660,"kb_used_data":108220,"kb_used_omap":1,"kb_used_meta":554430,"kb_avail":93709180,"statfs":{"total":96636764160,"available":95958200320,"internally_reserved":0,"allocated":110817280,"data_stored":242280270,"data_compressed":13998670,"data_compressed_allocated":51671040,"data_compressed_original":183349248,"omap_allocated":1594,"internal_metadata":567736774},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":3.7570000000000001,"5min":4.9139999999999997,"15min":3.3690000000000002},"min":{"1min":0.66300000000000003,"5min":0.248,"15min":0.23300000000000001},"max":{"1min":15.831,"5min":37.567,"15min":120.402},"last":2.661},{"interface":"front","average":{"1min":4.2869999999999999,"5min":5.6310000000000002,"15min":3.327},"min":{"1min":0.432,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":30.812999999999999,"5min":58.277999999999999,"15min":121.377},"last":0.36799999999999999}]},{"osd":1,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":3.4889999999999999,"5min":5.6909999999999998,"15min":3.7650000000000001},"min":{"1min":0.51100000000000001,"5min":0.32300000000000001,"15min":0.28399999999999997},"max":{"1min":8.5229999999999997,"5min":62.851999999999997,"15min":135.32400000000001},"last":0.32700000000000001},{"interface":"front","average":{"1min":3.3100000000000001,"5min":5.548,"15min":3.8370000000000002},"min":{"1min":0.64100000000000001,"5min":0.35599999999999998,"15min":0.27600000000000002},"max":{"1min":11.401,"5min":60.741999999999997,"15min":178.08199999999999},"last":0.503}]},{"osd":3,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":5.8479999999999999,"5min":5.0250000000000004,"15min":3.1509999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.35999999999999999},"max":{"1min":65.037000000000006,"5min":65.037000000000006,"15min":124.76300000000001},"last":4.0519999999999996},{"interface":"front","average":{"1min":7.4370000000000003,"5min":5.7990000000000004,"15min":3.5},"min":{"1min":0.53700000000000003,"5min":0.36699999999999999,"15min":0.33000000000000002},"max":{"1min":70.861999999999995,"5min":70.861999999999995,"15min":145.47200000000001},"last":3.4580000000000002}]},{"osd":4,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":2.944,"5min":3.931,"15min":2.298},"min":{"1min":0.49399999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":10.182,"5min":37.420000000000002,"15min":37.420000000000002},"last":2.621},{"interface":"front","average":{"1min":2.9249999999999998,"5min":3.5760000000000001,"15min":2.1749999999999998},"min":{"1min":0.65600000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":10.327999999999999,"5min":37.460000000000001,"15min":37.460000000000001},"last":6.8719999999999999}]},{"osd":5,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":3.0059999999999998,"5min":3.6850000000000001,"15min":2.1160000000000001},"min":{"1min":0.621,"5min":0.38,"15min":0.32700000000000001},"max":{"1min":10.250999999999999,"5min":37.5,"15min":37.5},"last":2.7480000000000002},{"interface":"front","average":{"1min":1.6419999999999999,"5min":3.331,"15min":2.1219999999999999},"min":{"1min":0.44700000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":6.2000000000000002,"5min":28.143000000000001,"15min":28.143000000000001},"last":6.2489999999999997}]},{"osd":6,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":3.2109999999999999,"5min":3.5619999999999998,"15min":2.2469999999999999},"min":{"1min":0.74199999999999999,"5min":0.47499999999999998,"15min":0.441},"max":{"1min":10.359999999999999,"5min":24.103000000000002,"15min":34.506999999999998},"last":4.069},{"interface":"front","average":{"1min":2.2200000000000002,"5min":3.75,"15min":2.2869999999999999},"min":{"1min":0.56200000000000006,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":5.6909999999999998,"5min":37.533000000000001,"15min":37.533000000000001},"last":4.0890000000000004}]},{"osd":7,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":2.5550000000000002,"5min":3.4169999999999998,"15min":2.0649999999999999},"min":{"1min":0.53200000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":6.0209999999999999,"5min":24.155000000000001,"15min":24.155000000000001},"last":5.1509999999999998},{"interface":"front","average":{"1min":1.5569999999999999,"5min":3.1360000000000001,"15min":2.125},"min":{"1min":0.52800000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":5.0099999999999998,"5min":26.064,"15min":34.576999999999998},"last":5.2679999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509574,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1419992,"kb_used_data":426420,"kb_used_omap":1,"kb_used_meta":992574,"kb_avail":92951848,"statfs":{"total":96636764160,"available":95182692352,"internally_reserved":0,"allocated":436654080,"data_stored":945067739,"data_compressed":55432483,"data_compressed_allocated":204931072,"data_compressed_original":713560064,"omap_allocated":1594,"internal_metadata":1016396230},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:54:40 2024","interfaces":[{"interface":"back","average":{"1min":2.347,"5min":5.9189999999999996,"15min":3.3500000000000001},"min":{"1min":0.26000000000000001,"5min":0.22,"15min":0.22},"max":{"1min":11.497999999999999,"5min":124.096,"15min":124.096},"last":0.28000000000000003},{"interface":"front","average":{"1min":3.9830000000000001,"5min":7.2380000000000004,"15min":4.0640000000000001},"min":{"1min":0.44500000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":14.279,"5min":143.60300000000001,"15min":164.41},"last":0.47199999999999998}]},{"osd":2,"last update":"Thu Apr 18 04:54:40 2024","interfaces":[{"interface":"back","average":{"1min":3.79,"5min":4.7270000000000003,"15min":5.9119999999999999},"min":{"1min":0.48499999999999999,"5min":0.33700000000000002,"15min":0.29299999999999998},"max":{"1min":11.513,"5min":25.558,"15min":840.66700000000003},"last":0.45700000000000002},{"interface":"front","average":{"1min":3.036,"5min":5.9249999999999998,"15min":3.722},"min":{"1min":0.44600000000000001,"5min":0.33600000000000002,"15min":0.33400000000000002},"max":{"1min":11.717000000000001,"5min":114.47199999999999,"15min":164.477},"last":0.437}]},{"osd":3,"last update":"Thu Apr 18 04:54:40 2024","interfaces":[{"interface":"back","average":{"1min":2.9220000000000002,"5min":6.6210000000000004,"15min":4.7510000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":11.66,"5min":88.673000000000002,"15min":164.50299999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":3.9239999999999999,"5min":8.1709999999999994,"15min":4.8360000000000003},"min":{"1min":0.5,"5min":0.39800000000000002,"15min":0.36899999999999999},"max":{"1min":14.032999999999999,"5min":151.82599999999999,"15min":151.82599999999999},"last":0.50800000000000001}]},{"osd":4,"last update":"Thu Apr 18 04:54:40 2024","interfaces":[{"interface":"back","average":{"1min":2.7000000000000002,"5min":3.851,"15min":2.637},"min":{"1min":0.45900000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":9.6219999999999999,"5min":23.478999999999999,"15min":52.072000000000003},"last":0.53900000000000003},{"interface":"front","average":{"1min":2.1459999999999999,"5min":4.5490000000000004,"15min":5.5670000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.34399999999999997},"max":{"1min":11.691000000000001,"5min":33.017000000000003,"15min":840.61500000000001},"last":0.70399999999999996}]},{"osd":5,"last update":"Thu Apr 18 04:54:40 2024","interfaces":[{"interface":"back","average":{"1min":3.6099999999999999,"5min":5.6520000000000001,"15min":4.5860000000000003},"min":{"1min":0.46500000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":14.146000000000001,"5min":114.37,"15min":478.47000000000003},"last":0.83199999999999996},{"interface":"front","average":{"1min":3.887,"5min":4.1609999999999996,"15min":3.0859999999999999},"min":{"1min":0.52700000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":14.176,"5min":41.832000000000001,"15min":164.374},"last":0.77800000000000002}]},{"osd":6,"last update":"Thu Apr 18 04:54:40 2024","interfaces":[{"interface":"back","average":{"1min":3.242,"5min":4.0090000000000003,"15min":2.742},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":14.496,"5min":23.416,"15min":52.100999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":2.5070000000000001,"5min":4.0839999999999996,"15min":3.782},"min":{"1min":0.55500000000000005,"5min":0.49399999999999999,"15min":0.438},"max":{"1min":11.625,"5min":25.809999999999999,"15min":396.81},"last":0.84799999999999998}]},{"osd":7,"last update":"Thu Apr 18 04:54:40 2024","interfaces":[{"interface":"back","average":{"1min":3.6680000000000001,"5min":5.6479999999999997,"15min":3.581},"min":{"1min":0.499,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":14.105,"5min":100.565,"15min":164.447},"last":0.80500000000000005},{"interface":"front","average":{"1min":3.5190000000000001,"5min":3.996,"15min":2.698},"min":{"1min":0.48999999999999999,"5min":0.46200000000000002,"15min":0.45400000000000001},"max":{"1min":14.558,"5min":23.648,"15min":54.353000000000002},"last":0.61099999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542283,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":999388,"kb_used_data":328660,"kb_used_omap":1,"kb_used_meta":670718,"kb_avail":93372452,"statfs":{"total":96636764160,"available":95613390848,"internally_reserved":0,"allocated":336547840,"data_stored":717958438,"data_compressed":42642948,"data_compressed_allocated":153939968,"data_compressed_original":535568384,"omap_allocated":1589,"internal_metadata":686815691},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:55:30 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":5.391,"15min":3.7480000000000002},"min":{"1min":0.29099999999999998,"5min":0.249,"15min":0.249},"max":{"1min":6.2889999999999997,"5min":195.89500000000001,"15min":287.19600000000003},"last":0.56399999999999995},{"interface":"front","average":{"1min":1.724,"5min":5.8419999999999996,"15min":4.1289999999999996},"min":{"1min":0.31900000000000001,"5min":0.26800000000000002,"15min":0.26200000000000001},"max":{"1min":6.5590000000000002,"5min":196.149,"15min":289.23899999999998},"last":0.72199999999999998}]},{"osd":1,"last update":"Thu Apr 18 04:54:48 2024","interfaces":[{"interface":"back","average":{"1min":6.774,"5min":4.2729999999999997,"15min":3.5590000000000002},"min":{"1min":0.34799999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":90.055000000000007,"5min":90.055000000000007,"15min":303.83800000000002},"last":0.99399999999999999},{"interface":"front","average":{"1min":7.1840000000000002,"5min":5.3330000000000002,"15min":3.6709999999999998},"min":{"1min":0.45400000000000001,"5min":0.34499999999999997,"15min":0.32000000000000001},"max":{"1min":90.001999999999995,"5min":90.001999999999995,"15min":288.05799999999999},"last":1.0129999999999999}]},{"osd":2,"last update":"Thu Apr 18 04:54:48 2024","interfaces":[{"interface":"back","average":{"1min":6.0229999999999997,"5min":3.585,"15min":2.3010000000000002},"min":{"1min":0.374,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":91.088999999999999,"5min":91.088999999999999,"15min":91.088999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":6.2089999999999996,"5min":3.0259999999999998,"15min":1.8799999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":91.171999999999997,"5min":91.171999999999997,"15min":91.171999999999997},"last":0.65200000000000002}]},{"osd":3,"last update":"Thu Apr 18 04:54:48 2024","interfaces":[{"interface":"back","average":{"1min":7.5279999999999996,"5min":4.2400000000000002,"15min":3.7999999999999998},"min":{"1min":0.36699999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":89.393000000000001,"5min":89.393000000000001,"15min":308.36700000000002},"last":0.78400000000000003},{"interface":"front","average":{"1min":6.0540000000000003,"5min":3.7349999999999999,"15min":3.1829999999999998},"min":{"1min":0.36799999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":88.070999999999998,"5min":88.070999999999998,"15min":289.86099999999999},"last":0.92600000000000005}]},{"osd":4,"last update":"Thu Apr 18 04:55:30 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":1.333,"15min":1.1559999999999999},"min":{"1min":0.317,"5min":0.25900000000000001,"15min":0.252},"max":{"1min":1.627,"5min":41.567,"15min":41.567},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.91700000000000004,"5min":1.4099999999999999,"15min":1.141},"min":{"1min":0.34699999999999998,"5min":0.29699999999999999,"15min":0.247},"max":{"1min":3.8860000000000001,"5min":45.646000000000001,"15min":45.646000000000001},"last":1.101}]},{"osd":5,"last update":"Thu Apr 18 04:55:30 2024","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.538,"15min":1.1859999999999999},"min":{"1min":0.30499999999999999,"5min":0.27000000000000002,"15min":0.26600000000000001},"max":{"1min":11.045,"5min":41.595999999999997,"15min":41.595999999999997},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.155,"15min":1.048},"min":{"1min":0.36199999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":11.082000000000001,"5min":15.271000000000001,"15min":15.271000000000001},"last":0.96699999999999997}]},{"osd":6,"last update":"Thu Apr 18 04:55:30 2024","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.1140000000000001,"15min":1.016},"min":{"1min":0.32000000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":6.3520000000000003,"5min":8.2390000000000008,"15min":8.2390000000000008},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.016,"5min":1.1379999999999999,"15min":1.069},"min":{"1min":0.34399999999999997,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":6.2329999999999997,"5min":11.288,"15min":11.288},"last":1.129}]}]},{"osd":6,"up_from":14,"seq":60129542281,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1121292,"kb_used_data":337348,"kb_used_omap":1,"kb_used_meta":783934,"kb_avail":93250548,"statfs":{"total":96636764160,"available":95488561152,"internally_reserved":0,"allocated":345444352,"data_stored":737504468,"data_compressed":43460466,"data_compressed_allocated":161660928,"data_compressed_original":553926656,"omap_allocated":1593,"internal_metadata":802748871},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":7.1710000000000003,"5min":2.77,"15min":1.667},"min":{"1min":0.36699999999999999,"5min":0.247,"15min":0.247},"max":{"1min":99.328999999999994,"5min":99.328999999999994,"15min":99.328999999999994},"last":0.46000000000000002},{"interface":"front","average":{"1min":7.202,"5min":3.3170000000000002,"15min":2.181},"min":{"1min":0.40300000000000002,"5min":0.309,"15min":0.309},"max":{"1min":99.287000000000006,"5min":99.287000000000006,"15min":99.287000000000006},"last":0.58699999999999997}]},{"osd":1,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":9.1219999999999999,"5min":5.085,"15min":2.8410000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":98.650999999999996,"5min":122.06999999999999,"15min":122.06999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":8.6890000000000001,"5min":4.649,"15min":2.6880000000000002},"min":{"1min":0.42799999999999999,"5min":0.33300000000000002,"15min":0.32800000000000001},"max":{"1min":98.683999999999997,"5min":122.09,"15min":122.09},"last":0.75700000000000001}]},{"osd":2,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":2.702,"5min":2.7919999999999998,"15min":1.835},"min":{"1min":0.33600000000000002,"5min":0.31,"15min":0.31},"max":{"1min":13.101000000000001,"5min":38.557000000000002,"15min":41.764000000000003},"last":0.501},{"interface":"front","average":{"1min":2.1640000000000001,"5min":2.8300000000000001,"15min":1.8919999999999999},"min":{"1min":0.373,"5min":0.35799999999999998,"15min":0.35199999999999998},"max":{"1min":10.993,"5min":35.734000000000002,"15min":41.710000000000001},"last":0.78800000000000003}]},{"osd":3,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":8.2070000000000007,"5min":3.9660000000000002,"15min":2.9119999999999999},"min":{"1min":0.39400000000000002,"5min":0.312,"15min":0.29999999999999999},"max":{"1min":101.006,"5min":101.006,"15min":101.006},"last":0.68400000000000005},{"interface":"front","average":{"1min":8.2420000000000009,"5min":4.0410000000000004,"15min":2.9980000000000002},"min":{"1min":0.437,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":101.039,"5min":101.039,"15min":101.039},"last":0.82999999999999996}]},{"osd":4,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":2.1829999999999998,"5min":1.6220000000000001,"15min":1.155},"min":{"1min":0.28599999999999998,"5min":0.217,"15min":0.217},"max":{"1min":17.401,"5min":19.481999999999999,"15min":19.481999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":2.2650000000000001,"5min":1.6200000000000001,"15min":1.234},"min":{"1min":0.33600000000000002,"5min":0.28199999999999997,"15min":0.26400000000000001},"max":{"1min":17.872,"5min":19.536999999999999,"15min":19.536999999999999},"last":0.86899999999999999}]},{"osd":5,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":0.90900000000000003,"15min":1.0389999999999999},"min":{"1min":0.27900000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":4.2050000000000001,"5min":13.538,"15min":13.538},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.05,"5min":0.95399999999999996,"15min":0.95199999999999996},"min":{"1min":0.35499999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":4.2350000000000003,"5min":8.7210000000000001,"15min":8.7210000000000001},"last":1.0129999999999999}]},{"osd":7,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":0.93400000000000005,"15min":1.0740000000000001},"min":{"1min":0.314,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":4.266,"5min":7.5359999999999996,"15min":7.5359999999999996},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.496,"5min":0.96299999999999997,"15min":1.036},"min":{"1min":0.35199999999999998,"5min":0.33500000000000002,"15min":0.314},"max":{"1min":10.955,"5min":10.955,"15min":10.955},"last":0.95599999999999996}]}]},{"osd":5,"up_from":14,"seq":60129542283,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":867424,"kb_used_data":250712,"kb_used_omap":1,"kb_used_meta":616702,"kb_avail":93504416,"statfs":{"total":96636764160,"available":95748521984,"internally_reserved":0,"allocated":256729088,"data_stored":555940093,"data_compressed":32853352,"data_compressed_allocated":119259136,"data_compressed_original":418684928,"omap_allocated":1593,"internal_metadata":631503303},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":6.1559999999999997,"5min":4.0069999999999997,"15min":2.343},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":81.960999999999999,"5min":84.305000000000007,"15min":84.305000000000007},"last":0.29799999999999999},{"interface":"front","average":{"1min":5.1970000000000001,"5min":4.0170000000000003,"15min":4.4409999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":82.180000000000007,"5min":86.994,"15min":553.95500000000004},"last":1.127}]},{"osd":1,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":5.4820000000000002,"5min":4.9640000000000004,"15min":4.6870000000000003},"min":{"1min":0.34899999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":81.361999999999995,"5min":87.989000000000004,"15min":553.36900000000003},"last":0.28100000000000003},{"interface":"front","average":{"1min":5.7640000000000002,"5min":4.6989999999999998,"15min":4.3010000000000002},"min":{"1min":0.32500000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":95.162000000000006,"5min":95.162000000000006,"15min":501.11000000000001},"last":0.502}]},{"osd":2,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":6.2830000000000004,"15min":3.1280000000000001},"min":{"1min":0.40300000000000002,"5min":0.34599999999999997,"15min":0.29799999999999999},"max":{"1min":6.8399999999999999,"5min":262.99700000000001,"15min":262.99700000000001},"last":0.629},{"interface":"front","average":{"1min":1.298,"5min":6.6760000000000002,"15min":3.3050000000000002},"min":{"1min":0.377,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":5.4320000000000004,"5min":259.24099999999999,"15min":259.24099999999999},"last":0.437}]},{"osd":3,"last update":"Thu Apr 18 04:54:39 2024","interfaces":[{"interface":"back","average":{"1min":5.4500000000000002,"5min":4.4909999999999997,"15min":2.6110000000000002},"min":{"1min":0.42099999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":84.394999999999996,"5min":84.394999999999996,"15min":84.394999999999996},"last":0.997},{"interface":"front","average":{"1min":5.54,"5min":4.593,"15min":2.8690000000000002},"min":{"1min":0.44900000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":83.763999999999996,"5min":86.834999999999994,"15min":86.834999999999994},"last":0.379}]},{"osd":4,"last update":"Thu Apr 18 04:54:39 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.749,"15min":0.83199999999999996},"min":{"1min":0.28100000000000003,"5min":0.246,"15min":0.246},"max":{"1min":1.2010000000000001,"5min":4.6440000000000001,"15min":4.6440000000000001},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":1.181,"15min":1.0600000000000001},"min":{"1min":0.36199999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":2.7599999999999998,"5min":12.888999999999999,"15min":12.888999999999999},"last":0.40400000000000003}]},{"osd":6,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.71599999999999997,"15min":0.874},"min":{"1min":0.31,"5min":0.252,"15min":0.252},"max":{"1min":3.306,"5min":4.6639999999999997,"15min":4.6639999999999997},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.96999999999999997,"15min":0.97899999999999998},"min":{"1min":0.32500000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":3.2850000000000001,"5min":12.694000000000001,"15min":12.694000000000001},"last":0.39600000000000002}]},{"osd":7,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.90500000000000003,"15min":1.018},"min":{"1min":0.34599999999999997,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.97599999999999998,"5min":12.74,"15min":12.74},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.89700000000000002,"5min":1.05,"15min":1.0429999999999999},"min":{"1min":0.40100000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":6.4630000000000001,"5min":27.658000000000001,"15min":27.658000000000001},"last":0.44600000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542283,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1040976,"kb_used_data":297544,"kb_used_omap":1,"kb_used_meta":743422,"kb_avail":93330864,"statfs":{"total":96636764160,"available":95570804736,"internally_reserved":0,"allocated":304685056,"data_stored":664050264,"data_compressed":39820654,"data_compressed_allocated":142872576,"data_compressed_original":502444032,"omap_allocated":1594,"internal_metadata":761264582},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,0,0,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":10.712,"5min":5.7519999999999998,"15min":2.8180000000000001},"min":{"1min":0.27700000000000002,"5min":0.25700000000000001,"15min":0.254},"max":{"1min":148.048,"5min":148.048,"15min":148.048},"last":1.9299999999999999},{"interface":"front","average":{"1min":9.0670000000000002,"5min":5.4290000000000003,"15min":2.8690000000000002},"min":{"1min":0.34899999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":144.72999999999999,"5min":144.72999999999999,"15min":144.72999999999999},"last":0.38200000000000001}]},{"osd":1,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":9.7420000000000009,"5min":8.516,"15min":4.0419999999999998},"min":{"1min":0.32200000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":158.56,"5min":158.56,"15min":158.56},"last":3.5960000000000001},{"interface":"front","average":{"1min":8.7690000000000001,"5min":7.3419999999999996,"15min":3.448},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":144.60400000000001,"5min":144.60400000000001,"15min":144.60400000000001},"last":3.5169999999999999}]},{"osd":2,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":3.9319999999999999,"15min":2.1949999999999998},"min":{"1min":0.379,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":4.5899999999999999,"5min":109.28,"15min":109.28},"last":1.756},{"interface":"front","average":{"1min":1.264,"5min":4.2400000000000002,"15min":2.21},"min":{"1min":0.34599999999999997,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":4.5419999999999998,"5min":109.242,"15min":109.242},"last":0.72099999999999997}]},{"osd":3,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":9.5440000000000005,"5min":7.0369999999999999,"15min":3.4500000000000002},"min":{"1min":0.45600000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":147.625,"5min":147.625,"15min":147.625},"last":7.5679999999999996},{"interface":"front","average":{"1min":9.9489999999999998,"5min":6.0170000000000003,"15min":3.355},"min":{"1min":0.41299999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":147.01599999999999,"5min":147.01599999999999,"15min":147.01599999999999},"last":4.319}]},{"osd":5,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":1.0860000000000001,"15min":1.0249999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":2.9670000000000001,"5min":19.143999999999998,"15min":19.143999999999998},"last":1.6819999999999999},{"interface":"front","average":{"1min":0.80300000000000005,"5min":1.1120000000000001,"15min":1.0249999999999999},"min":{"1min":0.29099999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":2.48,"5min":27.402999999999999,"15min":27.402999999999999},"last":1.728}]},{"osd":6,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.94899999999999995,"15min":1.0720000000000001},"min":{"1min":0.32700000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":3.113,"5min":8.8889999999999993,"15min":13.891999999999999},"last":4.0549999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":1.2330000000000001,"15min":1.133},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":2.5649999999999999,"5min":17.954999999999998,"15min":17.954999999999998},"last":0.67300000000000004}]},{"osd":7,"last update":"Thu Apr 18 04:54:36 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":1.484,"15min":1.1890000000000001},"min":{"1min":0.28899999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":3.0619999999999998,"5min":27.643000000000001,"15min":27.643000000000001},"last":1.6459999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":1.2130000000000001,"15min":1.107},"min":{"1min":0.34999999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":3.0920000000000001,"5min":18.800999999999998,"15min":18.800999999999998},"last":1.7070000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574985,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":740032,"kb_used_data":115680,"kb_used_omap":1,"kb_used_meta":622014,"kb_avail":93631808,"statfs":{"total":96636764160,"available":95878971392,"internally_reserved":0,"allocated":118456320,"data_stored":270116831,"data_compressed":16531500,"data_compressed_allocated":55255040,"data_compressed_original":207126528,"omap_allocated":1594,"internal_metadata":636942790},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,0,1,4],"upper_bound":128},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 04:54:44 2024","interfaces":[{"interface":"back","average":{"1min":3.5670000000000002,"5min":5.9139999999999997,"15min":2.839},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":30.347000000000001,"5min":55.061,"15min":55.061},"last":6.2759999999999998},{"interface":"front","average":{"1min":3.3919999999999999,"5min":6.6890000000000001,"15min":3.1659999999999999},"min":{"1min":0.377,"5min":0.309,"15min":0.28899999999999998},"max":{"1min":11.872,"5min":115.45099999999999,"15min":115.45099999999999},"last":6.2619999999999996}]},{"osd":2,"last update":"Thu Apr 18 04:54:41 2024","interfaces":[{"interface":"back","average":{"1min":2.9929999999999999,"5min":3.1360000000000001,"15min":1.782},"min":{"1min":0.35699999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":8.7430000000000003,"5min":22.475000000000001,"15min":28.802},"last":5.0229999999999997},{"interface":"front","average":{"1min":2.6970000000000001,"5min":4.8710000000000004,"15min":2.4420000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.29399999999999998},"max":{"1min":9.7460000000000004,"5min":115.229,"15min":115.229},"last":2.137}]},{"osd":3,"last update":"Thu Apr 18 04:54:41 2024","interfaces":[{"interface":"back","average":{"1min":3.5859999999999999,"5min":4.8010000000000002,"15min":2.4569999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":30.466000000000001,"5min":34.180999999999997,"15min":47.496000000000002},"last":7.8220000000000001},{"interface":"front","average":{"1min":3.2829999999999999,"5min":5.1589999999999998,"15min":2.5310000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":19.003,"5min":115.729,"15min":115.729},"last":2.3980000000000001}]},{"osd":4,"last update":"Thu Apr 18 04:55:29 2024","interfaces":[{"interface":"back","average":{"1min":2.0859999999999999,"5min":2.7599999999999998,"15min":1.855},"min":{"1min":0.41499999999999998,"5min":0.372,"15min":0.33000000000000002},"max":{"1min":16.451000000000001,"5min":49.738999999999997,"15min":49.738999999999997},"last":7.7430000000000003},{"interface":"front","average":{"1min":2.4929999999999999,"5min":3.8029999999999999,"15min":2.3519999999999999},"min":{"1min":0.47799999999999998,"5min":0.47499999999999998,"15min":0.38300000000000001},"max":{"1min":16.382999999999999,"5min":50.996000000000002,"15min":50.996000000000002},"last":7.8540000000000001}]},{"osd":5,"last update":"Thu Apr 18 04:55:29 2024","interfaces":[{"interface":"back","average":{"1min":1.843,"5min":2.9550000000000001,"15min":1.8720000000000001},"min":{"1min":0.504,"5min":0.437,"15min":0.38100000000000001},"max":{"1min":9.7469999999999999,"5min":34.402999999999999,"15min":34.402999999999999},"last":6.4690000000000003},{"interface":"front","average":{"1min":1.855,"5min":2.4239999999999999,"15min":1.911},"min":{"1min":0.56799999999999995,"5min":0.46000000000000002,"15min":0.42099999999999999},"max":{"1min":9.2050000000000001,"5min":16.317,"15min":33.392000000000003},"last":6.516}]},{"osd":6,"last update":"Thu Apr 18 04:55:29 2024","interfaces":[{"interface":"back","average":{"1min":1.825,"5min":4.1779999999999999,"15min":2.4169999999999998},"min":{"1min":0.47399999999999998,"5min":0.42199999999999999,"15min":0.40600000000000003},"max":{"1min":9.1549999999999994,"5min":115.277,"15min":115.277},"last":6.5519999999999996},{"interface":"front","average":{"1min":2.032,"5min":3.399,"15min":2.044},"min":{"1min":0.55500000000000005,"5min":0.41599999999999998,"15min":0.41399999999999998},"max":{"1min":10.212999999999999,"5min":48.652999999999999,"15min":48.652999999999999},"last":8.0690000000000008}]},{"osd":7,"last update":"Thu Apr 18 04:55:29 2024","interfaces":[{"interface":"back","average":{"1min":1.976,"5min":3.2639999999999998,"15min":2.2010000000000001},"min":{"1min":0.496,"5min":0.48899999999999999,"15min":0.437},"max":{"1min":7.4589999999999996,"5min":54.829000000000001,"15min":54.829000000000001},"last":2.4420000000000002},{"interface":"front","average":{"1min":2.331,"5min":4.6799999999999997,"15min":2.6859999999999999},"min":{"1min":0.52200000000000002,"5min":0.49399999999999999,"15min":0.48699999999999999},"max":{"1min":10.170999999999999,"5min":115.31399999999999,"15min":115.31399999999999},"last":7.7889999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33312,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33312,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3121152,"data_stored":20972180,"data_compressed":2483986,"data_compressed_allocated":2842624,"data_compressed_original":20709376,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3178496,"data_stored":20972464,"data_compressed":2531508,"data_compressed_allocated":2936832,"data_compressed_original":20754432,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1396736,"data_stored":4285475,"data_compressed":439103,"data_compressed_allocated":598016,"data_compressed_original":3510272,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6742016,"data_stored":16869536,"data_compressed":1734435,"data_compressed_allocated":2166784,"data_compressed_original":12316672,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6316032,"data_stored":29361965,"data_compressed":3215159,"data_compressed_allocated":3665920,"data_compressed_original":26726400,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":3239936,"data_stored":18154962,"data_compressed":2174151,"data_compressed_allocated":2514944,"data_compressed_original":17453056,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3473408,"data_stored":16779689,"data_compressed":2087260,"data_compressed_allocated":2478080,"data_compressed_original":15798272,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10387456,"data_stored":34932699,"data_compressed":3585780,"data_compressed_allocated":4227072,"data_compressed_original":28794880,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":101720064,"data_stored":221138944,"data_compressed":12395595,"data_compressed_allocated":46403584,"data_compressed_original":165822464,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":421404672,"data_stored":902971392,"data_compressed":51750971,"data_compressed_allocated":196952064,"data_compressed_original":678518784,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94765056,"data_stored":210579456,"data_compressed":12036578,"data_compressed_allocated":44331008,"data_compressed_original":160145408,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":160358400,"data_stored":349421568,"data_compressed":19927916,"data_compressed_allocated":74256384,"data_compressed_original":263319552,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":276594688,"data_stored":588398592,"data_compressed":34094853,"data_compressed_allocated":129941504,"data_compressed_original":441745408,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":242712576,"data_stored":514564096,"data_compressed":29273186,"data_compressed_allocated":112013312,"data_compressed_original":383864832,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":332550144,"data_stored":701698048,"data_compressed":40319194,"data_compressed_allocated":155107328,"data_compressed_original":524255232,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":264220672,"data_stored":556453888,"data_compressed":31630023,"data_compressed_allocated":122163200,"data_compressed_original":414396416,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T04:55:38.653 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.653 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.654 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-04-18T04:44:28.842896+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=28, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.654 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.654 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.654 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-18T04:44:28.842896+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=28, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.654 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.654 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.654 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-18T04:44:28.842896+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=28, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.654 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.654 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.655 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.655 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-18T04:44:28.842896+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=28, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.655 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.655 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.655 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-04-18T04:44:28.842896+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=28, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.655 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.655 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.655 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-18T04:44:28.842896+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=28, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.656 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.656 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.656 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-18T04:44:28.842896+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=28, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.656 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.656 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.656 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-18T04:44:28.842896+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=28, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.656 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.656 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.656 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-18T04:44:28.842896+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=28, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.656 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.657 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.657 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-18T04:44:28.842896+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=28, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.657 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.657 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.657 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-18T04:44:28.842896+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=28, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.657 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.657 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.657 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-18T04:44:28.842896+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=28, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.657 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.657 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.658 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-18T04:44:28.842896+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=28, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.658 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.658 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.658 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-18T04:44:28.842896+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=28, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.658 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.658 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.658 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-18T04:44:28.842896+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=28, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.658 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-18T04:44:17.410146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=17, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.658 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.659 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.659 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-04-18T04:44:28.842896+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=28, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.659 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.659 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.659 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-04-18T04:44:28.842896+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=28, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.659 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.659 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.659 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-18T04:44:28.842896+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=28, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.659 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.659 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.660 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-04-18T04:44:28.842896+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=28, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.660 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.660 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.660 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-04-18T04:44:28.842896+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=28, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.660 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.660 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.660 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-04-18T04:44:28.842896+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=28, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.660 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.660 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.660 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-18T04:44:28.842896+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=28, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.661 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.661 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.661 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.661 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.661 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-04-18T04:44:28.842896+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=28, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.661 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.661 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.661 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-18T04:44:28.842896+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=28, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.661 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.662 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.662 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-04-18T04:44:28.842896+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=28, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.662 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.662 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.662 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-04-18T04:44:28.842896+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=28, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.662 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.662 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.662 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.662 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-18T04:44:28.842896+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=28, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.662 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.663 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.663 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-04-18T04:44:28.842896+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=28, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.663 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-18T04:44:28.842896+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=28, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.663 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.663 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.663 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-04-18T04:44:28.842896+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=28, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.663 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.663 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.663 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.663 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.664 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.664 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.664 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.664 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.664 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.664 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.664 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.664 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.664 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.664 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.664 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.665 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.665 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.665 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.665 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.665 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.665 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.665 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.665 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.665 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.666 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.666 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.666 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.666 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.666 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.666 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.666 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.666 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.666 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:38.666 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-18T04:55:58.668 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T04:55:58.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.813+0000 7ff0dfa00640 1 Processor -- start 2024-04-18T04:55:58.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.813+0000 7ff0dfa00640 1 -- start start 2024-04-18T04:55:58.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.813+0000 7ff0dfa00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff0d80c69e0 0x7ff0d80c0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:58.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.813+0000 7ff0dfa00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff0d8157de0 0x7ff0d806bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:58.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.813+0000 7ff0dfa00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0d815e970 con 0x7ff0d8157a00 2024-04-18T04:55:58.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.813+0000 7ff0dfa00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d8162170 con 0x7ff0d8157de0 2024-04-18T04:55:58.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.813+0000 7ff0dfa00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d8158250 con 0x7ff0d80c69e0 2024-04-18T04:55:58.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.813+0000 7ff0dda00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff0d8157de0 0x7ff0d806bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:58.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.813+0000 7ff0dda00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff0d8157de0 0x7ff0d806bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50470/0 (socket says 172.21.15.120:50470) 2024-04-18T04:55:58.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.813+0000 7ff0dda00640 1 -- 172.21.15.120:0/3195016564 learned_addr learned my addr 172.21.15.120:0/3195016564 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:58.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.813+0000 7ff0d7e00640 1 --2- 172.21.15.120:0/3195016564 >> v2:172.21.15.132:3300/0 conn(0x7ff0d80c69e0 0x7ff0d80c0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:58.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.813+0000 7ff0dda00640 1 -- 172.21.15.120:0/3195016564 >> v2:172.21.15.132:3300/0 conn(0x7ff0d80c69e0 msgr2=0x7ff0d80c0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:55:58.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.813+0000 7ff0dda00640 1 --2- 172.21.15.120:0/3195016564 >> v2:172.21.15.132:3300/0 conn(0x7ff0d80c69e0 0x7ff0d80c0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:58.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.813+0000 7ff0dda00640 1 -- 172.21.15.120:0/3195016564 >> v1:172.21.15.132:6789/0 conn(0x7ff0d8157a00 legacy=0x7ff0d806b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:58.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.813+0000 7ff0dda00640 1 -- 172.21.15.120:0/3195016564 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d80c5940 con 0x7ff0d8157de0 2024-04-18T04:55:58.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.817+0000 7ff0dda00640 1 --2- 172.21.15.120:0/3195016564 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0d8157de0 0x7ff0d806bd70 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ff0d806f010 tx=0x7ff0d001f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20cfe902e056472d server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:58.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.817+0000 7ff0d7400640 1 -- 172.21.15.120:0/3195016564 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d00af400 con 0x7ff0d8157de0 2024-04-18T04:55:58.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.817+0000 7ff0d7400640 1 -- 172.21.15.120:0/3195016564 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d00ab050 con 0x7ff0d8157de0 2024-04-18T04:55:58.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.817+0000 7ff0d7400640 1 -- 172.21.15.120:0/3195016564 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d00af780 con 0x7ff0d8157de0 2024-04-18T04:55:58.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.817+0000 7ff0dfa00640 1 -- 172.21.15.120:0/3195016564 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0d8157de0 msgr2=0x7ff0d806bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:58.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.817+0000 7ff0dfa00640 1 --2- 172.21.15.120:0/3195016564 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0d8157de0 0x7ff0d806bd70 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ff0d806f010 tx=0x7ff0d001f1e0 comp rx=0 tx=0).stop 2024-04-18T04:55:58.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.817+0000 7ff0dfa00640 1 -- 172.21.15.120:0/3195016564 shutdown_connections 2024-04-18T04:55:58.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.817+0000 7ff0dfa00640 1 --2- 172.21.15.120:0/3195016564 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0d8157de0 0x7ff0d806bd70 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:58.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.817+0000 7ff0dfa00640 1 --2- 172.21.15.120:0/3195016564 >> v2:172.21.15.132:3300/0 conn(0x7ff0d80c69e0 0x7ff0d80c0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:58.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.817+0000 7ff0dfa00640 1 -- 172.21.15.120:0/3195016564 >> 172.21.15.120:0/3195016564 conn(0x7ff0d80c78c0 msgr2=0x7ff0d80c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:58.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.817+0000 7ff0dfa00640 1 -- 172.21.15.120:0/3195016564 shutdown_connections 2024-04-18T04:55:58.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.817+0000 7ff0dfa00640 1 -- 172.21.15.120:0/3195016564 wait complete. 2024-04-18T04:55:58.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.817+0000 7ff0dfa00640 1 Processor -- start 2024-04-18T04:55:58.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.821+0000 7ff0dfa00640 1 -- start start 2024-04-18T04:55:58.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.821+0000 7ff0dfa00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0d80c69e0 0x7ff0d815ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:58.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.821+0000 7ff0dfa00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0d8157a00 0x7ff0d814cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:58.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.821+0000 7ff0dfa00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0d8157de0 0x7ff0d814d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:58.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.821+0000 7ff0dfa00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d81f7500 con 0x7ff0d8157a00 2024-04-18T04:55:58.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.821+0000 7ff0dfa00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d81559f0 con 0x7ff0d80c69e0 2024-04-18T04:55:58.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.821+0000 7ff0dfa00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d8155cd0 con 0x7ff0d8157de0 2024-04-18T04:55:58.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.821+0000 7ff0d7e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0d8157a00 0x7ff0d814cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:58.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.821+0000 7ff0d7e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0d8157a00 0x7ff0d814cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50472/0 (socket says 172.21.15.120:50472) 2024-04-18T04:55:58.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.821+0000 7ff0d7e00640 1 -- 172.21.15.120:0/1987728415 learned_addr learned my addr 172.21.15.120:0/1987728415 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:55:58.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.821+0000 7ff0dd000640 1 --2- 172.21.15.120:0/1987728415 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0d80c69e0 0x7ff0d815ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:58.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.821+0000 7ff0dda00640 1 --2- 172.21.15.120:0/1987728415 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0d8157de0 0x7ff0d814d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:58.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.821+0000 7ff0d7e00640 1 -- 172.21.15.120:0/1987728415 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0d8157de0 msgr2=0x7ff0d814d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:58.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.821+0000 7ff0d7e00640 1 --2- 172.21.15.120:0/1987728415 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0d8157de0 0x7ff0d814d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:58.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.821+0000 7ff0d7e00640 1 -- 172.21.15.120:0/1987728415 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0d80c69e0 msgr2=0x7ff0d815ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:58.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.821+0000 7ff0d7e00640 1 --2- 172.21.15.120:0/1987728415 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0d80c69e0 0x7ff0d815ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:58.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.821+0000 7ff0d7e00640 1 -- 172.21.15.120:0/1987728415 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d0009b30 con 0x7ff0d8157a00 2024-04-18T04:55:58.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.821+0000 7ff0d7e00640 1 --2- 172.21.15.120:0/1987728415 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0d8157a00 0x7ff0d814cdf0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7ff0c400d5f0 tx=0x7ff0c400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:58.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.821+0000 7ff0d4c00640 1 -- 172.21.15.120:0/1987728415 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c40125f0 con 0x7ff0d8157a00 2024-04-18T04:55:58.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.821+0000 7ff0d4c00640 1 -- 172.21.15.120:0/1987728415 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c4012750 con 0x7ff0d8157a00 2024-04-18T04:55:58.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.821+0000 7ff0d4c00640 1 -- 172.21.15.120:0/1987728415 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c4012b00 con 0x7ff0d8157a00 2024-04-18T04:55:58.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.821+0000 7ff0dfa00640 1 -- 172.21.15.120:0/1987728415 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d8153db0 con 0x7ff0d8157a00 2024-04-18T04:55:58.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.821+0000 7ff0dfa00640 1 -- 172.21.15.120:0/1987728415 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d81f77e0 con 0x7ff0d8157a00 2024-04-18T04:55:58.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.821+0000 7ff0dfa00640 1 -- 172.21.15.120:0/1987728415 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d8153fa0 con 0x7ff0d8157a00 2024-04-18T04:55:58.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.825+0000 7ff0d4c00640 1 -- 172.21.15.120:0/1987728415 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff0c4012c60 con 0x7ff0d8157a00 2024-04-18T04:55:58.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.825+0000 7ff0d4c00640 1 --2- 172.21.15.120:0/1987728415 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff0b8066690 0x7ff0b8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:55:58.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.825+0000 7ff0d4c00640 1 -- 172.21.15.120:0/1987728415 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7ff0c4084be0 con 0x7ff0d8157a00 2024-04-18T04:55:58.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.825+0000 7ff0dd000640 1 --2- 172.21.15.120:0/1987728415 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff0b8066690 0x7ff0b8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:55:58.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.825+0000 7ff0dd000640 1 --2- 172.21.15.120:0/1987728415 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff0b8066690 0x7ff0b8068b50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc007fd0 tx=0x7ff0cc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:55:58.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.829+0000 7ff0d4c00640 1 -- 172.21.15.120:0/1987728415 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7ff0c40519f0 con 0x7ff0d8157a00 2024-04-18T04:55:58.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:58.985+0000 7ff0dfa00640 1 -- 172.21.15.120:0/1987728415 --> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff0d8155b60 con 0x7ff0b8066690 2024-04-18T04:55:59.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:59.013+0000 7ff0d4c00640 1 -- 172.21.15.120:0/1987728415 <== mgr.4113 v2:172.21.15.132:6832/27788 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368563 (secure 0 0 0) 0x7ff0d8155b60 con 0x7ff0b8066690 2024-04-18T04:55:59.014 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:55:59.017 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-04-18T04:55:59.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:59.017+0000 7ff0dfa00640 1 -- 172.21.15.120:0/1987728415 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff0b8066690 msgr2=0x7ff0b8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:59.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:59.017+0000 7ff0dfa00640 1 --2- 172.21.15.120:0/1987728415 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff0b8066690 0x7ff0b8068b50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc007fd0 tx=0x7ff0cc009040 comp rx=0 tx=0).stop 2024-04-18T04:55:59.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:59.017+0000 7ff0dfa00640 1 -- 172.21.15.120:0/1987728415 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0d8157a00 msgr2=0x7ff0d814cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:55:59.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:59.017+0000 7ff0dfa00640 1 --2- 172.21.15.120:0/1987728415 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0d8157a00 0x7ff0d814cdf0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7ff0c400d5f0 tx=0x7ff0c400dab0 comp rx=0 tx=0).stop 2024-04-18T04:55:59.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:59.017+0000 7ff0dfa00640 1 -- 172.21.15.120:0/1987728415 shutdown_connections 2024-04-18T04:55:59.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:59.017+0000 7ff0dfa00640 1 --2- 172.21.15.120:0/1987728415 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7ff0b8066690 0x7ff0b8068b50 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:59.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:59.017+0000 7ff0dfa00640 1 --2- 172.21.15.120:0/1987728415 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0d8157de0 0x7ff0d814d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:59.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:59.017+0000 7ff0dfa00640 1 --2- 172.21.15.120:0/1987728415 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0d8157a00 0x7ff0d814cdf0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:59.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:59.017+0000 7ff0dfa00640 1 --2- 172.21.15.120:0/1987728415 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0d80c69e0 0x7ff0d815ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:55:59.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:59.017+0000 7ff0dfa00640 1 -- 172.21.15.120:0/1987728415 >> 172.21.15.120:0/1987728415 conn(0x7ff0d80c78c0 msgr2=0x7ff0d80c0880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:55:59.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:59.017+0000 7ff0dfa00640 1 -- 172.21.15.120:0/1987728415 shutdown_connections 2024-04-18T04:55:59.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:55:59.017+0000 7ff0dfa00640 1 -- 172.21.15.120:0/1987728415 wait complete. 2024-04-18T04:55:59.035 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":376,"stamp":"2024-04-18T04:55:57.063416+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":81754853,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":667,"num_read_kb":75003,"num_write":2198758,"num_write_kb":31245689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":22954,"num_omap_keys":44,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154338,"ondisk_log_size":154338,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":6031336,"kb_used_data":39784,"kb_used_omap":12,"kb_used_meta":5991475,"kb_avail":748943384,"statfs":{"total":773094113280,"available":766918025216,"internally_reserved":0,"allocated":40738816,"data_stored":164728610,"data_compressed":18318006,"data_compressed_allocated":21520384,"data_compressed_original":147210240,"omap_allocated":12743,"internal_metadata":6135270969},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005220"},"pg_stats":[{"pgid":"2.1f","version":"32'26","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:34.453464+0000","last_change":"2024-04-18T04:55:34.453464+0000","last_active":"2024-04-18T04:55:34.453464+0000","last_peered":"2024-04-18T04:55:34.453464+0000","last_clean":"2024-04-18T04:55:34.453464+0000","last_became_active":"2024-04-18T04:44:29.890853+0000","last_became_peered":"2024-04-18T04:44:29.890853+0000","last_unstale":"2024-04-18T04:55:34.453464+0000","last_undegraded":"2024-04-18T04:55:34.453464+0000","last_fullsized":"2024-04-18T04:55:34.453464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2024-04-18T04:55:34.453305+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2024-04-18T04:55:34.453305+0000","last_clean_scrub_stamp":"2024-04-18T04:55:34.453305+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:34:55.135020+0000","scrub_duration":0.023886489,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":4124,"num_write":18,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.737791+0000","last_change":"2024-04-18T04:55:39.632341+0000","last_active":"2024-04-18T04:55:39.737791+0000","last_peered":"2024-04-18T04:55:39.737791+0000","last_clean":"2024-04-18T04:55:39.737791+0000","last_became_active":"2024-04-18T04:44:30.296064+0000","last_became_peered":"2024-04-18T04:44:30.296064+0000","last_unstale":"2024-04-18T04:55:39.737791+0000","last_undegraded":"2024-04-18T04:55:39.737791+0000","last_fullsized":"2024-04-18T04:55:39.737791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-18T04:55:39.631099+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-18T04:55:39.631099+0000","last_clean_scrub_stamp":"2024-04-18T04:55:39.631099+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:57:20.977227+0000","scrub_duration":0.0073039209999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'3974","reported_seq":3999,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.911733+0000","last_change":"2024-04-18T04:44:34.306605+0000","last_active":"2024-04-18T04:55:39.911733+0000","last_peered":"2024-04-18T04:55:39.911733+0000","last_clean":"2024-04-18T04:55:39.911733+0000","last_became_active":"2024-04-18T04:44:34.306224+0000","last_became_peered":"2024-04-18T04:44:34.306224+0000","last_unstale":"2024-04-18T04:55:39.911733+0000","last_undegraded":"2024-04-18T04:55:39.911733+0000","last_fullsized":"2024-04-18T04:55:39.911733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":3974,"log_dups_size":0,"ondisk_log_size":3974,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":58092,"num_write_kb":822950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"32'27","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:42.547016+0000","last_change":"2024-04-18T04:55:42.547117+0000","last_active":"2024-04-18T04:55:42.547016+0000","last_peered":"2024-04-18T04:55:42.547016+0000","last_clean":"2024-04-18T04:55:42.547016+0000","last_became_active":"2024-04-18T04:44:29.881258+0000","last_became_peered":"2024-04-18T04:44:29.881258+0000","last_unstale":"2024-04-18T04:55:42.547016+0000","last_undegraded":"2024-04-18T04:55:42.547016+0000","last_fullsized":"2024-04-18T04:55:42.547016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'27","last_scrub_stamp":"2024-04-18T04:55:42.546992+0000","last_deep_scrub":"32'27","last_deep_scrub_stamp":"2024-04-18T04:55:42.546992+0000","last_clean_scrub_stamp":"2024-04-18T04:55:42.546992+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:13:30.341368+0000","scrub_duration":0.014561063000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":19,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"32'10","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.751926+0000","last_change":"2024-04-18T04:44:30.314205+0000","last_active":"2024-04-18T04:55:39.751926+0000","last_peered":"2024-04-18T04:55:39.751926+0000","last_clean":"2024-04-18T04:55:39.751926+0000","last_became_active":"2024-04-18T04:44:30.313987+0000","last_became_peered":"2024-04-18T04:44:30.313987+0000","last_unstale":"2024-04-18T04:55:39.751926+0000","last_undegraded":"2024-04-18T04:55:39.751926+0000","last_fullsized":"2024-04-18T04:55:39.751926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"32'5326","reported_seq":5366,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:53.782856+0000","last_change":"2024-04-18T04:55:53.783108+0000","last_active":"2024-04-18T04:55:53.782856+0000","last_peered":"2024-04-18T04:55:53.782856+0000","last_clean":"2024-04-18T04:55:53.782856+0000","last_became_active":"2024-04-18T04:44:34.338485+0000","last_became_peered":"2024-04-18T04:44:34.338485+0000","last_unstale":"2024-04-18T04:55:53.782856+0000","last_undegraded":"2024-04-18T04:55:53.782856+0000","last_fullsized":"2024-04-18T04:55:53.782856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5326","last_scrub_stamp":"2024-04-18T04:55:53.782806+0000","last_deep_scrub":"32'5326","last_deep_scrub_stamp":"2024-04-18T04:55:53.782806+0000","last_clean_scrub_stamp":"2024-04-18T04:55:53.782806+0000","objects_scrubbed":0,"log_size":5326,"log_dups_size":0,"ondisk_log_size":5326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:01:07.430052+0000","scrub_duration":0.106252715,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":78012,"num_write_kb":1107856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"32'77","reported_seq":110,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.678218+0000","last_change":"2024-04-18T04:44:29.897785+0000","last_active":"2024-04-18T04:55:39.678218+0000","last_peered":"2024-04-18T04:55:39.678218+0000","last_clean":"2024-04-18T04:55:39.678218+0000","last_became_active":"2024-04-18T04:44:29.896520+0000","last_became_peered":"2024-04-18T04:44:29.896520+0000","last_unstale":"2024-04-18T04:55:39.678218+0000","last_undegraded":"2024-04-18T04:55:39.678218+0000","last_fullsized":"2024-04-18T04:55:39.678218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":14,"num_read_kb":8212,"num_write":66,"num_write_kb":8229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"32'11","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:36.696034+0000","last_change":"2024-04-18T04:44:30.300588+0000","last_active":"2024-04-18T04:55:36.696034+0000","last_peered":"2024-04-18T04:55:36.696034+0000","last_clean":"2024-04-18T04:55:36.696034+0000","last_became_active":"2024-04-18T04:44:30.299939+0000","last_became_peered":"2024-04-18T04:44:30.299939+0000","last_unstale":"2024-04-18T04:55:36.696034+0000","last_undegraded":"2024-04-18T04:55:36.696034+0000","last_fullsized":"2024-04-18T04:55:36.696034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"32'4916","reported_seq":4942,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.796413+0000","last_change":"2024-04-18T04:44:34.338794+0000","last_active":"2024-04-18T04:55:39.796413+0000","last_peered":"2024-04-18T04:55:39.796413+0000","last_clean":"2024-04-18T04:55:39.796413+0000","last_became_active":"2024-04-18T04:44:34.337938+0000","last_became_peered":"2024-04-18T04:44:34.337938+0000","last_unstale":"2024-04-18T04:55:39.796413+0000","last_undegraded":"2024-04-18T04:55:39.796413+0000","last_fullsized":"2024-04-18T04:55:39.796413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4916,"log_dups_size":0,"ondisk_log_size":4916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":72239,"num_write_kb":1012843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"32'90","reported_seq":130,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:47.712240+0000","last_change":"2024-04-18T04:55:47.712862+0000","last_active":"2024-04-18T04:55:47.712240+0000","last_peered":"2024-04-18T04:55:47.712240+0000","last_clean":"2024-04-18T04:55:47.712240+0000","last_became_active":"2024-04-18T04:44:29.902611+0000","last_became_peered":"2024-04-18T04:44:29.902611+0000","last_unstale":"2024-04-18T04:55:47.712240+0000","last_undegraded":"2024-04-18T04:55:47.712240+0000","last_fullsized":"2024-04-18T04:55:47.712240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'90","last_scrub_stamp":"2024-04-18T04:55:47.712175+0000","last_deep_scrub":"32'90","last_deep_scrub_stamp":"2024-04-18T04:55:47.712175+0000","last_clean_scrub_stamp":"2024-04-18T04:55:47.712175+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:32:28.237397+0000","scrub_duration":0.017371477999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":87,"num_write_kb":1391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"32'20","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.810437+0000","last_change":"2024-04-18T04:44:30.301328+0000","last_active":"2024-04-18T04:55:39.810437+0000","last_peered":"2024-04-18T04:55:39.810437+0000","last_clean":"2024-04-18T04:55:39.810437+0000","last_became_active":"2024-04-18T04:44:30.300303+0000","last_became_peered":"2024-04-18T04:44:30.300303+0000","last_unstale":"2024-04-18T04:55:39.810437+0000","last_undegraded":"2024-04-18T04:55:39.810437+0000","last_fullsized":"2024-04-18T04:55:39.810437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'4576","reported_seq":4605,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.877056+0000","last_change":"2024-04-18T04:44:34.327044+0000","last_active":"2024-04-18T04:55:39.877056+0000","last_peered":"2024-04-18T04:55:39.877056+0000","last_clean":"2024-04-18T04:55:39.877056+0000","last_became_active":"2024-04-18T04:44:34.326161+0000","last_became_peered":"2024-04-18T04:44:34.326161+0000","last_unstale":"2024-04-18T04:55:39.877056+0000","last_undegraded":"2024-04-18T04:55:39.877056+0000","last_fullsized":"2024-04-18T04:55:39.877056+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4576,"log_dups_size":0,"ondisk_log_size":4576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1,"num_write":67045,"num_write_kb":936790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:51.521933+0000","last_change":"2024-04-18T04:55:51.522165+0000","last_active":"2024-04-18T04:55:51.521933+0000","last_peered":"2024-04-18T04:55:51.521933+0000","last_clean":"2024-04-18T04:55:51.521933+0000","last_became_active":"2024-04-18T04:44:30.295657+0000","last_became_peered":"2024-04-18T04:44:30.295657+0000","last_unstale":"2024-04-18T04:55:51.521933+0000","last_undegraded":"2024-04-18T04:55:51.521933+0000","last_fullsized":"2024-04-18T04:55:51.521933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-18T04:55:51.521874+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-18T04:55:51.521874+0000","last_clean_scrub_stamp":"2024-04-18T04:55:51.521874+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:46:02.690401+0000","scrub_duration":0.00357457,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"32'988","reported_seq":1022,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.793087+0000","last_change":"2024-04-18T04:44:29.900036+0000","last_active":"2024-04-18T04:55:39.793087+0000","last_peered":"2024-04-18T04:55:39.793087+0000","last_clean":"2024-04-18T04:55:39.793087+0000","last_became_active":"2024-04-18T04:44:29.899402+0000","last_became_peered":"2024-04-18T04:44:29.899402+0000","last_unstale":"2024-04-18T04:55:39.793087+0000","last_undegraded":"2024-04-18T04:55:39.793087+0000","last_fullsized":"2024-04-18T04:55:39.793087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":988,"log_dups_size":0,"ondisk_log_size":988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":4110,"num_write":977,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"32'4777","reported_seq":4807,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.866426+0000","last_change":"2024-04-18T04:44:34.320846+0000","last_active":"2024-04-18T04:55:39.866426+0000","last_peered":"2024-04-18T04:55:39.866426+0000","last_clean":"2024-04-18T04:55:39.866426+0000","last_became_active":"2024-04-18T04:44:34.319868+0000","last_became_peered":"2024-04-18T04:44:34.319868+0000","last_unstale":"2024-04-18T04:55:39.866426+0000","last_undegraded":"2024-04-18T04:55:39.866426+0000","last_fullsized":"2024-04-18T04:55:39.866426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4777,"log_dups_size":0,"ondisk_log_size":4777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":69886,"num_write_kb":985071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:40.615562+0000","last_change":"2024-04-18T04:55:40.615562+0000","last_active":"2024-04-18T04:55:40.615562+0000","last_peered":"2024-04-18T04:55:40.615562+0000","last_clean":"2024-04-18T04:55:40.615562+0000","last_became_active":"2024-04-18T04:44:30.271420+0000","last_became_peered":"2024-04-18T04:44:30.271420+0000","last_unstale":"2024-04-18T04:55:40.615562+0000","last_undegraded":"2024-04-18T04:55:40.615562+0000","last_fullsized":"2024-04-18T04:55:40.615562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-18T04:55:40.615434+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-18T04:55:40.615434+0000","last_clean_scrub_stamp":"2024-04-18T04:55:40.615434+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:53:11.453735+0000","scrub_duration":0.026470450999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"32'10","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:43.441783+0000","last_change":"2024-04-18T04:55:43.441900+0000","last_active":"2024-04-18T04:55:43.441783+0000","last_peered":"2024-04-18T04:55:43.441783+0000","last_clean":"2024-04-18T04:55:43.441783+0000","last_became_active":"2024-04-18T04:44:29.878139+0000","last_became_peered":"2024-04-18T04:44:29.878139+0000","last_unstale":"2024-04-18T04:55:43.441783+0000","last_undegraded":"2024-04-18T04:55:43.441783+0000","last_fullsized":"2024-04-18T04:55:43.441783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-18T04:55:43.441759+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-18T04:55:43.441759+0000","last_clean_scrub_stamp":"2024-04-18T04:55:43.441759+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:07:54.010016+0000","scrub_duration":0.0033934379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"32'4649","reported_seq":4676,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.861559+0000","last_change":"2024-04-18T04:44:34.346123+0000","last_active":"2024-04-18T04:55:39.861559+0000","last_peered":"2024-04-18T04:55:39.861559+0000","last_clean":"2024-04-18T04:55:39.861559+0000","last_became_active":"2024-04-18T04:44:34.345267+0000","last_became_peered":"2024-04-18T04:44:34.345267+0000","last_unstale":"2024-04-18T04:55:39.861559+0000","last_undegraded":"2024-04-18T04:55:39.861559+0000","last_fullsized":"2024-04-18T04:55:39.861559+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4649,"log_dups_size":0,"ondisk_log_size":4649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":68133,"num_write_kb":992962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"32'11","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:53.573836+0000","last_change":"2024-04-18T04:55:53.573938+0000","last_active":"2024-04-18T04:55:53.573836+0000","last_peered":"2024-04-18T04:55:53.573836+0000","last_clean":"2024-04-18T04:55:53.573836+0000","last_became_active":"2024-04-18T04:44:30.273752+0000","last_became_peered":"2024-04-18T04:44:30.273752+0000","last_unstale":"2024-04-18T04:55:53.573836+0000","last_undegraded":"2024-04-18T04:55:53.573836+0000","last_fullsized":"2024-04-18T04:55:53.573836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-04-18T04:55:53.573817+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-04-18T04:55:53.573817+0000","last_clean_scrub_stamp":"2024-04-18T04:55:53.573817+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:15:50.107902+0000","scrub_duration":0.016381493,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"32'11","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.736159+0000","last_change":"2024-04-18T04:55:39.522596+0000","last_active":"2024-04-18T04:55:39.736159+0000","last_peered":"2024-04-18T04:55:39.736159+0000","last_clean":"2024-04-18T04:55:39.736159+0000","last_became_active":"2024-04-18T04:44:29.889684+0000","last_became_peered":"2024-04-18T04:44:29.889684+0000","last_unstale":"2024-04-18T04:55:39.736159+0000","last_undegraded":"2024-04-18T04:55:39.736159+0000","last_fullsized":"2024-04-18T04:55:39.736159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-18T04:55:39.522412+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-18T04:55:39.522412+0000","last_clean_scrub_stamp":"2024-04-18T04:55:39.522412+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:20:25.296279+0000","scrub_duration":0.014929192000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":9,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"32'4620","reported_seq":4646,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.670684+0000","last_change":"2024-04-18T04:44:34.313634+0000","last_active":"2024-04-18T04:55:39.670684+0000","last_peered":"2024-04-18T04:55:39.670684+0000","last_clean":"2024-04-18T04:55:39.670684+0000","last_became_active":"2024-04-18T04:44:34.313161+0000","last_became_peered":"2024-04-18T04:44:34.313161+0000","last_unstale":"2024-04-18T04:55:39.670684+0000","last_undegraded":"2024-04-18T04:55:39.670684+0000","last_fullsized":"2024-04-18T04:55:39.670684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4620,"log_dups_size":0,"ondisk_log_size":4620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":67683,"num_write_kb":962979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:41.633068+0000","last_change":"2024-04-18T04:55:41.633263+0000","last_active":"2024-04-18T04:55:41.633068+0000","last_peered":"2024-04-18T04:55:41.633068+0000","last_clean":"2024-04-18T04:55:41.633068+0000","last_became_active":"2024-04-18T04:44:30.279238+0000","last_became_peered":"2024-04-18T04:44:30.279238+0000","last_unstale":"2024-04-18T04:55:41.633068+0000","last_undegraded":"2024-04-18T04:55:41.633068+0000","last_fullsized":"2024-04-18T04:55:41.633068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-04-18T04:55:41.633017+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-04-18T04:55:41.633017+0000","last_clean_scrub_stamp":"2024-04-18T04:55:41.633017+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:54:01.121009+0000","scrub_duration":0.0030512479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"32'22","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.679933+0000","last_change":"2024-04-18T04:44:29.890816+0000","last_active":"2024-04-18T04:55:39.679933+0000","last_peered":"2024-04-18T04:55:39.679933+0000","last_clean":"2024-04-18T04:55:39.679933+0000","last_became_active":"2024-04-18T04:44:29.890272+0000","last_became_peered":"2024-04-18T04:44:29.890272+0000","last_unstale":"2024-04-18T04:55:39.679933+0000","last_undegraded":"2024-04-18T04:55:39.679933+0000","last_fullsized":"2024-04-18T04:55:39.679933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":4108,"num_write":18,"num_write_kb":4103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"32'4424","reported_seq":4451,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:40.492999+0000","last_change":"2024-04-18T04:44:34.344973+0000","last_active":"2024-04-18T04:55:40.492999+0000","last_peered":"2024-04-18T04:55:40.492999+0000","last_clean":"2024-04-18T04:55:40.492999+0000","last_became_active":"2024-04-18T04:44:34.344007+0000","last_became_peered":"2024-04-18T04:44:34.344007+0000","last_unstale":"2024-04-18T04:55:40.492999+0000","last_undegraded":"2024-04-18T04:55:40.492999+0000","last_fullsized":"2024-04-18T04:55:40.492999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4424,"log_dups_size":0,"ondisk_log_size":4424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":64589,"num_write_kb":921811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"32'15","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.881909+0000","last_change":"2024-04-18T04:44:30.278193+0000","last_active":"2024-04-18T04:55:39.881909+0000","last_peered":"2024-04-18T04:55:39.881909+0000","last_clean":"2024-04-18T04:55:39.881909+0000","last_became_active":"2024-04-18T04:44:30.277916+0000","last_became_peered":"2024-04-18T04:44:30.277916+0000","last_unstale":"2024-04-18T04:55:39.881909+0000","last_undegraded":"2024-04-18T04:55:39.881909+0000","last_fullsized":"2024-04-18T04:55:39.881909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"32'11","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:45.408643+0000","last_change":"2024-04-18T04:55:45.408857+0000","last_active":"2024-04-18T04:55:45.408643+0000","last_peered":"2024-04-18T04:55:45.408643+0000","last_clean":"2024-04-18T04:55:45.408643+0000","last_became_active":"2024-04-18T04:44:29.896392+0000","last_became_peered":"2024-04-18T04:44:29.896392+0000","last_unstale":"2024-04-18T04:55:45.408643+0000","last_undegraded":"2024-04-18T04:55:45.408643+0000","last_fullsized":"2024-04-18T04:55:45.408643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-04-18T04:55:45.408586+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-04-18T04:55:45.408586+0000","last_clean_scrub_stamp":"2024-04-18T04:55:45.408586+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:33:28.055043+0000","scrub_duration":0.0062587069999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"32'4470","reported_seq":4496,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.914572+0000","last_change":"2024-04-18T04:44:34.339233+0000","last_active":"2024-04-18T04:55:39.914572+0000","last_peered":"2024-04-18T04:55:39.914572+0000","last_clean":"2024-04-18T04:55:39.914572+0000","last_became_active":"2024-04-18T04:44:34.338294+0000","last_became_peered":"2024-04-18T04:44:34.338294+0000","last_unstale":"2024-04-18T04:55:39.914572+0000","last_undegraded":"2024-04-18T04:55:39.914572+0000","last_fullsized":"2024-04-18T04:55:39.914572+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4470,"log_dups_size":0,"ondisk_log_size":4470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":65571,"num_write_kb":938881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"32'9","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:33.075110+0000","last_change":"2024-04-18T04:45:12.045887+0000","last_active":"2024-04-18T04:55:33.075110+0000","last_peered":"2024-04-18T04:55:33.075110+0000","last_clean":"2024-04-18T04:55:33.075110+0000","last_became_active":"2024-04-18T04:45:12.045671+0000","last_became_peered":"2024-04-18T04:45:12.045671+0000","last_unstale":"2024-04-18T04:55:33.075110+0000","last_undegraded":"2024-04-18T04:55:33.075110+0000","last_fullsized":"2024-04-18T04:55:33.075110+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"32'100","reported_seq":143,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:36.496341+0000","last_change":"2024-04-18T04:55:36.496341+0000","last_active":"2024-04-18T04:55:36.496341+0000","last_peered":"2024-04-18T04:55:36.496341+0000","last_clean":"2024-04-18T04:55:36.496341+0000","last_became_active":"2024-04-18T04:44:29.894210+0000","last_became_peered":"2024-04-18T04:44:29.894210+0000","last_unstale":"2024-04-18T04:55:36.496341+0000","last_undegraded":"2024-04-18T04:55:36.496341+0000","last_fullsized":"2024-04-18T04:55:36.496341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'99","last_scrub_stamp":"2024-04-18T04:55:36.496160+0000","last_deep_scrub":"32'99","last_deep_scrub_stamp":"2024-04-18T04:55:36.496160+0000","last_clean_scrub_stamp":"2024-04-18T04:55:36.496160+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:33:42.522752+0000","scrub_duration":0.032044003000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":22,"num_write":222,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"32'4848","reported_seq":4878,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.823812+0000","last_change":"2024-04-18T04:44:34.305652+0000","last_active":"2024-04-18T04:55:39.823812+0000","last_peered":"2024-04-18T04:55:39.823812+0000","last_clean":"2024-04-18T04:55:39.823812+0000","last_became_active":"2024-04-18T04:44:34.305180+0000","last_became_peered":"2024-04-18T04:44:34.305180+0000","last_unstale":"2024-04-18T04:55:39.823812+0000","last_undegraded":"2024-04-18T04:55:39.823812+0000","last_fullsized":"2024-04-18T04:55:39.823812+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4848,"log_dups_size":0,"ondisk_log_size":4848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":70785,"num_write_kb":998644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"32'14","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.691162+0000","last_change":"2024-04-18T04:55:33.486145+0000","last_active":"2024-04-18T04:55:39.691162+0000","last_peered":"2024-04-18T04:55:39.691162+0000","last_clean":"2024-04-18T04:55:39.691162+0000","last_became_active":"2024-04-18T04:44:30.266814+0000","last_became_peered":"2024-04-18T04:44:30.266814+0000","last_unstale":"2024-04-18T04:55:39.691162+0000","last_undegraded":"2024-04-18T04:55:39.691162+0000","last_fullsized":"2024-04-18T04:55:39.691162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-18T04:55:33.485923+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-18T04:55:33.485923+0000","last_clean_scrub_stamp":"2024-04-18T04:55:33.485923+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:32:31.671872+0000","scrub_duration":0.031836318000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"32'11","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:49.771399+0000","last_change":"2024-04-18T04:55:49.771588+0000","last_active":"2024-04-18T04:55:49.771399+0000","last_peered":"2024-04-18T04:55:49.771399+0000","last_clean":"2024-04-18T04:55:49.771399+0000","last_became_active":"2024-04-18T04:44:29.897156+0000","last_became_peered":"2024-04-18T04:44:29.897156+0000","last_unstale":"2024-04-18T04:55:49.771399+0000","last_undegraded":"2024-04-18T04:55:49.771399+0000","last_fullsized":"2024-04-18T04:55:49.771399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-04-18T04:55:49.771338+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-04-18T04:55:49.771338+0000","last_clean_scrub_stamp":"2024-04-18T04:55:49.771338+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:37:50.640662+0000","scrub_duration":0.0048339239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":10,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"32'4380","reported_seq":4408,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.888762+0000","last_change":"2024-04-18T04:44:34.324721+0000","last_active":"2024-04-18T04:55:39.888762+0000","last_peered":"2024-04-18T04:55:39.888762+0000","last_clean":"2024-04-18T04:55:39.888762+0000","last_became_active":"2024-04-18T04:44:34.322925+0000","last_became_peered":"2024-04-18T04:44:34.322925+0000","last_unstale":"2024-04-18T04:55:39.888762+0000","last_undegraded":"2024-04-18T04:55:39.888762+0000","last_fullsized":"2024-04-18T04:55:39.888762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4380,"log_dups_size":0,"ondisk_log_size":4380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":64226,"num_write_kb":906867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"32'9","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.637771+0000","last_change":"2024-04-18T04:44:30.281640+0000","last_active":"2024-04-18T04:55:39.637771+0000","last_peered":"2024-04-18T04:55:39.637771+0000","last_clean":"2024-04-18T04:55:39.637771+0000","last_became_active":"2024-04-18T04:44:30.280968+0000","last_became_peered":"2024-04-18T04:44:30.280968+0000","last_unstale":"2024-04-18T04:55:39.637771+0000","last_undegraded":"2024-04-18T04:55:39.637771+0000","last_fullsized":"2024-04-18T04:55:39.637771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:48.422520+0000","last_change":"2024-04-18T04:55:48.422593+0000","last_active":"2024-04-18T04:55:48.422520+0000","last_peered":"2024-04-18T04:55:48.422520+0000","last_clean":"2024-04-18T04:55:48.422520+0000","last_became_active":"2024-04-18T04:44:29.882335+0000","last_became_peered":"2024-04-18T04:44:29.882335+0000","last_unstale":"2024-04-18T04:55:48.422520+0000","last_undegraded":"2024-04-18T04:55:48.422520+0000","last_fullsized":"2024-04-18T04:55:48.422520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-04-18T04:55:48.422500+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-04-18T04:55:48.422500+0000","last_clean_scrub_stamp":"2024-04-18T04:55:48.422500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:52:26.809919+0000","scrub_duration":0.0014886680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4640","reported_seq":4670,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.798930+0000","last_change":"2024-04-18T04:44:34.325029+0000","last_active":"2024-04-18T04:55:39.798930+0000","last_peered":"2024-04-18T04:55:39.798930+0000","last_clean":"2024-04-18T04:55:39.798930+0000","last_became_active":"2024-04-18T04:44:34.324082+0000","last_became_peered":"2024-04-18T04:44:34.324082+0000","last_unstale":"2024-04-18T04:55:39.798930+0000","last_undegraded":"2024-04-18T04:55:39.798930+0000","last_fullsized":"2024-04-18T04:55:39.798930+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4640,"log_dups_size":0,"ondisk_log_size":4640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":67980,"num_write_kb":954001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"32'9","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:51.707393+0000","last_change":"2024-04-18T04:55:51.707638+0000","last_active":"2024-04-18T04:55:51.707393+0000","last_peered":"2024-04-18T04:55:51.707393+0000","last_clean":"2024-04-18T04:55:51.707393+0000","last_became_active":"2024-04-18T04:44:30.270878+0000","last_became_peered":"2024-04-18T04:44:30.270878+0000","last_unstale":"2024-04-18T04:55:51.707393+0000","last_undegraded":"2024-04-18T04:55:51.707393+0000","last_fullsized":"2024-04-18T04:55:51.707393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-18T04:55:51.707338+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-18T04:55:51.707338+0000","last_clean_scrub_stamp":"2024-04-18T04:55:51.707338+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:46:00.559874+0000","scrub_duration":0.015878997999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"32'31","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:41.591869+0000","last_change":"2024-04-18T04:55:41.592079+0000","last_active":"2024-04-18T04:55:41.591869+0000","last_peered":"2024-04-18T04:55:41.591869+0000","last_clean":"2024-04-18T04:55:41.591869+0000","last_became_active":"2024-04-18T04:44:29.896199+0000","last_became_peered":"2024-04-18T04:44:29.896199+0000","last_unstale":"2024-04-18T04:55:41.591869+0000","last_undegraded":"2024-04-18T04:55:41.591869+0000","last_fullsized":"2024-04-18T04:55:41.591869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'31","last_scrub_stamp":"2024-04-18T04:55:41.591815+0000","last_deep_scrub":"32'31","last_deep_scrub_stamp":"2024-04-18T04:55:41.591815+0000","last_clean_scrub_stamp":"2024-04-18T04:55:41.591815+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:47:05.819279+0000","scrub_duration":0.031081439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":22,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"32'5255","reported_seq":5284,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.782158+0000","last_change":"2024-04-18T04:44:34.337429+0000","last_active":"2024-04-18T04:55:39.782158+0000","last_peered":"2024-04-18T04:55:39.782158+0000","last_clean":"2024-04-18T04:55:39.782158+0000","last_became_active":"2024-04-18T04:44:34.337089+0000","last_became_peered":"2024-04-18T04:44:34.337089+0000","last_unstale":"2024-04-18T04:55:39.782158+0000","last_undegraded":"2024-04-18T04:55:39.782158+0000","last_fullsized":"2024-04-18T04:55:39.782158+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":5255,"log_dups_size":0,"ondisk_log_size":5255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":76866,"num_write_kb":1090506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"32'13","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.671079+0000","last_change":"2024-04-18T04:44:30.270874+0000","last_active":"2024-04-18T04:55:39.671079+0000","last_peered":"2024-04-18T04:55:39.671079+0000","last_clean":"2024-04-18T04:55:39.671079+0000","last_became_active":"2024-04-18T04:44:30.270636+0000","last_became_peered":"2024-04-18T04:44:30.270636+0000","last_unstale":"2024-04-18T04:55:39.671079+0000","last_undegraded":"2024-04-18T04:55:39.671079+0000","last_fullsized":"2024-04-18T04:55:39.671079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"32'45","reported_seq":117,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:42.107941+0000","last_change":"2024-04-18T04:55:42.108086+0000","last_active":"2024-04-18T04:55:42.107941+0000","last_peered":"2024-04-18T04:55:42.107941+0000","last_clean":"2024-04-18T04:55:42.107941+0000","last_became_active":"2024-04-18T04:44:29.878330+0000","last_became_peered":"2024-04-18T04:44:29.878330+0000","last_unstale":"2024-04-18T04:55:42.107941+0000","last_undegraded":"2024-04-18T04:55:42.107941+0000","last_fullsized":"2024-04-18T04:55:42.107941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-04-18T04:55:42.107919+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-04-18T04:55:42.107919+0000","last_clean_scrub_stamp":"2024-04-18T04:55:42.107919+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:05:38.846240+0000","scrub_duration":0.0049119840000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90443,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":42,"num_read_kb":118,"num_write":37,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'4417","reported_seq":4444,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.707153+0000","last_change":"2024-04-18T04:44:34.323315+0000","last_active":"2024-04-18T04:55:39.707153+0000","last_peered":"2024-04-18T04:55:39.707153+0000","last_clean":"2024-04-18T04:55:39.707153+0000","last_became_active":"2024-04-18T04:44:34.322983+0000","last_became_peered":"2024-04-18T04:44:34.322983+0000","last_unstale":"2024-04-18T04:55:39.707153+0000","last_undegraded":"2024-04-18T04:55:39.707153+0000","last_fullsized":"2024-04-18T04:55:39.707153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4417,"log_dups_size":0,"ondisk_log_size":4417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":64703,"num_write_kb":914612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"32'6","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:43.527284+0000","last_change":"2024-04-18T04:55:43.527385+0000","last_active":"2024-04-18T04:55:43.527284+0000","last_peered":"2024-04-18T04:55:43.527284+0000","last_clean":"2024-04-18T04:55:43.527284+0000","last_became_active":"2024-04-18T04:44:30.285113+0000","last_became_peered":"2024-04-18T04:44:30.285113+0000","last_unstale":"2024-04-18T04:55:43.527284+0000","last_undegraded":"2024-04-18T04:55:43.527284+0000","last_fullsized":"2024-04-18T04:55:43.527284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-18T04:55:43.527263+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-18T04:55:43.527263+0000","last_clean_scrub_stamp":"2024-04-18T04:55:43.527263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:51:32.481877+0000","scrub_duration":0.0026846880000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"32'35","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:45.707944+0000","last_change":"2024-04-18T04:55:45.708153+0000","last_active":"2024-04-18T04:55:45.707944+0000","last_peered":"2024-04-18T04:55:45.707944+0000","last_clean":"2024-04-18T04:55:45.707944+0000","last_became_active":"2024-04-18T04:44:29.890207+0000","last_became_peered":"2024-04-18T04:44:29.890207+0000","last_unstale":"2024-04-18T04:55:45.707944+0000","last_undegraded":"2024-04-18T04:55:45.707944+0000","last_fullsized":"2024-04-18T04:55:45.707944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'35","last_scrub_stamp":"2024-04-18T04:55:45.707886+0000","last_deep_scrub":"32'35","last_deep_scrub_stamp":"2024-04-18T04:55:45.707886+0000","last_clean_scrub_stamp":"2024-04-18T04:55:45.707886+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:34:27.358342+0000","scrub_duration":0.034614290999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":8204,"num_write":25,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"32'5273","reported_seq":5311,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.897856+0000","last_change":"2024-04-18T04:45:12.378646+0000","last_active":"2024-04-18T04:55:39.897856+0000","last_peered":"2024-04-18T04:55:39.897856+0000","last_clean":"2024-04-18T04:55:39.897856+0000","last_became_active":"2024-04-18T04:45:12.378263+0000","last_became_peered":"2024-04-18T04:45:12.378263+0000","last_unstale":"2024-04-18T04:55:39.897856+0000","last_undegraded":"2024-04-18T04:55:39.897856+0000","last_fullsized":"2024-04-18T04:55:39.897856+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":5273,"log_dups_size":0,"ondisk_log_size":5273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":76633,"num_write_kb":1101398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"32'9","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:19.994041+0000","last_change":"2024-04-18T04:44:30.306826+0000","last_active":"2024-04-18T04:55:19.994041+0000","last_peered":"2024-04-18T04:55:19.994041+0000","last_clean":"2024-04-18T04:55:19.994041+0000","last_became_active":"2024-04-18T04:44:30.306320+0000","last_became_peered":"2024-04-18T04:44:30.306320+0000","last_unstale":"2024-04-18T04:55:19.994041+0000","last_undegraded":"2024-04-18T04:55:19.994041+0000","last_fullsized":"2024-04-18T04:55:19.994041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"32'9","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:42.555546+0000","last_change":"2024-04-18T04:55:42.555773+0000","last_active":"2024-04-18T04:55:42.555546+0000","last_peered":"2024-04-18T04:55:42.555546+0000","last_clean":"2024-04-18T04:55:42.555546+0000","last_became_active":"2024-04-18T04:44:29.887440+0000","last_became_peered":"2024-04-18T04:44:29.887440+0000","last_unstale":"2024-04-18T04:55:42.555546+0000","last_undegraded":"2024-04-18T04:55:42.555546+0000","last_fullsized":"2024-04-18T04:55:42.555546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-18T04:55:42.555488+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-18T04:55:42.555488+0000","last_clean_scrub_stamp":"2024-04-18T04:55:42.555488+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:41:03.271057+0000","scrub_duration":0.0067458550000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":20,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":194,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:44.677778+0000","last_change":"2024-04-18T04:55:44.677983+0000","last_active":"2024-04-18T04:55:44.677778+0000","last_peered":"2024-04-18T04:55:44.677778+0000","last_clean":"2024-04-18T04:55:44.677778+0000","last_became_active":"2024-04-18T04:44:18.627792+0000","last_became_peered":"2024-04-18T04:44:18.627792+0000","last_unstale":"2024-04-18T04:55:44.677778+0000","last_undegraded":"2024-04-18T04:55:44.677778+0000","last_fullsized":"2024-04-18T04:55:44.677778+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-04-18T04:55:44.677717+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-04-18T04:55:44.677717+0000","last_clean_scrub_stamp":"2024-04-18T04:55:44.677717+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:04:55.300837+0000","scrub_duration":0.0097382879999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"32'4252","reported_seq":4278,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.822744+0000","last_change":"2024-04-18T04:44:34.333286+0000","last_active":"2024-04-18T04:55:39.822744+0000","last_peered":"2024-04-18T04:55:39.822744+0000","last_clean":"2024-04-18T04:55:39.822744+0000","last_became_active":"2024-04-18T04:44:34.332520+0000","last_became_peered":"2024-04-18T04:44:34.332520+0000","last_unstale":"2024-04-18T04:55:39.822744+0000","last_undegraded":"2024-04-18T04:55:39.822744+0000","last_fullsized":"2024-04-18T04:55:39.822744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4252,"log_dups_size":0,"ondisk_log_size":4252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":62374,"num_write_kb":880557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"32'8","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.857138+0000","last_change":"2024-04-18T04:44:30.303602+0000","last_active":"2024-04-18T04:55:39.857138+0000","last_peered":"2024-04-18T04:55:39.857138+0000","last_clean":"2024-04-18T04:55:39.857138+0000","last_became_active":"2024-04-18T04:44:30.302157+0000","last_became_peered":"2024-04-18T04:44:30.302157+0000","last_unstale":"2024-04-18T04:55:39.857138+0000","last_undegraded":"2024-04-18T04:55:39.857138+0000","last_fullsized":"2024-04-18T04:55:39.857138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"32'14","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:45.141146+0000","last_change":"2024-04-18T04:55:45.141146+0000","last_active":"2024-04-18T04:55:45.141146+0000","last_peered":"2024-04-18T04:55:45.141146+0000","last_clean":"2024-04-18T04:55:45.141146+0000","last_became_active":"2024-04-18T04:44:29.890166+0000","last_became_peered":"2024-04-18T04:44:29.890166+0000","last_unstale":"2024-04-18T04:55:45.141146+0000","last_undegraded":"2024-04-18T04:55:45.141146+0000","last_fullsized":"2024-04-18T04:55:45.141146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-04-18T04:55:45.141052+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-04-18T04:55:45.141052+0000","last_clean_scrub_stamp":"2024-04-18T04:55:45.141052+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:03:19.757976+0000","scrub_duration":0.0051920170000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":14,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"32'3652","reported_seq":3683,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.726512+0000","last_change":"2024-04-18T04:44:34.334071+0000","last_active":"2024-04-18T04:55:39.726512+0000","last_peered":"2024-04-18T04:55:39.726512+0000","last_clean":"2024-04-18T04:55:39.726512+0000","last_became_active":"2024-04-18T04:44:34.332695+0000","last_became_peered":"2024-04-18T04:44:34.332695+0000","last_unstale":"2024-04-18T04:55:39.726512+0000","last_undegraded":"2024-04-18T04:55:39.726512+0000","last_fullsized":"2024-04-18T04:55:39.726512+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":3652,"log_dups_size":0,"ondisk_log_size":3652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":53440,"num_write_kb":771461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'7","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:36.695984+0000","last_change":"2024-04-18T04:44:30.287908+0000","last_active":"2024-04-18T04:55:36.695984+0000","last_peered":"2024-04-18T04:55:36.695984+0000","last_clean":"2024-04-18T04:55:36.695984+0000","last_became_active":"2024-04-18T04:44:30.287217+0000","last_became_peered":"2024-04-18T04:44:30.287217+0000","last_unstale":"2024-04-18T04:55:36.695984+0000","last_undegraded":"2024-04-18T04:55:36.695984+0000","last_fullsized":"2024-04-18T04:55:36.695984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"32'25","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.834012+0000","last_change":"2024-04-18T04:44:29.886376+0000","last_active":"2024-04-18T04:55:39.834012+0000","last_peered":"2024-04-18T04:55:39.834012+0000","last_clean":"2024-04-18T04:55:39.834012+0000","last_became_active":"2024-04-18T04:44:29.886058+0000","last_became_peered":"2024-04-18T04:44:29.886058+0000","last_unstale":"2024-04-18T04:55:39.834012+0000","last_undegraded":"2024-04-18T04:55:39.834012+0000","last_fullsized":"2024-04-18T04:55:39.834012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":23,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"32'4573","reported_seq":4611,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.833547+0000","last_change":"2024-04-18T04:45:12.373987+0000","last_active":"2024-04-18T04:55:39.833547+0000","last_peered":"2024-04-18T04:55:39.833547+0000","last_clean":"2024-04-18T04:55:39.833547+0000","last_became_active":"2024-04-18T04:45:12.373269+0000","last_became_peered":"2024-04-18T04:45:12.373269+0000","last_unstale":"2024-04-18T04:55:39.833547+0000","last_undegraded":"2024-04-18T04:55:39.833547+0000","last_fullsized":"2024-04-18T04:55:39.833547+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4573,"log_dups_size":0,"ondisk_log_size":4573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":66919,"num_write_kb":952859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"32'11","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.652842+0000","last_change":"2024-04-18T04:45:12.043098+0000","last_active":"2024-04-18T04:55:39.652842+0000","last_peered":"2024-04-18T04:55:39.652842+0000","last_clean":"2024-04-18T04:55:39.652842+0000","last_became_active":"2024-04-18T04:45:12.042803+0000","last_became_peered":"2024-04-18T04:45:12.042803+0000","last_unstale":"2024-04-18T04:55:39.652842+0000","last_undegraded":"2024-04-18T04:55:39.652842+0000","last_fullsized":"2024-04-18T04:55:39.652842+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"32'274","reported_seq":317,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.839246+0000","last_change":"2024-04-18T04:55:37.108330+0000","last_active":"2024-04-18T04:55:39.839246+0000","last_peered":"2024-04-18T04:55:39.839246+0000","last_clean":"2024-04-18T04:55:39.839246+0000","last_became_active":"2024-04-18T04:44:29.878361+0000","last_became_peered":"2024-04-18T04:44:29.878361+0000","last_unstale":"2024-04-18T04:55:39.839246+0000","last_undegraded":"2024-04-18T04:55:39.839246+0000","last_fullsized":"2024-04-18T04:55:39.839246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'271","last_scrub_stamp":"2024-04-18T04:55:37.108214+0000","last_deep_scrub":"32'271","last_deep_scrub_stamp":"2024-04-18T04:55:37.108214+0000","last_clean_scrub_stamp":"2024-04-18T04:55:37.108214+0000","objects_scrubbed":3,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:45:36.128941+0000","scrub_duration":0.015395397999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":678,"num_write":268,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7088,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"32'4411","reported_seq":4444,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.847776+0000","last_change":"2024-04-18T04:44:34.339023+0000","last_active":"2024-04-18T04:55:39.847776+0000","last_peered":"2024-04-18T04:55:39.847776+0000","last_clean":"2024-04-18T04:55:39.847776+0000","last_became_active":"2024-04-18T04:44:34.338042+0000","last_became_peered":"2024-04-18T04:44:34.338042+0000","last_unstale":"2024-04-18T04:55:39.847776+0000","last_undegraded":"2024-04-18T04:55:39.847776+0000","last_fullsized":"2024-04-18T04:55:39.847776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4411,"log_dups_size":0,"ondisk_log_size":4411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":64611,"num_write_kb":926956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"32'7","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.861900+0000","last_change":"2024-04-18T04:44:30.291740+0000","last_active":"2024-04-18T04:55:39.861900+0000","last_peered":"2024-04-18T04:55:39.861900+0000","last_clean":"2024-04-18T04:55:39.861900+0000","last_became_active":"2024-04-18T04:44:30.290379+0000","last_became_peered":"2024-04-18T04:44:30.290379+0000","last_unstale":"2024-04-18T04:55:39.861900+0000","last_undegraded":"2024-04-18T04:55:39.861900+0000","last_fullsized":"2024-04-18T04:55:39.861900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"32'12","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.663717+0000","last_change":"2024-04-18T04:55:38.668893+0000","last_active":"2024-04-18T04:55:39.663717+0000","last_peered":"2024-04-18T04:55:39.663717+0000","last_clean":"2024-04-18T04:55:39.663717+0000","last_became_active":"2024-04-18T04:44:29.881671+0000","last_became_peered":"2024-04-18T04:44:29.881671+0000","last_unstale":"2024-04-18T04:55:39.663717+0000","last_undegraded":"2024-04-18T04:55:39.663717+0000","last_fullsized":"2024-04-18T04:55:39.663717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-04-18T04:55:38.668646+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-04-18T04:55:38.668646+0000","last_clean_scrub_stamp":"2024-04-18T04:55:38.668646+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:45:33.432081+0000","scrub_duration":0.0053390160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"32'4121","reported_seq":4155,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.819638+0000","last_change":"2024-04-18T04:44:34.342465+0000","last_active":"2024-04-18T04:55:39.819638+0000","last_peered":"2024-04-18T04:55:39.819638+0000","last_clean":"2024-04-18T04:55:39.819638+0000","last_became_active":"2024-04-18T04:44:34.340327+0000","last_became_peered":"2024-04-18T04:44:34.340327+0000","last_unstale":"2024-04-18T04:55:39.819638+0000","last_undegraded":"2024-04-18T04:55:39.819638+0000","last_fullsized":"2024-04-18T04:55:39.819638+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4121,"log_dups_size":0,"ondisk_log_size":4121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":60260,"num_write_kb":847949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"32'12","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.136735+0000","last_change":"2024-04-18T04:44:30.299403+0000","last_active":"2024-04-18T04:55:39.136735+0000","last_peered":"2024-04-18T04:55:39.136735+0000","last_clean":"2024-04-18T04:55:39.136735+0000","last_became_active":"2024-04-18T04:44:30.298417+0000","last_became_peered":"2024-04-18T04:44:30.298417+0000","last_unstale":"2024-04-18T04:55:39.136735+0000","last_undegraded":"2024-04-18T04:55:39.136735+0000","last_fullsized":"2024-04-18T04:55:39.136735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"32'30","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:46.187510+0000","last_change":"2024-04-18T04:55:46.187598+0000","last_active":"2024-04-18T04:55:46.187510+0000","last_peered":"2024-04-18T04:55:46.187510+0000","last_clean":"2024-04-18T04:55:46.187510+0000","last_became_active":"2024-04-18T04:44:29.875059+0000","last_became_peered":"2024-04-18T04:44:29.875059+0000","last_unstale":"2024-04-18T04:55:46.187510+0000","last_undegraded":"2024-04-18T04:55:46.187510+0000","last_fullsized":"2024-04-18T04:55:46.187510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'30","last_scrub_stamp":"2024-04-18T04:55:46.187488+0000","last_deep_scrub":"32'30","last_deep_scrub_stamp":"2024-04-18T04:55:46.187488+0000","last_clean_scrub_stamp":"2024-04-18T04:55:46.187488+0000","objects_scrubbed":8,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:10:21.355167+0000","scrub_duration":0.0053312890000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":44,"num_read_kb":43,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"32'5105","reported_seq":5133,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.907427+0000","last_change":"2024-04-18T04:44:34.334498+0000","last_active":"2024-04-18T04:55:39.907427+0000","last_peered":"2024-04-18T04:55:39.907427+0000","last_clean":"2024-04-18T04:55:39.907427+0000","last_became_active":"2024-04-18T04:44:34.334192+0000","last_became_peered":"2024-04-18T04:44:34.334192+0000","last_unstale":"2024-04-18T04:55:39.907427+0000","last_undegraded":"2024-04-18T04:55:39.907427+0000","last_fullsized":"2024-04-18T04:55:39.907427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":5105,"log_dups_size":0,"ondisk_log_size":5105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":74408,"num_write_kb":1061210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"32'9","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:52.569009+0000","last_change":"2024-04-18T04:55:52.569224+0000","last_active":"2024-04-18T04:55:52.569009+0000","last_peered":"2024-04-18T04:55:52.569009+0000","last_clean":"2024-04-18T04:55:52.569009+0000","last_became_active":"2024-04-18T04:44:30.295404+0000","last_became_peered":"2024-04-18T04:44:30.295404+0000","last_unstale":"2024-04-18T04:55:52.569009+0000","last_undegraded":"2024-04-18T04:55:52.569009+0000","last_fullsized":"2024-04-18T04:55:52.569009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-18T04:55:52.568955+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-18T04:55:52.568955+0000","last_clean_scrub_stamp":"2024-04-18T04:55:52.568955+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:50:34.888052+0000","scrub_duration":0.0032512019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"32'19","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.648024+0000","last_change":"2024-04-18T04:55:39.372542+0000","last_active":"2024-04-18T04:55:39.648024+0000","last_peered":"2024-04-18T04:55:39.648024+0000","last_clean":"2024-04-18T04:55:39.648024+0000","last_became_active":"2024-04-18T04:44:29.893668+0000","last_became_peered":"2024-04-18T04:44:29.893668+0000","last_unstale":"2024-04-18T04:55:39.648024+0000","last_undegraded":"2024-04-18T04:55:39.648024+0000","last_fullsized":"2024-04-18T04:55:39.648024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-04-18T04:55:39.372420+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-04-18T04:55:39.372420+0000","last_clean_scrub_stamp":"2024-04-18T04:55:39.372420+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:51:03.179934+0000","scrub_duration":0.030124604999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1711,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":12,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5866,"num_omap_keys":11,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"32'5194","reported_seq":5232,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.816929+0000","last_change":"2024-04-18T04:45:12.057192+0000","last_active":"2024-04-18T04:55:39.816929+0000","last_peered":"2024-04-18T04:55:39.816929+0000","last_clean":"2024-04-18T04:55:39.816929+0000","last_became_active":"2024-04-18T04:45:12.056680+0000","last_became_peered":"2024-04-18T04:45:12.056680+0000","last_unstale":"2024-04-18T04:55:39.816929+0000","last_undegraded":"2024-04-18T04:55:39.816929+0000","last_fullsized":"2024-04-18T04:55:39.816929+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":5194,"log_dups_size":0,"ondisk_log_size":5194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":76118,"num_write_kb":1080690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'25","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.796161+0000","last_change":"2024-04-18T04:44:30.289122+0000","last_active":"2024-04-18T04:55:39.796161+0000","last_peered":"2024-04-18T04:55:39.796161+0000","last_clean":"2024-04-18T04:55:39.796161+0000","last_became_active":"2024-04-18T04:44:30.288364+0000","last_became_peered":"2024-04-18T04:44:30.288364+0000","last_unstale":"2024-04-18T04:55:39.796161+0000","last_undegraded":"2024-04-18T04:55:39.796161+0000","last_fullsized":"2024-04-18T04:55:39.796161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"32'9","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:47.609888+0000","last_change":"2024-04-18T04:55:47.610138+0000","last_active":"2024-04-18T04:55:47.609888+0000","last_peered":"2024-04-18T04:55:47.609888+0000","last_clean":"2024-04-18T04:55:47.609888+0000","last_became_active":"2024-04-18T04:44:29.889150+0000","last_became_peered":"2024-04-18T04:44:29.889150+0000","last_unstale":"2024-04-18T04:55:47.609888+0000","last_undegraded":"2024-04-18T04:55:47.609888+0000","last_fullsized":"2024-04-18T04:55:47.609888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-18T04:55:47.609828+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-18T04:55:47.609828+0000","last_clean_scrub_stamp":"2024-04-18T04:55:47.609828+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:14:23.527947+0000","scrub_duration":0.0044473270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'4551","reported_seq":4581,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.852594+0000","last_change":"2024-04-18T04:44:34.305657+0000","last_active":"2024-04-18T04:55:39.852594+0000","last_peered":"2024-04-18T04:55:39.852594+0000","last_clean":"2024-04-18T04:55:39.852594+0000","last_became_active":"2024-04-18T04:44:34.305341+0000","last_became_peered":"2024-04-18T04:44:34.305341+0000","last_unstale":"2024-04-18T04:55:39.852594+0000","last_undegraded":"2024-04-18T04:55:39.852594+0000","last_fullsized":"2024-04-18T04:55:39.852594+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4551,"log_dups_size":0,"ondisk_log_size":4551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":66735,"num_write_kb":961503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'10","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.613139+0000","last_change":"2024-04-18T04:44:30.307042+0000","last_active":"2024-04-18T04:55:39.613139+0000","last_peered":"2024-04-18T04:55:39.613139+0000","last_clean":"2024-04-18T04:55:39.613139+0000","last_became_active":"2024-04-18T04:44:30.306726+0000","last_became_peered":"2024-04-18T04:44:30.306726+0000","last_unstale":"2024-04-18T04:55:39.613139+0000","last_undegraded":"2024-04-18T04:55:39.613139+0000","last_fullsized":"2024-04-18T04:55:39.613139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"32'43","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.771678+0000","last_change":"2024-04-18T04:55:35.470607+0000","last_active":"2024-04-18T04:55:39.771678+0000","last_peered":"2024-04-18T04:55:39.771678+0000","last_clean":"2024-04-18T04:55:39.771678+0000","last_became_active":"2024-04-18T04:44:29.887095+0000","last_became_peered":"2024-04-18T04:44:29.887095+0000","last_unstale":"2024-04-18T04:55:39.771678+0000","last_undegraded":"2024-04-18T04:55:39.771678+0000","last_fullsized":"2024-04-18T04:55:39.771678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'40","last_scrub_stamp":"2024-04-18T04:55:35.470495+0000","last_deep_scrub":"32'40","last_deep_scrub_stamp":"2024-04-18T04:55:35.470495+0000","last_clean_scrub_stamp":"2024-04-18T04:55:35.470495+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:22:22.552307+0000","scrub_duration":0.035712923000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":31,"num_read_kb":8224,"num_write":33,"num_write_kb":8211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"32'4785","reported_seq":4813,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:38.149500+0000","last_change":"2024-04-18T04:44:34.322042+0000","last_active":"2024-04-18T04:55:38.149500+0000","last_peered":"2024-04-18T04:55:38.149500+0000","last_clean":"2024-04-18T04:55:38.149500+0000","last_became_active":"2024-04-18T04:44:34.320776+0000","last_became_peered":"2024-04-18T04:44:34.320776+0000","last_unstale":"2024-04-18T04:55:38.149500+0000","last_undegraded":"2024-04-18T04:55:38.149500+0000","last_fullsized":"2024-04-18T04:55:38.149500+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4785,"log_dups_size":0,"ondisk_log_size":4785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":70304,"num_write_kb":986201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"32'8","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:34.963247+0000","last_change":"2024-04-18T04:44:30.299413+0000","last_active":"2024-04-18T04:55:34.963247+0000","last_peered":"2024-04-18T04:55:34.963247+0000","last_clean":"2024-04-18T04:55:34.963247+0000","last_became_active":"2024-04-18T04:44:30.293185+0000","last_became_peered":"2024-04-18T04:44:30.293185+0000","last_unstale":"2024-04-18T04:55:34.963247+0000","last_undegraded":"2024-04-18T04:55:34.963247+0000","last_fullsized":"2024-04-18T04:55:34.963247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"32'234","reported_seq":280,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:42.418101+0000","last_change":"2024-04-18T04:55:42.418311+0000","last_active":"2024-04-18T04:55:42.418101+0000","last_peered":"2024-04-18T04:55:42.418101+0000","last_clean":"2024-04-18T04:55:42.418101+0000","last_became_active":"2024-04-18T04:44:29.892647+0000","last_became_peered":"2024-04-18T04:44:29.892647+0000","last_unstale":"2024-04-18T04:55:42.418101+0000","last_undegraded":"2024-04-18T04:55:42.418101+0000","last_fullsized":"2024-04-18T04:55:42.418101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'234","last_scrub_stamp":"2024-04-18T04:55:42.418044+0000","last_deep_scrub":"32'234","last_deep_scrub_stamp":"2024-04-18T04:55:42.418044+0000","last_clean_scrub_stamp":"2024-04-18T04:55:42.418044+0000","objects_scrubbed":5,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:33:18.193509+0000","scrub_duration":0.029742009,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":21,"num_read_kb":4116,"num_write":228,"num_write_kb":4214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"32'4396","reported_seq":4426,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.860403+0000","last_change":"2024-04-18T04:44:34.337866+0000","last_active":"2024-04-18T04:55:39.860403+0000","last_peered":"2024-04-18T04:55:39.860403+0000","last_clean":"2024-04-18T04:55:39.860403+0000","last_became_active":"2024-04-18T04:44:34.337486+0000","last_became_peered":"2024-04-18T04:44:34.337486+0000","last_unstale":"2024-04-18T04:55:39.860403+0000","last_undegraded":"2024-04-18T04:55:39.860403+0000","last_fullsized":"2024-04-18T04:55:39.860403+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4396,"log_dups_size":0,"ondisk_log_size":4396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1,"num_write":64313,"num_write_kb":903689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"32'14","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.829112+0000","last_change":"2024-04-18T04:55:39.618022+0000","last_active":"2024-04-18T04:55:39.829112+0000","last_peered":"2024-04-18T04:55:39.829112+0000","last_clean":"2024-04-18T04:55:39.829112+0000","last_became_active":"2024-04-18T04:44:30.307237+0000","last_became_peered":"2024-04-18T04:44:30.307237+0000","last_unstale":"2024-04-18T04:55:39.829112+0000","last_undegraded":"2024-04-18T04:55:39.829112+0000","last_fullsized":"2024-04-18T04:55:39.829112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-18T04:55:39.617881+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-18T04:55:39.617881+0000","last_clean_scrub_stamp":"2024-04-18T04:55:39.617881+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:45:32.468555+0000","scrub_duration":0.0024657490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"32'19","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.705167+0000","last_change":"2024-04-18T04:44:29.898488+0000","last_active":"2024-04-18T04:55:39.705167+0000","last_peered":"2024-04-18T04:55:39.705167+0000","last_clean":"2024-04-18T04:55:39.705167+0000","last_became_active":"2024-04-18T04:44:29.898113+0000","last_became_peered":"2024-04-18T04:44:29.898113+0000","last_unstale":"2024-04-18T04:55:39.705167+0000","last_undegraded":"2024-04-18T04:55:39.705167+0000","last_fullsized":"2024-04-18T04:55:39.705167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:28.842896+0000","last_clean_scrub_stamp":"2024-04-18T04:44:28.842896+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":19,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'5543","reported_seq":5571,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.814175+0000","last_change":"2024-04-18T04:44:34.344769+0000","last_active":"2024-04-18T04:55:39.814175+0000","last_peered":"2024-04-18T04:55:39.814175+0000","last_clean":"2024-04-18T04:55:39.814175+0000","last_became_active":"2024-04-18T04:44:34.343636+0000","last_became_peered":"2024-04-18T04:44:34.343636+0000","last_unstale":"2024-04-18T04:55:39.814175+0000","last_undegraded":"2024-04-18T04:55:39.814175+0000","last_fullsized":"2024-04-18T04:55:39.814175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":5543,"log_dups_size":0,"ondisk_log_size":5543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":7,"num_write":81014,"num_write_kb":1156235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"32'12","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:54.652162+0000","last_change":"2024-04-18T04:55:54.652263+0000","last_active":"2024-04-18T04:55:54.652162+0000","last_peered":"2024-04-18T04:55:54.652162+0000","last_clean":"2024-04-18T04:55:54.652162+0000","last_became_active":"2024-04-18T04:44:30.290127+0000","last_became_peered":"2024-04-18T04:44:30.290127+0000","last_unstale":"2024-04-18T04:55:54.652162+0000","last_undegraded":"2024-04-18T04:55:54.652162+0000","last_fullsized":"2024-04-18T04:55:54.652162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-04-18T04:55:54.652143+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-04-18T04:55:54.652143+0000","last_clean_scrub_stamp":"2024-04-18T04:55:54.652143+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:42:59.936226+0000","scrub_duration":0.043655591000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:46.605547+0000","last_change":"2024-04-18T04:55:46.605787+0000","last_active":"2024-04-18T04:55:46.605547+0000","last_peered":"2024-04-18T04:55:46.605547+0000","last_clean":"2024-04-18T04:55:46.605547+0000","last_became_active":"2024-04-18T04:44:29.895083+0000","last_became_peered":"2024-04-18T04:44:29.895083+0000","last_unstale":"2024-04-18T04:55:46.605547+0000","last_undegraded":"2024-04-18T04:55:46.605547+0000","last_fullsized":"2024-04-18T04:55:46.605547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-18T04:55:46.605493+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-18T04:55:46.605493+0000","last_clean_scrub_stamp":"2024-04-18T04:55:46.605493+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:59:10.105864+0000","scrub_duration":0.005528097,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"32'4755","reported_seq":4784,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.789719+0000","last_change":"2024-04-18T04:44:34.338412+0000","last_active":"2024-04-18T04:55:39.789719+0000","last_peered":"2024-04-18T04:55:39.789719+0000","last_clean":"2024-04-18T04:55:39.789719+0000","last_became_active":"2024-04-18T04:44:34.338062+0000","last_became_peered":"2024-04-18T04:44:34.338062+0000","last_unstale":"2024-04-18T04:55:39.789719+0000","last_undegraded":"2024-04-18T04:55:39.789719+0000","last_fullsized":"2024-04-18T04:55:39.789719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4755,"log_dups_size":0,"ondisk_log_size":4755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":69757,"num_write_kb":985522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"32'13","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:48.623621+0000","last_change":"2024-04-18T04:55:48.623813+0000","last_active":"2024-04-18T04:55:48.623621+0000","last_peered":"2024-04-18T04:55:48.623621+0000","last_clean":"2024-04-18T04:55:48.623621+0000","last_became_active":"2024-04-18T04:44:30.307168+0000","last_became_peered":"2024-04-18T04:44:30.307168+0000","last_unstale":"2024-04-18T04:55:48.623621+0000","last_undegraded":"2024-04-18T04:55:48.623621+0000","last_fullsized":"2024-04-18T04:55:48.623621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-04-18T04:55:48.623571+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-04-18T04:55:48.623571+0000","last_clean_scrub_stamp":"2024-04-18T04:55:48.623571+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:03:03.003462+0000","scrub_duration":0.053707861000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"32'12","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:49.458352+0000","last_change":"2024-04-18T04:55:49.458557+0000","last_active":"2024-04-18T04:55:49.458352+0000","last_peered":"2024-04-18T04:55:49.458352+0000","last_clean":"2024-04-18T04:55:49.458352+0000","last_became_active":"2024-04-18T04:44:29.902647+0000","last_became_peered":"2024-04-18T04:44:29.902647+0000","last_unstale":"2024-04-18T04:55:49.458352+0000","last_undegraded":"2024-04-18T04:55:49.458352+0000","last_fullsized":"2024-04-18T04:55:49.458352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-04-18T04:55:49.458295+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-04-18T04:55:49.458295+0000","last_clean_scrub_stamp":"2024-04-18T04:55:49.458295+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:59:11.252717+0000","scrub_duration":0.0067466690000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"32'5962","reported_seq":5991,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.764235+0000","last_change":"2024-04-18T04:44:34.338653+0000","last_active":"2024-04-18T04:55:39.764235+0000","last_peered":"2024-04-18T04:55:39.764235+0000","last_clean":"2024-04-18T04:55:39.764235+0000","last_became_active":"2024-04-18T04:44:34.338288+0000","last_became_peered":"2024-04-18T04:44:34.338288+0000","last_unstale":"2024-04-18T04:55:39.764235+0000","last_undegraded":"2024-04-18T04:55:39.764235+0000","last_fullsized":"2024-04-18T04:55:39.764235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":5962,"log_dups_size":0,"ondisk_log_size":5962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":87687,"num_write_kb":1229683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"32'4075","reported_seq":4104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.827148+0000","last_change":"2024-04-18T04:44:34.306999+0000","last_active":"2024-04-18T04:55:39.827148+0000","last_peered":"2024-04-18T04:55:39.827148+0000","last_clean":"2024-04-18T04:55:39.827148+0000","last_became_active":"2024-04-18T04:44:34.306657+0000","last_became_peered":"2024-04-18T04:44:34.306657+0000","last_unstale":"2024-04-18T04:55:39.827148+0000","last_undegraded":"2024-04-18T04:55:39.827148+0000","last_fullsized":"2024-04-18T04:55:39.827148+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4075,"log_dups_size":0,"ondisk_log_size":4075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":59702,"num_write_kb":838973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'14","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.695897+0000","last_change":"2024-04-18T04:55:34.435507+0000","last_active":"2024-04-18T04:55:39.695897+0000","last_peered":"2024-04-18T04:55:39.695897+0000","last_clean":"2024-04-18T04:55:39.695897+0000","last_became_active":"2024-04-18T04:44:30.271619+0000","last_became_peered":"2024-04-18T04:44:30.271619+0000","last_unstale":"2024-04-18T04:55:39.695897+0000","last_undegraded":"2024-04-18T04:55:39.695897+0000","last_fullsized":"2024-04-18T04:55:39.695897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-18T04:55:34.435387+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-18T04:55:34.435387+0000","last_clean_scrub_stamp":"2024-04-18T04:55:34.435387+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:54:07.144675+0000","scrub_duration":0.0023265299999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"32'54","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:43.553743+0000","last_change":"2024-04-18T04:55:43.553948+0000","last_active":"2024-04-18T04:55:43.553743+0000","last_peered":"2024-04-18T04:55:43.553743+0000","last_clean":"2024-04-18T04:55:43.553743+0000","last_became_active":"2024-04-18T04:44:29.889922+0000","last_became_peered":"2024-04-18T04:44:29.889922+0000","last_unstale":"2024-04-18T04:55:43.553743+0000","last_undegraded":"2024-04-18T04:55:43.553743+0000","last_fullsized":"2024-04-18T04:55:43.553743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'54","last_scrub_stamp":"2024-04-18T04:55:43.553684+0000","last_deep_scrub":"32'54","last_deep_scrub_stamp":"2024-04-18T04:55:43.553684+0000","last_clean_scrub_stamp":"2024-04-18T04:55:43.553684+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:19:01.902021+0000","scrub_duration":0.039263570999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":45,"num_write_kb":8216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4567","reported_seq":4599,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.755034+0000","last_change":"2024-04-18T04:44:34.333403+0000","last_active":"2024-04-18T04:55:39.755034+0000","last_peered":"2024-04-18T04:55:39.755034+0000","last_clean":"2024-04-18T04:55:39.755034+0000","last_became_active":"2024-04-18T04:44:34.332551+0000","last_became_peered":"2024-04-18T04:44:34.332551+0000","last_unstale":"2024-04-18T04:55:39.755034+0000","last_undegraded":"2024-04-18T04:55:39.755034+0000","last_fullsized":"2024-04-18T04:55:39.755034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4567,"log_dups_size":0,"ondisk_log_size":4567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":66761,"num_write_kb":945017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"32'16","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.571906+0000","last_change":"2024-04-18T04:44:30.271099+0000","last_active":"2024-04-18T04:55:39.571906+0000","last_peered":"2024-04-18T04:55:39.571906+0000","last_clean":"2024-04-18T04:55:39.571906+0000","last_became_active":"2024-04-18T04:44:30.270804+0000","last_became_peered":"2024-04-18T04:44:30.270804+0000","last_unstale":"2024-04-18T04:55:39.571906+0000","last_undegraded":"2024-04-18T04:55:39.571906+0000","last_fullsized":"2024-04-18T04:55:39.571906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"32'7","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:45.522305+0000","last_change":"2024-04-18T04:55:45.522393+0000","last_active":"2024-04-18T04:55:45.522305+0000","last_peered":"2024-04-18T04:55:45.522305+0000","last_clean":"2024-04-18T04:55:45.522305+0000","last_became_active":"2024-04-18T04:44:29.894829+0000","last_became_peered":"2024-04-18T04:44:29.894829+0000","last_unstale":"2024-04-18T04:55:45.522305+0000","last_undegraded":"2024-04-18T04:55:45.522305+0000","last_fullsized":"2024-04-18T04:55:45.522305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-04-18T04:55:45.522283+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-04-18T04:55:45.522283+0000","last_clean_scrub_stamp":"2024-04-18T04:55:45.522283+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:55:12.590156+0000","scrub_duration":0.004192093,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"32'11","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:48.487889+0000","last_change":"2024-04-18T04:55:48.488099+0000","last_active":"2024-04-18T04:55:48.487889+0000","last_peered":"2024-04-18T04:55:48.487889+0000","last_clean":"2024-04-18T04:55:48.487889+0000","last_became_active":"2024-04-18T04:44:29.892282+0000","last_became_peered":"2024-04-18T04:44:29.892282+0000","last_unstale":"2024-04-18T04:55:48.487889+0000","last_undegraded":"2024-04-18T04:55:48.487889+0000","last_fullsized":"2024-04-18T04:55:48.487889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-04-18T04:55:48.487833+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-04-18T04:55:48.487833+0000","last_clean_scrub_stamp":"2024-04-18T04:55:48.487833+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:31:55.892667+0000","scrub_duration":0.023028330999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":4108,"num_write":6,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"32'11","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.547930+0000","last_change":"2024-04-18T04:44:30.285312+0000","last_active":"2024-04-18T04:55:39.547930+0000","last_peered":"2024-04-18T04:55:39.547930+0000","last_clean":"2024-04-18T04:55:39.547930+0000","last_became_active":"2024-04-18T04:44:30.285055+0000","last_became_peered":"2024-04-18T04:44:30.285055+0000","last_unstale":"2024-04-18T04:55:39.547930+0000","last_undegraded":"2024-04-18T04:55:39.547930+0000","last_fullsized":"2024-04-18T04:55:39.547930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"32'4897","reported_seq":4924,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.607292+0000","last_change":"2024-04-18T04:44:34.323352+0000","last_active":"2024-04-18T04:55:39.607292+0000","last_peered":"2024-04-18T04:55:39.607292+0000","last_clean":"2024-04-18T04:55:39.607292+0000","last_became_active":"2024-04-18T04:44:34.321645+0000","last_became_peered":"2024-04-18T04:44:34.321645+0000","last_unstale":"2024-04-18T04:55:39.607292+0000","last_undegraded":"2024-04-18T04:55:39.607292+0000","last_fullsized":"2024-04-18T04:55:39.607292+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4897,"log_dups_size":0,"ondisk_log_size":4897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":71816,"num_write_kb":1022773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"32'1268","reported_seq":1312,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:52.585584+0000","last_change":"2024-04-18T04:55:52.585682+0000","last_active":"2024-04-18T04:55:52.585584+0000","last_peered":"2024-04-18T04:55:52.585584+0000","last_clean":"2024-04-18T04:55:52.585584+0000","last_became_active":"2024-04-18T04:44:29.891610+0000","last_became_peered":"2024-04-18T04:44:29.891610+0000","last_unstale":"2024-04-18T04:55:52.585584+0000","last_undegraded":"2024-04-18T04:55:52.585584+0000","last_fullsized":"2024-04-18T04:55:52.585584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'1268","last_scrub_stamp":"2024-04-18T04:55:52.585564+0000","last_deep_scrub":"32'1268","last_deep_scrub_stamp":"2024-04-18T04:55:52.585564+0000","last_clean_scrub_stamp":"2024-04-18T04:55:52.585564+0000","objects_scrubbed":3,"log_size":1268,"log_dups_size":0,"ondisk_log_size":1268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:31:27.987253+0000","scrub_duration":0.029907377999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195509,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":4100,"num_write":1255,"num_write_kb":4235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"32'12","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:44.699287+0000","last_change":"2024-04-18T04:55:44.699508+0000","last_active":"2024-04-18T04:55:44.699287+0000","last_peered":"2024-04-18T04:55:44.699287+0000","last_clean":"2024-04-18T04:55:44.699287+0000","last_became_active":"2024-04-18T04:44:30.278275+0000","last_became_peered":"2024-04-18T04:44:30.278275+0000","last_unstale":"2024-04-18T04:55:44.699287+0000","last_undegraded":"2024-04-18T04:55:44.699287+0000","last_fullsized":"2024-04-18T04:55:44.699287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-04-18T04:55:44.699232+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-04-18T04:55:44.699232+0000","last_clean_scrub_stamp":"2024-04-18T04:55:44.699232+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:13:54.970200+0000","scrub_duration":0.026423889999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'4563","reported_seq":4590,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.818504+0000","last_change":"2024-04-18T04:44:34.313835+0000","last_active":"2024-04-18T04:55:39.818504+0000","last_peered":"2024-04-18T04:55:39.818504+0000","last_clean":"2024-04-18T04:55:39.818504+0000","last_became_active":"2024-04-18T04:44:34.313416+0000","last_became_peered":"2024-04-18T04:44:34.313416+0000","last_unstale":"2024-04-18T04:55:39.818504+0000","last_undegraded":"2024-04-18T04:55:39.818504+0000","last_fullsized":"2024-04-18T04:55:39.818504+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4563,"log_dups_size":0,"ondisk_log_size":4563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":66470,"num_write_kb":963599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"32'18","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.836865+0000","last_change":"2024-04-18T04:44:30.297229+0000","last_active":"2024-04-18T04:55:39.836865+0000","last_peered":"2024-04-18T04:55:39.836865+0000","last_clean":"2024-04-18T04:55:39.836865+0000","last_became_active":"2024-04-18T04:44:30.296354+0000","last_became_peered":"2024-04-18T04:44:30.296354+0000","last_unstale":"2024-04-18T04:55:39.836865+0000","last_undegraded":"2024-04-18T04:55:39.836865+0000","last_fullsized":"2024-04-18T04:55:39.836865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"32'15","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:54.114852+0000","last_change":"2024-04-18T04:55:54.114945+0000","last_active":"2024-04-18T04:55:54.114852+0000","last_peered":"2024-04-18T04:55:54.114852+0000","last_clean":"2024-04-18T04:55:54.114852+0000","last_became_active":"2024-04-18T04:44:30.280941+0000","last_became_peered":"2024-04-18T04:44:30.280941+0000","last_unstale":"2024-04-18T04:55:54.114852+0000","last_undegraded":"2024-04-18T04:55:54.114852+0000","last_fullsized":"2024-04-18T04:55:54.114852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-04-18T04:55:54.114832+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-04-18T04:55:54.114832+0000","last_clean_scrub_stamp":"2024-04-18T04:55:54.114832+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:50:26.893196+0000","scrub_duration":0.030107505,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"32'13","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.793932+0000","last_change":"2024-04-18T04:44:30.288507+0000","last_active":"2024-04-18T04:55:39.793932+0000","last_peered":"2024-04-18T04:55:39.793932+0000","last_clean":"2024-04-18T04:55:39.793932+0000","last_became_active":"2024-04-18T04:44:30.287820+0000","last_became_peered":"2024-04-18T04:44:30.287820+0000","last_unstale":"2024-04-18T04:55:39.793932+0000","last_undegraded":"2024-04-18T04:55:39.793932+0000","last_fullsized":"2024-04-18T04:55:39.793932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"32'10","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.886393+0000","last_change":"2024-04-18T04:55:33.440693+0000","last_active":"2024-04-18T04:55:39.886393+0000","last_peered":"2024-04-18T04:55:39.886393+0000","last_clean":"2024-04-18T04:55:39.886393+0000","last_became_active":"2024-04-18T04:44:30.272973+0000","last_became_peered":"2024-04-18T04:44:30.272973+0000","last_unstale":"2024-04-18T04:55:39.886393+0000","last_undegraded":"2024-04-18T04:55:39.886393+0000","last_fullsized":"2024-04-18T04:55:39.886393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-04-18T04:55:33.440498+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-04-18T04:55:33.440498+0000","last_clean_scrub_stamp":"2024-04-18T04:55:33.440498+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:02:28.528382+0000","scrub_duration":0.0040422899999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'8","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.685954+0000","last_change":"2024-04-18T04:55:36.653343+0000","last_active":"2024-04-18T04:55:39.685954+0000","last_peered":"2024-04-18T04:55:39.685954+0000","last_clean":"2024-04-18T04:55:39.685954+0000","last_became_active":"2024-04-18T04:44:30.298637+0000","last_became_peered":"2024-04-18T04:44:30.298637+0000","last_unstale":"2024-04-18T04:55:39.685954+0000","last_undegraded":"2024-04-18T04:55:39.685954+0000","last_fullsized":"2024-04-18T04:55:39.685954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-18T04:55:36.653251+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-18T04:55:36.653251+0000","last_clean_scrub_stamp":"2024-04-18T04:55:36.653251+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:40:18.803560+0000","scrub_duration":0.0023708309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"32'10","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.809963+0000","last_change":"2024-04-18T04:44:30.274613+0000","last_active":"2024-04-18T04:55:39.809963+0000","last_peered":"2024-04-18T04:55:39.809963+0000","last_clean":"2024-04-18T04:55:39.809963+0000","last_became_active":"2024-04-18T04:44:30.274328+0000","last_became_peered":"2024-04-18T04:44:30.274328+0000","last_unstale":"2024-04-18T04:55:39.809963+0000","last_undegraded":"2024-04-18T04:55:39.809963+0000","last_fullsized":"2024-04-18T04:55:39.809963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"32'20","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.758237+0000","last_change":"2024-04-18T04:44:30.309403+0000","last_active":"2024-04-18T04:55:39.758237+0000","last_peered":"2024-04-18T04:55:39.758237+0000","last_clean":"2024-04-18T04:55:39.758237+0000","last_became_active":"2024-04-18T04:44:30.308415+0000","last_became_peered":"2024-04-18T04:44:30.308415+0000","last_unstale":"2024-04-18T04:55:39.758237+0000","last_undegraded":"2024-04-18T04:55:39.758237+0000","last_fullsized":"2024-04-18T04:55:39.758237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"32'6","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.687625+0000","last_change":"2024-04-18T04:44:30.293996+0000","last_active":"2024-04-18T04:55:39.687625+0000","last_peered":"2024-04-18T04:55:39.687625+0000","last_clean":"2024-04-18T04:55:39.687625+0000","last_became_active":"2024-04-18T04:44:30.293748+0000","last_became_peered":"2024-04-18T04:44:30.293748+0000","last_unstale":"2024-04-18T04:55:39.687625+0000","last_undegraded":"2024-04-18T04:55:39.687625+0000","last_fullsized":"2024-04-18T04:55:39.687625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"32'9","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.706419+0000","last_change":"2024-04-18T04:45:12.040362+0000","last_active":"2024-04-18T04:55:39.706419+0000","last_peered":"2024-04-18T04:55:39.706419+0000","last_clean":"2024-04-18T04:55:39.706419+0000","last_became_active":"2024-04-18T04:45:12.040045+0000","last_became_peered":"2024-04-18T04:45:12.040045+0000","last_unstale":"2024-04-18T04:55:39.706419+0000","last_undegraded":"2024-04-18T04:55:39.706419+0000","last_fullsized":"2024-04-18T04:55:39.706419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"32'12","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.861223+0000","last_change":"2024-04-18T04:44:30.285836+0000","last_active":"2024-04-18T04:55:39.861223+0000","last_peered":"2024-04-18T04:55:39.861223+0000","last_clean":"2024-04-18T04:55:39.861223+0000","last_became_active":"2024-04-18T04:44:30.285602+0000","last_became_peered":"2024-04-18T04:44:30.285602+0000","last_unstale":"2024-04-18T04:55:39.861223+0000","last_undegraded":"2024-04-18T04:55:39.861223+0000","last_fullsized":"2024-04-18T04:55:39.861223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"32'15","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.710846+0000","last_change":"2024-04-18T04:45:12.040347+0000","last_active":"2024-04-18T04:55:39.710846+0000","last_peered":"2024-04-18T04:55:39.710846+0000","last_clean":"2024-04-18T04:55:39.710846+0000","last_became_active":"2024-04-18T04:45:12.040023+0000","last_became_peered":"2024-04-18T04:45:12.040023+0000","last_unstale":"2024-04-18T04:55:39.710846+0000","last_undegraded":"2024-04-18T04:55:39.710846+0000","last_fullsized":"2024-04-18T04:55:39.710846+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"32'17","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.592335+0000","last_change":"2024-04-18T04:44:30.310229+0000","last_active":"2024-04-18T04:55:39.592335+0000","last_peered":"2024-04-18T04:55:39.592335+0000","last_clean":"2024-04-18T04:55:39.592335+0000","last_became_active":"2024-04-18T04:44:30.310045+0000","last_became_peered":"2024-04-18T04:44:30.310045+0000","last_unstale":"2024-04-18T04:55:39.592335+0000","last_undegraded":"2024-04-18T04:55:39.592335+0000","last_fullsized":"2024-04-18T04:55:39.592335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"32'11","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.851447+0000","last_change":"2024-04-18T04:44:30.305644+0000","last_active":"2024-04-18T04:55:39.851447+0000","last_peered":"2024-04-18T04:55:39.851447+0000","last_clean":"2024-04-18T04:55:39.851447+0000","last_became_active":"2024-04-18T04:44:30.304921+0000","last_became_peered":"2024-04-18T04:44:30.304921+0000","last_unstale":"2024-04-18T04:55:39.851447+0000","last_undegraded":"2024-04-18T04:55:39.851447+0000","last_fullsized":"2024-04-18T04:55:39.851447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"32'12","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.793804+0000","last_change":"2024-04-18T04:55:38.737483+0000","last_active":"2024-04-18T04:55:39.793804+0000","last_peered":"2024-04-18T04:55:39.793804+0000","last_clean":"2024-04-18T04:55:39.793804+0000","last_became_active":"2024-04-18T04:44:30.291742+0000","last_became_peered":"2024-04-18T04:44:30.291742+0000","last_unstale":"2024-04-18T04:55:39.793804+0000","last_undegraded":"2024-04-18T04:55:39.793804+0000","last_fullsized":"2024-04-18T04:55:39.793804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-18T04:55:38.737212+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-18T04:55:38.737212+0000","last_clean_scrub_stamp":"2024-04-18T04:55:38.737212+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:18:26.020231+0000","scrub_duration":0.0047678599999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"32'19","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:48.186727+0000","last_change":"2024-04-18T04:55:48.186803+0000","last_active":"2024-04-18T04:55:48.186727+0000","last_peered":"2024-04-18T04:55:48.186727+0000","last_clean":"2024-04-18T04:55:48.186727+0000","last_became_active":"2024-04-18T04:44:30.296177+0000","last_became_peered":"2024-04-18T04:44:30.296177+0000","last_unstale":"2024-04-18T04:55:48.186727+0000","last_undegraded":"2024-04-18T04:55:48.186727+0000","last_fullsized":"2024-04-18T04:55:48.186727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2024-04-18T04:55:48.186704+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2024-04-18T04:55:48.186704+0000","last_clean_scrub_stamp":"2024-04-18T04:55:48.186704+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:20:47.516415+0000","scrub_duration":0.0024521629999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"32'11","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:36.695982+0000","last_change":"2024-04-18T04:44:30.306568+0000","last_active":"2024-04-18T04:55:36.695982+0000","last_peered":"2024-04-18T04:55:36.695982+0000","last_clean":"2024-04-18T04:55:36.695982+0000","last_became_active":"2024-04-18T04:44:30.305674+0000","last_became_peered":"2024-04-18T04:44:30.305674+0000","last_unstale":"2024-04-18T04:55:36.695982+0000","last_undegraded":"2024-04-18T04:55:36.695982+0000","last_fullsized":"2024-04-18T04:55:36.695982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"32'14","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.666394+0000","last_change":"2024-04-18T04:44:30.307297+0000","last_active":"2024-04-18T04:55:39.666394+0000","last_peered":"2024-04-18T04:55:39.666394+0000","last_clean":"2024-04-18T04:55:39.666394+0000","last_became_active":"2024-04-18T04:44:30.305470+0000","last_became_peered":"2024-04-18T04:44:30.305470+0000","last_unstale":"2024-04-18T04:55:39.666394+0000","last_undegraded":"2024-04-18T04:55:39.666394+0000","last_fullsized":"2024-04-18T04:55:39.666394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"32'12","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.756677+0000","last_change":"2024-04-18T04:44:30.280849+0000","last_active":"2024-04-18T04:55:39.756677+0000","last_peered":"2024-04-18T04:55:39.756677+0000","last_clean":"2024-04-18T04:55:39.756677+0000","last_became_active":"2024-04-18T04:44:30.280535+0000","last_became_peered":"2024-04-18T04:44:30.280535+0000","last_unstale":"2024-04-18T04:55:39.756677+0000","last_undegraded":"2024-04-18T04:55:39.756677+0000","last_fullsized":"2024-04-18T04:55:39.756677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'11","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.855176+0000","last_change":"2024-04-18T04:44:30.278849+0000","last_active":"2024-04-18T04:55:39.855176+0000","last_peered":"2024-04-18T04:55:39.855176+0000","last_clean":"2024-04-18T04:55:39.855176+0000","last_became_active":"2024-04-18T04:44:30.278624+0000","last_became_peered":"2024-04-18T04:44:30.278624+0000","last_unstale":"2024-04-18T04:55:39.855176+0000","last_undegraded":"2024-04-18T04:55:39.855176+0000","last_fullsized":"2024-04-18T04:55:39.855176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"32'15","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.737363+0000","last_change":"2024-04-18T04:55:37.692128+0000","last_active":"2024-04-18T04:55:39.737363+0000","last_peered":"2024-04-18T04:55:39.737363+0000","last_clean":"2024-04-18T04:55:39.737363+0000","last_became_active":"2024-04-18T04:44:30.295754+0000","last_became_peered":"2024-04-18T04:44:30.295754+0000","last_unstale":"2024-04-18T04:55:39.737363+0000","last_undegraded":"2024-04-18T04:55:39.737363+0000","last_fullsized":"2024-04-18T04:55:39.737363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-04-18T04:55:37.691953+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-04-18T04:55:37.691953+0000","last_clean_scrub_stamp":"2024-04-18T04:55:37.691953+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:00:22.042260+0000","scrub_duration":0.042569443999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:47.662362+0000","last_change":"2024-04-18T04:55:47.662571+0000","last_active":"2024-04-18T04:55:47.662362+0000","last_peered":"2024-04-18T04:55:47.662362+0000","last_clean":"2024-04-18T04:55:47.662362+0000","last_became_active":"2024-04-18T04:44:30.297416+0000","last_became_peered":"2024-04-18T04:44:30.297416+0000","last_unstale":"2024-04-18T04:55:47.662362+0000","last_undegraded":"2024-04-18T04:55:47.662362+0000","last_fullsized":"2024-04-18T04:55:47.662362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-18T04:55:47.662310+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-18T04:55:47.662310+0000","last_clean_scrub_stamp":"2024-04-18T04:55:47.662310+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:55:53.708274+0000","scrub_duration":0.0036875200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"32'10","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:14.428296+0000","last_change":"2024-04-18T04:44:30.292802+0000","last_active":"2024-04-18T04:55:14.428296+0000","last_peered":"2024-04-18T04:55:14.428296+0000","last_clean":"2024-04-18T04:55:14.428296+0000","last_became_active":"2024-04-18T04:44:30.291939+0000","last_became_peered":"2024-04-18T04:44:30.291939+0000","last_unstale":"2024-04-18T04:55:14.428296+0000","last_undegraded":"2024-04-18T04:55:14.428296+0000","last_fullsized":"2024-04-18T04:55:14.428296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"32'21","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.772255+0000","last_change":"2024-04-18T04:44:30.309020+0000","last_active":"2024-04-18T04:55:39.772255+0000","last_peered":"2024-04-18T04:55:39.772255+0000","last_clean":"2024-04-18T04:55:39.772255+0000","last_became_active":"2024-04-18T04:44:30.307604+0000","last_became_peered":"2024-04-18T04:44:30.307604+0000","last_unstale":"2024-04-18T04:55:39.772255+0000","last_undegraded":"2024-04-18T04:55:39.772255+0000","last_fullsized":"2024-04-18T04:55:39.772255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"32'14","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.505869+0000","last_change":"2024-04-18T04:44:30.314533+0000","last_active":"2024-04-18T04:55:39.505869+0000","last_peered":"2024-04-18T04:55:39.505869+0000","last_clean":"2024-04-18T04:55:39.505869+0000","last_became_active":"2024-04-18T04:44:30.313985+0000","last_became_peered":"2024-04-18T04:44:30.313985+0000","last_unstale":"2024-04-18T04:55:39.505869+0000","last_undegraded":"2024-04-18T04:55:39.505869+0000","last_fullsized":"2024-04-18T04:55:39.505869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"32'11","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.584431+0000","last_change":"2024-04-18T04:44:30.309273+0000","last_active":"2024-04-18T04:55:39.584431+0000","last_peered":"2024-04-18T04:55:39.584431+0000","last_clean":"2024-04-18T04:55:39.584431+0000","last_became_active":"2024-04-18T04:44:30.309002+0000","last_became_peered":"2024-04-18T04:44:30.309002+0000","last_unstale":"2024-04-18T04:55:39.584431+0000","last_undegraded":"2024-04-18T04:55:39.584431+0000","last_fullsized":"2024-04-18T04:55:39.584431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"32'9","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.858059+0000","last_change":"2024-04-18T04:44:30.292371+0000","last_active":"2024-04-18T04:55:39.858059+0000","last_peered":"2024-04-18T04:55:39.858059+0000","last_clean":"2024-04-18T04:55:39.858059+0000","last_became_active":"2024-04-18T04:44:30.290504+0000","last_became_peered":"2024-04-18T04:44:30.290504+0000","last_unstale":"2024-04-18T04:55:39.858059+0000","last_undegraded":"2024-04-18T04:55:39.858059+0000","last_fullsized":"2024-04-18T04:55:39.858059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"32'10","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.250008+0000","last_change":"2024-04-18T04:44:30.299935+0000","last_active":"2024-04-18T04:55:39.250008+0000","last_peered":"2024-04-18T04:55:39.250008+0000","last_clean":"2024-04-18T04:55:39.250008+0000","last_became_active":"2024-04-18T04:44:30.290175+0000","last_became_peered":"2024-04-18T04:44:30.290175+0000","last_unstale":"2024-04-18T04:55:39.250008+0000","last_undegraded":"2024-04-18T04:55:39.250008+0000","last_fullsized":"2024-04-18T04:55:39.250008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"32'7","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.789579+0000","last_change":"2024-04-18T04:44:30.288940+0000","last_active":"2024-04-18T04:55:39.789579+0000","last_peered":"2024-04-18T04:55:39.789579+0000","last_clean":"2024-04-18T04:55:39.789579+0000","last_became_active":"2024-04-18T04:44:30.288131+0000","last_became_peered":"2024-04-18T04:44:30.288131+0000","last_unstale":"2024-04-18T04:55:39.789579+0000","last_undegraded":"2024-04-18T04:55:39.789579+0000","last_fullsized":"2024-04-18T04:55:39.789579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"32'11","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.592904+0000","last_change":"2024-04-18T04:55:39.585898+0000","last_active":"2024-04-18T04:55:39.592904+0000","last_peered":"2024-04-18T04:55:39.592904+0000","last_clean":"2024-04-18T04:55:39.592904+0000","last_became_active":"2024-04-18T04:44:30.287325+0000","last_became_peered":"2024-04-18T04:44:30.287325+0000","last_unstale":"2024-04-18T04:55:39.592904+0000","last_undegraded":"2024-04-18T04:55:39.592904+0000","last_fullsized":"2024-04-18T04:55:39.592904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-18T04:55:39.585750+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-18T04:55:39.585750+0000","last_clean_scrub_stamp":"2024-04-18T04:55:39.585750+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:50:34.983543+0000","scrub_duration":0.0086941710000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"32'8","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.641426+0000","last_change":"2024-04-18T04:44:30.275485+0000","last_active":"2024-04-18T04:55:39.641426+0000","last_peered":"2024-04-18T04:55:39.641426+0000","last_clean":"2024-04-18T04:55:39.641426+0000","last_became_active":"2024-04-18T04:44:30.275118+0000","last_became_peered":"2024-04-18T04:44:30.275118+0000","last_unstale":"2024-04-18T04:55:39.641426+0000","last_undegraded":"2024-04-18T04:55:39.641426+0000","last_fullsized":"2024-04-18T04:55:39.641426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.575152+0000","last_change":"2024-04-18T04:44:30.277119+0000","last_active":"2024-04-18T04:55:39.575152+0000","last_peered":"2024-04-18T04:55:39.575152+0000","last_clean":"2024-04-18T04:55:39.575152+0000","last_became_active":"2024-04-18T04:44:30.276654+0000","last_became_peered":"2024-04-18T04:44:30.276654+0000","last_unstale":"2024-04-18T04:55:39.575152+0000","last_undegraded":"2024-04-18T04:55:39.575152+0000","last_fullsized":"2024-04-18T04:55:39.575152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"32'12","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:38.253919+0000","last_change":"2024-04-18T04:44:30.302905+0000","last_active":"2024-04-18T04:55:38.253919+0000","last_peered":"2024-04-18T04:55:38.253919+0000","last_clean":"2024-04-18T04:55:38.253919+0000","last_became_active":"2024-04-18T04:44:30.302180+0000","last_became_peered":"2024-04-18T04:44:30.302180+0000","last_unstale":"2024-04-18T04:55:38.253919+0000","last_undegraded":"2024-04-18T04:55:38.253919+0000","last_fullsized":"2024-04-18T04:55:38.253919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":11,"num_write":2195132,"num_write_kb":31163048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149947,"ondisk_log_size":149947,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":739,"ondisk_log_size":739,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":81164485,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":422,"num_read_kb":74892,"num_write":3467,"num_write_kb":80225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":22954,"num_omap_keys":44,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":37855232,"data_stored":162328970,"data_compressed":18251382,"data_compressed_allocated":21430272,"data_compressed_original":146063360,"omap_allocated":0,"internal_metadata":0},"log_size":3533,"ondisk_log_size":3533,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66624,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509580,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":993936,"kb_used_data":6920,"kb_used_omap":1,"kb_used_meta":987006,"kb_avail":93377904,"statfs":{"total":96636764160,"available":95618973696,"internally_reserved":0,"allocated":7086080,"data_stored":17021899,"data_compressed":1734435,"data_compressed_allocated":2166784,"data_compressed_original":12316672,"omap_allocated":1592,"internal_metadata":1010694600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:55:43 2024","interfaces":[{"interface":"back","average":{"1min":2.04,"5min":5.1870000000000003,"15min":3.4540000000000002},"min":{"1min":0.29199999999999998,"5min":0.26200000000000001,"15min":0.252},"max":{"1min":9.3330000000000002,"5min":76.096999999999994,"15min":76.096999999999994},"last":0.40600000000000003},{"interface":"front","average":{"1min":2.1000000000000001,"5min":7.3920000000000003,"15min":3.8599999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":9.5879999999999992,"5min":184.16999999999999,"15min":184.16999999999999},"last":0.42299999999999999}]},{"osd":1,"last update":"Thu Apr 18 04:55:43 2024","interfaces":[{"interface":"back","average":{"1min":2.577,"5min":6.6239999999999997,"15min":4.4909999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.24299999999999999},"max":{"1min":14.954000000000001,"5min":85.109999999999999,"15min":153.59299999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":3.1949999999999998,"5min":5.7999999999999998,"15min":4.2220000000000004},"min":{"1min":0.38,"5min":0.35299999999999998,"15min":0.29199999999999998},"max":{"1min":19.210999999999999,"5min":88.606999999999999,"15min":153.94300000000001},"last":0.374}]},{"osd":2,"last update":"Thu Apr 18 04:55:43 2024","interfaces":[{"interface":"back","average":{"1min":2.198,"5min":3.202,"15min":2.754},"min":{"1min":0.34999999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":9.0220000000000002,"5min":23.867000000000001,"15min":162.59700000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":2.1440000000000001,"5min":3.8159999999999998,"15min":3.0659999999999998},"min":{"1min":0.41899999999999998,"5min":0.309,"15min":0.309},"max":{"1min":8.3670000000000009,"5min":22.957999999999998,"15min":153.83500000000001},"last":0.52900000000000003}]},{"osd":4,"last update":"Thu Apr 18 04:55:43 2024","interfaces":[{"interface":"back","average":{"1min":2.7490000000000001,"5min":2.552,"15min":1.8740000000000001},"min":{"1min":0.54100000000000004,"5min":0.43099999999999999,"15min":0.40000000000000002},"max":{"1min":29.809999999999999,"5min":29.809999999999999,"15min":31.974},"last":0.83699999999999997},{"interface":"front","average":{"1min":3.0219999999999998,"5min":4.4900000000000002,"15min":2.8620000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":29.777999999999999,"5min":50.536000000000001,"15min":50.536000000000001},"last":0.624}]},{"osd":5,"last update":"Thu Apr 18 04:55:43 2024","interfaces":[{"interface":"back","average":{"1min":3.0219999999999998,"5min":3.4740000000000002,"15min":2.4740000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":27.469000000000001,"5min":29.539999999999999,"15min":40.915999999999997},"last":0.64300000000000002},{"interface":"front","average":{"1min":3.0169999999999999,"5min":2.774,"15min":2.1150000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.41899999999999998},"max":{"1min":28.256,"5min":28.256,"15min":68.370000000000005},"last":0.81899999999999995}]},{"osd":6,"last update":"Thu Apr 18 04:55:43 2024","interfaces":[{"interface":"back","average":{"1min":1.992,"5min":3.0150000000000001,"15min":2.3109999999999999},"min":{"1min":0.47999999999999998,"5min":0.45100000000000001,"15min":0.39900000000000002},"max":{"1min":9.3699999999999992,"5min":23.579999999999998,"15min":48.765000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.631,"5min":4.1749999999999998,"15min":2.6440000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.38900000000000001},"max":{"1min":8.5619999999999994,"5min":69.227999999999994,"15min":69.227999999999994},"last":0.80700000000000005}]},{"osd":7,"last update":"Thu Apr 18 04:55:43 2024","interfaces":[{"interface":"back","average":{"1min":1.915,"5min":2.633,"15min":2.1720000000000002},"min":{"1min":0.56599999999999995,"5min":0.48899999999999999,"15min":0.44700000000000001},"max":{"1min":8.4960000000000004,"5min":18.795000000000002,"15min":40.947000000000003},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.994,"5min":3.1269999999999998,"15min":2.2959999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":9.4320000000000004,"5min":19.512,"15min":68.329999999999998},"last":0.86599999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509581,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":556140,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":554430,"kb_avail":93815700,"statfs":{"total":96636764160,"available":96067276800,"internally_reserved":0,"allocated":1740800,"data_stored":4437838,"data_compressed":439103,"data_compressed_allocated":598016,"data_compressed_original":3510272,"omap_allocated":1594,"internal_metadata":567736774},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:55:37 2024","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":3.512,"15min":3.4159999999999999},"min":{"1min":0.30299999999999999,"5min":0.28699999999999998,"15min":0.23300000000000001},"max":{"1min":5.5529999999999999,"5min":30.396999999999998,"15min":120.402},"last":0.28899999999999998},{"interface":"front","average":{"1min":1.165,"5min":4.6600000000000001,"15min":3.3700000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.28899999999999998},"max":{"1min":5.1159999999999997,"5min":58.277999999999999,"15min":121.377},"last":0.44}]},{"osd":1,"last update":"Thu Apr 18 04:55:37 2024","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":4.5439999999999996,"15min":3.823},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.28399999999999997},"max":{"1min":7.0899999999999999,"5min":62.851999999999997,"15min":135.32400000000001},"last":0.314},{"interface":"front","average":{"1min":2.359,"5min":4.7889999999999997,"15min":3.9590000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.27600000000000002},"max":{"1min":8.3480000000000008,"5min":60.741999999999997,"15min":178.08199999999999},"last":0.40400000000000003}]},{"osd":3,"last update":"Thu Apr 18 04:55:37 2024","interfaces":[{"interface":"back","average":{"1min":2.0619999999999998,"5min":4.1980000000000004,"15min":3.2509999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.35999999999999999},"max":{"1min":10.42,"5min":65.037000000000006,"15min":124.76300000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":3.0249999999999999,"5min":4.7030000000000003,"15min":3.6640000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.33000000000000002},"max":{"1min":22.298999999999999,"5min":70.861999999999995,"15min":145.47200000000001},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Apr 18 04:55:37 2024","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":2.7639999999999998,"15min":2.335},"min":{"1min":0.51200000000000001,"5min":0.45200000000000001,"15min":0.35299999999999998},"max":{"1min":5.4420000000000002,"5min":14.388999999999999,"15min":37.420000000000002},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.6220000000000001,"5min":2.7200000000000002,"15min":2.2269999999999999},"min":{"1min":0.48099999999999998,"5min":0.42999999999999999,"15min":0.42699999999999999},"max":{"1min":6.8719999999999999,"5min":14.356999999999999,"15min":37.460000000000001},"last":0.64500000000000002}]},{"osd":5,"last update":"Thu Apr 18 04:55:37 2024","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":2.8340000000000001,"15min":2.1619999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.32700000000000001},"max":{"1min":6.2869999999999999,"5min":14.244,"15min":37.5},"last":0.746},{"interface":"front","average":{"1min":1.657,"5min":2.8250000000000002,"15min":2.1779999999999999},"min":{"1min":0.56599999999999995,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":6.2489999999999997,"5min":28.143000000000001,"15min":28.143000000000001},"last":0.63900000000000001}]},{"osd":6,"last update":"Thu Apr 18 04:55:37 2024","interfaces":[{"interface":"back","average":{"1min":1.617,"5min":2.7130000000000001,"15min":2.2989999999999999},"min":{"1min":0.54900000000000004,"5min":0.47499999999999998,"15min":0.441},"max":{"1min":6.3289999999999997,"5min":11.337,"15min":34.506999999999998},"last":0.66500000000000004},{"interface":"front","average":{"1min":1.7689999999999999,"5min":2.8159999999999998,"15min":2.3450000000000002},"min":{"1min":0.504,"5min":0.46999999999999997,"15min":0.44800000000000001},"max":{"1min":6.8259999999999996,"5min":14.285,"15min":37.533000000000001},"last":0.84199999999999997}]},{"osd":7,"last update":"Thu Apr 18 04:55:37 2024","interfaces":[{"interface":"back","average":{"1min":2.008,"5min":2.8109999999999999,"15min":2.137},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.39800000000000002},"max":{"1min":6.8710000000000004,"5min":12.914999999999999,"15min":24.155000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":2.052,"5min":2.7330000000000001,"15min":2.2010000000000001},"min":{"1min":0.68300000000000005,"5min":0.52800000000000002,"15min":0.46899999999999997},"max":{"1min":6.9009999999999998,"5min":26.064,"15min":34.576999999999998},"last":0.90900000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509578,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1000120,"kb_used_data":3440,"kb_used_omap":1,"kb_used_meta":996670,"kb_avail":93371720,"statfs":{"total":96636764160,"available":95612641280,"internally_reserved":0,"allocated":3522560,"data_stored":21124827,"data_compressed":2531508,"data_compressed_allocated":2936832,"data_compressed_original":20754432,"omap_allocated":1594,"internal_metadata":1020590534},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:55:42 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":3.8340000000000001,"15min":3.383},"min":{"1min":0.26400000000000001,"5min":0.22,"15min":0.22},"max":{"1min":4.5839999999999996,"5min":32.177,"15min":124.096},"last":0.26100000000000001},{"interface":"front","average":{"1min":1.395,"5min":6.4779999999999998,"15min":4.117},"min":{"1min":0.29699999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":6.6260000000000003,"5min":143.60300000000001,"15min":164.41},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Apr 18 04:55:42 2024","interfaces":[{"interface":"back","average":{"1min":7.3040000000000003,"5min":5.0350000000000001,"15min":6.3550000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.29299999999999998},"max":{"1min":108.968,"5min":108.968,"15min":840.66700000000003},"last":0.34499999999999997},{"interface":"front","average":{"1min":7.1669999999999998,"5min":6.5599999999999996,"15min":4.1550000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":109.02800000000001,"5min":114.47199999999999,"15min":164.477},"last":0.502}]},{"osd":3,"last update":"Thu Apr 18 04:55:42 2024","interfaces":[{"interface":"back","average":{"1min":9.4390000000000001,"5min":7.1669999999999998,"15min":5.3319999999999999},"min":{"1min":0.39100000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":135.86099999999999,"5min":135.86099999999999,"15min":164.50299999999999},"last":0.371},{"interface":"front","average":{"1min":9.2579999999999991,"5min":8.4800000000000004,"15min":5.4039999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.36899999999999999},"max":{"1min":136.69300000000001,"5min":151.82599999999999,"15min":151.82599999999999},"last":0.38600000000000001}]},{"osd":4,"last update":"Thu Apr 18 04:55:42 2024","interfaces":[{"interface":"back","average":{"1min":1.845,"5min":3.4159999999999999,"15min":2.6949999999999998},"min":{"1min":0.42299999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":10.134,"5min":23.478999999999999,"15min":52.072000000000003},"last":0.72499999999999998},{"interface":"front","average":{"1min":2.0579999999999998,"5min":3.7200000000000002,"15min":5.6299999999999999},"min":{"1min":0.41799999999999998,"5min":0.40799999999999997,"15min":0.34399999999999997},"max":{"1min":13.097,"5min":33.017000000000003,"15min":840.61500000000001},"last":0.78000000000000003}]},{"osd":5,"last update":"Thu Apr 18 04:55:42 2024","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":5.1559999999999997,"15min":4.6130000000000004},"min":{"1min":0.627,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":4.2960000000000003,"5min":114.37,"15min":478.47000000000003},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.5980000000000001,"5min":3.6269999999999998,"15min":3.1269999999999998},"min":{"1min":0.745,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":5.194,"5min":41.832000000000001,"15min":164.374},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Apr 18 04:55:42 2024","interfaces":[{"interface":"back","average":{"1min":1.966,"5min":3.5249999999999999,"15min":2.8029999999999999},"min":{"1min":0.50600000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":14.938000000000001,"5min":23.416,"15min":52.100999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.6499999999999999,"5min":3.3410000000000002,"15min":3.8199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.438},"max":{"1min":5.5049999999999999,"5min":18.951000000000001,"15min":396.81},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Apr 18 04:55:42 2024","interfaces":[{"interface":"back","average":{"1min":2.1949999999999998,"5min":5.2370000000000001,"15min":3.6579999999999999},"min":{"1min":0.73399999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":10.177,"5min":100.565,"15min":164.447},"last":0.79500000000000004},{"interface":"front","average":{"1min":2.476,"5min":3.581,"15min":2.7919999999999998},"min":{"1min":0.55800000000000005,"5min":0.46200000000000002,"15min":0.45400000000000001},"max":{"1min":13.156000000000001,"5min":23.648,"15min":54.353000000000002},"last":0.84399999999999997}]}]},{"osd":7,"up_from":14,"seq":60129542287,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":687992,"kb_used_data":10544,"kb_used_omap":1,"kb_used_meta":677438,"kb_avail":93683848,"statfs":{"total":96636764160,"available":95932260352,"internally_reserved":0,"allocated":10797056,"data_stored":35675430,"data_compressed":3619092,"data_compressed_allocated":4272128,"data_compressed_original":29368320,"omap_allocated":1589,"internal_metadata":693696971},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:55:30 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":5.391,"15min":3.7480000000000002},"min":{"1min":0.29099999999999998,"5min":0.249,"15min":0.249},"max":{"1min":6.2889999999999997,"5min":195.89500000000001,"15min":287.19600000000003},"last":0.436},{"interface":"front","average":{"1min":1.724,"5min":5.8419999999999996,"15min":4.1289999999999996},"min":{"1min":0.31900000000000001,"5min":0.26800000000000002,"15min":0.26200000000000001},"max":{"1min":6.5590000000000002,"5min":196.149,"15min":289.23899999999998},"last":0.74299999999999999}]},{"osd":1,"last update":"Thu Apr 18 04:55:49 2024","interfaces":[{"interface":"back","average":{"1min":1.7989999999999999,"5min":3.8570000000000002,"15min":3.613},"min":{"1min":0.33400000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":9.5960000000000001,"5min":90.055000000000007,"15min":303.83800000000002},"last":0.53900000000000003},{"interface":"front","average":{"1min":1.9330000000000001,"5min":4.0019999999999998,"15min":3.7349999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32000000000000001},"max":{"1min":9.5800000000000001,"5min":90.001999999999995,"15min":288.05799999999999},"last":0.47799999999999998}]},{"osd":2,"last update":"Thu Apr 18 04:55:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":3.532,"15min":2.2989999999999999},"min":{"1min":0.36399999999999999,"5min":0.35599999999999998,"15min":0.30099999999999999},"max":{"1min":4.7110000000000003,"5min":91.088999999999999,"15min":91.088999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":3.0169999999999999,"15min":1.879},"min":{"1min":0.51600000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":3.7330000000000001,"5min":91.171999999999997,"15min":91.171999999999997},"last":0.67200000000000004}]},{"osd":3,"last update":"Thu Apr 18 04:55:49 2024","interfaces":[{"interface":"back","average":{"1min":1.9399999999999999,"5min":3.992,"15min":3.8599999999999999},"min":{"1min":0.48999999999999999,"5min":0.34300000000000003,"15min":0.30199999999999999},"max":{"1min":11.148999999999999,"5min":89.393000000000001,"15min":308.36700000000002},"last":0.63200000000000001},{"interface":"front","average":{"1min":1.3899999999999999,"5min":3.411,"15min":3.198},"min":{"1min":0.39200000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":6.5259999999999998,"5min":88.070999999999998,"15min":289.86099999999999},"last":0.79400000000000004}]},{"osd":4,"last update":"Thu Apr 18 04:55:30 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":1.333,"15min":1.1559999999999999},"min":{"1min":0.317,"5min":0.25900000000000001,"15min":0.252},"max":{"1min":1.627,"5min":41.567,"15min":41.567},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.91700000000000004,"5min":1.4099999999999999,"15min":1.141},"min":{"1min":0.34699999999999998,"5min":0.29699999999999999,"15min":0.247},"max":{"1min":3.8860000000000001,"5min":45.646000000000001,"15min":45.646000000000001},"last":0.91200000000000003}]},{"osd":5,"last update":"Thu Apr 18 04:55:30 2024","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.538,"15min":1.1859999999999999},"min":{"1min":0.30499999999999999,"5min":0.27000000000000002,"15min":0.26600000000000001},"max":{"1min":11.045,"5min":41.595999999999997,"15min":41.595999999999997},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.155,"15min":1.048},"min":{"1min":0.36199999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":11.082000000000001,"5min":15.271000000000001,"15min":15.271000000000001},"last":0.94999999999999996}]},{"osd":6,"last update":"Thu Apr 18 04:55:30 2024","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.1140000000000001,"15min":1.016},"min":{"1min":0.32000000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":6.3520000000000003,"5min":8.2390000000000008,"15min":8.2390000000000008},"last":1.038},{"interface":"front","average":{"1min":1.016,"5min":1.1379999999999999,"15min":1.069},"min":{"1min":0.34399999999999997,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":6.2329999999999997,"5min":11.288,"15min":11.288},"last":1.0600000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542285,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":809816,"kb_used_data":3728,"kb_used_omap":1,"kb_used_meta":806078,"kb_avail":93562024,"statfs":{"total":96636764160,"available":95807512576,"internally_reserved":0,"allocated":3817472,"data_stored":16932052,"data_compressed":2087260,"data_compressed_allocated":2478080,"data_compressed_original":15798272,"omap_allocated":1593,"internal_metadata":825424327},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:55:38 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":2.6560000000000001,"15min":1.6799999999999999},"min":{"1min":0.34499999999999997,"5min":0.247,"15min":0.247},"max":{"1min":3.1579999999999999,"5min":99.328999999999994,"15min":99.328999999999994},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.99299999999999999,"5min":2.7160000000000002,"15min":2.198},"min":{"1min":0.42599999999999999,"5min":0.311,"15min":0.309},"max":{"1min":3.202,"5min":99.287000000000006,"15min":99.287000000000006},"last":0.71399999999999997}]},{"osd":1,"last update":"Thu Apr 18 04:55:38 2024","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":4.593,"15min":2.855},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":5.3890000000000002,"5min":122.06999999999999,"15min":122.06999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.97299999999999998,"5min":4.1230000000000002,"15min":2.6899999999999999},"min":{"1min":0.33700000000000002,"5min":0.33300000000000002,"15min":0.32800000000000001},"max":{"1min":5.4009999999999998,"5min":122.09,"15min":122.09},"last":0.58199999999999996}]},{"osd":2,"last update":"Thu Apr 18 04:55:38 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":2.5379999999999998,"15min":1.835},"min":{"1min":0.40000000000000002,"5min":0.31,"15min":0.31},"max":{"1min":2.9129999999999998,"5min":38.557000000000002,"15min":41.764000000000003},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.4259999999999999,"5min":2.5950000000000002,"15min":1.9259999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":12.701000000000001,"5min":35.734000000000002,"15min":41.710000000000001},"last":1.0600000000000001}]},{"osd":3,"last update":"Thu Apr 18 04:55:38 2024","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":3.7669999999999999,"15min":2.948},"min":{"1min":0.38700000000000001,"5min":0.312,"15min":0.29999999999999999},"max":{"1min":9.2970000000000006,"5min":101.006,"15min":101.006},"last":0.67000000000000004},{"interface":"front","average":{"1min":1.6220000000000001,"5min":3.8250000000000002,"15min":3.032},"min":{"1min":0.44500000000000001,"5min":0.42499999999999999,"15min":0.42199999999999999},"max":{"1min":9.3840000000000003,"5min":101.039,"15min":101.039},"last":0.82999999999999996}]},{"osd":4,"last update":"Thu Apr 18 04:55:38 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":1.569,"15min":1.147},"min":{"1min":0.28199999999999997,"5min":0.217,"15min":0.217},"max":{"1min":2.1059999999999999,"5min":19.481999999999999,"15min":19.481999999999999},"last":1.131},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.681,"15min":1.2370000000000001},"min":{"1min":0.36799999999999999,"5min":0.28199999999999997,"15min":0.26400000000000001},"max":{"1min":2.8090000000000002,"5min":19.536999999999999,"15min":19.536999999999999},"last":1.1519999999999999}]},{"osd":5,"last update":"Thu Apr 18 04:55:38 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.82999999999999996,"15min":1.0089999999999999},"min":{"1min":0.312,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.6619999999999999,"5min":7.7720000000000002,"15min":13.538},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.89600000000000002,"15min":0.93500000000000005},"min":{"1min":0.30399999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.728,"5min":7.4950000000000001,"15min":8.7210000000000001},"last":1.026}]},{"osd":7,"last update":"Thu Apr 18 04:55:38 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.94499999999999995,"15min":1.0429999999999999},"min":{"1min":0.33300000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.696,"5min":7.5359999999999996,"15min":7.5359999999999996},"last":1.0960000000000001},{"interface":"front","average":{"1min":0.84899999999999998,"5min":1.006,"15min":1.018},"min":{"1min":0.34399999999999997,"5min":0.33900000000000002,"15min":0.314},"max":{"1min":2.887,"5min":10.955,"15min":10.955},"last":1.179}]}]},{"osd":5,"up_from":14,"seq":60129542287,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":620212,"kb_used_data":3500,"kb_used_omap":1,"kb_used_meta":616702,"kb_avail":93751628,"statfs":{"total":96636764160,"available":96001667072,"internally_reserved":0,"allocated":3584000,"data_stored":18307325,"data_compressed":2174151,"data_compressed_allocated":2514944,"data_compressed_original":17453056,"omap_allocated":1593,"internal_metadata":631503303},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:55:40 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":3.7040000000000002,"15min":2.363},"min":{"1min":0.28299999999999997,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":3.8319999999999999,"5min":84.305000000000007,"15min":84.305000000000007},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.3540000000000001,"5min":3.6739999999999999,"15min":4.4790000000000001},"min":{"1min":0.34200000000000003,"5min":0.252,"15min":0.252},"max":{"1min":4.7800000000000002,"5min":86.994,"15min":553.95500000000004},"last":0.68899999999999995}]},{"osd":1,"last update":"Thu Apr 18 04:55:40 2024","interfaces":[{"interface":"back","average":{"1min":8.5050000000000008,"5min":5.9530000000000003,"15min":5.1929999999999996},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":178.01499999999999,"5min":178.01499999999999,"15min":553.36900000000003},"last":0.48299999999999998},{"interface":"front","average":{"1min":8.9000000000000004,"5min":5.9660000000000002,"15min":4.8419999999999996},"min":{"1min":0.31900000000000001,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":177.964,"5min":177.964,"15min":501.11000000000001},"last":0.76800000000000002}]},{"osd":2,"last update":"Thu Apr 18 04:55:40 2024","interfaces":[{"interface":"back","average":{"1min":1.778,"5min":3.98,"15min":3.1920000000000002},"min":{"1min":0.442,"5min":0.35699999999999998,"15min":0.29799999999999999},"max":{"1min":5.2839999999999998,"5min":123.048,"15min":262.99700000000001},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.0049999999999999,"5min":4.0529999999999999,"15min":3.3119999999999998},"min":{"1min":0.39900000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":3.7519999999999998,"5min":125.04900000000001,"15min":259.24099999999999},"last":0.57899999999999996}]},{"osd":3,"last update":"Thu Apr 18 04:55:40 2024","interfaces":[{"interface":"back","average":{"1min":9.7750000000000004,"5min":5.9390000000000001,"15min":3.2040000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.34200000000000003},"max":{"1min":176.523,"5min":176.523,"15min":176.523},"last":0.79900000000000004},{"interface":"front","average":{"1min":9.2520000000000007,"5min":5.8250000000000002,"15min":3.4279999999999999},"min":{"1min":0.379,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":176.41999999999999,"5min":176.41999999999999,"15min":176.41999999999999},"last":0.84599999999999997}]},{"osd":4,"last update":"Thu Apr 18 04:55:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.754,"15min":0.81499999999999995},"min":{"1min":0.26300000000000001,"5min":0.246,"15min":0.246},"max":{"1min":1.8959999999999999,"5min":4.6440000000000001,"15min":4.6440000000000001},"last":0.875},{"interface":"front","average":{"1min":0.73399999999999999,"5min":1.214,"15min":1.038},"min":{"1min":0.30099999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.9219999999999999,"5min":12.888999999999999,"15min":12.888999999999999},"last":0.90000000000000002}]},{"osd":6,"last update":"Thu Apr 18 04:55:40 2024","interfaces":[{"interface":"back","average":{"1min":3.181,"5min":1.222,"15min":1.018},"min":{"1min":0.317,"5min":0.28000000000000003,"15min":0.252},"max":{"1min":58.222000000000001,"5min":58.222000000000001,"15min":58.222000000000001},"last":0.93899999999999995},{"interface":"front","average":{"1min":3.3500000000000001,"5min":1.522,"15min":1.1339999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":58.314999999999998,"5min":58.314999999999998,"15min":58.314999999999998},"last":0.628}]},{"osd":7,"last update":"Thu Apr 18 04:55:40 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.90700000000000003,"15min":0.98699999999999999},"min":{"1min":0.27000000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.3200000000000001,"5min":12.74,"15min":12.74},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.86599999999999999,"5min":1.0800000000000001,"15min":1.0269999999999999},"min":{"1min":0.33900000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":4.101,"5min":27.658000000000001,"15min":27.658000000000001},"last":1.1040000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542287,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":754032,"kb_used_data":6504,"kb_used_omap":1,"kb_used_meta":747518,"kb_avail":93617808,"statfs":{"total":96636764160,"available":95864635392,"internally_reserved":0,"allocated":6660096,"data_stored":29514328,"data_compressed":3215159,"data_compressed_allocated":3665920,"data_compressed_original":26726400,"omap_allocated":1594,"internal_metadata":765458886},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:55:39 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":5.4530000000000003,"15min":2.819},"min":{"1min":0.27400000000000002,"5min":0.25700000000000001,"15min":0.254},"max":{"1min":1.9299999999999999,"5min":148.048,"15min":148.048},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.206,"5min":5.1120000000000001,"15min":2.8969999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":5.8499999999999996,"5min":144.72999999999999,"15min":144.72999999999999},"last":0.82099999999999995}]},{"osd":1,"last update":"Thu Apr 18 04:55:39 2024","interfaces":[{"interface":"back","average":{"1min":1.9830000000000001,"5min":6.9020000000000001,"15min":4.1210000000000004},"min":{"1min":0.38300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":11.967000000000001,"5min":158.56,"15min":158.56},"last":0.61299999999999999},{"interface":"front","average":{"1min":1.792,"5min":6.9349999999999996,"15min":3.5129999999999999},"min":{"1min":0.32300000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":12.494,"5min":144.60400000000001,"15min":144.60400000000001},"last":1.2170000000000001}]},{"osd":2,"last update":"Thu Apr 18 04:55:39 2024","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":3.5209999999999999,"15min":2.2349999999999999},"min":{"1min":0.36699999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":9.7059999999999995,"5min":109.28,"15min":109.28},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.905,"5min":3.7200000000000002,"15min":2.2799999999999998},"min":{"1min":0.38400000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":10.670999999999999,"5min":109.242,"15min":109.242},"last":0.90800000000000003}]},{"osd":3,"last update":"Thu Apr 18 04:55:39 2024","interfaces":[{"interface":"back","average":{"1min":2.431,"5min":6.8310000000000004,"15min":3.5529999999999999},"min":{"1min":0.42699999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":13.782999999999999,"5min":147.625,"15min":147.625},"last":1.522},{"interface":"front","average":{"1min":2.4079999999999999,"5min":5.9390000000000001,"15min":3.456},"min":{"1min":0.48899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":7.6790000000000003,"5min":147.01599999999999,"15min":147.01599999999999},"last":0.98299999999999998}]},{"osd":5,"last update":"Thu Apr 18 04:55:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":0.94399999999999995,"15min":1.0309999999999999},"min":{"1min":0.28699999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":5.4729999999999999,"5min":11.151999999999999,"15min":19.143999999999998},"last":1.5980000000000001},{"interface":"front","average":{"1min":1.046,"5min":0.89600000000000002,"15min":1.03},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":3.6659999999999999,"5min":8.5199999999999996,"15min":27.402999999999999},"last":1.171}]},{"osd":6,"last update":"Thu Apr 18 04:55:39 2024","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.0329999999999999,"15min":1.0880000000000001},"min":{"1min":0.30499999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":7.5190000000000001,"5min":8.8889999999999993,"15min":13.891999999999999},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.6659999999999999,"5min":1.1899999999999999,"15min":1.1699999999999999},"min":{"1min":0.317,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":7.7409999999999997,"5min":17.954999999999998,"15min":17.954999999999998},"last":1.0580000000000001}]},{"osd":7,"last update":"Thu Apr 18 04:55:39 2024","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":1.028,"15min":1.1799999999999999},"min":{"1min":0.308,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":4.508,"5min":11.244999999999999,"15min":27.643000000000001},"last":1.6719999999999999},{"interface":"front","average":{"1min":1.008,"5min":1.095,"15min":1.105},"min":{"1min":0.39900000000000002,"5min":0.33500000000000002,"15min":0.32100000000000001},"max":{"1min":4.5869999999999997,"5min":18.800999999999998,"15min":18.800999999999998},"last":1.7509999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574989,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":609088,"kb_used_data":3448,"kb_used_omap":1,"kb_used_meta":605630,"kb_avail":93762752,"statfs":{"total":96636764160,"available":96013058048,"internally_reserved":0,"allocated":3530752,"data_stored":21714911,"data_compressed":2517298,"data_compressed_allocated":2887680,"data_compressed_original":21282816,"omap_allocated":1594,"internal_metadata":620165574},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 04:55:45 2024","interfaces":[{"interface":"back","average":{"1min":2.1400000000000001,"5min":5.3319999999999999,"15min":2.9510000000000001},"min":{"1min":0.308,"5min":0.221,"15min":0.221},"max":{"1min":7.1699999999999999,"5min":55.061,"15min":55.061},"last":0.30299999999999999},{"interface":"front","average":{"1min":2.5640000000000001,"5min":6.3259999999999996,"15min":3.3039999999999998},"min":{"1min":0.36099999999999999,"5min":0.309,"15min":0.28899999999999998},"max":{"1min":8.0190000000000001,"5min":115.45099999999999,"15min":115.45099999999999},"last":0.38300000000000001}]},{"osd":2,"last update":"Thu Apr 18 04:55:45 2024","interfaces":[{"interface":"back","average":{"1min":2.29,"5min":2.9060000000000001,"15min":1.901},"min":{"1min":0.317,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":9.2639999999999993,"5min":22.475000000000001,"15min":28.802},"last":0.43099999999999999},{"interface":"front","average":{"1min":2.2599999999999998,"5min":4.1230000000000002,"15min":2.556},"min":{"1min":0.40200000000000002,"5min":0.34000000000000002,"15min":0.29399999999999998},"max":{"1min":7.3879999999999999,"5min":115.229,"15min":115.229},"last":0.44500000000000001}]},{"osd":3,"last update":"Thu Apr 18 04:55:45 2024","interfaces":[{"interface":"back","average":{"1min":3.0939999999999999,"5min":4.016,"15min":2.6269999999999998},"min":{"1min":0.32300000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":14.502000000000001,"5min":34.180999999999997,"15min":47.496000000000002},"last":0.47899999999999998},{"interface":"front","average":{"1min":2.9900000000000002,"5min":4.6349999999999998,"15min":2.6930000000000001},"min":{"1min":0.42899999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":13.638,"5min":115.729,"15min":115.729},"last":0.47199999999999998}]},{"osd":4,"last update":"Thu Apr 18 04:55:29 2024","interfaces":[{"interface":"back","average":{"1min":2.0859999999999999,"5min":2.7599999999999998,"15min":1.855},"min":{"1min":0.41499999999999998,"5min":0.372,"15min":0.33000000000000002},"max":{"1min":16.451000000000001,"5min":49.738999999999997,"15min":49.738999999999997},"last":0.79600000000000004},{"interface":"front","average":{"1min":2.4929999999999999,"5min":3.8029999999999999,"15min":2.3519999999999999},"min":{"1min":0.47799999999999998,"5min":0.47499999999999998,"15min":0.38300000000000001},"max":{"1min":16.382999999999999,"5min":50.996000000000002,"15min":50.996000000000002},"last":0.82299999999999995}]},{"osd":5,"last update":"Thu Apr 18 04:55:29 2024","interfaces":[{"interface":"back","average":{"1min":1.843,"5min":2.9550000000000001,"15min":1.8720000000000001},"min":{"1min":0.504,"5min":0.437,"15min":0.38100000000000001},"max":{"1min":9.7469999999999999,"5min":34.402999999999999,"15min":34.402999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.855,"5min":2.4239999999999999,"15min":1.911},"min":{"1min":0.56799999999999995,"5min":0.46000000000000002,"15min":0.42099999999999999},"max":{"1min":9.2050000000000001,"5min":16.317,"15min":33.392000000000003},"last":0.57599999999999996}]},{"osd":6,"last update":"Thu Apr 18 04:55:29 2024","interfaces":[{"interface":"back","average":{"1min":1.825,"5min":4.1779999999999999,"15min":2.4169999999999998},"min":{"1min":0.47399999999999998,"5min":0.42199999999999999,"15min":0.40600000000000003},"max":{"1min":9.1549999999999994,"5min":115.277,"15min":115.277},"last":0.66100000000000003},{"interface":"front","average":{"1min":2.032,"5min":3.399,"15min":2.044},"min":{"1min":0.55500000000000005,"5min":0.41599999999999998,"15min":0.41399999999999998},"max":{"1min":10.212999999999999,"5min":48.652999999999999,"15min":48.652999999999999},"last":0.76600000000000001}]},{"osd":7,"last update":"Thu Apr 18 04:55:29 2024","interfaces":[{"interface":"back","average":{"1min":1.976,"5min":3.2639999999999998,"15min":2.2010000000000001},"min":{"1min":0.496,"5min":0.48899999999999999,"15min":0.437},"max":{"1min":7.4589999999999996,"5min":54.829000000000001,"15min":54.829000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":2.331,"5min":4.6799999999999997,"15min":2.6859999999999999},"min":{"1min":0.52200000000000002,"5min":0.49399999999999999,"15min":0.48699999999999999},"max":{"1min":10.170999999999999,"5min":115.31399999999999,"15min":115.31399999999999},"last":0.71799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33312,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33312,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3121152,"data_stored":20972180,"data_compressed":2483986,"data_compressed_allocated":2842624,"data_compressed_original":20709376,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3178496,"data_stored":20972464,"data_compressed":2531508,"data_compressed_allocated":2936832,"data_compressed_original":20754432,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1396736,"data_stored":4285475,"data_compressed":439103,"data_compressed_allocated":598016,"data_compressed_original":3510272,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6742016,"data_stored":16869536,"data_compressed":1734435,"data_compressed_allocated":2166784,"data_compressed_original":12316672,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6316032,"data_stored":29361965,"data_compressed":3215159,"data_compressed_allocated":3665920,"data_compressed_original":26726400,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":3239936,"data_stored":18154962,"data_compressed":2174151,"data_compressed_allocated":2514944,"data_compressed_original":17453056,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3473408,"data_stored":16779689,"data_compressed":2087260,"data_compressed_allocated":2478080,"data_compressed_original":15798272,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10387456,"data_stored":34932699,"data_compressed":3585780,"data_compressed_allocated":4227072,"data_compressed_original":28794880,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T04:55:59.044 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.044 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.044 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-18T04:44:28.842896+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=28, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.044 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.044 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.044 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.045 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.045 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-18T04:44:28.842896+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=28, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.045 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.045 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.045 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.045 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-18T04:44:28.842896+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=28, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.045 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.045 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.046 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.046 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.046 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.046 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.047 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.047 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.047 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.047 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.047 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.047 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.047 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.048 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.048 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.048 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.048 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.048 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-04-18T04:44:28.842896+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=28, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.048 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.048 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.048 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.048 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.049 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.049 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.049 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.050 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.050 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.050 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.050 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.050 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.051 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.051 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.051 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-18T04:44:28.842896+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=28, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.051 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.051 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.051 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.051 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.052 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.052 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.052 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.052 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.052 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.052 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.052 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.052 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.053 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.053 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.053 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.053 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.053 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.053 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.054 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.054 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.054 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.054 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.054 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.054 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.055 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.055 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.055 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.055 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.055 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.055 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.055 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.055 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.056 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:55:59.056 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-18T04:56:19.057 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T04:56:19.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.196+0000 7fe014200640 1 Processor -- start 2024-04-18T04:56:19.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.196+0000 7fe014200640 1 -- start start 2024-04-18T04:56:19.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.200+0000 7fe014200640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe00c1515e0 0x7fe00c1573c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:19.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.200+0000 7fe014200640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe00c0ca690 0x7fe00c0ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:19.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.200+0000 7fe014200640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe00c070410 con 0x7fe00c0ca280 2024-04-18T04:56:19.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.200+0000 7fe014200640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe00c0c3120 con 0x7fe00c1515e0 2024-04-18T04:56:19.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.200+0000 7fe014200640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe00c157a50 con 0x7fe00c0ca690 2024-04-18T04:56:19.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.200+0000 7fe011800640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe00c1515e0 0x7fe00c1573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:19.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.200+0000 7fe011800640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe00c1515e0 0x7fe00c1573c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34456/0 (socket says 172.21.15.120:34456) 2024-04-18T04:56:19.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.200+0000 7fe011800640 1 -- 172.21.15.120:0/3350617961 learned_addr learned my addr 172.21.15.120:0/3350617961 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:56:19.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.200+0000 7fe012200640 1 --2- 172.21.15.120:0/3350617961 >> v2:172.21.15.132:3300/0 conn(0x7fe00c0ca690 0x7fe00c0ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:19.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.200+0000 7fe011800640 1 -- 172.21.15.120:0/3350617961 >> v2:172.21.15.132:3300/0 conn(0x7fe00c0ca690 msgr2=0x7fe00c0ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:56:19.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.200+0000 7fe011800640 1 --2- 172.21.15.120:0/3350617961 >> v2:172.21.15.132:3300/0 conn(0x7fe00c0ca690 0x7fe00c0ccee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:19.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.200+0000 7fe011800640 1 -- 172.21.15.120:0/3350617961 >> v1:172.21.15.120:6789/0 conn(0x7fe00c0ca280 legacy=0x7fe00c06fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:19.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.200+0000 7fe011800640 1 -- 172.21.15.120:0/3350617961 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe00c157d10 con 0x7fe00c1515e0 2024-04-18T04:56:19.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.204+0000 7fe011800640 1 --2- 172.21.15.120:0/3350617961 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe00c1515e0 0x7fe00c1573c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe000009870 tx=0x7fe00001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab58cda3f91014f server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:19.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.204+0000 7fe00be00640 1 -- 172.21.15.120:0/3350617961 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0000a8a10 con 0x7fe00c1515e0 2024-04-18T04:56:19.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.204+0000 7fe00be00640 1 -- 172.21.15.120:0/3350617961 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0000a8b70 con 0x7fe00c1515e0 2024-04-18T04:56:19.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.204+0000 7fe00be00640 1 -- 172.21.15.120:0/3350617961 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0000b0440 con 0x7fe00c1515e0 2024-04-18T04:56:19.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.204+0000 7fe014200640 1 -- 172.21.15.120:0/3350617961 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe00c1515e0 msgr2=0x7fe00c1573c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:19.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.204+0000 7fe014200640 1 --2- 172.21.15.120:0/3350617961 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe00c1515e0 0x7fe00c1573c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe000009870 tx=0x7fe00001ed10 comp rx=0 tx=0).stop 2024-04-18T04:56:19.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.204+0000 7fe014200640 1 -- 172.21.15.120:0/3350617961 shutdown_connections 2024-04-18T04:56:19.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.204+0000 7fe014200640 1 --2- 172.21.15.120:0/3350617961 >> v2:172.21.15.132:3300/0 conn(0x7fe00c0ca690 0x7fe00c0ccee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:19.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.204+0000 7fe014200640 1 --2- 172.21.15.120:0/3350617961 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe00c1515e0 0x7fe00c1573c0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:19.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.204+0000 7fe014200640 1 -- 172.21.15.120:0/3350617961 >> 172.21.15.120:0/3350617961 conn(0x7fe00c06e0f0 msgr2=0x7fe00c071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:19.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.204+0000 7fe014200640 1 -- 172.21.15.120:0/3350617961 shutdown_connections 2024-04-18T04:56:19.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.204+0000 7fe014200640 1 -- 172.21.15.120:0/3350617961 wait complete. 2024-04-18T04:56:19.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.204+0000 7fe014200640 1 Processor -- start 2024-04-18T04:56:19.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.204+0000 7fe014200640 1 -- start start 2024-04-18T04:56:19.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.208+0000 7fe014200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe00c0ca280 0x7fe00c0cb950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:19.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.208+0000 7fe014200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe00c0ca690 0x7fe00c151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:19.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.208+0000 7fe014200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe00c1515e0 0x7fe00c14c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:19.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.208+0000 7fe014200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c1edaf0 con 0x7fe00c1515e0 2024-04-18T04:56:19.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.208+0000 7fe014200640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c1ecf70 con 0x7fe00c0ca690 2024-04-18T04:56:19.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.208+0000 7fe014200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c1ed250 con 0x7fe00c0ca280 2024-04-18T04:56:19.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.208+0000 7fe012200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe00c1515e0 0x7fe00c14c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:19.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.208+0000 7fe012200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe00c1515e0 0x7fe00c14c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34472/0 (socket says 172.21.15.120:34472) 2024-04-18T04:56:19.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.208+0000 7fe012200640 1 -- 172.21.15.120:0/1422088867 learned_addr learned my addr 172.21.15.120:0/1422088867 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:56:19.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.208+0000 7fe011800640 1 --2- 172.21.15.120:0/1422088867 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe00c0ca280 0x7fe00c0cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:19.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.208+0000 7fe010e00640 1 --2- 172.21.15.120:0/1422088867 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe00c0ca690 0x7fe00c151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:19.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.208+0000 7fe012200640 1 -- 172.21.15.120:0/1422088867 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe00c0ca280 msgr2=0x7fe00c0cb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:19.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.208+0000 7fe012200640 1 --2- 172.21.15.120:0/1422088867 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe00c0ca280 0x7fe00c0cb950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:19.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.208+0000 7fe012200640 1 -- 172.21.15.120:0/1422088867 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe00c0ca690 msgr2=0x7fe00c151bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:19.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.208+0000 7fe012200640 1 --2- 172.21.15.120:0/1422088867 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe00c0ca690 0x7fe00c151bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:19.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.208+0000 7fe012200640 1 -- 172.21.15.120:0/1422088867 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0000094d0 con 0x7fe00c1515e0 2024-04-18T04:56:19.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.208+0000 7fe012200640 1 --2- 172.21.15.120:0/1422088867 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe00c1515e0 0x7fe00c14c880 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe004007e30 tx=0x7fe00400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:19.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.208+0000 7fe009600640 1 -- 172.21.15.120:0/1422088867 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe004014620 con 0x7fe00c1515e0 2024-04-18T04:56:19.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.208+0000 7fe009600640 1 -- 172.21.15.120:0/1422088867 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00400ee90 con 0x7fe00c1515e0 2024-04-18T04:56:19.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.208+0000 7fe014200640 1 -- 172.21.15.120:0/1422088867 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe00c1ed530 con 0x7fe00c1515e0 2024-04-18T04:56:19.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.208+0000 7fe009600640 1 -- 172.21.15.120:0/1422088867 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0040149c0 con 0x7fe00c1515e0 2024-04-18T04:56:19.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.208+0000 7fe014200640 1 -- 172.21.15.120:0/1422088867 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe00c0c5a10 con 0x7fe00c1515e0 2024-04-18T04:56:19.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.208+0000 7fe014200640 1 -- 172.21.15.120:0/1422088867 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe00c0c5870 con 0x7fe00c1515e0 2024-04-18T04:56:19.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.208+0000 7fe009600640 1 -- 172.21.15.120:0/1422088867 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe004014b20 con 0x7fe00c1515e0 2024-04-18T04:56:19.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.212+0000 7fe009600640 1 --2- 172.21.15.120:0/1422088867 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fdfec066690 0x7fdfec068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:19.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.212+0000 7fe009600640 1 -- 172.21.15.120:0/1422088867 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7fe004084f80 con 0x7fe00c1515e0 2024-04-18T04:56:19.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.212+0000 7fe011800640 1 --2- 172.21.15.120:0/1422088867 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fdfec066690 0x7fdfec068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:19.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.212+0000 7fe011800640 1 --2- 172.21.15.120:0/1422088867 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fdfec066690 0x7fdfec068b50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe0000b2000 tx=0x7fe000009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:19.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.216+0000 7fe009600640 1 -- 172.21.15.120:0/1422088867 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fe00c0c5870 con 0x7fe00c1515e0 2024-04-18T04:56:19.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.372+0000 7fe014200640 1 -- 172.21.15.120:0/1422088867 --> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe00c06f7e0 con 0x7fdfec066690 2024-04-18T04:56:19.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.400+0000 7fe009600640 1 -- 172.21.15.120:0/1422088867 <== mgr.4113 v2:172.21.15.132:6832/27788 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+372648 (secure 0 0 0) 0x7fe0000b04c0 con 0x7fdfec066690 2024-04-18T04:56:19.402 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:56:19.405 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-04-18T04:56:19.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.404+0000 7fe014200640 1 -- 172.21.15.120:0/1422088867 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fdfec066690 msgr2=0x7fdfec068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:19.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.404+0000 7fe014200640 1 --2- 172.21.15.120:0/1422088867 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fdfec066690 0x7fdfec068b50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe0000b2000 tx=0x7fe000009040 comp rx=0 tx=0).stop 2024-04-18T04:56:19.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.404+0000 7fe014200640 1 -- 172.21.15.120:0/1422088867 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe00c1515e0 msgr2=0x7fe00c14c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:19.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.404+0000 7fe014200640 1 --2- 172.21.15.120:0/1422088867 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe00c1515e0 0x7fe00c14c880 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe004007e30 tx=0x7fe00400e4b0 comp rx=0 tx=0).stop 2024-04-18T04:56:19.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.404+0000 7fe014200640 1 -- 172.21.15.120:0/1422088867 shutdown_connections 2024-04-18T04:56:19.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.404+0000 7fe014200640 1 --2- 172.21.15.120:0/1422088867 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fdfec066690 0x7fdfec068b50 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:19.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.404+0000 7fe014200640 1 --2- 172.21.15.120:0/1422088867 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe00c1515e0 0x7fe00c14c880 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:19.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.404+0000 7fe014200640 1 --2- 172.21.15.120:0/1422088867 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe00c0ca690 0x7fe00c151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:19.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.404+0000 7fe014200640 1 --2- 172.21.15.120:0/1422088867 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe00c0ca280 0x7fe00c0cb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:19.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.404+0000 7fe014200640 1 -- 172.21.15.120:0/1422088867 >> 172.21.15.120:0/1422088867 conn(0x7fe00c06e0f0 msgr2=0x7fe00c0c7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:19.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.404+0000 7fe014200640 1 -- 172.21.15.120:0/1422088867 shutdown_connections 2024-04-18T04:56:19.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:19.404+0000 7fe014200640 1 -- 172.21.15.120:0/1422088867 wait complete. 2024-04-18T04:56:19.424 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":387,"stamp":"2024-04-18T04:56:19.073115+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":81754853,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":667,"num_read_kb":75003,"num_write":2198758,"num_write_kb":31245689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27954,"num_omap_keys":54,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154351,"ondisk_log_size":154351,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":6031336,"kb_used_data":39784,"kb_used_omap":12,"kb_used_meta":5991475,"kb_avail":748943384,"statfs":{"total":773094113280,"available":766918025216,"internally_reserved":0,"allocated":40738816,"data_stored":164728610,"data_compressed":18318006,"data_compressed_allocated":21520384,"data_compressed_original":147210240,"omap_allocated":12743,"internal_metadata":6135270969},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005402"},"pg_stats":[{"pgid":"2.1f","version":"32'26","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:34.453464+0000","last_change":"2024-04-18T04:55:34.453464+0000","last_active":"2024-04-18T04:55:34.453464+0000","last_peered":"2024-04-18T04:55:34.453464+0000","last_clean":"2024-04-18T04:55:34.453464+0000","last_became_active":"2024-04-18T04:44:29.890853+0000","last_became_peered":"2024-04-18T04:44:29.890853+0000","last_unstale":"2024-04-18T04:55:34.453464+0000","last_undegraded":"2024-04-18T04:55:34.453464+0000","last_fullsized":"2024-04-18T04:55:34.453464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2024-04-18T04:55:34.453305+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2024-04-18T04:55:34.453305+0000","last_clean_scrub_stamp":"2024-04-18T04:55:34.453305+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:34:55.135020+0000","scrub_duration":0.023886489,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":4124,"num_write":18,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.737791+0000","last_change":"2024-04-18T04:55:39.632341+0000","last_active":"2024-04-18T04:55:39.737791+0000","last_peered":"2024-04-18T04:55:39.737791+0000","last_clean":"2024-04-18T04:55:39.737791+0000","last_became_active":"2024-04-18T04:44:30.296064+0000","last_became_peered":"2024-04-18T04:44:30.296064+0000","last_unstale":"2024-04-18T04:55:39.737791+0000","last_undegraded":"2024-04-18T04:55:39.737791+0000","last_fullsized":"2024-04-18T04:55:39.737791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-18T04:55:39.631099+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-18T04:55:39.631099+0000","last_clean_scrub_stamp":"2024-04-18T04:55:39.631099+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:57:20.977227+0000","scrub_duration":0.0073039209999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'3974","reported_seq":3999,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.911733+0000","last_change":"2024-04-18T04:44:34.306605+0000","last_active":"2024-04-18T04:55:39.911733+0000","last_peered":"2024-04-18T04:55:39.911733+0000","last_clean":"2024-04-18T04:55:39.911733+0000","last_became_active":"2024-04-18T04:44:34.306224+0000","last_became_peered":"2024-04-18T04:44:34.306224+0000","last_unstale":"2024-04-18T04:55:39.911733+0000","last_undegraded":"2024-04-18T04:55:39.911733+0000","last_fullsized":"2024-04-18T04:55:39.911733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":3974,"log_dups_size":0,"ondisk_log_size":3974,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":58092,"num_write_kb":822950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"32'27","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:42.547016+0000","last_change":"2024-04-18T04:55:42.547117+0000","last_active":"2024-04-18T04:55:42.547016+0000","last_peered":"2024-04-18T04:55:42.547016+0000","last_clean":"2024-04-18T04:55:42.547016+0000","last_became_active":"2024-04-18T04:44:29.881258+0000","last_became_peered":"2024-04-18T04:44:29.881258+0000","last_unstale":"2024-04-18T04:55:42.547016+0000","last_undegraded":"2024-04-18T04:55:42.547016+0000","last_fullsized":"2024-04-18T04:55:42.547016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'27","last_scrub_stamp":"2024-04-18T04:55:42.546992+0000","last_deep_scrub":"32'27","last_deep_scrub_stamp":"2024-04-18T04:55:42.546992+0000","last_clean_scrub_stamp":"2024-04-18T04:55:42.546992+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:13:30.341368+0000","scrub_duration":0.014561063000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":19,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"32'10","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:01.734976+0000","last_change":"2024-04-18T04:56:01.735094+0000","last_active":"2024-04-18T04:56:01.734976+0000","last_peered":"2024-04-18T04:56:01.734976+0000","last_clean":"2024-04-18T04:56:01.734976+0000","last_became_active":"2024-04-18T04:44:30.313987+0000","last_became_peered":"2024-04-18T04:44:30.313987+0000","last_unstale":"2024-04-18T04:56:01.734976+0000","last_undegraded":"2024-04-18T04:56:01.734976+0000","last_fullsized":"2024-04-18T04:56:01.734976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-18T04:56:01.734955+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-18T04:56:01.734955+0000","last_clean_scrub_stamp":"2024-04-18T04:56:01.734955+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:15:08.643172+0000","scrub_duration":0.091151898999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"32'5326","reported_seq":5366,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:53.782856+0000","last_change":"2024-04-18T04:55:53.783108+0000","last_active":"2024-04-18T04:55:53.782856+0000","last_peered":"2024-04-18T04:55:53.782856+0000","last_clean":"2024-04-18T04:55:53.782856+0000","last_became_active":"2024-04-18T04:44:34.338485+0000","last_became_peered":"2024-04-18T04:44:34.338485+0000","last_unstale":"2024-04-18T04:55:53.782856+0000","last_undegraded":"2024-04-18T04:55:53.782856+0000","last_fullsized":"2024-04-18T04:55:53.782856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5326","last_scrub_stamp":"2024-04-18T04:55:53.782806+0000","last_deep_scrub":"32'5326","last_deep_scrub_stamp":"2024-04-18T04:55:53.782806+0000","last_clean_scrub_stamp":"2024-04-18T04:55:53.782806+0000","objects_scrubbed":0,"log_size":5326,"log_dups_size":0,"ondisk_log_size":5326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:01:07.430052+0000","scrub_duration":0.106252715,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":78012,"num_write_kb":1107856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"32'81","reported_seq":125,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:58.819578+0000","last_change":"2024-04-18T04:55:58.819803+0000","last_active":"2024-04-18T04:55:58.819578+0000","last_peered":"2024-04-18T04:55:58.819578+0000","last_clean":"2024-04-18T04:55:58.819578+0000","last_became_active":"2024-04-18T04:44:29.896520+0000","last_became_peered":"2024-04-18T04:44:29.896520+0000","last_unstale":"2024-04-18T04:55:58.819578+0000","last_undegraded":"2024-04-18T04:55:58.819578+0000","last_fullsized":"2024-04-18T04:55:58.819578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'81","last_scrub_stamp":"2024-04-18T04:55:58.819518+0000","last_deep_scrub":"32'81","last_deep_scrub_stamp":"2024-04-18T04:55:58.819518+0000","last_clean_scrub_stamp":"2024-04-18T04:55:58.819518+0000","objects_scrubbed":4,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:40:11.519285+0000","scrub_duration":0.041060156,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":14,"num_read_kb":8212,"num_write":66,"num_write_kb":8229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"32'11","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:57.587807+0000","last_change":"2024-04-18T04:55:57.587960+0000","last_active":"2024-04-18T04:55:57.587807+0000","last_peered":"2024-04-18T04:55:57.587807+0000","last_clean":"2024-04-18T04:55:57.587807+0000","last_became_active":"2024-04-18T04:44:30.299939+0000","last_became_peered":"2024-04-18T04:44:30.299939+0000","last_unstale":"2024-04-18T04:55:57.587807+0000","last_undegraded":"2024-04-18T04:55:57.587807+0000","last_fullsized":"2024-04-18T04:55:57.587807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-04-18T04:55:57.587765+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-04-18T04:55:57.587765+0000","last_clean_scrub_stamp":"2024-04-18T04:55:57.587765+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:25:32.097791+0000","scrub_duration":0.002796949,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"32'4916","reported_seq":4953,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:55.761722+0000","last_change":"2024-04-18T04:55:55.761957+0000","last_active":"2024-04-18T04:55:55.761722+0000","last_peered":"2024-04-18T04:55:55.761722+0000","last_clean":"2024-04-18T04:55:55.761722+0000","last_became_active":"2024-04-18T04:44:34.337938+0000","last_became_peered":"2024-04-18T04:44:34.337938+0000","last_unstale":"2024-04-18T04:55:55.761722+0000","last_undegraded":"2024-04-18T04:55:55.761722+0000","last_fullsized":"2024-04-18T04:55:55.761722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4916","last_scrub_stamp":"2024-04-18T04:55:55.761684+0000","last_deep_scrub":"32'4916","last_deep_scrub_stamp":"2024-04-18T04:55:55.761684+0000","last_clean_scrub_stamp":"2024-04-18T04:55:55.761684+0000","objects_scrubbed":0,"log_size":4916,"log_dups_size":0,"ondisk_log_size":4916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:13:52.532868+0000","scrub_duration":0.090021601000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":72239,"num_write_kb":1012843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"32'90","reported_seq":130,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:47.712240+0000","last_change":"2024-04-18T04:55:47.712862+0000","last_active":"2024-04-18T04:55:47.712240+0000","last_peered":"2024-04-18T04:55:47.712240+0000","last_clean":"2024-04-18T04:55:47.712240+0000","last_became_active":"2024-04-18T04:44:29.902611+0000","last_became_peered":"2024-04-18T04:44:29.902611+0000","last_unstale":"2024-04-18T04:55:47.712240+0000","last_undegraded":"2024-04-18T04:55:47.712240+0000","last_fullsized":"2024-04-18T04:55:47.712240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'90","last_scrub_stamp":"2024-04-18T04:55:47.712175+0000","last_deep_scrub":"32'90","last_deep_scrub_stamp":"2024-04-18T04:55:47.712175+0000","last_clean_scrub_stamp":"2024-04-18T04:55:47.712175+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:32:28.237397+0000","scrub_duration":0.017371477999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":87,"num_write_kb":1391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"32'20","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:09.647452+0000","last_change":"2024-04-18T04:56:09.647664+0000","last_active":"2024-04-18T04:56:09.647452+0000","last_peered":"2024-04-18T04:56:09.647452+0000","last_clean":"2024-04-18T04:56:09.647452+0000","last_became_active":"2024-04-18T04:44:30.300303+0000","last_became_peered":"2024-04-18T04:44:30.300303+0000","last_unstale":"2024-04-18T04:56:09.647452+0000","last_undegraded":"2024-04-18T04:56:09.647452+0000","last_fullsized":"2024-04-18T04:56:09.647452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-04-18T04:56:09.647394+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-04-18T04:56:09.647394+0000","last_clean_scrub_stamp":"2024-04-18T04:56:09.647394+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:57:07.285335+0000","scrub_duration":0.077403323999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'4576","reported_seq":4616,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:57.795465+0000","last_change":"2024-04-18T04:55:57.795780+0000","last_active":"2024-04-18T04:55:57.795465+0000","last_peered":"2024-04-18T04:55:57.795465+0000","last_clean":"2024-04-18T04:55:57.795465+0000","last_became_active":"2024-04-18T04:44:34.326161+0000","last_became_peered":"2024-04-18T04:44:34.326161+0000","last_unstale":"2024-04-18T04:55:57.795465+0000","last_undegraded":"2024-04-18T04:55:57.795465+0000","last_fullsized":"2024-04-18T04:55:57.795465+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4576","last_scrub_stamp":"2024-04-18T04:55:57.795407+0000","last_deep_scrub":"32'4576","last_deep_scrub_stamp":"2024-04-18T04:55:57.795407+0000","last_clean_scrub_stamp":"2024-04-18T04:55:57.795407+0000","objects_scrubbed":0,"log_size":4576,"log_dups_size":0,"ondisk_log_size":4576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:37:29.870374+0000","scrub_duration":0.14544079600000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1,"num_write":67045,"num_write_kb":936790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:51.521933+0000","last_change":"2024-04-18T04:55:51.522165+0000","last_active":"2024-04-18T04:55:51.521933+0000","last_peered":"2024-04-18T04:55:51.521933+0000","last_clean":"2024-04-18T04:55:51.521933+0000","last_became_active":"2024-04-18T04:44:30.295657+0000","last_became_peered":"2024-04-18T04:44:30.295657+0000","last_unstale":"2024-04-18T04:55:51.521933+0000","last_undegraded":"2024-04-18T04:55:51.521933+0000","last_fullsized":"2024-04-18T04:55:51.521933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-18T04:55:51.521874+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-18T04:55:51.521874+0000","last_clean_scrub_stamp":"2024-04-18T04:55:51.521874+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:46:02.690401+0000","scrub_duration":0.00357457,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"32'991","reported_seq":1036,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:52.785772+0000","last_change":"2024-04-18T04:55:52.785966+0000","last_active":"2024-04-18T04:55:52.785772+0000","last_peered":"2024-04-18T04:55:52.785772+0000","last_clean":"2024-04-18T04:55:52.785772+0000","last_became_active":"2024-04-18T04:44:29.899402+0000","last_became_peered":"2024-04-18T04:44:29.899402+0000","last_unstale":"2024-04-18T04:55:52.785772+0000","last_undegraded":"2024-04-18T04:55:52.785772+0000","last_fullsized":"2024-04-18T04:55:52.785772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'991","last_scrub_stamp":"2024-04-18T04:55:52.785717+0000","last_deep_scrub":"32'991","last_deep_scrub_stamp":"2024-04-18T04:55:52.785717+0000","last_clean_scrub_stamp":"2024-04-18T04:55:52.785717+0000","objects_scrubbed":3,"log_size":991,"log_dups_size":0,"ondisk_log_size":991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:11:45.603201+0000","scrub_duration":0.033700826000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":4110,"num_write":977,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"32'4777","reported_seq":4818,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:07.853201+0000","last_change":"2024-04-18T04:56:07.853500+0000","last_active":"2024-04-18T04:56:07.853201+0000","last_peered":"2024-04-18T04:56:07.853201+0000","last_clean":"2024-04-18T04:56:07.853201+0000","last_became_active":"2024-04-18T04:44:34.319868+0000","last_became_peered":"2024-04-18T04:44:34.319868+0000","last_unstale":"2024-04-18T04:56:07.853201+0000","last_undegraded":"2024-04-18T04:56:07.853201+0000","last_fullsized":"2024-04-18T04:56:07.853201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4777","last_scrub_stamp":"2024-04-18T04:56:07.853120+0000","last_deep_scrub":"32'4777","last_deep_scrub_stamp":"2024-04-18T04:56:07.853120+0000","last_clean_scrub_stamp":"2024-04-18T04:56:07.853120+0000","objects_scrubbed":0,"log_size":4777,"log_dups_size":0,"ondisk_log_size":4777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:56:41.273577+0000","scrub_duration":0.12501833700000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":69886,"num_write_kb":985071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:40.615562+0000","last_change":"2024-04-18T04:55:40.615562+0000","last_active":"2024-04-18T04:55:40.615562+0000","last_peered":"2024-04-18T04:55:40.615562+0000","last_clean":"2024-04-18T04:55:40.615562+0000","last_became_active":"2024-04-18T04:44:30.271420+0000","last_became_peered":"2024-04-18T04:44:30.271420+0000","last_unstale":"2024-04-18T04:55:40.615562+0000","last_undegraded":"2024-04-18T04:55:40.615562+0000","last_fullsized":"2024-04-18T04:55:40.615562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-18T04:55:40.615434+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-18T04:55:40.615434+0000","last_clean_scrub_stamp":"2024-04-18T04:55:40.615434+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:53:11.453735+0000","scrub_duration":0.026470450999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"32'10","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:43.441783+0000","last_change":"2024-04-18T04:55:43.441900+0000","last_active":"2024-04-18T04:55:43.441783+0000","last_peered":"2024-04-18T04:55:43.441783+0000","last_clean":"2024-04-18T04:55:43.441783+0000","last_became_active":"2024-04-18T04:44:29.878139+0000","last_became_peered":"2024-04-18T04:44:29.878139+0000","last_unstale":"2024-04-18T04:55:43.441783+0000","last_undegraded":"2024-04-18T04:55:43.441783+0000","last_fullsized":"2024-04-18T04:55:43.441783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-18T04:55:43.441759+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-18T04:55:43.441759+0000","last_clean_scrub_stamp":"2024-04-18T04:55:43.441759+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:07:54.010016+0000","scrub_duration":0.0033934379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"32'4649","reported_seq":4687,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:10.902532+0000","last_change":"2024-04-18T04:56:10.902809+0000","last_active":"2024-04-18T04:56:10.902532+0000","last_peered":"2024-04-18T04:56:10.902532+0000","last_clean":"2024-04-18T04:56:10.902532+0000","last_became_active":"2024-04-18T04:44:34.345267+0000","last_became_peered":"2024-04-18T04:44:34.345267+0000","last_unstale":"2024-04-18T04:56:10.902532+0000","last_undegraded":"2024-04-18T04:56:10.902532+0000","last_fullsized":"2024-04-18T04:56:10.902532+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4649","last_scrub_stamp":"2024-04-18T04:56:10.902481+0000","last_deep_scrub":"32'4649","last_deep_scrub_stamp":"2024-04-18T04:56:10.902481+0000","last_clean_scrub_stamp":"2024-04-18T04:56:10.902481+0000","objects_scrubbed":0,"log_size":4649,"log_dups_size":0,"ondisk_log_size":4649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:37:44.907299+0000","scrub_duration":0.077025255000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":68133,"num_write_kb":992962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"32'11","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:53.573836+0000","last_change":"2024-04-18T04:55:53.573938+0000","last_active":"2024-04-18T04:55:53.573836+0000","last_peered":"2024-04-18T04:55:53.573836+0000","last_clean":"2024-04-18T04:55:53.573836+0000","last_became_active":"2024-04-18T04:44:30.273752+0000","last_became_peered":"2024-04-18T04:44:30.273752+0000","last_unstale":"2024-04-18T04:55:53.573836+0000","last_undegraded":"2024-04-18T04:55:53.573836+0000","last_fullsized":"2024-04-18T04:55:53.573836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-04-18T04:55:53.573817+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-04-18T04:55:53.573817+0000","last_clean_scrub_stamp":"2024-04-18T04:55:53.573817+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:15:50.107902+0000","scrub_duration":0.016381493,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"32'11","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.736159+0000","last_change":"2024-04-18T04:55:39.522596+0000","last_active":"2024-04-18T04:55:39.736159+0000","last_peered":"2024-04-18T04:55:39.736159+0000","last_clean":"2024-04-18T04:55:39.736159+0000","last_became_active":"2024-04-18T04:44:29.889684+0000","last_became_peered":"2024-04-18T04:44:29.889684+0000","last_unstale":"2024-04-18T04:55:39.736159+0000","last_undegraded":"2024-04-18T04:55:39.736159+0000","last_fullsized":"2024-04-18T04:55:39.736159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-18T04:55:39.522412+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-18T04:55:39.522412+0000","last_clean_scrub_stamp":"2024-04-18T04:55:39.522412+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:20:25.296279+0000","scrub_duration":0.014929192000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":9,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"32'4620","reported_seq":4658,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:07.442761+0000","last_change":"2024-04-18T04:56:07.442888+0000","last_active":"2024-04-18T04:56:07.442761+0000","last_peered":"2024-04-18T04:56:07.442761+0000","last_clean":"2024-04-18T04:56:07.442761+0000","last_became_active":"2024-04-18T04:44:34.313161+0000","last_became_peered":"2024-04-18T04:44:34.313161+0000","last_unstale":"2024-04-18T04:56:07.442761+0000","last_undegraded":"2024-04-18T04:56:07.442761+0000","last_fullsized":"2024-04-18T04:56:07.442761+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4620","last_scrub_stamp":"2024-04-18T04:56:07.442742+0000","last_deep_scrub":"32'4620","last_deep_scrub_stamp":"2024-04-18T04:56:07.442742+0000","last_clean_scrub_stamp":"2024-04-18T04:56:07.442742+0000","objects_scrubbed":0,"log_size":4620,"log_dups_size":0,"ondisk_log_size":4620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:10:51.043267+0000","scrub_duration":0.067058095999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":67683,"num_write_kb":962979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:41.633068+0000","last_change":"2024-04-18T04:55:41.633263+0000","last_active":"2024-04-18T04:55:41.633068+0000","last_peered":"2024-04-18T04:55:41.633068+0000","last_clean":"2024-04-18T04:55:41.633068+0000","last_became_active":"2024-04-18T04:44:30.279238+0000","last_became_peered":"2024-04-18T04:44:30.279238+0000","last_unstale":"2024-04-18T04:55:41.633068+0000","last_undegraded":"2024-04-18T04:55:41.633068+0000","last_fullsized":"2024-04-18T04:55:41.633068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-04-18T04:55:41.633017+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-04-18T04:55:41.633017+0000","last_clean_scrub_stamp":"2024-04-18T04:55:41.633017+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:54:01.121009+0000","scrub_duration":0.0030512479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"32'24","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:55.773763+0000","last_change":"2024-04-18T04:55:55.773914+0000","last_active":"2024-04-18T04:55:55.773763+0000","last_peered":"2024-04-18T04:55:55.773763+0000","last_clean":"2024-04-18T04:55:55.773763+0000","last_became_active":"2024-04-18T04:44:29.890272+0000","last_became_peered":"2024-04-18T04:44:29.890272+0000","last_unstale":"2024-04-18T04:55:55.773763+0000","last_undegraded":"2024-04-18T04:55:55.773763+0000","last_fullsized":"2024-04-18T04:55:55.773763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'24","last_scrub_stamp":"2024-04-18T04:55:55.773726+0000","last_deep_scrub":"32'24","last_deep_scrub_stamp":"2024-04-18T04:55:55.773726+0000","last_clean_scrub_stamp":"2024-04-18T04:55:55.773726+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:18:51.342848+0000","scrub_duration":0.017478133,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":4108,"num_write":18,"num_write_kb":4103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"32'4424","reported_seq":4462,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:04.798210+0000","last_change":"2024-04-18T04:56:04.798389+0000","last_active":"2024-04-18T04:56:04.798210+0000","last_peered":"2024-04-18T04:56:04.798210+0000","last_clean":"2024-04-18T04:56:04.798210+0000","last_became_active":"2024-04-18T04:44:34.344007+0000","last_became_peered":"2024-04-18T04:44:34.344007+0000","last_unstale":"2024-04-18T04:56:04.798210+0000","last_undegraded":"2024-04-18T04:56:04.798210+0000","last_fullsized":"2024-04-18T04:56:04.798210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4424","last_scrub_stamp":"2024-04-18T04:56:04.798174+0000","last_deep_scrub":"32'4424","last_deep_scrub_stamp":"2024-04-18T04:56:04.798174+0000","last_clean_scrub_stamp":"2024-04-18T04:56:04.798174+0000","objects_scrubbed":0,"log_size":4424,"log_dups_size":0,"ondisk_log_size":4424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:19:47.215939+0000","scrub_duration":0.095564331000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":64589,"num_write_kb":921811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"32'15","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:57.628634+0000","last_change":"2024-04-18T04:55:57.628751+0000","last_active":"2024-04-18T04:55:57.628634+0000","last_peered":"2024-04-18T04:55:57.628634+0000","last_clean":"2024-04-18T04:55:57.628634+0000","last_became_active":"2024-04-18T04:44:30.277916+0000","last_became_peered":"2024-04-18T04:44:30.277916+0000","last_unstale":"2024-04-18T04:55:57.628634+0000","last_undegraded":"2024-04-18T04:55:57.628634+0000","last_fullsized":"2024-04-18T04:55:57.628634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-04-18T04:55:57.628613+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-04-18T04:55:57.628613+0000","last_clean_scrub_stamp":"2024-04-18T04:55:57.628613+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:00:54.736411+0000","scrub_duration":0.017000623999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"32'11","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:45.408643+0000","last_change":"2024-04-18T04:55:45.408857+0000","last_active":"2024-04-18T04:55:45.408643+0000","last_peered":"2024-04-18T04:55:45.408643+0000","last_clean":"2024-04-18T04:55:45.408643+0000","last_became_active":"2024-04-18T04:44:29.896392+0000","last_became_peered":"2024-04-18T04:44:29.896392+0000","last_unstale":"2024-04-18T04:55:45.408643+0000","last_undegraded":"2024-04-18T04:55:45.408643+0000","last_fullsized":"2024-04-18T04:55:45.408643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-04-18T04:55:45.408586+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-04-18T04:55:45.408586+0000","last_clean_scrub_stamp":"2024-04-18T04:55:45.408586+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:33:28.055043+0000","scrub_duration":0.0062587069999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"32'4470","reported_seq":4507,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:54.858277+0000","last_change":"2024-04-18T04:55:54.858566+0000","last_active":"2024-04-18T04:55:54.858277+0000","last_peered":"2024-04-18T04:55:54.858277+0000","last_clean":"2024-04-18T04:55:54.858277+0000","last_became_active":"2024-04-18T04:44:34.338294+0000","last_became_peered":"2024-04-18T04:44:34.338294+0000","last_unstale":"2024-04-18T04:55:54.858277+0000","last_undegraded":"2024-04-18T04:55:54.858277+0000","last_fullsized":"2024-04-18T04:55:54.858277+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4470","last_scrub_stamp":"2024-04-18T04:55:54.858225+0000","last_deep_scrub":"32'4470","last_deep_scrub_stamp":"2024-04-18T04:55:54.858225+0000","last_clean_scrub_stamp":"2024-04-18T04:55:54.858225+0000","objects_scrubbed":0,"log_size":4470,"log_dups_size":0,"ondisk_log_size":4470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:42:43.493104+0000","scrub_duration":0.166457198,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":65571,"num_write_kb":938881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"32'9","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:11.413824+0000","last_change":"2024-04-18T04:56:11.413911+0000","last_active":"2024-04-18T04:56:11.413824+0000","last_peered":"2024-04-18T04:56:11.413824+0000","last_clean":"2024-04-18T04:56:11.413824+0000","last_became_active":"2024-04-18T04:45:12.045671+0000","last_became_peered":"2024-04-18T04:45:12.045671+0000","last_unstale":"2024-04-18T04:56:11.413824+0000","last_undegraded":"2024-04-18T04:56:11.413824+0000","last_fullsized":"2024-04-18T04:56:11.413824+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-18T04:56:11.413806+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-18T04:56:11.413806+0000","last_clean_scrub_stamp":"2024-04-18T04:56:11.413806+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:48:13.128223+0000","scrub_duration":0.017754388999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"32'100","reported_seq":143,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:36.496341+0000","last_change":"2024-04-18T04:55:36.496341+0000","last_active":"2024-04-18T04:55:36.496341+0000","last_peered":"2024-04-18T04:55:36.496341+0000","last_clean":"2024-04-18T04:55:36.496341+0000","last_became_active":"2024-04-18T04:44:29.894210+0000","last_became_peered":"2024-04-18T04:44:29.894210+0000","last_unstale":"2024-04-18T04:55:36.496341+0000","last_undegraded":"2024-04-18T04:55:36.496341+0000","last_fullsized":"2024-04-18T04:55:36.496341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'99","last_scrub_stamp":"2024-04-18T04:55:36.496160+0000","last_deep_scrub":"32'99","last_deep_scrub_stamp":"2024-04-18T04:55:36.496160+0000","last_clean_scrub_stamp":"2024-04-18T04:55:36.496160+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:33:42.522752+0000","scrub_duration":0.032044003000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":22,"num_write":222,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"32'4848","reported_seq":4878,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.823812+0000","last_change":"2024-04-18T04:44:34.305652+0000","last_active":"2024-04-18T04:55:39.823812+0000","last_peered":"2024-04-18T04:55:39.823812+0000","last_clean":"2024-04-18T04:55:39.823812+0000","last_became_active":"2024-04-18T04:44:34.305180+0000","last_became_peered":"2024-04-18T04:44:34.305180+0000","last_unstale":"2024-04-18T04:55:39.823812+0000","last_undegraded":"2024-04-18T04:55:39.823812+0000","last_fullsized":"2024-04-18T04:55:39.823812+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4848,"log_dups_size":0,"ondisk_log_size":4848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":70785,"num_write_kb":998644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"32'14","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.691162+0000","last_change":"2024-04-18T04:55:33.486145+0000","last_active":"2024-04-18T04:55:39.691162+0000","last_peered":"2024-04-18T04:55:39.691162+0000","last_clean":"2024-04-18T04:55:39.691162+0000","last_became_active":"2024-04-18T04:44:30.266814+0000","last_became_peered":"2024-04-18T04:44:30.266814+0000","last_unstale":"2024-04-18T04:55:39.691162+0000","last_undegraded":"2024-04-18T04:55:39.691162+0000","last_fullsized":"2024-04-18T04:55:39.691162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-18T04:55:33.485923+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-18T04:55:33.485923+0000","last_clean_scrub_stamp":"2024-04-18T04:55:33.485923+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:32:31.671872+0000","scrub_duration":0.031836318000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"32'11","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:49.771399+0000","last_change":"2024-04-18T04:55:49.771588+0000","last_active":"2024-04-18T04:55:49.771399+0000","last_peered":"2024-04-18T04:55:49.771399+0000","last_clean":"2024-04-18T04:55:49.771399+0000","last_became_active":"2024-04-18T04:44:29.897156+0000","last_became_peered":"2024-04-18T04:44:29.897156+0000","last_unstale":"2024-04-18T04:55:49.771399+0000","last_undegraded":"2024-04-18T04:55:49.771399+0000","last_fullsized":"2024-04-18T04:55:49.771399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-04-18T04:55:49.771338+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-04-18T04:55:49.771338+0000","last_clean_scrub_stamp":"2024-04-18T04:55:49.771338+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:37:50.640662+0000","scrub_duration":0.0048339239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":10,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"32'4380","reported_seq":4408,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.888762+0000","last_change":"2024-04-18T04:44:34.324721+0000","last_active":"2024-04-18T04:55:39.888762+0000","last_peered":"2024-04-18T04:55:39.888762+0000","last_clean":"2024-04-18T04:55:39.888762+0000","last_became_active":"2024-04-18T04:44:34.322925+0000","last_became_peered":"2024-04-18T04:44:34.322925+0000","last_unstale":"2024-04-18T04:55:39.888762+0000","last_undegraded":"2024-04-18T04:55:39.888762+0000","last_fullsized":"2024-04-18T04:55:39.888762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4380,"log_dups_size":0,"ondisk_log_size":4380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":64226,"num_write_kb":906867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"32'9","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:02.564694+0000","last_change":"2024-04-18T04:56:02.564900+0000","last_active":"2024-04-18T04:56:02.564694+0000","last_peered":"2024-04-18T04:56:02.564694+0000","last_clean":"2024-04-18T04:56:02.564694+0000","last_became_active":"2024-04-18T04:44:30.280968+0000","last_became_peered":"2024-04-18T04:44:30.280968+0000","last_unstale":"2024-04-18T04:56:02.564694+0000","last_undegraded":"2024-04-18T04:56:02.564694+0000","last_fullsized":"2024-04-18T04:56:02.564694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-18T04:56:02.564649+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-18T04:56:02.564649+0000","last_clean_scrub_stamp":"2024-04-18T04:56:02.564649+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:50:53.366249+0000","scrub_duration":0.049629663999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:48.422520+0000","last_change":"2024-04-18T04:55:48.422593+0000","last_active":"2024-04-18T04:55:48.422520+0000","last_peered":"2024-04-18T04:55:48.422520+0000","last_clean":"2024-04-18T04:55:48.422520+0000","last_became_active":"2024-04-18T04:44:29.882335+0000","last_became_peered":"2024-04-18T04:44:29.882335+0000","last_unstale":"2024-04-18T04:55:48.422520+0000","last_undegraded":"2024-04-18T04:55:48.422520+0000","last_fullsized":"2024-04-18T04:55:48.422520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-04-18T04:55:48.422500+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-04-18T04:55:48.422500+0000","last_clean_scrub_stamp":"2024-04-18T04:55:48.422500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:52:26.809919+0000","scrub_duration":0.0014886680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4640","reported_seq":4681,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:09.529659+0000","last_change":"2024-04-18T04:56:09.529792+0000","last_active":"2024-04-18T04:56:09.529659+0000","last_peered":"2024-04-18T04:56:09.529659+0000","last_clean":"2024-04-18T04:56:09.529659+0000","last_became_active":"2024-04-18T04:44:34.324082+0000","last_became_peered":"2024-04-18T04:44:34.324082+0000","last_unstale":"2024-04-18T04:56:09.529659+0000","last_undegraded":"2024-04-18T04:56:09.529659+0000","last_fullsized":"2024-04-18T04:56:09.529659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4640","last_scrub_stamp":"2024-04-18T04:56:09.529639+0000","last_deep_scrub":"32'4640","last_deep_scrub_stamp":"2024-04-18T04:56:09.529639+0000","last_clean_scrub_stamp":"2024-04-18T04:56:09.529639+0000","objects_scrubbed":0,"log_size":4640,"log_dups_size":0,"ondisk_log_size":4640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:04:20.828783+0000","scrub_duration":0.15868613000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":67980,"num_write_kb":954001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"32'9","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:51.707393+0000","last_change":"2024-04-18T04:55:51.707638+0000","last_active":"2024-04-18T04:55:51.707393+0000","last_peered":"2024-04-18T04:55:51.707393+0000","last_clean":"2024-04-18T04:55:51.707393+0000","last_became_active":"2024-04-18T04:44:30.270878+0000","last_became_peered":"2024-04-18T04:44:30.270878+0000","last_unstale":"2024-04-18T04:55:51.707393+0000","last_undegraded":"2024-04-18T04:55:51.707393+0000","last_fullsized":"2024-04-18T04:55:51.707393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-18T04:55:51.707338+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-18T04:55:51.707338+0000","last_clean_scrub_stamp":"2024-04-18T04:55:51.707338+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:46:00.559874+0000","scrub_duration":0.015878997999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"32'31","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:41.591869+0000","last_change":"2024-04-18T04:55:41.592079+0000","last_active":"2024-04-18T04:55:41.591869+0000","last_peered":"2024-04-18T04:55:41.591869+0000","last_clean":"2024-04-18T04:55:41.591869+0000","last_became_active":"2024-04-18T04:44:29.896199+0000","last_became_peered":"2024-04-18T04:44:29.896199+0000","last_unstale":"2024-04-18T04:55:41.591869+0000","last_undegraded":"2024-04-18T04:55:41.591869+0000","last_fullsized":"2024-04-18T04:55:41.591869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'31","last_scrub_stamp":"2024-04-18T04:55:41.591815+0000","last_deep_scrub":"32'31","last_deep_scrub_stamp":"2024-04-18T04:55:41.591815+0000","last_clean_scrub_stamp":"2024-04-18T04:55:41.591815+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:47:05.819279+0000","scrub_duration":0.031081439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":22,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"32'5255","reported_seq":5295,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:08.518701+0000","last_change":"2024-04-18T04:56:08.518855+0000","last_active":"2024-04-18T04:56:08.518701+0000","last_peered":"2024-04-18T04:56:08.518701+0000","last_clean":"2024-04-18T04:56:08.518701+0000","last_became_active":"2024-04-18T04:44:34.337089+0000","last_became_peered":"2024-04-18T04:44:34.337089+0000","last_unstale":"2024-04-18T04:56:08.518701+0000","last_undegraded":"2024-04-18T04:56:08.518701+0000","last_fullsized":"2024-04-18T04:56:08.518701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5255","last_scrub_stamp":"2024-04-18T04:56:08.518681+0000","last_deep_scrub":"32'5255","last_deep_scrub_stamp":"2024-04-18T04:56:08.518681+0000","last_clean_scrub_stamp":"2024-04-18T04:56:08.518681+0000","objects_scrubbed":0,"log_size":5255,"log_dups_size":0,"ondisk_log_size":5255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:12:50.723446+0000","scrub_duration":0.114400374,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":76866,"num_write_kb":1090506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"32'13","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:59.385349+0000","last_change":"2024-04-18T04:55:59.385423+0000","last_active":"2024-04-18T04:55:59.385349+0000","last_peered":"2024-04-18T04:55:59.385349+0000","last_clean":"2024-04-18T04:55:59.385349+0000","last_became_active":"2024-04-18T04:44:30.270636+0000","last_became_peered":"2024-04-18T04:44:30.270636+0000","last_unstale":"2024-04-18T04:55:59.385349+0000","last_undegraded":"2024-04-18T04:55:59.385349+0000","last_fullsized":"2024-04-18T04:55:59.385349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-04-18T04:55:59.385329+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-04-18T04:55:59.385329+0000","last_clean_scrub_stamp":"2024-04-18T04:55:59.385329+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:23:06.860026+0000","scrub_duration":0.0014736669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"32'45","reported_seq":117,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:42.107941+0000","last_change":"2024-04-18T04:55:42.108086+0000","last_active":"2024-04-18T04:55:42.107941+0000","last_peered":"2024-04-18T04:55:42.107941+0000","last_clean":"2024-04-18T04:55:42.107941+0000","last_became_active":"2024-04-18T04:44:29.878330+0000","last_became_peered":"2024-04-18T04:44:29.878330+0000","last_unstale":"2024-04-18T04:55:42.107941+0000","last_undegraded":"2024-04-18T04:55:42.107941+0000","last_fullsized":"2024-04-18T04:55:42.107941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-04-18T04:55:42.107919+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-04-18T04:55:42.107919+0000","last_clean_scrub_stamp":"2024-04-18T04:55:42.107919+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:05:38.846240+0000","scrub_duration":0.0049119840000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90443,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":42,"num_read_kb":118,"num_write":37,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'4417","reported_seq":4455,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:04.504388+0000","last_change":"2024-04-18T04:56:04.504532+0000","last_active":"2024-04-18T04:56:04.504388+0000","last_peered":"2024-04-18T04:56:04.504388+0000","last_clean":"2024-04-18T04:56:04.504388+0000","last_became_active":"2024-04-18T04:44:34.322983+0000","last_became_peered":"2024-04-18T04:44:34.322983+0000","last_unstale":"2024-04-18T04:56:04.504388+0000","last_undegraded":"2024-04-18T04:56:04.504388+0000","last_fullsized":"2024-04-18T04:56:04.504388+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4417","last_scrub_stamp":"2024-04-18T04:56:04.504368+0000","last_deep_scrub":"32'4417","last_deep_scrub_stamp":"2024-04-18T04:56:04.504368+0000","last_clean_scrub_stamp":"2024-04-18T04:56:04.504368+0000","objects_scrubbed":0,"log_size":4417,"log_dups_size":0,"ondisk_log_size":4417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:53:39.809940+0000","scrub_duration":0.118053505,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":64703,"num_write_kb":914612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"32'6","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:43.527284+0000","last_change":"2024-04-18T04:55:43.527385+0000","last_active":"2024-04-18T04:55:43.527284+0000","last_peered":"2024-04-18T04:55:43.527284+0000","last_clean":"2024-04-18T04:55:43.527284+0000","last_became_active":"2024-04-18T04:44:30.285113+0000","last_became_peered":"2024-04-18T04:44:30.285113+0000","last_unstale":"2024-04-18T04:55:43.527284+0000","last_undegraded":"2024-04-18T04:55:43.527284+0000","last_fullsized":"2024-04-18T04:55:43.527284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-18T04:55:43.527263+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-18T04:55:43.527263+0000","last_clean_scrub_stamp":"2024-04-18T04:55:43.527263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:51:32.481877+0000","scrub_duration":0.0026846880000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"32'35","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:45.707944+0000","last_change":"2024-04-18T04:55:45.708153+0000","last_active":"2024-04-18T04:55:45.707944+0000","last_peered":"2024-04-18T04:55:45.707944+0000","last_clean":"2024-04-18T04:55:45.707944+0000","last_became_active":"2024-04-18T04:44:29.890207+0000","last_became_peered":"2024-04-18T04:44:29.890207+0000","last_unstale":"2024-04-18T04:55:45.707944+0000","last_undegraded":"2024-04-18T04:55:45.707944+0000","last_fullsized":"2024-04-18T04:55:45.707944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'35","last_scrub_stamp":"2024-04-18T04:55:45.707886+0000","last_deep_scrub":"32'35","last_deep_scrub_stamp":"2024-04-18T04:55:45.707886+0000","last_clean_scrub_stamp":"2024-04-18T04:55:45.707886+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:34:27.358342+0000","scrub_duration":0.034614290999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":8204,"num_write":25,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"32'5273","reported_seq":5322,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:09.710663+0000","last_change":"2024-04-18T04:56:09.710790+0000","last_active":"2024-04-18T04:56:09.710663+0000","last_peered":"2024-04-18T04:56:09.710663+0000","last_clean":"2024-04-18T04:56:09.710663+0000","last_became_active":"2024-04-18T04:45:12.378263+0000","last_became_peered":"2024-04-18T04:45:12.378263+0000","last_unstale":"2024-04-18T04:56:09.710663+0000","last_undegraded":"2024-04-18T04:56:09.710663+0000","last_fullsized":"2024-04-18T04:56:09.710663+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5273","last_scrub_stamp":"2024-04-18T04:56:09.710643+0000","last_deep_scrub":"32'5273","last_deep_scrub_stamp":"2024-04-18T04:56:09.710643+0000","last_clean_scrub_stamp":"2024-04-18T04:56:09.710643+0000","objects_scrubbed":0,"log_size":5273,"log_dups_size":0,"ondisk_log_size":5273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:28:45.280253+0000","scrub_duration":0.16230691,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":76633,"num_write_kb":1101398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:00.673352+0000","last_change":"2024-04-18T04:56:00.673433+0000","last_active":"2024-04-18T04:56:00.673352+0000","last_peered":"2024-04-18T04:56:00.673352+0000","last_clean":"2024-04-18T04:56:00.673352+0000","last_became_active":"2024-04-18T04:44:30.306320+0000","last_became_peered":"2024-04-18T04:44:30.306320+0000","last_unstale":"2024-04-18T04:56:00.673352+0000","last_undegraded":"2024-04-18T04:56:00.673352+0000","last_fullsized":"2024-04-18T04:56:00.673352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-18T04:56:00.673335+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-18T04:56:00.673335+0000","last_clean_scrub_stamp":"2024-04-18T04:56:00.673335+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:18:23.146975+0000","scrub_duration":0.0022741749999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"32'9","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:42.555546+0000","last_change":"2024-04-18T04:55:42.555773+0000","last_active":"2024-04-18T04:55:42.555546+0000","last_peered":"2024-04-18T04:55:42.555546+0000","last_clean":"2024-04-18T04:55:42.555546+0000","last_became_active":"2024-04-18T04:44:29.887440+0000","last_became_peered":"2024-04-18T04:44:29.887440+0000","last_unstale":"2024-04-18T04:55:42.555546+0000","last_undegraded":"2024-04-18T04:55:42.555546+0000","last_fullsized":"2024-04-18T04:55:42.555546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-18T04:55:42.555488+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-18T04:55:42.555488+0000","last_clean_scrub_stamp":"2024-04-18T04:55:42.555488+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:41:03.271057+0000","scrub_duration":0.0067458550000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":20,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":194,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:44.677778+0000","last_change":"2024-04-18T04:55:44.677983+0000","last_active":"2024-04-18T04:55:44.677778+0000","last_peered":"2024-04-18T04:55:44.677778+0000","last_clean":"2024-04-18T04:55:44.677778+0000","last_became_active":"2024-04-18T04:44:18.627792+0000","last_became_peered":"2024-04-18T04:44:18.627792+0000","last_unstale":"2024-04-18T04:55:44.677778+0000","last_undegraded":"2024-04-18T04:55:44.677778+0000","last_fullsized":"2024-04-18T04:55:44.677778+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-04-18T04:55:44.677717+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-04-18T04:55:44.677717+0000","last_clean_scrub_stamp":"2024-04-18T04:55:44.677717+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:04:55.300837+0000","scrub_duration":0.0097382879999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"32'4252","reported_seq":4278,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.822744+0000","last_change":"2024-04-18T04:44:34.333286+0000","last_active":"2024-04-18T04:55:39.822744+0000","last_peered":"2024-04-18T04:55:39.822744+0000","last_clean":"2024-04-18T04:55:39.822744+0000","last_became_active":"2024-04-18T04:44:34.332520+0000","last_became_peered":"2024-04-18T04:44:34.332520+0000","last_unstale":"2024-04-18T04:55:39.822744+0000","last_undegraded":"2024-04-18T04:55:39.822744+0000","last_fullsized":"2024-04-18T04:55:39.822744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4252,"log_dups_size":0,"ondisk_log_size":4252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":62374,"num_write_kb":880557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"32'8","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:10.727171+0000","last_change":"2024-04-18T04:56:10.727392+0000","last_active":"2024-04-18T04:56:10.727171+0000","last_peered":"2024-04-18T04:56:10.727171+0000","last_clean":"2024-04-18T04:56:10.727171+0000","last_became_active":"2024-04-18T04:44:30.302157+0000","last_became_peered":"2024-04-18T04:44:30.302157+0000","last_unstale":"2024-04-18T04:56:10.727171+0000","last_undegraded":"2024-04-18T04:56:10.727171+0000","last_fullsized":"2024-04-18T04:56:10.727171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-18T04:56:10.727118+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-18T04:56:10.727118+0000","last_clean_scrub_stamp":"2024-04-18T04:56:10.727118+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:56:23.166218+0000","scrub_duration":0.031439657000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"32'14","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:45.141146+0000","last_change":"2024-04-18T04:55:45.141146+0000","last_active":"2024-04-18T04:55:45.141146+0000","last_peered":"2024-04-18T04:55:45.141146+0000","last_clean":"2024-04-18T04:55:45.141146+0000","last_became_active":"2024-04-18T04:44:29.890166+0000","last_became_peered":"2024-04-18T04:44:29.890166+0000","last_unstale":"2024-04-18T04:55:45.141146+0000","last_undegraded":"2024-04-18T04:55:45.141146+0000","last_fullsized":"2024-04-18T04:55:45.141146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-04-18T04:55:45.141052+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-04-18T04:55:45.141052+0000","last_clean_scrub_stamp":"2024-04-18T04:55:45.141052+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:03:19.757976+0000","scrub_duration":0.0051920170000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":14,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"32'3652","reported_seq":3694,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:14.920944+0000","last_change":"2024-04-18T04:56:14.921328+0000","last_active":"2024-04-18T04:56:14.920944+0000","last_peered":"2024-04-18T04:56:14.920944+0000","last_clean":"2024-04-18T04:56:14.920944+0000","last_became_active":"2024-04-18T04:44:34.332695+0000","last_became_peered":"2024-04-18T04:44:34.332695+0000","last_unstale":"2024-04-18T04:56:14.920944+0000","last_undegraded":"2024-04-18T04:56:14.920944+0000","last_fullsized":"2024-04-18T04:56:14.920944+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3652","last_scrub_stamp":"2024-04-18T04:56:14.920854+0000","last_deep_scrub":"32'3652","last_deep_scrub_stamp":"2024-04-18T04:56:14.920854+0000","last_clean_scrub_stamp":"2024-04-18T04:56:14.920854+0000","objects_scrubbed":0,"log_size":3652,"log_dups_size":0,"ondisk_log_size":3652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:53:27.805077+0000","scrub_duration":0.118060287,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":53440,"num_write_kb":771461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'7","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:53.546185+0000","last_change":"2024-04-18T04:55:53.546427+0000","last_active":"2024-04-18T04:55:53.546185+0000","last_peered":"2024-04-18T04:55:53.546185+0000","last_clean":"2024-04-18T04:55:53.546185+0000","last_became_active":"2024-04-18T04:44:30.287217+0000","last_became_peered":"2024-04-18T04:44:30.287217+0000","last_unstale":"2024-04-18T04:55:53.546185+0000","last_undegraded":"2024-04-18T04:55:53.546185+0000","last_fullsized":"2024-04-18T04:55:53.546185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-18T04:55:53.546130+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-18T04:55:53.546130+0000","last_clean_scrub_stamp":"2024-04-18T04:55:53.546130+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:37:04.371045+0000","scrub_duration":0.0026409860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"32'27","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:55.479159+0000","last_change":"2024-04-18T04:55:55.479261+0000","last_active":"2024-04-18T04:55:55.479159+0000","last_peered":"2024-04-18T04:55:55.479159+0000","last_clean":"2024-04-18T04:55:55.479159+0000","last_became_active":"2024-04-18T04:44:29.886058+0000","last_became_peered":"2024-04-18T04:44:29.886058+0000","last_unstale":"2024-04-18T04:55:55.479159+0000","last_undegraded":"2024-04-18T04:55:55.479159+0000","last_fullsized":"2024-04-18T04:55:55.479159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'27","last_scrub_stamp":"2024-04-18T04:55:55.479138+0000","last_deep_scrub":"32'27","last_deep_scrub_stamp":"2024-04-18T04:55:55.479138+0000","last_clean_scrub_stamp":"2024-04-18T04:55:55.479138+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:51:06.781945+0000","scrub_duration":0.019171673,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":23,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"32'4573","reported_seq":4622,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:11.686324+0000","last_change":"2024-04-18T04:56:11.686452+0000","last_active":"2024-04-18T04:56:11.686324+0000","last_peered":"2024-04-18T04:56:11.686324+0000","last_clean":"2024-04-18T04:56:11.686324+0000","last_became_active":"2024-04-18T04:45:12.373269+0000","last_became_peered":"2024-04-18T04:45:12.373269+0000","last_unstale":"2024-04-18T04:56:11.686324+0000","last_undegraded":"2024-04-18T04:56:11.686324+0000","last_fullsized":"2024-04-18T04:56:11.686324+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4573","last_scrub_stamp":"2024-04-18T04:56:11.686302+0000","last_deep_scrub":"32'4573","last_deep_scrub_stamp":"2024-04-18T04:56:11.686302+0000","last_clean_scrub_stamp":"2024-04-18T04:56:11.686302+0000","objects_scrubbed":0,"log_size":4573,"log_dups_size":0,"ondisk_log_size":4573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:05:21.377177+0000","scrub_duration":0.087948346999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":66919,"num_write_kb":952859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"32'11","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:05.126024+0000","last_change":"2024-04-18T04:56:05.126129+0000","last_active":"2024-04-18T04:56:05.126024+0000","last_peered":"2024-04-18T04:56:05.126024+0000","last_clean":"2024-04-18T04:56:05.126024+0000","last_became_active":"2024-04-18T04:45:12.042803+0000","last_became_peered":"2024-04-18T04:45:12.042803+0000","last_unstale":"2024-04-18T04:56:05.126024+0000","last_undegraded":"2024-04-18T04:56:05.126024+0000","last_fullsized":"2024-04-18T04:56:05.126024+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-04-18T04:56:05.126005+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-04-18T04:56:05.126005+0000","last_clean_scrub_stamp":"2024-04-18T04:56:05.126005+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:41:03.081229+0000","scrub_duration":0.11656122100000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"32'274","reported_seq":317,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.839246+0000","last_change":"2024-04-18T04:55:37.108330+0000","last_active":"2024-04-18T04:55:39.839246+0000","last_peered":"2024-04-18T04:55:39.839246+0000","last_clean":"2024-04-18T04:55:39.839246+0000","last_became_active":"2024-04-18T04:44:29.878361+0000","last_became_peered":"2024-04-18T04:44:29.878361+0000","last_unstale":"2024-04-18T04:55:39.839246+0000","last_undegraded":"2024-04-18T04:55:39.839246+0000","last_fullsized":"2024-04-18T04:55:39.839246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'271","last_scrub_stamp":"2024-04-18T04:55:37.108214+0000","last_deep_scrub":"32'271","last_deep_scrub_stamp":"2024-04-18T04:55:37.108214+0000","last_clean_scrub_stamp":"2024-04-18T04:55:37.108214+0000","objects_scrubbed":3,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:45:36.128941+0000","scrub_duration":0.015395397999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":678,"num_write":268,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7088,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"32'4411","reported_seq":4455,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:12.778619+0000","last_change":"2024-04-18T04:56:12.778813+0000","last_active":"2024-04-18T04:56:12.778619+0000","last_peered":"2024-04-18T04:56:12.778619+0000","last_clean":"2024-04-18T04:56:12.778619+0000","last_became_active":"2024-04-18T04:44:34.338042+0000","last_became_peered":"2024-04-18T04:44:34.338042+0000","last_unstale":"2024-04-18T04:56:12.778619+0000","last_undegraded":"2024-04-18T04:56:12.778619+0000","last_fullsized":"2024-04-18T04:56:12.778619+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4411","last_scrub_stamp":"2024-04-18T04:56:12.778597+0000","last_deep_scrub":"32'4411","last_deep_scrub_stamp":"2024-04-18T04:56:12.778597+0000","last_clean_scrub_stamp":"2024-04-18T04:56:12.778597+0000","objects_scrubbed":0,"log_size":4411,"log_dups_size":0,"ondisk_log_size":4411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:12:13.686072+0000","scrub_duration":0.163448752,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":64611,"num_write_kb":926956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"32'7","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:05.753005+0000","last_change":"2024-04-18T04:56:05.753171+0000","last_active":"2024-04-18T04:56:05.753005+0000","last_peered":"2024-04-18T04:56:05.753005+0000","last_clean":"2024-04-18T04:56:05.753005+0000","last_became_active":"2024-04-18T04:44:30.290379+0000","last_became_peered":"2024-04-18T04:44:30.290379+0000","last_unstale":"2024-04-18T04:56:05.753005+0000","last_undegraded":"2024-04-18T04:56:05.753005+0000","last_fullsized":"2024-04-18T04:56:05.753005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-04-18T04:56:05.752957+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-04-18T04:56:05.752957+0000","last_clean_scrub_stamp":"2024-04-18T04:56:05.752957+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:26:19.212850+0000","scrub_duration":0.0035311740000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"32'12","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.663717+0000","last_change":"2024-04-18T04:55:38.668893+0000","last_active":"2024-04-18T04:55:39.663717+0000","last_peered":"2024-04-18T04:55:39.663717+0000","last_clean":"2024-04-18T04:55:39.663717+0000","last_became_active":"2024-04-18T04:44:29.881671+0000","last_became_peered":"2024-04-18T04:44:29.881671+0000","last_unstale":"2024-04-18T04:55:39.663717+0000","last_undegraded":"2024-04-18T04:55:39.663717+0000","last_fullsized":"2024-04-18T04:55:39.663717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-04-18T04:55:38.668646+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-04-18T04:55:38.668646+0000","last_clean_scrub_stamp":"2024-04-18T04:55:38.668646+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:45:33.432081+0000","scrub_duration":0.0053390160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"32'4121","reported_seq":4166,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:11.869433+0000","last_change":"2024-04-18T04:56:11.869669+0000","last_active":"2024-04-18T04:56:11.869433+0000","last_peered":"2024-04-18T04:56:11.869433+0000","last_clean":"2024-04-18T04:56:11.869433+0000","last_became_active":"2024-04-18T04:44:34.340327+0000","last_became_peered":"2024-04-18T04:44:34.340327+0000","last_unstale":"2024-04-18T04:56:11.869433+0000","last_undegraded":"2024-04-18T04:56:11.869433+0000","last_fullsized":"2024-04-18T04:56:11.869433+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4121","last_scrub_stamp":"2024-04-18T04:56:11.869385+0000","last_deep_scrub":"32'4121","last_deep_scrub_stamp":"2024-04-18T04:56:11.869385+0000","last_clean_scrub_stamp":"2024-04-18T04:56:11.869385+0000","objects_scrubbed":0,"log_size":4121,"log_dups_size":0,"ondisk_log_size":4121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:05:40.214948+0000","scrub_duration":0.064509755000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":60260,"num_write_kb":847949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"32'12","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:14.684986+0000","last_change":"2024-04-18T04:56:14.685197+0000","last_active":"2024-04-18T04:56:14.684986+0000","last_peered":"2024-04-18T04:56:14.684986+0000","last_clean":"2024-04-18T04:56:14.684986+0000","last_became_active":"2024-04-18T04:44:30.298417+0000","last_became_peered":"2024-04-18T04:44:30.298417+0000","last_unstale":"2024-04-18T04:56:14.684986+0000","last_undegraded":"2024-04-18T04:56:14.684986+0000","last_fullsized":"2024-04-18T04:56:14.684986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-04-18T04:56:14.684930+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-04-18T04:56:14.684930+0000","last_clean_scrub_stamp":"2024-04-18T04:56:14.684930+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:15:43.272876+0000","scrub_duration":0.0035795190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"32'30","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:46.187598+0000","last_change":"2024-04-18T04:55:46.187598+0000","last_active":"2024-04-18T04:55:46.187598+0000","last_peered":"2024-04-18T04:55:46.187598+0000","last_clean":"2024-04-18T04:55:46.187598+0000","last_became_active":"2024-04-18T04:44:29.875059+0000","last_became_peered":"2024-04-18T04:44:29.875059+0000","last_unstale":"2024-04-18T04:55:46.187598+0000","last_undegraded":"2024-04-18T04:55:46.187598+0000","last_fullsized":"2024-04-18T04:55:46.187598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'30","last_scrub_stamp":"2024-04-18T04:55:46.187488+0000","last_deep_scrub":"32'30","last_deep_scrub_stamp":"2024-04-18T04:55:46.187488+0000","last_clean_scrub_stamp":"2024-04-18T04:55:46.187488+0000","objects_scrubbed":8,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:10:21.355167+0000","scrub_duration":0.0053312890000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":44,"num_read_kb":43,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"32'5105","reported_seq":5144,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:12.653035+0000","last_change":"2024-04-18T04:56:12.653176+0000","last_active":"2024-04-18T04:56:12.653035+0000","last_peered":"2024-04-18T04:56:12.653035+0000","last_clean":"2024-04-18T04:56:12.653035+0000","last_became_active":"2024-04-18T04:44:34.334192+0000","last_became_peered":"2024-04-18T04:44:34.334192+0000","last_unstale":"2024-04-18T04:56:12.653035+0000","last_undegraded":"2024-04-18T04:56:12.653035+0000","last_fullsized":"2024-04-18T04:56:12.653035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5105","last_scrub_stamp":"2024-04-18T04:56:12.653015+0000","last_deep_scrub":"32'5105","last_deep_scrub_stamp":"2024-04-18T04:56:12.653015+0000","last_clean_scrub_stamp":"2024-04-18T04:56:12.653015+0000","objects_scrubbed":0,"log_size":5105,"log_dups_size":0,"ondisk_log_size":5105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:47:28.273505+0000","scrub_duration":0.081297269000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":74408,"num_write_kb":1061210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:52.569224+0000","last_change":"2024-04-18T04:55:52.569224+0000","last_active":"2024-04-18T04:55:52.569224+0000","last_peered":"2024-04-18T04:55:52.569224+0000","last_clean":"2024-04-18T04:55:52.569224+0000","last_became_active":"2024-04-18T04:44:30.295404+0000","last_became_peered":"2024-04-18T04:44:30.295404+0000","last_unstale":"2024-04-18T04:55:52.569224+0000","last_undegraded":"2024-04-18T04:55:52.569224+0000","last_fullsized":"2024-04-18T04:55:52.569224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-18T04:55:52.568955+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-18T04:55:52.568955+0000","last_clean_scrub_stamp":"2024-04-18T04:55:52.568955+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:50:34.888052+0000","scrub_duration":0.0032512019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"32'19","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.737684+0000","last_change":"2024-04-18T04:55:39.372542+0000","last_active":"2024-04-18T04:55:39.737684+0000","last_peered":"2024-04-18T04:55:39.737684+0000","last_clean":"2024-04-18T04:55:39.737684+0000","last_became_active":"2024-04-18T04:44:29.893668+0000","last_became_peered":"2024-04-18T04:44:29.893668+0000","last_unstale":"2024-04-18T04:55:39.737684+0000","last_undegraded":"2024-04-18T04:55:39.737684+0000","last_fullsized":"2024-04-18T04:55:39.737684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-04-18T04:55:39.372420+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-04-18T04:55:39.372420+0000","last_clean_scrub_stamp":"2024-04-18T04:55:39.372420+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:51:03.179934+0000","scrub_duration":0.030124604999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1711,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":12,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5866,"num_omap_keys":11,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"32'5194","reported_seq":5243,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:13.764373+0000","last_change":"2024-04-18T04:56:13.764494+0000","last_active":"2024-04-18T04:56:13.764373+0000","last_peered":"2024-04-18T04:56:13.764373+0000","last_clean":"2024-04-18T04:56:13.764373+0000","last_became_active":"2024-04-18T04:45:12.056680+0000","last_became_peered":"2024-04-18T04:45:12.056680+0000","last_unstale":"2024-04-18T04:56:13.764373+0000","last_undegraded":"2024-04-18T04:56:13.764373+0000","last_fullsized":"2024-04-18T04:56:13.764373+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5194","last_scrub_stamp":"2024-04-18T04:56:13.764352+0000","last_deep_scrub":"32'5194","last_deep_scrub_stamp":"2024-04-18T04:56:13.764352+0000","last_clean_scrub_stamp":"2024-04-18T04:56:13.764352+0000","objects_scrubbed":0,"log_size":5194,"log_dups_size":0,"ondisk_log_size":5194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:49:55.046692+0000","scrub_duration":0.122515213,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":76118,"num_write_kb":1080690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'25","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:04.733053+0000","last_change":"2024-04-18T04:56:04.733053+0000","last_active":"2024-04-18T04:56:04.733053+0000","last_peered":"2024-04-18T04:56:04.733053+0000","last_clean":"2024-04-18T04:56:04.733053+0000","last_became_active":"2024-04-18T04:44:30.288364+0000","last_became_peered":"2024-04-18T04:44:30.288364+0000","last_unstale":"2024-04-18T04:56:04.733053+0000","last_undegraded":"2024-04-18T04:56:04.733053+0000","last_fullsized":"2024-04-18T04:56:04.733053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2024-04-18T04:56:04.732768+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2024-04-18T04:56:04.732768+0000","last_clean_scrub_stamp":"2024-04-18T04:56:04.732768+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:22:43.000995+0000","scrub_duration":0.0072562310000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"32'9","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:47.610138+0000","last_change":"2024-04-18T04:55:47.610138+0000","last_active":"2024-04-18T04:55:47.610138+0000","last_peered":"2024-04-18T04:55:47.610138+0000","last_clean":"2024-04-18T04:55:47.610138+0000","last_became_active":"2024-04-18T04:44:29.889150+0000","last_became_peered":"2024-04-18T04:44:29.889150+0000","last_unstale":"2024-04-18T04:55:47.610138+0000","last_undegraded":"2024-04-18T04:55:47.610138+0000","last_fullsized":"2024-04-18T04:55:47.610138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-18T04:55:47.609828+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-18T04:55:47.609828+0000","last_clean_scrub_stamp":"2024-04-18T04:55:47.609828+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:14:23.527947+0000","scrub_duration":0.0044473270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'4551","reported_seq":4592,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:10.791244+0000","last_change":"2024-04-18T04:56:10.791379+0000","last_active":"2024-04-18T04:56:10.791244+0000","last_peered":"2024-04-18T04:56:10.791244+0000","last_clean":"2024-04-18T04:56:10.791244+0000","last_became_active":"2024-04-18T04:44:34.305341+0000","last_became_peered":"2024-04-18T04:44:34.305341+0000","last_unstale":"2024-04-18T04:56:10.791244+0000","last_undegraded":"2024-04-18T04:56:10.791244+0000","last_fullsized":"2024-04-18T04:56:10.791244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4551","last_scrub_stamp":"2024-04-18T04:56:10.791224+0000","last_deep_scrub":"32'4551","last_deep_scrub_stamp":"2024-04-18T04:56:10.791224+0000","last_clean_scrub_stamp":"2024-04-18T04:56:10.791224+0000","objects_scrubbed":0,"log_size":4551,"log_dups_size":0,"ondisk_log_size":4551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:23:23.184308+0000","scrub_duration":0.13359138000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":66735,"num_write_kb":961503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'10","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:00.619208+0000","last_change":"2024-04-18T04:56:00.619208+0000","last_active":"2024-04-18T04:56:00.619208+0000","last_peered":"2024-04-18T04:56:00.619208+0000","last_clean":"2024-04-18T04:56:00.619208+0000","last_became_active":"2024-04-18T04:44:30.306726+0000","last_became_peered":"2024-04-18T04:44:30.306726+0000","last_unstale":"2024-04-18T04:56:00.619208+0000","last_undegraded":"2024-04-18T04:56:00.619208+0000","last_fullsized":"2024-04-18T04:56:00.619208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-18T04:56:00.619107+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-18T04:56:00.619107+0000","last_clean_scrub_stamp":"2024-04-18T04:56:00.619107+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:52:49.090454+0000","scrub_duration":0.0023757240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"32'43","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.823187+0000","last_change":"2024-04-18T04:55:35.470607+0000","last_active":"2024-04-18T04:55:39.823187+0000","last_peered":"2024-04-18T04:55:39.823187+0000","last_clean":"2024-04-18T04:55:39.823187+0000","last_became_active":"2024-04-18T04:44:29.887095+0000","last_became_peered":"2024-04-18T04:44:29.887095+0000","last_unstale":"2024-04-18T04:55:39.823187+0000","last_undegraded":"2024-04-18T04:55:39.823187+0000","last_fullsized":"2024-04-18T04:55:39.823187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'40","last_scrub_stamp":"2024-04-18T04:55:35.470495+0000","last_deep_scrub":"32'40","last_deep_scrub_stamp":"2024-04-18T04:55:35.470495+0000","last_clean_scrub_stamp":"2024-04-18T04:55:35.470495+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:22:22.552307+0000","scrub_duration":0.035712923000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":31,"num_read_kb":8224,"num_write":33,"num_write_kb":8211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"32'4785","reported_seq":4824,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:15.781786+0000","last_change":"2024-04-18T04:56:15.781934+0000","last_active":"2024-04-18T04:56:15.781786+0000","last_peered":"2024-04-18T04:56:15.781786+0000","last_clean":"2024-04-18T04:56:15.781786+0000","last_became_active":"2024-04-18T04:44:34.320776+0000","last_became_peered":"2024-04-18T04:44:34.320776+0000","last_unstale":"2024-04-18T04:56:15.781786+0000","last_undegraded":"2024-04-18T04:56:15.781786+0000","last_fullsized":"2024-04-18T04:56:15.781786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4785","last_scrub_stamp":"2024-04-18T04:56:15.781760+0000","last_deep_scrub":"32'4785","last_deep_scrub_stamp":"2024-04-18T04:56:15.781760+0000","last_clean_scrub_stamp":"2024-04-18T04:56:15.781760+0000","objects_scrubbed":0,"log_size":4785,"log_dups_size":0,"ondisk_log_size":4785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:22:39.933533+0000","scrub_duration":0.19696786199999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":70304,"num_write_kb":986201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"32'8","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:13.726939+0000","last_change":"2024-04-18T04:56:13.727188+0000","last_active":"2024-04-18T04:56:13.726939+0000","last_peered":"2024-04-18T04:56:13.726939+0000","last_clean":"2024-04-18T04:56:13.726939+0000","last_became_active":"2024-04-18T04:44:30.293185+0000","last_became_peered":"2024-04-18T04:44:30.293185+0000","last_unstale":"2024-04-18T04:56:13.726939+0000","last_undegraded":"2024-04-18T04:56:13.726939+0000","last_fullsized":"2024-04-18T04:56:13.726939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-18T04:56:13.726883+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-18T04:56:13.726883+0000","last_clean_scrub_stamp":"2024-04-18T04:56:13.726883+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:09:07.850930+0000","scrub_duration":0.0077545139999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"32'234","reported_seq":281,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:42.418311+0000","last_change":"2024-04-18T04:55:42.418311+0000","last_active":"2024-04-18T04:55:42.418311+0000","last_peered":"2024-04-18T04:55:42.418311+0000","last_clean":"2024-04-18T04:55:42.418311+0000","last_became_active":"2024-04-18T04:44:29.892647+0000","last_became_peered":"2024-04-18T04:44:29.892647+0000","last_unstale":"2024-04-18T04:55:42.418311+0000","last_undegraded":"2024-04-18T04:55:42.418311+0000","last_fullsized":"2024-04-18T04:55:42.418311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'234","last_scrub_stamp":"2024-04-18T04:55:42.418044+0000","last_deep_scrub":"32'234","last_deep_scrub_stamp":"2024-04-18T04:55:42.418044+0000","last_clean_scrub_stamp":"2024-04-18T04:55:42.418044+0000","objects_scrubbed":5,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:33:18.193509+0000","scrub_duration":0.029742009,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":21,"num_read_kb":4116,"num_write":228,"num_write_kb":4214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"32'4396","reported_seq":4437,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:02.512792+0000","last_change":"2024-04-18T04:56:02.512908+0000","last_active":"2024-04-18T04:56:02.512792+0000","last_peered":"2024-04-18T04:56:02.512792+0000","last_clean":"2024-04-18T04:56:02.512792+0000","last_became_active":"2024-04-18T04:44:34.337486+0000","last_became_peered":"2024-04-18T04:44:34.337486+0000","last_unstale":"2024-04-18T04:56:02.512792+0000","last_undegraded":"2024-04-18T04:56:02.512792+0000","last_fullsized":"2024-04-18T04:56:02.512792+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4396","last_scrub_stamp":"2024-04-18T04:56:02.512772+0000","last_deep_scrub":"32'4396","last_deep_scrub_stamp":"2024-04-18T04:56:02.512772+0000","last_clean_scrub_stamp":"2024-04-18T04:56:02.512772+0000","objects_scrubbed":0,"log_size":4396,"log_dups_size":0,"ondisk_log_size":4396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:51:35.718269+0000","scrub_duration":0.11782891099999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1,"num_write":64313,"num_write_kb":903689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"32'14","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.850719+0000","last_change":"2024-04-18T04:55:39.618022+0000","last_active":"2024-04-18T04:55:39.850719+0000","last_peered":"2024-04-18T04:55:39.850719+0000","last_clean":"2024-04-18T04:55:39.850719+0000","last_became_active":"2024-04-18T04:44:30.307237+0000","last_became_peered":"2024-04-18T04:44:30.307237+0000","last_unstale":"2024-04-18T04:55:39.850719+0000","last_undegraded":"2024-04-18T04:55:39.850719+0000","last_fullsized":"2024-04-18T04:55:39.850719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-18T04:55:39.617881+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-18T04:55:39.617881+0000","last_clean_scrub_stamp":"2024-04-18T04:55:39.617881+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:45:32.468555+0000","scrub_duration":0.0024657490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"32'21","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:57.424031+0000","last_change":"2024-04-18T04:55:57.424110+0000","last_active":"2024-04-18T04:55:57.424031+0000","last_peered":"2024-04-18T04:55:57.424031+0000","last_clean":"2024-04-18T04:55:57.424031+0000","last_became_active":"2024-04-18T04:44:29.898113+0000","last_became_peered":"2024-04-18T04:44:29.898113+0000","last_unstale":"2024-04-18T04:55:57.424031+0000","last_undegraded":"2024-04-18T04:55:57.424031+0000","last_fullsized":"2024-04-18T04:55:57.424031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-04-18T04:55:57.424010+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-04-18T04:55:57.424010+0000","last_clean_scrub_stamp":"2024-04-18T04:55:57.424010+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:19:23.487965+0000","scrub_duration":0.0061927750000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":19,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'5543","reported_seq":5583,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:09.935679+0000","last_change":"2024-04-18T04:56:09.935679+0000","last_active":"2024-04-18T04:56:09.935679+0000","last_peered":"2024-04-18T04:56:09.935679+0000","last_clean":"2024-04-18T04:56:09.935679+0000","last_became_active":"2024-04-18T04:44:34.343636+0000","last_became_peered":"2024-04-18T04:44:34.343636+0000","last_unstale":"2024-04-18T04:56:09.935679+0000","last_undegraded":"2024-04-18T04:56:09.935679+0000","last_fullsized":"2024-04-18T04:56:09.935679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5543","last_scrub_stamp":"2024-04-18T04:56:09.935390+0000","last_deep_scrub":"32'5543","last_deep_scrub_stamp":"2024-04-18T04:56:09.935390+0000","last_clean_scrub_stamp":"2024-04-18T04:56:09.935390+0000","objects_scrubbed":0,"log_size":5543,"log_dups_size":0,"ondisk_log_size":5543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:21:06.087982+0000","scrub_duration":0.13318435200000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":7,"num_write":81014,"num_write_kb":1156235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"32'12","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:54.652162+0000","last_change":"2024-04-18T04:55:54.652263+0000","last_active":"2024-04-18T04:55:54.652162+0000","last_peered":"2024-04-18T04:55:54.652162+0000","last_clean":"2024-04-18T04:55:54.652162+0000","last_became_active":"2024-04-18T04:44:30.290127+0000","last_became_peered":"2024-04-18T04:44:30.290127+0000","last_unstale":"2024-04-18T04:55:54.652162+0000","last_undegraded":"2024-04-18T04:55:54.652162+0000","last_fullsized":"2024-04-18T04:55:54.652162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-04-18T04:55:54.652143+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-04-18T04:55:54.652143+0000","last_clean_scrub_stamp":"2024-04-18T04:55:54.652143+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:42:59.936226+0000","scrub_duration":0.043655591000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:46.605547+0000","last_change":"2024-04-18T04:55:46.605787+0000","last_active":"2024-04-18T04:55:46.605547+0000","last_peered":"2024-04-18T04:55:46.605547+0000","last_clean":"2024-04-18T04:55:46.605547+0000","last_became_active":"2024-04-18T04:44:29.895083+0000","last_became_peered":"2024-04-18T04:44:29.895083+0000","last_unstale":"2024-04-18T04:55:46.605547+0000","last_undegraded":"2024-04-18T04:55:46.605547+0000","last_fullsized":"2024-04-18T04:55:46.605547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-18T04:55:46.605493+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-18T04:55:46.605493+0000","last_clean_scrub_stamp":"2024-04-18T04:55:46.605493+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:59:10.105864+0000","scrub_duration":0.005528097,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"32'4755","reported_seq":4785,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.840777+0000","last_change":"2024-04-18T04:44:34.338412+0000","last_active":"2024-04-18T04:55:39.840777+0000","last_peered":"2024-04-18T04:55:39.840777+0000","last_clean":"2024-04-18T04:55:39.840777+0000","last_became_active":"2024-04-18T04:44:34.338062+0000","last_became_peered":"2024-04-18T04:44:34.338062+0000","last_unstale":"2024-04-18T04:55:39.840777+0000","last_undegraded":"2024-04-18T04:55:39.840777+0000","last_fullsized":"2024-04-18T04:55:39.840777+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4755,"log_dups_size":0,"ondisk_log_size":4755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":69757,"num_write_kb":985522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"32'13","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:48.623621+0000","last_change":"2024-04-18T04:55:48.623813+0000","last_active":"2024-04-18T04:55:48.623621+0000","last_peered":"2024-04-18T04:55:48.623621+0000","last_clean":"2024-04-18T04:55:48.623621+0000","last_became_active":"2024-04-18T04:44:30.307168+0000","last_became_peered":"2024-04-18T04:44:30.307168+0000","last_unstale":"2024-04-18T04:55:48.623621+0000","last_undegraded":"2024-04-18T04:55:48.623621+0000","last_fullsized":"2024-04-18T04:55:48.623621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-04-18T04:55:48.623571+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-04-18T04:55:48.623571+0000","last_clean_scrub_stamp":"2024-04-18T04:55:48.623571+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:03:03.003462+0000","scrub_duration":0.053707861000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"32'12","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:49.458352+0000","last_change":"2024-04-18T04:55:49.458557+0000","last_active":"2024-04-18T04:55:49.458352+0000","last_peered":"2024-04-18T04:55:49.458352+0000","last_clean":"2024-04-18T04:55:49.458352+0000","last_became_active":"2024-04-18T04:44:29.902647+0000","last_became_peered":"2024-04-18T04:44:29.902647+0000","last_unstale":"2024-04-18T04:55:49.458352+0000","last_undegraded":"2024-04-18T04:55:49.458352+0000","last_fullsized":"2024-04-18T04:55:49.458352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-04-18T04:55:49.458295+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-04-18T04:55:49.458295+0000","last_clean_scrub_stamp":"2024-04-18T04:55:49.458295+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:59:11.252717+0000","scrub_duration":0.0067466690000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"32'5962","reported_seq":6003,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:05.799284+0000","last_change":"2024-04-18T04:56:05.799284+0000","last_active":"2024-04-18T04:56:05.799284+0000","last_peered":"2024-04-18T04:56:05.799284+0000","last_clean":"2024-04-18T04:56:05.799284+0000","last_became_active":"2024-04-18T04:44:34.338288+0000","last_became_peered":"2024-04-18T04:44:34.338288+0000","last_unstale":"2024-04-18T04:56:05.799284+0000","last_undegraded":"2024-04-18T04:56:05.799284+0000","last_fullsized":"2024-04-18T04:56:05.799284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5962","last_scrub_stamp":"2024-04-18T04:56:05.799140+0000","last_deep_scrub":"32'5962","last_deep_scrub_stamp":"2024-04-18T04:56:05.799140+0000","last_clean_scrub_stamp":"2024-04-18T04:56:05.799140+0000","objects_scrubbed":0,"log_size":5962,"log_dups_size":0,"ondisk_log_size":5962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:05:20.863879+0000","scrub_duration":0.142364307,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":87687,"num_write_kb":1229683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"32'4075","reported_seq":4104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.827148+0000","last_change":"2024-04-18T04:44:34.306999+0000","last_active":"2024-04-18T04:55:39.827148+0000","last_peered":"2024-04-18T04:55:39.827148+0000","last_clean":"2024-04-18T04:55:39.827148+0000","last_became_active":"2024-04-18T04:44:34.306657+0000","last_became_peered":"2024-04-18T04:44:34.306657+0000","last_unstale":"2024-04-18T04:55:39.827148+0000","last_undegraded":"2024-04-18T04:55:39.827148+0000","last_fullsized":"2024-04-18T04:55:39.827148+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4075,"log_dups_size":0,"ondisk_log_size":4075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":59702,"num_write_kb":838973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'14","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.695897+0000","last_change":"2024-04-18T04:55:34.435507+0000","last_active":"2024-04-18T04:55:39.695897+0000","last_peered":"2024-04-18T04:55:39.695897+0000","last_clean":"2024-04-18T04:55:39.695897+0000","last_became_active":"2024-04-18T04:44:30.271619+0000","last_became_peered":"2024-04-18T04:44:30.271619+0000","last_unstale":"2024-04-18T04:55:39.695897+0000","last_undegraded":"2024-04-18T04:55:39.695897+0000","last_fullsized":"2024-04-18T04:55:39.695897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-18T04:55:34.435387+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-18T04:55:34.435387+0000","last_clean_scrub_stamp":"2024-04-18T04:55:34.435387+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:54:07.144675+0000","scrub_duration":0.0023265299999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"32'54","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:43.553743+0000","last_change":"2024-04-18T04:55:43.553948+0000","last_active":"2024-04-18T04:55:43.553743+0000","last_peered":"2024-04-18T04:55:43.553743+0000","last_clean":"2024-04-18T04:55:43.553743+0000","last_became_active":"2024-04-18T04:44:29.889922+0000","last_became_peered":"2024-04-18T04:44:29.889922+0000","last_unstale":"2024-04-18T04:55:43.553743+0000","last_undegraded":"2024-04-18T04:55:43.553743+0000","last_fullsized":"2024-04-18T04:55:43.553743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'54","last_scrub_stamp":"2024-04-18T04:55:43.553684+0000","last_deep_scrub":"32'54","last_deep_scrub_stamp":"2024-04-18T04:55:43.553684+0000","last_clean_scrub_stamp":"2024-04-18T04:55:43.553684+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:19:01.902021+0000","scrub_duration":0.039263570999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":45,"num_write_kb":8216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4567","reported_seq":4599,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.755034+0000","last_change":"2024-04-18T04:44:34.333403+0000","last_active":"2024-04-18T04:55:39.755034+0000","last_peered":"2024-04-18T04:55:39.755034+0000","last_clean":"2024-04-18T04:55:39.755034+0000","last_became_active":"2024-04-18T04:44:34.332551+0000","last_became_peered":"2024-04-18T04:44:34.332551+0000","last_unstale":"2024-04-18T04:55:39.755034+0000","last_undegraded":"2024-04-18T04:55:39.755034+0000","last_fullsized":"2024-04-18T04:55:39.755034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4567,"log_dups_size":0,"ondisk_log_size":4567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":66761,"num_write_kb":945017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"32'16","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:57.643672+0000","last_change":"2024-04-18T04:55:57.643751+0000","last_active":"2024-04-18T04:55:57.643672+0000","last_peered":"2024-04-18T04:55:57.643672+0000","last_clean":"2024-04-18T04:55:57.643672+0000","last_became_active":"2024-04-18T04:44:30.270804+0000","last_became_peered":"2024-04-18T04:44:30.270804+0000","last_unstale":"2024-04-18T04:55:57.643672+0000","last_undegraded":"2024-04-18T04:55:57.643672+0000","last_fullsized":"2024-04-18T04:55:57.643672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-04-18T04:55:57.643654+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-04-18T04:55:57.643654+0000","last_clean_scrub_stamp":"2024-04-18T04:55:57.643654+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:23:05.773805+0000","scrub_duration":0.0013667989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"32'7","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:45.522305+0000","last_change":"2024-04-18T04:55:45.522393+0000","last_active":"2024-04-18T04:55:45.522305+0000","last_peered":"2024-04-18T04:55:45.522305+0000","last_clean":"2024-04-18T04:55:45.522305+0000","last_became_active":"2024-04-18T04:44:29.894829+0000","last_became_peered":"2024-04-18T04:44:29.894829+0000","last_unstale":"2024-04-18T04:55:45.522305+0000","last_undegraded":"2024-04-18T04:55:45.522305+0000","last_fullsized":"2024-04-18T04:55:45.522305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-04-18T04:55:45.522283+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-04-18T04:55:45.522283+0000","last_clean_scrub_stamp":"2024-04-18T04:55:45.522283+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:55:12.590156+0000","scrub_duration":0.004192093,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"32'11","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:48.487889+0000","last_change":"2024-04-18T04:55:48.488099+0000","last_active":"2024-04-18T04:55:48.487889+0000","last_peered":"2024-04-18T04:55:48.487889+0000","last_clean":"2024-04-18T04:55:48.487889+0000","last_became_active":"2024-04-18T04:44:29.892282+0000","last_became_peered":"2024-04-18T04:44:29.892282+0000","last_unstale":"2024-04-18T04:55:48.487889+0000","last_undegraded":"2024-04-18T04:55:48.487889+0000","last_fullsized":"2024-04-18T04:55:48.487889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-04-18T04:55:48.487833+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-04-18T04:55:48.487833+0000","last_clean_scrub_stamp":"2024-04-18T04:55:48.487833+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:31:55.892667+0000","scrub_duration":0.023028330999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":4108,"num_write":6,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"32'11","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:58.639049+0000","last_change":"2024-04-18T04:55:58.639159+0000","last_active":"2024-04-18T04:55:58.639049+0000","last_peered":"2024-04-18T04:55:58.639049+0000","last_clean":"2024-04-18T04:55:58.639049+0000","last_became_active":"2024-04-18T04:44:30.285055+0000","last_became_peered":"2024-04-18T04:44:30.285055+0000","last_unstale":"2024-04-18T04:55:58.639049+0000","last_undegraded":"2024-04-18T04:55:58.639049+0000","last_fullsized":"2024-04-18T04:55:58.639049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-04-18T04:55:58.639031+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-04-18T04:55:58.639031+0000","last_clean_scrub_stamp":"2024-04-18T04:55:58.639031+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:45:02.934723+0000","scrub_duration":0.025810151,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"32'4897","reported_seq":4935,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:57.202824+0000","last_change":"2024-04-18T04:55:57.203004+0000","last_active":"2024-04-18T04:55:57.202824+0000","last_peered":"2024-04-18T04:55:57.202824+0000","last_clean":"2024-04-18T04:55:57.202824+0000","last_became_active":"2024-04-18T04:44:34.321645+0000","last_became_peered":"2024-04-18T04:44:34.321645+0000","last_unstale":"2024-04-18T04:55:57.202824+0000","last_undegraded":"2024-04-18T04:55:57.202824+0000","last_fullsized":"2024-04-18T04:55:57.202824+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4897","last_scrub_stamp":"2024-04-18T04:55:57.202804+0000","last_deep_scrub":"32'4897","last_deep_scrub_stamp":"2024-04-18T04:55:57.202804+0000","last_clean_scrub_stamp":"2024-04-18T04:55:57.202804+0000","objects_scrubbed":0,"log_size":4897,"log_dups_size":0,"ondisk_log_size":4897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:56:34.996758+0000","scrub_duration":0.171972929,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":71816,"num_write_kb":1022773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"32'1268","reported_seq":1312,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:52.585584+0000","last_change":"2024-04-18T04:55:52.585682+0000","last_active":"2024-04-18T04:55:52.585584+0000","last_peered":"2024-04-18T04:55:52.585584+0000","last_clean":"2024-04-18T04:55:52.585584+0000","last_became_active":"2024-04-18T04:44:29.891610+0000","last_became_peered":"2024-04-18T04:44:29.891610+0000","last_unstale":"2024-04-18T04:55:52.585584+0000","last_undegraded":"2024-04-18T04:55:52.585584+0000","last_fullsized":"2024-04-18T04:55:52.585584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'1268","last_scrub_stamp":"2024-04-18T04:55:52.585564+0000","last_deep_scrub":"32'1268","last_deep_scrub_stamp":"2024-04-18T04:55:52.585564+0000","last_clean_scrub_stamp":"2024-04-18T04:55:52.585564+0000","objects_scrubbed":3,"log_size":1268,"log_dups_size":0,"ondisk_log_size":1268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:31:27.987253+0000","scrub_duration":0.029907377999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195509,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":4100,"num_write":1255,"num_write_kb":4235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"32'12","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:44.699287+0000","last_change":"2024-04-18T04:55:44.699508+0000","last_active":"2024-04-18T04:55:44.699287+0000","last_peered":"2024-04-18T04:55:44.699287+0000","last_clean":"2024-04-18T04:55:44.699287+0000","last_became_active":"2024-04-18T04:44:30.278275+0000","last_became_peered":"2024-04-18T04:44:30.278275+0000","last_unstale":"2024-04-18T04:55:44.699287+0000","last_undegraded":"2024-04-18T04:55:44.699287+0000","last_fullsized":"2024-04-18T04:55:44.699287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-04-18T04:55:44.699232+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-04-18T04:55:44.699232+0000","last_clean_scrub_stamp":"2024-04-18T04:55:44.699232+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:13:54.970200+0000","scrub_duration":0.026423889999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'4563","reported_seq":4590,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.818504+0000","last_change":"2024-04-18T04:44:34.313835+0000","last_active":"2024-04-18T04:55:39.818504+0000","last_peered":"2024-04-18T04:55:39.818504+0000","last_clean":"2024-04-18T04:55:39.818504+0000","last_became_active":"2024-04-18T04:44:34.313416+0000","last_became_peered":"2024-04-18T04:44:34.313416+0000","last_unstale":"2024-04-18T04:55:39.818504+0000","last_undegraded":"2024-04-18T04:55:39.818504+0000","last_fullsized":"2024-04-18T04:55:39.818504+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:33.267578+0000","last_clean_scrub_stamp":"2024-04-18T04:44:33.267578+0000","objects_scrubbed":0,"log_size":4563,"log_dups_size":0,"ondisk_log_size":4563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":66470,"num_write_kb":963599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"32'18","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:03.767422+0000","last_change":"2024-04-18T04:56:03.767628+0000","last_active":"2024-04-18T04:56:03.767422+0000","last_peered":"2024-04-18T04:56:03.767422+0000","last_clean":"2024-04-18T04:56:03.767422+0000","last_became_active":"2024-04-18T04:44:30.296354+0000","last_became_peered":"2024-04-18T04:44:30.296354+0000","last_unstale":"2024-04-18T04:56:03.767422+0000","last_undegraded":"2024-04-18T04:56:03.767422+0000","last_fullsized":"2024-04-18T04:56:03.767422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-04-18T04:56:03.767367+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-04-18T04:56:03.767367+0000","last_clean_scrub_stamp":"2024-04-18T04:56:03.767367+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:07:26.620900+0000","scrub_duration":0.0027217090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"32'15","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:54.114852+0000","last_change":"2024-04-18T04:55:54.114945+0000","last_active":"2024-04-18T04:55:54.114852+0000","last_peered":"2024-04-18T04:55:54.114852+0000","last_clean":"2024-04-18T04:55:54.114852+0000","last_became_active":"2024-04-18T04:44:30.280941+0000","last_became_peered":"2024-04-18T04:44:30.280941+0000","last_unstale":"2024-04-18T04:55:54.114852+0000","last_undegraded":"2024-04-18T04:55:54.114852+0000","last_fullsized":"2024-04-18T04:55:54.114852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-04-18T04:55:54.114832+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-04-18T04:55:54.114832+0000","last_clean_scrub_stamp":"2024-04-18T04:55:54.114832+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:50:26.893196+0000","scrub_duration":0.030107505,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"32'13","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:59.590726+0000","last_change":"2024-04-18T04:55:59.590895+0000","last_active":"2024-04-18T04:55:59.590726+0000","last_peered":"2024-04-18T04:55:59.590726+0000","last_clean":"2024-04-18T04:55:59.590726+0000","last_became_active":"2024-04-18T04:44:30.287820+0000","last_became_peered":"2024-04-18T04:44:30.287820+0000","last_unstale":"2024-04-18T04:55:59.590726+0000","last_undegraded":"2024-04-18T04:55:59.590726+0000","last_fullsized":"2024-04-18T04:55:59.590726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-04-18T04:55:59.590679+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-04-18T04:55:59.590679+0000","last_clean_scrub_stamp":"2024-04-18T04:55:59.590679+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:25:34.648377+0000","scrub_duration":0.0025947409999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"32'10","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.886393+0000","last_change":"2024-04-18T04:55:33.440693+0000","last_active":"2024-04-18T04:55:39.886393+0000","last_peered":"2024-04-18T04:55:39.886393+0000","last_clean":"2024-04-18T04:55:39.886393+0000","last_became_active":"2024-04-18T04:44:30.272973+0000","last_became_peered":"2024-04-18T04:44:30.272973+0000","last_unstale":"2024-04-18T04:55:39.886393+0000","last_undegraded":"2024-04-18T04:55:39.886393+0000","last_fullsized":"2024-04-18T04:55:39.886393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-04-18T04:55:33.440498+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-04-18T04:55:33.440498+0000","last_clean_scrub_stamp":"2024-04-18T04:55:33.440498+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:02:28.528382+0000","scrub_duration":0.0040422899999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'8","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.685954+0000","last_change":"2024-04-18T04:55:36.653343+0000","last_active":"2024-04-18T04:55:39.685954+0000","last_peered":"2024-04-18T04:55:39.685954+0000","last_clean":"2024-04-18T04:55:39.685954+0000","last_became_active":"2024-04-18T04:44:30.298637+0000","last_became_peered":"2024-04-18T04:44:30.298637+0000","last_unstale":"2024-04-18T04:55:39.685954+0000","last_undegraded":"2024-04-18T04:55:39.685954+0000","last_fullsized":"2024-04-18T04:55:39.685954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-18T04:55:36.653251+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-18T04:55:36.653251+0000","last_clean_scrub_stamp":"2024-04-18T04:55:36.653251+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:40:18.803560+0000","scrub_duration":0.0023708309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"32'10","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:01.419357+0000","last_change":"2024-04-18T04:56:01.419471+0000","last_active":"2024-04-18T04:56:01.419357+0000","last_peered":"2024-04-18T04:56:01.419357+0000","last_clean":"2024-04-18T04:56:01.419357+0000","last_became_active":"2024-04-18T04:44:30.274328+0000","last_became_peered":"2024-04-18T04:44:30.274328+0000","last_unstale":"2024-04-18T04:56:01.419357+0000","last_undegraded":"2024-04-18T04:56:01.419357+0000","last_fullsized":"2024-04-18T04:56:01.419357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-18T04:56:01.419337+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-18T04:56:01.419337+0000","last_clean_scrub_stamp":"2024-04-18T04:56:01.419337+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:38:14.078605+0000","scrub_duration":0.049311784999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"32'20","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:06.779295+0000","last_change":"2024-04-18T04:56:06.779491+0000","last_active":"2024-04-18T04:56:06.779295+0000","last_peered":"2024-04-18T04:56:06.779295+0000","last_clean":"2024-04-18T04:56:06.779295+0000","last_became_active":"2024-04-18T04:44:30.308415+0000","last_became_peered":"2024-04-18T04:44:30.308415+0000","last_unstale":"2024-04-18T04:56:06.779295+0000","last_undegraded":"2024-04-18T04:56:06.779295+0000","last_fullsized":"2024-04-18T04:56:06.779295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-04-18T04:56:06.779242+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-04-18T04:56:06.779242+0000","last_clean_scrub_stamp":"2024-04-18T04:56:06.779242+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:49:12.866749+0000","scrub_duration":0.0030912359999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"32'6","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:04.659801+0000","last_change":"2024-04-18T04:56:04.659916+0000","last_active":"2024-04-18T04:56:04.659801+0000","last_peered":"2024-04-18T04:56:04.659801+0000","last_clean":"2024-04-18T04:56:04.659801+0000","last_became_active":"2024-04-18T04:44:30.293748+0000","last_became_peered":"2024-04-18T04:44:30.293748+0000","last_unstale":"2024-04-18T04:56:04.659801+0000","last_undegraded":"2024-04-18T04:56:04.659801+0000","last_fullsized":"2024-04-18T04:56:04.659801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-18T04:56:04.659780+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-18T04:56:04.659780+0000","last_clean_scrub_stamp":"2024-04-18T04:56:04.659780+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:51:48.841753+0000","scrub_duration":0.034517979999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"32'9","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:01.013443+0000","last_change":"2024-04-18T04:56:01.013443+0000","last_active":"2024-04-18T04:56:01.013443+0000","last_peered":"2024-04-18T04:56:01.013443+0000","last_clean":"2024-04-18T04:56:01.013443+0000","last_became_active":"2024-04-18T04:45:12.040045+0000","last_became_peered":"2024-04-18T04:45:12.040045+0000","last_unstale":"2024-04-18T04:56:01.013443+0000","last_undegraded":"2024-04-18T04:56:01.013443+0000","last_fullsized":"2024-04-18T04:56:01.013443+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-18T04:56:01.013349+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-18T04:56:01.013349+0000","last_clean_scrub_stamp":"2024-04-18T04:56:01.013349+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:46:27.766760+0000","scrub_duration":0.0013506869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"32'12","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:56.662089+0000","last_change":"2024-04-18T04:55:56.662165+0000","last_active":"2024-04-18T04:55:56.662089+0000","last_peered":"2024-04-18T04:55:56.662089+0000","last_clean":"2024-04-18T04:55:56.662089+0000","last_became_active":"2024-04-18T04:44:30.285602+0000","last_became_peered":"2024-04-18T04:44:30.285602+0000","last_unstale":"2024-04-18T04:55:56.662089+0000","last_undegraded":"2024-04-18T04:55:56.662089+0000","last_fullsized":"2024-04-18T04:55:56.662089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-04-18T04:55:56.662070+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-04-18T04:55:56.662070+0000","last_clean_scrub_stamp":"2024-04-18T04:55:56.662070+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:04:03.410143+0000","scrub_duration":0.0061866239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"32'15","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:02.020651+0000","last_change":"2024-04-18T04:56:02.020729+0000","last_active":"2024-04-18T04:56:02.020651+0000","last_peered":"2024-04-18T04:56:02.020651+0000","last_clean":"2024-04-18T04:56:02.020651+0000","last_became_active":"2024-04-18T04:45:12.040023+0000","last_became_peered":"2024-04-18T04:45:12.040023+0000","last_unstale":"2024-04-18T04:56:02.020651+0000","last_undegraded":"2024-04-18T04:56:02.020651+0000","last_fullsized":"2024-04-18T04:56:02.020651+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-04-18T04:56:02.020632+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-04-18T04:56:02.020632+0000","last_clean_scrub_stamp":"2024-04-18T04:56:02.020632+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:25:27.584276+0000","scrub_duration":0.0028188739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"32'17","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:08.612146+0000","last_change":"2024-04-18T04:56:08.612246+0000","last_active":"2024-04-18T04:56:08.612146+0000","last_peered":"2024-04-18T04:56:08.612146+0000","last_clean":"2024-04-18T04:56:08.612146+0000","last_became_active":"2024-04-18T04:44:30.310045+0000","last_became_peered":"2024-04-18T04:44:30.310045+0000","last_unstale":"2024-04-18T04:56:08.612146+0000","last_undegraded":"2024-04-18T04:56:08.612146+0000","last_fullsized":"2024-04-18T04:56:08.612146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'17","last_scrub_stamp":"2024-04-18T04:56:08.612127+0000","last_deep_scrub":"32'17","last_deep_scrub_stamp":"2024-04-18T04:56:08.612127+0000","last_clean_scrub_stamp":"2024-04-18T04:56:08.612127+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:01:09.612979+0000","scrub_duration":0.026419456000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"32'11","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:56.595848+0000","last_change":"2024-04-18T04:55:56.596105+0000","last_active":"2024-04-18T04:55:56.595848+0000","last_peered":"2024-04-18T04:55:56.595848+0000","last_clean":"2024-04-18T04:55:56.595848+0000","last_became_active":"2024-04-18T04:44:30.304921+0000","last_became_peered":"2024-04-18T04:44:30.304921+0000","last_unstale":"2024-04-18T04:55:56.595848+0000","last_undegraded":"2024-04-18T04:55:56.595848+0000","last_fullsized":"2024-04-18T04:55:56.595848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-04-18T04:55:56.595793+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-04-18T04:55:56.595793+0000","last_clean_scrub_stamp":"2024-04-18T04:55:56.595793+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:57:37.876966+0000","scrub_duration":0.0035079680000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"32'12","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.793804+0000","last_change":"2024-04-18T04:55:38.737483+0000","last_active":"2024-04-18T04:55:39.793804+0000","last_peered":"2024-04-18T04:55:39.793804+0000","last_clean":"2024-04-18T04:55:39.793804+0000","last_became_active":"2024-04-18T04:44:30.291742+0000","last_became_peered":"2024-04-18T04:44:30.291742+0000","last_unstale":"2024-04-18T04:55:39.793804+0000","last_undegraded":"2024-04-18T04:55:39.793804+0000","last_fullsized":"2024-04-18T04:55:39.793804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-18T04:55:38.737212+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-18T04:55:38.737212+0000","last_clean_scrub_stamp":"2024-04-18T04:55:38.737212+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:18:26.020231+0000","scrub_duration":0.0047678599999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"32'19","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:48.186803+0000","last_change":"2024-04-18T04:55:48.186803+0000","last_active":"2024-04-18T04:55:48.186803+0000","last_peered":"2024-04-18T04:55:48.186803+0000","last_clean":"2024-04-18T04:55:48.186803+0000","last_became_active":"2024-04-18T04:44:30.296177+0000","last_became_peered":"2024-04-18T04:44:30.296177+0000","last_unstale":"2024-04-18T04:55:48.186803+0000","last_undegraded":"2024-04-18T04:55:48.186803+0000","last_fullsized":"2024-04-18T04:55:48.186803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2024-04-18T04:55:48.186704+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2024-04-18T04:55:48.186704+0000","last_clean_scrub_stamp":"2024-04-18T04:55:48.186704+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:20:47.516415+0000","scrub_duration":0.0024521629999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"32'11","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:58.716976+0000","last_change":"2024-04-18T04:55:58.716976+0000","last_active":"2024-04-18T04:55:58.716976+0000","last_peered":"2024-04-18T04:55:58.716976+0000","last_clean":"2024-04-18T04:55:58.716976+0000","last_became_active":"2024-04-18T04:44:30.305674+0000","last_became_peered":"2024-04-18T04:44:30.305674+0000","last_unstale":"2024-04-18T04:55:58.716976+0000","last_undegraded":"2024-04-18T04:55:58.716976+0000","last_fullsized":"2024-04-18T04:55:58.716976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-04-18T04:55:58.716755+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-04-18T04:55:58.716755+0000","last_clean_scrub_stamp":"2024-04-18T04:55:58.716755+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:44:30.198979+0000","scrub_duration":0.116453402,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"32'14","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:03.566376+0000","last_change":"2024-04-18T04:56:03.566376+0000","last_active":"2024-04-18T04:56:03.566376+0000","last_peered":"2024-04-18T04:56:03.566376+0000","last_clean":"2024-04-18T04:56:03.566376+0000","last_became_active":"2024-04-18T04:44:30.305470+0000","last_became_peered":"2024-04-18T04:44:30.305470+0000","last_unstale":"2024-04-18T04:56:03.566376+0000","last_undegraded":"2024-04-18T04:56:03.566376+0000","last_fullsized":"2024-04-18T04:56:03.566376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-04-18T04:56:03.566098+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-04-18T04:56:03.566098+0000","last_clean_scrub_stamp":"2024-04-18T04:56:03.566098+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:07:02.082666+0000","scrub_duration":0.0029455890000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"32'12","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:58.451968+0000","last_change":"2024-04-18T04:55:58.452095+0000","last_active":"2024-04-18T04:55:58.451968+0000","last_peered":"2024-04-18T04:55:58.451968+0000","last_clean":"2024-04-18T04:55:58.451968+0000","last_became_active":"2024-04-18T04:44:30.280535+0000","last_became_peered":"2024-04-18T04:44:30.280535+0000","last_unstale":"2024-04-18T04:55:58.451968+0000","last_undegraded":"2024-04-18T04:55:58.451968+0000","last_fullsized":"2024-04-18T04:55:58.451968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-04-18T04:55:58.451948+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-04-18T04:55:58.451948+0000","last_clean_scrub_stamp":"2024-04-18T04:55:58.451948+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:13:57.037061+0000","scrub_duration":0.028967124,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'11","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:06.620893+0000","last_change":"2024-04-18T04:56:06.620893+0000","last_active":"2024-04-18T04:56:06.620893+0000","last_peered":"2024-04-18T04:56:06.620893+0000","last_clean":"2024-04-18T04:56:06.620893+0000","last_became_active":"2024-04-18T04:44:30.278624+0000","last_became_peered":"2024-04-18T04:44:30.278624+0000","last_unstale":"2024-04-18T04:56:06.620893+0000","last_undegraded":"2024-04-18T04:56:06.620893+0000","last_fullsized":"2024-04-18T04:56:06.620893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-04-18T04:56:06.620761+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-04-18T04:56:06.620761+0000","last_clean_scrub_stamp":"2024-04-18T04:56:06.620761+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:12:07.973763+0000","scrub_duration":0.015897504999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"32'15","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.737363+0000","last_change":"2024-04-18T04:55:37.692128+0000","last_active":"2024-04-18T04:55:39.737363+0000","last_peered":"2024-04-18T04:55:39.737363+0000","last_clean":"2024-04-18T04:55:39.737363+0000","last_became_active":"2024-04-18T04:44:30.295754+0000","last_became_peered":"2024-04-18T04:44:30.295754+0000","last_unstale":"2024-04-18T04:55:39.737363+0000","last_undegraded":"2024-04-18T04:55:39.737363+0000","last_fullsized":"2024-04-18T04:55:39.737363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-04-18T04:55:37.691953+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-04-18T04:55:37.691953+0000","last_clean_scrub_stamp":"2024-04-18T04:55:37.691953+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:00:22.042260+0000","scrub_duration":0.042569443999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:47.662362+0000","last_change":"2024-04-18T04:55:47.662571+0000","last_active":"2024-04-18T04:55:47.662362+0000","last_peered":"2024-04-18T04:55:47.662362+0000","last_clean":"2024-04-18T04:55:47.662362+0000","last_became_active":"2024-04-18T04:44:30.297416+0000","last_became_peered":"2024-04-18T04:44:30.297416+0000","last_unstale":"2024-04-18T04:55:47.662362+0000","last_undegraded":"2024-04-18T04:55:47.662362+0000","last_fullsized":"2024-04-18T04:55:47.662362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-18T04:55:47.662310+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-18T04:55:47.662310+0000","last_clean_scrub_stamp":"2024-04-18T04:55:47.662310+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:55:53.708274+0000","scrub_duration":0.0036875200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"32'10","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:58.667066+0000","last_change":"2024-04-18T04:55:58.667309+0000","last_active":"2024-04-18T04:55:58.667066+0000","last_peered":"2024-04-18T04:55:58.667066+0000","last_clean":"2024-04-18T04:55:58.667066+0000","last_became_active":"2024-04-18T04:44:30.291939+0000","last_became_peered":"2024-04-18T04:44:30.291939+0000","last_unstale":"2024-04-18T04:55:58.667066+0000","last_undegraded":"2024-04-18T04:55:58.667066+0000","last_fullsized":"2024-04-18T04:55:58.667066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-18T04:55:58.667014+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-18T04:55:58.667014+0000","last_clean_scrub_stamp":"2024-04-18T04:55:58.667014+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:13:49.025145+0000","scrub_duration":0.064905824000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"32'21","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:07.831937+0000","last_change":"2024-04-18T04:56:07.832151+0000","last_active":"2024-04-18T04:56:07.831937+0000","last_peered":"2024-04-18T04:56:07.831937+0000","last_clean":"2024-04-18T04:56:07.831937+0000","last_became_active":"2024-04-18T04:44:30.307604+0000","last_became_peered":"2024-04-18T04:44:30.307604+0000","last_unstale":"2024-04-18T04:56:07.831937+0000","last_undegraded":"2024-04-18T04:56:07.831937+0000","last_fullsized":"2024-04-18T04:56:07.831937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-04-18T04:56:07.831882+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-04-18T04:56:07.831882+0000","last_clean_scrub_stamp":"2024-04-18T04:56:07.831882+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:41:39.311080+0000","scrub_duration":0.030838164000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"32'14","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:08.786432+0000","last_change":"2024-04-18T04:56:08.786712+0000","last_active":"2024-04-18T04:56:08.786432+0000","last_peered":"2024-04-18T04:56:08.786432+0000","last_clean":"2024-04-18T04:56:08.786432+0000","last_became_active":"2024-04-18T04:44:30.313985+0000","last_became_peered":"2024-04-18T04:44:30.313985+0000","last_unstale":"2024-04-18T04:56:08.786432+0000","last_undegraded":"2024-04-18T04:56:08.786432+0000","last_fullsized":"2024-04-18T04:56:08.786432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-04-18T04:56:08.786374+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-04-18T04:56:08.786374+0000","last_clean_scrub_stamp":"2024-04-18T04:56:08.786374+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:43:54.033410+0000","scrub_duration":0.045562271000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"32'11","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:02.652660+0000","last_change":"2024-04-18T04:56:02.652732+0000","last_active":"2024-04-18T04:56:02.652660+0000","last_peered":"2024-04-18T04:56:02.652660+0000","last_clean":"2024-04-18T04:56:02.652660+0000","last_became_active":"2024-04-18T04:44:30.309002+0000","last_became_peered":"2024-04-18T04:44:30.309002+0000","last_unstale":"2024-04-18T04:56:02.652660+0000","last_undegraded":"2024-04-18T04:56:02.652660+0000","last_fullsized":"2024-04-18T04:56:02.652660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-04-18T04:56:02.652642+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-04-18T04:56:02.652642+0000","last_clean_scrub_stamp":"2024-04-18T04:56:02.652642+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:29:26.197738+0000","scrub_duration":0.0021008340000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:16.718545+0000","last_change":"2024-04-18T04:56:16.718724+0000","last_active":"2024-04-18T04:56:16.718545+0000","last_peered":"2024-04-18T04:56:16.718545+0000","last_clean":"2024-04-18T04:56:16.718545+0000","last_became_active":"2024-04-18T04:44:30.290504+0000","last_became_peered":"2024-04-18T04:44:30.290504+0000","last_unstale":"2024-04-18T04:56:16.718545+0000","last_undegraded":"2024-04-18T04:56:16.718545+0000","last_fullsized":"2024-04-18T04:56:16.718545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-18T04:56:16.718485+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-18T04:56:16.718485+0000","last_clean_scrub_stamp":"2024-04-18T04:56:16.718485+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:59:18.755359+0000","scrub_duration":0.0024279430000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"32'10","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:10.531785+0000","last_change":"2024-04-18T04:56:10.531934+0000","last_active":"2024-04-18T04:56:10.531785+0000","last_peered":"2024-04-18T04:56:10.531785+0000","last_clean":"2024-04-18T04:56:10.531785+0000","last_became_active":"2024-04-18T04:44:30.290175+0000","last_became_peered":"2024-04-18T04:44:30.290175+0000","last_unstale":"2024-04-18T04:56:10.531785+0000","last_undegraded":"2024-04-18T04:56:10.531785+0000","last_fullsized":"2024-04-18T04:56:10.531785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-18T04:56:10.531747+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-18T04:56:10.531747+0000","last_clean_scrub_stamp":"2024-04-18T04:56:10.531747+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:09:29.049508+0000","scrub_duration":0.0028526049999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"32'7","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:15.754594+0000","last_change":"2024-04-18T04:56:15.754759+0000","last_active":"2024-04-18T04:56:15.754594+0000","last_peered":"2024-04-18T04:56:15.754594+0000","last_clean":"2024-04-18T04:56:15.754594+0000","last_became_active":"2024-04-18T04:44:30.288131+0000","last_became_peered":"2024-04-18T04:44:30.288131+0000","last_unstale":"2024-04-18T04:56:15.754594+0000","last_undegraded":"2024-04-18T04:56:15.754594+0000","last_fullsized":"2024-04-18T04:56:15.754594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-04-18T04:56:15.754547+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-04-18T04:56:15.754547+0000","last_clean_scrub_stamp":"2024-04-18T04:56:15.754547+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:59:00.647127+0000","scrub_duration":0.072162940999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"32'11","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.592904+0000","last_change":"2024-04-18T04:55:39.585898+0000","last_active":"2024-04-18T04:55:39.592904+0000","last_peered":"2024-04-18T04:55:39.592904+0000","last_clean":"2024-04-18T04:55:39.592904+0000","last_became_active":"2024-04-18T04:44:30.287325+0000","last_became_peered":"2024-04-18T04:44:30.287325+0000","last_unstale":"2024-04-18T04:55:39.592904+0000","last_undegraded":"2024-04-18T04:55:39.592904+0000","last_fullsized":"2024-04-18T04:55:39.592904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-18T04:55:39.585750+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-18T04:55:39.585750+0000","last_clean_scrub_stamp":"2024-04-18T04:55:39.585750+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:50:34.983543+0000","scrub_duration":0.0086941710000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"32'8","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:07.660037+0000","last_change":"2024-04-18T04:56:07.660141+0000","last_active":"2024-04-18T04:56:07.660037+0000","last_peered":"2024-04-18T04:56:07.660037+0000","last_clean":"2024-04-18T04:56:07.660037+0000","last_became_active":"2024-04-18T04:44:30.275118+0000","last_became_peered":"2024-04-18T04:44:30.275118+0000","last_unstale":"2024-04-18T04:56:07.660037+0000","last_undegraded":"2024-04-18T04:56:07.660037+0000","last_fullsized":"2024-04-18T04:56:07.660037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-18T04:56:07.660018+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-18T04:56:07.660018+0000","last_clean_scrub_stamp":"2024-04-18T04:56:07.660018+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:23:11.114701+0000","scrub_duration":0.058651572999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"32'4","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:00.427204+0000","last_change":"2024-04-18T04:56:00.427301+0000","last_active":"2024-04-18T04:56:00.427204+0000","last_peered":"2024-04-18T04:56:00.427204+0000","last_clean":"2024-04-18T04:56:00.427204+0000","last_became_active":"2024-04-18T04:44:30.276654+0000","last_became_peered":"2024-04-18T04:44:30.276654+0000","last_unstale":"2024-04-18T04:56:00.427204+0000","last_undegraded":"2024-04-18T04:56:00.427204+0000","last_fullsized":"2024-04-18T04:56:00.427204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-18T04:56:00.427184+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-18T04:56:00.427184+0000","last_clean_scrub_stamp":"2024-04-18T04:56:00.427184+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:15:37.992228+0000","scrub_duration":0.029663450000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"32'12","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:38.253919+0000","last_change":"2024-04-18T04:44:30.302905+0000","last_active":"2024-04-18T04:55:38.253919+0000","last_peered":"2024-04-18T04:55:38.253919+0000","last_clean":"2024-04-18T04:55:38.253919+0000","last_became_active":"2024-04-18T04:44:30.302180+0000","last_became_peered":"2024-04-18T04:44:30.302180+0000","last_unstale":"2024-04-18T04:55:38.253919+0000","last_undegraded":"2024-04-18T04:55:38.253919+0000","last_fullsized":"2024-04-18T04:55:38.253919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T04:44:29.850188+0000","last_clean_scrub_stamp":"2024-04-18T04:44:29.850188+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":11,"num_write":2195132,"num_write_kb":31163048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149947,"ondisk_log_size":149947,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":739,"ondisk_log_size":739,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":81164485,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":422,"num_read_kb":74892,"num_write":3467,"num_write_kb":80225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27954,"num_omap_keys":54,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":37855232,"data_stored":162328970,"data_compressed":18251382,"data_compressed_allocated":21430272,"data_compressed_original":146063360,"omap_allocated":0,"internal_metadata":0},"log_size":3546,"ondisk_log_size":3546,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66624,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509584,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":993936,"kb_used_data":6920,"kb_used_omap":1,"kb_used_meta":987006,"kb_avail":93377904,"statfs":{"total":96636764160,"available":95618973696,"internally_reserved":0,"allocated":7086080,"data_stored":17021899,"data_compressed":1734435,"data_compressed_allocated":2166784,"data_compressed_original":12316672,"omap_allocated":1592,"internal_metadata":1010694600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:55:43 2024","interfaces":[{"interface":"back","average":{"1min":2.04,"5min":5.1870000000000003,"15min":3.4540000000000002},"min":{"1min":0.29199999999999998,"5min":0.26200000000000001,"15min":0.252},"max":{"1min":9.3330000000000002,"5min":76.096999999999994,"15min":76.096999999999994},"last":0.29099999999999998},{"interface":"front","average":{"1min":2.1000000000000001,"5min":7.3920000000000003,"15min":3.8599999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":9.5879999999999992,"5min":184.16999999999999,"15min":184.16999999999999},"last":0.42199999999999999}]},{"osd":1,"last update":"Thu Apr 18 04:55:43 2024","interfaces":[{"interface":"back","average":{"1min":2.577,"5min":6.6239999999999997,"15min":4.4909999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.24299999999999999},"max":{"1min":14.954000000000001,"5min":85.109999999999999,"15min":153.59299999999999},"last":0.32200000000000001},{"interface":"front","average":{"1min":3.1949999999999998,"5min":5.7999999999999998,"15min":4.2220000000000004},"min":{"1min":0.38,"5min":0.35299999999999998,"15min":0.29199999999999998},"max":{"1min":19.210999999999999,"5min":88.606999999999999,"15min":153.94300000000001},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Apr 18 04:55:43 2024","interfaces":[{"interface":"back","average":{"1min":2.198,"5min":3.202,"15min":2.754},"min":{"1min":0.34999999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":9.0220000000000002,"5min":23.867000000000001,"15min":162.59700000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":2.1440000000000001,"5min":3.8159999999999998,"15min":3.0659999999999998},"min":{"1min":0.41899999999999998,"5min":0.309,"15min":0.309},"max":{"1min":8.3670000000000009,"5min":22.957999999999998,"15min":153.83500000000001},"last":0.51200000000000001}]},{"osd":4,"last update":"Thu Apr 18 04:55:43 2024","interfaces":[{"interface":"back","average":{"1min":2.7490000000000001,"5min":2.552,"15min":1.8740000000000001},"min":{"1min":0.54100000000000004,"5min":0.43099999999999999,"15min":0.40000000000000002},"max":{"1min":29.809999999999999,"5min":29.809999999999999,"15min":31.974},"last":0.93300000000000005},{"interface":"front","average":{"1min":3.0219999999999998,"5min":4.4900000000000002,"15min":2.8620000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":29.777999999999999,"5min":50.536000000000001,"15min":50.536000000000001},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Apr 18 04:55:43 2024","interfaces":[{"interface":"back","average":{"1min":3.0219999999999998,"5min":3.4740000000000002,"15min":2.4740000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":27.469000000000001,"5min":29.539999999999999,"15min":40.915999999999997},"last":0.64700000000000002},{"interface":"front","average":{"1min":3.0169999999999999,"5min":2.774,"15min":2.1150000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.41899999999999998},"max":{"1min":28.256,"5min":28.256,"15min":68.370000000000005},"last":0.752}]},{"osd":6,"last update":"Thu Apr 18 04:55:43 2024","interfaces":[{"interface":"back","average":{"1min":1.992,"5min":3.0150000000000001,"15min":2.3109999999999999},"min":{"1min":0.47999999999999998,"5min":0.45100000000000001,"15min":0.39900000000000002},"max":{"1min":9.3699999999999992,"5min":23.579999999999998,"15min":48.765000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.631,"5min":4.1749999999999998,"15min":2.6440000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.38900000000000001},"max":{"1min":8.5619999999999994,"5min":69.227999999999994,"15min":69.227999999999994},"last":0.88300000000000001}]},{"osd":7,"last update":"Thu Apr 18 04:55:43 2024","interfaces":[{"interface":"back","average":{"1min":1.915,"5min":2.633,"15min":2.1720000000000002},"min":{"1min":0.56599999999999995,"5min":0.48899999999999999,"15min":0.44700000000000001},"max":{"1min":8.4960000000000004,"5min":18.795000000000002,"15min":40.947000000000003},"last":0.76900000000000002},{"interface":"front","average":{"1min":1.994,"5min":3.1269999999999998,"15min":2.2959999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":9.4320000000000004,"5min":19.512,"15min":68.329999999999998},"last":0.70899999999999996}]}]},{"osd":2,"up_from":15,"seq":64424509585,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":556140,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":554430,"kb_avail":93815700,"statfs":{"total":96636764160,"available":96067276800,"internally_reserved":0,"allocated":1740800,"data_stored":4437838,"data_compressed":439103,"data_compressed_allocated":598016,"data_compressed_original":3510272,"omap_allocated":1594,"internal_metadata":567736774},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:55:37 2024","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":3.512,"15min":3.4159999999999999},"min":{"1min":0.30299999999999999,"5min":0.28699999999999998,"15min":0.23300000000000001},"max":{"1min":5.5529999999999999,"5min":30.396999999999998,"15min":120.402},"last":0.28799999999999998},{"interface":"front","average":{"1min":1.165,"5min":4.6600000000000001,"15min":3.3700000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.28899999999999998},"max":{"1min":5.1159999999999997,"5min":58.277999999999999,"15min":121.377},"last":0.36599999999999999}]},{"osd":1,"last update":"Thu Apr 18 04:55:37 2024","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":4.5439999999999996,"15min":3.823},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.28399999999999997},"max":{"1min":7.0899999999999999,"5min":62.851999999999997,"15min":135.32400000000001},"last":0.30499999999999999},{"interface":"front","average":{"1min":2.359,"5min":4.7889999999999997,"15min":3.9590000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.27600000000000002},"max":{"1min":8.3480000000000008,"5min":60.741999999999997,"15min":178.08199999999999},"last":0.45100000000000001}]},{"osd":3,"last update":"Thu Apr 18 04:55:37 2024","interfaces":[{"interface":"back","average":{"1min":2.0619999999999998,"5min":4.1980000000000004,"15min":3.2509999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.35999999999999999},"max":{"1min":10.42,"5min":65.037000000000006,"15min":124.76300000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":3.0249999999999999,"5min":4.7030000000000003,"15min":3.6640000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.33000000000000002},"max":{"1min":22.298999999999999,"5min":70.861999999999995,"15min":145.47200000000001},"last":0.38700000000000001}]},{"osd":4,"last update":"Thu Apr 18 04:55:37 2024","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":2.7639999999999998,"15min":2.335},"min":{"1min":0.51200000000000001,"5min":0.45200000000000001,"15min":0.35299999999999998},"max":{"1min":5.4420000000000002,"5min":14.388999999999999,"15min":37.420000000000002},"last":0.60899999999999999},{"interface":"front","average":{"1min":1.6220000000000001,"5min":2.7200000000000002,"15min":2.2269999999999999},"min":{"1min":0.48099999999999998,"5min":0.42999999999999999,"15min":0.42699999999999999},"max":{"1min":6.8719999999999999,"5min":14.356999999999999,"15min":37.460000000000001},"last":0.78800000000000003}]},{"osd":5,"last update":"Thu Apr 18 04:55:37 2024","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":2.8340000000000001,"15min":2.1619999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.32700000000000001},"max":{"1min":6.2869999999999999,"5min":14.244,"15min":37.5},"last":0.66500000000000004},{"interface":"front","average":{"1min":1.657,"5min":2.8250000000000002,"15min":2.1779999999999999},"min":{"1min":0.56599999999999995,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":6.2489999999999997,"5min":28.143000000000001,"15min":28.143000000000001},"last":0.80700000000000005}]},{"osd":6,"last update":"Thu Apr 18 04:55:37 2024","interfaces":[{"interface":"back","average":{"1min":1.617,"5min":2.7130000000000001,"15min":2.2989999999999999},"min":{"1min":0.54900000000000004,"5min":0.47499999999999998,"15min":0.441},"max":{"1min":6.3289999999999997,"5min":11.337,"15min":34.506999999999998},"last":0.754},{"interface":"front","average":{"1min":1.7689999999999999,"5min":2.8159999999999998,"15min":2.3450000000000002},"min":{"1min":0.504,"5min":0.46999999999999997,"15min":0.44800000000000001},"max":{"1min":6.8259999999999996,"5min":14.285,"15min":37.533000000000001},"last":0.65400000000000003}]},{"osd":7,"last update":"Thu Apr 18 04:55:37 2024","interfaces":[{"interface":"back","average":{"1min":2.008,"5min":2.8109999999999999,"15min":2.137},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.39800000000000002},"max":{"1min":6.8710000000000004,"5min":12.914999999999999,"15min":24.155000000000001},"last":0.622},{"interface":"front","average":{"1min":2.052,"5min":2.7330000000000001,"15min":2.2010000000000001},"min":{"1min":0.68300000000000005,"5min":0.52800000000000002,"15min":0.46899999999999997},"max":{"1min":6.9009999999999998,"5min":26.064,"15min":34.576999999999998},"last":0.70999999999999996}]}]},{"osd":1,"up_from":15,"seq":64424509583,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1000120,"kb_used_data":3440,"kb_used_omap":1,"kb_used_meta":996670,"kb_avail":93371720,"statfs":{"total":96636764160,"available":95612641280,"internally_reserved":0,"allocated":3522560,"data_stored":21124827,"data_compressed":2531508,"data_compressed_allocated":2936832,"data_compressed_original":20754432,"omap_allocated":1594,"internal_metadata":1020590534},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:55:42 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":3.8340000000000001,"15min":3.383},"min":{"1min":0.26400000000000001,"5min":0.22,"15min":0.22},"max":{"1min":4.5839999999999996,"5min":32.177,"15min":124.096},"last":0.40300000000000002},{"interface":"front","average":{"1min":1.395,"5min":6.4779999999999998,"15min":4.117},"min":{"1min":0.29699999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":6.6260000000000003,"5min":143.60300000000001,"15min":164.41},"last":0.44500000000000001}]},{"osd":2,"last update":"Thu Apr 18 04:55:42 2024","interfaces":[{"interface":"back","average":{"1min":7.3040000000000003,"5min":5.0350000000000001,"15min":6.3550000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.29299999999999998},"max":{"1min":108.968,"5min":108.968,"15min":840.66700000000003},"last":0.28799999999999998},{"interface":"front","average":{"1min":7.1669999999999998,"5min":6.5599999999999996,"15min":4.1550000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":109.02800000000001,"5min":114.47199999999999,"15min":164.477},"last":0.43099999999999999}]},{"osd":3,"last update":"Thu Apr 18 04:55:42 2024","interfaces":[{"interface":"back","average":{"1min":9.4390000000000001,"5min":7.1669999999999998,"15min":5.3319999999999999},"min":{"1min":0.39100000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":135.86099999999999,"5min":135.86099999999999,"15min":164.50299999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":9.2579999999999991,"5min":8.4800000000000004,"15min":5.4039999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.36899999999999999},"max":{"1min":136.69300000000001,"5min":151.82599999999999,"15min":151.82599999999999},"last":0.47599999999999998}]},{"osd":4,"last update":"Thu Apr 18 04:55:42 2024","interfaces":[{"interface":"back","average":{"1min":1.845,"5min":3.4159999999999999,"15min":2.6949999999999998},"min":{"1min":0.42299999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":10.134,"5min":23.478999999999999,"15min":52.072000000000003},"last":0.56799999999999995},{"interface":"front","average":{"1min":2.0579999999999998,"5min":3.7200000000000002,"15min":5.6299999999999999},"min":{"1min":0.41799999999999998,"5min":0.40799999999999997,"15min":0.34399999999999997},"max":{"1min":13.097,"5min":33.017000000000003,"15min":840.61500000000001},"last":0.72199999999999998}]},{"osd":5,"last update":"Thu Apr 18 04:55:42 2024","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":5.1559999999999997,"15min":4.6130000000000004},"min":{"1min":0.627,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":4.2960000000000003,"5min":114.37,"15min":478.47000000000003},"last":0.63400000000000001},{"interface":"front","average":{"1min":1.5980000000000001,"5min":3.6269999999999998,"15min":3.1269999999999998},"min":{"1min":0.745,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":5.194,"5min":41.832000000000001,"15min":164.374},"last":0.80400000000000005}]},{"osd":6,"last update":"Thu Apr 18 04:55:42 2024","interfaces":[{"interface":"back","average":{"1min":1.966,"5min":3.5249999999999999,"15min":2.8029999999999999},"min":{"1min":0.50600000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":14.938000000000001,"5min":23.416,"15min":52.100999999999999},"last":0.623},{"interface":"front","average":{"1min":1.6499999999999999,"5min":3.3410000000000002,"15min":3.8199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.438},"max":{"1min":5.5049999999999999,"5min":18.951000000000001,"15min":396.81},"last":0.746}]},{"osd":7,"last update":"Thu Apr 18 04:55:42 2024","interfaces":[{"interface":"back","average":{"1min":2.1949999999999998,"5min":5.2370000000000001,"15min":3.6579999999999999},"min":{"1min":0.73399999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":10.177,"5min":100.565,"15min":164.447},"last":0.59299999999999997},{"interface":"front","average":{"1min":2.476,"5min":3.581,"15min":2.7919999999999998},"min":{"1min":0.55800000000000005,"5min":0.46200000000000002,"15min":0.45400000000000001},"max":{"1min":13.156000000000001,"5min":23.648,"15min":54.353000000000002},"last":0.82699999999999996}]}]},{"osd":7,"up_from":14,"seq":60129542292,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":687992,"kb_used_data":10544,"kb_used_omap":1,"kb_used_meta":677438,"kb_avail":93683848,"statfs":{"total":96636764160,"available":95932260352,"internally_reserved":0,"allocated":10797056,"data_stored":35675430,"data_compressed":3619092,"data_compressed_allocated":4272128,"data_compressed_original":29368320,"omap_allocated":1589,"internal_metadata":693696971},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:55:30 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":5.391,"15min":3.7480000000000002},"min":{"1min":0.29099999999999998,"5min":0.249,"15min":0.249},"max":{"1min":6.2889999999999997,"5min":195.89500000000001,"15min":287.19600000000003},"last":0.56799999999999995},{"interface":"front","average":{"1min":1.724,"5min":5.8419999999999996,"15min":4.1289999999999996},"min":{"1min":0.31900000000000001,"5min":0.26800000000000002,"15min":0.26200000000000001},"max":{"1min":6.5590000000000002,"5min":196.149,"15min":289.23899999999998},"last":0.621}]},{"osd":1,"last update":"Thu Apr 18 04:55:49 2024","interfaces":[{"interface":"back","average":{"1min":1.7989999999999999,"5min":3.8570000000000002,"15min":3.613},"min":{"1min":0.33400000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":9.5960000000000001,"5min":90.055000000000007,"15min":303.83800000000002},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.9330000000000001,"5min":4.0019999999999998,"15min":3.7349999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32000000000000001},"max":{"1min":9.5800000000000001,"5min":90.001999999999995,"15min":288.05799999999999},"last":0.84599999999999997}]},{"osd":2,"last update":"Thu Apr 18 04:55:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":3.532,"15min":2.2989999999999999},"min":{"1min":0.36399999999999999,"5min":0.35599999999999998,"15min":0.30099999999999999},"max":{"1min":4.7110000000000003,"5min":91.088999999999999,"15min":91.088999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.0720000000000001,"5min":3.0169999999999999,"15min":1.879},"min":{"1min":0.51600000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":3.7330000000000001,"5min":91.171999999999997,"15min":91.171999999999997},"last":0.67800000000000005}]},{"osd":3,"last update":"Thu Apr 18 04:55:49 2024","interfaces":[{"interface":"back","average":{"1min":1.9399999999999999,"5min":3.992,"15min":3.8599999999999999},"min":{"1min":0.48999999999999999,"5min":0.34300000000000003,"15min":0.30199999999999999},"max":{"1min":11.148999999999999,"5min":89.393000000000001,"15min":308.36700000000002},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.3899999999999999,"5min":3.411,"15min":3.198},"min":{"1min":0.39200000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":6.5259999999999998,"5min":88.070999999999998,"15min":289.86099999999999},"last":0.999}]},{"osd":4,"last update":"Thu Apr 18 04:55:30 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":1.333,"15min":1.1559999999999999},"min":{"1min":0.317,"5min":0.25900000000000001,"15min":0.252},"max":{"1min":1.627,"5min":41.567,"15min":41.567},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.91700000000000004,"5min":1.4099999999999999,"15min":1.141},"min":{"1min":0.34699999999999998,"5min":0.29699999999999999,"15min":0.247},"max":{"1min":3.8860000000000001,"5min":45.646000000000001,"15min":45.646000000000001},"last":1.095}]},{"osd":5,"last update":"Thu Apr 18 04:55:30 2024","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.538,"15min":1.1859999999999999},"min":{"1min":0.30499999999999999,"5min":0.27000000000000002,"15min":0.26600000000000001},"max":{"1min":11.045,"5min":41.595999999999997,"15min":41.595999999999997},"last":1.157},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.155,"15min":1.048},"min":{"1min":0.36199999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":11.082000000000001,"5min":15.271000000000001,"15min":15.271000000000001},"last":1.054}]},{"osd":6,"last update":"Thu Apr 18 04:55:30 2024","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.1140000000000001,"15min":1.016},"min":{"1min":0.32000000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":6.3520000000000003,"5min":8.2390000000000008,"15min":8.2390000000000008},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.016,"5min":1.1379999999999999,"15min":1.069},"min":{"1min":0.34399999999999997,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":6.2329999999999997,"5min":11.288,"15min":11.288},"last":1.1950000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542290,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":809816,"kb_used_data":3728,"kb_used_omap":1,"kb_used_meta":806078,"kb_avail":93562024,"statfs":{"total":96636764160,"available":95807512576,"internally_reserved":0,"allocated":3817472,"data_stored":16932052,"data_compressed":2087260,"data_compressed_allocated":2478080,"data_compressed_original":15798272,"omap_allocated":1593,"internal_metadata":825424327},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:55:38 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":2.6560000000000001,"15min":1.6799999999999999},"min":{"1min":0.34499999999999997,"5min":0.247,"15min":0.247},"max":{"1min":3.1579999999999999,"5min":99.328999999999994,"15min":99.328999999999994},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.99299999999999999,"5min":2.7160000000000002,"15min":2.198},"min":{"1min":0.42599999999999999,"5min":0.311,"15min":0.309},"max":{"1min":3.202,"5min":99.287000000000006,"15min":99.287000000000006},"last":0.72899999999999998}]},{"osd":1,"last update":"Thu Apr 18 04:55:38 2024","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":4.593,"15min":2.855},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":5.3890000000000002,"5min":122.06999999999999,"15min":122.06999999999999},"last":0.87},{"interface":"front","average":{"1min":0.97299999999999998,"5min":4.1230000000000002,"15min":2.6899999999999999},"min":{"1min":0.33700000000000002,"5min":0.33300000000000002,"15min":0.32800000000000001},"max":{"1min":5.4009999999999998,"5min":122.09,"15min":122.09},"last":0.82499999999999996}]},{"osd":2,"last update":"Thu Apr 18 04:55:38 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":2.5379999999999998,"15min":1.835},"min":{"1min":0.40000000000000002,"5min":0.31,"15min":0.31},"max":{"1min":2.9129999999999998,"5min":38.557000000000002,"15min":41.764000000000003},"last":0.56100000000000005},{"interface":"front","average":{"1min":1.4259999999999999,"5min":2.5950000000000002,"15min":1.9259999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":12.701000000000001,"5min":35.734000000000002,"15min":41.710000000000001},"last":0.77200000000000002}]},{"osd":3,"last update":"Thu Apr 18 04:55:38 2024","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":3.7669999999999999,"15min":2.948},"min":{"1min":0.38700000000000001,"5min":0.312,"15min":0.29999999999999999},"max":{"1min":9.2970000000000006,"5min":101.006,"15min":101.006},"last":0.69299999999999995},{"interface":"front","average":{"1min":1.6220000000000001,"5min":3.8250000000000002,"15min":3.032},"min":{"1min":0.44500000000000001,"5min":0.42499999999999999,"15min":0.42199999999999999},"max":{"1min":9.3840000000000003,"5min":101.039,"15min":101.039},"last":0.92300000000000004}]},{"osd":4,"last update":"Thu Apr 18 04:55:38 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":1.569,"15min":1.147},"min":{"1min":0.28199999999999997,"5min":0.217,"15min":0.217},"max":{"1min":2.1059999999999999,"5min":19.481999999999999,"15min":19.481999999999999},"last":0.995},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.681,"15min":1.2370000000000001},"min":{"1min":0.36799999999999999,"5min":0.28199999999999997,"15min":0.26400000000000001},"max":{"1min":2.8090000000000002,"5min":19.536999999999999,"15min":19.536999999999999},"last":0.97299999999999998}]},{"osd":5,"last update":"Thu Apr 18 04:55:38 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.82999999999999996,"15min":1.0089999999999999},"min":{"1min":0.312,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.6619999999999999,"5min":7.7720000000000002,"15min":13.538},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.89600000000000002,"15min":0.93500000000000005},"min":{"1min":0.30399999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.728,"5min":7.4950000000000001,"15min":8.7210000000000001},"last":1.0640000000000001}]},{"osd":7,"last update":"Thu Apr 18 04:55:38 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.94499999999999995,"15min":1.0429999999999999},"min":{"1min":0.33300000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.696,"5min":7.5359999999999996,"15min":7.5359999999999996},"last":1.107},{"interface":"front","average":{"1min":0.84899999999999998,"5min":1.006,"15min":1.018},"min":{"1min":0.34399999999999997,"5min":0.33900000000000002,"15min":0.314},"max":{"1min":2.887,"5min":10.955,"15min":10.955},"last":0.95099999999999996}]}]},{"osd":5,"up_from":14,"seq":60129542292,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":620212,"kb_used_data":3500,"kb_used_omap":1,"kb_used_meta":616702,"kb_avail":93751628,"statfs":{"total":96636764160,"available":96001667072,"internally_reserved":0,"allocated":3584000,"data_stored":18307325,"data_compressed":2174151,"data_compressed_allocated":2514944,"data_compressed_original":17453056,"omap_allocated":1593,"internal_metadata":631503303},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:55:40 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":3.7040000000000002,"15min":2.363},"min":{"1min":0.28299999999999997,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":3.8319999999999999,"5min":84.305000000000007,"15min":84.305000000000007},"last":0.53400000000000003},{"interface":"front","average":{"1min":1.3540000000000001,"5min":3.6739999999999999,"15min":4.4790000000000001},"min":{"1min":0.34200000000000003,"5min":0.252,"15min":0.252},"max":{"1min":4.7800000000000002,"5min":86.994,"15min":553.95500000000004},"last":0.75800000000000001}]},{"osd":1,"last update":"Thu Apr 18 04:55:40 2024","interfaces":[{"interface":"back","average":{"1min":8.5050000000000008,"5min":5.9530000000000003,"15min":5.1929999999999996},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":178.01499999999999,"5min":178.01499999999999,"15min":553.36900000000003},"last":0.58599999999999997},{"interface":"front","average":{"1min":8.9000000000000004,"5min":5.9660000000000002,"15min":4.8419999999999996},"min":{"1min":0.31900000000000001,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":177.964,"5min":177.964,"15min":501.11000000000001},"last":0.92700000000000005}]},{"osd":2,"last update":"Thu Apr 18 04:55:40 2024","interfaces":[{"interface":"back","average":{"1min":1.778,"5min":3.98,"15min":3.1920000000000002},"min":{"1min":0.442,"5min":0.35699999999999998,"15min":0.29799999999999999},"max":{"1min":5.2839999999999998,"5min":123.048,"15min":262.99700000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.0049999999999999,"5min":4.0529999999999999,"15min":3.3119999999999998},"min":{"1min":0.39900000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":3.7519999999999998,"5min":125.04900000000001,"15min":259.24099999999999},"last":0.78900000000000003}]},{"osd":3,"last update":"Thu Apr 18 04:55:40 2024","interfaces":[{"interface":"back","average":{"1min":9.7750000000000004,"5min":5.9390000000000001,"15min":3.2040000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.34200000000000003},"max":{"1min":176.523,"5min":176.523,"15min":176.523},"last":0.63700000000000001},{"interface":"front","average":{"1min":9.2520000000000007,"5min":5.8250000000000002,"15min":3.4279999999999999},"min":{"1min":0.379,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":176.41999999999999,"5min":176.41999999999999,"15min":176.41999999999999},"last":0.70899999999999996}]},{"osd":4,"last update":"Thu Apr 18 04:55:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.754,"15min":0.81499999999999995},"min":{"1min":0.26300000000000001,"5min":0.246,"15min":0.246},"max":{"1min":1.8959999999999999,"5min":4.6440000000000001,"15min":4.6440000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":1.214,"15min":1.038},"min":{"1min":0.30099999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.9219999999999999,"5min":12.888999999999999,"15min":12.888999999999999},"last":0.97599999999999998}]},{"osd":6,"last update":"Thu Apr 18 04:55:40 2024","interfaces":[{"interface":"back","average":{"1min":3.181,"5min":1.222,"15min":1.018},"min":{"1min":0.317,"5min":0.28000000000000003,"15min":0.252},"max":{"1min":58.222000000000001,"5min":58.222000000000001,"15min":58.222000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":3.3500000000000001,"5min":1.522,"15min":1.1339999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":58.314999999999998,"5min":58.314999999999998,"15min":58.314999999999998},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Apr 18 04:55:40 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.90700000000000003,"15min":0.98699999999999999},"min":{"1min":0.27000000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.3200000000000001,"5min":12.74,"15min":12.74},"last":1.008},{"interface":"front","average":{"1min":0.86599999999999999,"5min":1.0800000000000001,"15min":1.0269999999999999},"min":{"1min":0.33900000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":4.101,"5min":27.658000000000001,"15min":27.658000000000001},"last":1.1040000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542292,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":754032,"kb_used_data":6504,"kb_used_omap":1,"kb_used_meta":747518,"kb_avail":93617808,"statfs":{"total":96636764160,"available":95864635392,"internally_reserved":0,"allocated":6660096,"data_stored":29514328,"data_compressed":3215159,"data_compressed_allocated":3665920,"data_compressed_original":26726400,"omap_allocated":1594,"internal_metadata":765458886},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:55:39 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":5.4530000000000003,"15min":2.819},"min":{"1min":0.27400000000000002,"5min":0.25700000000000001,"15min":0.254},"max":{"1min":1.9299999999999999,"5min":148.048,"15min":148.048},"last":0.63700000000000001},{"interface":"front","average":{"1min":1.206,"5min":5.1120000000000001,"15min":2.8969999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":5.8499999999999996,"5min":144.72999999999999,"15min":144.72999999999999},"last":0.60999999999999999}]},{"osd":1,"last update":"Thu Apr 18 04:55:39 2024","interfaces":[{"interface":"back","average":{"1min":1.9830000000000001,"5min":6.9020000000000001,"15min":4.1210000000000004},"min":{"1min":0.38300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":11.967000000000001,"5min":158.56,"15min":158.56},"last":0.52800000000000002},{"interface":"front","average":{"1min":1.792,"5min":6.9349999999999996,"15min":3.5129999999999999},"min":{"1min":0.32300000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":12.494,"5min":144.60400000000001,"15min":144.60400000000001},"last":0.86599999999999999}]},{"osd":2,"last update":"Thu Apr 18 04:55:39 2024","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":3.5209999999999999,"15min":2.2349999999999999},"min":{"1min":0.36699999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":9.7059999999999995,"5min":109.28,"15min":109.28},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.905,"5min":3.7200000000000002,"15min":2.2799999999999998},"min":{"1min":0.38400000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":10.670999999999999,"5min":109.242,"15min":109.242},"last":0.77100000000000002}]},{"osd":3,"last update":"Thu Apr 18 04:55:39 2024","interfaces":[{"interface":"back","average":{"1min":2.431,"5min":6.8310000000000004,"15min":3.5529999999999999},"min":{"1min":0.42699999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":13.782999999999999,"5min":147.625,"15min":147.625},"last":0.95999999999999996},{"interface":"front","average":{"1min":2.4079999999999999,"5min":5.9390000000000001,"15min":3.456},"min":{"1min":0.48899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":7.6790000000000003,"5min":147.01599999999999,"15min":147.01599999999999},"last":0.69699999999999995}]},{"osd":5,"last update":"Thu Apr 18 04:55:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":0.94399999999999995,"15min":1.0309999999999999},"min":{"1min":0.28699999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":5.4729999999999999,"5min":11.151999999999999,"15min":19.143999999999998},"last":1.014},{"interface":"front","average":{"1min":1.046,"5min":0.89600000000000002,"15min":1.03},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":3.6659999999999999,"5min":8.5199999999999996,"15min":27.402999999999999},"last":0.73899999999999999}]},{"osd":6,"last update":"Thu Apr 18 04:55:39 2024","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.0329999999999999,"15min":1.0880000000000001},"min":{"1min":0.30499999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":7.5190000000000001,"5min":8.8889999999999993,"15min":13.891999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.6659999999999999,"5min":1.1899999999999999,"15min":1.1699999999999999},"min":{"1min":0.317,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":7.7409999999999997,"5min":17.954999999999998,"15min":17.954999999999998},"last":0.92600000000000005}]},{"osd":7,"last update":"Thu Apr 18 04:55:39 2024","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":1.028,"15min":1.1799999999999999},"min":{"1min":0.308,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":4.508,"5min":11.244999999999999,"15min":27.643000000000001},"last":1.107},{"interface":"front","average":{"1min":1.008,"5min":1.095,"15min":1.105},"min":{"1min":0.39900000000000002,"5min":0.33500000000000002,"15min":0.32100000000000001},"max":{"1min":4.5869999999999997,"5min":18.800999999999998,"15min":18.800999999999998},"last":1.1479999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574993,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":609088,"kb_used_data":3448,"kb_used_omap":1,"kb_used_meta":605630,"kb_avail":93762752,"statfs":{"total":96636764160,"available":96013058048,"internally_reserved":0,"allocated":3530752,"data_stored":21714911,"data_compressed":2517298,"data_compressed_allocated":2887680,"data_compressed_original":21282816,"omap_allocated":1594,"internal_metadata":620165574},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 04:55:45 2024","interfaces":[{"interface":"back","average":{"1min":2.1400000000000001,"5min":5.3319999999999999,"15min":2.9510000000000001},"min":{"1min":0.308,"5min":0.221,"15min":0.221},"max":{"1min":7.1699999999999999,"5min":55.061,"15min":55.061},"last":0.28399999999999997},{"interface":"front","average":{"1min":2.5640000000000001,"5min":6.3259999999999996,"15min":3.3039999999999998},"min":{"1min":0.36099999999999999,"5min":0.309,"15min":0.28899999999999998},"max":{"1min":8.0190000000000001,"5min":115.45099999999999,"15min":115.45099999999999},"last":0.40500000000000003}]},{"osd":2,"last update":"Thu Apr 18 04:55:45 2024","interfaces":[{"interface":"back","average":{"1min":2.29,"5min":2.9060000000000001,"15min":1.901},"min":{"1min":0.317,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":9.2639999999999993,"5min":22.475000000000001,"15min":28.802},"last":0.45300000000000001},{"interface":"front","average":{"1min":2.2599999999999998,"5min":4.1230000000000002,"15min":2.556},"min":{"1min":0.40200000000000002,"5min":0.34000000000000002,"15min":0.29399999999999998},"max":{"1min":7.3879999999999999,"5min":115.229,"15min":115.229},"last":0.35099999999999998}]},{"osd":3,"last update":"Thu Apr 18 04:55:45 2024","interfaces":[{"interface":"back","average":{"1min":3.0939999999999999,"5min":4.016,"15min":2.6269999999999998},"min":{"1min":0.32300000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":14.502000000000001,"5min":34.180999999999997,"15min":47.496000000000002},"last":0.49399999999999999},{"interface":"front","average":{"1min":2.9900000000000002,"5min":4.6349999999999998,"15min":2.6930000000000001},"min":{"1min":0.42899999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":13.638,"5min":115.729,"15min":115.729},"last":0.52900000000000003}]},{"osd":4,"last update":"Thu Apr 18 04:55:29 2024","interfaces":[{"interface":"back","average":{"1min":2.0859999999999999,"5min":2.7599999999999998,"15min":1.855},"min":{"1min":0.41499999999999998,"5min":0.372,"15min":0.33000000000000002},"max":{"1min":16.451000000000001,"5min":49.738999999999997,"15min":49.738999999999997},"last":0.64600000000000002},{"interface":"front","average":{"1min":2.4929999999999999,"5min":3.8029999999999999,"15min":2.3519999999999999},"min":{"1min":0.47799999999999998,"5min":0.47499999999999998,"15min":0.38300000000000001},"max":{"1min":16.382999999999999,"5min":50.996000000000002,"15min":50.996000000000002},"last":0.70999999999999996}]},{"osd":5,"last update":"Thu Apr 18 04:55:29 2024","interfaces":[{"interface":"back","average":{"1min":1.843,"5min":2.9550000000000001,"15min":1.8720000000000001},"min":{"1min":0.504,"5min":0.437,"15min":0.38100000000000001},"max":{"1min":9.7469999999999999,"5min":34.402999999999999,"15min":34.402999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":1.855,"5min":2.4239999999999999,"15min":1.911},"min":{"1min":0.56799999999999995,"5min":0.46000000000000002,"15min":0.42099999999999999},"max":{"1min":9.2050000000000001,"5min":16.317,"15min":33.392000000000003},"last":0.69999999999999996}]},{"osd":6,"last update":"Thu Apr 18 04:55:29 2024","interfaces":[{"interface":"back","average":{"1min":1.825,"5min":4.1779999999999999,"15min":2.4169999999999998},"min":{"1min":0.47399999999999998,"5min":0.42199999999999999,"15min":0.40600000000000003},"max":{"1min":9.1549999999999994,"5min":115.277,"15min":115.277},"last":0.73499999999999999},{"interface":"front","average":{"1min":2.032,"5min":3.399,"15min":2.044},"min":{"1min":0.55500000000000005,"5min":0.41599999999999998,"15min":0.41399999999999998},"max":{"1min":10.212999999999999,"5min":48.652999999999999,"15min":48.652999999999999},"last":0.81399999999999995}]},{"osd":7,"last update":"Thu Apr 18 04:55:29 2024","interfaces":[{"interface":"back","average":{"1min":1.976,"5min":3.2639999999999998,"15min":2.2010000000000001},"min":{"1min":0.496,"5min":0.48899999999999999,"15min":0.437},"max":{"1min":7.4589999999999996,"5min":54.829000000000001,"15min":54.829000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":2.331,"5min":4.6799999999999997,"15min":2.6859999999999999},"min":{"1min":0.52200000000000002,"5min":0.49399999999999999,"15min":0.48699999999999999},"max":{"1min":10.170999999999999,"5min":115.31399999999999,"15min":115.31399999999999},"last":0.74299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33312,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33312,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3121152,"data_stored":20972180,"data_compressed":2483986,"data_compressed_allocated":2842624,"data_compressed_original":20709376,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3178496,"data_stored":20972464,"data_compressed":2531508,"data_compressed_allocated":2936832,"data_compressed_original":20754432,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1396736,"data_stored":4285475,"data_compressed":439103,"data_compressed_allocated":598016,"data_compressed_original":3510272,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6742016,"data_stored":16869536,"data_compressed":1734435,"data_compressed_allocated":2166784,"data_compressed_original":12316672,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6316032,"data_stored":29361965,"data_compressed":3215159,"data_compressed_allocated":3665920,"data_compressed_original":26726400,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":3239936,"data_stored":18154962,"data_compressed":2174151,"data_compressed_allocated":2514944,"data_compressed_original":17453056,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3473408,"data_stored":16779689,"data_compressed":2087260,"data_compressed_allocated":2478080,"data_compressed_original":15798272,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10387456,"data_stored":34932699,"data_compressed":3585780,"data_compressed_allocated":4227072,"data_compressed_original":28794880,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T04:56:19.431 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:56:19.431 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:56:19.431 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:56:19.431 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:56:19.432 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:56:19.432 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:56:19.432 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:56:19.432 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-18T04:44:33.267578+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:56:19.433 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-18T04:44:29.850188+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=44, tm_sec=29, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=4, tm_min=55, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T04:56:19.433 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-18T04:56:39.434 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T04:56:39.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.576+0000 7fd477200640 1 Processor -- start 2024-04-18T04:56:39.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.576+0000 7fd477200640 1 -- start start 2024-04-18T04:56:39.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.576+0000 7fd477200640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd4701516a0 0x7fd4700c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:39.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.576+0000 7fd477200640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd4700ca3a0 0x7fd4700c8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:39.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.576+0000 7fd477200640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd470157410 con 0x7fd470072420 2024-04-18T04:56:39.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.576+0000 7fd477200640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4701576b0 con 0x7fd4700ca3a0 2024-04-18T04:56:39.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.576+0000 7fd477200640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd470157990 con 0x7fd4701516a0 2024-04-18T04:56:39.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.576+0000 7fd476800640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd4700ca3a0 0x7fd4700c8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:39.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.576+0000 7fd476800640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd4700ca3a0 0x7fd4700c8ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:33710/0 (socket says 172.21.15.120:33710) 2024-04-18T04:56:39.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.576+0000 7fd476800640 1 -- 172.21.15.120:0/2272486485 learned_addr learned my addr 172.21.15.120:0/2272486485 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:56:39.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.576+0000 7fd475e00640 1 --2- 172.21.15.120:0/2272486485 >> v2:172.21.15.132:3300/0 conn(0x7fd4701516a0 0x7fd4700c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:39.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.576+0000 7fd476800640 1 -- 172.21.15.120:0/2272486485 >> v2:172.21.15.132:3300/0 conn(0x7fd4701516a0 msgr2=0x7fd4700c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:56:39.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.576+0000 7fd476800640 1 --2- 172.21.15.120:0/2272486485 >> v2:172.21.15.132:3300/0 conn(0x7fd4701516a0 0x7fd4700c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:39.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.576+0000 7fd476800640 1 -- 172.21.15.120:0/2272486485 >> v1:172.21.15.132:6789/0 conn(0x7fd470072420 legacy=0x7fd4700c9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:56:39.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.576+0000 7fd476800640 1 -- 172.21.15.120:0/2272486485 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd470157c70 con 0x7fd4700ca3a0 2024-04-18T04:56:39.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.580+0000 7fd476800640 1 --2- 172.21.15.120:0/2272486485 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4700ca3a0 0x7fd4700c8ef0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd4700c52d0 tx=0x7fd46c01f1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ac74adcd8ec70a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:39.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.580+0000 7fd474a00640 1 -- 172.21.15.120:0/2272486485 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46c0af400 con 0x7fd4700ca3a0 2024-04-18T04:56:39.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.580+0000 7fd474a00640 1 -- 172.21.15.120:0/2272486485 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46c0ab050 con 0x7fd4700ca3a0 2024-04-18T04:56:39.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.580+0000 7fd474a00640 1 -- 172.21.15.120:0/2272486485 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46c0af780 con 0x7fd4700ca3a0 2024-04-18T04:56:39.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.580+0000 7fd477200640 1 -- 172.21.15.120:0/2272486485 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4700ca3a0 msgr2=0x7fd4700c8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:39.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.580+0000 7fd477200640 1 --2- 172.21.15.120:0/2272486485 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4700ca3a0 0x7fd4700c8ef0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd4700c52d0 tx=0x7fd46c01f1a0 comp rx=0 tx=0).stop 2024-04-18T04:56:39.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.580+0000 7fd477200640 1 -- 172.21.15.120:0/2272486485 shutdown_connections 2024-04-18T04:56:39.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.580+0000 7fd477200640 1 --2- 172.21.15.120:0/2272486485 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4700ca3a0 0x7fd4700c8ef0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:39.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.580+0000 7fd477200640 1 --2- 172.21.15.120:0/2272486485 >> v2:172.21.15.132:3300/0 conn(0x7fd4701516a0 0x7fd4700c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:39.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.580+0000 7fd477200640 1 -- 172.21.15.120:0/2272486485 >> 172.21.15.120:0/2272486485 conn(0x7fd47006e700 msgr2=0x7fd47006eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:39.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.580+0000 7fd477200640 1 -- 172.21.15.120:0/2272486485 shutdown_connections 2024-04-18T04:56:39.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.580+0000 7fd477200640 1 -- 172.21.15.120:0/2272486485 wait complete. 2024-04-18T04:56:39.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.584+0000 7fd477200640 1 Processor -- start 2024-04-18T04:56:39.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.584+0000 7fd477200640 1 -- start start 2024-04-18T04:56:39.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.584+0000 7fd477200640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd470072420 0x7fd470151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:39.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.584+0000 7fd477200640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4700ca3a0 0x7fd470156490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:39.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.584+0000 7fd477200640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4701516a0 0x7fd47006abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:39.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.584+0000 7fd477200640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd470157120 con 0x7fd4701516a0 2024-04-18T04:56:39.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.584+0000 7fd477200640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4700b14a0 con 0x7fd470072420 2024-04-18T04:56:39.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.584+0000 7fd477200640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4701548f0 con 0x7fd4700ca3a0 2024-04-18T04:56:39.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.584+0000 7fd476800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4701516a0 0x7fd47006abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:39.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.584+0000 7fd476800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4701516a0 0x7fd47006abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:33724/0 (socket says 172.21.15.120:33724) 2024-04-18T04:56:39.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.584+0000 7fd476800640 1 -- 172.21.15.120:0/2943394779 learned_addr learned my addr 172.21.15.120:0/2943394779 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:56:39.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.584+0000 7fd475400640 1 --2- 172.21.15.120:0/2943394779 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4700ca3a0 0x7fd470156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:39.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.584+0000 7fd475e00640 1 --2- 172.21.15.120:0/2943394779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd470072420 0x7fd470151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:39.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.584+0000 7fd476800640 1 -- 172.21.15.120:0/2943394779 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4700ca3a0 msgr2=0x7fd470156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:39.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.584+0000 7fd476800640 1 --2- 172.21.15.120:0/2943394779 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4700ca3a0 0x7fd470156490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:39.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.584+0000 7fd476800640 1 -- 172.21.15.120:0/2943394779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd470072420 msgr2=0x7fd470151d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:39.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.584+0000 7fd476800640 1 --2- 172.21.15.120:0/2943394779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd470072420 0x7fd470151d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:39.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.584+0000 7fd476800640 1 -- 172.21.15.120:0/2943394779 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd46c009b30 con 0x7fd4701516a0 2024-04-18T04:56:39.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.584+0000 7fd476800640 1 --2- 172.21.15.120:0/2943394779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4701516a0 0x7fd47006abf0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd46c01d850 tx=0x7fd46c01bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:39.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.584+0000 7fd46a000640 1 -- 172.21.15.120:0/2943394779 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46c0afde0 con 0x7fd4701516a0 2024-04-18T04:56:39.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.584+0000 7fd46a000640 1 -- 172.21.15.120:0/2943394779 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46c009510 con 0x7fd4701516a0 2024-04-18T04:56:39.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.584+0000 7fd46a000640 1 -- 172.21.15.120:0/2943394779 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46c0ba680 con 0x7fd4701516a0 2024-04-18T04:56:39.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.584+0000 7fd477200640 1 -- 172.21.15.120:0/2943394779 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4701545c0 con 0x7fd4701516a0 2024-04-18T04:56:39.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.584+0000 7fd477200640 1 -- 172.21.15.120:0/2943394779 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4701ef620 con 0x7fd4701516a0 2024-04-18T04:56:39.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.584+0000 7fd477200640 1 -- 172.21.15.120:0/2943394779 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd470154a60 con 0x7fd4701516a0 2024-04-18T04:56:39.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.588+0000 7fd46a000640 1 -- 172.21.15.120:0/2943394779 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd46c0b6040 con 0x7fd4701516a0 2024-04-18T04:56:39.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.588+0000 7fd46a000640 1 --2- 172.21.15.120:0/2943394779 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd454066690 0x7fd454068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:39.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.588+0000 7fd46a000640 1 -- 172.21.15.120:0/2943394779 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7fd46c1229e0 con 0x7fd4701516a0 2024-04-18T04:56:39.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.588+0000 7fd475e00640 1 --2- 172.21.15.120:0/2943394779 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd454066690 0x7fd454068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:39.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.588+0000 7fd475e00640 1 --2- 172.21.15.120:0/2943394779 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd454066690 0x7fd454068b50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd46400b9d0 tx=0x7fd464008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:39.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.592+0000 7fd46a000640 1 -- 172.21.15.120:0/2943394779 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fd46c0ef800 con 0x7fd4701516a0 2024-04-18T04:56:39.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.744+0000 7fd477200640 1 -- 172.21.15.120:0/2943394779 --> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd4700cb6d0 con 0x7fd454066690 2024-04-18T04:56:39.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.776+0000 7fd46a000640 1 -- 172.21.15.120:0/2943394779 <== mgr.4113 v2:172.21.15.132:6832/27788 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+373317 (secure 0 0 0) 0x7fd46400b670 con 0x7fd454066690 2024-04-18T04:56:39.777 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:56:39.779 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-04-18T04:56:39.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.780+0000 7fd477200640 1 -- 172.21.15.120:0/2943394779 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd454066690 msgr2=0x7fd454068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:39.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.780+0000 7fd477200640 1 --2- 172.21.15.120:0/2943394779 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd454066690 0x7fd454068b50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd46400b9d0 tx=0x7fd464008040 comp rx=0 tx=0).stop 2024-04-18T04:56:39.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.780+0000 7fd477200640 1 -- 172.21.15.120:0/2943394779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4701516a0 msgr2=0x7fd47006abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:39.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.780+0000 7fd477200640 1 --2- 172.21.15.120:0/2943394779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4701516a0 0x7fd47006abf0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd46c01d850 tx=0x7fd46c01bf40 comp rx=0 tx=0).stop 2024-04-18T04:56:39.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.780+0000 7fd477200640 1 -- 172.21.15.120:0/2943394779 shutdown_connections 2024-04-18T04:56:39.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.780+0000 7fd477200640 1 --2- 172.21.15.120:0/2943394779 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7fd454066690 0x7fd454068b50 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:39.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.780+0000 7fd477200640 1 --2- 172.21.15.120:0/2943394779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4701516a0 0x7fd47006abf0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:39.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.780+0000 7fd477200640 1 --2- 172.21.15.120:0/2943394779 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4700ca3a0 0x7fd470156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:39.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.780+0000 7fd477200640 1 --2- 172.21.15.120:0/2943394779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd470072420 0x7fd470151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:39.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.780+0000 7fd477200640 1 -- 172.21.15.120:0/2943394779 >> 172.21.15.120:0/2943394779 conn(0x7fd47006e700 msgr2=0x7fd47014ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:39.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.780+0000 7fd477200640 1 -- 172.21.15.120:0/2943394779 shutdown_connections 2024-04-18T04:56:39.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.780+0000 7fd477200640 1 -- 172.21.15.120:0/2943394779 wait complete. 2024-04-18T04:56:39.798 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":397,"stamp":"2024-04-18T04:56:39.081696+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":81754853,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":667,"num_read_kb":75003,"num_write":2198758,"num_write_kb":31245689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27954,"num_omap_keys":54,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154351,"ondisk_log_size":154351,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":6031336,"kb_used_data":39784,"kb_used_omap":12,"kb_used_meta":5991475,"kb_avail":748943384,"statfs":{"total":773094113280,"available":766918025216,"internally_reserved":0,"allocated":40738816,"data_stored":164728610,"data_compressed":18318006,"data_compressed_allocated":21520384,"data_compressed_original":147210240,"omap_allocated":12743,"internal_metadata":6135270969},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005158"},"pg_stats":[{"pgid":"2.1f","version":"32'26","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:34.453464+0000","last_change":"2024-04-18T04:55:34.453464+0000","last_active":"2024-04-18T04:55:34.453464+0000","last_peered":"2024-04-18T04:55:34.453464+0000","last_clean":"2024-04-18T04:55:34.453464+0000","last_became_active":"2024-04-18T04:44:29.890853+0000","last_became_peered":"2024-04-18T04:44:29.890853+0000","last_unstale":"2024-04-18T04:55:34.453464+0000","last_undegraded":"2024-04-18T04:55:34.453464+0000","last_fullsized":"2024-04-18T04:55:34.453464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2024-04-18T04:55:34.453305+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2024-04-18T04:55:34.453305+0000","last_clean_scrub_stamp":"2024-04-18T04:55:34.453305+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:34:55.135020+0000","scrub_duration":0.023886489,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":4124,"num_write":18,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.737791+0000","last_change":"2024-04-18T04:55:39.632341+0000","last_active":"2024-04-18T04:55:39.737791+0000","last_peered":"2024-04-18T04:55:39.737791+0000","last_clean":"2024-04-18T04:55:39.737791+0000","last_became_active":"2024-04-18T04:44:30.296064+0000","last_became_peered":"2024-04-18T04:44:30.296064+0000","last_unstale":"2024-04-18T04:55:39.737791+0000","last_undegraded":"2024-04-18T04:55:39.737791+0000","last_fullsized":"2024-04-18T04:55:39.737791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-18T04:55:39.631099+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-18T04:55:39.631099+0000","last_clean_scrub_stamp":"2024-04-18T04:55:39.631099+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:57:20.977227+0000","scrub_duration":0.0073039209999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'3974","reported_seq":4010,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:22.944946+0000","last_change":"2024-04-18T04:56:22.945079+0000","last_active":"2024-04-18T04:56:22.944946+0000","last_peered":"2024-04-18T04:56:22.944946+0000","last_clean":"2024-04-18T04:56:22.944946+0000","last_became_active":"2024-04-18T04:44:34.306224+0000","last_became_peered":"2024-04-18T04:44:34.306224+0000","last_unstale":"2024-04-18T04:56:22.944946+0000","last_undegraded":"2024-04-18T04:56:22.944946+0000","last_fullsized":"2024-04-18T04:56:22.944946+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3974","last_scrub_stamp":"2024-04-18T04:56:22.944925+0000","last_deep_scrub":"32'3974","last_deep_scrub_stamp":"2024-04-18T04:56:22.944925+0000","last_clean_scrub_stamp":"2024-04-18T04:56:22.944925+0000","objects_scrubbed":0,"log_size":3974,"log_dups_size":0,"ondisk_log_size":3974,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:55:00.303041+0000","scrub_duration":0.14784176099999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":58092,"num_write_kb":822950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"32'27","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:42.547016+0000","last_change":"2024-04-18T04:55:42.547117+0000","last_active":"2024-04-18T04:55:42.547016+0000","last_peered":"2024-04-18T04:55:42.547016+0000","last_clean":"2024-04-18T04:55:42.547016+0000","last_became_active":"2024-04-18T04:44:29.881258+0000","last_became_peered":"2024-04-18T04:44:29.881258+0000","last_unstale":"2024-04-18T04:55:42.547016+0000","last_undegraded":"2024-04-18T04:55:42.547016+0000","last_fullsized":"2024-04-18T04:55:42.547016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'27","last_scrub_stamp":"2024-04-18T04:55:42.546992+0000","last_deep_scrub":"32'27","last_deep_scrub_stamp":"2024-04-18T04:55:42.546992+0000","last_clean_scrub_stamp":"2024-04-18T04:55:42.546992+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:13:30.341368+0000","scrub_duration":0.014561063000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":19,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"32'10","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:01.734976+0000","last_change":"2024-04-18T04:56:01.735094+0000","last_active":"2024-04-18T04:56:01.734976+0000","last_peered":"2024-04-18T04:56:01.734976+0000","last_clean":"2024-04-18T04:56:01.734976+0000","last_became_active":"2024-04-18T04:44:30.313987+0000","last_became_peered":"2024-04-18T04:44:30.313987+0000","last_unstale":"2024-04-18T04:56:01.734976+0000","last_undegraded":"2024-04-18T04:56:01.734976+0000","last_fullsized":"2024-04-18T04:56:01.734976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-18T04:56:01.734955+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-18T04:56:01.734955+0000","last_clean_scrub_stamp":"2024-04-18T04:56:01.734955+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:15:08.643172+0000","scrub_duration":0.091151898999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"32'5326","reported_seq":5366,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:53.782856+0000","last_change":"2024-04-18T04:55:53.783108+0000","last_active":"2024-04-18T04:55:53.782856+0000","last_peered":"2024-04-18T04:55:53.782856+0000","last_clean":"2024-04-18T04:55:53.782856+0000","last_became_active":"2024-04-18T04:44:34.338485+0000","last_became_peered":"2024-04-18T04:44:34.338485+0000","last_unstale":"2024-04-18T04:55:53.782856+0000","last_undegraded":"2024-04-18T04:55:53.782856+0000","last_fullsized":"2024-04-18T04:55:53.782856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5326","last_scrub_stamp":"2024-04-18T04:55:53.782806+0000","last_deep_scrub":"32'5326","last_deep_scrub_stamp":"2024-04-18T04:55:53.782806+0000","last_clean_scrub_stamp":"2024-04-18T04:55:53.782806+0000","objects_scrubbed":0,"log_size":5326,"log_dups_size":0,"ondisk_log_size":5326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:01:07.430052+0000","scrub_duration":0.106252715,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":78012,"num_write_kb":1107856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"32'81","reported_seq":125,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:58.819578+0000","last_change":"2024-04-18T04:55:58.819803+0000","last_active":"2024-04-18T04:55:58.819578+0000","last_peered":"2024-04-18T04:55:58.819578+0000","last_clean":"2024-04-18T04:55:58.819578+0000","last_became_active":"2024-04-18T04:44:29.896520+0000","last_became_peered":"2024-04-18T04:44:29.896520+0000","last_unstale":"2024-04-18T04:55:58.819578+0000","last_undegraded":"2024-04-18T04:55:58.819578+0000","last_fullsized":"2024-04-18T04:55:58.819578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'81","last_scrub_stamp":"2024-04-18T04:55:58.819518+0000","last_deep_scrub":"32'81","last_deep_scrub_stamp":"2024-04-18T04:55:58.819518+0000","last_clean_scrub_stamp":"2024-04-18T04:55:58.819518+0000","objects_scrubbed":4,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:40:11.519285+0000","scrub_duration":0.041060156,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":14,"num_read_kb":8212,"num_write":66,"num_write_kb":8229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"32'11","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:57.587807+0000","last_change":"2024-04-18T04:55:57.587960+0000","last_active":"2024-04-18T04:55:57.587807+0000","last_peered":"2024-04-18T04:55:57.587807+0000","last_clean":"2024-04-18T04:55:57.587807+0000","last_became_active":"2024-04-18T04:44:30.299939+0000","last_became_peered":"2024-04-18T04:44:30.299939+0000","last_unstale":"2024-04-18T04:55:57.587807+0000","last_undegraded":"2024-04-18T04:55:57.587807+0000","last_fullsized":"2024-04-18T04:55:57.587807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-04-18T04:55:57.587765+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-04-18T04:55:57.587765+0000","last_clean_scrub_stamp":"2024-04-18T04:55:57.587765+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:25:32.097791+0000","scrub_duration":0.002796949,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"32'4916","reported_seq":4953,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:55.761722+0000","last_change":"2024-04-18T04:55:55.761957+0000","last_active":"2024-04-18T04:55:55.761722+0000","last_peered":"2024-04-18T04:55:55.761722+0000","last_clean":"2024-04-18T04:55:55.761722+0000","last_became_active":"2024-04-18T04:44:34.337938+0000","last_became_peered":"2024-04-18T04:44:34.337938+0000","last_unstale":"2024-04-18T04:55:55.761722+0000","last_undegraded":"2024-04-18T04:55:55.761722+0000","last_fullsized":"2024-04-18T04:55:55.761722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4916","last_scrub_stamp":"2024-04-18T04:55:55.761684+0000","last_deep_scrub":"32'4916","last_deep_scrub_stamp":"2024-04-18T04:55:55.761684+0000","last_clean_scrub_stamp":"2024-04-18T04:55:55.761684+0000","objects_scrubbed":0,"log_size":4916,"log_dups_size":0,"ondisk_log_size":4916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:13:52.532868+0000","scrub_duration":0.090021601000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":72239,"num_write_kb":1012843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"32'90","reported_seq":130,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:47.712240+0000","last_change":"2024-04-18T04:55:47.712862+0000","last_active":"2024-04-18T04:55:47.712240+0000","last_peered":"2024-04-18T04:55:47.712240+0000","last_clean":"2024-04-18T04:55:47.712240+0000","last_became_active":"2024-04-18T04:44:29.902611+0000","last_became_peered":"2024-04-18T04:44:29.902611+0000","last_unstale":"2024-04-18T04:55:47.712240+0000","last_undegraded":"2024-04-18T04:55:47.712240+0000","last_fullsized":"2024-04-18T04:55:47.712240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'90","last_scrub_stamp":"2024-04-18T04:55:47.712175+0000","last_deep_scrub":"32'90","last_deep_scrub_stamp":"2024-04-18T04:55:47.712175+0000","last_clean_scrub_stamp":"2024-04-18T04:55:47.712175+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:32:28.237397+0000","scrub_duration":0.017371477999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":87,"num_write_kb":1391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"32'20","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:09.647452+0000","last_change":"2024-04-18T04:56:09.647664+0000","last_active":"2024-04-18T04:56:09.647452+0000","last_peered":"2024-04-18T04:56:09.647452+0000","last_clean":"2024-04-18T04:56:09.647452+0000","last_became_active":"2024-04-18T04:44:30.300303+0000","last_became_peered":"2024-04-18T04:44:30.300303+0000","last_unstale":"2024-04-18T04:56:09.647452+0000","last_undegraded":"2024-04-18T04:56:09.647452+0000","last_fullsized":"2024-04-18T04:56:09.647452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-04-18T04:56:09.647394+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-04-18T04:56:09.647394+0000","last_clean_scrub_stamp":"2024-04-18T04:56:09.647394+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:57:07.285335+0000","scrub_duration":0.077403323999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'4576","reported_seq":4616,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:57.795465+0000","last_change":"2024-04-18T04:55:57.795780+0000","last_active":"2024-04-18T04:55:57.795465+0000","last_peered":"2024-04-18T04:55:57.795465+0000","last_clean":"2024-04-18T04:55:57.795465+0000","last_became_active":"2024-04-18T04:44:34.326161+0000","last_became_peered":"2024-04-18T04:44:34.326161+0000","last_unstale":"2024-04-18T04:55:57.795465+0000","last_undegraded":"2024-04-18T04:55:57.795465+0000","last_fullsized":"2024-04-18T04:55:57.795465+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4576","last_scrub_stamp":"2024-04-18T04:55:57.795407+0000","last_deep_scrub":"32'4576","last_deep_scrub_stamp":"2024-04-18T04:55:57.795407+0000","last_clean_scrub_stamp":"2024-04-18T04:55:57.795407+0000","objects_scrubbed":0,"log_size":4576,"log_dups_size":0,"ondisk_log_size":4576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:37:29.870374+0000","scrub_duration":0.14544079600000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1,"num_write":67045,"num_write_kb":936790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:51.521933+0000","last_change":"2024-04-18T04:55:51.522165+0000","last_active":"2024-04-18T04:55:51.521933+0000","last_peered":"2024-04-18T04:55:51.521933+0000","last_clean":"2024-04-18T04:55:51.521933+0000","last_became_active":"2024-04-18T04:44:30.295657+0000","last_became_peered":"2024-04-18T04:44:30.295657+0000","last_unstale":"2024-04-18T04:55:51.521933+0000","last_undegraded":"2024-04-18T04:55:51.521933+0000","last_fullsized":"2024-04-18T04:55:51.521933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-18T04:55:51.521874+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-18T04:55:51.521874+0000","last_clean_scrub_stamp":"2024-04-18T04:55:51.521874+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:46:02.690401+0000","scrub_duration":0.00357457,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"32'991","reported_seq":1036,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:52.785772+0000","last_change":"2024-04-18T04:55:52.785966+0000","last_active":"2024-04-18T04:55:52.785772+0000","last_peered":"2024-04-18T04:55:52.785772+0000","last_clean":"2024-04-18T04:55:52.785772+0000","last_became_active":"2024-04-18T04:44:29.899402+0000","last_became_peered":"2024-04-18T04:44:29.899402+0000","last_unstale":"2024-04-18T04:55:52.785772+0000","last_undegraded":"2024-04-18T04:55:52.785772+0000","last_fullsized":"2024-04-18T04:55:52.785772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'991","last_scrub_stamp":"2024-04-18T04:55:52.785717+0000","last_deep_scrub":"32'991","last_deep_scrub_stamp":"2024-04-18T04:55:52.785717+0000","last_clean_scrub_stamp":"2024-04-18T04:55:52.785717+0000","objects_scrubbed":3,"log_size":991,"log_dups_size":0,"ondisk_log_size":991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:11:45.603201+0000","scrub_duration":0.033700826000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":4110,"num_write":977,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"32'4777","reported_seq":4818,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:07.853201+0000","last_change":"2024-04-18T04:56:07.853500+0000","last_active":"2024-04-18T04:56:07.853201+0000","last_peered":"2024-04-18T04:56:07.853201+0000","last_clean":"2024-04-18T04:56:07.853201+0000","last_became_active":"2024-04-18T04:44:34.319868+0000","last_became_peered":"2024-04-18T04:44:34.319868+0000","last_unstale":"2024-04-18T04:56:07.853201+0000","last_undegraded":"2024-04-18T04:56:07.853201+0000","last_fullsized":"2024-04-18T04:56:07.853201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4777","last_scrub_stamp":"2024-04-18T04:56:07.853120+0000","last_deep_scrub":"32'4777","last_deep_scrub_stamp":"2024-04-18T04:56:07.853120+0000","last_clean_scrub_stamp":"2024-04-18T04:56:07.853120+0000","objects_scrubbed":0,"log_size":4777,"log_dups_size":0,"ondisk_log_size":4777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:56:41.273577+0000","scrub_duration":0.12501833700000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":69886,"num_write_kb":985071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:40.615562+0000","last_change":"2024-04-18T04:55:40.615562+0000","last_active":"2024-04-18T04:55:40.615562+0000","last_peered":"2024-04-18T04:55:40.615562+0000","last_clean":"2024-04-18T04:55:40.615562+0000","last_became_active":"2024-04-18T04:44:30.271420+0000","last_became_peered":"2024-04-18T04:44:30.271420+0000","last_unstale":"2024-04-18T04:55:40.615562+0000","last_undegraded":"2024-04-18T04:55:40.615562+0000","last_fullsized":"2024-04-18T04:55:40.615562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-18T04:55:40.615434+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-18T04:55:40.615434+0000","last_clean_scrub_stamp":"2024-04-18T04:55:40.615434+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:53:11.453735+0000","scrub_duration":0.026470450999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"32'10","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:43.441783+0000","last_change":"2024-04-18T04:55:43.441900+0000","last_active":"2024-04-18T04:55:43.441783+0000","last_peered":"2024-04-18T04:55:43.441783+0000","last_clean":"2024-04-18T04:55:43.441783+0000","last_became_active":"2024-04-18T04:44:29.878139+0000","last_became_peered":"2024-04-18T04:44:29.878139+0000","last_unstale":"2024-04-18T04:55:43.441783+0000","last_undegraded":"2024-04-18T04:55:43.441783+0000","last_fullsized":"2024-04-18T04:55:43.441783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-18T04:55:43.441759+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-18T04:55:43.441759+0000","last_clean_scrub_stamp":"2024-04-18T04:55:43.441759+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:07:54.010016+0000","scrub_duration":0.0033934379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"32'4649","reported_seq":4687,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:10.902532+0000","last_change":"2024-04-18T04:56:10.902809+0000","last_active":"2024-04-18T04:56:10.902532+0000","last_peered":"2024-04-18T04:56:10.902532+0000","last_clean":"2024-04-18T04:56:10.902532+0000","last_became_active":"2024-04-18T04:44:34.345267+0000","last_became_peered":"2024-04-18T04:44:34.345267+0000","last_unstale":"2024-04-18T04:56:10.902532+0000","last_undegraded":"2024-04-18T04:56:10.902532+0000","last_fullsized":"2024-04-18T04:56:10.902532+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4649","last_scrub_stamp":"2024-04-18T04:56:10.902481+0000","last_deep_scrub":"32'4649","last_deep_scrub_stamp":"2024-04-18T04:56:10.902481+0000","last_clean_scrub_stamp":"2024-04-18T04:56:10.902481+0000","objects_scrubbed":0,"log_size":4649,"log_dups_size":0,"ondisk_log_size":4649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:37:44.907299+0000","scrub_duration":0.077025255000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":68133,"num_write_kb":992962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"32'11","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:53.573836+0000","last_change":"2024-04-18T04:55:53.573938+0000","last_active":"2024-04-18T04:55:53.573836+0000","last_peered":"2024-04-18T04:55:53.573836+0000","last_clean":"2024-04-18T04:55:53.573836+0000","last_became_active":"2024-04-18T04:44:30.273752+0000","last_became_peered":"2024-04-18T04:44:30.273752+0000","last_unstale":"2024-04-18T04:55:53.573836+0000","last_undegraded":"2024-04-18T04:55:53.573836+0000","last_fullsized":"2024-04-18T04:55:53.573836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-04-18T04:55:53.573817+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-04-18T04:55:53.573817+0000","last_clean_scrub_stamp":"2024-04-18T04:55:53.573817+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:15:50.107902+0000","scrub_duration":0.016381493,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"32'11","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.736159+0000","last_change":"2024-04-18T04:55:39.522596+0000","last_active":"2024-04-18T04:55:39.736159+0000","last_peered":"2024-04-18T04:55:39.736159+0000","last_clean":"2024-04-18T04:55:39.736159+0000","last_became_active":"2024-04-18T04:44:29.889684+0000","last_became_peered":"2024-04-18T04:44:29.889684+0000","last_unstale":"2024-04-18T04:55:39.736159+0000","last_undegraded":"2024-04-18T04:55:39.736159+0000","last_fullsized":"2024-04-18T04:55:39.736159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-18T04:55:39.522412+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-18T04:55:39.522412+0000","last_clean_scrub_stamp":"2024-04-18T04:55:39.522412+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:20:25.296279+0000","scrub_duration":0.014929192000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":9,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"32'4620","reported_seq":4658,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:07.442761+0000","last_change":"2024-04-18T04:56:07.442888+0000","last_active":"2024-04-18T04:56:07.442761+0000","last_peered":"2024-04-18T04:56:07.442761+0000","last_clean":"2024-04-18T04:56:07.442761+0000","last_became_active":"2024-04-18T04:44:34.313161+0000","last_became_peered":"2024-04-18T04:44:34.313161+0000","last_unstale":"2024-04-18T04:56:07.442761+0000","last_undegraded":"2024-04-18T04:56:07.442761+0000","last_fullsized":"2024-04-18T04:56:07.442761+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4620","last_scrub_stamp":"2024-04-18T04:56:07.442742+0000","last_deep_scrub":"32'4620","last_deep_scrub_stamp":"2024-04-18T04:56:07.442742+0000","last_clean_scrub_stamp":"2024-04-18T04:56:07.442742+0000","objects_scrubbed":0,"log_size":4620,"log_dups_size":0,"ondisk_log_size":4620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:10:51.043267+0000","scrub_duration":0.067058095999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":67683,"num_write_kb":962979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:41.633068+0000","last_change":"2024-04-18T04:55:41.633263+0000","last_active":"2024-04-18T04:55:41.633068+0000","last_peered":"2024-04-18T04:55:41.633068+0000","last_clean":"2024-04-18T04:55:41.633068+0000","last_became_active":"2024-04-18T04:44:30.279238+0000","last_became_peered":"2024-04-18T04:44:30.279238+0000","last_unstale":"2024-04-18T04:55:41.633068+0000","last_undegraded":"2024-04-18T04:55:41.633068+0000","last_fullsized":"2024-04-18T04:55:41.633068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-04-18T04:55:41.633017+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-04-18T04:55:41.633017+0000","last_clean_scrub_stamp":"2024-04-18T04:55:41.633017+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:54:01.121009+0000","scrub_duration":0.0030512479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"32'24","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:55.773763+0000","last_change":"2024-04-18T04:55:55.773914+0000","last_active":"2024-04-18T04:55:55.773763+0000","last_peered":"2024-04-18T04:55:55.773763+0000","last_clean":"2024-04-18T04:55:55.773763+0000","last_became_active":"2024-04-18T04:44:29.890272+0000","last_became_peered":"2024-04-18T04:44:29.890272+0000","last_unstale":"2024-04-18T04:55:55.773763+0000","last_undegraded":"2024-04-18T04:55:55.773763+0000","last_fullsized":"2024-04-18T04:55:55.773763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'24","last_scrub_stamp":"2024-04-18T04:55:55.773726+0000","last_deep_scrub":"32'24","last_deep_scrub_stamp":"2024-04-18T04:55:55.773726+0000","last_clean_scrub_stamp":"2024-04-18T04:55:55.773726+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:18:51.342848+0000","scrub_duration":0.017478133,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":4108,"num_write":18,"num_write_kb":4103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"32'4424","reported_seq":4462,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:04.798210+0000","last_change":"2024-04-18T04:56:04.798389+0000","last_active":"2024-04-18T04:56:04.798210+0000","last_peered":"2024-04-18T04:56:04.798210+0000","last_clean":"2024-04-18T04:56:04.798210+0000","last_became_active":"2024-04-18T04:44:34.344007+0000","last_became_peered":"2024-04-18T04:44:34.344007+0000","last_unstale":"2024-04-18T04:56:04.798210+0000","last_undegraded":"2024-04-18T04:56:04.798210+0000","last_fullsized":"2024-04-18T04:56:04.798210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4424","last_scrub_stamp":"2024-04-18T04:56:04.798174+0000","last_deep_scrub":"32'4424","last_deep_scrub_stamp":"2024-04-18T04:56:04.798174+0000","last_clean_scrub_stamp":"2024-04-18T04:56:04.798174+0000","objects_scrubbed":0,"log_size":4424,"log_dups_size":0,"ondisk_log_size":4424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:19:47.215939+0000","scrub_duration":0.095564331000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":64589,"num_write_kb":921811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"32'15","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:57.628634+0000","last_change":"2024-04-18T04:55:57.628751+0000","last_active":"2024-04-18T04:55:57.628634+0000","last_peered":"2024-04-18T04:55:57.628634+0000","last_clean":"2024-04-18T04:55:57.628634+0000","last_became_active":"2024-04-18T04:44:30.277916+0000","last_became_peered":"2024-04-18T04:44:30.277916+0000","last_unstale":"2024-04-18T04:55:57.628634+0000","last_undegraded":"2024-04-18T04:55:57.628634+0000","last_fullsized":"2024-04-18T04:55:57.628634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-04-18T04:55:57.628613+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-04-18T04:55:57.628613+0000","last_clean_scrub_stamp":"2024-04-18T04:55:57.628613+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:00:54.736411+0000","scrub_duration":0.017000623999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"32'11","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:45.408643+0000","last_change":"2024-04-18T04:55:45.408857+0000","last_active":"2024-04-18T04:55:45.408643+0000","last_peered":"2024-04-18T04:55:45.408643+0000","last_clean":"2024-04-18T04:55:45.408643+0000","last_became_active":"2024-04-18T04:44:29.896392+0000","last_became_peered":"2024-04-18T04:44:29.896392+0000","last_unstale":"2024-04-18T04:55:45.408643+0000","last_undegraded":"2024-04-18T04:55:45.408643+0000","last_fullsized":"2024-04-18T04:55:45.408643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-04-18T04:55:45.408586+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-04-18T04:55:45.408586+0000","last_clean_scrub_stamp":"2024-04-18T04:55:45.408586+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:33:28.055043+0000","scrub_duration":0.0062587069999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"32'4470","reported_seq":4507,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:54.858277+0000","last_change":"2024-04-18T04:55:54.858566+0000","last_active":"2024-04-18T04:55:54.858277+0000","last_peered":"2024-04-18T04:55:54.858277+0000","last_clean":"2024-04-18T04:55:54.858277+0000","last_became_active":"2024-04-18T04:44:34.338294+0000","last_became_peered":"2024-04-18T04:44:34.338294+0000","last_unstale":"2024-04-18T04:55:54.858277+0000","last_undegraded":"2024-04-18T04:55:54.858277+0000","last_fullsized":"2024-04-18T04:55:54.858277+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4470","last_scrub_stamp":"2024-04-18T04:55:54.858225+0000","last_deep_scrub":"32'4470","last_deep_scrub_stamp":"2024-04-18T04:55:54.858225+0000","last_clean_scrub_stamp":"2024-04-18T04:55:54.858225+0000","objects_scrubbed":0,"log_size":4470,"log_dups_size":0,"ondisk_log_size":4470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:42:43.493104+0000","scrub_duration":0.166457198,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":65571,"num_write_kb":938881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"32'9","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:11.413824+0000","last_change":"2024-04-18T04:56:11.413911+0000","last_active":"2024-04-18T04:56:11.413824+0000","last_peered":"2024-04-18T04:56:11.413824+0000","last_clean":"2024-04-18T04:56:11.413824+0000","last_became_active":"2024-04-18T04:45:12.045671+0000","last_became_peered":"2024-04-18T04:45:12.045671+0000","last_unstale":"2024-04-18T04:56:11.413824+0000","last_undegraded":"2024-04-18T04:56:11.413824+0000","last_fullsized":"2024-04-18T04:56:11.413824+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-18T04:56:11.413806+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-18T04:56:11.413806+0000","last_clean_scrub_stamp":"2024-04-18T04:56:11.413806+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:48:13.128223+0000","scrub_duration":0.017754388999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"32'100","reported_seq":143,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:36.496341+0000","last_change":"2024-04-18T04:55:36.496341+0000","last_active":"2024-04-18T04:55:36.496341+0000","last_peered":"2024-04-18T04:55:36.496341+0000","last_clean":"2024-04-18T04:55:36.496341+0000","last_became_active":"2024-04-18T04:44:29.894210+0000","last_became_peered":"2024-04-18T04:44:29.894210+0000","last_unstale":"2024-04-18T04:55:36.496341+0000","last_undegraded":"2024-04-18T04:55:36.496341+0000","last_fullsized":"2024-04-18T04:55:36.496341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'99","last_scrub_stamp":"2024-04-18T04:55:36.496160+0000","last_deep_scrub":"32'99","last_deep_scrub_stamp":"2024-04-18T04:55:36.496160+0000","last_clean_scrub_stamp":"2024-04-18T04:55:36.496160+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:33:42.522752+0000","scrub_duration":0.032044003000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":22,"num_write":222,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"32'4848","reported_seq":4889,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:18.869945+0000","last_change":"2024-04-18T04:56:18.870078+0000","last_active":"2024-04-18T04:56:18.869945+0000","last_peered":"2024-04-18T04:56:18.869945+0000","last_clean":"2024-04-18T04:56:18.869945+0000","last_became_active":"2024-04-18T04:44:34.305180+0000","last_became_peered":"2024-04-18T04:44:34.305180+0000","last_unstale":"2024-04-18T04:56:18.869945+0000","last_undegraded":"2024-04-18T04:56:18.869945+0000","last_fullsized":"2024-04-18T04:56:18.869945+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4848","last_scrub_stamp":"2024-04-18T04:56:18.869925+0000","last_deep_scrub":"32'4848","last_deep_scrub_stamp":"2024-04-18T04:56:18.869925+0000","last_clean_scrub_stamp":"2024-04-18T04:56:18.869925+0000","objects_scrubbed":0,"log_size":4848,"log_dups_size":0,"ondisk_log_size":4848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:06:13.464134+0000","scrub_duration":0.11931554900000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":70785,"num_write_kb":998644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"32'14","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.691162+0000","last_change":"2024-04-18T04:55:33.486145+0000","last_active":"2024-04-18T04:55:39.691162+0000","last_peered":"2024-04-18T04:55:39.691162+0000","last_clean":"2024-04-18T04:55:39.691162+0000","last_became_active":"2024-04-18T04:44:30.266814+0000","last_became_peered":"2024-04-18T04:44:30.266814+0000","last_unstale":"2024-04-18T04:55:39.691162+0000","last_undegraded":"2024-04-18T04:55:39.691162+0000","last_fullsized":"2024-04-18T04:55:39.691162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-18T04:55:33.485923+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-18T04:55:33.485923+0000","last_clean_scrub_stamp":"2024-04-18T04:55:33.485923+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:32:31.671872+0000","scrub_duration":0.031836318000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"32'11","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:49.771399+0000","last_change":"2024-04-18T04:55:49.771588+0000","last_active":"2024-04-18T04:55:49.771399+0000","last_peered":"2024-04-18T04:55:49.771399+0000","last_clean":"2024-04-18T04:55:49.771399+0000","last_became_active":"2024-04-18T04:44:29.897156+0000","last_became_peered":"2024-04-18T04:44:29.897156+0000","last_unstale":"2024-04-18T04:55:49.771399+0000","last_undegraded":"2024-04-18T04:55:49.771399+0000","last_fullsized":"2024-04-18T04:55:49.771399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-04-18T04:55:49.771338+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-04-18T04:55:49.771338+0000","last_clean_scrub_stamp":"2024-04-18T04:55:49.771338+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:37:50.640662+0000","scrub_duration":0.0048339239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":10,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"32'4380","reported_seq":4419,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:16.703600+0000","last_change":"2024-04-18T04:56:16.703763+0000","last_active":"2024-04-18T04:56:16.703600+0000","last_peered":"2024-04-18T04:56:16.703600+0000","last_clean":"2024-04-18T04:56:16.703600+0000","last_became_active":"2024-04-18T04:44:34.322925+0000","last_became_peered":"2024-04-18T04:44:34.322925+0000","last_unstale":"2024-04-18T04:56:16.703600+0000","last_undegraded":"2024-04-18T04:56:16.703600+0000","last_fullsized":"2024-04-18T04:56:16.703600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4380","last_scrub_stamp":"2024-04-18T04:56:16.703580+0000","last_deep_scrub":"32'4380","last_deep_scrub_stamp":"2024-04-18T04:56:16.703580+0000","last_clean_scrub_stamp":"2024-04-18T04:56:16.703580+0000","objects_scrubbed":0,"log_size":4380,"log_dups_size":0,"ondisk_log_size":4380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:11:59.574906+0000","scrub_duration":0.144760058,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":64226,"num_write_kb":906867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"32'9","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:02.564694+0000","last_change":"2024-04-18T04:56:02.564900+0000","last_active":"2024-04-18T04:56:02.564694+0000","last_peered":"2024-04-18T04:56:02.564694+0000","last_clean":"2024-04-18T04:56:02.564694+0000","last_became_active":"2024-04-18T04:44:30.280968+0000","last_became_peered":"2024-04-18T04:44:30.280968+0000","last_unstale":"2024-04-18T04:56:02.564694+0000","last_undegraded":"2024-04-18T04:56:02.564694+0000","last_fullsized":"2024-04-18T04:56:02.564694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-18T04:56:02.564649+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-18T04:56:02.564649+0000","last_clean_scrub_stamp":"2024-04-18T04:56:02.564649+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:50:53.366249+0000","scrub_duration":0.049629663999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:48.422520+0000","last_change":"2024-04-18T04:55:48.422593+0000","last_active":"2024-04-18T04:55:48.422520+0000","last_peered":"2024-04-18T04:55:48.422520+0000","last_clean":"2024-04-18T04:55:48.422520+0000","last_became_active":"2024-04-18T04:44:29.882335+0000","last_became_peered":"2024-04-18T04:44:29.882335+0000","last_unstale":"2024-04-18T04:55:48.422520+0000","last_undegraded":"2024-04-18T04:55:48.422520+0000","last_fullsized":"2024-04-18T04:55:48.422520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-04-18T04:55:48.422500+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-04-18T04:55:48.422500+0000","last_clean_scrub_stamp":"2024-04-18T04:55:48.422500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:52:26.809919+0000","scrub_duration":0.0014886680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4640","reported_seq":4681,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:09.529659+0000","last_change":"2024-04-18T04:56:09.529792+0000","last_active":"2024-04-18T04:56:09.529659+0000","last_peered":"2024-04-18T04:56:09.529659+0000","last_clean":"2024-04-18T04:56:09.529659+0000","last_became_active":"2024-04-18T04:44:34.324082+0000","last_became_peered":"2024-04-18T04:44:34.324082+0000","last_unstale":"2024-04-18T04:56:09.529659+0000","last_undegraded":"2024-04-18T04:56:09.529659+0000","last_fullsized":"2024-04-18T04:56:09.529659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4640","last_scrub_stamp":"2024-04-18T04:56:09.529639+0000","last_deep_scrub":"32'4640","last_deep_scrub_stamp":"2024-04-18T04:56:09.529639+0000","last_clean_scrub_stamp":"2024-04-18T04:56:09.529639+0000","objects_scrubbed":0,"log_size":4640,"log_dups_size":0,"ondisk_log_size":4640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:04:20.828783+0000","scrub_duration":0.15868613000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":67980,"num_write_kb":954001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"32'9","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:51.707393+0000","last_change":"2024-04-18T04:55:51.707638+0000","last_active":"2024-04-18T04:55:51.707393+0000","last_peered":"2024-04-18T04:55:51.707393+0000","last_clean":"2024-04-18T04:55:51.707393+0000","last_became_active":"2024-04-18T04:44:30.270878+0000","last_became_peered":"2024-04-18T04:44:30.270878+0000","last_unstale":"2024-04-18T04:55:51.707393+0000","last_undegraded":"2024-04-18T04:55:51.707393+0000","last_fullsized":"2024-04-18T04:55:51.707393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-18T04:55:51.707338+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-18T04:55:51.707338+0000","last_clean_scrub_stamp":"2024-04-18T04:55:51.707338+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:46:00.559874+0000","scrub_duration":0.015878997999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"32'31","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:41.591869+0000","last_change":"2024-04-18T04:55:41.592079+0000","last_active":"2024-04-18T04:55:41.591869+0000","last_peered":"2024-04-18T04:55:41.591869+0000","last_clean":"2024-04-18T04:55:41.591869+0000","last_became_active":"2024-04-18T04:44:29.896199+0000","last_became_peered":"2024-04-18T04:44:29.896199+0000","last_unstale":"2024-04-18T04:55:41.591869+0000","last_undegraded":"2024-04-18T04:55:41.591869+0000","last_fullsized":"2024-04-18T04:55:41.591869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'31","last_scrub_stamp":"2024-04-18T04:55:41.591815+0000","last_deep_scrub":"32'31","last_deep_scrub_stamp":"2024-04-18T04:55:41.591815+0000","last_clean_scrub_stamp":"2024-04-18T04:55:41.591815+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:47:05.819279+0000","scrub_duration":0.031081439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":22,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"32'5255","reported_seq":5295,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:08.518701+0000","last_change":"2024-04-18T04:56:08.518855+0000","last_active":"2024-04-18T04:56:08.518701+0000","last_peered":"2024-04-18T04:56:08.518701+0000","last_clean":"2024-04-18T04:56:08.518701+0000","last_became_active":"2024-04-18T04:44:34.337089+0000","last_became_peered":"2024-04-18T04:44:34.337089+0000","last_unstale":"2024-04-18T04:56:08.518701+0000","last_undegraded":"2024-04-18T04:56:08.518701+0000","last_fullsized":"2024-04-18T04:56:08.518701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5255","last_scrub_stamp":"2024-04-18T04:56:08.518681+0000","last_deep_scrub":"32'5255","last_deep_scrub_stamp":"2024-04-18T04:56:08.518681+0000","last_clean_scrub_stamp":"2024-04-18T04:56:08.518681+0000","objects_scrubbed":0,"log_size":5255,"log_dups_size":0,"ondisk_log_size":5255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:12:50.723446+0000","scrub_duration":0.114400374,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":76866,"num_write_kb":1090506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"32'13","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:59.385423+0000","last_change":"2024-04-18T04:55:59.385423+0000","last_active":"2024-04-18T04:55:59.385423+0000","last_peered":"2024-04-18T04:55:59.385423+0000","last_clean":"2024-04-18T04:55:59.385423+0000","last_became_active":"2024-04-18T04:44:30.270636+0000","last_became_peered":"2024-04-18T04:44:30.270636+0000","last_unstale":"2024-04-18T04:55:59.385423+0000","last_undegraded":"2024-04-18T04:55:59.385423+0000","last_fullsized":"2024-04-18T04:55:59.385423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-04-18T04:55:59.385329+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-04-18T04:55:59.385329+0000","last_clean_scrub_stamp":"2024-04-18T04:55:59.385329+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:23:06.860026+0000","scrub_duration":0.0014736669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"32'45","reported_seq":117,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:42.107941+0000","last_change":"2024-04-18T04:55:42.108086+0000","last_active":"2024-04-18T04:55:42.107941+0000","last_peered":"2024-04-18T04:55:42.107941+0000","last_clean":"2024-04-18T04:55:42.107941+0000","last_became_active":"2024-04-18T04:44:29.878330+0000","last_became_peered":"2024-04-18T04:44:29.878330+0000","last_unstale":"2024-04-18T04:55:42.107941+0000","last_undegraded":"2024-04-18T04:55:42.107941+0000","last_fullsized":"2024-04-18T04:55:42.107941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-04-18T04:55:42.107919+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-04-18T04:55:42.107919+0000","last_clean_scrub_stamp":"2024-04-18T04:55:42.107919+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:05:38.846240+0000","scrub_duration":0.0049119840000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90443,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":42,"num_read_kb":118,"num_write":37,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'4417","reported_seq":4455,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:04.504388+0000","last_change":"2024-04-18T04:56:04.504532+0000","last_active":"2024-04-18T04:56:04.504388+0000","last_peered":"2024-04-18T04:56:04.504388+0000","last_clean":"2024-04-18T04:56:04.504388+0000","last_became_active":"2024-04-18T04:44:34.322983+0000","last_became_peered":"2024-04-18T04:44:34.322983+0000","last_unstale":"2024-04-18T04:56:04.504388+0000","last_undegraded":"2024-04-18T04:56:04.504388+0000","last_fullsized":"2024-04-18T04:56:04.504388+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4417","last_scrub_stamp":"2024-04-18T04:56:04.504368+0000","last_deep_scrub":"32'4417","last_deep_scrub_stamp":"2024-04-18T04:56:04.504368+0000","last_clean_scrub_stamp":"2024-04-18T04:56:04.504368+0000","objects_scrubbed":0,"log_size":4417,"log_dups_size":0,"ondisk_log_size":4417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:53:39.809940+0000","scrub_duration":0.118053505,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":64703,"num_write_kb":914612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"32'6","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:43.527284+0000","last_change":"2024-04-18T04:55:43.527385+0000","last_active":"2024-04-18T04:55:43.527284+0000","last_peered":"2024-04-18T04:55:43.527284+0000","last_clean":"2024-04-18T04:55:43.527284+0000","last_became_active":"2024-04-18T04:44:30.285113+0000","last_became_peered":"2024-04-18T04:44:30.285113+0000","last_unstale":"2024-04-18T04:55:43.527284+0000","last_undegraded":"2024-04-18T04:55:43.527284+0000","last_fullsized":"2024-04-18T04:55:43.527284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-18T04:55:43.527263+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-18T04:55:43.527263+0000","last_clean_scrub_stamp":"2024-04-18T04:55:43.527263+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:51:32.481877+0000","scrub_duration":0.0026846880000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"32'35","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:45.708153+0000","last_change":"2024-04-18T04:55:45.708153+0000","last_active":"2024-04-18T04:55:45.708153+0000","last_peered":"2024-04-18T04:55:45.708153+0000","last_clean":"2024-04-18T04:55:45.708153+0000","last_became_active":"2024-04-18T04:44:29.890207+0000","last_became_peered":"2024-04-18T04:44:29.890207+0000","last_unstale":"2024-04-18T04:55:45.708153+0000","last_undegraded":"2024-04-18T04:55:45.708153+0000","last_fullsized":"2024-04-18T04:55:45.708153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'35","last_scrub_stamp":"2024-04-18T04:55:45.707886+0000","last_deep_scrub":"32'35","last_deep_scrub_stamp":"2024-04-18T04:55:45.707886+0000","last_clean_scrub_stamp":"2024-04-18T04:55:45.707886+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:34:27.358342+0000","scrub_duration":0.034614290999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":8204,"num_write":25,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"32'5273","reported_seq":5322,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:09.710663+0000","last_change":"2024-04-18T04:56:09.710790+0000","last_active":"2024-04-18T04:56:09.710663+0000","last_peered":"2024-04-18T04:56:09.710663+0000","last_clean":"2024-04-18T04:56:09.710663+0000","last_became_active":"2024-04-18T04:45:12.378263+0000","last_became_peered":"2024-04-18T04:45:12.378263+0000","last_unstale":"2024-04-18T04:56:09.710663+0000","last_undegraded":"2024-04-18T04:56:09.710663+0000","last_fullsized":"2024-04-18T04:56:09.710663+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5273","last_scrub_stamp":"2024-04-18T04:56:09.710643+0000","last_deep_scrub":"32'5273","last_deep_scrub_stamp":"2024-04-18T04:56:09.710643+0000","last_clean_scrub_stamp":"2024-04-18T04:56:09.710643+0000","objects_scrubbed":0,"log_size":5273,"log_dups_size":0,"ondisk_log_size":5273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:28:45.280253+0000","scrub_duration":0.16230691,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":76633,"num_write_kb":1101398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:00.673352+0000","last_change":"2024-04-18T04:56:00.673433+0000","last_active":"2024-04-18T04:56:00.673352+0000","last_peered":"2024-04-18T04:56:00.673352+0000","last_clean":"2024-04-18T04:56:00.673352+0000","last_became_active":"2024-04-18T04:44:30.306320+0000","last_became_peered":"2024-04-18T04:44:30.306320+0000","last_unstale":"2024-04-18T04:56:00.673352+0000","last_undegraded":"2024-04-18T04:56:00.673352+0000","last_fullsized":"2024-04-18T04:56:00.673352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-18T04:56:00.673335+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-18T04:56:00.673335+0000","last_clean_scrub_stamp":"2024-04-18T04:56:00.673335+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:18:23.146975+0000","scrub_duration":0.0022741749999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"32'9","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:42.555546+0000","last_change":"2024-04-18T04:55:42.555773+0000","last_active":"2024-04-18T04:55:42.555546+0000","last_peered":"2024-04-18T04:55:42.555546+0000","last_clean":"2024-04-18T04:55:42.555546+0000","last_became_active":"2024-04-18T04:44:29.887440+0000","last_became_peered":"2024-04-18T04:44:29.887440+0000","last_unstale":"2024-04-18T04:55:42.555546+0000","last_undegraded":"2024-04-18T04:55:42.555546+0000","last_fullsized":"2024-04-18T04:55:42.555546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-18T04:55:42.555488+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-18T04:55:42.555488+0000","last_clean_scrub_stamp":"2024-04-18T04:55:42.555488+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:41:03.271057+0000","scrub_duration":0.0067458550000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":20,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":195,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:44.677983+0000","last_change":"2024-04-18T04:55:44.677983+0000","last_active":"2024-04-18T04:55:44.677983+0000","last_peered":"2024-04-18T04:55:44.677983+0000","last_clean":"2024-04-18T04:55:44.677983+0000","last_became_active":"2024-04-18T04:44:18.627792+0000","last_became_peered":"2024-04-18T04:44:18.627792+0000","last_unstale":"2024-04-18T04:55:44.677983+0000","last_undegraded":"2024-04-18T04:55:44.677983+0000","last_fullsized":"2024-04-18T04:55:44.677983+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-04-18T04:55:44.677717+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-04-18T04:55:44.677717+0000","last_clean_scrub_stamp":"2024-04-18T04:55:44.677717+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:04:55.300837+0000","scrub_duration":0.0097382879999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"32'4252","reported_seq":4289,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:37.137068+0000","last_change":"2024-04-18T04:56:37.137272+0000","last_active":"2024-04-18T04:56:37.137068+0000","last_peered":"2024-04-18T04:56:37.137068+0000","last_clean":"2024-04-18T04:56:37.137068+0000","last_became_active":"2024-04-18T04:44:34.332520+0000","last_became_peered":"2024-04-18T04:44:34.332520+0000","last_unstale":"2024-04-18T04:56:37.137068+0000","last_undegraded":"2024-04-18T04:56:37.137068+0000","last_fullsized":"2024-04-18T04:56:37.137068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4252","last_scrub_stamp":"2024-04-18T04:56:37.137035+0000","last_deep_scrub":"32'4252","last_deep_scrub_stamp":"2024-04-18T04:56:37.137035+0000","last_clean_scrub_stamp":"2024-04-18T04:56:37.137035+0000","objects_scrubbed":0,"log_size":4252,"log_dups_size":0,"ondisk_log_size":4252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:06:50.173166+0000","scrub_duration":0.098236064999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":62374,"num_write_kb":880557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"32'8","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:10.727171+0000","last_change":"2024-04-18T04:56:10.727392+0000","last_active":"2024-04-18T04:56:10.727171+0000","last_peered":"2024-04-18T04:56:10.727171+0000","last_clean":"2024-04-18T04:56:10.727171+0000","last_became_active":"2024-04-18T04:44:30.302157+0000","last_became_peered":"2024-04-18T04:44:30.302157+0000","last_unstale":"2024-04-18T04:56:10.727171+0000","last_undegraded":"2024-04-18T04:56:10.727171+0000","last_fullsized":"2024-04-18T04:56:10.727171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-18T04:56:10.727118+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-18T04:56:10.727118+0000","last_clean_scrub_stamp":"2024-04-18T04:56:10.727118+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:56:23.166218+0000","scrub_duration":0.031439657000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"32'14","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:45.141146+0000","last_change":"2024-04-18T04:55:45.141146+0000","last_active":"2024-04-18T04:55:45.141146+0000","last_peered":"2024-04-18T04:55:45.141146+0000","last_clean":"2024-04-18T04:55:45.141146+0000","last_became_active":"2024-04-18T04:44:29.890166+0000","last_became_peered":"2024-04-18T04:44:29.890166+0000","last_unstale":"2024-04-18T04:55:45.141146+0000","last_undegraded":"2024-04-18T04:55:45.141146+0000","last_fullsized":"2024-04-18T04:55:45.141146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-04-18T04:55:45.141052+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-04-18T04:55:45.141052+0000","last_clean_scrub_stamp":"2024-04-18T04:55:45.141052+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:03:19.757976+0000","scrub_duration":0.0051920170000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":14,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"32'3652","reported_seq":3694,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:14.920944+0000","last_change":"2024-04-18T04:56:14.921328+0000","last_active":"2024-04-18T04:56:14.920944+0000","last_peered":"2024-04-18T04:56:14.920944+0000","last_clean":"2024-04-18T04:56:14.920944+0000","last_became_active":"2024-04-18T04:44:34.332695+0000","last_became_peered":"2024-04-18T04:44:34.332695+0000","last_unstale":"2024-04-18T04:56:14.920944+0000","last_undegraded":"2024-04-18T04:56:14.920944+0000","last_fullsized":"2024-04-18T04:56:14.920944+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3652","last_scrub_stamp":"2024-04-18T04:56:14.920854+0000","last_deep_scrub":"32'3652","last_deep_scrub_stamp":"2024-04-18T04:56:14.920854+0000","last_clean_scrub_stamp":"2024-04-18T04:56:14.920854+0000","objects_scrubbed":0,"log_size":3652,"log_dups_size":0,"ondisk_log_size":3652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:53:27.805077+0000","scrub_duration":0.118060287,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":53440,"num_write_kb":771461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'7","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:53.546185+0000","last_change":"2024-04-18T04:55:53.546427+0000","last_active":"2024-04-18T04:55:53.546185+0000","last_peered":"2024-04-18T04:55:53.546185+0000","last_clean":"2024-04-18T04:55:53.546185+0000","last_became_active":"2024-04-18T04:44:30.287217+0000","last_became_peered":"2024-04-18T04:44:30.287217+0000","last_unstale":"2024-04-18T04:55:53.546185+0000","last_undegraded":"2024-04-18T04:55:53.546185+0000","last_fullsized":"2024-04-18T04:55:53.546185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-18T04:55:53.546130+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-18T04:55:53.546130+0000","last_clean_scrub_stamp":"2024-04-18T04:55:53.546130+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:37:04.371045+0000","scrub_duration":0.0026409860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"32'27","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:55.479159+0000","last_change":"2024-04-18T04:55:55.479261+0000","last_active":"2024-04-18T04:55:55.479159+0000","last_peered":"2024-04-18T04:55:55.479159+0000","last_clean":"2024-04-18T04:55:55.479159+0000","last_became_active":"2024-04-18T04:44:29.886058+0000","last_became_peered":"2024-04-18T04:44:29.886058+0000","last_unstale":"2024-04-18T04:55:55.479159+0000","last_undegraded":"2024-04-18T04:55:55.479159+0000","last_fullsized":"2024-04-18T04:55:55.479159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'27","last_scrub_stamp":"2024-04-18T04:55:55.479138+0000","last_deep_scrub":"32'27","last_deep_scrub_stamp":"2024-04-18T04:55:55.479138+0000","last_clean_scrub_stamp":"2024-04-18T04:55:55.479138+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:51:06.781945+0000","scrub_duration":0.019171673,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":23,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"32'4573","reported_seq":4622,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:11.686324+0000","last_change":"2024-04-18T04:56:11.686452+0000","last_active":"2024-04-18T04:56:11.686324+0000","last_peered":"2024-04-18T04:56:11.686324+0000","last_clean":"2024-04-18T04:56:11.686324+0000","last_became_active":"2024-04-18T04:45:12.373269+0000","last_became_peered":"2024-04-18T04:45:12.373269+0000","last_unstale":"2024-04-18T04:56:11.686324+0000","last_undegraded":"2024-04-18T04:56:11.686324+0000","last_fullsized":"2024-04-18T04:56:11.686324+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4573","last_scrub_stamp":"2024-04-18T04:56:11.686302+0000","last_deep_scrub":"32'4573","last_deep_scrub_stamp":"2024-04-18T04:56:11.686302+0000","last_clean_scrub_stamp":"2024-04-18T04:56:11.686302+0000","objects_scrubbed":0,"log_size":4573,"log_dups_size":0,"ondisk_log_size":4573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:05:21.377177+0000","scrub_duration":0.087948346999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":66919,"num_write_kb":952859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"32'11","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:05.126129+0000","last_change":"2024-04-18T04:56:05.126129+0000","last_active":"2024-04-18T04:56:05.126129+0000","last_peered":"2024-04-18T04:56:05.126129+0000","last_clean":"2024-04-18T04:56:05.126129+0000","last_became_active":"2024-04-18T04:45:12.042803+0000","last_became_peered":"2024-04-18T04:45:12.042803+0000","last_unstale":"2024-04-18T04:56:05.126129+0000","last_undegraded":"2024-04-18T04:56:05.126129+0000","last_fullsized":"2024-04-18T04:56:05.126129+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-04-18T04:56:05.126005+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-04-18T04:56:05.126005+0000","last_clean_scrub_stamp":"2024-04-18T04:56:05.126005+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:41:03.081229+0000","scrub_duration":0.11656122100000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"32'274","reported_seq":317,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.839246+0000","last_change":"2024-04-18T04:55:37.108330+0000","last_active":"2024-04-18T04:55:39.839246+0000","last_peered":"2024-04-18T04:55:39.839246+0000","last_clean":"2024-04-18T04:55:39.839246+0000","last_became_active":"2024-04-18T04:44:29.878361+0000","last_became_peered":"2024-04-18T04:44:29.878361+0000","last_unstale":"2024-04-18T04:55:39.839246+0000","last_undegraded":"2024-04-18T04:55:39.839246+0000","last_fullsized":"2024-04-18T04:55:39.839246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'271","last_scrub_stamp":"2024-04-18T04:55:37.108214+0000","last_deep_scrub":"32'271","last_deep_scrub_stamp":"2024-04-18T04:55:37.108214+0000","last_clean_scrub_stamp":"2024-04-18T04:55:37.108214+0000","objects_scrubbed":3,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:45:36.128941+0000","scrub_duration":0.015395397999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":678,"num_write":268,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7088,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"32'4411","reported_seq":4455,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:12.778619+0000","last_change":"2024-04-18T04:56:12.778813+0000","last_active":"2024-04-18T04:56:12.778619+0000","last_peered":"2024-04-18T04:56:12.778619+0000","last_clean":"2024-04-18T04:56:12.778619+0000","last_became_active":"2024-04-18T04:44:34.338042+0000","last_became_peered":"2024-04-18T04:44:34.338042+0000","last_unstale":"2024-04-18T04:56:12.778619+0000","last_undegraded":"2024-04-18T04:56:12.778619+0000","last_fullsized":"2024-04-18T04:56:12.778619+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4411","last_scrub_stamp":"2024-04-18T04:56:12.778597+0000","last_deep_scrub":"32'4411","last_deep_scrub_stamp":"2024-04-18T04:56:12.778597+0000","last_clean_scrub_stamp":"2024-04-18T04:56:12.778597+0000","objects_scrubbed":0,"log_size":4411,"log_dups_size":0,"ondisk_log_size":4411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:12:13.686072+0000","scrub_duration":0.163448752,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":64611,"num_write_kb":926956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"32'7","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:05.753005+0000","last_change":"2024-04-18T04:56:05.753171+0000","last_active":"2024-04-18T04:56:05.753005+0000","last_peered":"2024-04-18T04:56:05.753005+0000","last_clean":"2024-04-18T04:56:05.753005+0000","last_became_active":"2024-04-18T04:44:30.290379+0000","last_became_peered":"2024-04-18T04:44:30.290379+0000","last_unstale":"2024-04-18T04:56:05.753005+0000","last_undegraded":"2024-04-18T04:56:05.753005+0000","last_fullsized":"2024-04-18T04:56:05.753005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-04-18T04:56:05.752957+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-04-18T04:56:05.752957+0000","last_clean_scrub_stamp":"2024-04-18T04:56:05.752957+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:26:19.212850+0000","scrub_duration":0.0035311740000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"32'12","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.663717+0000","last_change":"2024-04-18T04:55:38.668893+0000","last_active":"2024-04-18T04:55:39.663717+0000","last_peered":"2024-04-18T04:55:39.663717+0000","last_clean":"2024-04-18T04:55:39.663717+0000","last_became_active":"2024-04-18T04:44:29.881671+0000","last_became_peered":"2024-04-18T04:44:29.881671+0000","last_unstale":"2024-04-18T04:55:39.663717+0000","last_undegraded":"2024-04-18T04:55:39.663717+0000","last_fullsized":"2024-04-18T04:55:39.663717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-04-18T04:55:38.668646+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-04-18T04:55:38.668646+0000","last_clean_scrub_stamp":"2024-04-18T04:55:38.668646+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:45:33.432081+0000","scrub_duration":0.0053390160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"32'4121","reported_seq":4166,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:11.869433+0000","last_change":"2024-04-18T04:56:11.869669+0000","last_active":"2024-04-18T04:56:11.869433+0000","last_peered":"2024-04-18T04:56:11.869433+0000","last_clean":"2024-04-18T04:56:11.869433+0000","last_became_active":"2024-04-18T04:44:34.340327+0000","last_became_peered":"2024-04-18T04:44:34.340327+0000","last_unstale":"2024-04-18T04:56:11.869433+0000","last_undegraded":"2024-04-18T04:56:11.869433+0000","last_fullsized":"2024-04-18T04:56:11.869433+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4121","last_scrub_stamp":"2024-04-18T04:56:11.869385+0000","last_deep_scrub":"32'4121","last_deep_scrub_stamp":"2024-04-18T04:56:11.869385+0000","last_clean_scrub_stamp":"2024-04-18T04:56:11.869385+0000","objects_scrubbed":0,"log_size":4121,"log_dups_size":0,"ondisk_log_size":4121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:05:40.214948+0000","scrub_duration":0.064509755000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":60260,"num_write_kb":847949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"32'12","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:14.684986+0000","last_change":"2024-04-18T04:56:14.685197+0000","last_active":"2024-04-18T04:56:14.684986+0000","last_peered":"2024-04-18T04:56:14.684986+0000","last_clean":"2024-04-18T04:56:14.684986+0000","last_became_active":"2024-04-18T04:44:30.298417+0000","last_became_peered":"2024-04-18T04:44:30.298417+0000","last_unstale":"2024-04-18T04:56:14.684986+0000","last_undegraded":"2024-04-18T04:56:14.684986+0000","last_fullsized":"2024-04-18T04:56:14.684986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-04-18T04:56:14.684930+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-04-18T04:56:14.684930+0000","last_clean_scrub_stamp":"2024-04-18T04:56:14.684930+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:15:43.272876+0000","scrub_duration":0.0035795190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"32'30","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:46.187598+0000","last_change":"2024-04-18T04:55:46.187598+0000","last_active":"2024-04-18T04:55:46.187598+0000","last_peered":"2024-04-18T04:55:46.187598+0000","last_clean":"2024-04-18T04:55:46.187598+0000","last_became_active":"2024-04-18T04:44:29.875059+0000","last_became_peered":"2024-04-18T04:44:29.875059+0000","last_unstale":"2024-04-18T04:55:46.187598+0000","last_undegraded":"2024-04-18T04:55:46.187598+0000","last_fullsized":"2024-04-18T04:55:46.187598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'30","last_scrub_stamp":"2024-04-18T04:55:46.187488+0000","last_deep_scrub":"32'30","last_deep_scrub_stamp":"2024-04-18T04:55:46.187488+0000","last_clean_scrub_stamp":"2024-04-18T04:55:46.187488+0000","objects_scrubbed":8,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:10:21.355167+0000","scrub_duration":0.0053312890000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":44,"num_read_kb":43,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"32'5105","reported_seq":5144,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:12.653035+0000","last_change":"2024-04-18T04:56:12.653176+0000","last_active":"2024-04-18T04:56:12.653035+0000","last_peered":"2024-04-18T04:56:12.653035+0000","last_clean":"2024-04-18T04:56:12.653035+0000","last_became_active":"2024-04-18T04:44:34.334192+0000","last_became_peered":"2024-04-18T04:44:34.334192+0000","last_unstale":"2024-04-18T04:56:12.653035+0000","last_undegraded":"2024-04-18T04:56:12.653035+0000","last_fullsized":"2024-04-18T04:56:12.653035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5105","last_scrub_stamp":"2024-04-18T04:56:12.653015+0000","last_deep_scrub":"32'5105","last_deep_scrub_stamp":"2024-04-18T04:56:12.653015+0000","last_clean_scrub_stamp":"2024-04-18T04:56:12.653015+0000","objects_scrubbed":0,"log_size":5105,"log_dups_size":0,"ondisk_log_size":5105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:47:28.273505+0000","scrub_duration":0.081297269000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":74408,"num_write_kb":1061210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:52.569224+0000","last_change":"2024-04-18T04:55:52.569224+0000","last_active":"2024-04-18T04:55:52.569224+0000","last_peered":"2024-04-18T04:55:52.569224+0000","last_clean":"2024-04-18T04:55:52.569224+0000","last_became_active":"2024-04-18T04:44:30.295404+0000","last_became_peered":"2024-04-18T04:44:30.295404+0000","last_unstale":"2024-04-18T04:55:52.569224+0000","last_undegraded":"2024-04-18T04:55:52.569224+0000","last_fullsized":"2024-04-18T04:55:52.569224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-18T04:55:52.568955+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-18T04:55:52.568955+0000","last_clean_scrub_stamp":"2024-04-18T04:55:52.568955+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:50:34.888052+0000","scrub_duration":0.0032512019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"32'19","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.737684+0000","last_change":"2024-04-18T04:55:39.372542+0000","last_active":"2024-04-18T04:55:39.737684+0000","last_peered":"2024-04-18T04:55:39.737684+0000","last_clean":"2024-04-18T04:55:39.737684+0000","last_became_active":"2024-04-18T04:44:29.893668+0000","last_became_peered":"2024-04-18T04:44:29.893668+0000","last_unstale":"2024-04-18T04:55:39.737684+0000","last_undegraded":"2024-04-18T04:55:39.737684+0000","last_fullsized":"2024-04-18T04:55:39.737684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-04-18T04:55:39.372420+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-04-18T04:55:39.372420+0000","last_clean_scrub_stamp":"2024-04-18T04:55:39.372420+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:51:03.179934+0000","scrub_duration":0.030124604999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1711,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":12,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5866,"num_omap_keys":11,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"32'5194","reported_seq":5243,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:13.764373+0000","last_change":"2024-04-18T04:56:13.764494+0000","last_active":"2024-04-18T04:56:13.764373+0000","last_peered":"2024-04-18T04:56:13.764373+0000","last_clean":"2024-04-18T04:56:13.764373+0000","last_became_active":"2024-04-18T04:45:12.056680+0000","last_became_peered":"2024-04-18T04:45:12.056680+0000","last_unstale":"2024-04-18T04:56:13.764373+0000","last_undegraded":"2024-04-18T04:56:13.764373+0000","last_fullsized":"2024-04-18T04:56:13.764373+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5194","last_scrub_stamp":"2024-04-18T04:56:13.764352+0000","last_deep_scrub":"32'5194","last_deep_scrub_stamp":"2024-04-18T04:56:13.764352+0000","last_clean_scrub_stamp":"2024-04-18T04:56:13.764352+0000","objects_scrubbed":0,"log_size":5194,"log_dups_size":0,"ondisk_log_size":5194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:49:55.046692+0000","scrub_duration":0.122515213,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":76118,"num_write_kb":1080690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'25","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:04.733053+0000","last_change":"2024-04-18T04:56:04.733053+0000","last_active":"2024-04-18T04:56:04.733053+0000","last_peered":"2024-04-18T04:56:04.733053+0000","last_clean":"2024-04-18T04:56:04.733053+0000","last_became_active":"2024-04-18T04:44:30.288364+0000","last_became_peered":"2024-04-18T04:44:30.288364+0000","last_unstale":"2024-04-18T04:56:04.733053+0000","last_undegraded":"2024-04-18T04:56:04.733053+0000","last_fullsized":"2024-04-18T04:56:04.733053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2024-04-18T04:56:04.732768+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2024-04-18T04:56:04.732768+0000","last_clean_scrub_stamp":"2024-04-18T04:56:04.732768+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:22:43.000995+0000","scrub_duration":0.0072562310000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"32'9","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:47.610138+0000","last_change":"2024-04-18T04:55:47.610138+0000","last_active":"2024-04-18T04:55:47.610138+0000","last_peered":"2024-04-18T04:55:47.610138+0000","last_clean":"2024-04-18T04:55:47.610138+0000","last_became_active":"2024-04-18T04:44:29.889150+0000","last_became_peered":"2024-04-18T04:44:29.889150+0000","last_unstale":"2024-04-18T04:55:47.610138+0000","last_undegraded":"2024-04-18T04:55:47.610138+0000","last_fullsized":"2024-04-18T04:55:47.610138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-18T04:55:47.609828+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-18T04:55:47.609828+0000","last_clean_scrub_stamp":"2024-04-18T04:55:47.609828+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:14:23.527947+0000","scrub_duration":0.0044473270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'4551","reported_seq":4593,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:10.791379+0000","last_change":"2024-04-18T04:56:10.791379+0000","last_active":"2024-04-18T04:56:10.791379+0000","last_peered":"2024-04-18T04:56:10.791379+0000","last_clean":"2024-04-18T04:56:10.791379+0000","last_became_active":"2024-04-18T04:44:34.305341+0000","last_became_peered":"2024-04-18T04:44:34.305341+0000","last_unstale":"2024-04-18T04:56:10.791379+0000","last_undegraded":"2024-04-18T04:56:10.791379+0000","last_fullsized":"2024-04-18T04:56:10.791379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4551","last_scrub_stamp":"2024-04-18T04:56:10.791224+0000","last_deep_scrub":"32'4551","last_deep_scrub_stamp":"2024-04-18T04:56:10.791224+0000","last_clean_scrub_stamp":"2024-04-18T04:56:10.791224+0000","objects_scrubbed":0,"log_size":4551,"log_dups_size":0,"ondisk_log_size":4551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:23:23.184308+0000","scrub_duration":0.13359138000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":66735,"num_write_kb":961503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'10","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:00.619208+0000","last_change":"2024-04-18T04:56:00.619208+0000","last_active":"2024-04-18T04:56:00.619208+0000","last_peered":"2024-04-18T04:56:00.619208+0000","last_clean":"2024-04-18T04:56:00.619208+0000","last_became_active":"2024-04-18T04:44:30.306726+0000","last_became_peered":"2024-04-18T04:44:30.306726+0000","last_unstale":"2024-04-18T04:56:00.619208+0000","last_undegraded":"2024-04-18T04:56:00.619208+0000","last_fullsized":"2024-04-18T04:56:00.619208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-18T04:56:00.619107+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-18T04:56:00.619107+0000","last_clean_scrub_stamp":"2024-04-18T04:56:00.619107+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:52:49.090454+0000","scrub_duration":0.0023757240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"32'43","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.823187+0000","last_change":"2024-04-18T04:55:35.470607+0000","last_active":"2024-04-18T04:55:39.823187+0000","last_peered":"2024-04-18T04:55:39.823187+0000","last_clean":"2024-04-18T04:55:39.823187+0000","last_became_active":"2024-04-18T04:44:29.887095+0000","last_became_peered":"2024-04-18T04:44:29.887095+0000","last_unstale":"2024-04-18T04:55:39.823187+0000","last_undegraded":"2024-04-18T04:55:39.823187+0000","last_fullsized":"2024-04-18T04:55:39.823187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'40","last_scrub_stamp":"2024-04-18T04:55:35.470495+0000","last_deep_scrub":"32'40","last_deep_scrub_stamp":"2024-04-18T04:55:35.470495+0000","last_clean_scrub_stamp":"2024-04-18T04:55:35.470495+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:22:22.552307+0000","scrub_duration":0.035712923000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":31,"num_read_kb":8224,"num_write":33,"num_write_kb":8211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"32'4785","reported_seq":4824,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:15.781786+0000","last_change":"2024-04-18T04:56:15.781934+0000","last_active":"2024-04-18T04:56:15.781786+0000","last_peered":"2024-04-18T04:56:15.781786+0000","last_clean":"2024-04-18T04:56:15.781786+0000","last_became_active":"2024-04-18T04:44:34.320776+0000","last_became_peered":"2024-04-18T04:44:34.320776+0000","last_unstale":"2024-04-18T04:56:15.781786+0000","last_undegraded":"2024-04-18T04:56:15.781786+0000","last_fullsized":"2024-04-18T04:56:15.781786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4785","last_scrub_stamp":"2024-04-18T04:56:15.781760+0000","last_deep_scrub":"32'4785","last_deep_scrub_stamp":"2024-04-18T04:56:15.781760+0000","last_clean_scrub_stamp":"2024-04-18T04:56:15.781760+0000","objects_scrubbed":0,"log_size":4785,"log_dups_size":0,"ondisk_log_size":4785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:22:39.933533+0000","scrub_duration":0.19696786199999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":70304,"num_write_kb":986201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"32'8","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:13.727188+0000","last_change":"2024-04-18T04:56:13.727188+0000","last_active":"2024-04-18T04:56:13.727188+0000","last_peered":"2024-04-18T04:56:13.727188+0000","last_clean":"2024-04-18T04:56:13.727188+0000","last_became_active":"2024-04-18T04:44:30.293185+0000","last_became_peered":"2024-04-18T04:44:30.293185+0000","last_unstale":"2024-04-18T04:56:13.727188+0000","last_undegraded":"2024-04-18T04:56:13.727188+0000","last_fullsized":"2024-04-18T04:56:13.727188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-18T04:56:13.726883+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-18T04:56:13.726883+0000","last_clean_scrub_stamp":"2024-04-18T04:56:13.726883+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:09:07.850930+0000","scrub_duration":0.0077545139999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"32'234","reported_seq":281,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:42.418311+0000","last_change":"2024-04-18T04:55:42.418311+0000","last_active":"2024-04-18T04:55:42.418311+0000","last_peered":"2024-04-18T04:55:42.418311+0000","last_clean":"2024-04-18T04:55:42.418311+0000","last_became_active":"2024-04-18T04:44:29.892647+0000","last_became_peered":"2024-04-18T04:44:29.892647+0000","last_unstale":"2024-04-18T04:55:42.418311+0000","last_undegraded":"2024-04-18T04:55:42.418311+0000","last_fullsized":"2024-04-18T04:55:42.418311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'234","last_scrub_stamp":"2024-04-18T04:55:42.418044+0000","last_deep_scrub":"32'234","last_deep_scrub_stamp":"2024-04-18T04:55:42.418044+0000","last_clean_scrub_stamp":"2024-04-18T04:55:42.418044+0000","objects_scrubbed":5,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:33:18.193509+0000","scrub_duration":0.029742009,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":21,"num_read_kb":4116,"num_write":228,"num_write_kb":4214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"32'4396","reported_seq":4438,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:02.512908+0000","last_change":"2024-04-18T04:56:02.512908+0000","last_active":"2024-04-18T04:56:02.512908+0000","last_peered":"2024-04-18T04:56:02.512908+0000","last_clean":"2024-04-18T04:56:02.512908+0000","last_became_active":"2024-04-18T04:44:34.337486+0000","last_became_peered":"2024-04-18T04:44:34.337486+0000","last_unstale":"2024-04-18T04:56:02.512908+0000","last_undegraded":"2024-04-18T04:56:02.512908+0000","last_fullsized":"2024-04-18T04:56:02.512908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4396","last_scrub_stamp":"2024-04-18T04:56:02.512772+0000","last_deep_scrub":"32'4396","last_deep_scrub_stamp":"2024-04-18T04:56:02.512772+0000","last_clean_scrub_stamp":"2024-04-18T04:56:02.512772+0000","objects_scrubbed":0,"log_size":4396,"log_dups_size":0,"ondisk_log_size":4396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:51:35.718269+0000","scrub_duration":0.11782891099999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1,"num_write":64313,"num_write_kb":903689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"32'14","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.850719+0000","last_change":"2024-04-18T04:55:39.618022+0000","last_active":"2024-04-18T04:55:39.850719+0000","last_peered":"2024-04-18T04:55:39.850719+0000","last_clean":"2024-04-18T04:55:39.850719+0000","last_became_active":"2024-04-18T04:44:30.307237+0000","last_became_peered":"2024-04-18T04:44:30.307237+0000","last_unstale":"2024-04-18T04:55:39.850719+0000","last_undegraded":"2024-04-18T04:55:39.850719+0000","last_fullsized":"2024-04-18T04:55:39.850719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-18T04:55:39.617881+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-18T04:55:39.617881+0000","last_clean_scrub_stamp":"2024-04-18T04:55:39.617881+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:45:32.468555+0000","scrub_duration":0.0024657490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"32'21","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:57.424110+0000","last_change":"2024-04-18T04:55:57.424110+0000","last_active":"2024-04-18T04:55:57.424110+0000","last_peered":"2024-04-18T04:55:57.424110+0000","last_clean":"2024-04-18T04:55:57.424110+0000","last_became_active":"2024-04-18T04:44:29.898113+0000","last_became_peered":"2024-04-18T04:44:29.898113+0000","last_unstale":"2024-04-18T04:55:57.424110+0000","last_undegraded":"2024-04-18T04:55:57.424110+0000","last_fullsized":"2024-04-18T04:55:57.424110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-04-18T04:55:57.424010+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-04-18T04:55:57.424010+0000","last_clean_scrub_stamp":"2024-04-18T04:55:57.424010+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:19:23.487965+0000","scrub_duration":0.0061927750000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":19,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'5543","reported_seq":5583,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:09.935679+0000","last_change":"2024-04-18T04:56:09.935679+0000","last_active":"2024-04-18T04:56:09.935679+0000","last_peered":"2024-04-18T04:56:09.935679+0000","last_clean":"2024-04-18T04:56:09.935679+0000","last_became_active":"2024-04-18T04:44:34.343636+0000","last_became_peered":"2024-04-18T04:44:34.343636+0000","last_unstale":"2024-04-18T04:56:09.935679+0000","last_undegraded":"2024-04-18T04:56:09.935679+0000","last_fullsized":"2024-04-18T04:56:09.935679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5543","last_scrub_stamp":"2024-04-18T04:56:09.935390+0000","last_deep_scrub":"32'5543","last_deep_scrub_stamp":"2024-04-18T04:56:09.935390+0000","last_clean_scrub_stamp":"2024-04-18T04:56:09.935390+0000","objects_scrubbed":0,"log_size":5543,"log_dups_size":0,"ondisk_log_size":5543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:21:06.087982+0000","scrub_duration":0.13318435200000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":7,"num_write":81014,"num_write_kb":1156235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"32'12","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:54.652162+0000","last_change":"2024-04-18T04:55:54.652263+0000","last_active":"2024-04-18T04:55:54.652162+0000","last_peered":"2024-04-18T04:55:54.652162+0000","last_clean":"2024-04-18T04:55:54.652162+0000","last_became_active":"2024-04-18T04:44:30.290127+0000","last_became_peered":"2024-04-18T04:44:30.290127+0000","last_unstale":"2024-04-18T04:55:54.652162+0000","last_undegraded":"2024-04-18T04:55:54.652162+0000","last_fullsized":"2024-04-18T04:55:54.652162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-04-18T04:55:54.652143+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-04-18T04:55:54.652143+0000","last_clean_scrub_stamp":"2024-04-18T04:55:54.652143+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:42:59.936226+0000","scrub_duration":0.043655591000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"32'6","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:46.605787+0000","last_change":"2024-04-18T04:55:46.605787+0000","last_active":"2024-04-18T04:55:46.605787+0000","last_peered":"2024-04-18T04:55:46.605787+0000","last_clean":"2024-04-18T04:55:46.605787+0000","last_became_active":"2024-04-18T04:44:29.895083+0000","last_became_peered":"2024-04-18T04:44:29.895083+0000","last_unstale":"2024-04-18T04:55:46.605787+0000","last_undegraded":"2024-04-18T04:55:46.605787+0000","last_fullsized":"2024-04-18T04:55:46.605787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-18T04:55:46.605493+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-18T04:55:46.605493+0000","last_clean_scrub_stamp":"2024-04-18T04:55:46.605493+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:59:10.105864+0000","scrub_duration":0.005528097,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"32'4755","reported_seq":4796,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:24.866401+0000","last_change":"2024-04-18T04:56:24.866544+0000","last_active":"2024-04-18T04:56:24.866401+0000","last_peered":"2024-04-18T04:56:24.866401+0000","last_clean":"2024-04-18T04:56:24.866401+0000","last_became_active":"2024-04-18T04:44:34.338062+0000","last_became_peered":"2024-04-18T04:44:34.338062+0000","last_unstale":"2024-04-18T04:56:24.866401+0000","last_undegraded":"2024-04-18T04:56:24.866401+0000","last_fullsized":"2024-04-18T04:56:24.866401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4755","last_scrub_stamp":"2024-04-18T04:56:24.866381+0000","last_deep_scrub":"32'4755","last_deep_scrub_stamp":"2024-04-18T04:56:24.866381+0000","last_clean_scrub_stamp":"2024-04-18T04:56:24.866381+0000","objects_scrubbed":0,"log_size":4755,"log_dups_size":0,"ondisk_log_size":4755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:55:55.697655+0000","scrub_duration":0.083445299000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":69757,"num_write_kb":985522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"32'13","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:48.623813+0000","last_change":"2024-04-18T04:55:48.623813+0000","last_active":"2024-04-18T04:55:48.623813+0000","last_peered":"2024-04-18T04:55:48.623813+0000","last_clean":"2024-04-18T04:55:48.623813+0000","last_became_active":"2024-04-18T04:44:30.307168+0000","last_became_peered":"2024-04-18T04:44:30.307168+0000","last_unstale":"2024-04-18T04:55:48.623813+0000","last_undegraded":"2024-04-18T04:55:48.623813+0000","last_fullsized":"2024-04-18T04:55:48.623813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-04-18T04:55:48.623571+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-04-18T04:55:48.623571+0000","last_clean_scrub_stamp":"2024-04-18T04:55:48.623571+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:03:03.003462+0000","scrub_duration":0.053707861000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"32'12","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:49.458557+0000","last_change":"2024-04-18T04:55:49.458557+0000","last_active":"2024-04-18T04:55:49.458557+0000","last_peered":"2024-04-18T04:55:49.458557+0000","last_clean":"2024-04-18T04:55:49.458557+0000","last_became_active":"2024-04-18T04:44:29.902647+0000","last_became_peered":"2024-04-18T04:44:29.902647+0000","last_unstale":"2024-04-18T04:55:49.458557+0000","last_undegraded":"2024-04-18T04:55:49.458557+0000","last_fullsized":"2024-04-18T04:55:49.458557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-04-18T04:55:49.458295+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-04-18T04:55:49.458295+0000","last_clean_scrub_stamp":"2024-04-18T04:55:49.458295+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:59:11.252717+0000","scrub_duration":0.0067466690000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"32'5962","reported_seq":6003,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:05.799284+0000","last_change":"2024-04-18T04:56:05.799284+0000","last_active":"2024-04-18T04:56:05.799284+0000","last_peered":"2024-04-18T04:56:05.799284+0000","last_clean":"2024-04-18T04:56:05.799284+0000","last_became_active":"2024-04-18T04:44:34.338288+0000","last_became_peered":"2024-04-18T04:44:34.338288+0000","last_unstale":"2024-04-18T04:56:05.799284+0000","last_undegraded":"2024-04-18T04:56:05.799284+0000","last_fullsized":"2024-04-18T04:56:05.799284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5962","last_scrub_stamp":"2024-04-18T04:56:05.799140+0000","last_deep_scrub":"32'5962","last_deep_scrub_stamp":"2024-04-18T04:56:05.799140+0000","last_clean_scrub_stamp":"2024-04-18T04:56:05.799140+0000","objects_scrubbed":0,"log_size":5962,"log_dups_size":0,"ondisk_log_size":5962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:05:20.863879+0000","scrub_duration":0.142364307,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":87687,"num_write_kb":1229683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"32'4075","reported_seq":4115,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:17.627359+0000","last_change":"2024-04-18T04:56:17.627496+0000","last_active":"2024-04-18T04:56:17.627359+0000","last_peered":"2024-04-18T04:56:17.627359+0000","last_clean":"2024-04-18T04:56:17.627359+0000","last_became_active":"2024-04-18T04:44:34.306657+0000","last_became_peered":"2024-04-18T04:44:34.306657+0000","last_unstale":"2024-04-18T04:56:17.627359+0000","last_undegraded":"2024-04-18T04:56:17.627359+0000","last_fullsized":"2024-04-18T04:56:17.627359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4075","last_scrub_stamp":"2024-04-18T04:56:17.627339+0000","last_deep_scrub":"32'4075","last_deep_scrub_stamp":"2024-04-18T04:56:17.627339+0000","last_clean_scrub_stamp":"2024-04-18T04:56:17.627339+0000","objects_scrubbed":0,"log_size":4075,"log_dups_size":0,"ondisk_log_size":4075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:48:39.530008+0000","scrub_duration":0.103084825,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":59702,"num_write_kb":838973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'14","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.695897+0000","last_change":"2024-04-18T04:55:34.435507+0000","last_active":"2024-04-18T04:55:39.695897+0000","last_peered":"2024-04-18T04:55:39.695897+0000","last_clean":"2024-04-18T04:55:39.695897+0000","last_became_active":"2024-04-18T04:44:30.271619+0000","last_became_peered":"2024-04-18T04:44:30.271619+0000","last_unstale":"2024-04-18T04:55:39.695897+0000","last_undegraded":"2024-04-18T04:55:39.695897+0000","last_fullsized":"2024-04-18T04:55:39.695897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-18T04:55:34.435387+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-18T04:55:34.435387+0000","last_clean_scrub_stamp":"2024-04-18T04:55:34.435387+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:54:07.144675+0000","scrub_duration":0.0023265299999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"32'54","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:43.553948+0000","last_change":"2024-04-18T04:55:43.553948+0000","last_active":"2024-04-18T04:55:43.553948+0000","last_peered":"2024-04-18T04:55:43.553948+0000","last_clean":"2024-04-18T04:55:43.553948+0000","last_became_active":"2024-04-18T04:44:29.889922+0000","last_became_peered":"2024-04-18T04:44:29.889922+0000","last_unstale":"2024-04-18T04:55:43.553948+0000","last_undegraded":"2024-04-18T04:55:43.553948+0000","last_fullsized":"2024-04-18T04:55:43.553948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'54","last_scrub_stamp":"2024-04-18T04:55:43.553684+0000","last_deep_scrub":"32'54","last_deep_scrub_stamp":"2024-04-18T04:55:43.553684+0000","last_clean_scrub_stamp":"2024-04-18T04:55:43.553684+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:19:01.902021+0000","scrub_duration":0.039263570999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":45,"num_write_kb":8216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4567","reported_seq":4610,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:28.078585+0000","last_change":"2024-04-18T04:56:28.078866+0000","last_active":"2024-04-18T04:56:28.078585+0000","last_peered":"2024-04-18T04:56:28.078585+0000","last_clean":"2024-04-18T04:56:28.078585+0000","last_became_active":"2024-04-18T04:44:34.332551+0000","last_became_peered":"2024-04-18T04:44:34.332551+0000","last_unstale":"2024-04-18T04:56:28.078585+0000","last_undegraded":"2024-04-18T04:56:28.078585+0000","last_fullsized":"2024-04-18T04:56:28.078585+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4567","last_scrub_stamp":"2024-04-18T04:56:28.078528+0000","last_deep_scrub":"32'4567","last_deep_scrub_stamp":"2024-04-18T04:56:28.078528+0000","last_clean_scrub_stamp":"2024-04-18T04:56:28.078528+0000","objects_scrubbed":0,"log_size":4567,"log_dups_size":0,"ondisk_log_size":4567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:13:46.985009+0000","scrub_duration":0.14448513800000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":66761,"num_write_kb":945017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"32'16","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:57.643672+0000","last_change":"2024-04-18T04:55:57.643751+0000","last_active":"2024-04-18T04:55:57.643672+0000","last_peered":"2024-04-18T04:55:57.643672+0000","last_clean":"2024-04-18T04:55:57.643672+0000","last_became_active":"2024-04-18T04:44:30.270804+0000","last_became_peered":"2024-04-18T04:44:30.270804+0000","last_unstale":"2024-04-18T04:55:57.643672+0000","last_undegraded":"2024-04-18T04:55:57.643672+0000","last_fullsized":"2024-04-18T04:55:57.643672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-04-18T04:55:57.643654+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-04-18T04:55:57.643654+0000","last_clean_scrub_stamp":"2024-04-18T04:55:57.643654+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:23:05.773805+0000","scrub_duration":0.0013667989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"32'7","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:45.522305+0000","last_change":"2024-04-18T04:55:45.522393+0000","last_active":"2024-04-18T04:55:45.522305+0000","last_peered":"2024-04-18T04:55:45.522305+0000","last_clean":"2024-04-18T04:55:45.522305+0000","last_became_active":"2024-04-18T04:44:29.894829+0000","last_became_peered":"2024-04-18T04:44:29.894829+0000","last_unstale":"2024-04-18T04:55:45.522305+0000","last_undegraded":"2024-04-18T04:55:45.522305+0000","last_fullsized":"2024-04-18T04:55:45.522305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-04-18T04:55:45.522283+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-04-18T04:55:45.522283+0000","last_clean_scrub_stamp":"2024-04-18T04:55:45.522283+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:55:12.590156+0000","scrub_duration":0.004192093,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"32'11","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:48.487889+0000","last_change":"2024-04-18T04:55:48.488099+0000","last_active":"2024-04-18T04:55:48.487889+0000","last_peered":"2024-04-18T04:55:48.487889+0000","last_clean":"2024-04-18T04:55:48.487889+0000","last_became_active":"2024-04-18T04:44:29.892282+0000","last_became_peered":"2024-04-18T04:44:29.892282+0000","last_unstale":"2024-04-18T04:55:48.487889+0000","last_undegraded":"2024-04-18T04:55:48.487889+0000","last_fullsized":"2024-04-18T04:55:48.487889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-04-18T04:55:48.487833+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-04-18T04:55:48.487833+0000","last_clean_scrub_stamp":"2024-04-18T04:55:48.487833+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:31:55.892667+0000","scrub_duration":0.023028330999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":4108,"num_write":6,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"32'11","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:58.639049+0000","last_change":"2024-04-18T04:55:58.639159+0000","last_active":"2024-04-18T04:55:58.639049+0000","last_peered":"2024-04-18T04:55:58.639049+0000","last_clean":"2024-04-18T04:55:58.639049+0000","last_became_active":"2024-04-18T04:44:30.285055+0000","last_became_peered":"2024-04-18T04:44:30.285055+0000","last_unstale":"2024-04-18T04:55:58.639049+0000","last_undegraded":"2024-04-18T04:55:58.639049+0000","last_fullsized":"2024-04-18T04:55:58.639049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-04-18T04:55:58.639031+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-04-18T04:55:58.639031+0000","last_clean_scrub_stamp":"2024-04-18T04:55:58.639031+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:45:02.934723+0000","scrub_duration":0.025810151,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"32'4897","reported_seq":4935,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:57.202824+0000","last_change":"2024-04-18T04:55:57.203004+0000","last_active":"2024-04-18T04:55:57.202824+0000","last_peered":"2024-04-18T04:55:57.202824+0000","last_clean":"2024-04-18T04:55:57.202824+0000","last_became_active":"2024-04-18T04:44:34.321645+0000","last_became_peered":"2024-04-18T04:44:34.321645+0000","last_unstale":"2024-04-18T04:55:57.202824+0000","last_undegraded":"2024-04-18T04:55:57.202824+0000","last_fullsized":"2024-04-18T04:55:57.202824+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4897","last_scrub_stamp":"2024-04-18T04:55:57.202804+0000","last_deep_scrub":"32'4897","last_deep_scrub_stamp":"2024-04-18T04:55:57.202804+0000","last_clean_scrub_stamp":"2024-04-18T04:55:57.202804+0000","objects_scrubbed":0,"log_size":4897,"log_dups_size":0,"ondisk_log_size":4897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:56:34.996758+0000","scrub_duration":0.171972929,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":71816,"num_write_kb":1022773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"32'1268","reported_seq":1312,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:52.585584+0000","last_change":"2024-04-18T04:55:52.585682+0000","last_active":"2024-04-18T04:55:52.585584+0000","last_peered":"2024-04-18T04:55:52.585584+0000","last_clean":"2024-04-18T04:55:52.585584+0000","last_became_active":"2024-04-18T04:44:29.891610+0000","last_became_peered":"2024-04-18T04:44:29.891610+0000","last_unstale":"2024-04-18T04:55:52.585584+0000","last_undegraded":"2024-04-18T04:55:52.585584+0000","last_fullsized":"2024-04-18T04:55:52.585584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'1268","last_scrub_stamp":"2024-04-18T04:55:52.585564+0000","last_deep_scrub":"32'1268","last_deep_scrub_stamp":"2024-04-18T04:55:52.585564+0000","last_clean_scrub_stamp":"2024-04-18T04:55:52.585564+0000","objects_scrubbed":3,"log_size":1268,"log_dups_size":0,"ondisk_log_size":1268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:31:27.987253+0000","scrub_duration":0.029907377999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195509,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":4100,"num_write":1255,"num_write_kb":4235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"32'12","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:44.699287+0000","last_change":"2024-04-18T04:55:44.699508+0000","last_active":"2024-04-18T04:55:44.699287+0000","last_peered":"2024-04-18T04:55:44.699287+0000","last_clean":"2024-04-18T04:55:44.699287+0000","last_became_active":"2024-04-18T04:44:30.278275+0000","last_became_peered":"2024-04-18T04:44:30.278275+0000","last_unstale":"2024-04-18T04:55:44.699287+0000","last_undegraded":"2024-04-18T04:55:44.699287+0000","last_fullsized":"2024-04-18T04:55:44.699287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-04-18T04:55:44.699232+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-04-18T04:55:44.699232+0000","last_clean_scrub_stamp":"2024-04-18T04:55:44.699232+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:13:54.970200+0000","scrub_duration":0.026423889999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'4563","reported_seq":4601,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:27.857865+0000","last_change":"2024-04-18T04:56:27.858016+0000","last_active":"2024-04-18T04:56:27.857865+0000","last_peered":"2024-04-18T04:56:27.857865+0000","last_clean":"2024-04-18T04:56:27.857865+0000","last_became_active":"2024-04-18T04:44:34.313416+0000","last_became_peered":"2024-04-18T04:44:34.313416+0000","last_unstale":"2024-04-18T04:56:27.857865+0000","last_undegraded":"2024-04-18T04:56:27.857865+0000","last_fullsized":"2024-04-18T04:56:27.857865+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4563","last_scrub_stamp":"2024-04-18T04:56:27.857843+0000","last_deep_scrub":"32'4563","last_deep_scrub_stamp":"2024-04-18T04:56:27.857843+0000","last_clean_scrub_stamp":"2024-04-18T04:56:27.857843+0000","objects_scrubbed":0,"log_size":4563,"log_dups_size":0,"ondisk_log_size":4563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:59:39.043197+0000","scrub_duration":0.095126781999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":66470,"num_write_kb":963599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"32'18","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:03.767422+0000","last_change":"2024-04-18T04:56:03.767628+0000","last_active":"2024-04-18T04:56:03.767422+0000","last_peered":"2024-04-18T04:56:03.767422+0000","last_clean":"2024-04-18T04:56:03.767422+0000","last_became_active":"2024-04-18T04:44:30.296354+0000","last_became_peered":"2024-04-18T04:44:30.296354+0000","last_unstale":"2024-04-18T04:56:03.767422+0000","last_undegraded":"2024-04-18T04:56:03.767422+0000","last_fullsized":"2024-04-18T04:56:03.767422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-04-18T04:56:03.767367+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-04-18T04:56:03.767367+0000","last_clean_scrub_stamp":"2024-04-18T04:56:03.767367+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:07:26.620900+0000","scrub_duration":0.0027217090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"32'15","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:54.114852+0000","last_change":"2024-04-18T04:55:54.114945+0000","last_active":"2024-04-18T04:55:54.114852+0000","last_peered":"2024-04-18T04:55:54.114852+0000","last_clean":"2024-04-18T04:55:54.114852+0000","last_became_active":"2024-04-18T04:44:30.280941+0000","last_became_peered":"2024-04-18T04:44:30.280941+0000","last_unstale":"2024-04-18T04:55:54.114852+0000","last_undegraded":"2024-04-18T04:55:54.114852+0000","last_fullsized":"2024-04-18T04:55:54.114852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-04-18T04:55:54.114832+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-04-18T04:55:54.114832+0000","last_clean_scrub_stamp":"2024-04-18T04:55:54.114832+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:50:26.893196+0000","scrub_duration":0.030107505,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"32'13","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:59.590726+0000","last_change":"2024-04-18T04:55:59.590895+0000","last_active":"2024-04-18T04:55:59.590726+0000","last_peered":"2024-04-18T04:55:59.590726+0000","last_clean":"2024-04-18T04:55:59.590726+0000","last_became_active":"2024-04-18T04:44:30.287820+0000","last_became_peered":"2024-04-18T04:44:30.287820+0000","last_unstale":"2024-04-18T04:55:59.590726+0000","last_undegraded":"2024-04-18T04:55:59.590726+0000","last_fullsized":"2024-04-18T04:55:59.590726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-04-18T04:55:59.590679+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-04-18T04:55:59.590679+0000","last_clean_scrub_stamp":"2024-04-18T04:55:59.590679+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:25:34.648377+0000","scrub_duration":0.0025947409999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"32'10","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.886393+0000","last_change":"2024-04-18T04:55:33.440693+0000","last_active":"2024-04-18T04:55:39.886393+0000","last_peered":"2024-04-18T04:55:39.886393+0000","last_clean":"2024-04-18T04:55:39.886393+0000","last_became_active":"2024-04-18T04:44:30.272973+0000","last_became_peered":"2024-04-18T04:44:30.272973+0000","last_unstale":"2024-04-18T04:55:39.886393+0000","last_undegraded":"2024-04-18T04:55:39.886393+0000","last_fullsized":"2024-04-18T04:55:39.886393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-04-18T04:55:33.440498+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-04-18T04:55:33.440498+0000","last_clean_scrub_stamp":"2024-04-18T04:55:33.440498+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:02:28.528382+0000","scrub_duration":0.0040422899999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'8","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.685954+0000","last_change":"2024-04-18T04:55:36.653343+0000","last_active":"2024-04-18T04:55:39.685954+0000","last_peered":"2024-04-18T04:55:39.685954+0000","last_clean":"2024-04-18T04:55:39.685954+0000","last_became_active":"2024-04-18T04:44:30.298637+0000","last_became_peered":"2024-04-18T04:44:30.298637+0000","last_unstale":"2024-04-18T04:55:39.685954+0000","last_undegraded":"2024-04-18T04:55:39.685954+0000","last_fullsized":"2024-04-18T04:55:39.685954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-18T04:55:36.653251+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-18T04:55:36.653251+0000","last_clean_scrub_stamp":"2024-04-18T04:55:36.653251+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:40:18.803560+0000","scrub_duration":0.0023708309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"32'10","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:01.419357+0000","last_change":"2024-04-18T04:56:01.419471+0000","last_active":"2024-04-18T04:56:01.419357+0000","last_peered":"2024-04-18T04:56:01.419357+0000","last_clean":"2024-04-18T04:56:01.419357+0000","last_became_active":"2024-04-18T04:44:30.274328+0000","last_became_peered":"2024-04-18T04:44:30.274328+0000","last_unstale":"2024-04-18T04:56:01.419357+0000","last_undegraded":"2024-04-18T04:56:01.419357+0000","last_fullsized":"2024-04-18T04:56:01.419357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-18T04:56:01.419337+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-18T04:56:01.419337+0000","last_clean_scrub_stamp":"2024-04-18T04:56:01.419337+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:38:14.078605+0000","scrub_duration":0.049311784999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"32'20","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:06.779295+0000","last_change":"2024-04-18T04:56:06.779491+0000","last_active":"2024-04-18T04:56:06.779295+0000","last_peered":"2024-04-18T04:56:06.779295+0000","last_clean":"2024-04-18T04:56:06.779295+0000","last_became_active":"2024-04-18T04:44:30.308415+0000","last_became_peered":"2024-04-18T04:44:30.308415+0000","last_unstale":"2024-04-18T04:56:06.779295+0000","last_undegraded":"2024-04-18T04:56:06.779295+0000","last_fullsized":"2024-04-18T04:56:06.779295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-04-18T04:56:06.779242+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-04-18T04:56:06.779242+0000","last_clean_scrub_stamp":"2024-04-18T04:56:06.779242+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:49:12.866749+0000","scrub_duration":0.0030912359999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"32'6","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:04.659801+0000","last_change":"2024-04-18T04:56:04.659916+0000","last_active":"2024-04-18T04:56:04.659801+0000","last_peered":"2024-04-18T04:56:04.659801+0000","last_clean":"2024-04-18T04:56:04.659801+0000","last_became_active":"2024-04-18T04:44:30.293748+0000","last_became_peered":"2024-04-18T04:44:30.293748+0000","last_unstale":"2024-04-18T04:56:04.659801+0000","last_undegraded":"2024-04-18T04:56:04.659801+0000","last_fullsized":"2024-04-18T04:56:04.659801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-18T04:56:04.659780+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-18T04:56:04.659780+0000","last_clean_scrub_stamp":"2024-04-18T04:56:04.659780+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:51:48.841753+0000","scrub_duration":0.034517979999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"32'9","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:01.013443+0000","last_change":"2024-04-18T04:56:01.013443+0000","last_active":"2024-04-18T04:56:01.013443+0000","last_peered":"2024-04-18T04:56:01.013443+0000","last_clean":"2024-04-18T04:56:01.013443+0000","last_became_active":"2024-04-18T04:45:12.040045+0000","last_became_peered":"2024-04-18T04:45:12.040045+0000","last_unstale":"2024-04-18T04:56:01.013443+0000","last_undegraded":"2024-04-18T04:56:01.013443+0000","last_fullsized":"2024-04-18T04:56:01.013443+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-18T04:56:01.013349+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-18T04:56:01.013349+0000","last_clean_scrub_stamp":"2024-04-18T04:56:01.013349+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:46:27.766760+0000","scrub_duration":0.0013506869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"32'12","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:56.662089+0000","last_change":"2024-04-18T04:55:56.662165+0000","last_active":"2024-04-18T04:55:56.662089+0000","last_peered":"2024-04-18T04:55:56.662089+0000","last_clean":"2024-04-18T04:55:56.662089+0000","last_became_active":"2024-04-18T04:44:30.285602+0000","last_became_peered":"2024-04-18T04:44:30.285602+0000","last_unstale":"2024-04-18T04:55:56.662089+0000","last_undegraded":"2024-04-18T04:55:56.662089+0000","last_fullsized":"2024-04-18T04:55:56.662089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-04-18T04:55:56.662070+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-04-18T04:55:56.662070+0000","last_clean_scrub_stamp":"2024-04-18T04:55:56.662070+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:04:03.410143+0000","scrub_duration":0.0061866239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"32'15","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:02.020729+0000","last_change":"2024-04-18T04:56:02.020729+0000","last_active":"2024-04-18T04:56:02.020729+0000","last_peered":"2024-04-18T04:56:02.020729+0000","last_clean":"2024-04-18T04:56:02.020729+0000","last_became_active":"2024-04-18T04:45:12.040023+0000","last_became_peered":"2024-04-18T04:45:12.040023+0000","last_unstale":"2024-04-18T04:56:02.020729+0000","last_undegraded":"2024-04-18T04:56:02.020729+0000","last_fullsized":"2024-04-18T04:56:02.020729+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-04-18T04:56:02.020632+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-04-18T04:56:02.020632+0000","last_clean_scrub_stamp":"2024-04-18T04:56:02.020632+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:25:27.584276+0000","scrub_duration":0.0028188739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"32'17","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:08.612146+0000","last_change":"2024-04-18T04:56:08.612246+0000","last_active":"2024-04-18T04:56:08.612146+0000","last_peered":"2024-04-18T04:56:08.612146+0000","last_clean":"2024-04-18T04:56:08.612146+0000","last_became_active":"2024-04-18T04:44:30.310045+0000","last_became_peered":"2024-04-18T04:44:30.310045+0000","last_unstale":"2024-04-18T04:56:08.612146+0000","last_undegraded":"2024-04-18T04:56:08.612146+0000","last_fullsized":"2024-04-18T04:56:08.612146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'17","last_scrub_stamp":"2024-04-18T04:56:08.612127+0000","last_deep_scrub":"32'17","last_deep_scrub_stamp":"2024-04-18T04:56:08.612127+0000","last_clean_scrub_stamp":"2024-04-18T04:56:08.612127+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:01:09.612979+0000","scrub_duration":0.026419456000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"32'11","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:56.595848+0000","last_change":"2024-04-18T04:55:56.596105+0000","last_active":"2024-04-18T04:55:56.595848+0000","last_peered":"2024-04-18T04:55:56.595848+0000","last_clean":"2024-04-18T04:55:56.595848+0000","last_became_active":"2024-04-18T04:44:30.304921+0000","last_became_peered":"2024-04-18T04:44:30.304921+0000","last_unstale":"2024-04-18T04:55:56.595848+0000","last_undegraded":"2024-04-18T04:55:56.595848+0000","last_fullsized":"2024-04-18T04:55:56.595848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-04-18T04:55:56.595793+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-04-18T04:55:56.595793+0000","last_clean_scrub_stamp":"2024-04-18T04:55:56.595793+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:57:37.876966+0000","scrub_duration":0.0035079680000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"32'12","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.793804+0000","last_change":"2024-04-18T04:55:38.737483+0000","last_active":"2024-04-18T04:55:39.793804+0000","last_peered":"2024-04-18T04:55:39.793804+0000","last_clean":"2024-04-18T04:55:39.793804+0000","last_became_active":"2024-04-18T04:44:30.291742+0000","last_became_peered":"2024-04-18T04:44:30.291742+0000","last_unstale":"2024-04-18T04:55:39.793804+0000","last_undegraded":"2024-04-18T04:55:39.793804+0000","last_fullsized":"2024-04-18T04:55:39.793804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-18T04:55:38.737212+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-18T04:55:38.737212+0000","last_clean_scrub_stamp":"2024-04-18T04:55:38.737212+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:18:26.020231+0000","scrub_duration":0.0047678599999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"32'19","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:48.186803+0000","last_change":"2024-04-18T04:55:48.186803+0000","last_active":"2024-04-18T04:55:48.186803+0000","last_peered":"2024-04-18T04:55:48.186803+0000","last_clean":"2024-04-18T04:55:48.186803+0000","last_became_active":"2024-04-18T04:44:30.296177+0000","last_became_peered":"2024-04-18T04:44:30.296177+0000","last_unstale":"2024-04-18T04:55:48.186803+0000","last_undegraded":"2024-04-18T04:55:48.186803+0000","last_fullsized":"2024-04-18T04:55:48.186803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2024-04-18T04:55:48.186704+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2024-04-18T04:55:48.186704+0000","last_clean_scrub_stamp":"2024-04-18T04:55:48.186704+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:20:47.516415+0000","scrub_duration":0.0024521629999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"32'11","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:58.716976+0000","last_change":"2024-04-18T04:55:58.716976+0000","last_active":"2024-04-18T04:55:58.716976+0000","last_peered":"2024-04-18T04:55:58.716976+0000","last_clean":"2024-04-18T04:55:58.716976+0000","last_became_active":"2024-04-18T04:44:30.305674+0000","last_became_peered":"2024-04-18T04:44:30.305674+0000","last_unstale":"2024-04-18T04:55:58.716976+0000","last_undegraded":"2024-04-18T04:55:58.716976+0000","last_fullsized":"2024-04-18T04:55:58.716976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-04-18T04:55:58.716755+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-04-18T04:55:58.716755+0000","last_clean_scrub_stamp":"2024-04-18T04:55:58.716755+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:44:30.198979+0000","scrub_duration":0.116453402,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"32'14","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:03.566376+0000","last_change":"2024-04-18T04:56:03.566376+0000","last_active":"2024-04-18T04:56:03.566376+0000","last_peered":"2024-04-18T04:56:03.566376+0000","last_clean":"2024-04-18T04:56:03.566376+0000","last_became_active":"2024-04-18T04:44:30.305470+0000","last_became_peered":"2024-04-18T04:44:30.305470+0000","last_unstale":"2024-04-18T04:56:03.566376+0000","last_undegraded":"2024-04-18T04:56:03.566376+0000","last_fullsized":"2024-04-18T04:56:03.566376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-04-18T04:56:03.566098+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-04-18T04:56:03.566098+0000","last_clean_scrub_stamp":"2024-04-18T04:56:03.566098+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:07:02.082666+0000","scrub_duration":0.0029455890000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"32'12","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:58.452095+0000","last_change":"2024-04-18T04:55:58.452095+0000","last_active":"2024-04-18T04:55:58.452095+0000","last_peered":"2024-04-18T04:55:58.452095+0000","last_clean":"2024-04-18T04:55:58.452095+0000","last_became_active":"2024-04-18T04:44:30.280535+0000","last_became_peered":"2024-04-18T04:44:30.280535+0000","last_unstale":"2024-04-18T04:55:58.452095+0000","last_undegraded":"2024-04-18T04:55:58.452095+0000","last_fullsized":"2024-04-18T04:55:58.452095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-04-18T04:55:58.451948+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-04-18T04:55:58.451948+0000","last_clean_scrub_stamp":"2024-04-18T04:55:58.451948+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:13:57.037061+0000","scrub_duration":0.028967124,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'11","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:06.620893+0000","last_change":"2024-04-18T04:56:06.620893+0000","last_active":"2024-04-18T04:56:06.620893+0000","last_peered":"2024-04-18T04:56:06.620893+0000","last_clean":"2024-04-18T04:56:06.620893+0000","last_became_active":"2024-04-18T04:44:30.278624+0000","last_became_peered":"2024-04-18T04:44:30.278624+0000","last_unstale":"2024-04-18T04:56:06.620893+0000","last_undegraded":"2024-04-18T04:56:06.620893+0000","last_fullsized":"2024-04-18T04:56:06.620893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-04-18T04:56:06.620761+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-04-18T04:56:06.620761+0000","last_clean_scrub_stamp":"2024-04-18T04:56:06.620761+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:12:07.973763+0000","scrub_duration":0.015897504999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"32'15","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.756506+0000","last_change":"2024-04-18T04:55:37.692128+0000","last_active":"2024-04-18T04:55:39.756506+0000","last_peered":"2024-04-18T04:55:39.756506+0000","last_clean":"2024-04-18T04:55:39.756506+0000","last_became_active":"2024-04-18T04:44:30.295754+0000","last_became_peered":"2024-04-18T04:44:30.295754+0000","last_unstale":"2024-04-18T04:55:39.756506+0000","last_undegraded":"2024-04-18T04:55:39.756506+0000","last_fullsized":"2024-04-18T04:55:39.756506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-04-18T04:55:37.691953+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-04-18T04:55:37.691953+0000","last_clean_scrub_stamp":"2024-04-18T04:55:37.691953+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:00:22.042260+0000","scrub_duration":0.042569443999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"32'9","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:47.662571+0000","last_change":"2024-04-18T04:55:47.662571+0000","last_active":"2024-04-18T04:55:47.662571+0000","last_peered":"2024-04-18T04:55:47.662571+0000","last_clean":"2024-04-18T04:55:47.662571+0000","last_became_active":"2024-04-18T04:44:30.297416+0000","last_became_peered":"2024-04-18T04:44:30.297416+0000","last_unstale":"2024-04-18T04:55:47.662571+0000","last_undegraded":"2024-04-18T04:55:47.662571+0000","last_fullsized":"2024-04-18T04:55:47.662571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-18T04:55:47.662310+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-18T04:55:47.662310+0000","last_clean_scrub_stamp":"2024-04-18T04:55:47.662310+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:55:53.708274+0000","scrub_duration":0.0036875200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"32'10","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:58.667309+0000","last_change":"2024-04-18T04:55:58.667309+0000","last_active":"2024-04-18T04:55:58.667309+0000","last_peered":"2024-04-18T04:55:58.667309+0000","last_clean":"2024-04-18T04:55:58.667309+0000","last_became_active":"2024-04-18T04:44:30.291939+0000","last_became_peered":"2024-04-18T04:44:30.291939+0000","last_unstale":"2024-04-18T04:55:58.667309+0000","last_undegraded":"2024-04-18T04:55:58.667309+0000","last_fullsized":"2024-04-18T04:55:58.667309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-18T04:55:58.667014+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-18T04:55:58.667014+0000","last_clean_scrub_stamp":"2024-04-18T04:55:58.667014+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:13:49.025145+0000","scrub_duration":0.064905824000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"32'21","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:07.832151+0000","last_change":"2024-04-18T04:56:07.832151+0000","last_active":"2024-04-18T04:56:07.832151+0000","last_peered":"2024-04-18T04:56:07.832151+0000","last_clean":"2024-04-18T04:56:07.832151+0000","last_became_active":"2024-04-18T04:44:30.307604+0000","last_became_peered":"2024-04-18T04:44:30.307604+0000","last_unstale":"2024-04-18T04:56:07.832151+0000","last_undegraded":"2024-04-18T04:56:07.832151+0000","last_fullsized":"2024-04-18T04:56:07.832151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-04-18T04:56:07.831882+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-04-18T04:56:07.831882+0000","last_clean_scrub_stamp":"2024-04-18T04:56:07.831882+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:41:39.311080+0000","scrub_duration":0.030838164000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"32'14","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:08.786712+0000","last_change":"2024-04-18T04:56:08.786712+0000","last_active":"2024-04-18T04:56:08.786712+0000","last_peered":"2024-04-18T04:56:08.786712+0000","last_clean":"2024-04-18T04:56:08.786712+0000","last_became_active":"2024-04-18T04:44:30.313985+0000","last_became_peered":"2024-04-18T04:44:30.313985+0000","last_unstale":"2024-04-18T04:56:08.786712+0000","last_undegraded":"2024-04-18T04:56:08.786712+0000","last_fullsized":"2024-04-18T04:56:08.786712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-04-18T04:56:08.786374+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-04-18T04:56:08.786374+0000","last_clean_scrub_stamp":"2024-04-18T04:56:08.786374+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:43:54.033410+0000","scrub_duration":0.045562271000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"32'11","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:02.652660+0000","last_change":"2024-04-18T04:56:02.652732+0000","last_active":"2024-04-18T04:56:02.652660+0000","last_peered":"2024-04-18T04:56:02.652660+0000","last_clean":"2024-04-18T04:56:02.652660+0000","last_became_active":"2024-04-18T04:44:30.309002+0000","last_became_peered":"2024-04-18T04:44:30.309002+0000","last_unstale":"2024-04-18T04:56:02.652660+0000","last_undegraded":"2024-04-18T04:56:02.652660+0000","last_fullsized":"2024-04-18T04:56:02.652660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-04-18T04:56:02.652642+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-04-18T04:56:02.652642+0000","last_clean_scrub_stamp":"2024-04-18T04:56:02.652642+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:29:26.197738+0000","scrub_duration":0.0021008340000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:16.718545+0000","last_change":"2024-04-18T04:56:16.718724+0000","last_active":"2024-04-18T04:56:16.718545+0000","last_peered":"2024-04-18T04:56:16.718545+0000","last_clean":"2024-04-18T04:56:16.718545+0000","last_became_active":"2024-04-18T04:44:30.290504+0000","last_became_peered":"2024-04-18T04:44:30.290504+0000","last_unstale":"2024-04-18T04:56:16.718545+0000","last_undegraded":"2024-04-18T04:56:16.718545+0000","last_fullsized":"2024-04-18T04:56:16.718545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-18T04:56:16.718485+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-18T04:56:16.718485+0000","last_clean_scrub_stamp":"2024-04-18T04:56:16.718485+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:59:18.755359+0000","scrub_duration":0.0024279430000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"32'10","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:10.531785+0000","last_change":"2024-04-18T04:56:10.531934+0000","last_active":"2024-04-18T04:56:10.531785+0000","last_peered":"2024-04-18T04:56:10.531785+0000","last_clean":"2024-04-18T04:56:10.531785+0000","last_became_active":"2024-04-18T04:44:30.290175+0000","last_became_peered":"2024-04-18T04:44:30.290175+0000","last_unstale":"2024-04-18T04:56:10.531785+0000","last_undegraded":"2024-04-18T04:56:10.531785+0000","last_fullsized":"2024-04-18T04:56:10.531785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-18T04:56:10.531747+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-18T04:56:10.531747+0000","last_clean_scrub_stamp":"2024-04-18T04:56:10.531747+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:09:29.049508+0000","scrub_duration":0.0028526049999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"32'7","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:15.754594+0000","last_change":"2024-04-18T04:56:15.754759+0000","last_active":"2024-04-18T04:56:15.754594+0000","last_peered":"2024-04-18T04:56:15.754594+0000","last_clean":"2024-04-18T04:56:15.754594+0000","last_became_active":"2024-04-18T04:44:30.288131+0000","last_became_peered":"2024-04-18T04:44:30.288131+0000","last_unstale":"2024-04-18T04:56:15.754594+0000","last_undegraded":"2024-04-18T04:56:15.754594+0000","last_fullsized":"2024-04-18T04:56:15.754594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-04-18T04:56:15.754547+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-04-18T04:56:15.754547+0000","last_clean_scrub_stamp":"2024-04-18T04:56:15.754547+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:59:00.647127+0000","scrub_duration":0.072162940999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"32'11","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:55:39.869865+0000","last_change":"2024-04-18T04:55:39.585898+0000","last_active":"2024-04-18T04:55:39.869865+0000","last_peered":"2024-04-18T04:55:39.869865+0000","last_clean":"2024-04-18T04:55:39.869865+0000","last_became_active":"2024-04-18T04:44:30.287325+0000","last_became_peered":"2024-04-18T04:44:30.287325+0000","last_unstale":"2024-04-18T04:55:39.869865+0000","last_undegraded":"2024-04-18T04:55:39.869865+0000","last_fullsized":"2024-04-18T04:55:39.869865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-18T04:55:39.585750+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-18T04:55:39.585750+0000","last_clean_scrub_stamp":"2024-04-18T04:55:39.585750+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:50:34.983543+0000","scrub_duration":0.0086941710000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"32'8","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:07.660037+0000","last_change":"2024-04-18T04:56:07.660141+0000","last_active":"2024-04-18T04:56:07.660037+0000","last_peered":"2024-04-18T04:56:07.660037+0000","last_clean":"2024-04-18T04:56:07.660037+0000","last_became_active":"2024-04-18T04:44:30.275118+0000","last_became_peered":"2024-04-18T04:44:30.275118+0000","last_unstale":"2024-04-18T04:56:07.660037+0000","last_undegraded":"2024-04-18T04:56:07.660037+0000","last_fullsized":"2024-04-18T04:56:07.660037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-18T04:56:07.660018+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-18T04:56:07.660018+0000","last_clean_scrub_stamp":"2024-04-18T04:56:07.660018+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:23:11.114701+0000","scrub_duration":0.058651572999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"32'4","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:00.427204+0000","last_change":"2024-04-18T04:56:00.427301+0000","last_active":"2024-04-18T04:56:00.427204+0000","last_peered":"2024-04-18T04:56:00.427204+0000","last_clean":"2024-04-18T04:56:00.427204+0000","last_became_active":"2024-04-18T04:44:30.276654+0000","last_became_peered":"2024-04-18T04:44:30.276654+0000","last_unstale":"2024-04-18T04:56:00.427204+0000","last_undegraded":"2024-04-18T04:56:00.427204+0000","last_fullsized":"2024-04-18T04:56:00.427204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-18T04:56:00.427184+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-18T04:56:00.427184+0000","last_clean_scrub_stamp":"2024-04-18T04:56:00.427184+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:15:37.992228+0000","scrub_duration":0.029663450000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"32'12","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-18T04:56:18.807387+0000","last_change":"2024-04-18T04:56:18.807606+0000","last_active":"2024-04-18T04:56:18.807387+0000","last_peered":"2024-04-18T04:56:18.807387+0000","last_clean":"2024-04-18T04:56:18.807387+0000","last_became_active":"2024-04-18T04:44:30.302180+0000","last_became_peered":"2024-04-18T04:44:30.302180+0000","last_unstale":"2024-04-18T04:56:18.807387+0000","last_undegraded":"2024-04-18T04:56:18.807387+0000","last_fullsized":"2024-04-18T04:56:18.807387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-04-18T04:56:18.807321+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-04-18T04:56:18.807321+0000","last_clean_scrub_stamp":"2024-04-18T04:56:18.807321+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:19:58.431229+0000","scrub_duration":0.083374895000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":11,"num_write":2195132,"num_write_kb":31163048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149947,"ondisk_log_size":149947,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":739,"ondisk_log_size":739,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":81164485,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":422,"num_read_kb":74892,"num_write":3467,"num_write_kb":80225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27954,"num_omap_keys":54,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":37855232,"data_stored":162328970,"data_compressed":18251382,"data_compressed_allocated":21430272,"data_compressed_original":146063360,"omap_allocated":0,"internal_metadata":0},"log_size":3546,"ondisk_log_size":3546,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66624,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509588,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":993936,"kb_used_data":6920,"kb_used_omap":1,"kb_used_meta":987006,"kb_avail":93377904,"statfs":{"total":96636764160,"available":95618973696,"internally_reserved":0,"allocated":7086080,"data_stored":17021899,"data_compressed":1734435,"data_compressed_allocated":2166784,"data_compressed_original":12316672,"omap_allocated":1592,"internal_metadata":1010694600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:55:43 2024","interfaces":[{"interface":"back","average":{"1min":2.04,"5min":5.1870000000000003,"15min":3.4540000000000002},"min":{"1min":0.29199999999999998,"5min":0.26200000000000001,"15min":0.252},"max":{"1min":9.3330000000000002,"5min":76.096999999999994,"15min":76.096999999999994},"last":0.41099999999999998},{"interface":"front","average":{"1min":2.1000000000000001,"5min":7.3920000000000003,"15min":3.8599999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":9.5879999999999992,"5min":184.16999999999999,"15min":184.16999999999999},"last":0.48499999999999999}]},{"osd":1,"last update":"Thu Apr 18 04:55:43 2024","interfaces":[{"interface":"back","average":{"1min":2.577,"5min":6.6239999999999997,"15min":4.4909999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.24299999999999999},"max":{"1min":14.954000000000001,"5min":85.109999999999999,"15min":153.59299999999999},"last":0.437},{"interface":"front","average":{"1min":3.1949999999999998,"5min":5.7999999999999998,"15min":4.2220000000000004},"min":{"1min":0.38,"5min":0.35299999999999998,"15min":0.29199999999999998},"max":{"1min":19.210999999999999,"5min":88.606999999999999,"15min":153.94300000000001},"last":0.45500000000000002}]},{"osd":2,"last update":"Thu Apr 18 04:55:43 2024","interfaces":[{"interface":"back","average":{"1min":2.198,"5min":3.202,"15min":2.754},"min":{"1min":0.34999999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":9.0220000000000002,"5min":23.867000000000001,"15min":162.59700000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":2.1440000000000001,"5min":3.8159999999999998,"15min":3.0659999999999998},"min":{"1min":0.41899999999999998,"5min":0.309,"15min":0.309},"max":{"1min":8.3670000000000009,"5min":22.957999999999998,"15min":153.83500000000001},"last":0.499}]},{"osd":4,"last update":"Thu Apr 18 04:55:43 2024","interfaces":[{"interface":"back","average":{"1min":2.7490000000000001,"5min":2.552,"15min":1.8740000000000001},"min":{"1min":0.54100000000000004,"5min":0.43099999999999999,"15min":0.40000000000000002},"max":{"1min":29.809999999999999,"5min":29.809999999999999,"15min":31.974},"last":0.745},{"interface":"front","average":{"1min":3.0219999999999998,"5min":4.4900000000000002,"15min":2.8620000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":29.777999999999999,"5min":50.536000000000001,"15min":50.536000000000001},"last":0.84599999999999997}]},{"osd":5,"last update":"Thu Apr 18 04:55:43 2024","interfaces":[{"interface":"back","average":{"1min":3.0219999999999998,"5min":3.4740000000000002,"15min":2.4740000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":27.469000000000001,"5min":29.539999999999999,"15min":40.915999999999997},"last":0.64200000000000002},{"interface":"front","average":{"1min":3.0169999999999999,"5min":2.774,"15min":2.1150000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.41899999999999998},"max":{"1min":28.256,"5min":28.256,"15min":68.370000000000005},"last":0.78400000000000003}]},{"osd":6,"last update":"Thu Apr 18 04:55:43 2024","interfaces":[{"interface":"back","average":{"1min":1.992,"5min":3.0150000000000001,"15min":2.3109999999999999},"min":{"1min":0.47999999999999998,"5min":0.45100000000000001,"15min":0.39900000000000002},"max":{"1min":9.3699999999999992,"5min":23.579999999999998,"15min":48.765000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.631,"5min":4.1749999999999998,"15min":2.6440000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.38900000000000001},"max":{"1min":8.5619999999999994,"5min":69.227999999999994,"15min":69.227999999999994},"last":0.91100000000000003}]},{"osd":7,"last update":"Thu Apr 18 04:55:43 2024","interfaces":[{"interface":"back","average":{"1min":1.915,"5min":2.633,"15min":2.1720000000000002},"min":{"1min":0.56599999999999995,"5min":0.48899999999999999,"15min":0.44700000000000001},"max":{"1min":8.4960000000000004,"5min":18.795000000000002,"15min":40.947000000000003},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.994,"5min":3.1269999999999998,"15min":2.2959999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":9.4320000000000004,"5min":19.512,"15min":68.329999999999998},"last":0.71499999999999997}]}]},{"osd":2,"up_from":15,"seq":64424509589,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":556140,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":554430,"kb_avail":93815700,"statfs":{"total":96636764160,"available":96067276800,"internally_reserved":0,"allocated":1740800,"data_stored":4437838,"data_compressed":439103,"data_compressed_allocated":598016,"data_compressed_original":3510272,"omap_allocated":1594,"internal_metadata":567736774},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:55:37 2024","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":3.512,"15min":3.4159999999999999},"min":{"1min":0.30299999999999999,"5min":0.28699999999999998,"15min":0.23300000000000001},"max":{"1min":5.5529999999999999,"5min":30.396999999999998,"15min":120.402},"last":0.29499999999999998},{"interface":"front","average":{"1min":1.165,"5min":4.6600000000000001,"15min":3.3700000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.28899999999999998},"max":{"1min":5.1159999999999997,"5min":58.277999999999999,"15min":121.377},"last":0.34100000000000003}]},{"osd":1,"last update":"Thu Apr 18 04:55:37 2024","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":4.5439999999999996,"15min":3.823},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.28399999999999997},"max":{"1min":7.0899999999999999,"5min":62.851999999999997,"15min":135.32400000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":2.359,"5min":4.7889999999999997,"15min":3.9590000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.27600000000000002},"max":{"1min":8.3480000000000008,"5min":60.741999999999997,"15min":178.08199999999999},"last":0.42499999999999999}]},{"osd":3,"last update":"Thu Apr 18 04:55:37 2024","interfaces":[{"interface":"back","average":{"1min":2.0619999999999998,"5min":4.1980000000000004,"15min":3.2509999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.35999999999999999},"max":{"1min":10.42,"5min":65.037000000000006,"15min":124.76300000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":3.0249999999999999,"5min":4.7030000000000003,"15min":3.6640000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.33000000000000002},"max":{"1min":22.298999999999999,"5min":70.861999999999995,"15min":145.47200000000001},"last":0.44500000000000001}]},{"osd":4,"last update":"Thu Apr 18 04:55:37 2024","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":2.7639999999999998,"15min":2.335},"min":{"1min":0.51200000000000001,"5min":0.45200000000000001,"15min":0.35299999999999998},"max":{"1min":5.4420000000000002,"5min":14.388999999999999,"15min":37.420000000000002},"last":0.60999999999999999},{"interface":"front","average":{"1min":1.6220000000000001,"5min":2.7200000000000002,"15min":2.2269999999999999},"min":{"1min":0.48099999999999998,"5min":0.42999999999999999,"15min":0.42699999999999999},"max":{"1min":6.8719999999999999,"5min":14.356999999999999,"15min":37.460000000000001},"last":0.74099999999999999}]},{"osd":5,"last update":"Thu Apr 18 04:55:37 2024","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":2.8340000000000001,"15min":2.1619999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.32700000000000001},"max":{"1min":6.2869999999999999,"5min":14.244,"15min":37.5},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.657,"5min":2.8250000000000002,"15min":2.1779999999999999},"min":{"1min":0.56599999999999995,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":6.2489999999999997,"5min":28.143000000000001,"15min":28.143000000000001},"last":0.63800000000000001}]},{"osd":6,"last update":"Thu Apr 18 04:55:37 2024","interfaces":[{"interface":"back","average":{"1min":1.617,"5min":2.7130000000000001,"15min":2.2989999999999999},"min":{"1min":0.54900000000000004,"5min":0.47499999999999998,"15min":0.441},"max":{"1min":6.3289999999999997,"5min":11.337,"15min":34.506999999999998},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.7689999999999999,"5min":2.8159999999999998,"15min":2.3450000000000002},"min":{"1min":0.504,"5min":0.46999999999999997,"15min":0.44800000000000001},"max":{"1min":6.8259999999999996,"5min":14.285,"15min":37.533000000000001},"last":0.68200000000000005}]},{"osd":7,"last update":"Thu Apr 18 04:55:37 2024","interfaces":[{"interface":"back","average":{"1min":2.008,"5min":2.8109999999999999,"15min":2.137},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.39800000000000002},"max":{"1min":6.8710000000000004,"5min":12.914999999999999,"15min":24.155000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":2.052,"5min":2.7330000000000001,"15min":2.2010000000000001},"min":{"1min":0.68300000000000005,"5min":0.52800000000000002,"15min":0.46899999999999997},"max":{"1min":6.9009999999999998,"5min":26.064,"15min":34.576999999999998},"last":0.65000000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509587,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1000120,"kb_used_data":3440,"kb_used_omap":1,"kb_used_meta":996670,"kb_avail":93371720,"statfs":{"total":96636764160,"available":95612641280,"internally_reserved":0,"allocated":3522560,"data_stored":21124827,"data_compressed":2531508,"data_compressed_allocated":2936832,"data_compressed_original":20754432,"omap_allocated":1594,"internal_metadata":1020590534},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:55:42 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":3.8340000000000001,"15min":3.383},"min":{"1min":0.26400000000000001,"5min":0.22,"15min":0.22},"max":{"1min":4.5839999999999996,"5min":32.177,"15min":124.096},"last":0.34300000000000003},{"interface":"front","average":{"1min":1.395,"5min":6.4779999999999998,"15min":4.117},"min":{"1min":0.29699999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":6.6260000000000003,"5min":143.60300000000001,"15min":164.41},"last":0.311}]},{"osd":2,"last update":"Thu Apr 18 04:55:42 2024","interfaces":[{"interface":"back","average":{"1min":7.3040000000000003,"5min":5.0350000000000001,"15min":6.3550000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.29299999999999998},"max":{"1min":108.968,"5min":108.968,"15min":840.66700000000003},"last":0.32700000000000001},{"interface":"front","average":{"1min":7.1669999999999998,"5min":6.5599999999999996,"15min":4.1550000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":109.02800000000001,"5min":114.47199999999999,"15min":164.477},"last":0.38700000000000001}]},{"osd":3,"last update":"Thu Apr 18 04:55:42 2024","interfaces":[{"interface":"back","average":{"1min":9.4390000000000001,"5min":7.1669999999999998,"15min":5.3319999999999999},"min":{"1min":0.39100000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":135.86099999999999,"5min":135.86099999999999,"15min":164.50299999999999},"last":0.41699999999999998},{"interface":"front","average":{"1min":9.2579999999999991,"5min":8.4800000000000004,"15min":5.4039999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.36899999999999999},"max":{"1min":136.69300000000001,"5min":151.82599999999999,"15min":151.82599999999999},"last":0.36299999999999999}]},{"osd":4,"last update":"Thu Apr 18 04:55:42 2024","interfaces":[{"interface":"back","average":{"1min":1.845,"5min":3.4159999999999999,"15min":2.6949999999999998},"min":{"1min":0.42299999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":10.134,"5min":23.478999999999999,"15min":52.072000000000003},"last":0.753},{"interface":"front","average":{"1min":2.0579999999999998,"5min":3.7200000000000002,"15min":5.6299999999999999},"min":{"1min":0.41799999999999998,"5min":0.40799999999999997,"15min":0.34399999999999997},"max":{"1min":13.097,"5min":33.017000000000003,"15min":840.61500000000001},"last":0.82399999999999995}]},{"osd":5,"last update":"Thu Apr 18 04:55:42 2024","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":5.1559999999999997,"15min":4.6130000000000004},"min":{"1min":0.627,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":4.2960000000000003,"5min":114.37,"15min":478.47000000000003},"last":0.54900000000000004},{"interface":"front","average":{"1min":1.5980000000000001,"5min":3.6269999999999998,"15min":3.1269999999999998},"min":{"1min":0.745,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":5.194,"5min":41.832000000000001,"15min":164.374},"last":0.64800000000000002}]},{"osd":6,"last update":"Thu Apr 18 04:55:42 2024","interfaces":[{"interface":"back","average":{"1min":1.966,"5min":3.5249999999999999,"15min":2.8029999999999999},"min":{"1min":0.50600000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":14.938000000000001,"5min":23.416,"15min":52.100999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":1.6499999999999999,"5min":3.3410000000000002,"15min":3.8199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.438},"max":{"1min":5.5049999999999999,"5min":18.951000000000001,"15min":396.81},"last":0.61699999999999999}]},{"osd":7,"last update":"Thu Apr 18 04:55:42 2024","interfaces":[{"interface":"back","average":{"1min":2.1949999999999998,"5min":5.2370000000000001,"15min":3.6579999999999999},"min":{"1min":0.73399999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":10.177,"5min":100.565,"15min":164.447},"last":0.82799999999999996},{"interface":"front","average":{"1min":2.476,"5min":3.581,"15min":2.7919999999999998},"min":{"1min":0.55800000000000005,"5min":0.46200000000000002,"15min":0.45400000000000001},"max":{"1min":13.156000000000001,"5min":23.648,"15min":54.353000000000002},"last":0.79400000000000004}]}]},{"osd":7,"up_from":14,"seq":60129542296,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":687992,"kb_used_data":10544,"kb_used_omap":1,"kb_used_meta":677438,"kb_avail":93683848,"statfs":{"total":96636764160,"available":95932260352,"internally_reserved":0,"allocated":10797056,"data_stored":35675430,"data_compressed":3619092,"data_compressed_allocated":4272128,"data_compressed_original":29368320,"omap_allocated":1589,"internal_metadata":693696971},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:56:31 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":5.2679999999999998,"15min":3.7370000000000001},"min":{"1min":0.39900000000000002,"5min":0.25800000000000001,"15min":0.249},"max":{"1min":4.7640000000000002,"5min":195.89500000000001,"15min":287.19600000000003},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":5.7149999999999999,"15min":4.1130000000000004},"min":{"1min":0.52000000000000002,"5min":0.26800000000000002,"15min":0.26200000000000001},"max":{"1min":2.1059999999999999,"5min":196.149,"15min":289.23899999999998},"last":0.84299999999999997}]},{"osd":1,"last update":"Thu Apr 18 04:55:49 2024","interfaces":[{"interface":"back","average":{"1min":1.7989999999999999,"5min":3.8570000000000002,"15min":3.613},"min":{"1min":0.33400000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":9.5960000000000001,"5min":90.055000000000007,"15min":303.83800000000002},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.9330000000000001,"5min":4.0019999999999998,"15min":3.7349999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32000000000000001},"max":{"1min":9.5800000000000001,"5min":90.001999999999995,"15min":288.05799999999999},"last":0.80400000000000005}]},{"osd":2,"last update":"Thu Apr 18 04:55:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":3.532,"15min":2.2989999999999999},"min":{"1min":0.36399999999999999,"5min":0.35599999999999998,"15min":0.30099999999999999},"max":{"1min":4.7110000000000003,"5min":91.088999999999999,"15min":91.088999999999999},"last":1.087},{"interface":"front","average":{"1min":1.0720000000000001,"5min":3.0169999999999999,"15min":1.879},"min":{"1min":0.51600000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":3.7330000000000001,"5min":91.171999999999997,"15min":91.171999999999997},"last":0.70699999999999996}]},{"osd":3,"last update":"Thu Apr 18 04:55:49 2024","interfaces":[{"interface":"back","average":{"1min":1.9399999999999999,"5min":3.992,"15min":3.8599999999999999},"min":{"1min":0.48999999999999999,"5min":0.34300000000000003,"15min":0.30199999999999999},"max":{"1min":11.148999999999999,"5min":89.393000000000001,"15min":308.36700000000002},"last":0.61399999999999999},{"interface":"front","average":{"1min":1.3899999999999999,"5min":3.411,"15min":3.198},"min":{"1min":0.39200000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":6.5259999999999998,"5min":88.070999999999998,"15min":289.86099999999999},"last":1.002}]},{"osd":4,"last update":"Thu Apr 18 04:56:31 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":1.298,"15min":1.147},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.1890000000000001,"5min":41.567,"15min":41.567},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.3799999999999999,"15min":1.141},"min":{"1min":0.35099999999999998,"5min":0.30499999999999999,"15min":0.247},"max":{"1min":1.1140000000000001,"5min":45.646000000000001,"15min":45.646000000000001},"last":1.198}]},{"osd":5,"last update":"Thu Apr 18 04:56:31 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.6140000000000001,"15min":1.1830000000000001},"min":{"1min":0.318,"5min":0.27300000000000002,"15min":0.26600000000000001},"max":{"1min":1.3129999999999999,"5min":41.595999999999997,"15min":41.595999999999997},"last":1.167},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.238,"15min":1.0409999999999999},"min":{"1min":0.33000000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.262,"5min":15.271000000000001,"15min":15.271000000000001},"last":1.046}]},{"osd":6,"last update":"Thu Apr 18 04:56:31 2024","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.1279999999999999,"15min":1.0149999999999999},"min":{"1min":0.30299999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.2789999999999999,"5min":8.2390000000000008,"15min":8.2390000000000008},"last":1.121},{"interface":"front","average":{"1min":1.091,"5min":1.077,"15min":1.0649999999999999},"min":{"1min":0.375,"5min":0.29399999999999998,"15min":0.28999999999999998},"max":{"1min":1.331,"5min":8.8870000000000005,"15min":11.288},"last":1.252}]}]},{"osd":6,"up_from":14,"seq":60129542294,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":809816,"kb_used_data":3728,"kb_used_omap":1,"kb_used_meta":806078,"kb_avail":93562024,"statfs":{"total":96636764160,"available":95807512576,"internally_reserved":0,"allocated":3817472,"data_stored":16932052,"data_compressed":2087260,"data_compressed_allocated":2478080,"data_compressed_original":15798272,"omap_allocated":1593,"internal_metadata":825424327},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:55:38 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":2.6560000000000001,"15min":1.6799999999999999},"min":{"1min":0.34499999999999997,"5min":0.247,"15min":0.247},"max":{"1min":3.1579999999999999,"5min":99.328999999999994,"15min":99.328999999999994},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.99299999999999999,"5min":2.7160000000000002,"15min":2.198},"min":{"1min":0.42599999999999999,"5min":0.311,"15min":0.309},"max":{"1min":3.202,"5min":99.287000000000006,"15min":99.287000000000006},"last":0.53000000000000003}]},{"osd":1,"last update":"Thu Apr 18 04:55:38 2024","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":4.593,"15min":2.855},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":5.3890000000000002,"5min":122.06999999999999,"15min":122.06999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.97299999999999998,"5min":4.1230000000000002,"15min":2.6899999999999999},"min":{"1min":0.33700000000000002,"5min":0.33300000000000002,"15min":0.32800000000000001},"max":{"1min":5.4009999999999998,"5min":122.09,"15min":122.09},"last":0.76400000000000001}]},{"osd":2,"last update":"Thu Apr 18 04:55:38 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":2.5379999999999998,"15min":1.835},"min":{"1min":0.40000000000000002,"5min":0.31,"15min":0.31},"max":{"1min":2.9129999999999998,"5min":38.557000000000002,"15min":41.764000000000003},"last":0.66000000000000003},{"interface":"front","average":{"1min":1.4259999999999999,"5min":2.5950000000000002,"15min":1.9259999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":12.701000000000001,"5min":35.734000000000002,"15min":41.710000000000001},"last":0.72999999999999998}]},{"osd":3,"last update":"Thu Apr 18 04:55:38 2024","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":3.7669999999999999,"15min":2.948},"min":{"1min":0.38700000000000001,"5min":0.312,"15min":0.29999999999999999},"max":{"1min":9.2970000000000006,"5min":101.006,"15min":101.006},"last":0.60399999999999998},{"interface":"front","average":{"1min":1.6220000000000001,"5min":3.8250000000000002,"15min":3.032},"min":{"1min":0.44500000000000001,"5min":0.42499999999999999,"15min":0.42199999999999999},"max":{"1min":9.3840000000000003,"5min":101.039,"15min":101.039},"last":0.68799999999999994}]},{"osd":4,"last update":"Thu Apr 18 04:55:38 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":1.569,"15min":1.147},"min":{"1min":0.28199999999999997,"5min":0.217,"15min":0.217},"max":{"1min":2.1059999999999999,"5min":19.481999999999999,"15min":19.481999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.681,"15min":1.2370000000000001},"min":{"1min":0.36799999999999999,"5min":0.28199999999999997,"15min":0.26400000000000001},"max":{"1min":2.8090000000000002,"5min":19.536999999999999,"15min":19.536999999999999},"last":0.96499999999999997}]},{"osd":5,"last update":"Thu Apr 18 04:55:38 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.82999999999999996,"15min":1.0089999999999999},"min":{"1min":0.312,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.6619999999999999,"5min":7.7720000000000002,"15min":13.538},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.89600000000000002,"15min":0.93500000000000005},"min":{"1min":0.30399999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.728,"5min":7.4950000000000001,"15min":8.7210000000000001},"last":1.04}]},{"osd":7,"last update":"Thu Apr 18 04:55:38 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.94499999999999995,"15min":1.0429999999999999},"min":{"1min":0.33300000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.696,"5min":7.5359999999999996,"15min":7.5359999999999996},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.84899999999999998,"5min":1.006,"15min":1.018},"min":{"1min":0.34399999999999997,"5min":0.33900000000000002,"15min":0.314},"max":{"1min":2.887,"5min":10.955,"15min":10.955},"last":1.21}]}]},{"osd":5,"up_from":14,"seq":60129542296,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":620212,"kb_used_data":3500,"kb_used_omap":1,"kb_used_meta":616702,"kb_avail":93751628,"statfs":{"total":96636764160,"available":96001667072,"internally_reserved":0,"allocated":3584000,"data_stored":18307325,"data_compressed":2174151,"data_compressed_allocated":2514944,"data_compressed_original":17453056,"omap_allocated":1593,"internal_metadata":631503303},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:55:40 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":3.7040000000000002,"15min":2.363},"min":{"1min":0.28299999999999997,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":3.8319999999999999,"5min":84.305000000000007,"15min":84.305000000000007},"last":0.77200000000000002},{"interface":"front","average":{"1min":1.3540000000000001,"5min":3.6739999999999999,"15min":4.4790000000000001},"min":{"1min":0.34200000000000003,"5min":0.252,"15min":0.252},"max":{"1min":4.7800000000000002,"5min":86.994,"15min":553.95500000000004},"last":0.68600000000000005}]},{"osd":1,"last update":"Thu Apr 18 04:55:40 2024","interfaces":[{"interface":"back","average":{"1min":8.5050000000000008,"5min":5.9530000000000003,"15min":5.1929999999999996},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":178.01499999999999,"5min":178.01499999999999,"15min":553.36900000000003},"last":0.51600000000000001},{"interface":"front","average":{"1min":8.9000000000000004,"5min":5.9660000000000002,"15min":4.8419999999999996},"min":{"1min":0.31900000000000001,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":177.964,"5min":177.964,"15min":501.11000000000001},"last":0.58699999999999997}]},{"osd":2,"last update":"Thu Apr 18 04:55:40 2024","interfaces":[{"interface":"back","average":{"1min":1.778,"5min":3.98,"15min":3.1920000000000002},"min":{"1min":0.442,"5min":0.35699999999999998,"15min":0.29799999999999999},"max":{"1min":5.2839999999999998,"5min":123.048,"15min":262.99700000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":1.0049999999999999,"5min":4.0529999999999999,"15min":3.3119999999999998},"min":{"1min":0.39900000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":3.7519999999999998,"5min":125.04900000000001,"15min":259.24099999999999},"last":0.88400000000000001}]},{"osd":3,"last update":"Thu Apr 18 04:55:40 2024","interfaces":[{"interface":"back","average":{"1min":9.7750000000000004,"5min":5.9390000000000001,"15min":3.2040000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.34200000000000003},"max":{"1min":176.523,"5min":176.523,"15min":176.523},"last":0.72099999999999997},{"interface":"front","average":{"1min":9.2520000000000007,"5min":5.8250000000000002,"15min":3.4279999999999999},"min":{"1min":0.379,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":176.41999999999999,"5min":176.41999999999999,"15min":176.41999999999999},"last":0.82599999999999996}]},{"osd":4,"last update":"Thu Apr 18 04:55:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.754,"15min":0.81499999999999995},"min":{"1min":0.26300000000000001,"5min":0.246,"15min":0.246},"max":{"1min":1.8959999999999999,"5min":4.6440000000000001,"15min":4.6440000000000001},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":1.214,"15min":1.038},"min":{"1min":0.30099999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.9219999999999999,"5min":12.888999999999999,"15min":12.888999999999999},"last":1.0089999999999999}]},{"osd":6,"last update":"Thu Apr 18 04:55:40 2024","interfaces":[{"interface":"back","average":{"1min":3.181,"5min":1.222,"15min":1.018},"min":{"1min":0.317,"5min":0.28000000000000003,"15min":0.252},"max":{"1min":58.222000000000001,"5min":58.222000000000001,"15min":58.222000000000001},"last":0.93100000000000005},{"interface":"front","average":{"1min":3.3500000000000001,"5min":1.522,"15min":1.1339999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":58.314999999999998,"5min":58.314999999999998,"15min":58.314999999999998},"last":1.0489999999999999}]},{"osd":7,"last update":"Thu Apr 18 04:55:40 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.90700000000000003,"15min":0.98699999999999999},"min":{"1min":0.27000000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.3200000000000001,"5min":12.74,"15min":12.74},"last":1.097},{"interface":"front","average":{"1min":0.86599999999999999,"5min":1.0800000000000001,"15min":1.0269999999999999},"min":{"1min":0.33900000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":4.101,"5min":27.658000000000001,"15min":27.658000000000001},"last":1.1519999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542296,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":754032,"kb_used_data":6504,"kb_used_omap":1,"kb_used_meta":747518,"kb_avail":93617808,"statfs":{"total":96636764160,"available":95864635392,"internally_reserved":0,"allocated":6660096,"data_stored":29514328,"data_compressed":3215159,"data_compressed_allocated":3665920,"data_compressed_original":26726400,"omap_allocated":1594,"internal_metadata":765458886},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 04:55:39 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":5.4530000000000003,"15min":2.819},"min":{"1min":0.27400000000000002,"5min":0.25700000000000001,"15min":0.254},"max":{"1min":1.9299999999999999,"5min":148.048,"15min":148.048},"last":0.59199999999999997},{"interface":"front","average":{"1min":1.206,"5min":5.1120000000000001,"15min":2.8969999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":5.8499999999999996,"5min":144.72999999999999,"15min":144.72999999999999},"last":0.72099999999999997}]},{"osd":1,"last update":"Thu Apr 18 04:55:39 2024","interfaces":[{"interface":"back","average":{"1min":1.9830000000000001,"5min":6.9020000000000001,"15min":4.1210000000000004},"min":{"1min":0.38300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":11.967000000000001,"5min":158.56,"15min":158.56},"last":0.55800000000000005},{"interface":"front","average":{"1min":1.792,"5min":6.9349999999999996,"15min":3.5129999999999999},"min":{"1min":0.32300000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":12.494,"5min":144.60400000000001,"15min":144.60400000000001},"last":0.98299999999999998}]},{"osd":2,"last update":"Thu Apr 18 04:55:39 2024","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":3.5209999999999999,"15min":2.2349999999999999},"min":{"1min":0.36699999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":9.7059999999999995,"5min":109.28,"15min":109.28},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.905,"5min":3.7200000000000002,"15min":2.2799999999999998},"min":{"1min":0.38400000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":10.670999999999999,"5min":109.242,"15min":109.242},"last":0.53100000000000003}]},{"osd":3,"last update":"Thu Apr 18 04:55:39 2024","interfaces":[{"interface":"back","average":{"1min":2.431,"5min":6.8310000000000004,"15min":3.5529999999999999},"min":{"1min":0.42699999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":13.782999999999999,"5min":147.625,"15min":147.625},"last":0.89400000000000002},{"interface":"front","average":{"1min":2.4079999999999999,"5min":5.9390000000000001,"15min":3.456},"min":{"1min":0.48899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":7.6790000000000003,"5min":147.01599999999999,"15min":147.01599999999999},"last":0.80300000000000005}]},{"osd":5,"last update":"Thu Apr 18 04:55:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":0.94399999999999995,"15min":1.0309999999999999},"min":{"1min":0.28699999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":5.4729999999999999,"5min":11.151999999999999,"15min":19.143999999999998},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.046,"5min":0.89600000000000002,"15min":1.03},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":3.6659999999999999,"5min":8.5199999999999996,"15min":27.402999999999999},"last":0.84899999999999998}]},{"osd":6,"last update":"Thu Apr 18 04:55:39 2024","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.0329999999999999,"15min":1.0880000000000001},"min":{"1min":0.30499999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":7.5190000000000001,"5min":8.8889999999999993,"15min":13.891999999999999},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.6659999999999999,"5min":1.1899999999999999,"15min":1.1699999999999999},"min":{"1min":0.317,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":7.7409999999999997,"5min":17.954999999999998,"15min":17.954999999999998},"last":0.95699999999999996}]},{"osd":7,"last update":"Thu Apr 18 04:55:39 2024","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":1.028,"15min":1.1799999999999999},"min":{"1min":0.308,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":4.508,"5min":11.244999999999999,"15min":27.643000000000001},"last":1.127},{"interface":"front","average":{"1min":1.008,"5min":1.095,"15min":1.105},"min":{"1min":0.39900000000000002,"5min":0.33500000000000002,"15min":0.32100000000000001},"max":{"1min":4.5869999999999997,"5min":18.800999999999998,"15min":18.800999999999998},"last":1.1779999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574997,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":609088,"kb_used_data":3448,"kb_used_omap":1,"kb_used_meta":605630,"kb_avail":93762752,"statfs":{"total":96636764160,"available":96013058048,"internally_reserved":0,"allocated":3530752,"data_stored":21714911,"data_compressed":2517298,"data_compressed_allocated":2887680,"data_compressed_original":21282816,"omap_allocated":1594,"internal_metadata":620165574},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 04:55:45 2024","interfaces":[{"interface":"back","average":{"1min":2.1400000000000001,"5min":5.3319999999999999,"15min":2.9510000000000001},"min":{"1min":0.308,"5min":0.221,"15min":0.221},"max":{"1min":7.1699999999999999,"5min":55.061,"15min":55.061},"last":0.29999999999999999},{"interface":"front","average":{"1min":2.5640000000000001,"5min":6.3259999999999996,"15min":3.3039999999999998},"min":{"1min":0.36099999999999999,"5min":0.309,"15min":0.28899999999999998},"max":{"1min":8.0190000000000001,"5min":115.45099999999999,"15min":115.45099999999999},"last":0.378}]},{"osd":2,"last update":"Thu Apr 18 04:55:45 2024","interfaces":[{"interface":"back","average":{"1min":2.29,"5min":2.9060000000000001,"15min":1.901},"min":{"1min":0.317,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":9.2639999999999993,"5min":22.475000000000001,"15min":28.802},"last":0.41799999999999998},{"interface":"front","average":{"1min":2.2599999999999998,"5min":4.1230000000000002,"15min":2.556},"min":{"1min":0.40200000000000002,"5min":0.34000000000000002,"15min":0.29399999999999998},"max":{"1min":7.3879999999999999,"5min":115.229,"15min":115.229},"last":0.39900000000000002}]},{"osd":3,"last update":"Thu Apr 18 04:55:45 2024","interfaces":[{"interface":"back","average":{"1min":3.0939999999999999,"5min":4.016,"15min":2.6269999999999998},"min":{"1min":0.32300000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":14.502000000000001,"5min":34.180999999999997,"15min":47.496000000000002},"last":0.35499999999999998},{"interface":"front","average":{"1min":2.9900000000000002,"5min":4.6349999999999998,"15min":2.6930000000000001},"min":{"1min":0.42899999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":13.638,"5min":115.729,"15min":115.729},"last":0.44}]},{"osd":4,"last update":"Thu Apr 18 04:56:32 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":2.3919999999999999,"15min":1.8620000000000001},"min":{"1min":0.48299999999999998,"5min":0.38100000000000001,"15min":0.33000000000000002},"max":{"1min":7.7430000000000003,"5min":49.738999999999997,"15min":49.738999999999997},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.0600000000000001,"5min":3.085,"15min":2.3650000000000002},"min":{"1min":0.498,"5min":0.47499999999999998,"15min":0.38300000000000001},"max":{"1min":7.8540000000000001,"5min":50.996000000000002,"15min":50.996000000000002},"last":0.63500000000000001}]},{"osd":5,"last update":"Thu Apr 18 04:56:32 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":2.3940000000000001,"15min":1.8759999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.38100000000000001},"max":{"1min":6.4690000000000003,"5min":34.402999999999999,"15min":34.402999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.93700000000000006,"5min":1.8620000000000001,"15min":1.9139999999999999},"min":{"1min":0.57599999999999996,"5min":0.46000000000000002,"15min":0.42099999999999999},"max":{"1min":6.516,"5min":15.897,"15min":33.392000000000003},"last":0.51200000000000001}]},{"osd":6,"last update":"Thu Apr 18 04:56:32 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":3.7709999999999999,"15min":2.4260000000000002},"min":{"1min":0.59699999999999998,"5min":0.42199999999999999,"15min":0.40600000000000003},"max":{"1min":6.5519999999999996,"5min":115.277,"15min":115.277},"last":0.627},{"interface":"front","average":{"1min":1.0529999999999999,"5min":2.9790000000000001,"15min":2.0529999999999999},"min":{"1min":0.53800000000000003,"5min":0.442,"15min":0.41399999999999998},"max":{"1min":8.0690000000000008,"5min":48.652999999999999,"15min":48.652999999999999},"last":0.69499999999999995}]},{"osd":7,"last update":"Thu Apr 18 04:56:32 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":2.7360000000000002,"15min":2.194},"min":{"1min":0.54400000000000004,"5min":0.48899999999999999,"15min":0.437},"max":{"1min":2.4420000000000002,"5min":54.829000000000001,"15min":54.829000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.2110000000000001,"5min":4.3120000000000003,"15min":2.7069999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":7.7889999999999997,"5min":115.31399999999999,"15min":115.31399999999999},"last":0.65900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33312,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33312,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3121152,"data_stored":20972180,"data_compressed":2483986,"data_compressed_allocated":2842624,"data_compressed_original":20709376,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3178496,"data_stored":20972464,"data_compressed":2531508,"data_compressed_allocated":2936832,"data_compressed_original":20754432,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1396736,"data_stored":4285475,"data_compressed":439103,"data_compressed_allocated":598016,"data_compressed_original":3510272,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6742016,"data_stored":16869536,"data_compressed":1734435,"data_compressed_allocated":2166784,"data_compressed_original":12316672,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6316032,"data_stored":29361965,"data_compressed":3215159,"data_compressed_allocated":3665920,"data_compressed_original":26726400,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":3239936,"data_stored":18154962,"data_compressed":2174151,"data_compressed_allocated":2514944,"data_compressed_original":17453056,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3473408,"data_stored":16779689,"data_compressed":2087260,"data_compressed_allocated":2478080,"data_compressed_original":15798272,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10387456,"data_stored":34932699,"data_compressed":3585780,"data_compressed_allocated":4227072,"data_compressed_original":28794880,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T04:56:39.807 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-18T04:56:39.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.976+0000 7f7cc8400640 1 Processor -- start 2024-04-18T04:56:39.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.976+0000 7f7cc8400640 1 -- start start 2024-04-18T04:56:39.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.976+0000 7f7cc8400640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7cc00c1fe0 0x7f7cc0157db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:39.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.976+0000 7f7cc8400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7cc00c79c0 0x7f7cc00c23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:39.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.976+0000 7f7cc8400640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cc0157920 con 0x7f7cc00c3ef0 2024-04-18T04:56:39.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.976+0000 7f7cc8400640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc01582f0 con 0x7f7cc00c1fe0 2024-04-18T04:56:39.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.976+0000 7f7cc8400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc00c2900 con 0x7f7cc00c79c0 2024-04-18T04:56:39.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.980+0000 7f7cc6400640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f7cc00c3ef0 0x7f7cc015a920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:42090/0 (socket says 172.21.15.120:42090) 2024-04-18T04:56:39.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.980+0000 7f7cc6400640 1 -- 172.21.15.120:0/3810185566 learned_addr learned my addr 172.21.15.120:0/3810185566 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:56:39.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.980+0000 7f7cc5000640 1 --2- 172.21.15.120:0/3810185566 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7cc00c79c0 0x7f7cc00c23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:39.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.980+0000 7f7cc5a00640 1 --2- 172.21.15.120:0/3810185566 >> v2:172.21.15.132:3300/0 conn(0x7f7cc00c1fe0 0x7f7cc0157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:39.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.980+0000 7f7cbfe00640 1 -- 172.21.15.120:0/3810185566 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 681907026 0 0) 0x7f7cc0157920 con 0x7f7cc00c3ef0 2024-04-18T04:56:39.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.980+0000 7f7cbfe00640 1 -- 172.21.15.120:0/3810185566 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ca8003530 con 0x7f7cc00c3ef0 2024-04-18T04:56:39.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.980+0000 7f7cbfe00640 1 -- 172.21.15.120:0/3810185566 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4052930317 0 0) 0x7f7ca8003530 con 0x7f7cc00c3ef0 2024-04-18T04:56:39.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.980+0000 7f7cbfe00640 1 -- 172.21.15.120:0/3810185566 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7cc00c79c0 msgr2=0x7f7cc00c23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:56:39.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.980+0000 7f7cbfe00640 1 --2- 172.21.15.120:0/3810185566 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7cc00c79c0 0x7f7cc00c23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:39.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.980+0000 7f7cbfe00640 1 -- 172.21.15.120:0/3810185566 >> v2:172.21.15.132:3300/0 conn(0x7f7cc00c1fe0 msgr2=0x7f7cc0157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:56:39.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.980+0000 7f7cbfe00640 1 --2- 172.21.15.120:0/3810185566 >> v2:172.21.15.132:3300/0 conn(0x7f7cc00c1fe0 0x7f7cc0157db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:39.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.980+0000 7f7cbfe00640 1 -- 172.21.15.120:0/3810185566 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc006e9a0 con 0x7f7cc00c3ef0 2024-04-18T04:56:39.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.980+0000 7f7cbfe00640 1 -- 172.21.15.120:0/3810185566 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7f7cb8001a00 con 0x7f7cc00c3ef0 2024-04-18T04:56:39.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.980+0000 7f7cbfe00640 1 -- 172.21.15.120:0/3810185566 >> v1:172.21.15.120:6789/0 conn(0x7f7cc00c3ef0 legacy=0x7f7cc015a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:39.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.980+0000 7f7cbfe00640 1 --2- 172.21.15.120:0/3810185566 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ca8003980 0x7f7ca8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:39.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.980+0000 7f7cbfe00640 1 --2- 172.21.15.120:0/3810185566 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7ca80047d0 0x7f7ca8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:39.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.980+0000 7f7cbfe00640 1 --2- 172.21.15.120:0/3810185566 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7cc00c79c0 0x7f7ca8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:39.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.980+0000 7f7cbfe00640 1 -- 172.21.15.120:0/3810185566 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc01582f0 con 0x7f7ca80047d0 2024-04-18T04:56:39.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.980+0000 7f7cbfe00640 1 -- 172.21.15.120:0/3810185566 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc00c2900 con 0x7f7ca8003980 2024-04-18T04:56:39.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.980+0000 7f7cbfe00640 1 -- 172.21.15.120:0/3810185566 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca800b9c0 con 0x7f7cc00c79c0 2024-04-18T04:56:39.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.980+0000 7f7cc5000640 1 --2- 172.21.15.120:0/3810185566 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7ca80047d0 0x7f7ca8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:39.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.980+0000 7f7cc5a00640 1 --2- 172.21.15.120:0/3810185566 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ca8003980 0x7f7ca8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:39.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.980+0000 7f7cc6400640 1 --2- 172.21.15.120:0/3810185566 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7cc00c79c0 0x7f7ca8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:39.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.980+0000 7f7cc5000640 1 -- 172.21.15.120:0/3810185566 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7cc00c79c0 msgr2=0x7f7ca8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:56:39.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.980+0000 7f7cc5000640 1 --2- 172.21.15.120:0/3810185566 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7cc00c79c0 0x7f7ca8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:39.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.980+0000 7f7cc5000640 1 -- 172.21.15.120:0/3810185566 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ca8003980 msgr2=0x7f7ca8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:56:39.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.980+0000 7f7cc5000640 1 --2- 172.21.15.120:0/3810185566 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ca8003980 0x7f7ca8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:39.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.980+0000 7f7cc5000640 1 -- 172.21.15.120:0/3810185566 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca8003530 con 0x7f7ca80047d0 2024-04-18T04:56:39.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.984+0000 7f7cc5000640 1 --2- 172.21.15.120:0/3810185566 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7ca80047d0 0x7f7ca8004c50 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f7cac009ae0 tx=0x7f7cac01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38b2ba35d8f43311 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:39.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.984+0000 7f7cbfe00640 1 -- 172.21.15.120:0/3810185566 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac0a5660 con 0x7f7ca80047d0 2024-04-18T04:56:39.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.984+0000 7f7cbfe00640 1 -- 172.21.15.120:0/3810185566 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cac0a57c0 con 0x7f7ca80047d0 2024-04-18T04:56:39.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.984+0000 7f7cbfe00640 1 -- 172.21.15.120:0/3810185566 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac0a5b70 con 0x7f7ca80047d0 2024-04-18T04:56:39.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.984+0000 7f7cc8400640 1 -- 172.21.15.120:0/3810185566 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7ca80047d0 msgr2=0x7f7ca8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:39.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.984+0000 7f7cc8400640 1 --2- 172.21.15.120:0/3810185566 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7ca80047d0 0x7f7ca8004c50 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f7cac009ae0 tx=0x7f7cac01ca70 comp rx=0 tx=0).stop 2024-04-18T04:56:39.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.984+0000 7f7cc6400640 1 -- 172.21.15.120:0/3810185566 reap_dead start 2024-04-18T04:56:39.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.984+0000 7f7cc8400640 1 -- 172.21.15.120:0/3810185566 shutdown_connections 2024-04-18T04:56:39.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.984+0000 7f7cc8400640 1 -- 172.21.15.120:0/3810185566 >> 172.21.15.120:0/3810185566 conn(0x7f7cc0072190 msgr2=0x7f7cc0065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:39.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.984+0000 7f7cc8400640 1 -- 172.21.15.120:0/3810185566 shutdown_connections 2024-04-18T04:56:39.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.984+0000 7f7cc8400640 1 -- 172.21.15.120:0/3810185566 wait complete. 2024-04-18T04:56:39.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.984+0000 7f7cc8400640 1 Processor -- start 2024-04-18T04:56:39.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.984+0000 7f7cc8400640 1 -- start start 2024-04-18T04:56:39.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.988+0000 7f7cc8400640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7ca80047d0 0x7f7cc01eedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:39.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.988+0000 7f7cc8400640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cc01ef2f0 0x7f7cc0153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:39.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.988+0000 7f7cc8400640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7cc0152720 0x7f7cc01509d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:39.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.988+0000 7f7cc8400640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc01efa60 con 0x7f7ca80047d0 2024-04-18T04:56:39.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.988+0000 7f7cc8400640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc0153a20 con 0x7f7cc01ef2f0 2024-04-18T04:56:39.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.988+0000 7f7cc8400640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc00ca4e0 con 0x7f7cc0152720 2024-04-18T04:56:39.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.988+0000 7f7cc5a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7ca80047d0 0x7f7cc01eedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:39.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.988+0000 7f7cc5a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7ca80047d0 0x7f7cc01eedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:33734/0 (socket says 172.21.15.120:33734) 2024-04-18T04:56:39.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.988+0000 7f7cc5a00640 1 -- 172.21.15.120:0/2524264953 learned_addr learned my addr 172.21.15.120:0/2524264953 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:56:39.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.988+0000 7f7cc6400640 1 --2- 172.21.15.120:0/2524264953 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7cc0152720 0x7f7cc01509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:39.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.988+0000 7f7cc5000640 1 --2- 172.21.15.120:0/2524264953 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cc01ef2f0 0x7f7cc0153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:39.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.988+0000 7f7cc5a00640 1 -- 172.21.15.120:0/2524264953 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7cc0152720 msgr2=0x7f7cc01509d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:39.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.988+0000 7f7cc5a00640 1 --2- 172.21.15.120:0/2524264953 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7cc0152720 0x7f7cc01509d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:39.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.988+0000 7f7cc5a00640 1 -- 172.21.15.120:0/2524264953 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cc01ef2f0 msgr2=0x7f7cc0153eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:39.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.988+0000 7f7cc5a00640 1 --2- 172.21.15.120:0/2524264953 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cc01ef2f0 0x7f7cc0153eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:39.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.988+0000 7f7cc5a00640 1 -- 172.21.15.120:0/2524264953 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc01ef780 con 0x7f7ca80047d0 2024-04-18T04:56:39.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.988+0000 7f7cc6400640 1 --2- 172.21.15.120:0/2524264953 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7cc0152720 0x7f7cc01509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:56:39.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.988+0000 7f7cc5a00640 1 --2- 172.21.15.120:0/2524264953 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7ca80047d0 0x7f7cc01eedb0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4011ad0 tx=0x7f7cb4011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:39.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.988+0000 7f7cbd600640 1 -- 172.21.15.120:0/2524264953 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb400fbb0 con 0x7f7ca80047d0 2024-04-18T04:56:39.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.988+0000 7f7cbd600640 1 -- 172.21.15.120:0/2524264953 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb400fd10 con 0x7f7ca80047d0 2024-04-18T04:56:39.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.988+0000 7f7cbd600640 1 -- 172.21.15.120:0/2524264953 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb4014680 con 0x7f7ca80047d0 2024-04-18T04:56:39.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.988+0000 7f7cc8400640 1 -- 172.21.15.120:0/2524264953 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cc01533d0 con 0x7f7ca80047d0 2024-04-18T04:56:39.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.988+0000 7f7cc8400640 1 -- 172.21.15.120:0/2524264953 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc00c43a0 con 0x7f7ca80047d0 2024-04-18T04:56:39.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.988+0000 7f7cc8400640 1 -- 172.21.15.120:0/2524264953 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cc0067590 con 0x7f7ca80047d0 2024-04-18T04:56:39.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.988+0000 7f7cbd600640 1 -- 172.21.15.120:0/2524264953 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7cb40147e0 con 0x7f7ca80047d0 2024-04-18T04:56:39.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.992+0000 7f7cbd600640 1 --2- 172.21.15.120:0/2524264953 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7ca0066690 0x7f7ca0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:39.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.992+0000 7f7cbd600640 1 -- 172.21.15.120:0/2524264953 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f7cb40850e0 con 0x7f7ca80047d0 2024-04-18T04:56:39.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.992+0000 7f7cc5000640 1 --2- 172.21.15.120:0/2524264953 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7ca0066690 0x7f7ca0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:39.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.992+0000 7f7cc5000640 1 --2- 172.21.15.120:0/2524264953 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7ca0066690 0x7f7ca0068b50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7cac0af000 tx=0x7f7cac0046d0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:39.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:39.996+0000 7f7cbd600640 1 -- 172.21.15.120:0/2524264953 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f7cb4051e40 con 0x7f7ca80047d0 2024-04-18T04:56:40.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.152+0000 7f7cc8400640 1 -- 172.21.15.120:0/2524264953 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f7cc00729d0 con 0x7f7ca80047d0 2024-04-18T04:56:40.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.156+0000 7f7cbd600640 1 -- 172.21.15.120:0/2524264953 <== mon.0 v2:172.21.15.120:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7cb4051e40 con 0x7f7ca80047d0 2024-04-18T04:56:40.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.160+0000 7f7cbd600640 1 -- 172.21.15.120:0/2524264953 <== mon.0 v2:172.21.15.120:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f7cb40220c0 con 0x7f7ca80047d0 2024-04-18T04:56:40.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.160+0000 7f7cc8400640 1 -- 172.21.15.120:0/2524264953 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7ca0066690 msgr2=0x7f7ca0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:40.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.160+0000 7f7cc8400640 1 --2- 172.21.15.120:0/2524264953 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7ca0066690 0x7f7ca0068b50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7cac0af000 tx=0x7f7cac0046d0 comp rx=0 tx=0).stop 2024-04-18T04:56:40.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.160+0000 7f7cc8400640 1 -- 172.21.15.120:0/2524264953 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7ca80047d0 msgr2=0x7f7cc01eedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:40.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.160+0000 7f7cc8400640 1 --2- 172.21.15.120:0/2524264953 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7ca80047d0 0x7f7cc01eedb0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4011ad0 tx=0x7f7cb4011f90 comp rx=0 tx=0).stop 2024-04-18T04:56:40.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.160+0000 7f7cc8400640 1 -- 172.21.15.120:0/2524264953 shutdown_connections 2024-04-18T04:56:40.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.160+0000 7f7cc8400640 1 --2- 172.21.15.120:0/2524264953 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7ca0066690 0x7f7ca0068b50 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:40.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.160+0000 7f7cc8400640 1 --2- 172.21.15.120:0/2524264953 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7cc0152720 0x7f7cc01509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:40.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.160+0000 7f7cc8400640 1 --2- 172.21.15.120:0/2524264953 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cc01ef2f0 0x7f7cc0153eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:40.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.160+0000 7f7cc8400640 1 --2- 172.21.15.120:0/2524264953 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7ca80047d0 0x7f7cc01eedb0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:40.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.160+0000 7f7cc8400640 1 -- 172.21.15.120:0/2524264953 >> 172.21.15.120:0/2524264953 conn(0x7f7cc0072190 msgr2=0x7f7cc00cadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:40.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.160+0000 7f7cc8400640 1 -- 172.21.15.120:0/2524264953 shutdown_connections 2024-04-18T04:56:40.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.160+0000 7f7cc8400640 1 -- 172.21.15.120:0/2524264953 wait complete. 2024-04-18T04:56:40.179 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-18T04:56:40.179 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:56:40.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.320+0000 7f8136c00640 1 Processor -- start 2024-04-18T04:56:40.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.320+0000 7f8136c00640 1 -- start start 2024-04-18T04:56:40.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.320+0000 7f8136c00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f813015d860 0x7f8130153580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:40.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.320+0000 7f8136c00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f813006b660 con 0x7f813015d3a0 2024-04-18T04:56:40.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.320+0000 7f8136c00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81300c0e00 con 0x7f813015cfc0 2024-04-18T04:56:40.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.320+0000 7f8136c00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8130070060 con 0x7f813015d860 2024-04-18T04:56:40.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.320+0000 7f812f400640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f813015d3a0 0x7f81300c1290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:42102/0 (socket says 172.21.15.120:42102) 2024-04-18T04:56:40.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.320+0000 7f812f400640 1 -- 172.21.15.120:0/3396301302 learned_addr learned my addr 172.21.15.120:0/3396301302 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:56:40.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.320+0000 7f8134c00640 1 --2- 172.21.15.120:0/3396301302 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f813015d860 0x7f8130153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:40.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.320+0000 7f812ea00640 1 -- 172.21.15.120:0/3396301302 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 80832795 0 0) 0x7f813006b660 con 0x7f813015d3a0 2024-04-18T04:56:40.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.320+0000 7f812ea00640 1 -- 172.21.15.120:0/3396301302 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8114003530 con 0x7f813015d3a0 2024-04-18T04:56:40.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.320+0000 7f812ea00640 1 -- 172.21.15.120:0/3396301302 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1060308043 0 0) 0x7f8114003530 con 0x7f813015d3a0 2024-04-18T04:56:40.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.320+0000 7f812ea00640 1 -- 172.21.15.120:0/3396301302 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f813015d860 msgr2=0x7f8130153580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:56:40.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.320+0000 7f812ea00640 1 --2- 172.21.15.120:0/3396301302 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f813015d860 0x7f8130153580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:40.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.320+0000 7f812ea00640 1 -- 172.21.15.120:0/3396301302 >> v1:172.21.15.132:6789/0 conn(0x7f813015cfc0 legacy=0x7f813015a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:40.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.320+0000 7f812ea00640 1 -- 172.21.15.120:0/3396301302 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f813015dcf0 con 0x7f813015d3a0 2024-04-18T04:56:40.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.320+0000 7f812ea00640 1 -- 172.21.15.120:0/3396301302 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7f811c0016a0 con 0x7f813015d3a0 2024-04-18T04:56:40.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.320+0000 7f812ea00640 1 -- 172.21.15.120:0/3396301302 >> v1:172.21.15.120:6789/0 conn(0x7f813015d3a0 legacy=0x7f81300c1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:40.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.320+0000 7f812ea00640 1 --2- 172.21.15.120:0/3396301302 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f813015d860 0x7f81140039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:40.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.320+0000 7f812ea00640 1 --2- 172.21.15.120:0/3396301302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8114003f30 0x7f81140047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:40.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.320+0000 7f812ea00640 1 --2- 172.21.15.120:0/3396301302 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8114004d10 0x7f8114005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:40.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.320+0000 7f812ea00640 1 -- 172.21.15.120:0/3396301302 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811400bad0 con 0x7f8114003f30 2024-04-18T04:56:40.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.320+0000 7f812ea00640 1 -- 172.21.15.120:0/3396301302 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811400bc40 con 0x7f8114004d10 2024-04-18T04:56:40.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.320+0000 7f812ea00640 1 -- 172.21.15.120:0/3396301302 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f811400be00 con 0x7f813015d860 2024-04-18T04:56:40.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.320+0000 7f812f400640 1 --2- 172.21.15.120:0/3396301302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8114003f30 0x7f81140047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:40.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.320+0000 7f8134c00640 1 --2- 172.21.15.120:0/3396301302 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8114004d10 0x7f8114005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:40.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.320+0000 7f812fe00640 1 --2- 172.21.15.120:0/3396301302 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f813015d860 0x7f81140039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:40.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.320+0000 7f812f400640 1 -- 172.21.15.120:0/3396301302 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f813015d860 msgr2=0x7f81140039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:56:40.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.320+0000 7f812f400640 1 --2- 172.21.15.120:0/3396301302 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f813015d860 0x7f81140039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:40.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.320+0000 7f812f400640 1 -- 172.21.15.120:0/3396301302 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8114004d10 msgr2=0x7f8114005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:56:40.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.320+0000 7f812f400640 1 --2- 172.21.15.120:0/3396301302 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8114004d10 0x7f8114005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:40.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.320+0000 7f812f400640 1 -- 172.21.15.120:0/3396301302 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8114003530 con 0x7f8114003f30 2024-04-18T04:56:40.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.320+0000 7f812fe00640 1 --2- 172.21.15.120:0/3396301302 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f813015d860 0x7f81140039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:56:40.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.324+0000 7f812f400640 1 --2- 172.21.15.120:0/3396301302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8114003f30 0x7f81140047d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f811c00c190 tx=0x7f811c01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f76bcdf3afa0d91 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:40.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.324+0000 7f812ea00640 1 -- 172.21.15.120:0/3396301302 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811c0a5b20 con 0x7f8114003f30 2024-04-18T04:56:40.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.324+0000 7f812ea00640 1 -- 172.21.15.120:0/3396301302 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f811c0a5c80 con 0x7f8114003f30 2024-04-18T04:56:40.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.324+0000 7f812ea00640 1 -- 172.21.15.120:0/3396301302 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811c0058e0 con 0x7f8114003f30 2024-04-18T04:56:40.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.324+0000 7f8136c00640 1 -- 172.21.15.120:0/3396301302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8114003f30 msgr2=0x7f81140047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:40.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.324+0000 7f8136c00640 1 --2- 172.21.15.120:0/3396301302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8114003f30 0x7f81140047d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f811c00c190 tx=0x7f811c01cc20 comp rx=0 tx=0).stop 2024-04-18T04:56:40.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.324+0000 7f8134c00640 1 -- 172.21.15.120:0/3396301302 reap_dead start 2024-04-18T04:56:40.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.324+0000 7f8136c00640 1 -- 172.21.15.120:0/3396301302 shutdown_connections 2024-04-18T04:56:40.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.324+0000 7f8136c00640 1 -- 172.21.15.120:0/3396301302 >> 172.21.15.120:0/3396301302 conn(0x7f81300c78c0 msgr2=0x7f81300c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:40.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.324+0000 7f8136c00640 1 -- 172.21.15.120:0/3396301302 shutdown_connections 2024-04-18T04:56:40.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.324+0000 7f8136c00640 1 -- 172.21.15.120:0/3396301302 wait complete. 2024-04-18T04:56:40.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.328+0000 7f8136c00640 1 Processor -- start 2024-04-18T04:56:40.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.328+0000 7f8136c00640 1 -- start start 2024-04-18T04:56:40.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.328+0000 7f8136c00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8114003f30 0x7f8130157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:40.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.328+0000 7f8136c00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8130156d80 0x7f81301f2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:40.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.328+0000 7f8136c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81301592b0 0x7f81301f2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:40.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.328+0000 7f8136c00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81301f2400 con 0x7f81301592b0 2024-04-18T04:56:40.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.328+0000 7f8136c00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813015ca70 con 0x7f8114003f30 2024-04-18T04:56:40.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.328+0000 7f8136c00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81300caa40 con 0x7f8130156d80 2024-04-18T04:56:40.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.328+0000 7f8134c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81301592b0 0x7f81301f2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:40.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.328+0000 7f8134c00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81301592b0 0x7f81301f2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:33762/0 (socket says 172.21.15.120:33762) 2024-04-18T04:56:40.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.328+0000 7f8134c00640 1 -- 172.21.15.120:0/76211872 learned_addr learned my addr 172.21.15.120:0/76211872 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:56:40.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.328+0000 7f812fe00640 1 --2- 172.21.15.120:0/76211872 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8114003f30 0x7f8130157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:40.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.328+0000 7f812f400640 1 --2- 172.21.15.120:0/76211872 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8130156d80 0x7f81301f2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:40.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.328+0000 7f8134c00640 1 -- 172.21.15.120:0/76211872 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8130156d80 msgr2=0x7f81301f2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:40.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.328+0000 7f8134c00640 1 --2- 172.21.15.120:0/76211872 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8130156d80 0x7f81301f2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:40.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.328+0000 7f8134c00640 1 -- 172.21.15.120:0/76211872 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8114003f30 msgr2=0x7f8130157610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:40.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.328+0000 7f8134c00640 1 --2- 172.21.15.120:0/76211872 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8114003f30 0x7f8130157610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:40.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.328+0000 7f8134c00640 1 -- 172.21.15.120:0/76211872 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f813014d9c0 con 0x7f81301592b0 2024-04-18T04:56:40.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.328+0000 7f812f400640 1 --2- 172.21.15.120:0/76211872 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8130156d80 0x7f81301f2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:56:40.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.328+0000 7f8134c00640 1 --2- 172.21.15.120:0/76211872 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81301592b0 0x7f81301f2d60 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f813006ee30 tx=0x7f812800f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:40.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.328+0000 7f8127e00640 1 -- 172.21.15.120:0/76211872 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812800e040 con 0x7f81301592b0 2024-04-18T04:56:40.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.328+0000 7f8127e00640 1 -- 172.21.15.120:0/76211872 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f812800f040 con 0x7f81301592b0 2024-04-18T04:56:40.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.328+0000 7f8127e00640 1 -- 172.21.15.120:0/76211872 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8128015430 con 0x7f81301592b0 2024-04-18T04:56:40.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.328+0000 7f8136c00640 1 -- 172.21.15.120:0/76211872 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f813014dca0 con 0x7f81301592b0 2024-04-18T04:56:40.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.328+0000 7f8136c00640 1 -- 172.21.15.120:0/76211872 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f813014e260 con 0x7f81301592b0 2024-04-18T04:56:40.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.332+0000 7f8136c00640 1 -- 172.21.15.120:0/76211872 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81301f2540 con 0x7f81301592b0 2024-04-18T04:56:40.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.332+0000 7f8127e00640 1 -- 172.21.15.120:0/76211872 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8128015590 con 0x7f81301592b0 2024-04-18T04:56:40.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.332+0000 7f8127e00640 1 --2- 172.21.15.120:0/76211872 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f81100666c0 0x7f8110068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:40.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.332+0000 7f8127e00640 1 -- 172.21.15.120:0/76211872 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f81280850e0 con 0x7f81301592b0 2024-04-18T04:56:40.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.332+0000 7f812fe00640 1 --2- 172.21.15.120:0/76211872 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f81100666c0 0x7f8110068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:40.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.332+0000 7f812fe00640 1 --2- 172.21.15.120:0/76211872 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f81100666c0 0x7f8110068b80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f81200016e0 tx=0x7f8120009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:40.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.336+0000 7f8127e00640 1 -- 172.21.15.120:0/76211872 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f81301f2540 con 0x7f81301592b0 2024-04-18T04:56:40.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.536+0000 7f8136c00640 1 -- 172.21.15.120:0/76211872 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f81301f2540 con 0x7f81301592b0 2024-04-18T04:56:40.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.536+0000 7f8127e00640 1 -- 172.21.15.120:0/76211872 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+6279 (secure 0 0 0) 0x7f81301f2540 con 0x7f81301592b0 2024-04-18T04:56:40.535 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:56:40.535 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":49,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5602,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/450336204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":450336204},{"type":"v1","addr":"172.21.15.132:6835","nonce":450336204}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:54:18.217132+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5105,"mds_1":5400},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_5105":{"gid":5105,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":14,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5400":{"gid":5400,"name":"e","rank":1,"incarnation":44,"state":"up:active","state_seq":27,"addr":"172.21.15.120:6837/671327196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":671327196},{"type":"v1","addr":"172.21.15.120:6837","nonce":671327196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:56:40.535 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 49 2024-04-18T04:56:40.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.540+0000 7f8136c00640 1 -- 172.21.15.120:0/76211872 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f81100666c0 msgr2=0x7f8110068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:40.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.540+0000 7f8136c00640 1 --2- 172.21.15.120:0/76211872 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f81100666c0 0x7f8110068b80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f81200016e0 tx=0x7f8120009040 comp rx=0 tx=0).stop 2024-04-18T04:56:40.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.540+0000 7f8136c00640 1 -- 172.21.15.120:0/76211872 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81301592b0 msgr2=0x7f81301f2d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:40.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.540+0000 7f8136c00640 1 --2- 172.21.15.120:0/76211872 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81301592b0 0x7f81301f2d60 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f813006ee30 tx=0x7f812800f1b0 comp rx=0 tx=0).stop 2024-04-18T04:56:40.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.540+0000 7f8136c00640 1 -- 172.21.15.120:0/76211872 shutdown_connections 2024-04-18T04:56:40.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.540+0000 7f8136c00640 1 --2- 172.21.15.120:0/76211872 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f81100666c0 0x7f8110068b80 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:40.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.540+0000 7f8136c00640 1 --2- 172.21.15.120:0/76211872 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81301592b0 0x7f81301f2d60 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:40.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.540+0000 7f8136c00640 1 --2- 172.21.15.120:0/76211872 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8130156d80 0x7f81301f2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:40.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.540+0000 7f8136c00640 1 --2- 172.21.15.120:0/76211872 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8114003f30 0x7f8130157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:40.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.540+0000 7f8136c00640 1 -- 172.21.15.120:0/76211872 >> 172.21.15.120:0/76211872 conn(0x7f81300c78c0 msgr2=0x7f81300708b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:40.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.540+0000 7f8136c00640 1 -- 172.21.15.120:0/76211872 shutdown_connections 2024-04-18T04:56:40.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.540+0000 7f8136c00640 1 -- 172.21.15.120:0/76211872 wait complete. 2024-04-18T04:56:40.556 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T04:56:40.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.700+0000 7f7369800640 1 Processor -- start 2024-04-18T04:56:40.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.700+0000 7f7369800640 1 -- start start 2024-04-18T04:56:40.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.700+0000 7f7369800640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f73640c74a0 0x7f7364157180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:40.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.700+0000 7f7369800640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f736406b620 0x7f736406ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:40.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.700+0000 7f7369800640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73640701c0 con 0x7f7364151450 2024-04-18T04:56:40.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.700+0000 7f7369800640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73640c67a0 con 0x7f73640c74a0 2024-04-18T04:56:40.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.700+0000 7f7369800640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73640c5860 con 0x7f736406b620 2024-04-18T04:56:40.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.700+0000 7f735be00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f73640c74a0 0x7f7364157180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:40.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.700+0000 7f735be00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f73640c74a0 0x7f7364157180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:33772/0 (socket says 172.21.15.120:33772) 2024-04-18T04:56:40.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.700+0000 7f735be00640 1 -- 172.21.15.120:0/3629233819 learned_addr learned my addr 172.21.15.120:0/3629233819 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:56:40.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.700+0000 7f7368e00640 1 --2- 172.21.15.120:0/3629233819 >> v2:172.21.15.132:3300/0 conn(0x7f736406b620 0x7f736406ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:40.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.700+0000 7f735be00640 1 -- 172.21.15.120:0/3629233819 >> v2:172.21.15.132:3300/0 conn(0x7f736406b620 msgr2=0x7f736406ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:56:40.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.700+0000 7f735be00640 1 --2- 172.21.15.120:0/3629233819 >> v2:172.21.15.132:3300/0 conn(0x7f736406b620 0x7f736406ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:40.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.700+0000 7f735be00640 1 -- 172.21.15.120:0/3629233819 >> v1:172.21.15.120:6789/0 conn(0x7f7364151450 legacy=0x7f736406fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:40.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.700+0000 7f735be00640 1 -- 172.21.15.120:0/3629233819 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73640c5b20 con 0x7f73640c74a0 2024-04-18T04:56:40.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.704+0000 7f735be00640 1 --2- 172.21.15.120:0/3629233819 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73640c74a0 0x7f7364157180 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f736415b810 tx=0x7f734c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a6237af22e3a66b server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:40.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.704+0000 7f7363400640 1 -- 172.21.15.120:0/3629233819 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734c0a8a10 con 0x7f73640c74a0 2024-04-18T04:56:40.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.704+0000 7f7363400640 1 -- 172.21.15.120:0/3629233819 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f734c0a8b70 con 0x7f73640c74a0 2024-04-18T04:56:40.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.704+0000 7f7363400640 1 -- 172.21.15.120:0/3629233819 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734c0b0440 con 0x7f73640c74a0 2024-04-18T04:56:40.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.704+0000 7f7369800640 1 -- 172.21.15.120:0/3629233819 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73640c74a0 msgr2=0x7f7364157180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:40.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.704+0000 7f7369800640 1 --2- 172.21.15.120:0/3629233819 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73640c74a0 0x7f7364157180 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f736415b810 tx=0x7f734c01ed10 comp rx=0 tx=0).stop 2024-04-18T04:56:40.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.704+0000 7f7369800640 1 -- 172.21.15.120:0/3629233819 shutdown_connections 2024-04-18T04:56:40.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.704+0000 7f7369800640 1 --2- 172.21.15.120:0/3629233819 >> v2:172.21.15.132:3300/0 conn(0x7f736406b620 0x7f736406ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:40.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.704+0000 7f7369800640 1 --2- 172.21.15.120:0/3629233819 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73640c74a0 0x7f7364157180 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:40.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.704+0000 7f7369800640 1 -- 172.21.15.120:0/3629233819 >> 172.21.15.120:0/3629233819 conn(0x7f736406d000 msgr2=0x7f736406d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:40.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.704+0000 7f7369800640 1 -- 172.21.15.120:0/3629233819 shutdown_connections 2024-04-18T04:56:40.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.704+0000 7f7369800640 1 -- 172.21.15.120:0/3629233819 wait complete. 2024-04-18T04:56:40.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.704+0000 7f7369800640 1 Processor -- start 2024-04-18T04:56:40.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.708+0000 7f7369800640 1 -- start start 2024-04-18T04:56:40.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.708+0000 7f7369800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f736406b620 0x7f73641ef5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:40.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.708+0000 7f7369800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f73640c74a0 0x7f73641590e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:40.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.708+0000 7f7369800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7364151450 0x7f7364152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:40.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.708+0000 7f7369800640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73641efb20 con 0x7f736406b620 2024-04-18T04:56:40.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.708+0000 7f7369800640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7364154bb0 con 0x7f7364151450 2024-04-18T04:56:40.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.708+0000 7f7369800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7364151c70 con 0x7f73640c74a0 2024-04-18T04:56:40.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.708+0000 7f7363e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f736406b620 0x7f73641ef5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:40.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.708+0000 7f7363e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f736406b620 0x7f73641ef5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:33784/0 (socket says 172.21.15.120:33784) 2024-04-18T04:56:40.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.708+0000 7f7363e00640 1 -- 172.21.15.120:0/1701936780 learned_addr learned my addr 172.21.15.120:0/1701936780 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:56:40.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.708+0000 7f735be00640 1 --2- 172.21.15.120:0/1701936780 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f73640c74a0 0x7f73641590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:40.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.708+0000 7f7368e00640 1 --2- 172.21.15.120:0/1701936780 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7364151450 0x7f7364152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:40.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.708+0000 7f7363e00640 1 -- 172.21.15.120:0/1701936780 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f73640c74a0 msgr2=0x7f73641590e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:40.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.708+0000 7f7363e00640 1 --2- 172.21.15.120:0/1701936780 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f73640c74a0 0x7f73641590e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:40.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.708+0000 7f7363e00640 1 -- 172.21.15.120:0/1701936780 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7364151450 msgr2=0x7f7364152100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:40.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.708+0000 7f7363e00640 1 --2- 172.21.15.120:0/1701936780 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7364151450 0x7f7364152100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:40.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.708+0000 7f7363e00640 1 -- 172.21.15.120:0/1701936780 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f734c0094d0 con 0x7f736406b620 2024-04-18T04:56:40.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.708+0000 7f735be00640 1 --2- 172.21.15.120:0/1701936780 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f73640c74a0 0x7f73641590e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:56:40.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.708+0000 7f7368e00640 1 --2- 172.21.15.120:0/1701936780 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7364151450 0x7f7364152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T04:56:40.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.708+0000 7f7363e00640 1 --2- 172.21.15.120:0/1701936780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f736406b620 0x7f73641ef5e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f735400c530 tx=0x7f735400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:40.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.708+0000 7f7360c00640 1 -- 172.21.15.120:0/1701936780 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7354005220 con 0x7f736406b620 2024-04-18T04:56:40.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.708+0000 7f7360c00640 1 -- 172.21.15.120:0/1701936780 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7354005380 con 0x7f736406b620 2024-04-18T04:56:40.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.708+0000 7f7360c00640 1 -- 172.21.15.120:0/1701936780 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7354007290 con 0x7f736406b620 2024-04-18T04:56:40.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.708+0000 7f7369800640 1 -- 172.21.15.120:0/1701936780 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7364147600 con 0x7f736406b620 2024-04-18T04:56:40.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.708+0000 7f7369800640 1 -- 172.21.15.120:0/1701936780 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7364154310 con 0x7f736406b620 2024-04-18T04:56:40.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.708+0000 7f7369800640 1 -- 172.21.15.120:0/1701936780 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73640728f0 con 0x7f736406b620 2024-04-18T04:56:40.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.712+0000 7f7360c00640 1 -- 172.21.15.120:0/1701936780 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f73540073f0 con 0x7f736406b620 2024-04-18T04:56:40.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.712+0000 7f7360c00640 1 --2- 172.21.15.120:0/1701936780 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7340066690 0x7f7340068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:40.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.712+0000 7f7360c00640 1 -- 172.21.15.120:0/1701936780 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f7354083ff0 con 0x7f736406b620 2024-04-18T04:56:40.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.712+0000 7f735be00640 1 --2- 172.21.15.120:0/1701936780 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7340066690 0x7f7340068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:40.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.712+0000 7f735be00640 1 --2- 172.21.15.120:0/1701936780 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7340066690 0x7f7340068b50 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f734c0b2000 tx=0x7f734c0aa070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:40.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.716+0000 7f7360c00640 1 -- 172.21.15.120:0/1701936780 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f73540b5be0 con 0x7f736406b620 2024-04-18T04:56:40.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.908+0000 7f7369800640 1 -- 172.21.15.120:0/1701936780 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f73640c9550 con 0x7f736406b620 2024-04-18T04:56:40.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.908+0000 7f7360c00640 1 -- 172.21.15.120:0/1701936780 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+6279 (secure 0 0 0) 0x7f7354050e00 con 0x7f736406b620 2024-04-18T04:56:40.905 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:56:40.905 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":49,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4292136288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4292136288},{"type":"v1","addr":"172.21.15.132:6839","nonce":4292136288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/1712856922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6837","nonce":1712856922},{"type":"v1","addr":"172.21.15.132:6838","nonce":1712856922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2384594941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2384594941},{"type":"v1","addr":"172.21.15.120:6836","nonce":2384594941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5602,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/450336204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":450336204},{"type":"v1","addr":"172.21.15.132:6835","nonce":450336204}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T04:44:30.251235+0000","modified":"2024-04-18T04:54:18.217132+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5105,"mds_1":5400},"failed":[],"damaged":[],"stopped":[2],"info":{"gid_5105":{"gid":5105,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":14,"addr":"172.21.15.120:6833/3842815393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3842815393},{"type":"v1","addr":"172.21.15.120:6833","nonce":3842815393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5400":{"gid":5400,"name":"e","rank":1,"incarnation":44,"state":"up:active","state_seq":27,"addr":"172.21.15.120:6837/671327196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":671327196},{"type":"v1","addr":"172.21.15.120:6837","nonce":671327196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T04:56:40.906 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 49 2024-04-18T04:56:40.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.908+0000 7f7369800640 1 -- 172.21.15.120:0/1701936780 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7340066690 msgr2=0x7f7340068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:40.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.908+0000 7f7369800640 1 --2- 172.21.15.120:0/1701936780 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7340066690 0x7f7340068b50 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f734c0b2000 tx=0x7f734c0aa070 comp rx=0 tx=0).stop 2024-04-18T04:56:40.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.908+0000 7f7369800640 1 -- 172.21.15.120:0/1701936780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f736406b620 msgr2=0x7f73641ef5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:40.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.908+0000 7f7369800640 1 --2- 172.21.15.120:0/1701936780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f736406b620 0x7f73641ef5e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f735400c530 tx=0x7f735400c9f0 comp rx=0 tx=0).stop 2024-04-18T04:56:40.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.908+0000 7f7369800640 1 -- 172.21.15.120:0/1701936780 shutdown_connections 2024-04-18T04:56:40.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.908+0000 7f7369800640 1 --2- 172.21.15.120:0/1701936780 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f7340066690 0x7f7340068b50 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:40.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.908+0000 7f7369800640 1 --2- 172.21.15.120:0/1701936780 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7364151450 0x7f7364152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:40.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.908+0000 7f7369800640 1 --2- 172.21.15.120:0/1701936780 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f73640c74a0 0x7f73641590e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:40.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.908+0000 7f7369800640 1 --2- 172.21.15.120:0/1701936780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f736406b620 0x7f73641ef5e0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:40.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.908+0000 7f7369800640 1 -- 172.21.15.120:0/1701936780 >> 172.21.15.120:0/1701936780 conn(0x7f736406d000 msgr2=0x7f7364156e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:40.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.908+0000 7f7369800640 1 -- 172.21.15.120:0/1701936780 shutdown_connections 2024-04-18T04:56:40.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:40.908+0000 7f7369800640 1 -- 172.21.15.120:0/1701936780 wait complete. 2024-04-18T04:56:40.928 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T04:56:41.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.068+0000 7f9d17800640 1 Processor -- start 2024-04-18T04:56:41.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.068+0000 7f9d17800640 1 -- start start 2024-04-18T04:56:41.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.068+0000 7f9d17800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d100cd520 0x7f9d1015a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:41.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.068+0000 7f9d17800640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9d10153540 0x7f9d101539b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:41.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.068+0000 7f9d17800640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d1006f5e0 con 0x7f9d100cd140 2024-04-18T04:56:41.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.068+0000 7f9d17800640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d10153ef0 con 0x7f9d10153540 2024-04-18T04:56:41.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.068+0000 7f9d17800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d100ca9d0 con 0x7f9d100cd520 2024-04-18T04:56:41.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.068+0000 7f9d14e00640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f9d100cd140 0x7f9d100ca2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:33026/0 (socket says 172.21.15.120:33026) 2024-04-18T04:56:41.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.068+0000 7f9d14e00640 1 -- 172.21.15.120:0/342697839 learned_addr learned my addr 172.21.15.120:0/342697839 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:56:41.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.068+0000 7f9d0fe00640 1 --2- 172.21.15.120:0/342697839 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d100cd520 0x7f9d1015a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:41.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.068+0000 7f9d15800640 1 --2- 172.21.15.120:0/342697839 >> v2:172.21.15.132:3300/0 conn(0x7f9d10153540 0x7f9d101539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:41.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.068+0000 7f9d0f400640 1 -- 172.21.15.120:0/342697839 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2471623161 0 0) 0x7f9d1006f5e0 con 0x7f9d100cd140 2024-04-18T04:56:41.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.068+0000 7f9d0f400640 1 -- 172.21.15.120:0/342697839 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cf8003530 con 0x7f9d100cd140 2024-04-18T04:56:41.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.068+0000 7f9d0f400640 1 -- 172.21.15.120:0/342697839 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 862923686 0 0) 0x7f9cf8003530 con 0x7f9d100cd140 2024-04-18T04:56:41.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.068+0000 7f9d0f400640 1 -- 172.21.15.120:0/342697839 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d100cd520 msgr2=0x7f9d1015a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:56:41.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.068+0000 7f9d0f400640 1 --2- 172.21.15.120:0/342697839 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d100cd520 0x7f9d1015a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:41.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.068+0000 7f9d0f400640 1 -- 172.21.15.120:0/342697839 >> v2:172.21.15.132:3300/0 conn(0x7f9d10153540 msgr2=0x7f9d101539b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:56:41.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.068+0000 7f9d0f400640 1 --2- 172.21.15.120:0/342697839 >> v2:172.21.15.132:3300/0 conn(0x7f9d10153540 0x7f9d101539b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:41.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.068+0000 7f9d0f400640 1 -- 172.21.15.120:0/342697839 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d1006f880 con 0x7f9d100cd140 2024-04-18T04:56:41.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.072+0000 7f9d0f400640 1 -- 172.21.15.120:0/342697839 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3269244278 0 0) 0x7f9d04001680 con 0x7f9d100cd140 2024-04-18T04:56:41.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.072+0000 7f9d0f400640 1 -- 172.21.15.120:0/342697839 >> v1:172.21.15.120:6789/0 conn(0x7f9d100cd140 legacy=0x7f9d100ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:41.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.072+0000 7f9d0f400640 1 --2- 172.21.15.120:0/342697839 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cf8003980 0x7f9cf8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:41.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.072+0000 7f9d0f400640 1 --2- 172.21.15.120:0/342697839 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9cf80047d0 0x7f9cf8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:41.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.072+0000 7f9d0f400640 1 --2- 172.21.15.120:0/342697839 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d100cd520 0x7f9cf8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:41.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.072+0000 7f9d0f400640 1 -- 172.21.15.120:0/342697839 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d10153ef0 con 0x7f9cf80047d0 2024-04-18T04:56:41.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.072+0000 7f9d0f400640 1 -- 172.21.15.120:0/342697839 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d100ca9d0 con 0x7f9cf8003980 2024-04-18T04:56:41.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.072+0000 7f9d0f400640 1 -- 172.21.15.120:0/342697839 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf800b990 con 0x7f9d100cd520 2024-04-18T04:56:41.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.072+0000 7f9d0fe00640 1 --2- 172.21.15.120:0/342697839 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9cf80047d0 0x7f9cf8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:41.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.072+0000 7f9d14e00640 1 --2- 172.21.15.120:0/342697839 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cf8003980 0x7f9cf8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:41.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.072+0000 7f9d15800640 1 --2- 172.21.15.120:0/342697839 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d100cd520 0x7f9cf8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:41.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.072+0000 7f9d0fe00640 1 -- 172.21.15.120:0/342697839 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d100cd520 msgr2=0x7f9cf8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:56:41.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.072+0000 7f9d0fe00640 1 --2- 172.21.15.120:0/342697839 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d100cd520 0x7f9cf8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:41.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.072+0000 7f9d0fe00640 1 -- 172.21.15.120:0/342697839 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cf8003980 msgr2=0x7f9cf8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:56:41.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.072+0000 7f9d0fe00640 1 --2- 172.21.15.120:0/342697839 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cf8003980 0x7f9cf8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:41.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.072+0000 7f9d0fe00640 1 -- 172.21.15.120:0/342697839 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf8003530 con 0x7f9cf80047d0 2024-04-18T04:56:41.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.072+0000 7f9d0fe00640 1 --2- 172.21.15.120:0/342697839 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9cf80047d0 0x7f9cf8004c50 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc009ab0 tx=0x7f9cfc01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=583a8391f23f1f4d server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:41.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.072+0000 7f9d0f400640 1 -- 172.21.15.120:0/342697839 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc0a5560 con 0x7f9cf80047d0 2024-04-18T04:56:41.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.072+0000 7f9d0f400640 1 -- 172.21.15.120:0/342697839 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9cfc0a56c0 con 0x7f9cf80047d0 2024-04-18T04:56:41.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.072+0000 7f9d0f400640 1 -- 172.21.15.120:0/342697839 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc0a5a90 con 0x7f9cf80047d0 2024-04-18T04:56:41.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.076+0000 7f9d17800640 1 -- 172.21.15.120:0/342697839 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9cf80047d0 msgr2=0x7f9cf8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:41.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.076+0000 7f9d17800640 1 --2- 172.21.15.120:0/342697839 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9cf80047d0 0x7f9cf8004c50 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc009ab0 tx=0x7f9cfc01ca50 comp rx=0 tx=0).stop 2024-04-18T04:56:41.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.076+0000 7f9d15800640 1 -- 172.21.15.120:0/342697839 reap_dead start 2024-04-18T04:56:41.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.076+0000 7f9d17800640 1 -- 172.21.15.120:0/342697839 shutdown_connections 2024-04-18T04:56:41.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.076+0000 7f9d17800640 1 -- 172.21.15.120:0/342697839 >> 172.21.15.120:0/342697839 conn(0x7f9d1006e0f0 msgr2=0x7f9d10071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:41.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.076+0000 7f9d17800640 1 -- 172.21.15.120:0/342697839 shutdown_connections 2024-04-18T04:56:41.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.076+0000 7f9d17800640 1 -- 172.21.15.120:0/342697839 wait complete. 2024-04-18T04:56:41.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.076+0000 7f9d17800640 1 Processor -- start 2024-04-18T04:56:41.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.076+0000 7f9d17800640 1 -- start start 2024-04-18T04:56:41.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.076+0000 7f9d17800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9cf80047d0 0x7f9d101f26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:41.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.076+0000 7f9d17800640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d1015b970 0x7f9d10146b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:41.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.076+0000 7f9d17800640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d10157b80 0x7f9d10158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:41.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.076+0000 7f9d17800640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d101f2be0 con 0x7f9cf80047d0 2024-04-18T04:56:41.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.076+0000 7f9d17800640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d101555f0 con 0x7f9d1015b970 2024-04-18T04:56:41.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.076+0000 7f9d17800640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d101eea20 con 0x7f9d10157b80 2024-04-18T04:56:41.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.076+0000 7f9d14e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9cf80047d0 0x7f9d101f26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:41.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.076+0000 7f9d14e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9cf80047d0 0x7f9d101f26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34250/0 (socket says 172.21.15.120:34250) 2024-04-18T04:56:41.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.076+0000 7f9d14e00640 1 -- 172.21.15.120:0/1067478486 learned_addr learned my addr 172.21.15.120:0/1067478486 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:56:41.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.076+0000 7f9d0fe00640 1 --2- 172.21.15.120:0/1067478486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d1015b970 0x7f9d10146b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:41.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.076+0000 7f9d15800640 1 --2- 172.21.15.120:0/1067478486 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d10157b80 0x7f9d10158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:41.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.076+0000 7f9d14e00640 1 -- 172.21.15.120:0/1067478486 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d10157b80 msgr2=0x7f9d10158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:41.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.076+0000 7f9d14e00640 1 --2- 172.21.15.120:0/1067478486 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d10157b80 0x7f9d10158000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:41.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.076+0000 7f9d14e00640 1 -- 172.21.15.120:0/1067478486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d1015b970 msgr2=0x7f9d10146b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:41.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.076+0000 7f9d14e00640 1 --2- 172.21.15.120:0/1067478486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d1015b970 0x7f9d10146b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:41.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.076+0000 7f9d14e00640 1 -- 172.21.15.120:0/1067478486 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d101eed00 con 0x7f9cf80047d0 2024-04-18T04:56:41.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.080+0000 7f9d14e00640 1 --2- 172.21.15.120:0/1067478486 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9cf80047d0 0x7f9d101f26a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f9d04007310 tx=0x7f9d040077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:41.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.080+0000 7f9d0cc00640 1 -- 172.21.15.120:0/1067478486 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0400f9c0 con 0x7f9cf80047d0 2024-04-18T04:56:41.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.080+0000 7f9d0cc00640 1 -- 172.21.15.120:0/1067478486 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9d0400fb40 con 0x7f9cf80047d0 2024-04-18T04:56:41.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.080+0000 7f9d0cc00640 1 -- 172.21.15.120:0/1067478486 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d040133f0 con 0x7f9cf80047d0 2024-04-18T04:56:41.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.080+0000 7f9d17800640 1 -- 172.21.15.120:0/1067478486 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d101eefe0 con 0x7f9cf80047d0 2024-04-18T04:56:41.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.080+0000 7f9d17800640 1 -- 172.21.15.120:0/1067478486 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d10147080 con 0x7f9cf80047d0 2024-04-18T04:56:41.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.080+0000 7f9d17800640 1 -- 172.21.15.120:0/1067478486 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d10072a70 con 0x7f9cf80047d0 2024-04-18T04:56:41.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.080+0000 7f9d0cc00640 1 -- 172.21.15.120:0/1067478486 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9d04013550 con 0x7f9cf80047d0 2024-04-18T04:56:41.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.080+0000 7f9d0cc00640 1 --2- 172.21.15.120:0/1067478486 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9cf00666e0 0x7f9cf0068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:41.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.080+0000 7f9d0cc00640 1 -- 172.21.15.120:0/1067478486 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f9d04084980 con 0x7f9cf80047d0 2024-04-18T04:56:41.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.084+0000 7f9d0fe00640 1 --2- 172.21.15.120:0/1067478486 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9cf00666e0 0x7f9cf0068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:41.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.084+0000 7f9d0fe00640 1 --2- 172.21.15.120:0/1067478486 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9cf00666e0 0x7f9cf0068ba0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc0af000 tx=0x7f9cfc0046d0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:41.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.084+0000 7f9d0cc00640 1 -- 172.21.15.120:0/1067478486 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f9d04051740 con 0x7f9cf80047d0 2024-04-18T04:56:41.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.248+0000 7f9d17800640 1 -- 172.21.15.120:0/1067478486 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d1015afe0 con 0x7f9cf80047d0 2024-04-18T04:56:41.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.248+0000 7f9d0cc00640 1 -- 172.21.15.120:0/1067478486 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+18910 (secure 0 0 0) 0x7f9d04053670 con 0x7f9cf80047d0 2024-04-18T04:56:41.247 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-18T04:56:41.247 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":32,"fsid":"8e73592f-08e2-4957-a98f-9d044cec4ba5","created":"2024-04-18T04:44:06.139983+0000","modified":"2024-04-18T04:53:26.031496+0000","last_up_change":"2024-04-18T04:44:17.410146+0000","last_in_change":"2024-04-18T04:44:08.470250+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T04:44:16.864728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T04:44:28.825773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T04:44:29.245857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-18T04:44:32.314302+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a80903bd-d9be-4fb9-af99-6125cb26bd2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":27468},{"type":"v1","addr":"172.21.15.120:6801","nonce":27468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":27468},{"type":"v1","addr":"172.21.15.120:6803","nonce":27468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":27468},{"type":"v1","addr":"172.21.15.120:6807","nonce":27468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":27468},{"type":"v1","addr":"172.21.15.120:6805","nonce":27468}]},"public_addr":"172.21.15.120:6801/27468","cluster_addr":"172.21.15.120:6803/27468","heartbeat_back_addr":"172.21.15.120:6807/27468","heartbeat_front_addr":"172.21.15.120:6805/27468","state":["exists","up"]},{"osd":1,"uuid":"8f5f004b-6870-4c78-8d50-9622e631ec25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":27470},{"type":"v1","addr":"172.21.15.120:6823","nonce":27470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":27470},{"type":"v1","addr":"172.21.15.120:6827","nonce":27470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":27470},{"type":"v1","addr":"172.21.15.120:6831","nonce":27470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":27470},{"type":"v1","addr":"172.21.15.120:6829","nonce":27470}]},"public_addr":"172.21.15.120:6823/27470","cluster_addr":"172.21.15.120:6827/27470","heartbeat_back_addr":"172.21.15.120:6831/27470","heartbeat_front_addr":"172.21.15.120:6829/27470","state":["exists","up"]},{"osd":2,"uuid":"6e228a2b-6103-4301-a8b5-ee81dbb1f920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":27471},{"type":"v1","addr":"172.21.15.120:6817","nonce":27471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":27471},{"type":"v1","addr":"172.21.15.120:6819","nonce":27471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":27471},{"type":"v1","addr":"172.21.15.120:6826","nonce":27471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":27471},{"type":"v1","addr":"172.21.15.120:6822","nonce":27471}]},"public_addr":"172.21.15.120:6817/27471","cluster_addr":"172.21.15.120:6819/27471","heartbeat_back_addr":"172.21.15.120:6826/27471","heartbeat_front_addr":"172.21.15.120:6822/27471","state":["exists","up"]},{"osd":3,"uuid":"7a5cabd7-d898-4e32-a03c-25b46e790134","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":27469},{"type":"v1","addr":"172.21.15.120:6809","nonce":27469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":27469},{"type":"v1","addr":"172.21.15.120:6811","nonce":27469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":27469},{"type":"v1","addr":"172.21.15.120:6815","nonce":27469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":27469},{"type":"v1","addr":"172.21.15.120:6813","nonce":27469}]},"public_addr":"172.21.15.120:6809/27469","cluster_addr":"172.21.15.120:6811/27469","heartbeat_back_addr":"172.21.15.120:6815/27469","heartbeat_front_addr":"172.21.15.120:6813/27469","state":["exists","up"]},{"osd":4,"uuid":"8e9f530f-6bab-4b23-a1a3-a71362fefcc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":28102},{"type":"v1","addr":"172.21.15.132:6825","nonce":28102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":28102},{"type":"v1","addr":"172.21.15.132:6827","nonce":28102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":28102},{"type":"v1","addr":"172.21.15.132:6831","nonce":28102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":28102},{"type":"v1","addr":"172.21.15.132:6829","nonce":28102}]},"public_addr":"172.21.15.132:6825/28102","cluster_addr":"172.21.15.132:6827/28102","heartbeat_back_addr":"172.21.15.132:6831/28102","heartbeat_front_addr":"172.21.15.132:6829/28102","state":["exists","up"]},{"osd":5,"uuid":"2243fabe-cc81-40cf-91bc-f106fe275a01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":28104},{"type":"v1","addr":"172.21.15.132:6809","nonce":28104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":28104},{"type":"v1","addr":"172.21.15.132:6811","nonce":28104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":28104},{"type":"v1","addr":"172.21.15.132:6815","nonce":28104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":28104},{"type":"v1","addr":"172.21.15.132:6813","nonce":28104}]},"public_addr":"172.21.15.132:6809/28104","cluster_addr":"172.21.15.132:6811/28104","heartbeat_back_addr":"172.21.15.132:6815/28104","heartbeat_front_addr":"172.21.15.132:6813/28104","state":["exists","up"]},{"osd":6,"uuid":"c093a5ed-25c8-41a7-a20d-606a1a1661e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":28103},{"type":"v1","addr":"172.21.15.132:6801","nonce":28103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":28103},{"type":"v1","addr":"172.21.15.132:6803","nonce":28103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":28103},{"type":"v1","addr":"172.21.15.132:6807","nonce":28103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":28103},{"type":"v1","addr":"172.21.15.132:6805","nonce":28103}]},"public_addr":"172.21.15.132:6801/28103","cluster_addr":"172.21.15.132:6803/28103","heartbeat_back_addr":"172.21.15.132:6807/28103","heartbeat_front_addr":"172.21.15.132:6805/28103","state":["exists","up"]},{"osd":7,"uuid":"c37426b7-1080-4434-9f3e-a3afbbdc0fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":28129},{"type":"v1","addr":"172.21.15.132:6817","nonce":28129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":28129},{"type":"v1","addr":"172.21.15.132:6819","nonce":28129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":28129},{"type":"v1","addr":"172.21.15.132:6823","nonce":28129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":28129},{"type":"v1","addr":"172.21.15.132:6821","nonce":28129}]},"public_addr":"172.21.15.132:6817/28129","cluster_addr":"172.21.15.132:6819/28129","heartbeat_back_addr":"172.21.15.132:6823/28129","heartbeat_front_addr":"172.21.15.132:6821/28129","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.053825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.289753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.274645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:14.146361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.943883+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.701955+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.851076+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T04:44:13.800782+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":1}]},{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.132:6835/396956733":"2024-04-19T04:53:26.031128+0000","172.21.15.132:6834/396956733":"2024-04-19T04:53:26.031128+0000","172.21.15.120:6837/76856194":"2024-04-19T04:52:05.993392+0000","172.21.15.120:6835/76856194":"2024-04-19T04:52:05.993392+0000","172.21.15.120:6836/1079090700":"2024-04-19T04:50:25.928576+0000","172.21.15.132:6835/1552155328":"2024-04-19T04:48:30.875534+0000","172.21.15.132:6834/1552155328":"2024-04-19T04:48:30.875534+0000","172.21.15.120:6834/1079090700":"2024-04-19T04:50:25.928576+0000","172.21.15.120:6833/2564667113":"2024-04-19T04:47:00.847858+0000","172.21.15.120:6832/2564667113":"2024-04-19T04:47:00.847858+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T04:56:41.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.252+0000 7f9d17800640 1 -- 172.21.15.120:0/1067478486 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9cf00666e0 msgr2=0x7f9cf0068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:41.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.252+0000 7f9d17800640 1 --2- 172.21.15.120:0/1067478486 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9cf00666e0 0x7f9cf0068ba0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc0af000 tx=0x7f9cfc0046d0 comp rx=0 tx=0).stop 2024-04-18T04:56:41.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.252+0000 7f9d17800640 1 -- 172.21.15.120:0/1067478486 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9cf80047d0 msgr2=0x7f9d101f26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:41.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.252+0000 7f9d17800640 1 --2- 172.21.15.120:0/1067478486 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9cf80047d0 0x7f9d101f26a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f9d04007310 tx=0x7f9d040077d0 comp rx=0 tx=0).stop 2024-04-18T04:56:41.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.252+0000 7f9d17800640 1 -- 172.21.15.120:0/1067478486 shutdown_connections 2024-04-18T04:56:41.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.252+0000 7f9d17800640 1 --2- 172.21.15.120:0/1067478486 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f9cf00666e0 0x7f9cf0068ba0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:41.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.252+0000 7f9d17800640 1 --2- 172.21.15.120:0/1067478486 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d10157b80 0x7f9d10158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:41.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.252+0000 7f9d17800640 1 --2- 172.21.15.120:0/1067478486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d1015b970 0x7f9d10146b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:41.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.252+0000 7f9d17800640 1 --2- 172.21.15.120:0/1067478486 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9cf80047d0 0x7f9d101f26a0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:41.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.252+0000 7f9d17800640 1 -- 172.21.15.120:0/1067478486 >> 172.21.15.120:0/1067478486 conn(0x7f9d1006e0f0 msgr2=0x7f9d10151f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:41.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.252+0000 7f9d17800640 1 -- 172.21.15.120:0/1067478486 shutdown_connections 2024-04-18T04:56:41.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.252+0000 7f9d17800640 1 -- 172.21.15.120:0/1067478486 wait complete. 2024-04-18T04:56:41.270 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-18T04:56:41.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.412+0000 7f69a8e00640 1 Processor -- start 2024-04-18T04:56:41.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.412+0000 7f69a8e00640 1 -- start start 2024-04-18T04:56:41.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.416+0000 7f69a8e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f69a415b1b0 0x7f69a4159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:41.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.416+0000 7f69a8e00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69a40c4dc0 con 0x7f69a406ae20 2024-04-18T04:56:41.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.416+0000 7f69a8e00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69a4153c80 con 0x7f69a41538a0 2024-04-18T04:56:41.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.416+0000 7f69a8e00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69a40b2040 con 0x7f69a415b1b0 2024-04-18T04:56:41.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.416+0000 7f69a2800640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f69a415b1b0 0x7f69a4159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:41.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.416+0000 7f69a2800640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f69a415b1b0 0x7f69a4159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34256/0 (socket says 172.21.15.120:34256) 2024-04-18T04:56:41.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.416+0000 7f69a2800640 1 -- 172.21.15.120:0/2294480082 learned_addr learned my addr 172.21.15.120:0/2294480082 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:56:41.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.416+0000 7f69a2800640 1 -- 172.21.15.120:0/2294480082 >> v1:172.21.15.132:6789/0 conn(0x7f69a41538a0 legacy=0x7f69a40cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:41.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.416+0000 7f69a2800640 1 -- 172.21.15.120:0/2294480082 >> v1:172.21.15.120:6789/0 conn(0x7f69a406ae20 legacy=0x7f69a415aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:41.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.416+0000 7f69a2800640 1 -- 172.21.15.120:0/2294480082 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a40c3ed0 con 0x7f69a415b1b0 2024-04-18T04:56:41.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.420+0000 7f69a2800640 1 --2- 172.21.15.120:0/2294480082 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69a415b1b0 0x7f69a4159fa0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f699c009e50 tx=0x7f699c01f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc640d0da79fd25 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:41.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.420+0000 7f69a0a00640 1 -- 172.21.15.120:0/2294480082 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699c0af400 con 0x7f69a415b1b0 2024-04-18T04:56:41.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.420+0000 7f69a0a00640 1 -- 172.21.15.120:0/2294480082 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f699c0ab050 con 0x7f69a415b1b0 2024-04-18T04:56:41.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.420+0000 7f69a0a00640 1 -- 172.21.15.120:0/2294480082 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699c0af7a0 con 0x7f69a415b1b0 2024-04-18T04:56:41.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.420+0000 7f69a8e00640 1 -- 172.21.15.120:0/2294480082 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69a415b1b0 msgr2=0x7f69a4159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:41.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.420+0000 7f69a8e00640 1 --2- 172.21.15.120:0/2294480082 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69a415b1b0 0x7f69a4159fa0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f699c009e50 tx=0x7f699c01f210 comp rx=0 tx=0).stop 2024-04-18T04:56:41.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.420+0000 7f69a8e00640 1 -- 172.21.15.120:0/2294480082 shutdown_connections 2024-04-18T04:56:41.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.420+0000 7f69a8e00640 1 --2- 172.21.15.120:0/2294480082 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69a415b1b0 0x7f69a4159fa0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:41.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.420+0000 7f69a8e00640 1 -- 172.21.15.120:0/2294480082 >> 172.21.15.120:0/2294480082 conn(0x7f69a4065fc0 msgr2=0x7f69a40663d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:41.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.420+0000 7f69a8e00640 1 -- 172.21.15.120:0/2294480082 shutdown_connections 2024-04-18T04:56:41.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.420+0000 7f69a8e00640 1 -- 172.21.15.120:0/2294480082 wait complete. 2024-04-18T04:56:41.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.420+0000 7f69a8e00640 1 Processor -- start 2024-04-18T04:56:41.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.420+0000 7f69a8e00640 1 -- start start 2024-04-18T04:56:41.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.424+0000 7f69a8e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69a406ae20 0x7f69a40cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:41.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.424+0000 7f69a8e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69a41538a0 0x7f69a4149be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:41.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.424+0000 7f69a8e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69a415b1b0 0x7f69a40b3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:41.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.424+0000 7f69a8e00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a41f3400 con 0x7f69a415b1b0 2024-04-18T04:56:41.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.424+0000 7f69a8e00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a41f2860 con 0x7f69a406ae20 2024-04-18T04:56:41.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.424+0000 7f69a8e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69a41f2ad0 con 0x7f69a41538a0 2024-04-18T04:56:41.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.424+0000 7f69a2800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69a415b1b0 0x7f69a40b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:41.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.424+0000 7f69a2800640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69a415b1b0 0x7f69a40b3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34258/0 (socket says 172.21.15.120:34258) 2024-04-18T04:56:41.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.424+0000 7f69a2800640 1 -- 172.21.15.120:0/109997868 learned_addr learned my addr 172.21.15.120:0/109997868 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:56:41.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.424+0000 7f69a1400640 1 --2- 172.21.15.120:0/109997868 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69a41538a0 0x7f69a4149be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:41.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.424+0000 7f69a1e00640 1 --2- 172.21.15.120:0/109997868 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69a406ae20 0x7f69a40cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:41.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.424+0000 7f69a2800640 1 -- 172.21.15.120:0/109997868 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69a41538a0 msgr2=0x7f69a4149be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:41.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.424+0000 7f69a2800640 1 --2- 172.21.15.120:0/109997868 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69a41538a0 0x7f69a4149be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:41.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.424+0000 7f69a2800640 1 -- 172.21.15.120:0/109997868 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69a406ae20 msgr2=0x7f69a40cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:41.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.424+0000 7f69a2800640 1 --2- 172.21.15.120:0/109997868 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69a406ae20 0x7f69a40cb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:41.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.424+0000 7f69a2800640 1 -- 172.21.15.120:0/109997868 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f699c009b30 con 0x7f69a415b1b0 2024-04-18T04:56:41.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.424+0000 7f69a1e00640 1 --2- 172.21.15.120:0/109997868 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69a406ae20 0x7f69a40cb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:56:41.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.424+0000 7f69a2800640 1 --2- 172.21.15.120:0/109997868 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69a415b1b0 0x7f69a40b3560 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f699c01be20 tx=0x7f699c01bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:41.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.424+0000 7f699a000640 1 -- 172.21.15.120:0/109997868 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699c0afe20 con 0x7f69a415b1b0 2024-04-18T04:56:41.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.424+0000 7f699a000640 1 -- 172.21.15.120:0/109997868 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f699c009510 con 0x7f69a415b1b0 2024-04-18T04:56:41.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.424+0000 7f699a000640 1 -- 172.21.15.120:0/109997868 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699c0ba660 con 0x7f69a415b1b0 2024-04-18T04:56:41.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.424+0000 7f69a8e00640 1 -- 172.21.15.120:0/109997868 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69a41f2db0 con 0x7f69a415b1b0 2024-04-18T04:56:41.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.424+0000 7f69a8e00640 1 -- 172.21.15.120:0/109997868 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69a414a120 con 0x7f69a415b1b0 2024-04-18T04:56:41.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.424+0000 7f69a8e00640 1 -- 172.21.15.120:0/109997868 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69a41f3260 con 0x7f69a415b1b0 2024-04-18T04:56:41.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.424+0000 7f699a000640 1 -- 172.21.15.120:0/109997868 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f699c0b6040 con 0x7f69a415b1b0 2024-04-18T04:56:41.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.428+0000 7f699a000640 1 --2- 172.21.15.120:0/109997868 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f69840666c0 0x7f6984068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:41.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.428+0000 7f699a000640 1 -- 172.21.15.120:0/109997868 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f699c122a40 con 0x7f69a415b1b0 2024-04-18T04:56:41.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.428+0000 7f69a1e00640 1 --2- 172.21.15.120:0/109997868 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f69840666c0 0x7f6984068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:41.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.428+0000 7f69a1e00640 1 --2- 172.21.15.120:0/109997868 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f69840666c0 0x7f6984068b80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6994000f70 tx=0x7f6994009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:41.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.432+0000 7f699a000640 1 -- 172.21.15.120:0/109997868 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f69a41f3260 con 0x7f69a415b1b0 2024-04-18T04:56:41.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.624+0000 7f69a8e00640 1 -- 172.21.15.120:0/109997868 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f69a41f3260 con 0x7f69a415b1b0 2024-04-18T04:56:41.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.640+0000 7f699a000640 1 -- 172.21.15.120:0/109997868 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v50) v1 ==== 161+0+0 (secure 0 0 0) 0x7f69a41f3260 con 0x7f69a415b1b0 2024-04-18T04:56:41.638 INFO:teuthology.orchestra.run.smithi120.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-18T04:56:41.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.640+0000 7f69a8e00640 1 -- 172.21.15.120:0/109997868 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f69840666c0 msgr2=0x7f6984068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:41.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.640+0000 7f69a8e00640 1 --2- 172.21.15.120:0/109997868 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f69840666c0 0x7f6984068b80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6994000f70 tx=0x7f6994009040 comp rx=0 tx=0).stop 2024-04-18T04:56:41.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.640+0000 7f69a8e00640 1 -- 172.21.15.120:0/109997868 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69a415b1b0 msgr2=0x7f69a40b3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:41.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.640+0000 7f69a8e00640 1 --2- 172.21.15.120:0/109997868 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69a415b1b0 0x7f69a40b3560 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f699c01be20 tx=0x7f699c01bfb0 comp rx=0 tx=0).stop 2024-04-18T04:56:41.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.640+0000 7f69a8e00640 1 -- 172.21.15.120:0/109997868 shutdown_connections 2024-04-18T04:56:41.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.640+0000 7f69a8e00640 1 --2- 172.21.15.120:0/109997868 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f69840666c0 0x7f6984068b80 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:41.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.640+0000 7f69a8e00640 1 --2- 172.21.15.120:0/109997868 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69a415b1b0 0x7f69a40b3560 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:41.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.640+0000 7f69a8e00640 1 --2- 172.21.15.120:0/109997868 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69a41538a0 0x7f69a4149be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:41.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.640+0000 7f69a8e00640 1 --2- 172.21.15.120:0/109997868 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69a406ae20 0x7f69a40cb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:41.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.640+0000 7f69a8e00640 1 -- 172.21.15.120:0/109997868 >> 172.21.15.120:0/109997868 conn(0x7f69a4065fc0 msgr2=0x7f69a415b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:41.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.640+0000 7f69a8e00640 1 -- 172.21.15.120:0/109997868 shutdown_connections 2024-04-18T04:56:41.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.644+0000 7f69a8e00640 1 -- 172.21.15.120:0/109997868 wait complete. 2024-04-18T04:56:41.666 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-18T04:56:41.756 INFO:tasks.ceph.mds.c.smithi120.stdout:starting mds.c at 2024-04-18T04:56:41.759 INFO:tasks.ceph.mds.e.smithi120.stdout:starting mds.e at 2024-04-18T04:56:41.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.812+0000 7f3fdb000640 1 Processor -- start 2024-04-18T04:56:41.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.812+0000 7f3fdb000640 1 -- start start 2024-04-18T04:56:41.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.816+0000 7f3fdb000640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3fd4153890 0x7f3fd41596e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:41.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.816+0000 7f3fdb000640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3fd415cc50 0x7f3fd40c6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:41.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.816+0000 7f3fdb000640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fd4070790 con 0x7f3fd4153c70 2024-04-18T04:56:41.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.816+0000 7f3fdb000640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fd4071ae0 con 0x7f3fd4153890 2024-04-18T04:56:41.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.816+0000 7f3fdb000640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fd4159c20 con 0x7f3fd415cc50 2024-04-18T04:56:41.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.816+0000 7f3fd3e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3fd4153890 0x7f3fd41596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:41.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.816+0000 7f3fd3e00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3fd4153890 0x7f3fd41596e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34316/0 (socket says 172.21.15.120:34316) 2024-04-18T04:56:41.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.816+0000 7f3fd3e00640 1 -- 172.21.15.120:0/1975385313 learned_addr learned my addr 172.21.15.120:0/1975385313 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:56:41.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.816+0000 7f3fd9000640 1 --2- 172.21.15.120:0/1975385313 >> v2:172.21.15.132:3300/0 conn(0x7f3fd415cc50 0x7f3fd40c6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:41.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.816+0000 7f3fd3e00640 1 -- 172.21.15.120:0/1975385313 >> v2:172.21.15.132:3300/0 conn(0x7f3fd415cc50 msgr2=0x7f3fd40c6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:56:41.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.816+0000 7f3fd3e00640 1 --2- 172.21.15.120:0/1975385313 >> v2:172.21.15.132:3300/0 conn(0x7f3fd415cc50 0x7f3fd40c6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:41.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.816+0000 7f3fd3e00640 1 -- 172.21.15.120:0/1975385313 >> v1:172.21.15.132:6789/0 conn(0x7f3fd4153c70 legacy=0x7f3fd4070c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:56:41.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.816+0000 7f3fd3e00640 1 -- 172.21.15.120:0/1975385313 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd4159e90 con 0x7f3fd4153890 2024-04-18T04:56:41.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.820+0000 7f3fd3e00640 1 --2- 172.21.15.120:0/1975385313 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3fd4153890 0x7f3fd41596e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3fd40c94b0 tx=0x7f3fc401ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8817986769d15b8f server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:41.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.820+0000 7f3fd2a00640 1 -- 172.21.15.120:0/1975385313 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc40a89d0 con 0x7f3fd4153890 2024-04-18T04:56:41.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.820+0000 7f3fd2a00640 1 -- 172.21.15.120:0/1975385313 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3fc40a8b30 con 0x7f3fd4153890 2024-04-18T04:56:41.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.820+0000 7f3fd2a00640 1 -- 172.21.15.120:0/1975385313 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc40b0440 con 0x7f3fd4153890 2024-04-18T04:56:41.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.820+0000 7f3fdb000640 1 -- 172.21.15.120:0/1975385313 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3fd4153890 msgr2=0x7f3fd41596e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:41.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.820+0000 7f3fdb000640 1 --2- 172.21.15.120:0/1975385313 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3fd4153890 0x7f3fd41596e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3fd40c94b0 tx=0x7f3fc401ecd0 comp rx=0 tx=0).stop 2024-04-18T04:56:41.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.820+0000 7f3fdb000640 1 -- 172.21.15.120:0/1975385313 shutdown_connections 2024-04-18T04:56:41.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.820+0000 7f3fdb000640 1 --2- 172.21.15.120:0/1975385313 >> v2:172.21.15.132:3300/0 conn(0x7f3fd415cc50 0x7f3fd40c6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:41.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.820+0000 7f3fdb000640 1 --2- 172.21.15.120:0/1975385313 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3fd4153890 0x7f3fd41596e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:41.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.820+0000 7f3fdb000640 1 -- 172.21.15.120:0/1975385313 >> 172.21.15.120:0/1975385313 conn(0x7f3fd4066a50 msgr2=0x7f3fd4069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:41.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.820+0000 7f3fdb000640 1 -- 172.21.15.120:0/1975385313 shutdown_connections 2024-04-18T04:56:41.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.820+0000 7f3fdb000640 1 -- 172.21.15.120:0/1975385313 wait complete. 2024-04-18T04:56:41.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.820+0000 7f3fdb000640 1 Processor -- start 2024-04-18T04:56:41.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.820+0000 7f3fdb000640 1 -- start start 2024-04-18T04:56:41.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.820+0000 7f3fdb000640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fd4153890 0x7f3fd414c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:41.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.820+0000 7f3fdb000640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3fd4153c70 0x7f3fd415c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:41.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.824+0000 7f3fdb000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3fd415cc50 0x7f3fd41eeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:41.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.824+0000 7f3fdb000640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd41f2120 con 0x7f3fd415cc50 2024-04-18T04:56:41.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.824+0000 7f3fdb000640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd414ceb0 con 0x7f3fd4153890 2024-04-18T04:56:41.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.824+0000 7f3fdb000640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd41f23c0 con 0x7f3fd4153c70 2024-04-18T04:56:41.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.824+0000 7f3fd9000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3fd415cc50 0x7f3fd41eeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:41.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.824+0000 7f3fd3e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fd4153890 0x7f3fd414c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:41.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.824+0000 7f3fd9000640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3fd415cc50 0x7f3fd41eeb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34320/0 (socket says 172.21.15.120:34320) 2024-04-18T04:56:41.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.824+0000 7f3fd9000640 1 -- 172.21.15.120:0/666207515 learned_addr learned my addr 172.21.15.120:0/666207515 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:56:41.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.824+0000 7f3fd3400640 1 --2- 172.21.15.120:0/666207515 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3fd4153c70 0x7f3fd415c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:41.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.824+0000 7f3fd9000640 1 -- 172.21.15.120:0/666207515 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3fd4153c70 msgr2=0x7f3fd415c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:41.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.824+0000 7f3fd9000640 1 --2- 172.21.15.120:0/666207515 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3fd4153c70 0x7f3fd415c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:41.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.824+0000 7f3fd9000640 1 -- 172.21.15.120:0/666207515 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fd4153890 msgr2=0x7f3fd414c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:41.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.824+0000 7f3fd9000640 1 --2- 172.21.15.120:0/666207515 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fd4153890 0x7f3fd414c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:41.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.824+0000 7f3fd9000640 1 -- 172.21.15.120:0/666207515 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc40094d0 con 0x7f3fd415cc50 2024-04-18T04:56:41.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.824+0000 7f3fd9000640 1 --2- 172.21.15.120:0/666207515 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3fd415cc50 0x7f3fd41eeb10 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc007cf0 tx=0x7f3fcc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:41.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.824+0000 7f3fcbe00640 1 -- 172.21.15.120:0/666207515 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc014420 con 0x7f3fd415cc50 2024-04-18T04:56:41.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.824+0000 7f3fcbe00640 1 -- 172.21.15.120:0/666207515 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3fcc0145a0 con 0x7f3fd415cc50 2024-04-18T04:56:41.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.824+0000 7f3fcbe00640 1 -- 172.21.15.120:0/666207515 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc014970 con 0x7f3fd415cc50 2024-04-18T04:56:41.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.824+0000 7f3fdb000640 1 -- 172.21.15.120:0/666207515 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fd41f26a0 con 0x7f3fd415cc50 2024-04-18T04:56:41.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.824+0000 7f3fdb000640 1 -- 172.21.15.120:0/666207515 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fd414d190 con 0x7f3fd415cc50 2024-04-18T04:56:41.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.824+0000 7f3fdb000640 1 -- 172.21.15.120:0/666207515 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fd41f2bc0 con 0x7f3fd415cc50 2024-04-18T04:56:41.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.824+0000 7f3fcbe00640 1 -- 172.21.15.120:0/666207515 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3fcc014ad0 con 0x7f3fd415cc50 2024-04-18T04:56:41.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.828+0000 7f3fcbe00640 1 --2- 172.21.15.120:0/666207515 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3fb4066690 0x7f3fb4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:41.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.828+0000 7f3fcbe00640 1 -- 172.21.15.120:0/666207515 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7265+0+0 (secure 0 0 0) 0x7f3fcc084fe0 con 0x7f3fd415cc50 2024-04-18T04:56:41.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.828+0000 7f3fd3e00640 1 --2- 172.21.15.120:0/666207515 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3fb4066690 0x7f3fb4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:41.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.828+0000 7f3fd3e00640 1 --2- 172.21.15.120:0/666207515 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3fb4066690 0x7f3fb4068b50 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3fc40b2000 tx=0x7f3fc4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:41.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:41.832+0000 7f3fcbe00640 1 -- 172.21.15.120:0/666207515 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f3fcc051cc0 con 0x7f3fd415cc50 2024-04-18T04:56:42.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.024+0000 7f3fdb000640 1 -- 172.21.15.120:0/666207515 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3fd40729d0 con 0x7f3fd415cc50 2024-04-18T04:56:42.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.640+0000 7f3fcbe00640 1 -- 172.21.15.120:0/666207515 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v51) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3fcc053bf0 con 0x7f3fd415cc50 2024-04-18T04:56:42.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.644+0000 7f3fdb000640 1 -- 172.21.15.120:0/666207515 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3fb4066690 msgr2=0x7f3fb4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:42.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.644+0000 7f3fdb000640 1 --2- 172.21.15.120:0/666207515 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3fb4066690 0x7f3fb4068b50 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3fc40b2000 tx=0x7f3fc4009040 comp rx=0 tx=0).stop 2024-04-18T04:56:42.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.644+0000 7f3fdb000640 1 -- 172.21.15.120:0/666207515 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3fd415cc50 msgr2=0x7f3fd41eeb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:42.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.644+0000 7f3fdb000640 1 --2- 172.21.15.120:0/666207515 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3fd415cc50 0x7f3fd41eeb10 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc007cf0 tx=0x7f3fcc00e4b0 comp rx=0 tx=0).stop 2024-04-18T04:56:42.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.644+0000 7f3fdb000640 1 -- 172.21.15.120:0/666207515 shutdown_connections 2024-04-18T04:56:42.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.644+0000 7f3fdb000640 1 --2- 172.21.15.120:0/666207515 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f3fb4066690 0x7f3fb4068b50 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:42.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.644+0000 7f3fdb000640 1 --2- 172.21.15.120:0/666207515 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3fd415cc50 0x7f3fd41eeb10 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:42.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.644+0000 7f3fdb000640 1 --2- 172.21.15.120:0/666207515 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3fd4153c70 0x7f3fd415c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:42.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.644+0000 7f3fdb000640 1 --2- 172.21.15.120:0/666207515 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fd4153890 0x7f3fd414c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:42.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.644+0000 7f3fdb000640 1 -- 172.21.15.120:0/666207515 >> 172.21.15.120:0/666207515 conn(0x7f3fd4066a50 msgr2=0x7f3fd406e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:42.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.644+0000 7f3fdb000640 1 -- 172.21.15.120:0/666207515 shutdown_connections 2024-04-18T04:56:42.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.644+0000 7f3fdb000640 1 -- 172.21.15.120:0/666207515 wait complete. 2024-04-18T04:56:42.664 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-18T04:56:42.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.808+0000 7f26f6600640 1 Processor -- start 2024-04-18T04:56:42.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.808+0000 7f26f6600640 1 -- start start 2024-04-18T04:56:42.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.812+0000 7f26f6600640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f26f0150670 0x7f26f00c0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:42.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.812+0000 7f26f6600640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26f00c0370 con 0x7f26f00c13f0 2024-04-18T04:56:42.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.812+0000 7f26f6600640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26f006db90 con 0x7f26f0071830 2024-04-18T04:56:42.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.812+0000 7f26f6600640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26f00c0710 con 0x7f26f0150670 2024-04-18T04:56:42.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.812+0000 7f26f5c00640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f26f00c13f0 0x7f26f00c68d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:33046/0 (socket says 172.21.15.120:33046) 2024-04-18T04:56:42.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.812+0000 7f26f5c00640 1 -- 172.21.15.120:0/3855382706 learned_addr learned my addr 172.21.15.120:0/3855382706 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:56:42.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.812+0000 7f26f5200640 1 --2- 172.21.15.120:0/3855382706 >> v2:172.21.15.132:3300/0 conn(0x7f26f0150670 0x7f26f00c0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:42.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.812+0000 7f26ef400640 1 -- 172.21.15.120:0/3855382706 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2565217519 0 0) 0x7f26f00c0370 con 0x7f26f00c13f0 2024-04-18T04:56:42.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.812+0000 7f26ef400640 1 -- 172.21.15.120:0/3855382706 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26d8003530 con 0x7f26f00c13f0 2024-04-18T04:56:42.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.812+0000 7f26f5200640 1 -- 172.21.15.120:0/3855382706 >> v1:172.21.15.132:6789/0 conn(0x7f26f0071830 legacy=0x7f26f00c1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:42.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.812+0000 7f26f5200640 1 -- 172.21.15.120:0/3855382706 >> v1:172.21.15.120:6789/0 conn(0x7f26f00c13f0 legacy=0x7f26f00c68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:42.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.812+0000 7f26ef400640 1 -- 172.21.15.120:0/3855382706 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1675670910 0 0) 0x7f26d8003530 con 0x7f26f00c13f0 2024-04-18T04:56:42.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.812+0000 7f26f5200640 1 -- 172.21.15.120:0/3855382706 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f006de70 con 0x7f26f0150670 2024-04-18T04:56:42.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.816+0000 7f26f5200640 1 --2- 172.21.15.120:0/3855382706 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26f0150670 0x7f26f00c0e30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f26e40097c0 tx=0x7f26e401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc3f302f3ff0111c server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:42.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.816+0000 7f26ef400640 1 -- 172.21.15.120:0/3855382706 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e8001a00 con 0x7f26f0150670 2024-04-18T04:56:42.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.816+0000 7f26ef400640 1 -- 172.21.15.120:0/3855382706 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f26e40a7050 con 0x7f26f0150670 2024-04-18T04:56:42.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.816+0000 7f26ef400640 1 -- 172.21.15.120:0/3855382706 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e40ab600 con 0x7f26f0150670 2024-04-18T04:56:42.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.816+0000 7f26f6600640 1 -- 172.21.15.120:0/3855382706 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26f0150670 msgr2=0x7f26f00c0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:42.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.816+0000 7f26f6600640 1 --2- 172.21.15.120:0/3855382706 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26f0150670 0x7f26f00c0e30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f26e40097c0 tx=0x7f26e401c3c0 comp rx=0 tx=0).stop 2024-04-18T04:56:42.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.816+0000 7f26f6600640 1 -- 172.21.15.120:0/3855382706 shutdown_connections 2024-04-18T04:56:42.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.816+0000 7f26f6600640 1 --2- 172.21.15.120:0/3855382706 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26f0150670 0x7f26f00c0e30 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:42.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.816+0000 7f26f6600640 1 -- 172.21.15.120:0/3855382706 >> 172.21.15.120:0/3855382706 conn(0x7f26f006d000 msgr2=0x7f26f006d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:42.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.816+0000 7f26f6600640 1 -- 172.21.15.120:0/3855382706 shutdown_connections 2024-04-18T04:56:42.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.816+0000 7f26f6600640 1 -- 172.21.15.120:0/3855382706 wait complete. 2024-04-18T04:56:42.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.816+0000 7f26f6600640 1 Processor -- start 2024-04-18T04:56:42.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.820+0000 7f26f6600640 1 -- start start 2024-04-18T04:56:42.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.820+0000 7f26f6600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26f0071830 0x7f26f0155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:42.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.820+0000 7f26f6600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f26f00c13f0 0x7f26f0154420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:42.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.820+0000 7f26f6600640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26f0150670 0x7f26f0149ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:42.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.820+0000 7f26f6600640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f014c790 con 0x7f26f00c13f0 2024-04-18T04:56:42.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.820+0000 7f26f6600640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f0154ce0 con 0x7f26f0150670 2024-04-18T04:56:42.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.820+0000 7f26f6600640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26f01ef9c0 con 0x7f26f0071830 2024-04-18T04:56:42.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.820+0000 7f26efe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f26f00c13f0 0x7f26f0154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:42.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.820+0000 7f26efe00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f26f00c13f0 0x7f26f0154420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34324/0 (socket says 172.21.15.120:34324) 2024-04-18T04:56:42.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.820+0000 7f26efe00640 1 -- 172.21.15.120:0/1422931060 learned_addr learned my addr 172.21.15.120:0/1422931060 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:56:42.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.820+0000 7f26f5200640 1 --2- 172.21.15.120:0/1422931060 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26f0071830 0x7f26f0155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:42.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.820+0000 7f26f5c00640 1 --2- 172.21.15.120:0/1422931060 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26f0150670 0x7f26f0149ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:42.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.820+0000 7f26efe00640 1 -- 172.21.15.120:0/1422931060 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26f0071830 msgr2=0x7f26f0155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:42.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.820+0000 7f26efe00640 1 --2- 172.21.15.120:0/1422931060 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26f0071830 0x7f26f0155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:42.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.820+0000 7f26efe00640 1 -- 172.21.15.120:0/1422931060 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26f0150670 msgr2=0x7f26f0149ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:42.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.820+0000 7f26efe00640 1 --2- 172.21.15.120:0/1422931060 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26f0150670 0x7f26f0149ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:42.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.820+0000 7f26efe00640 1 -- 172.21.15.120:0/1422931060 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e4009420 con 0x7f26f00c13f0 2024-04-18T04:56:42.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.820+0000 7f26efe00640 1 --2- 172.21.15.120:0/1422931060 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f26f00c13f0 0x7f26f0154420 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f26dc00c390 tx=0x7f26dc00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:42.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.820+0000 7f26ecc00640 1 -- 172.21.15.120:0/1422931060 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26dc0052d0 con 0x7f26f00c13f0 2024-04-18T04:56:42.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.820+0000 7f26ecc00640 1 -- 172.21.15.120:0/1422931060 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f26dc005430 con 0x7f26f00c13f0 2024-04-18T04:56:42.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.820+0000 7f26f6600640 1 -- 172.21.15.120:0/1422931060 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26f006d760 con 0x7f26f00c13f0 2024-04-18T04:56:42.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.820+0000 7f26ecc00640 1 -- 172.21.15.120:0/1422931060 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26dc003840 con 0x7f26f00c13f0 2024-04-18T04:56:42.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.820+0000 7f26f6600640 1 -- 172.21.15.120:0/1422931060 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26f0155380 con 0x7f26f00c13f0 2024-04-18T04:56:42.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.820+0000 7f26f6600640 1 -- 172.21.15.120:0/1422931060 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26f0072960 con 0x7f26f00c13f0 2024-04-18T04:56:42.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.824+0000 7f26ecc00640 1 -- 172.21.15.120:0/1422931060 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f26dc0039a0 con 0x7f26f00c13f0 2024-04-18T04:56:42.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.824+0000 7f26ecc00640 1 --2- 172.21.15.120:0/1422931060 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f26d0066690 0x7f26d0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:42.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.824+0000 7f26ecc00640 1 -- 172.21.15.120:0/1422931060 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7265+0+0 (secure 0 0 0) 0x7f26dc083eb0 con 0x7f26f00c13f0 2024-04-18T04:56:42.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.824+0000 7f26f5200640 1 --2- 172.21.15.120:0/1422931060 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f26d0066690 0x7f26d0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:42.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.824+0000 7f26f5200640 1 --2- 172.21.15.120:0/1422931060 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f26d0066690 0x7f26d0068b50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f26e40ad000 tx=0x7f26e40a6000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:42.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.828+0000 7f26ecc00640 1 -- 172.21.15.120:0/1422931060 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f26dc050a40 con 0x7f26f00c13f0 2024-04-18T04:56:42.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:42.988+0000 7f26f6600640 1 -- 172.21.15.120:0/1422931060 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f26f00704f0 con 0x7f26f00c13f0 2024-04-18T04:56:43.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.652+0000 7f26ecc00640 1 -- 172.21.15.120:0/1422931060 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v34) v1 ==== 181+0+0 (secure 0 0 0) 0x7f26dc017020 con 0x7f26f00c13f0 2024-04-18T04:56:43.653 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_metadata' removed 2024-04-18T04:56:43.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.656+0000 7f26f6600640 1 -- 172.21.15.120:0/1422931060 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f26d0066690 msgr2=0x7f26d0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:43.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.656+0000 7f26f6600640 1 --2- 172.21.15.120:0/1422931060 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f26d0066690 0x7f26d0068b50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f26e40ad000 tx=0x7f26e40a6000 comp rx=0 tx=0).stop 2024-04-18T04:56:43.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.656+0000 7f26f6600640 1 -- 172.21.15.120:0/1422931060 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f26f00c13f0 msgr2=0x7f26f0154420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:43.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.656+0000 7f26f6600640 1 --2- 172.21.15.120:0/1422931060 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f26f00c13f0 0x7f26f0154420 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f26dc00c390 tx=0x7f26dc00c850 comp rx=0 tx=0).stop 2024-04-18T04:56:43.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.656+0000 7f26f6600640 1 -- 172.21.15.120:0/1422931060 shutdown_connections 2024-04-18T04:56:43.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.656+0000 7f26f6600640 1 --2- 172.21.15.120:0/1422931060 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f26d0066690 0x7f26d0068b50 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:43.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.656+0000 7f26f6600640 1 --2- 172.21.15.120:0/1422931060 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26f0150670 0x7f26f0149ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:43.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.656+0000 7f26f6600640 1 --2- 172.21.15.120:0/1422931060 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f26f00c13f0 0x7f26f0154420 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:43.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.656+0000 7f26f6600640 1 --2- 172.21.15.120:0/1422931060 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26f0071830 0x7f26f0155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:43.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.656+0000 7f26f6600640 1 -- 172.21.15.120:0/1422931060 >> 172.21.15.120:0/1422931060 conn(0x7f26f006d000 msgr2=0x7f26f006f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:43.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.656+0000 7f26f6600640 1 -- 172.21.15.120:0/1422931060 shutdown_connections 2024-04-18T04:56:43.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.656+0000 7f26f6600640 1 -- 172.21.15.120:0/1422931060 wait complete. 2024-04-18T04:56:43.677 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-18T04:56:43.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.832+0000 7f59f6e00640 1 Processor -- start 2024-04-18T04:56:43.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.832+0000 7f59f6e00640 1 -- start start 2024-04-18T04:56:43.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.836+0000 7f59f6e00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f59f006df40 0x7f59f00c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:43.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.836+0000 7f59f6e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59f0153c30 0x7f59f015a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:43.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.836+0000 7f59f6e00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59f00c8890 con 0x7f59f006e320 2024-04-18T04:56:43.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.836+0000 7f59f6e00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59f006ea80 con 0x7f59f006df40 2024-04-18T04:56:43.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.836+0000 7f59f6e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f00c8ac0 con 0x7f59f0153c30 2024-04-18T04:56:43.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.836+0000 7f59ef400640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f59f006e320 0x7f59f0153520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:33054/0 (socket says 172.21.15.120:33054) 2024-04-18T04:56:43.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.836+0000 7f59ef400640 1 -- 172.21.15.120:0/3908554021 learned_addr learned my addr 172.21.15.120:0/3908554021 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:56:43.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.836+0000 7f59efe00640 1 --2- 172.21.15.120:0/3908554021 >> v2:172.21.15.132:3300/0 conn(0x7f59f006df40 0x7f59f00c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:43.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.836+0000 7f59f4e00640 1 --2- 172.21.15.120:0/3908554021 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59f0153c30 0x7f59f015a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:43.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.836+0000 7f59eea00640 1 -- 172.21.15.120:0/3908554021 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1226395972 0 0) 0x7f59f00c8890 con 0x7f59f006e320 2024-04-18T04:56:43.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.836+0000 7f59eea00640 1 -- 172.21.15.120:0/3908554021 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59d4003530 con 0x7f59f006e320 2024-04-18T04:56:43.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.836+0000 7f59eea00640 1 -- 172.21.15.120:0/3908554021 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3009079854 0 0) 0x7f59d4003530 con 0x7f59f006e320 2024-04-18T04:56:43.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.836+0000 7f59efe00640 1 -- 172.21.15.120:0/3908554021 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59f0153c30 msgr2=0x7f59f015a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:56:43.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.836+0000 7f59efe00640 1 --2- 172.21.15.120:0/3908554021 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59f0153c30 0x7f59f015a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:43.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.836+0000 7f59efe00640 1 -- 172.21.15.120:0/3908554021 >> v1:172.21.15.120:6789/0 conn(0x7f59f006e320 legacy=0x7f59f0153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:43.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.836+0000 7f59efe00640 1 -- 172.21.15.120:0/3908554021 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f00c8da0 con 0x7f59f006df40 2024-04-18T04:56:43.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.840+0000 7f59efe00640 1 --2- 172.21.15.120:0/3908554021 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59f006df40 0x7f59f00c79c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f59e00097c0 tx=0x7f59e001ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5b773cd274ccbf7 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:43.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.840+0000 7f59eea00640 1 -- 172.21.15.120:0/3908554021 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59dc001680 con 0x7f59f006df40 2024-04-18T04:56:43.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.840+0000 7f59eea00640 1 -- 172.21.15.120:0/3908554021 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f59e00a85f0 con 0x7f59f006df40 2024-04-18T04:56:43.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.840+0000 7f59eea00640 1 -- 172.21.15.120:0/3908554021 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e00a8960 con 0x7f59f006df40 2024-04-18T04:56:43.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.840+0000 7f59f6e00640 1 -- 172.21.15.120:0/3908554021 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59f006df40 msgr2=0x7f59f00c79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:43.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.840+0000 7f59f6e00640 1 --2- 172.21.15.120:0/3908554021 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59f006df40 0x7f59f00c79c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f59e00097c0 tx=0x7f59e001ebb0 comp rx=0 tx=0).stop 2024-04-18T04:56:43.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.840+0000 7f59f6e00640 1 -- 172.21.15.120:0/3908554021 shutdown_connections 2024-04-18T04:56:43.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.840+0000 7f59f6e00640 1 --2- 172.21.15.120:0/3908554021 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59f0153c30 0x7f59f015a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:43.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.840+0000 7f59f6e00640 1 --2- 172.21.15.120:0/3908554021 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59f006df40 0x7f59f00c79c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:43.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.840+0000 7f59f6e00640 1 -- 172.21.15.120:0/3908554021 >> 172.21.15.120:0/3908554021 conn(0x7f59f006f660 msgr2=0x7f59f006fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:43.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.840+0000 7f59f6e00640 1 -- 172.21.15.120:0/3908554021 shutdown_connections 2024-04-18T04:56:43.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.840+0000 7f59f6e00640 1 -- 172.21.15.120:0/3908554021 wait complete. 2024-04-18T04:56:43.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.840+0000 7f59f6e00640 1 Processor -- start 2024-04-18T04:56:43.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.840+0000 7f59f6e00640 1 -- start start 2024-04-18T04:56:43.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.844+0000 7f59f6e00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59f006df40 0x7f59f0156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:43.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.844+0000 7f59f6e00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59f006e320 0x7f59f01f2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:43.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.844+0000 7f59f6e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59f0153c30 0x7f59f0146100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:43.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.844+0000 7f59f6e00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f00c7b70 con 0x7f59f0153c30 2024-04-18T04:56:43.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.844+0000 7f59f6e00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f01f0a30 con 0x7f59f006e320 2024-04-18T04:56:43.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.844+0000 7f59f6e00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f0147b20 con 0x7f59f006df40 2024-04-18T04:56:43.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.844+0000 7f59f4e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59f0153c30 0x7f59f0146100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:43.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.844+0000 7f59f4e00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59f0153c30 0x7f59f0146100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34340/0 (socket says 172.21.15.120:34340) 2024-04-18T04:56:43.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.844+0000 7f59f4e00640 1 -- 172.21.15.120:0/188080277 learned_addr learned my addr 172.21.15.120:0/188080277 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:56:43.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.844+0000 7f59ef400640 1 --2- 172.21.15.120:0/188080277 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59f006e320 0x7f59f01f2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:43.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.844+0000 7f59efe00640 1 --2- 172.21.15.120:0/188080277 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59f006df40 0x7f59f0156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:43.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.844+0000 7f59f4e00640 1 -- 172.21.15.120:0/188080277 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59f006df40 msgr2=0x7f59f0156760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:43.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.844+0000 7f59f4e00640 1 --2- 172.21.15.120:0/188080277 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59f006df40 0x7f59f0156760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:43.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.844+0000 7f59f4e00640 1 -- 172.21.15.120:0/188080277 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59f006e320 msgr2=0x7f59f01f2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:43.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.844+0000 7f59f4e00640 1 --2- 172.21.15.120:0/188080277 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59f006e320 0x7f59f01f2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:43.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.844+0000 7f59f4e00640 1 -- 172.21.15.120:0/188080277 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e0009420 con 0x7f59f0153c30 2024-04-18T04:56:43.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.844+0000 7f59ef400640 1 --2- 172.21.15.120:0/188080277 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59f006e320 0x7f59f01f2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:56:43.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.844+0000 7f59f4e00640 1 --2- 172.21.15.120:0/188080277 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59f0153c30 0x7f59f0146100 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f59e800efc0 tx=0x7f59e800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:43.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.844+0000 7f59e7e00640 1 -- 172.21.15.120:0/188080277 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e8009b20 con 0x7f59f0153c30 2024-04-18T04:56:43.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.844+0000 7f59e7e00640 1 -- 172.21.15.120:0/188080277 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f59e800f040 con 0x7f59f0153c30 2024-04-18T04:56:43.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.844+0000 7f59e7e00640 1 -- 172.21.15.120:0/188080277 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e80146e0 con 0x7f59f0153c30 2024-04-18T04:56:43.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.844+0000 7f59f6e00640 1 -- 172.21.15.120:0/188080277 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59f00c7da0 con 0x7f59f0153c30 2024-04-18T04:56:43.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.844+0000 7f59f6e00640 1 -- 172.21.15.120:0/188080277 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59f00cdcc0 con 0x7f59f0153c30 2024-04-18T04:56:43.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.844+0000 7f59f6e00640 1 -- 172.21.15.120:0/188080277 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59f0066df0 con 0x7f59f0153c30 2024-04-18T04:56:43.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.844+0000 7f59e7e00640 1 -- 172.21.15.120:0/188080277 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f59e8014840 con 0x7f59f0153c30 2024-04-18T04:56:43.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.848+0000 7f59e7e00640 1 --2- 172.21.15.120:0/188080277 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f59d0066690 0x7f59d0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:43.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.848+0000 7f59e7e00640 1 -- 172.21.15.120:0/188080277 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6827+0+0 (secure 0 0 0) 0x7f59e80853b0 con 0x7f59f0153c30 2024-04-18T04:56:43.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.848+0000 7f59efe00640 1 --2- 172.21.15.120:0/188080277 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f59d0066690 0x7f59d0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:43.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.848+0000 7f59efe00640 1 --2- 172.21.15.120:0/188080277 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f59d0066690 0x7f59d0068b50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f59e00b2000 tx=0x7f59e00aa070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:43.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:43.852+0000 7f59e7e00640 1 -- 172.21.15.120:0/188080277 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f59e80522c0 con 0x7f59f0153c30 2024-04-18T04:56:44.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.008+0000 7f59f6e00640 1 -- 172.21.15.120:0/188080277 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f59f0067070 con 0x7f59f0153c30 2024-04-18T04:56:44.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.660+0000 7f59e7e00640 1 -- 172.21.15.120:0/188080277 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v35) v1 ==== 169+0+0 (secure 0 0 0) 0x7f59e8009e60 con 0x7f59f0153c30 2024-04-18T04:56:44.664 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_data' removed 2024-04-18T04:56:44.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.668+0000 7f59f6e00640 1 -- 172.21.15.120:0/188080277 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f59d0066690 msgr2=0x7f59d0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:44.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.668+0000 7f59f6e00640 1 --2- 172.21.15.120:0/188080277 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f59d0066690 0x7f59d0068b50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f59e00b2000 tx=0x7f59e00aa070 comp rx=0 tx=0).stop 2024-04-18T04:56:44.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.668+0000 7f59f6e00640 1 -- 172.21.15.120:0/188080277 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59f0153c30 msgr2=0x7f59f0146100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:44.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.668+0000 7f59f6e00640 1 --2- 172.21.15.120:0/188080277 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59f0153c30 0x7f59f0146100 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f59e800efc0 tx=0x7f59e800c490 comp rx=0 tx=0).stop 2024-04-18T04:56:44.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.672+0000 7f59f6e00640 1 -- 172.21.15.120:0/188080277 shutdown_connections 2024-04-18T04:56:44.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.672+0000 7f59f6e00640 1 --2- 172.21.15.120:0/188080277 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f59d0066690 0x7f59d0068b50 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:44.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.672+0000 7f59f6e00640 1 --2- 172.21.15.120:0/188080277 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59f0153c30 0x7f59f0146100 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:44.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.672+0000 7f59f6e00640 1 --2- 172.21.15.120:0/188080277 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59f006e320 0x7f59f01f2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:44.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.672+0000 7f59f6e00640 1 --2- 172.21.15.120:0/188080277 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59f006df40 0x7f59f0156760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:44.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.672+0000 7f59f6e00640 1 -- 172.21.15.120:0/188080277 >> 172.21.15.120:0/188080277 conn(0x7f59f006f660 msgr2=0x7f59f0159730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:44.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.672+0000 7f59f6e00640 1 -- 172.21.15.120:0/188080277 shutdown_connections 2024-04-18T04:56:44.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.672+0000 7f59f6e00640 1 -- 172.21.15.120:0/188080277 wait complete. 2024-04-18T04:56:44.699 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-18T04:56:44.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.848+0000 7f6d69600640 1 Processor -- start 2024-04-18T04:56:44.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.848+0000 7f6d69600640 1 -- start start 2024-04-18T04:56:44.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.852+0000 7f6d69600640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6d64153c30 0x7f6d640c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:44.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.852+0000 7f6d69600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6d6406e320 0x7f6d6415a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:44.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.852+0000 7f6d69600640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d640c8890 con 0x7f6d6406df40 2024-04-18T04:56:44.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.852+0000 7f6d69600640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d6406ea80 con 0x7f6d64153c30 2024-04-18T04:56:44.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.852+0000 7f6d69600640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d640c8ac0 con 0x7f6d6406e320 2024-04-18T04:56:44.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.852+0000 7f6d62a00640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f6d6406df40 0x7f6d64153520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:33056/0 (socket says 172.21.15.120:33056) 2024-04-18T04:56:44.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.852+0000 7f6d62a00640 1 -- 172.21.15.120:0/3487160085 learned_addr learned my addr 172.21.15.120:0/3487160085 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-18T04:56:44.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.852+0000 7f6d62000640 1 --2- 172.21.15.120:0/3487160085 >> v2:172.21.15.120:3300/0 conn(0x7f6d64153c30 0x7f6d640c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:44.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.852+0000 7f6d63400640 1 --2- 172.21.15.120:0/3487160085 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6d6406e320 0x7f6d6415a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:44.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.852+0000 7f6d62000640 1 -- 172.21.15.120:0/3487160085 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6d6406e320 msgr2=0x7f6d6415a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T04:56:44.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.852+0000 7f6d62000640 1 --2- 172.21.15.120:0/3487160085 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6d6406e320 0x7f6d6415a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:44.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.852+0000 7f6d62000640 1 -- 172.21.15.120:0/3487160085 >> v1:172.21.15.120:6789/0 conn(0x7f6d6406df40 legacy=0x7f6d64153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:44.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.852+0000 7f6d62000640 1 -- 172.21.15.120:0/3487160085 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d640c8da0 con 0x7f6d64153c30 2024-04-18T04:56:44.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.852+0000 7f6d61600640 1 -- 172.21.15.120:0/3487160085 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3099237401 0 0) 0x7f6d640c8890 con 0x7f6d6406df40 2024-04-18T04:56:44.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.856+0000 7f6d62000640 1 --2- 172.21.15.120:0/3487160085 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d64153c30 0x7f6d640c79c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f6d500097c0 tx=0x7f6d5001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33577dc61ca76532 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:44.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.856+0000 7f6d61600640 1 -- 172.21.15.120:0/3487160085 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d500a8990 con 0x7f6d64153c30 2024-04-18T04:56:44.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.856+0000 7f6d61600640 1 -- 172.21.15.120:0/3487160085 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6d500a8af0 con 0x7f6d64153c30 2024-04-18T04:56:44.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.856+0000 7f6d61600640 1 -- 172.21.15.120:0/3487160085 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d500a8ea0 con 0x7f6d64153c30 2024-04-18T04:56:44.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.856+0000 7f6d69600640 1 -- 172.21.15.120:0/3487160085 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d64153c30 msgr2=0x7f6d640c79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:44.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.856+0000 7f6d69600640 1 --2- 172.21.15.120:0/3487160085 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d64153c30 0x7f6d640c79c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f6d500097c0 tx=0x7f6d5001ec90 comp rx=0 tx=0).stop 2024-04-18T04:56:44.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.856+0000 7f6d69600640 1 -- 172.21.15.120:0/3487160085 shutdown_connections 2024-04-18T04:56:44.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.856+0000 7f6d69600640 1 --2- 172.21.15.120:0/3487160085 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6d6406e320 0x7f6d6415a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:44.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.856+0000 7f6d69600640 1 --2- 172.21.15.120:0/3487160085 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d64153c30 0x7f6d640c79c0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:44.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.856+0000 7f6d69600640 1 -- 172.21.15.120:0/3487160085 >> 172.21.15.120:0/3487160085 conn(0x7f6d6406f660 msgr2=0x7f6d6406fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:44.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.856+0000 7f6d69600640 1 -- 172.21.15.120:0/3487160085 shutdown_connections 2024-04-18T04:56:44.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.856+0000 7f6d69600640 1 -- 172.21.15.120:0/3487160085 wait complete. 2024-04-18T04:56:44.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.856+0000 7f6d69600640 1 Processor -- start 2024-04-18T04:56:44.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.856+0000 7f6d69600640 1 -- start start 2024-04-18T04:56:44.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.856+0000 7f6d69600640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d6406df40 0x7f6d640cd120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:44.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.856+0000 7f6d69600640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6d6406e320 0x7f6d6414ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:44.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.856+0000 7f6d69600640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d64153c30 0x7f6d6414f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:44.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.856+0000 7f6d69600640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d641eee00 con 0x7f6d6406df40 2024-04-18T04:56:44.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.856+0000 7f6d69600640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6414da30 con 0x7f6d64153c30 2024-04-18T04:56:44.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.856+0000 7f6d69600640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d641ef0c0 con 0x7f6d6406e320 2024-04-18T04:56:44.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.856+0000 7f6d62a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d6406df40 0x7f6d640cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:44.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.856+0000 7f6d62a00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d6406df40 0x7f6d640cd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34356/0 (socket says 172.21.15.120:34356) 2024-04-18T04:56:44.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.856+0000 7f6d62a00640 1 -- 172.21.15.120:0/559260396 learned_addr learned my addr 172.21.15.120:0/559260396 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-18T04:56:44.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.860+0000 7f6d62000640 1 --2- 172.21.15.120:0/559260396 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6d6406e320 0x7f6d6414ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:44.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.860+0000 7f6d63400640 1 --2- 172.21.15.120:0/559260396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d64153c30 0x7f6d6414f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:44.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.860+0000 7f6d62a00640 1 -- 172.21.15.120:0/559260396 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6d6406e320 msgr2=0x7f6d6414ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:44.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.860+0000 7f6d62a00640 1 --2- 172.21.15.120:0/559260396 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6d6406e320 0x7f6d6414ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:44.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.860+0000 7f6d62a00640 1 -- 172.21.15.120:0/559260396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d64153c30 msgr2=0x7f6d6414f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:44.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.860+0000 7f6d62a00640 1 --2- 172.21.15.120:0/559260396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d64153c30 0x7f6d6414f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:44.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.860+0000 7f6d62a00640 1 -- 172.21.15.120:0/559260396 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d50009420 con 0x7f6d6406df40 2024-04-18T04:56:44.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.860+0000 7f6d62000640 1 --2- 172.21.15.120:0/559260396 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6d6406e320 0x7f6d6414ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T04:56:44.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.860+0000 7f6d62a00640 1 --2- 172.21.15.120:0/559260396 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d6406df40 0x7f6d640cd120 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f6d540011f0 tx=0x7f6d5400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:44.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.860+0000 7f6d5aa00640 1 -- 172.21.15.120:0/559260396 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d540074e0 con 0x7f6d6406df40 2024-04-18T04:56:44.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.860+0000 7f6d5aa00640 1 -- 172.21.15.120:0/559260396 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6d54007640 con 0x7f6d6406df40 2024-04-18T04:56:44.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.860+0000 7f6d69600640 1 -- 172.21.15.120:0/559260396 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d641ef3a0 con 0x7f6d6406df40 2024-04-18T04:56:44.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.860+0000 7f6d5aa00640 1 -- 172.21.15.120:0/559260396 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d54004a30 con 0x7f6d6406df40 2024-04-18T04:56:44.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.860+0000 7f6d69600640 1 -- 172.21.15.120:0/559260396 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d641ef960 con 0x7f6d6406df40 2024-04-18T04:56:44.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.860+0000 7f6d69600640 1 -- 172.21.15.120:0/559260396 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d64066df0 con 0x7f6d6406df40 2024-04-18T04:56:44.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.860+0000 7f6d5aa00640 1 -- 172.21.15.120:0/559260396 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6d54004b90 con 0x7f6d6406df40 2024-04-18T04:56:44.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.860+0000 7f6d5aa00640 1 --2- 172.21.15.120:0/559260396 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6d440666c0 0x7f6d44068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T04:56:44.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.860+0000 7f6d5aa00640 1 -- 172.21.15.120:0/559260396 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6297+0+0 (secure 0 0 0) 0x7f6d54083aa0 con 0x7f6d6406df40 2024-04-18T04:56:44.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.864+0000 7f6d62000640 1 --2- 172.21.15.120:0/559260396 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6d440666c0 0x7f6d44068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T04:56:44.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.864+0000 7f6d62000640 1 --2- 172.21.15.120:0/559260396 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6d440666c0 0x7f6d44068b80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6d500b2000 tx=0x7f6d50008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T04:56:44.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:44.868+0000 7f6d5aa00640 1 -- 172.21.15.120:0/559260396 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f6d54050a90 con 0x7f6d6406df40 2024-04-18T04:56:45.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:45.056+0000 7f6d69600640 1 -- 172.21.15.120:0/559260396 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6d64067070 con 0x7f6d6406df40 2024-04-18T04:56:45.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:45.672+0000 7f6d5aa00640 1 -- 172.21.15.120:0/559260396 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v36) v1 ==== 178+0+0 (secure 0 0 0) 0x7f6d54018070 con 0x7f6d6406df40 2024-04-18T04:56:45.670 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_data_ec' removed 2024-04-18T04:56:45.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:45.676+0000 7f6d69600640 1 -- 172.21.15.120:0/559260396 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6d440666c0 msgr2=0x7f6d44068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:45.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:45.676+0000 7f6d69600640 1 --2- 172.21.15.120:0/559260396 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6d440666c0 0x7f6d44068b80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6d500b2000 tx=0x7f6d50008040 comp rx=0 tx=0).stop 2024-04-18T04:56:45.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:45.676+0000 7f6d69600640 1 -- 172.21.15.120:0/559260396 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d6406df40 msgr2=0x7f6d640cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T04:56:45.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:45.676+0000 7f6d69600640 1 --2- 172.21.15.120:0/559260396 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d6406df40 0x7f6d640cd120 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f6d540011f0 tx=0x7f6d5400c9b0 comp rx=0 tx=0).stop 2024-04-18T04:56:45.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:45.680+0000 7f6d69600640 1 -- 172.21.15.120:0/559260396 shutdown_connections 2024-04-18T04:56:45.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:45.680+0000 7f6d69600640 1 --2- 172.21.15.120:0/559260396 >> [v2:172.21.15.132:6832/27788,v1:172.21.15.132:6833/27788] conn(0x7f6d440666c0 0x7f6d44068b80 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:45.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:45.680+0000 7f6d69600640 1 --2- 172.21.15.120:0/559260396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d64153c30 0x7f6d6414f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:45.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:45.680+0000 7f6d69600640 1 --2- 172.21.15.120:0/559260396 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6d6406e320 0x7f6d6414ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:45.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:45.680+0000 7f6d69600640 1 --2- 172.21.15.120:0/559260396 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d6406df40 0x7f6d640cd120 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T04:56:45.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:45.680+0000 7f6d69600640 1 -- 172.21.15.120:0/559260396 >> 172.21.15.120:0/559260396 conn(0x7f6d6406f660 msgr2=0x7f6d640c9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T04:56:45.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:45.684+0000 7f6d69600640 1 -- 172.21.15.120:0/559260396 shutdown_connections 2024-04-18T04:56:45.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-18T04:56:45.684+0000 7f6d69600640 1 -- 172.21.15.120:0/559260396 wait complete. 2024-04-18T04:56:45.771 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-18T04:56:45.771 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-18T04:56:45.771 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T04:56:45.813 INFO:tasks.ceph.mds.a:Stopped 2024-04-18T04:56:45.813 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-18T04:56:45.813 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T04:56:45.848 INFO:tasks.ceph.mds.c:Stopped 2024-04-18T04:56:45.849 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-04-18T04:56:45.849 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T04:56:45.908 INFO:tasks.ceph.mds.e:Stopped 2024-04-18T04:56:45.908 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-18T04:56:45.908 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T04:56:45.921 INFO:tasks.ceph.mds.b:Stopped 2024-04-18T04:56:45.922 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-18T04:56:45.922 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T04:56:45.974 INFO:tasks.ceph.mds.d:Stopped 2024-04-18T04:56:45.974 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-04-18T04:56:45.974 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T04:56:46.029 INFO:tasks.ceph.mds.f:Stopped 2024-04-18T04:56:46.029 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-18T04:56:46.030 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-18T04:56:46.030 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T04:56:50.228 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-04-18T04:56:52.131 INFO:tasks.ceph.osd.0:Stopped 2024-04-18T04:56:52.131 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-18T04:56:52.132 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T04:56:56.337 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-18T04:56:56.338 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-04-18T04:56:58.233 INFO:tasks.ceph.osd.1:Stopped 2024-04-18T04:56:58.234 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-18T04:56:58.234 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T04:57:02.346 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-04-18T04:57:02.346 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-18T04:57:04.335 INFO:tasks.ceph.osd.2:Stopped 2024-04-18T04:57:04.336 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-18T04:57:04.336 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T04:57:08.253 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-04-18T04:57:08.254 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-04-18T04:57:10.438 INFO:tasks.ceph.osd.3:Stopped 2024-04-18T04:57:10.438 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-18T04:57:10.438 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T04:57:10.526 INFO:tasks.ceph.osd.4:Stopped 2024-04-18T04:57:10.526 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-18T04:57:10.526 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T04:57:13.961 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-04-18T04:57:13.961 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-04-18T04:57:16.628 INFO:tasks.ceph.osd.5:Stopped 2024-04-18T04:57:16.628 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-18T04:57:16.628 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T04:57:19.566 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-04-18T04:57:19.567 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-04-18T04:57:22.730 INFO:tasks.ceph.osd.6:Stopped 2024-04-18T04:57:22.730 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-18T04:57:22.730 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T04:57:25.071 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-04-18T04:57:25.071 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-04-18T04:57:28.832 INFO:tasks.ceph.osd.7:Stopped 2024-04-18T04:57:28.833 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-18T04:57:28.833 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-18T04:57:28.833 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T04:57:28.883 INFO:tasks.ceph.mgr.y:Stopped 2024-04-18T04:57:28.884 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-18T04:57:28.884 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T04:57:28.914 INFO:tasks.ceph.mgr.x:Stopped 2024-04-18T04:57:28.914 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-18T04:57:28.914 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-18T04:57:28.914 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T04:57:30.274 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-04-18T04:57:30.274 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-04-18T04:57:35.016 INFO:tasks.ceph.mon.a:Stopped 2024-04-18T04:57:35.016 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-18T04:57:35.016 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T04:57:35.037 INFO:tasks.ceph.mon.b:Stopped 2024-04-18T04:57:35.037 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-18T04:57:35.037 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T04:57:35.097 INFO:tasks.ceph.mon.c:Stopped 2024-04-18T04:57:35.097 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-18T04:57:35.097 DEBUG:teuthology.orchestra.run.smithi120:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v 'Replacing daemon mds' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-04-18T04:57:35.214 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi120.front.sepia.ceph.com 2024-04-18T04:57:35.214 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-18T04:57:35.274 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-04-18T04:57:35.746 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi120.front.sepia.ceph.com 2024-04-18T04:57:35.747 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-18T04:57:36.092 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi120.front.sepia.ceph.com 2024-04-18T04:57:36.093 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-18T04:57:36.378 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi120.front.sepia.ceph.com 2024-04-18T04:57:36.379 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-18T04:57:36.697 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi132.front.sepia.ceph.com 2024-04-18T04:57:36.697 DEBUG:teuthology.orchestra.run.smithi132:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-18T04:57:37.023 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi132.front.sepia.ceph.com 2024-04-18T04:57:37.024 DEBUG:teuthology.orchestra.run.smithi132:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-18T04:57:37.224 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi132.front.sepia.ceph.com 2024-04-18T04:57:37.224 DEBUG:teuthology.orchestra.run.smithi132:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-18T04:57:37.416 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi132.front.sepia.ceph.com 2024-04-18T04:57:37.416 DEBUG:teuthology.orchestra.run.smithi132:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-18T04:57:37.584 INFO:tasks.ceph:Archiving mon data... 2024-04-18T04:57:37.586 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661522/data/mon.a.tgz 2024-04-18T04:57:37.586 DEBUG:teuthology.orchestra.run.smithi120:> mktemp 2024-04-18T04:57:37.612 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/tmp.FCIbqD75ZK 2024-04-18T04:57:37.613 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.FCIbqD75ZK 2024-04-18T04:57:37.794 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0666 /tmp/tmp.FCIbqD75ZK 2024-04-18T04:57:37.864 DEBUG:teuthology.orchestra.remote:smithi120:/tmp/tmp.FCIbqD75ZK is 356KB 2024-04-18T04:57:37.926 DEBUG:teuthology.orchestra.run.smithi120:> rm -fr /tmp/tmp.FCIbqD75ZK 2024-04-18T04:57:37.934 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661522/data/mon.b.tgz 2024-04-18T04:57:37.935 DEBUG:teuthology.orchestra.run.smithi132:> mktemp 2024-04-18T04:57:37.962 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.VIJFIOJr9v 2024-04-18T04:57:37.962 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.VIJFIOJr9v 2024-04-18T04:57:38.108 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0666 /tmp/tmp.VIJFIOJr9v 2024-04-18T04:57:38.202 DEBUG:teuthology.orchestra.remote:smithi132:/tmp/tmp.VIJFIOJr9v is 357KB 2024-04-18T04:57:38.264 DEBUG:teuthology.orchestra.run.smithi132:> rm -fr /tmp/tmp.VIJFIOJr9v 2024-04-18T04:57:38.270 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661522/data/mon.c.tgz 2024-04-18T04:57:38.271 DEBUG:teuthology.orchestra.run.smithi132:> mktemp 2024-04-18T04:57:38.318 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.0VmoD8aaWD 2024-04-18T04:57:38.318 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.0VmoD8aaWD 2024-04-18T04:57:38.450 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0666 /tmp/tmp.0VmoD8aaWD 2024-04-18T04:57:38.514 DEBUG:teuthology.orchestra.remote:smithi132:/tmp/tmp.0VmoD8aaWD is 357KB 2024-04-18T04:57:38.572 DEBUG:teuthology.orchestra.run.smithi132:> rm -fr /tmp/tmp.0VmoD8aaWD 2024-04-18T04:57:38.578 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-18T04:57:38.578 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-18T04:57:38.581 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-18T04:57:38.658 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-04-18T04:57:38.658 DEBUG:teuthology.orchestra.run.smithi120:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-18T04:57:38.661 DEBUG:teuthology.orchestra.run.smithi132:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-18T04:57:38.717 INFO:teuthology.orchestra.run.smithi132.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-18T04:57:38.731 INFO:teuthology.orchestra.run.smithi120.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-18T04:57:38.738 INFO:tasks.ceph:Archiving crash dumps... 2024-04-18T04:57:38.739 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661522/remote/smithi120/crash 2024-04-18T04:57:38.740 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-18T04:57:38.760 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661522/remote/smithi132/crash 2024-04-18T04:57:38.760 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-18T04:57:38.772 INFO:tasks.ceph:Shutting down logrotate 2024-04-18T04:57:56.702 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-18T04:57:56.722 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-18T04:57:56.757 INFO:tasks.ceph:Compressing logs... 2024-04-18T04:57:56.757 DEBUG:teuthology.orchestra.run.smithi120:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-18T04:57:56.767 DEBUG:teuthology.orchestra.run.smithi132:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-18T05:06:49.454 INFO:tasks.ceph:Archiving logs... 2024-04-18T05:06:49.456 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661522/remote/smithi120/log 2024-04-18T05:06:49.457 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-18T05:07:52.105 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661522/remote/smithi132/log 2024-04-18T05:07:52.107 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-18T05:08:45.229 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-18T05:08:45.240 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-18T05:08:45.240 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-18T05:08:45.244 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-18T05:08:45.347 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-18T05:08:45.359 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-18T05:08:45.359 DEBUG:teuthology.orchestra.run.smithi120:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-18T05:08:45.363 DEBUG:teuthology.orchestra.run.smithi132:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-18T05:08:45.402 INFO:teuthology.orchestra.run.smithi120.stdout: remote refid st t when poll reach delay offset jitter 2024-04-18T05:08:45.403 INFO:teuthology.orchestra.run.smithi120.stdout:============================================================================== 2024-04-18T05:08:45.403 INFO:teuthology.orchestra.run.smithi120.stdout:*hv01.front.sepi 67.205.162.81 3 u 39 64 377 0.075 -6.424 0.479 2024-04-18T05:08:45.403 INFO:teuthology.orchestra.run.smithi120.stdout:+hv02.front.sepi 63.231.80.2 3 u 39 64 377 0.097 -3.644 0.278 2024-04-18T05:08:45.403 INFO:teuthology.orchestra.run.smithi120.stdout:+hv03.front.sepi 74.6.168.72 3 u 45 64 377 0.092 -3.556 0.382 2024-04-18T05:08:45.403 INFO:teuthology.orchestra.run.smithi120.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-04-18T05:08:45.505 INFO:teuthology.orchestra.run.smithi132.stdout: remote refid st t when poll reach delay offset jitter 2024-04-18T05:08:45.506 INFO:teuthology.orchestra.run.smithi132.stdout:============================================================================== 2024-04-18T05:08:45.506 INFO:teuthology.orchestra.run.smithi132.stdout:+hv01.front.sepi 67.205.162.81 3 u 40 64 377 0.067 -9.117 1.101 2024-04-18T05:08:45.506 INFO:teuthology.orchestra.run.smithi132.stdout:*hv02.front.sepi 63.231.80.2 3 u 39 64 377 0.096 -6.450 1.210 2024-04-18T05:08:45.506 INFO:teuthology.orchestra.run.smithi132.stdout:+hv03.front.sepi 74.6.168.72 3 u 43 64 377 0.101 -7.481 0.996 2024-04-18T05:08:45.506 INFO:teuthology.orchestra.run.smithi132.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-04-18T05:08:45.507 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-18T05:08:45.517 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-18T05:08:45.517 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-18T05:08:45.526 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-18T05:08:45.550 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-18T05:08:45.559 INFO:teuthology.task.internal:Duration was 2143.506973 seconds 2024-04-18T05:08:45.560 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-18T05:08:45.569 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-18T05:08:45.569 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-18T05:08:45.572 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-18T05:08:45.933 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-18T05:08:45.933 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi120.front.sepia.ceph.com 2024-04-18T05:08:45.933 DEBUG:teuthology.orchestra.run.smithi120:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-18T05:08:45.955 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi132.front.sepia.ceph.com 2024-04-18T05:08:45.955 DEBUG:teuthology.orchestra.run.smithi132:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-18T05:08:45.966 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-18T05:08:45.966 DEBUG:teuthology.orchestra.run.smithi120:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-18T05:08:45.998 DEBUG:teuthology.orchestra.run.smithi132:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-18T05:08:46.060 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-18T05:08:46.061 DEBUG:teuthology.orchestra.run.smithi120:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-18T05:08:46.064 DEBUG:teuthology.orchestra.run.smithi132:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-18T05:08:46.210 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-18T05:08:46.221 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-18T05:08:46.221 DEBUG:teuthology.orchestra.run.smithi120:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-18T05:08:46.282 DEBUG:teuthology.orchestra.run.smithi132:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-18T05:08:46.312 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-18T05:08:46.323 DEBUG:teuthology.orchestra.run.smithi120:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-18T05:08:46.326 DEBUG:teuthology.orchestra.run.smithi132:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-18T05:08:46.381 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern = core 2024-04-18T05:08:46.382 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern = core 2024-04-18T05:08:46.416 DEBUG:teuthology.orchestra.run.smithi120:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-18T05:08:46.423 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T05:08:46.423 DEBUG:teuthology.orchestra.run.smithi132:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-18T05:08:46.462 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T05:08:46.462 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-18T05:08:46.473 INFO:teuthology.task.internal:Transferring archived files... 2024-04-18T05:08:46.474 DEBUG:teuthology.misc:Transferring archived files from smithi120:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661522/remote/smithi120 2024-04-18T05:08:46.474 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-18T05:08:46.501 DEBUG:teuthology.misc:Transferring archived files from smithi132:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661522/remote/smithi132 2024-04-18T05:08:46.501 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-18T05:08:46.527 INFO:teuthology.task.internal:Removing archive directory... 2024-04-18T05:08:46.527 DEBUG:teuthology.orchestra.run.smithi120:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-18T05:08:46.546 DEBUG:teuthology.orchestra.run.smithi132:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-18T05:08:46.571 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-18T05:08:46.583 INFO:teuthology.task.internal:Not uploading archives. 2024-04-18T05:08:46.583 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-18T05:08:46.593 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-18T05:08:46.593 DEBUG:teuthology.orchestra.run.smithi120:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-18T05:08:46.598 DEBUG:teuthology.orchestra.run.smithi132:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-18T05:08:46.603 INFO:teuthology.orchestra.run.smithi120.stdout: 658121 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 18 05:08 /home/ubuntu/cephtest 2024-04-18T05:08:46.619 INFO:teuthology.orchestra.run.smithi132.stdout: 524291 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 18 05:08 /home/ubuntu/cephtest 2024-04-18T05:08:46.621 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-18T05:08:46.631 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-18T05:08:46.665 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/ffsb}} duration: 2143.5069732666016 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-04-18T05:08:46.665 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T05:08:46.769 INFO:teuthology.run:pass